How to Turn on encoded Subtitles in iTunes

If subtitles are not on by default, click on the Caption bubble, next click on Subtitles and choose English (or the name of the language your subtitles track is on):

Two pictures of the iTunes player, highlighting the Caption bubble and the Subtitles menu