Plex has a feature that can index multiple episodes of a show from a single file. Shuffling that show will then do what you described.

I don’t recall the specifics, but I think I had to specify that there were multiple episodes in each file via the Web UI to get it to work, so it might be a manual process.