For many its the Roman empire or the Greeks. Similarly ancient Egypt. Or the British empire. Maybe the Japanese, Chinese and Norse as the next 3.
I have deliberately not mentioned time periods there.
These are the most commonly beloved. What are your favourites and why?
I get the desire to move backwards in time. That goes for me too, to a lesser extent than you though.
Another useful way that I think might help you is to just see what else is happening in the world in that time period. That helps you create an anchor just as knowing what cones after does.