I'm a big fan of the Old School Records in Forest Park (end of the Blue Line and about a 6 block walk). The owners are super friendly, very fair prices, well stocked cheapo bin, dirt cheap 45s.
I've only stopped by once, but a place called Kstarke Records just opened up at 1109 N. Western...