Aylesbury was founded in Saxon times but you'll be hard pushed to find any traces of those times.
Worth exploring is the Georgian area of the town, which includes a church and the relatively new Roald Dahl Children's Gallery.
Built with lottery money, it uses Roald Dahl's hugely entertaining children's stories (like James and Giant Peach or Charlie and the Chocolate Factory) to introduce knowledge to youngsters. It's a highly original way of showing learning doesn't need to be boring.