Utrecht and Leiden come to mind for The Netherlands. Sure, there is tourism, but not even close to the number in Amsterdam, and both cities also have beautiful canals and other sightseeing spots.

As for outside of NL, Cahor in France is also beautiful, both the city itself and the surrounding area. Great for hikes!