If you want to head to Ely - try going on the second or forth Saturday of the month when the farmer's markets are there. It's quite a decent market too (much better than the Cambridge market). Along the River Ouse, Ely is a cathedral town, so there plenty to look at including a nice walk from the cathedral to the river. Along the river there are a few lovely places to eat - but not too many that I've eaten at so can't really recommend. If you want to head into Cambridgeshire, I would suggest going to Granchester which is more of a village. It's about 3 miles from Cambridge and quite small. Food wise, if you're looking for afternoon tea, try The Orchard or for a quaint pub experience try the Green Man which has, I think, more of the feeling that you're looking for. Let us know where you head!