There are a couple companies that do 90-minute boat tours of the Chicago River and talk about the architecture. These are fun and May will probably be a great time to be on the water.
Highly recommend Chicago beaches if it's hot that weekend. Bring a swimsuit.
There are cute neighborhood shops up and down Clark Street in Andersonville.