Check out the promenade, maybe explore some random museums, and, when in Maryland, eat crabs.
From this list, Maggie recommends the Inner Harbor, the National Aquarium, and checking out an Orioles game. Also the Walters and Baltimore Museum of Art. Not on this list, but easily google-able, the Charles Theater.
Enjoy your meal surrounded by weird objects. Order a milkshake.