This is the place to go for music. Stay off of Bourbon Street (unless you're really in the mood for wasted frat boys throwing up on your shoes). Instead, go check out the stretch of Frenchmen Street between Decatur and Dauphine. These few blocks are jam packed with clubs and venues, as well as the Night Market, and frequently bands playing in the street.
I don't often recommend a specific place for food, because good food is so plentiful in New Orleans, but the jambalya at Coop's is truly a cut above. Go for the rabbit and gator if you're feeling especially adventurous.
Get a frozen Irish coffee and thank me later.
It's touristy, but a chicory cafe au lait with fresh, hot beignets is a truly delicious treat.
Royal Street is full of art galleries, cute shops, and street performers. Some of the best musicians can be found posted up on Royal. Have a stroll, check out some art, and remember to tip the musicians.
Hop in a carriage and kick back while taking in the history and the architecture. Some of the tour guides are more historically accurate than others, but all can be relied on to spin a good yarn. Plus, Jackson Square is usually full of local artists, tarot readers, and musicians.