This is probably the most classic place to visit in Charleston! You can walk around all over downtown while you visit! Eva suggests going to Tinto y Crema for gelato and the Cathedral of St. John the Baptist while you're there!
To avoid the Beach Traffic on the way to Mass you can become the Beach traffic that morning! Feel free to go to the beach Friday or Saturday morning! As long as you bring a change of clothes for Mass :)