Tarrytown has a great little area right off the Hudson that has boutique stores, restaurants and bars. There’s even a nice walking path that follows the Hudson River
Depending on your length of stay, you can catch the metro north train line down into Manhattan NY