Anything you need last minute? Not only is this close, but most of the stores are outlet brands to save you an extra buck!
The most easternmost point of Long Island, this lighthouse was the first one built in New York state and houses a museum and walkable beach front and other nature reserves in the area. Would recommend booking in advance if you choose to do a museum tour, but walking around is at no cost except possible parking.