Hotel
If you want to stay close to the wedding venue, the East Norwich Inn is close by and affordable. There are many options in the city and it is possible to take the train into Long Island just for the day. There are also several Airbnb's in Oyster Bay, and smaller nicer boutique B&Bs you can look for.