If your invitation says “and Guest,” then yes, if not, we would prefer if it was just you.
Casual, please. But we want you to feel comfortable, so if those shoes are too high or that top button is too tight, let it all hang loose.