If your invitation says “and Guest,” then yes, if not, we would prefer if it was just you.
If your invitation says "and Family" or includes the child's names, then yes. If not, we would prefer only adults attend.