Yes, bring all of your children!
Just Sunday church type attire as it's a simple wedding! Doesn't have to be anything super super fancy.