Can one spouse take a child across state lines without the other spouse's permission?

I want to visit my parents with my child, but my husband is very overbearing. If I go visit my parents (across state lines) without telling him, I fear he might call the police. Am I doing anything illegal?