Working for a NJ office but living in VA

I’m confused about taxes and how much should be withheld.
I work in NJ, but my job is mostly remote and I live in VA (my husband is in the military). I travel to NJ when I need to, so some days are in NJ and I have a NJ address as it’s where I’m from.
Taxes are currently being taken from NJ.
What else should I be doing to make sure I don’t have a $20k tax bill 🫣