Living in the US while owning a business in CAN?

My husband and I are both Canadian, living in the states under his H1B work visa. As a spouse on his visa I am not, as I understand it, allowed to work in the states. I travel back to Canada frequently to visit family.

My question is, if I wish to start my own business, is there any way this would be possible? Could I legally "base" my business out of Canada, while working and living mainly in the US? My business would be a garment manufacturing company, so it would need a physical office and eventually a couple of employees in the US.

Regrdless of where the "base" is, you would be working for yourself in US, which is illegal under anything but E visa -- ceetainly not H4.
So there would be no pint setting up the business office in canada if all work was gointg to be done in US.

E Visa requires muco investment and job creation. See an immigrtaion site for more info.