Question on Tariffs

Is it really so bad to support tariffs because of human rights violations and not for protectionism at home? Here’s my extreme case argument, if my society has deemed slavery evil and illegal than why should we allow free trade with a country with slavery? Imagine the Northern and Southern states remained split and as separate nations. Shouldn’t the North cease all trade with the South because everything they manufacture is potentially made with slave labor? Now fast-forward that argument to the present day. Maybe the other country isn’t using “slave” labor but their doing something more similar to feudalism. Shouldn’t our response be heavy tariffs?

FYI, I do NOT support tariffs for ‘America First’ protectionist policies. If your business can’t compete with a foreign business without government help, you should go out of business.