What barriers exist to naturally prevent white-collar offshoring?

Given the extreme rise in remote work since COVID, workers from English-speaking countries like the Philippines or India have evidently been more commonly replacing some white collar work, often under the guise of AI.

There are so many anecdotes of teams within tech, IT, or other roles that tend to be remote being entirely replaced with foreign workers, paid 1/5 or less of the standard U.S. salary for somewhat comparable work.

Obviously there are H-1B restrictions, but this seems to be an entirely different issue of accessibility now, where there are enough resources out there that ample qualified people in these countries can learn the relevant higher tier skills and work for U.S. companies.

Historically, we didn't have this much accessibility, and H-1B visas were the biggest concern, as work had to be done in person.

Now, time zone, cultural, and even quality barriers don't seem to be an issue. If this continues, will we see any legislation specifically addressing this? Could there be viable incentives for companies prioritizing U.S. head-counts?

I'd love for there to be some major factors I'm overlooking that make the problem not quite so alarming.