Why don’t all countries try to become tax havens?

I read about tax havens. Basically sounds like a cheat code to make that country rich. So why don't all countries do this?