Should I pay my tax… (WHV)

I moved to AUS in January and starting working part time freelance at a company through my ABN (I started working there in February)

It’s May now and I’m planning on go home at the start of June. I’ve been putting money aside to pay my taxes but what will happen if I don’t pay the taxes?

I only worked there 3 days a week for about 8-10 weeks so I only owe about $2,000 I think.

Any advice whether it’s worth paying and what would happen if I don’t?