Should I refinance 53k , trying to pay off

I have about 53k in student loan . my goal is to pay off as fast as possible . currently paying about 3k a month . However my interest rate is 7.35 . It looks like I can refinance for about 4.36 . However it seems that calculators I’ve done said I only will save about $1500-3000 given how fast I am going to pay it off . I also plan to out some lunp sum payments of 2-10k at some point . My concern with refinancing before was missing out on some hardship and non interest payment like he had during Covid . With this administration I don’t see that ever happening . My new concern now is refinancing my lower my credit score some with me looking to rent a new place in maybe 4-5 months and buy second house in 1-2 years .

Right now I’m still on Save I haven’t switched to a plan because I’m not looking for forgiveness .