Stupid question about switching renters insurance

So I told my broker I wanna change my renters back to the company I was using before. I switched it to his (i use him for auto) last year and it increased in price by about $50-60 and my coverages were less and my deductible went up. I basically locked in switching it so I said ah whatever ill change it back later. I just told him I wanna cancel it and he gave me some story about a lady who switches companies often, how it looks bad. But like, I want more coverage (and adding optional ones) and im kinda sick of paying more for less, even with these discounts im getting.

Would it really be all that bad to change ONLY my renters to a different company???? I want better coverage and i dont want to pay an extra 80$ over what I could be. That will go into getting better auto coverage :/ if it matters ive only needed renters insurance for 2 years, going on 3. Never switched my auto since getting it too