Does having too much SME hurt the productivity of a country?

I’ve heard that one reason Japan’s productivity is low is the high proportion of SMEs among all companies. Is this true?