To better compare a folder's size with its number of files, sort the folders by name.
You can choose the sort mode in the View menu.