If Hamites were cursed, how could they be so numerous?

Genesis 10 gives their number as high as japhetites and semites combined. Also, Hamites were the first to colonize the globe and make inventions. It is interesting that in Genesis 9 Ham is blessed, but in Genesis 10 Canaan is cursed. Or does their curse lie in their religion (sacred prostitution, child sacrifice, withcraft)? I sometimes wander if Japhetites were ever as numerous as them