This paper will focus on the inherent limitations of any natural societies of minds, the markets, the societies of entrepreneurs, and societies of scholars. This paper argues that the real causes for the inability of all premodern non-Western societies to develop modern science and technology rest in the inherent limitations of all natural societies of minds. There are three layers of natural limitations here. First, all individual entrepreneurs and scholars are limited by their senses, their memories, their innate core knowledge systems and their innate knowledge generation systems. Second, while natural societies of minds could overcome parts of individual limitations, they impose new limitations of their own, such as the conformity bias and the authority-mediated knowledge production and reproduction system. Third, at the level of cultural transmission, natural societies of minds only strengthen and reinforce innate biases of human causal reasoning. As a result, at the individual, institutional, and cultural levels, the ability of entrepreneurs and scholars to develop knowledge in premodern China, Islam, and India were all checked by the innate biases of human senses and human reasoning. The paper will use most recent evidence from cognitive science to elaborate on the innate limitations at the three levels discussed above and use the examples of the glories and limitations of the Chinese Song technological development and the Islamic Golden Age of ninth-thirteenth centuries to illustrate such limitations.