In the beginning search engines indexed each site individually.

 

The web grew and searches often resulted in irrelevant results.  Something was needed to organize the results for better indexing.

But the web was already organized.