There is so much info on the net we are missing :(

subtotal said:

Yes and in 300 years time google is still going to be using the exact same computers...
yeah right!

the volume of information on the net is always going to keep expanding, but if you think google isn't going to expand their capacity then i want to know what you're smoking, odds are google is never going to completely catch up.

and i can think of 2 main reasons for this.
1: there are and will always be companies or people who don't want their websites listed by google, it could be that the websites are of questionable legality, or just information that is private.
2: financial feasability, can you imagine what it would cost to index the entire internet? and how much would it really be worth to google if they did manage it? in all likely hood the value to google would be dwarfwed by the cost the way an ant is dwarfed by an elephant

Click to expand...

Lionsault_100 said:

most of what you're missing is porn.. i mean the really specialized stuff that you dont see.. some of this stuff will never make you want to eat pizza again.

Click to expand...

Google's mission is to organize the world's information and make it universally accessible and useful.

Click to expand...

Well, first off there is plenty of information already out there, so we might as well index and organize it. At this point in time, the internet looks to be the mose universally accessible form of media so let's make it accessible through that. But it's not usefull just throwing it out there, so let's make people describe what there looking for, and then we'll return results based on that. That would be useful wouldn't it?

The internet is easily accessible, so lets start there. We'll make a web crawler to visit pages and gather information. Easy enough.

What? You mean people like the idea of searching the world and coming up with useful information. Hmm. We'll I wonder if we can make some money off it. Research grants aren't going to pay the bills forever. Maybe we can display ads based on what they searched for.

Well, we're doing great so far. I guess we need to get on the other forms of information out there now. The next biggest source is books I guess. We need to scan every book out there and put it in a useful form. The internet would work. While we're at it, we need to do video and sound as well.

We'll thats going good and we're still making money so let's get all the other information. Archives, scrolls, etc. We'll put that on the internet as well for people to access.

WHOA! I forgot a major part! People are creating new information all the time, how are we going to get all that information? I guess we could just keep searching. But wait, what if all the new information came through us anyway? Then we would have it there for us to analyse. Hmm, we'll try this. Let's start small. Email will work. We'll make an email service that people will use to send their information through us. But what will make people come to us opposed to all the other email services. We'll what else...we'll be BIGGER. We'll offer 10 times the amount of space the others have.

Wow, that email thing went well. It also gave us alot of publicity. Lets try something else. Blogs seem to be popular, lets make a blogging service for people to use. Then we'll have that information for us to use.

Man we're going now! Look at all this information. But since we're using the internet all this information is taking up alot of bandwidth. Since we're going to index all the worlds information, I think we'll need basically our own internet to transfer all this data between ourselves to process. We better get working on that. Isn't there alot of dark fibre laying around?

We'll most of the newly created information comes through us, so we should be set for a while. We've got to catch up on the processing of the data. But what do we do when China, India, and eventually Africa come up to age. We need that information. We'll if they follow the footsteps of the West, they will probably join the net and have computers. But that will take a while for them to build that infrastructure. Why don't we give it to them. Then all their information will come through us. They love us because we gave it to them, and we get there information. Plus there won't be so many people hesitant about us accessing their information like there is now.

Click to expand...

9mmCensor said:

Google needs moar power.

Google Distributed Index Project anyone?

Click to expand...

He said that there was approximately five million terabytes of information on the web. Google has only managed to index about 170 terabytes of it.

Click to expand...

mage_x said:

i think i read somewhere that porn sites amount to like 70% of all websites on the internet, or some other really high number.

Click to expand...