You kinda pooh-pooh'd it last week, but I'm down with the doom 'n' gloom crowd that thinks that if this were to actually start happening, when a critical mass of folks was reached, the only obvious end result would be that robots.txt simply gets ignored. I hope we never get there.
posted by CRZ at 2009-11-16 14:41:40 ![]()
If a site were excluded, I'm sure someone COULD make a fair use case too, but I don't think that will happen. I think it would just be horrible PR.
posted by Rex at 2009-11-16 14:47:34 ![]()
robots.txt can never be ignored i hope we do never get there
posted by vic at 2009-11-17 15:21:46 ![]()
People have to remember exactly what being at the top of the search market game actually means. The most commonly searched word on Yahoo is overwhelmingly "Google."<br /><br /> <br /><br /> Unless they were being paid very handsomely for it, I can't imagine it would be worth it for Fox to decrease their traffic by at least 40%. But let's say that does happen and Bing does pay handsomely - does that also correlate with a algorithmic boost that automatically promotes Fox content? <br /><br /> <br /><br /> The only people who would benefit from Fox-heavy search results probably already have Fox as their startup page. It's a balancing act that doesn't really seem all that beneficial to either party.
posted by Carlos at 2009-11-19 12:13:35 ![]()

