Skip to content

Tag Archives: crawler

The “Deep Web”

Today I noticed an article in the New York Times about “The Deep Web”. It isn’t some kind of Sci-Fi fantasy but a term to describe the data “hidden” inside web sites. Think of it as crawling the data inside an airport’s front page.
It isn’t completely “undiscovered”. Google has some projects to address this; Google [...]