The future of the web is spiders.