Apple has revealed that it is using ‘Applebot’ to crawl the web for Siri and Spotlight Suggestions in a newly modified support document.Applebot respects customary robots.txt rules and robots meta tags and originates in the 17.0.0.0 net block.It’s user-agent strings will contain “Applebot” together with additional agent information. Share Article:Facebook,   Twitter,   LinkedIn,   Google Plus,   Email,   Reddit,   Digg,   Delicious,   StumbleUponFollow iClarified:Facebook,   Twitter,   LinkedIn,   Google Plus,   Newsletter,   App Store,   YouTubeAdvertise Here

Source: iClarified Read More: Apple is Using 'Applebot' to Crawl the Web for Siri and Spotlight