Help for Publishers

In order for our crawler to correctly gather your content, each article needs to link to a page dedicated solely to that article. Pages that display an article's full text need to have a unique URL, and that URL needs to be a link available on one of your site's main news pages.

Our automated crawler is currently best able to crawl regular text HTML links. We’re unable to crawl image links or links embedded in JavaScript. We're also unable to crawl articles in formats other than HTML, such as .pdfs.