Feedsearch provides a simple API for searching websites for RSS, Atom, and JSON feeds.

The long-term goal of Feedsearch is to provide a comprehensive, publicly accessible repository of feed information by saving the location and metadata of all crawled feeds.

Feeds for Ars Technica

API Usage

Make a GET request to https://feedsearch.dev/api/v1/search with a "url" value in the querystring containing the URL you'd like to search:

curl -X GET "https://feedsearch.dev/api/v1/search?url=arstechnica.com"
  • When the scheme (e.g. "https://") is not provided in the "url" value, the scheme will default to "http://".
  • A request URL that contains only the domain and no path (e.g. "http://example.com" or "example.com") will always return all previously found feeds associated with that domain.
  • A request URL that contains a path (e.g. "https://example.com/test", or "example.com/rss.xml" ) will return only those feeds found from that particular crawl.
  • An individual feed can be crawled by passing in the full URL to that feed. If you know the specific location of a feed, but that feed doesn't appear in the results for a domain, then please query the feed's specific URL. The API will associate the feed with its root domain, and will then return the feed upon subsequent queries for that domain.

Query Parameters

The Feedsearch API accepts the following query parameters:

  • url: The URL to search. Will return 400 Bad Request if not sent.
  • info: Returns all feed metadata as below. Defaults True. If False, only found URLs are returned, and all other values will be empty or default.
  • favicon: Returns the favicon as a Data Uri. Defaults False.
  • skip_crawl: By default, the queried URL will be crawled if it has not been crawled in the past week. Set this value to True if you wish to always skip the crawl and return only saved feeds. Defaults False.
  • opml: Return the feeds as an OPML XML string. Defaults False.
curl "https://feedsearch.dev/api/v1/search?url=arstechnica.com&info=true&favicon=false&opml=false&skip_crawl=false"

API Response

The Feedsearch API returns a list of found feeds in JSON format, with attached metadata about the feed.

  • bozo: Set to 1 when feed data is not well formed or may not be a feed. Defaults 0.
  • content_length: Length of the feed in bytes.
  • content_type: Content-Type/Media-Type value of the returned feed.
  • description: Feed description.
  • favicon: URL of feed or site Favicon
  • favicon_data_uri: Data Uri of the Favicon.
  • hubs: List of Websub hubs for the feed if available.
  • is_podcast: True if the feed contains valid podcast elements and enclosures.
  • is_push: True if the feed contains valid Websub data.
  • item_count: Number of items in the feed.
  • last_seen: Date that the feed was last seen by the crawler.
  • last_updated: Date of the latest entry in the feed, at the time the feed was last crawled.
  • score: Computed relevance of feed url value to requested search URL. May be safely ignored.
  • self_url: The rel="self" value returned from feed links. May be different from feed url.
  • site_name: Name of the feed's website.
  • site_url: URL of the feed's website.
  • title: Feed Title.
  • url: URL link to the feed.
  • velocity: A calculation of the mean number of items per day at the time the feed was fetched.
  • version: Detected feed type version (e.g. "rs