Documentation

Data licence and bulk access

Shorted publishes official ASIC short position data for every ASX stock, who holds those stocks, Australian house prices and economic series. All of it is available at volume without crawling the site.

If a crawler sent you here

Your user agent is on the list below. Those agents are redirected to this page at the edge and asked not to crawl in robots.txt, because they either serve no readers of this site or were measured fetching the same pages thousands of times a day. Nothing else on the site answers them.

  • Baiduspider
  • Bytespider
  • PetalBot
  • MJ12bot
  • SemrushBot
  • AhrefsBot
  • DotBot
  • DataForSeoBot
  • Reflectionbot
  • ShapBot

If you operate one of them and want the data, use a route below. If you think the listing is a mistake, write to support@shorted.com.au with the agent name and what it is for.

Getting the data

  • The API

    Every dataset on the site, as JSON over HTTPS, with a key. Free keys have a monthly quota; paid plans raise it. Rate limits and quotas are published on the docs and enforced as published.

  • The MCP server

    The same data as tools for Claude, ChatGPT and any Model Context Protocol client. Add the URL and the client does the rest: no key to paste, and signing in raises the limits.

  • Open data

    Bulk downloads of the ASIC short position series and the other public datasets, with their sources, update cadence and attribution line.

  • The feed

    RSS for the reports, the blog and the news desk, so a reader does not need to poll pages.

Licence

The underlying figures come from public sources: ASIC short position reports, ASX announcements, ABS and RBA statistics, state valuer-general sales and the federal registers of interests. Each dataset names its source and its update cadence on the open data page. What Shorted adds (the enrichment, the derived series, the reports and the editorial) is published under the terms of use. Reuse of the data needs attribution to Shorted.com.au and the original source; the open data page gives the line to use.

AI systems may read and cite the public pages: the robots.txt Content-Signal says so, and the crawl rules name the sections they may read and ask for a five second delay between fetches. Training on the site and bulk extraction go through the API or the open data downloads, not the HTML.

Crawl policy

  • Search engines may crawl every public page. The RPC endpoints, the private pages and the parameterised views are disallowed because nothing there can be indexed.
  • AI crawlers may read the listed content sections with a Crawl-delay of five seconds. Verified AI crawlers are also rate limited at the edge, per address.
  • The agents named above are steered here. A crawler that ignores robots.txt is redirected before it reaches the site.
  • The machine-readable statements are robots.txt, ai.txt and llms.txt.