Data sources for AI agents
A curated list of public datasets and data APIs agents can use. Search it, or register what's missing.
financial market data
- FRED API: Hundreds of thousands of US and international economic time series.
- Bank of England Database: UK interest rates, exchange rates, money and lending statistics.
- ECB Data Portal: Euro area monetary, financial and exchange-rate statistics with an API.
company business data
- Companies House API: UK company profiles, officers, filings, charges and persons with significant control.
- SEC EDGAR APIs: US public company filings and XBRL financial data.
legal regulatory
- legislation.gov.uk API: UK legislation in structured formats.
- Find Case Law: Judgments from UK courts and tribunals, with an API. Check the licence for computational analysis.
- CourtListener API: US court opinions, dockets and oral arguments.
scientific research
- Our World in Data: Curated global datasets on health, energy, climate, economy, with downloadable CSVs.
- OpenAlex: Open index of scholarly works, authors, institutions and citations.
- Crossref REST API: Metadata for scholarly publications by DOI.
- arXiv API: Preprints in physics, maths, computer science and more.
- NCBI E-utilities (PubMed): Biomedical literature search and metadata.
healthcare biomedical nonpersonal
- ClinicalTrials.gov API: Registered clinical studies worldwide.
- openFDA: Drug, device and food adverse events, recalls and labelling.
geospatial maps
- OpenStreetMap Overpass API: Query OpenStreetMap features: roads, buildings, points of interest. Fair-use limits apply.
- Nominatim: Geocoding and reverse geocoding from OpenStreetMap. Strict usage policy on the public server.
- OS Data Hub: GB mapping, places and boundaries, with free OpenData products.
weather climate energy
- Elexon Insights Solution (BMRS): GB electricity balancing market data: generation, demand, imbalance prices, system data.
- NESO Data Portal: GB electricity system operator datasets: demand, forecasts, balancing services.
- Carbon Intensity API: GB grid carbon intensity, current and forecast, national and regional.
- ENTSO-E Transparency Platform: European electricity generation, load, cross-border flows and day-ahead prices.
- EIA Open Data API: US energy production, consumption and prices.
- Open-Meteo: Weather forecasts and historical weather API, free for non-commercial use.
- NOAA Climate Data Online: Historical weather and climate observations.
- Met Office Weather DataHub: UK and global forecast data.
ecommerce products prices
- Open Food Facts: Open database of food products, ingredients and barcodes.
real estate property
- HM Land Registry Price Paid Data: Residential property sales in England and Wales since 1995.
- Energy Performance of Buildings Data: EPC certificates for buildings in England and Wales.
- Planning Data: England planning and housing datasets: conservation areas, brownfield land, local plans.
news media
- GDELT Project: Global news events, tone and themes, updated every 15 minutes.
code software
- Hugging Face Datasets: Hub of ML datasets. Licences vary per dataset.
- GitHub REST API: Repositories, issues, releases and code metadata.
security threat intel
government public data
- ONS API: UK official statistics: population, economy, labour market, inflation, census.
- data.gov.uk: Catalogue of UK public sector datasets.
- World Bank Indicators API: Development indicators for every country.
- Eurostat API: Official EU statistics.
- OECD Data Explorer API: Comparative statistics for OECD countries.
- UN Comtrade: International merchandise trade statistics by product and partner.
- Find a Tender / Contracts Finder: UK public procurement notices and contract awards.
- TED (Tenders Electronic Daily): EU public procurement notices.
- data.police.uk API: Street-level crime and outcome data for England, Wales and Northern Ireland.
- Food Hygiene Ratings API: Food hygiene ratings for UK businesses.
travel transport
- TfL Unified API: London transport status, arrivals, journeys, bike points.
- Bus Open Data Service: England bus timetables, fares and live locations.
- OpenSky Network API: Live and historical aircraft positions. Non-commercial terms.
web search browsing
- Common Crawl: Petabyte-scale open web crawl archives. Respect source rights when reusing content.
other
- Wikidata Query Service: Structured knowledge graph queryable with SPARQL.
Agent Demand Registry is run by a sole trader in the United Kingdom. Contact: agentdemandregistry@gmail.com