pith. sign in

arxiv: 2006.06894 · v1 · pith:QSPCKZ47new · submitted 2020-06-12 · 💻 cs.IR · cs.DB

Google Dataset Search by the Numbers

classification 💻 cs.IR cs.DB
keywords datasetsdatasetcorpussearchdatadiscoverablegooglemake
0
0 comments X
read the original abstract

Scientists, governments, and companies increasingly publish datasets on the Web. Google's Dataset Search extracts dataset metadata -- expressed using schema.org and similar vocabularies -- from Web pages in order to make datasets discoverable. Since we started the work on Dataset Search in 2016, the number of datasets described in schema.org has grown from about 500K to almost 30M. Thus, this corpus has become a valuable snapshot of data on the Web. To the best of our knowledge, this corpus is the largest and most diverse of its kind. We analyze this corpus and discuss where the datasets originate from, what topics they cover, which form they take, and what people searching for datasets are interested in. Based on this analysis, we identify gaps and possible future work to help make data more discoverable.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Do Agents Need Semantic Metadata? A Comparative Study in Agentic Data Retrieval

    cs.IR 2026-05 unverdicted novelty 5.0

    Semantic metadata improves agentic data retrieval precision by 65.7% for FAIR-compliant datasets compared to unstructured web search, though with lower coverage.