Skip to content

bblocks-datacommons-tools

Tools to manage and load data for custom Data Commons instances

GitHub Repo GitHub License PyPI - Version Codecov

The bblocks-datacommons_tools package simplifies the process of preparing and loading data to custom Data Commons instances. It provides utilities for building and editing configuration, metadata, and data files, and automating the data load pipeline.

Data Commons is a Google initiative that brings together public data from a wide range of sources into a unified knowledge graph, making it easier to explore and analyze information across domains. Organisations can create custom instances of Data Commons to host their own datasets, integrate them into the graph, and build tailored tools on top of the platform.

Custom instances allow you to take advantage of core features such as natural language search and interactive visualisations, while combining your own data with everything available in the base Data Commons.

bblocks-datacommons_tools is designed to simplify and automate steps to build your custom instance—removing much of the manual work involved in formatting and loading data, and helping you get your custom knowledge graph up and running quickly.

Key features

  • Build and edit config.json files programmatically
  • Generate MCF files from simple metadata
  • Upload CSV, MCF, and config files to Google Cloud Storage
  • Trigger the data load job and redeploy your custom instance
  • Use as a Python module or from the command line

Ready to get started using bblocks-datacommons-tools?
Read Getting started ↗.

Want to learn more about Data Commons?
Read the official Custom Data Commons documentation ↗.