Google Cloud Introduces Open Knowledge Format

Google Cloud is introducing the Open Knowledge Format (OKF), a new specification that standardizes knowledge as Markdown files, making it portable across systems. This development aims to address the issue of fragmented knowledge that slows down AI agents. By providing a standardized format, OKF enables seamless interaction between AI agents and various knowledge sources.

The Problem of Fragmented Knowledge

Most organizations face the challenge of scattered knowledge across metadata catalogs, wikis, code comments, notebook cells, and individual engineers' expertise. When an AI agent needs to access specific information, it has to piece together fragments from these disparate sources. According to Google Cloud, every agent developer currently solves this context problem from scratch, resulting in custom-built solutions that are not designed to work with other systems.

The Open Knowledge Format (OKF) Specification

OKF v0.1 represents knowledge as a directory of Markdown files with YAML frontmatter, containing a minimal set of required and optional fields. The spec includes one required field ("type") and a handful of optional fields like title, description, resource, tags, and timestamps, plus a Markdown body for additional information. Concepts link to each other through standard Markdown links, forming a knowledge graph. This format allows OKF bundles to be readable in any editor, rendered on GitHub, and indexed by any search tool.

Built for Portability and Minimalism

OKF is designed to be minimal and portable, requiring only one field ("type"). The specification does not impose any specific structure or extra fields, allowing producers and consumers to be decoupled. This means that a bundle written by humans can be consumed by an AI agent, and a machine-generated bundle can be viewed in a visualizer. OKF works with any cloud provider, database, or agent framework, providing a high degree of flexibility.

Reference Implementations and Integration

Google Cloud is shipping several reference implementations alongside the OKF specification, including an enrichment agent that crawls BigQuery datasets and creates an OKF document for each table, a static HTML visualizer, and three sample bundles for GA4 e-commerce, Stack Overflow, and Bitcoin datasets. Additionally, Google Cloud has updated its Knowledge Catalog to ingest OKF and serve it to agents, with the spec and code available on GitHub.

Key Takeaways