Cortex Framework extensibility guide

Google Cloud Cortex Framework provides data product accelerators for advanced analytics and AI. This documentation explains how to customize and extend Cortex Framework and is organized by three key steps:

  1. Custom namespace setup: To package and isolate custom modules inside a dedicated environment.
  2. Data foundation module creation: To add tables to the data foundation module.
  3. Data product module creation: To create new data products with your own SQLX or JS files.

Example scenario

To illustrate an end-to-end example of extending Google Cloud Cortex Framework, this guide provides practical examples using SAP flight scheduling data:

  1. Namespace definition: To package and isolate custom modules, a dedicated custom namespace sap_bookingdatamodel is introduced. See Custom namespace setup for details.
  2. Data foundation extension: To add a new table sflight (Training and demo flight table) to the deployment, a custom data foundation module is created to ingest and process this table from the raw layer into the data foundation layer. See Data foundation module creation for details.
  3. Custom data product creation: To build on the new foundation data, a custom data product module named flights_usd is created. This data product consumes the sflight foundation table, joins it with the standard SAP currency exchange rates table (tcurr), and converts the flight pricing from local currency into US dollars (USD). See Data product module creation for details.