Data connectivity & integration

This section covers how OpenFoundry connects to source systems, ingests data, and moves it into operational platform flows.

OpenFoundry mapping

services/data-connector
services/dataset-service
services/pipeline-service
services/streaming-service
proto/data_integration/*
proto/dataset/*
proto/pipeline/*
proto/streaming/*

Key concerns

connection management
sync orchestration
dataset creation and versioning
batch and streaming ingestion
storage and archival integration