Ingestion

Load any source. Install it, or let your agent write it.

Managed loading from every SaaS tool, ad platform and database. Every source, including ours, is a plugin on the same public SDK. If a connector does not exist yet, your agent writes it before lunch.

Start a pilot Join the waitlist

Partitioned and backfillable

Historical loads partitioned by day, with backfills you start from the console, the CLI or an agent.

Idempotent by design

Each run replaces exactly the days it was asked for. Re-running a day corrects it instead of duplicating it.

Respects rate limits

Concurrency pools keep every source under its API limits, however large the backfill.

Observable

Retries, logs and lineage come with every asset. A failure names the day, the request and the reason.

In code

pipeline/ingestion/hubspot/contacts.py

@s.ingestion(
    tier=s.Tier.Bronze,
    mode=s.IngestionMode.Historical(
        partitioning=s.Partitioning.Daily(
            column="created_date", start_date="2020-08-13",
        ),
    ),
    connections=("hubspot",),
    schema=CONTACT_SCHEMA,
    primary_key=("contact_id",),
)
def hubspot_contacts(context: s.Context) -> Iterator[s.IngestionRow]:
    """Every contact created on the assigned days."""
    yield from contact_rows(context)

Pipeline SDK reference →

Use it, install it, or build on it

Every block on the platform comes three ways. Most teams use all three.

Use it

Start a backfill for any installed source from the console or CLI.

Install it

Install a ready ingestion from the marketplace and backfill history in one command.

Build on it

Your agent writes an ingestion asset against any API; the platform schedules, retries and monitors it.

Replaces Fivetran, Airbyte and Custom cron scripts.

Install from the marketplace

Google Ads

Spend, clicks and conversions from every Google Ads account.

Connector

HubSpot

Contacts, companies, deals and the history of every property.

Connector

Stripe

Charges, invoices, subscriptions and balance transactions.

Connector

Xero

Invoices, bills, payments and the general ledger.

Connector

Zendesk

Tickets, comments, satisfaction and agents.

Connector

Fivetran

Tables Fivetran already loads into your warehouse.

Connector · Connect or replace

Any REST API

Connect any API with a key; your agent writes the loader.

Connector

Browse the marketplace →

Solutions built with it

Marketing analytics

Attribution and budget optimization on first-party data

Lead scoring

Grade leads A to D against standards you can read

Warehouse migration

Move off Snowflake or Databricks with proven parity

Enterprise pilot

Start a pilot.

Want ingestion set up for you? Our forward-deployed engineers build it for you in your workspace, as code you own.

One solution, on your data, in your own workspace
First version live in two weeks
Parity proven before anything is switched off
Fixed scope and price, credited to your contract if you continue

Not ready for a pilot? Send the form anyway with your question. An engineer will reply, not a sales rep.

How the pilot works

Your company’s context, ready for every agent.

$ segmentstream workspace create acme --region eu

▸ workspace ready · data, objects, metrics and access rules in one place

▸ connect Claude, ChatGPT or Cursor with one connector

▸ tell your agent: “add our billing API as a source”

Start a pilot

Our engineers build the first version on your data in two weeks, at a fixed price.

Or join the waitlist for self-serve:

Pilots are open now. Self-serve opens to the waitlist this fall.