Built in

Apify

The Apify API with a personal token: start an Actor, wait for the run, then page through its dataset. Good for public web data you cannot get through an API.

What the connection reaches

Actors and their runs
Datasets of finished runs
Callable from pipelines and from ontology actions

Status: Built into the pipeline SDK
Connection class: ApifyConnection
Credential: API token
In use: In use at SegmentStream HQ, our own workspace.

Connect Apify

Three steps, the same for every connection. The credential goes to the platform, never into the repository or pipeline code.

Declare it in connections/connections.py

connections/connections.py

from segmentstream.connections import ApifyConnection connections = (    ApifyConnection(key="apify"),)

2
Deploy
```
$ segmentstream deploy
```
3
Connect
Paste the API token (Apify Console > Settings > API & Integrations) into the connection in the console, or configure it from the terminal with a hidden prompt. API-key connections need no authorisation step: once the value is set, the connection is connected.
```
$ segmentstream connection configure apify
```

Use it

Code asks for the connection by its key. The platform adds the credential on the way out.

pipeline/ingestion/…

import segmentstream as s with s.get_connection("apify").get_http_client() as client:    response = client.post("/actors/apify~website-content-crawler/runs", json=actor_input)    response.raise_for_status()

Or ask your agent

“Run the website crawler on our competitors' pricing pages every Monday.”

Part of these solutions

Marketing

Social listening, audiences and consent

More in Data & files

Google SheetsBuilt inTargets, budgets and mappings from spreadsheets.SupabaseBuilt inTables and views of a Supabase project.AirtableVia APIBases, tables and records.NotionVia APIDatabases and pages shared with your integration.

All integrations →

Enterprise pilot

Want Apify set up for you?

Our forward-deployed engineers build one solution on your data, in your own workspace, as code you own. Tell us what you run today and what you want; your note goes straight to our founder.

One solution, on your data, in your own workspace
First version live in two weeks
Parity proven before anything is switched off
Fixed scope and price, credited to your contract if you continue

Not ready for a pilot? Send the form anyway with your question. An engineer will reply, not a sales rep.

How the pilot works

Connect what your company runs.

Start a pilot

Our engineers build the first version on your data in two weeks, at a fixed price.

Or join the waitlist for self-serve:

Self-serve opens to the waitlist first.