You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit b1bb38b
Browse filesBrowse the repository at this point in the historyBrowse files
Copy file name to clipboardExpand all lines: README.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -189,7 +189,7 @@ provider's uploads until they switch), and for an HTTPS push source **Rotate API
189
189
key** (`/provider/sources/{id}/rotate-key`: the old key stops working immediately;
190
190
before this a lost key meant deleting and re-registering the source).
191
191
192
-
**Input and Output are steps** (Transform Box): a transform's list reads **IN** -> the processing steps (the first is *Read XML/JSON/CSV/Excel*) -> **OUT**. How callers ask an API source's published address (the GET->POST turn-around and its template) is set in the Load Box, on the source's row (Request -> Edit). A source can have several pipelines (each with its own steps, output and on or off switch; a new one is added from the Transform Box page, empty or as a copy of one of the source's pipelines): the Transform page has a switcher, and a pipeline's pages live under /transform/sources/<id>/pipelines/<name>/. The first is named default. Every enabled pipeline runs on an arriving file and stores its own output. Index tables belong to one source (Extract Box, the source's menu: Index tables): uploaded, replaced and deleted there, and only that source's pipelines can look things up in them; a table name is unique within its source, never shared. Deleting a source deletes everything that belongs to it: its pipelines, index tables, publish setting, stored runs, files and outputs. The source form (Extract Box, register and edit) is split into tabs -- General (name, title, e-mail), Connection (pull or push, the connector, endpoint, schedule and credentials), Request and Limits (every rate limit, timeout, retry and depth setting together) -- and only the tabs a source needs are shown: a push source and SFTP / FTP have General and Connection (a push source's how-they-send and allowed senders are its Connection), an HTTP API all four.
192
+
**Input and Output are steps** (Transform Box): a transform's list reads **IN** -> the processing steps (the first is *Read XML/JSON/CSV/Excel*) -> **OUT**. How callers ask an API source's published address (the GET->POST turn-around and its template) is set in the Load Box, on the source's row (Request -> Edit). A source can have several pipelines (each with its own steps, output and on or off switch; a new one is added from the Transform Box page, empty or as a copy of one of the source's pipelines): the Transform page has a switcher, and a pipeline's pages live under /transform/sources/<id>/pipelines/<name>/. The first is named default. Every enabled pipeline runs on an arriving file and stores its own output. Index tables belong to one source (Extract Box, the source's menu: Index tables): uploaded, replaced and deleted there, and only that source's pipelines can look things up in them; a table name is unique within its source, never shared. Deleting a source deletes everything that belongs to it: its pipelines, index tables, publish setting, stored runs, files and outputs. The source form (Extract Box, register and edit) is split into tabs -- General (name, title, e-mail), Connection (pull or push, the connector, endpoint, schedule and credentials), Request and Limits (every rate limit, timeout, retry and depth setting together) -- and only the tabs a source needs are shown: a push source and SFTP / FTP have General and Connection (a push source's how-they-send and allowed senders are its Connection), an HTTP API all four. On a new source the button leads through the tabs ("Next: Connection", ...) and becomes Register source once every required field is filled.
193
193
The two ends are fixed (not removable or movable, not offered under "Add a step") and each has its own page, opened by its Edit button:
194
194
*Input* (`/transform/sources/{id}/steps/input`) says where the data comes from -- for a source that stores data, the newest file the steps are built
195
195
on; for an API source, its sample answer (paste one, or fetch one with the source's test request); *Output* (`.../steps/output`) holds the format and
0 commit comments