You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit e8b44db
Browse filesBrowse the repository at this point in the historyBrowse files
Copy file name to clipboardExpand all lines: README.md
+2Lines changed: 2 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -827,3 +827,5 @@ The Overview is the **default screen**: `/` and a login that was not sent anywhe
827
827
A new dataset **and a new data service** are created with the visibility chosen on the form (*Who can see it in CKAN*: private, the default, or public); an entry that is already in CKAN keeps its own visibility, which is changed with the *Make public* / *Make private* button, and a later push never resets it (a data service used to be created public and re-sent as public with every update).
828
828
829
829
**API documentation of each public address** (`api_docs.py`). Every published pipeline has a Swagger page at `/api-docs/<source>[/<pipeline>]` and its OpenAPI 3.1 description at `.../openapi.json`, public like the address itself (exempt from the login) and a 404 for anything that is not published of an active source. It is made from what the loader knows: the path and method (for an API source, the one callers use, and the request template's parameters as required query parameters or a JSON body), the output format's content type with an example and, for a source that stores data, the column names and types and example rows of the newest output (a pass-through API source says "as the provider returns it" instead of inventing a shape), the ETag / 304 behaviour, the 404 / 429 / 502 answers and the per-address rate limit. The Swagger UI script and style are loaded from jsdelivr (`swagger-ui-dist`, a pinned version), so nothing is installed on the VM. The Load Box shows an *API docs* link on the public-address line, and a data service's `documentation` always includes the link.
830
+
831
+
**CSV files that are not a plain table** (`transform_engine.csv_options`; the reader step in the Transform Box, under "The file has lines before the table, no header row, or marks for 'no value'"). A CSV reader can skip a number of lines at the top, name the columns from a list when the file has no header row (typed, or filled from a header file such as EMY's `header_info.txt` in the browser: the first token of each line, a titles line skipped, a repeated name numbered), and turn values that match a pattern (`/+` for the `////` a weather station writes where it has no sensor) into empty ones. A date and time with no separators (`202604010150`, also 8 and 14 digits) is read as UTC by the *datetime* conversion. These are the pieces for the two-line files the EMY stations send.
<summary>The file has lines before the table, no header row, or marks for "no value"</summary>
81
+
<divclass="row-pair"><div><labelfor="skip_lines">Skip this many lines at the top</label><inputid="skip_lines" name="skip_lines" value="{{ r.csv.skip_lines }}" size="3" maxlength="3"></div>
82
+
<div><labelfor="empty_regex">Values that mean "nothing" (a pattern, e.g. <code>/+</code> for ////)</label><inputid="empty_regex" name="empty_regex" value="{{ r.csv.empty_regex }}" maxlength="100"></div></div>
83
+
<labelfor="column_names">The file has no header row: name its columns (one per line, or separated by commas)</label>
84
+
<textareaid="column_names" name="column_names" rows="5" placeholder="Leave empty when the first line of the table holds the column names">{{ r.csv.column_names }}</textarea>
85
+
<pclass="muted" style="margin:0.2rem 0 0.4rem;">Or fill the list from a header file (a text file whose lines start with the column name, such as <code>header_info.txt</code>; a first line of titles is skipped and a name used twice gets a number):
compact= {8: "%Y%m%d", 12: "%Y%m%d%H%M", 14: "%Y%m%d%H%M%S"}.get(len(text)) iftext.isdigit() elseNone# (202604010150: a date and time with no separators, UTC)
0 commit comments