Skip to content

Commit 2ccdcda

Browse files
ksfikasclaude
andcommitted
Rename the "Provider portal" tab to "Extract Box"
The service is an ETL: sources come in (Extract), may be transformed (Transform), and go out (Load). Only the tab label changes; addresses stay, so existing links keep working. The README describes the planned Transform and Load boxes. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
1 parent b742f18 commit 2ccdcda

4 files changed

Lines changed: 35 additions & 3 deletions

File tree

‎README.md‎

Lines changed: 16 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -21,6 +21,21 @@ pipeline. Do not add a dependency from here back onto
2121
`ckanext.providerharvest` (or vice versa) -- the whole point is these
2222
are independently deployable.
2323

24+
## The shape: Extract, Transform, Load
25+
26+
The service follows an ETL flow, and its tabs follow it: sources come **in**, may be **transformed**, and go **out**
27+
(to data.gov.gr, or by other means).
28+
29+
| Tab | Role | State |
30+
|---|---|---|
31+
| **Extract Box** | the sources: registering them, how they deliver (pull over HTTP/SFTP/FTP, or push by API key or FTP/SFTP login), their runs and files | built (this was "Provider portal") |
32+
| **Transform Box** | turning what was extracted into what is wanted (field mapping, cleaning) | planned |
33+
| **Load Box** | sending the result out to data.gov.gr or elsewhere | planned |
34+
| Admin dashboard, **Data boxes**, Security box | operating it: approvals and retention; the HTTP and FTP machines; access control | built |
35+
36+
Only the tab is renamed for now; the addresses (`/provider/...`) are unchanged so existing links and the providers' own
37+
bookmarks keep working.
38+
2439
## Status: engine + CKAN adapter + working CI/CD + a live FTP/SFTP receiving server + token provisioning + full provider/admin source lifecycle (register/edit/delete) + connection health checks + a live API proxy + a real, manually-triggered harvest that stores data in PostgreSQL
2540

2641
`providerharvest_service/engine/` -- the transport implementations
@@ -96,7 +111,7 @@ the admin API can't be pointed at an arbitrary path. Generated
96111
passwords are bcrypt-hashed and shown exactly once, at creation (or
97112
rotation) -- never returned again.
98113

99-
The whole site -- the provider portal, the admin pages, the API docs --
114+
The whole site -- the Extract Box (the provider-facing pages), the admin pages, the API docs --
100115
sits behind a real login (`admin_session.py`: a signed session cookie,
101116
one shared username/password, enforced by a single ASGI middleware). It
102117
is **deny by default**: a path needs the session unless it is on a short

‎providerharvest_service/templates/base.html‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -373,7 +373,7 @@
373373
</a>
374374
</div>
375375
<nav class="masthead-nav">
376-
<a href="/provider/sources" class="{{ 'active' if request.url.path.startswith('/provider') else '' }}">{{ macros.icon("provider", 16) }} Provider portal</a>
376+
<a href="/provider/sources" class="{{ 'active' if request.url.path.startswith('/provider') else '' }}">{{ macros.icon("provider", 16) }} Extract Box</a>
377377
{# Sources waiting for approval, as a number on the dashboard tab. Not on the login page: nothing about the
378378
queue is for someone who has not logged in. #}
379379
{% set pending_n = pending_approvals() if (pending_approvals is defined and request.url.path != '/admin/login') else 0 %}

‎providerharvest_service/ui_admin_ftp.py‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -69,7 +69,7 @@
6969

7070
_MANAGED_NOTE = (
7171
"%r belongs to a push source -- its allowed addresses are set on the source "
72-
"(Provider portal, edit the source), not here."
72+
"(Extract Box, edit the source), not here."
7373
)
7474

7575

‎tests/test_nav_labels.py‎

Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
1+
"""The masthead's tabs follow the ETL flow (see the README): the provider-facing pages are the Extract Box."""
2+
3+
from tests.test_ui_admin_ftp import ( # noqa: F401 (fixtures shared with the admin page tests)
4+
_admin_session_env, _isolated_db, _master_key, _upload_root, client,
5+
)
6+
7+
8+
def test_the_provider_pages_tab_is_the_extract_box_and_the_old_name_is_gone(client):
9+
for path in ("/provider/sources", "/admin/sources", "/admin/ftp"):
10+
page = client.get(path).text
11+
assert "Extract Box</a>" in page, path
12+
assert "Provider portal" not in page, path
13+
14+
15+
def test_the_tab_still_points_at_the_same_address_and_is_marked_active_there(client):
16+
page = client.get("/provider/sources").text
17+
assert 'href="/provider/sources" class="active"' in page

0 commit comments

Comments
 (0)