Cefic Comext ETL Status
Eurostat Comext → PostgreSQL → Parquet export. Imports the chemistry-relevant CN codes (chapters 20–39) every Monday morning, then republishes a single Parquet file for Power BI.
Latest run
Most recent execution of the weekly cron — what it tried, what it imported, what it skipped.
No summary available.
Published Parquet outputs
Artifacts produced by the weekly export — the fact table filtered on chemistry CN codes, plus the partner-country dimension rebuilt from Eurostat's SDMX codelist. Both are regenerated in the same export_parquet.py run.
period, declarant, partner, product_nc, cpa2015, chapter_cn, flow, flow_label, value_in_euros, quantity_in_kg.
Filtered on ~1369 CN2025 codes from SubstanceId.csv, EU27 aggregated on both sides.
partner_code, label_en, label_fr, label_de, is_standard_code, source, note, ec_corporate_code, ec_corporate_uri.
Join in Power BI on partner_code to get multilingual labels.
Source: Eurostat SDMX 3.0 — ESTAT/PARTNER.
product_code, label_en, label_fr, label_de, level, parent_code, chapter, is_not_elsewhere_specified.
Full Combined Nomenclature hierarchy (chapters → headings → HS subheadings → 8-digit CN codes). Join on product_code in Power BI.
Source: Eurostat SDMX 3.0 — ESTAT/CXT_NC.
Recent imports
Last successful monthly imports recorded in etl_log.
| Period | Filename | Rows loaded | Finished at | Status |
|---|---|---|---|---|
| — | ||||
Loaded rows over time
Total rows inserted into PostgreSQL per monthly file, from the oldest period to the most recent.
Coverage matrix
Year × month grid. Filled cells = period present in etl_log (darker = more rows). Dashed cells = missing.
Source freshness by Member State
When each EU Member State last uploaded a slice to Eurostat's Comext database. Rows = MS, columns = reference period (most recent on the right). Darker = fresher upload date; dashed = not yet published. Toggle between Intra-EU (MS-declared) and Extra-EU (customs-declared) flows.
Latest log
Tail of the most recent cron log — INFO in default, WARNING in orange, ERROR in red.