Confidential · Data Platform

Canonical Entity Warehouse

A confidential data warehouse that unifies people/accounts/orgs across several projects into one canonical store — dedup + soft-delete governance, each project reading only its slice (scale/target masked).

PersonalContribution 100%
Key Metric: Canonical data platform · multi-source dedup · soft-delete governance · cron-distributed ingestion
Engineering Role
BackendInfra
Confidential · Data Platform
Canonical Entity Warehouse
VIS
#Backend#Python#System#Personal

Overview

A local-first ETL warehouse that merges contacts/entities from several sources into one canonical Postgres store: multi-source adapters, email/domain dedup, a DB guard that blocks hard-deletes (soft-delete only), and periodic cron re-ingestion distributed across machines. Data pipeline only, no UI. (Real scale and target masked.)

Highlights

  • Multi-source → one canonical store (email/domain dedup)
  • Hard-delete-blocking DB guard — soft-delete-only governance
  • Cron-based multi-machine re-ingestion (ETL adapters)
  • Pure data pipeline with no UI (Postgres/Supabase)

Timeline

Role: Solo design & operation (target masked)
Contribution: 100%
Collaboration: Personal

Tech Stack

</>Postgres canonical store · multi-source ETL · dedup · soft-delete guard · cron distribution

PostgreSQLSupabasePythonBashDockercron