← Back to projects

Project

Data Platform (ETL + Products)

Core data platform responsible for ingesting, normalizing, and serving datasets consumed by multiple SaaS products and enterprise clients.

Software Engineer (Platform Contributor) Professional work Proprietary

Professional work. I contributed to the platform architecture and backend systems. Description focuses on technical responsibilities.

Stack

Node.jsPythonGCPCloud RunPub/SubDockerFirestoreCloud Storage

Impact

  • Enabled multiple SaaS products and enterprise clients from a shared, reliable data foundation.
  • Improved ingestion reliability using event-driven architecture and structured monitoring.
  • Standardized normalization contracts to accelerate onboarding of new products.

What I did

  • Designed ingestion adapters and normalization workflows.
  • Implemented event-driven pipelines using Pub/Sub.
  • Improved production stability via retries, idempotency, and monitoring.
  • Contributed to platform scalability and service boundary definitions.

Architecture

  • External sources → ingestion workers (Cloud Run / Functions)
  • Pub/Sub for decoupled processing stages and buffering
  • Transformation and normalization services
  • Curated datasets consumed by downstream products

Products built on top

CattleWiz

SaaS Product

Cattle and beef market intelligence platform built on top of the Data Platform.

EconWiz

SaaS Product (In Progress)

Economic data product extending the platform to macroeconomic and market indicators.

Custom Client Pipelines

Enterprise Integrations

Custom ingestion and transformation pipelines for enterprise clients (anonymized).