Overview: We are looking for a Senior Python Data Engineer to join our team for a long-term engagement with an international client. You will join an AI platform project that collects real-time data from sensors and PLCs at industrial and water-treatment plants, then uses AI to detect anomalies, predict maintenance, optimise chemical dosing and prove the cost savings to plant owners. You will own the backend & data platform behind it, from the first PLC signal to the prediction an operator acts on.
Working hours: Monday - Friday, 8:30am - 5:30pm (1-hour lunch break included) - GMT+7 (Vietnam time)
Location: Remote - Vietnam
Expected starting date: ASAP
What You'll Do
Backend services and APIs: design and build Python services and APIs that take in plant data and serve predictions, insights and actions to the product
Streaming pipelines: build and run pipelines on Kafka and Flink, with event-time processing, late and out-of-order data, and joins across data that arrives at very different rates (every second, every 30 minutes, every 2 hours, days later)
Data quality: set up data contracts and a schema registry. Build sensor validation from basic checks (range, flatline, rate of change) to physics-based checks (mass and flow balances). Quarantine bad data instead of deleting it
Storage: design TimescaleDB hypertables, continuous aggregates, compression and retention; Redis for real-time views; Parquet object storage for training data, replay and audits
Data for AI/ML: make plant data reliable for physics models, optimisation and ML. Build incident replay and data lineage so every AI recommendation can be reproduced (MLflow, Airflow, OpenLineage)
Observability and scale: monitor data freshness, completeness and drift; keep queries and schemas fast as data volumes and sites grow
Testing: write contract tests, replay tests and outage tests
AI-first engineering: use AI coding tools and agents every day to design, write, test and review code. Write machine-readable specs (schemas, templates, rule catalogues) that agents can build from
Team: join design and code reviews, including AI-generated code, and mentor other engineers