datajobs-au.fyi

Staff Data Engineer at Tech Aalto — Sydney, Sydney Region

Tech Aalto — Sydney, Sydney Region · Skills: Snowflake

About this role

2. Staff Data Engineer Key responsibilities 1. Design the Collections Snowflake and PySpark architecture. 2. Lead integration with commbank.data. 3. Model HPS card and account data for Collections use cases. 4. Define data contracts and schema-evolution standards. 5. Establish automated data-quality and reconciliation controls. 6. Design restartable, idempotent and recoverable pipelines. 7. Optimise Snowflake and PySpark workloads. 8. Establish production monitoring and data-pipeline observabil…