Senior Engineer Data

Data Engineer

Role Summary

Key Responsibilities

Required Qualifications

• Design, build, and manage scalable data processing pipelines on theGoogle Cloud Platform.
• Drive engineering excellence, data quality, and continuous improvement.
• Lead end-to-end design, development, and deployment of scalable data pipelines and integration solutions.
• Manage multiple delivery workstreams.
• Translate complex business and technical requirements into robust data engineering solutions.
• Develop and optimize ETL/ELT processes using modern cloud, data warehousing, and data processing platforms.
• Collaborate with technical and business teams to translate complex requirements into robust data solutions.
• Diagnose and resolve complex production issues through root-cause analysis and system optimization.
• Drive technology and process improvements by evaluating emerging tools and engineering best practices.
• Ensure adherence to enterprise architecture, security, compliance, and performance standards.
• Maintain high-quality technical documentation, user guides, and solution specifications.

Experience:

• Experience in Data modelling, Data engineering, Data integration.
• Experience leading engineering initiatives.
• Proven experience with cloud tools such asGCP Dataflow, GCP Composer (Airflow), GCP cloud storage.
• Strong expertise in cloud platforms:GCP

Hands-on experience with data warehousing and processing technologies including:

Nice to Have

• BigQuery, Lakehouse (Iceberg)
• Spark
• Python, SQL
• Experience with data streaming tools:Kafka, Cloud Data Flow, Spark Streaming.
• Strong experience in data quality and observability platforms to automate quality coverage using iceDQ, Monte Carlo, or similar tools.
• Strong proficiency with high-level programming and query languages.
• Experience collaborating with distributed teams across time zone.
• Experience withPower BI/ThoughtSpot,AI in data engineering,Stonebranch,CI/CD,DatabricksandDevOpspractices.
• Familiarity with enterprise databases such asDB2, SQL Server, Oracle, PostgreSQL.
• Google Cloud Data Engineer certification is preferred.
• Experience in Retail domain (Customer, Stores, eCommerce, Marketing, Supply chain, Merchandising)