Lead Data Engineer (GCP & Pipeline Architecture)
ZettaMine Labs Pvt. Ltd.
Job Description
Hello All, Greetings from ZettaMine!!! Project-Specific Prerequisite Skills: Lead Data Engineer (GCP & Pipeline Architecture) Years of Experience: 8–12 Years Location: PAN India Notice Period: Immediate Joiners Job Summary We are seeking a highly skilled Lead Data Engineer with expertise in Google Cloud Platform (GCP) and Data Pipeline Architecture to design, develop, and implement scalable, secure, and high-performance data solutions. The ideal candidate will have strong experience in building end-to-end data pipelines, data warehouse architectures, and automated ETL/ELT workflows within the GCP ecosystem.
Required Skills Expert proficiency in Python and SQL. Experience in parsing and flattening complex XML and JSON payloads. Strong knowledge of the Google Cloud Platform (GCP) ecosystem, including: BigQuery schema design Google Cloud Storage (GCS) Identity and Access Management (IAM) Familiarity with GCP data ingestion services and patterns, including: BigQuery Data Transfer Service Cloud Data Fusion Expertise in building end-to-end data pipelines and automating ETL/ELT workflows.
Experience connecting to Infor IONAPI endpoints. Ability to design, deploy, and manage data warehouse architectures within GCP. Roles & Responsibilities Lead the design and development of scalable data pipelines and data architectures on GCP.
Develop, maintain, and optimize ETL/ELT processes to automate data workflows. Design and optimize BigQuery schemas for performance, scalability, and cost efficiency. Manage data ingestion from multiple source systems, including Infor IONAPI endpoints.
Implement and enforce security best practices using IAM roles and permissions. Collaborate with cross-functional teams to ensure data quality, integrity, and availability. Monitor, troubleshoot, and enhance data pipeline performance, reliability, and scalability.
Support enterprise data initiatives by delivering robust and efficient cloud-based data solutions. If you are interested kindly share your updated CV to or WhatsApp to 6302404863. Thanks & Regards, Aruna.M