Senior Data Engineer (AWS)

Role: Senior Data Engineer (AWS)

Company Name : WillWare Technologies 

Work Model : Fulltime / Hybrid

Experience : 8+ Years 

Work Location : Bangalore / Hyderabad / Pune / Chennai / Noida / Gurgaon 

Job Description : 

• Scope: Build/operate ingestion pipelines from unstructured , semi-structured data sources and additional sources; develop PySpark/Glue transformations; manage S3 data lake layout/partitioning; orchestrate with Airflow; CI/CD, testing, and operational monitoring.

• Core skills: PySpark, Python, AWS Glue, Amazon S3, SQL-based transforms, Airflow orchestration, connectors/streaming (e.g., Kafka/Snowflake connectors), CI/CD for data pipelines, observability and automated data quality checks. Nice to have: Experience preparing data for vectorization and search services.