Databricks / Spark Data Engineer
Saicon
Job Description
We are seeking a Data Engineer with strong Spark fundamentals and experience working in cloud-based data environments. The ideal candidate will have hands-on expertise in building scalable data pipelines and leveraging modern development tools to improve productivity. Required Skill sStrong experience with Apache Spark and Databrick sSolid understanding of distributed data processing and performance optimizatio nExperience with AWS data services and cloud ecosystems, including :Amazon S 3AWS Glu eAmazon Redshif tData queues such as Amazon SQ SUnderstanding of cloud storage, data movement, and ingestion concept sExperience using AI-assisted coding tools such as GitHub Copilo t What You'll DoBuild and maintain scalable data ingestion and processing pipelin esDevelop and optimize Spark-based workloa dsWork with cloud-native data storage and integration servic esSupport enterprise data platform initiativ esUtilize modern development and AI coding tools to improve engineering efficien cy