Freelance Opportunity – Scala Data Engineer (Remote)
ThreatXIntel
Job Description
ThreatXintel Cyber Labs LLP is looking for a highly skilled Scala Data Engineer to join a dynamic data engineering team working on large-scale data platforms and modern cloud-based analytics solutions.
Key Responsibilities:
• Design, develop, and maintain scalable data processing applications using Scala
• Build and optimize ETL/ELT pipelines for large-scale data platforms
• Develop and maintain data warehouse solutions using Snowflake and Redshift
• Work with both SQL and NoSQL databases for data storage and analytics
• Develop data integration and streaming solutions using Apache Spark and Kafka
• Collaborate with cross-functional teams to support business intelligence and analytics initiatives
• Implement workflow orchestration using Airflow
• Work within Azure cloud environments to deploy and manage data solutions
• Ensure data quality, performance, and scalability across the data ecosystem
Required Skills:
• Strong hands-on experience with Scala programming
• Moderate to strong Java development experience
• Experience with SQL and NoSQL databases such as Teradata, PostgreSQL, and MongoDB
• Strong expertise in ETL pipeline development and data warehousing concepts
• Experience with Snowflake and/or Amazon Redshift
• Hands-on experience with Apache Spark, Kafka, Databricks, and Airflow
• Familiarity with Azure cloud infrastructure
• Strong problem-solving and analytical skills
Preferred Qualifications:
• Experience working with large-scale distributed data systems
• Knowledge of data architecture and performance optimization
• Experience supporting enterprise data engineering initiatives