Job Description
Role: Senior Data Engineer
Location: Charlotte, NC (3 Days/ week)
Position Summary
We are seeking a highly skilled Senior Data Engineer to design, build, and optimize scalable data platforms and pipelines supporting enterprise data initiatives. The role involves working on large-scale data processing systems, enabling analytics, reporting, and AI/ML use cases within a modern cloud-based architecture.
Key Responsibilities
Design, develop, and maintain scalable data pipelines (batch and real-time) using modern data engineering frameworks
Build and optimize data ingestion and processing workflows using tools like Spark, Hadoop, Kafka, and Airflow
Develop and manage data models, ETL/ELT pipelines, and data transformation processes
Work closely with data scientists, analysts, and business teams to deliver high-quality data solutions
Implement data quality, data validation, and governance frameworks
Optimize performance for large-scale datasets and ensure efficient data processing
Design and manage cloud-based data architectures (AWS/Azure/GCP)
Ensure data security, compliance, and regulatory standards are met
Troubleshoot and resolve production issues related to data pipelines
Mentor junior data engineers and contribute to best practices and standards
Required Skills
Strong experience in Python, Scala, or Java for data engineering
Hands-on experience with Apache Spark, Hadoop ecosystem (Hive, HDFS)
Expertise in building ETL/ELT pipelines
Experience with data orchestration tools like Airflow
Knowledge of real-time streaming tools such as Kafka
Strong proficiency in SQL and data modeling techniques
Experience with cloud platforms (AWS preferred – S3, Glue, EMR, Redshift)
Understanding of data warehouse and data lake architectures
Familiarity with CI/CD pipelines and DevOps practices
