Data Engineer 1422

Referral Eligible  

 

Summary: 

We are seeking an enthusiastic cleared Data Engineer with full scope polygraph in Chantilly, VA, to join a groundbreaking initiative dedicated to advancing machine learning capabilities. This is a unique opportunity to contribute directly to mission-critical projects by developing, rigorously testing, and optimizing cutting-edge ML pipelines. Your expertise will be pivotal in safeguarding data integrity, validating state-of-the-art models, automating essential validation processes, and ensuring highly efficient, reliable data processing workflows. Join us and play a key role in shaping impactful technology that drives innovation forward.

 

Salary: 230,000-300,000

 

Responsibilities:

• Test and validate ML pipelines to ensure data integrity and model reliability.
• Monitor and maintain Databricks, Apache Spark, and other data processing frameworks.
• Automate model validation, testing, and monitoring processes.
• Optimize data processing workflows for scalability and performance.
• Troubleshoot performance issues in data pipelines and ML workflows.
• Collaborate closely with ML engineers and data teams for seamless integration and deployment.

 

Job Qualifications: 

• Experience in Data Engineering, MLOps, or related fields.
• Strong background in Python and data validation/testing.
• Proficiency in Databricks, Apache Spark, and distributed data processing.
• Knowledge of data pipeline monitoring, debugging, and optimization techniques.
• Experience with automated testing and validation frameworks for ML models.
• Knowledge of orchestration tools (Airflow, Prefect) for data workflows.
• Understanding of real-time data streaming technologies (Kafka, Flink, etc.).

 

Education/Experience include: 

Bachelor's degree in a related field preferred.  

 

Position Type:

Full time position 

 

Clearance Type: 

Requires a current TS/SCI with FS Polygraph. 

 

AAP/EEO Statement: 

Equal Opportunity Employer – M/F/Disabled/Veteran 

Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. 

 

Zapata Technology, Inc. provides reasonable accommodation to applicants who are veterans or who have disabilities and are unable to fully use our company application system. If you need a reasonable accommodation for any part of the application and hiring process, please notify Christina Hall, EEO Coordinator at ChristinaHall@ZapataTechnology.com