Apache Spark | Airflow | Azure Synapse | PySpark - Data Engineer

Manchaca, TX

Full-time $75,000.00 - $105,000.00

Posted 04/28/2025

Data Engineer - Apache Spark | Airflow | Azure Synapse | PySpark

Position Overview
We are looking for a skilled Data Engineer to join our team, specializing in Apache Spark, Airflow, Azure Synapse, and PySpark. The ideal candidate will be responsible for designing and implementing scalable data pipelines, ensuring the efficient processing and analysis of large datasets. This role requires a strong understanding of cloud-based data solutions and the ability to collaborate with cross-functional teams to deliver data-driven insights.

Key Responsibilities

Design, develop, and maintain robust data pipelines using Apache Spark and PySpark.
Implement and manage workflows with Apache Airflow for data processing tasks.
Collaborate with data scientists and analysts to understand data requirements and deliver solutions accordingly.
Optimize data storage and retrieval processes in Azure Synapse and other data storage solutions.
Monitor and troubleshoot data pipeline performance to ensure high availability and reliability.
Work with BI tools, particularly Power BI, to enable data visualization and reporting needs.
Utilize version control systems like GitHub for code management and collaboration.
Integrate REST APIs for data ingestion and interaction with external systems.

Qualifications

Bachelor's degree in Computer Science, Engineering, or a related field.
Proven experience as a Data Engineer or in a related position.
Strong proficiency in Apache Spark and PySpark for data processing.
Experience with orchestration tools such as Apache Airflow.
Familiarity with Azure Synapse and cloud-based data solutions.
Understanding of BI tools, preferably Power BI, is a plus.
Experience in DevOps practices and tools is desirable.
Knowledge of GitHub for version control and collaboration.
Familiarity with REST APIs and their integration in data workflows.

Benefits

Medical/Dental/Vision
HSA/FSA Accounts Available
Life & AD&D Insurance
401k (50% match with no cap)
Employee Assistance Programs

For this position you must be currently authorized to work in the United States. We do not sponsor for this position.

Additional ways to apply

Preferred Skills

Lance Beyer is recruiting for this position and the positions below.
Email me to apply for this position

Lead Technology Analyst - Manufacturing Technologies - Stratus

Carrollton, TX•Laurel, MD•Phoenix, AZ•Schertz, TX•Los Angeles, CA Full-time $110,000.00 - $140,000.00

AEC Support Manager

Carrollton, TX•San Diego, CA•Washington, DC•Phoenix, AZ•Chicago, IL Full-time $100,000.00 - $150,000.00

Job ID: LB6-1850703

Employees will receive paid leave to the extent required by state or local law. This job was first posted by CyberCoders on 04/28/2025 and applications will be accepted on an ongoing basis until the position is filled or closed.

CyberCoders, Inc is proud to be an Equal Opportunity Employer

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, sexual orientation, gender identity or expression, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, status as a crime victim, disability, protected veteran status, or any other characteristic protected by law. CyberCoders will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable state and local law, including but not limited to the Los Angeles County Fair Chance Ordinance, the San Francisco Fair Chance Ordinance, and the California Fair Chance Act. CyberCoders is committed to working with and providing reasonable accommodation to individuals with physical and mental disabilities. If you need special assistance or an accommodation while seeking employment, please contact a member of our Human Resources team to make arrangements.

Your Right to Work – In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification document form upon hire.