Position: Python Developer with Airflow, Autosys & MWAA
Location: Reston, VA (Onsite)
Duration: 6+ Month
Job Description:
Experience Level:
Overall Professional Experience: 8+ years
Apache Airflow Specific Experience: 3+ years
Autosys Specific Experience: 3+ years
AWS MWAA Specific Experience: Proven track record of successful migrations
Job Summary:
We are seeking a highly accomplished and strategically minded hands-on Lead Engineer to drive the modernization of our customer’s batch processing system. This pivotal role requires over 8 years of progressive experience in application development, integration of batch processes, with a specialized focus on Apache Airflow (and a deep understanding of legacy scheduling tools like Autosys). A critical component of this role will be leading the migration of existing Autosys workflows and jobs to AWS Managed Workflows for Apache Airflow (MWAA).
Qualifications:
5+ years of hands-on experience specifically with Apache Airflow, including complex DAG development, custom operators/hooks, and plugin creation.
3+ years of hands-on experience with Autosys, demonstrating a solid understanding of its features, job scheduling, and administration.
Proven track record of successfully leading and executing migrations from legacy scheduling tools (specifically Autosys) to cloud-native orchestration platforms like AWS MWAA.
Demonstrable expert-level experience with AWS Managed Workflows for Apache Airflow (MWAA), including environment setup, configuration, scaling, security, and troubleshooting.
5+ years of hands-on experience in Python programming for Airflow DAG development.
Extensive experience with AWS cloud services, including but not limited to CloudWatch, and IAM.
Proven experience designing and implementing highly scalable and fault-tolerant batch pipelines.
Experience with relational and NoSQL databases (e.g., PostgreSQL, Oracle, DynamoDB, MongoDB).
Familiarity with CI/CD practices and tools (e.g., Jenkins, GitLab CI, AWS CodePipeline).
Strong problem-solving skills and the ability to diagnose and resolve complex technical issues, especially during migration.
Excellent communication, interpersonal, and leadership skills, with the ability to effectively collaborate with cross-functional teams and mentor junior engineers.
Preferred Qualifications:
1. AWS Certifications (e.g., AWS Certified Solutions Architect - Associate/Professional).
2. Experience with containerization technologies (Docker, Kubernetes).
3. Experience in the Financial services sector, particularly in environments with complex legacy systems.
&##127775; We're Hiring: Operations Assistant Are you organized, detail-oriented, and ready to be the backbone of a fast-moving team? Our client is looking for a proactive Operations Assistant to help keep their day-to-day operations running smoothly. What you'll ...
...~ FASA certification ~ BASA certification ~1 or more years of experience with fire sprinklers Job Description Insight Global is looking for a Fire Sprinkler Inspector to be a part of their client's team in the Fort Myers, FL area. This person will be responsible...
...Join Our Team as a Recruiter at GTS Technology Solutions! Are you results-driven and passionate about finding and attracting top talent... ..., education institutions, including K-12 and higher ed, healthcare entities and private businesses. Our mission is to exceed the...
...-based school, is seeking a dynamic and dedicated Life Science teacher to join the Global Extension of our school. This is an exciting... .... Minimum of three years of teaching experience, including online instruction Strong organizational skills with the ability to...
...with a supportive team, ongoing training, and unlimited growth potential! Job Description Were looking for a motivated Entry-Level Sales Representative to join our team! In this role, you will generate leads, build relationships with customers, and drive sales...