Position: Python Developer with Airflow, Autosys & MWAA
Location: Reston, VA (Onsite)
Duration: 6+ Month
Job Description:
Experience Level:
Overall Professional Experience: 8+ years
Apache Airflow Specific Experience: 3+ years
Autosys Specific Experience: 3+ years
AWS MWAA Specific Experience: Proven track record of successful migrations
Job Summary:
We are seeking a highly accomplished and strategically minded hands-on Lead Engineer to drive the modernization of our customer’s batch processing system. This pivotal role requires over 8 years of progressive experience in application development, integration of batch processes, with a specialized focus on Apache Airflow (and a deep understanding of legacy scheduling tools like Autosys). A critical component of this role will be leading the migration of existing Autosys workflows and jobs to AWS Managed Workflows for Apache Airflow (MWAA).
Qualifications:
5+ years of hands-on experience specifically with Apache Airflow, including complex DAG development, custom operators/hooks, and plugin creation.
3+ years of hands-on experience with Autosys, demonstrating a solid understanding of its features, job scheduling, and administration.
Proven track record of successfully leading and executing migrations from legacy scheduling tools (specifically Autosys) to cloud-native orchestration platforms like AWS MWAA.
Demonstrable expert-level experience with AWS Managed Workflows for Apache Airflow (MWAA), including environment setup, configuration, scaling, security, and troubleshooting.
5+ years of hands-on experience in Python programming for Airflow DAG development.
Extensive experience with AWS cloud services, including but not limited to CloudWatch, and IAM.
Proven experience designing and implementing highly scalable and fault-tolerant batch pipelines.
Experience with relational and NoSQL databases (e.g., PostgreSQL, Oracle, DynamoDB, MongoDB).
Familiarity with CI/CD practices and tools (e.g., Jenkins, GitLab CI, AWS CodePipeline).
Strong problem-solving skills and the ability to diagnose and resolve complex technical issues, especially during migration.
Excellent communication, interpersonal, and leadership skills, with the ability to effectively collaborate with cross-functional teams and mentor junior engineers.
Preferred Qualifications:
1. AWS Certifications (e.g., AWS Certified Solutions Architect - Associate/Professional).
2. Experience with containerization technologies (Docker, Kubernetes).
3. Experience in the Financial services sector, particularly in environments with complex legacy systems.
...Employment Type: Independent Contractor (1099) About the Role: We are seeking experienced and compassionate Spanish Medical Interpreters to provide in-person interpretation services at a well-known Cancer centerin Seattle. Interpreters play a vital role in...
...Assignment description: Field Force Merchandising is currently seeking part time retail service merchandisers to maintain GREETING CARD displays once per month. Pay rate $17 per hour HIRING ASAP This is an Independent Contractor position Although this is...
...to be part of Wizards of the Coast which is a division of Hasbro. We are looking for a highly technical and creative Sound Design Lead to join our team at Atomic Arcade. As Sound Design Lead, reporting to the Audio Director, you will be instrumental in shaping...
...testing company in the Florida Panhandle. H2's sister company is looking for an energetic and organized individual to fill our Medical Office Manager job in our Santa Rosa Beach, FL location. This job is perfect for a qualified CMA that is wanting to take the next step...
...improvement department stores, seeking full-time candidates who are dependable, reliable, and capable of performing a physical job while working independently. Our Delivery Drivers operate a 26 ft. box truck to deliver large and bulky items in Littleton, NH and the...