Cloud Data Engineer (Full Time-Remote)
Job Description:
We have an "immediate opening" for an experienced Cloud Data Engineer to work remote with the possibility of working onsite in Atlanta, GA at some point in the future. Facilitate coordination and implementation of CDC’s AI/ML strategy and enterprise AI/ML roadmap through performance of project management activities, data science support, development, and dissemination of informational and training related materials and artifacts for consumption by internal and external partners, and coordination and collaboration assistance with CDC programs, governance bodies, and STLT partners.
Responsibilities:
- Working with a multi-disciplinary team of scientists, data engineers, developers, and data consumers in a fast-paced, Agile environment
- Monitor and optimize data pipelines for performance, scalability, and cost-effectiveness.
- Opportunity to sharpen skills in analytical exploration and data examination while support the assessment, design, developing, and maintenance of scalable platforms for the clients.
Qualifications:
- Bachelor’s Degree with 3+ years of experience with extract, transform, load (ETL) operations with a focus on Azure technologies.
- 2+ years of experience with source control and collaboration software, including Git or Atlassian tools.
- Knowledge of Azure Batch and its application in processing large data sets.
- Experience with SQL and relational databases (e.g., Azure SQL Database, SQL Server).
- Experience with Python or R including experience with data manipulation libraries (e.g., Pandas, NumPy, Polars, Tidyverse)
- Strong problem-solving skills and ability to work independently and in a team environment.
- Proficiency in Azure Data Factory and its components
Desired Skills and Experience:
- Experience with developing pipeline utilizing Azure Batch and Azure Data Factory
- Familiarity with Apache Airflow or similar workflow orchestration tools
- Experience with Azure Synapse Analytics, Azure Databricks, or Azure Blob Storage.
- Familiarity with cloud security best practices and data governance
- Ability to quickly learn technical concepts and communicate with multiple functional groups.
Security Requirements:
- Must be US Citizen or with the ability to obtain a US Government security clearance (Public Trust 5) within a reasonable period.
- Market competitive salary, commensurate with experience and education.
- Comprehensive benefits package available, Medical, Dental, Vision and Life Insurance, Paid Time Off (PTO), 401K with company match, growth, and promotion opportunities.
We are an Equal Opportunity Employer/Veterans/Disabled