*We are open to supporting 100% remote work anywhere within the US. * Our IT Modernization division is an information technology and management consulting department that offers integrated, strategic solutions to its public and private-sector clients. ICF has the expertise, agility, and commitment to design, build, and operate high-performance IT engines to support all aspects of our client’s business. Job Description: The Data Engineer will use a variety of full-stack software languages and tools to build a data processing system for health care data in a major Health & Sciences agency. The system will be built on and Azure infrastructure and will integrate data from both internal and external data sources. The Data Engineer will create new pipelines and build reusable components at scale to support reporting & analytics data products. You will: Write complex queries to transform raw data sources into accessible models by coding. Clean, prepare, transform, and optimize data at scale for integration and consumption. Implement data management projects and restructure current web architecture. Solve complex data issues and perform root cause analysis to proactively resolve product issues. Own the data pipeline and support systems failures. Requirements: Must have previous experience working with any CDC Center, Institute, or Office or specific CDC application(s) that are in scope for modernization 3+ years of experience programming with Java and/or Kotlin 3+ years of experience working with Azure cloud native technologies 2+ years of experience building a pipeline for Public health/health care data (HL7, FHIR, vocabulary, and HHS data standards) 2+ years experience with developing ETL pipelines in Azure using tools such as Azure Data factory, Event hubs, Event grid, Azure functions, 2+ years developing data engineering pipeline with Databricks or Spark 2+ years of experience working in Agile teams Familiar with devOps process, CI/CD, security, coding standard and SDLC cycle Preferred: 1+ year working with technologies such as CosmoDB, AzureSQL, Redis, Synapse 1+ year working with orchestration tool such as Airflow or Oozie Experience working with streaming and batching solutions Experience working with csv, json, xml and complex structures #DMX #LI-CC1 #Indeed Working at ICF ICF is a global advisory and technology services provider, but we’re not your typical consultants. We combine unmatched expertise with cutting-edge technology to help clients solve their most complex challenges, navigate change, and shape the future. We can only solve the world’s toughest challenges by building an inclusive workplace that allows everyone to thrive. We are an equal opportunity employer, committed to hiring regardless of any protected characteristic, such as race, ethnicity, national origin, color, sex, gender identity/expression, sexual orientation, religion, age, disability status, or military/veteran status. Together, our employees are empowered to share their expertise and collaborate with others to achieve personal and professional goals. For more information, please read our EEO & AA policy . Reasonable Accommodations are available, including, but not limited to, for disabled veterans, individuals with disabilities, and individuals with sincerely held religious beliefs, in all phases of the application and employment process. To request an accommodation please email and we will be happy to assist. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations. Read more about non-discrimination: Know Your Rights and Pay Transparency Statement. Pay Range – There are multiple factors that are considered in determining final pay for a position, including, but not limited to, relevant work experience, skills, certifications and competencies that align to the specified role, geographic location, education and certifications as well as contract provisions regarding labor categories that are specific to the position. The pay range for this position is: $82,673.00 – $140,544.00 Nationwide Remote Office (US99) #J-18808-Ljbffr
databricks Agile Apache Spark Data Engineering Azure JSON Kotlin hl7 oozie CSV hl7-fhir Airflow XML Java Redis ETL synapse