We are seeking a REMOTE Data Engineer to join the Pharmacy team at a large provider/payor.
Responsibilities
Design, develop, and implement end-to-end data solutions using Azure Databricks and other relevant technologies.
Build and maintain scalable data pipelines to extract, transform, and load large volumes of data from various sources.
Collaborate with cross-functional teams to analyze data requirements and translate them into technical specifications.
Ensure data quality and integrity by implementing data validation and cleansing processes.
Optimize data processing and storage for improved performance and efficiency.
Conduct data profiling, analysis, and modeling to identify opportunities for data-driven insights and recommendations.
Monitor and troubleshoot data pipelines and processes to ensure continuous data flow and availability.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to .
To learn more about how we collect, keep, and process your private information, please review Insight Global’s Workforce Privacy Policy: .
Required Skills & Experience
3+ years of most-recent experience as a Data Engineer in an Azure, not AWS, environment, building code, and QA’ing it.
Proficient in programming languages such as Python, PySpark, Scala, and SQL.
Strong experience with Azure Databricks and other Azure services, such as Azure Data Factory and Azure SQL Database.
Healthcare data experience (at a payor/provider, familiar with HIPPA regulations)
Experience with data integration, transformation and orchestration frameworks such as Airflow, dbt, Fivetran or similar
Solid understanding of data engineering principles, including data modeling, data integration, and data architecture.
Use of tools such as Git, GitHub Actions, Agile, Jira and Confluence or similar.
Clear interpersonal communication to work closely with the business, and to ask the right questions/translate business needs into optimized and efficient data models in SQL or NoSQL.
Experience in a large organization, and ability to work that kind of fast-paced, deadline-driven environment.
Nice to Have Skills & Experience
Medallion Architecture experience
Experience with Agile methodologies
Relevant certifications in Azure Databricks or related technologies
Pharmacy data experience
Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.
PySpark Git Azure Data Factory fivetran Agile Azure SQL Database Scala Python GitHub Actions Data Engineering Confluence Medallion Architecture Jira SQL Airflow NoSQL azure-databricks DBT