Building Location: Peerless Building Department: 47670 Analytics & Architecture Job Description: The Data Engineer is responsible for developing data pipelines with a focus on scalability, maintainability, performance, and quality. Collaborates with stakeholders and peers across the organization to develop data driven solutions to improve patient care, outcomes, and optimize business operations. The data engineer plays a key role in the enterprise data lake development and success. The Data Engineer works directly with key technology partners to develop and deploy modern data management infrastructure and processes. Successful candidates will have a forward-looking vision focused on data engineering and data operations. Individuals who thrive on having opportunities for innovation will find this role rewarding. Key Responsibilities:
- Work with teams and key stakeholders to gather requirements and develop data driven solutions
- Lead teams through complex projects using agile development methodology
- Design, develop and implement scalable data workflows and pipelines, and integrate diverse data sources across the system
- Implement CI/CD processes to optimize management, reliability, and scalability of solutions
- Design, build and manage solutions for data profiling, quality assurance, and data observability to meet SLA’s
- Evaluate, recommend, and implement tools and technologies to modernize and scale data management solutions to meet current and future business needs
- Support Data Governance activities, best practice process adherence, and manage technical documentation
Work Experience:
- 5 years of recent experience in Data Engineering or related area to include 2 years working hands-on with Data Engineering tools and technologies in a cloud-based environment (Public, Private or Hybrid)
- ETL Data integration development experience with tools such as SSIS or Informatica
- Advanced knowledge of a programming language such as Python, Java, C++, C#
- Experience with data governance frameworks, SDLC, and Agile methodology
- Proficient working in Linux environments
- Self-starter; able to work independently as well as in a team environment
Preferred Qualifications:
- Working knowledge of hybrid or virtual data lake platforms such as Denodo or Dremio
- Experience with object storage and big data file formats such as ORC, Avro, and Parquet
- Hands-on experience working with containerization tools like Docker and orchestration tools such as Kubernetes, VMware Tanzu, Google Anthos, Red Hat OpenShift, Rancher
- Apache Airflow, Nifi, Spark experience preferred
Education Qualifications: BS in Computer Science, Mathematics, Engineering, Information Technology, or related field Licensure/Certification Qualifications: No certification/licensure required. FTE: 1 Possible Remote/Hybrid Option: Remote Shift Rotation: Day Rotation (United States of America) Shift Start Time: 8:00 Shift End Time: 4:30 Weekends: Holidays: No Call Obligation: No Union: Union Posting Deadline: To search for more jobs, please CLICK HERE ( . Find more than a job. Find more in yourself. Find your calling. Essentia Health seeks employees who embrace our commitment to patient- and family-centered care in communities both large and small. We’re looking for people who are committed to making patients and their families feel known and understood. People who understand what it means to be Here with you. People who are willing to use their strengths to help others. Our Values Quality | Hospitality | Respect | Joy | Justice | Stewardship | Teamwork Essentia Health is an Equal Opportunity/Affirmative Action Employer. Essentia Health does not discriminate in employment because of age, color, creed, culture, disability (physical or mental), ethnicity, familial status, gender identity or expression, genetic information, language, local Human Rights Commission activity, national origin, military service, race, religion, sex, sexual orientation, socioeconomic status, or public assistance status. Effective December 1, 2019: Job offers are contingent upon successful completion of a post-offer assessment, including a urine drug screen, immunization review, proof of required vaccinations and background check. Essentia Health is committed to maintaining a work environment free from the influence of illegal drugs and alcohol. Equal Employment Opportunity (EEO) at Essentia It is our policy to afford EEO to all individuals, regardless of race, religion, color, sex, pregnancy, gender identity, national origin, age, disability, family medical history, genetic information, sexual orientation, marital status, military service or veteran status, culture, socio-economic status, status with regard to public assistance, and other factors not related to qualifications, including employees or applicants who inquire about, discuss, or disclose their compensation or the compensation of other employees or applicants, or membership or activity in a local human rights commission, or any other category as defined by law.
Informatica denodo Python Apache Spark Data Engineering apache-nifi avro Linux C++ SQL Server Integration Services (SSIS) orc Docker Airflow Kubernetes Java rancher parquet dremio C#