DivIHN (pronounced divine ) is a CMMI ML3-certified Technology and Talent solutions firm. Driven by a unique Purpose, Culture, and Value Delivery Model, we enable meaningful connections between talented professionals and forward-thinking organizations. Since our formation in 2002, organizations across commercial and public sectors have been trusting us to help build their teams with exceptional temporary and permanent talent. Visit us at to learn more and view our open positions. Please apply or call one of us to learn more For further inquiries regarding the following opportunity, please contact one of our Talent Specialists Dipankar at Saravanan at Title: Principal Data Engineer II (REMOTE) Location: Remote Duration: 6 Months Description: Essential Duties and Responsibilities Performs a combination of duties in accordance with departmental guidelines: Acts as the principal builder of large-scale data processing systems and data lakes, optimized for both computational and storage efficiency on Google Cloud Platform. Applies deep technical knowledge on data modeling and best engineering practices. Independently delivers results, creating value for the Client brand, customers, and key internal stakeholders. Works with external (and offshore) resources as required. Leads the design, implementation and automation of data pipelines sourcing data from internal and external systems, transforming the data for the optimal needs of various systems and business requirements. Leads robust unit testing to ensure deliverables match the design and provides expertise to support subsequent release testing. Actively adheres to established quality and reliability standards, and ensures team adheres to the same quality and standards working in an Agile development environment. Leads the design of complex physical data models, projects and cloud-based data lake constructs including SQL/NoSQL database systems. Leads the creation of integrated data views based on business or analytics requirements. Researches and leads the identification and implementation of process improvements that address complex technology gaps. Builds strong knowledge of technology enablers. Leads the design and building of data solutions and applications that enable reporting, analytics, data science, and data management. Maintains professional and technical knowledge by attending educational workshops; reviewing professional publications; establishing personal networks; participating in professional societies. Drives the evolution of Client’s application development processes and standards. Applies machine learning to work as applicable. May perform additional duties as assigned. Skills, Knowledge and Abilities Expert knowledge of relational database concepts, ETL/ELT, star schema, data modeling. Expert knowledge of data integration design and development, ensuring accuracy and ease of consumption. Strong troubleshooting and problem solving skills. Proficient in Python or advanced SQL in a business environment with large-scale, complex datasets. Excellent communication and interpersonal skills and the ability to work effectively with peers and team members in a highly matrixed environment. Strong experience in building data analytics solutions using Google Cloud Platform services such as Google BigQuery, Cloud Storage, Dataflow, DataProc, Pub/Sub, Cloud Composer, or DataPrep. AWS, including, Amazon Redshift, Postgres, Elastic MapReduce a plus. Preferred experience with the insurance industry, its products and services. Strong experience in implementing big data processing technology. Apache Spark preferred. Working knowledge of Business Intelligence tools. Education and Experience Bachelor’s degree with Master’s preferred in Computer Science, Information Technology, related discipline or equivalent work experience. Typically 7 years of experience in data, analytics or application development. 3 years of coding proficiency in at least one programming language (Python, Java, SQL). Experience using Agile methods preferred. Previous project leadership experience preferred. Applicable certifications preferred (GCP, Data Engineering). Language: English ( Read, Write and Speak) About us: DivIHN , the ‘IT Asset Performance Services’ organization, provides Professional Consulting, Custom Projects, and Professional Resource Augmentation services to clients in the Mid-West and beyond. The strategic characteristics of the organization are Standardization, Specialization, and Collaboration. DivIHN is an equal opportunity employer. DivIHN does not and shall not discriminate against any employee or qualified applicant on the basis of race, color, religion (creed), gender, gender expression, age, national origin (ancestry), disability, marital status, sexual orientation, or military status.
cloud-storage Business Intelligence (BI) Python Apache Spark Amazon Web Services (AWS) Data Engineering ELT Google Dataflow google-cloud-composer dataproc Google Cloud Platform (GCP) publish-subscribe SQL ETL google-bigquery