Job Description Our Client is looking for a data engineer. As a member of the global data engineering team, reporting to the Data and Analytics Manager, this role has a primary focus on contributing to our enterprise data movement, warehousing and reporting deliverables. Responsibilities include designing, creating, and maintaining business intelligence assets, pipelines and reports that drive innovation, client value and business efficiency. This position will be working across our client’s largest business units and experience with multi-terabyte database systems is required. Assisting primarily through maintaining and implementing an array of data synchronization efforts across numerous systems both on-premises and in the cloud. You will coordinate with their data architects, product management, and IT management to ensure that their data pipelines for both internal operations and customer reporting are accurate, scalable, and secure.
- Building our enterprise data movement capability for ingestion to snowflake.
- ELT development primarily with a mixture of SQL and Python.
- Contribute to cloud migration and ensure system uptime for data warehouse products.
- Centralizing orchestration of scheduled data pipelines and automated processes.
- Participate in Agile work planning, testing, and quality assurance.
Education qualifications:
- BA/BS degree in Computer Science, Computer Engineering, or related field, or equivalent practical experience.
- Preferred Qualifications include: Expertise in parallel processing warehouses (Snowflake/Redshift), high-frequency differential ETL processes, and Agile development methodology.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to . To learn more about how we collect, keep, and process your private information, please review Insight Global’s Workforce Privacy Policy: . Skills and Requirements
- 3-5 years Data engineering experience
- Python – Snowflake
- ELT exp with SQL and Python
- Cloud migration experience
- CI/CD pipelines
- Powershell
- Adept at designing and implementing effective data models and Extract, Transform, Load (ETL) * Business Intelligence/reporting tools including Microsoft SQL, SRSS, SSIS, SSAS, Power BI, DAX
- Experience incorporating data from varied relational systems (e.g. MySQL, Postgres etc), flat-file, API, and No-SQL sources
- Prior use of orchestration tools such as Prefect or Dagster
- Snowflake, DBT or Coalesce, Fivetran
- Agile environment experience null
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to .
PostgreSQL fivetran Agile CI/CD API powershell Python Amazon Redshift Microsoft SQL Server snowflake-cloud-data-platform coalesce SQL Server Integration Services (SSIS) SQL DAX NoSQL dagster Prefect MySQL Power BI SSAS DBT