Data Engineer We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will be responsible for designing, implementing, and maintaining ETL processes for both structured and unstructured data. Experience with Microsoft Dynamics 365 and the Dataverse is highly desirable, as well as proficiency in Python scripting. The successful candidate will play a crucial role in ensuring the efficient and secure handling of data, contributing to the optimization of our data infrastructure. Pay Range: $120,000 – $165,000 Travel Up To – 20% You Will: Design, develop, and maintain ETL processes for structured and unstructured data. Integrate data from various sources into our data infrastructure. Optimize and tune ETL processes for performance and reliability. Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and provide robust solutions. Implement data validation and quality checks to ensure data accuracy and integrity. Develop and maintain documentation for ETL processes and data workflows. Monitor ETL jobs and data pipelines, addressing issues promptly. Ensure data security and compliance with relevant regulations. Work with Microsoft Dynamics 365 and Dataverse to integrate and manage data. Utilize Python scripting for data manipulation, automation, and integration tasks. Stay up-to-date with emerging technologies and best practices in data engineering. Support data migration projects and contribute to cloud data integration initiatives. You Have: Bachelor’s degree in Computer Science, Information Technology, or a related field. Proven experience as a Data Engineer or in a similar role. Experience with Microsoft Azure Data Factory, Data Lake Storage Gen2, Azure Blob Storage. Experience migrating data from Microsoft SQL Server Databases into Microsoft Dataverse. Experience with Cloud Platforms to just what the CG has (Microsoft Azure Gov Cloud or Amazon Web Service Gov Cloud). Experience migrating multiple data formats from and to Microsoft SharePoint Online. Experience in Oracle Web Logic Server Expertise in ETL processes for both structured and unstructured data. Experience with Microsoft Dynamics 365 Customer Service and Dataverse. Proficiency in Python scripting. Strong understanding of data architecture, data modeling, and database design principles. Familiarity with SQL and noSQL databases. Experience with data integration tools and platforms. Knowledge of data security and privacy best practices. Excellent problem-solving and analytical skills. Effective communication and collaboration skills. Ability to work independently and as part of a team. This position offers a unique opportunity to contribute to the optimization and security of our data infrastructure. If you are passionate about data engineering and have the required skills and experience, we encourage you to apply. Want to hear more? Read on to see what our Team Members say about their experience:
- Atlas Tech has the culture, trust, and fairness that you expect of the best of communities. I feel lucky to be part of their amazing journey of growth as a standout organization.” – Syed
- You are not just a number here at Atlas. I have been with Atlas for over 13 years now I can say that Atlas displays a genuine interest in its employees. This is evidenced in its commitment to mentoring every employee and providing educational paths for each employee’s personal and professional growth within the company.” – Ian
Atlas Tech offers a competitive salary, generous benefits package, and an opportunity to make a positive impact in your own community.
SQL Python cloud-platforms ETL Data Engineering NoSQL dynamics-365 Microsoft SQL Server azure-blob-storage Dataverse