Become a pioneer in smart crop science development with us!
Warsaw-based opportunity with possibility to work partly remote (only 2 x month visits in office)
As a Data Engineer, you will work for our Client – a global enterprise using science and imagination to advance health and nutrition. You will be working on cutting-edge solutions in the area of crop science – monitoring yields, environmental impact of products, irrigation status, analysing data that will translate into environmental improvements. Join us and be a part of a global transformation to the world where farms are more sustainable, with plants that are more adaptive and resilient, to help improve life for families and communities.
Your main responsibilities:
- Create and maintain an optimal data quality, structure, pipeline, and processing architecture
- Build infrastructure required to optimally integrate, cleanse, and load data from diverse data sources using various modern cloud and big data technologies
- Address data platform quality attributes such as security, high availability, reliability, performance, etc
- Develop cloud data platform design skills and pass certified training
You’re ideal for the role if you have:
- Minimum 5 years of experience in the area of Data Engineering
- Experience in working with large amounts of data within SQL, Python, version control (git)
- Experience in building and optimizing data integrations, data pipelines, data architectures, and data sets with Apache Airflow or a similar tool
- Ability to create and maintain optimal data pipeline and data access architecture
- SQL and NoSQL database design, and Data Warehouse design skills
- Knowledge of data integration patterns and tools (Kafka, pub-sub, SQS or similar)
- Good analytical capabilities
- Experience with at least one cloud provider (AWS, GCP, Azure)
- Ability to architect build and manage robust and scalable data pipeline
- Excellent communication skills
- Fluent English
It’s nice if you have:
- Knowledge of ML algorithms and familiarity with ML frameworks like TensorFlow, PyTorch, etc
- Cloud certification
- Knowledge of R language
We offer you:
ITDS Business Consultants is involved in many various, innovative and professional IT projects for international companies in the financial industry in Europe. We offer an environment for professional, ambitious, and driven people. The offer includes:
- Stable and long-term cooperation with very good conditions
- Enhance your skills and develop your expertise in the financial industry
- Work on the most strategic projects available in the market
- Define your career roadmap and develop yourself in the best and fastest possible way by delivering strategic projects for different clients of ITDS over several years
- Participate in Social Events, training, and work in an international environment
- Access to attractive Medical Package
- Access to Multisport Program
#5352
Git Python Amazon Web Services (AWS) Apache Kafka Data Engineering Azure Google Cloud Platform (GCP) SQL Airflow Machine Learning TensorFlow NoSQL PyTorch