Data Engineer at MP Solutions Ltd. #vacancy #remote

Design, implementation, consulting, operation, support. Covering a wide range of IT disciplines, our partner is at the forefront of supporting complex projects in various sectors including telco, financial, health informatics, and energy. They specialize in project support and consulting, implementing both Hungarian and international projects.

  • Developing and testing NiFi data flows, including ingesting data from various sources such as Snowflake, Azure Data Services, and REST API.
  • Performing data mapping, transformation, and publishing the data to destination systems.
  • Implementing CI/CD best practices across different teams.
  • Ensuring compliance of the solution with technical design standards and architecture.
  • Proficiency in conversational English is required.
  • Flexibility to work on-site for 3 days per week in Budapest XIII.
  • In the case of junior or mid-level candidates, providing professional mentoring to enhance their ability to quickly learn requirements analysis and system design.

Requirements

Experience in the implementation of data processing pipelines, such as ETL processes and Big Data data flows, is required. Additionally, proficiency in at least two of the following technologies is necessary:

  • Apache NiFi
  • Apache Kafka
  • Snowflake
  • Rapid Response
  • Postgre
  • Azure Data Services
  • Azure Event Hubs
  • Airflow
  • DAG
  • Python

Benefits

  • Join a small team of passionate, driven, and skilled colleagues utilizing cutting edge technologies.
  • Engage in relevant training and certification programs to acquire and maintain the necessary knowledge to excel.
  • Share and embrace our mission and core values that resonate with your own aspirations.
  • Benefit from a fantastic company culture that prioritizes both business excellence and enjoyment through frequent team events and more.
  • Thrive in an informal, entrepreneurial, and flexible environment that fosters innovative thinking.

PostgreSQL REST CI/CD Python Data Engineering Apache Kafka apache-nifi Azure Data Services snowflake-cloud-data-platform Big data Azure EventHubs Airflow directed-acyclic-graphs ETL

Залишити відповідь