Azure Data Engineer at Lingaro #vacancy #remote

Tasks:

  • Designing and implementing data processing systems on Azure platform. This involves writing efficient and scalable code to process, transform, and clean large volumes of structured and unstructured data.
  • Building data pipelines to ingest data from various sources such as databases, APIs, or streaming platforms.
  • Integrating and transforming data to ensure its compatibility with the target data model or format.
  • Hands-on experience in designing and optimizing of data storage (data lakes, data warehouses, distributed file systems).
  • Familiarity with partitioning, compression, optimization of data storage and retrieval.
  • Identifying and resolving bottlenecks, tuning queries, and implementing caching strategies to enhance data retrieval speed and overall system efficiency.
  • Collaborating with cross-functional teams including data scientists, analysts, and business stakeholders to understand their requirements and provide technical solutions.
  • Independence and responsibility in delivering solutions.
  • Ability to work under agile methodologies.

Requirements: 

  • Proven experience in Azure cloud-based infrastructure, Databricks and one of SQL implementation (e.g., Oracle, T-SQL, MySQL, etc.).
  • At least 4 years of experience within Data&Analytics
  • Very good level of communication including ability to convey information clearly and specifically to co-workers and business stakeholders.
  • Working experience in the agile methodologies – supporting tools (JIRA, Azure DevOps).
  • English at least at B2 level, ideally C1.
  • Experience or familiarity with other cloud technologies, data warehouses, data governance, and business analysis is a plus.

Nice to have:

  • Knowledge of Python
  • Programming skills for data analysis (especially PySpark, SparkSQL)

We offer:

  • Stable employment. On the market since 2008, 1300+ talents currently on board in 7 global sites.
  • “Office as an option” model. You can choose to work remotely or in the office, depending on your location. 
  • Flexibility regarding working hours and your preferred form of contract.  
  • Comprehensive online onboarding program with a “Buddy” from day 1.
  • Cooperation with top-tier engineers and experts. 
  • Unlimited access to the Udemy learning platform from day 1.
  • Certificate training programs. Lingarians earn 500+ technology certificates yearly. 
  • Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly.
  • Internal Gallup Certified Strengths Coach to support your growth.
  • Grow as we grow as a company. 76% of our managers are internal promotions.
  • A diverse, inclusive, and values-driven community.
  • Autonomy to choose the way you work. We trust your ideas. 
  • Create our community together. Refer your friends to receive bonuses. 
  • Activities to support your  well-being and health.
  • Plenty of opportunities to donate to charities and support the environment. 
  • Modern office equipment.  Purchased for you or available to borrow, depending on your location.

databricks PySpark Agile compression query-optimization Python Data Storage Azure Data Engineer optimization Communication Jira SQL data-pipelines Azure DevOps data-processing partitioning

Залишити відповідь