Tasks:
- Designing and implementing data processing systems on Azure platform. This involves writing efficient and scalable code to process, transform, and clean large volumes of structured and unstructured data.
- Building data pipelines to ingest data from various sources such as databases, APIs, or streaming platforms.
- Integrating and transforming data to ensure its compatibility with the target data model or format.
- Hands-on experience in designing and optimizing of data storage (data lakes, data warehouses, distributed file systems).
- Familiarity with partitioning, compression, optimization of data storage and retrieval.
- Identifying and resolving bottlenecks, tuning queries, and implementing caching strategies to enhance data retrieval speed and overall system efficiency.
- Collaborating with cross-functional teams including data scientists, analysts, and business stakeholders to understand their requirements and provide technical solutions.
- Independence and responsibility in delivering solutions.
- Ability to work under agile methodologies.
Requirements:
- Proven experience in Azure cloud-based infrastructure, Databricks and one of SQL implementation (e.g., Oracle, T-SQL, MySQL, etc.).
- At least 4 years of experience within Data&Analytics
- Very good level of communication including ability to convey information clearly and specifically to co-workers and business stakeholders.
- Working experience in the agile methodologies – supporting tools (JIRA, Azure DevOps).
- English at least at B2 level, ideally C1.
- Experience or familiarity with other cloud technologies, data warehouses, data governance, and business analysis is a plus.
Nice to have:
- Knowledge of Python
- Programming skills for data analysis (especially PySpark, SparkSQL)
We offer:
- Stable employment. On the market since 2008, 1300+ talents currently on board in 7 global sites.
- “Office as an option” model. You can choose to work remotely or in the office, depending on your location.
- Flexibility regarding working hours and your preferred form of contract.
- Comprehensive online onboarding program with a “Buddy” from day 1.
- Cooperation with top-tier engineers and experts.
- Unlimited access to the Udemy learning platform from day 1.
- Certificate training programs. Lingarians earn 500+ technology certificates yearly.
- Upskilling support. Capability development programs, Competency Centers, knowledge sharing sessions, community webinars, 110+ training opportunities yearly.
- Internal Gallup Certified Strengths Coach to support your growth.
- Grow as we grow as a company. 76% of our managers are internal promotions.
- A diverse, inclusive, and values-driven community.
- Autonomy to choose the way you work. We trust your ideas.
- Create our community together. Refer your friends to receive bonuses.
- Activities to support your well-being and health.
- Plenty of opportunities to donate to charities and support the environment.
- Modern office equipment. Purchased for you or available to borrow, depending on your location.
databricks PySpark Agile compression query-optimization Python Data Storage Azure Data Engineer optimization Communication Jira SQL data-pipelines Azure DevOps data-processing partitioning