Search Results for: Apache Spark

Form of cooperation: B2B Remote work Rate: 130-140 PLN/h net+VAT Responsibilities: Implement Medallion Architecture: Apply the medallion architecture to organise data layers (Bronze, Silver, Gold) within the Lakehouse, ensuring progressive enhancement of data quality. Design and Optimize Data Storage: Develop scalable and secure data storage solutions that align with the medallion architecture principles. […]

Essential:  3+ years of relevant professional experience, including 2+ of DS/Operations Research experience.  Experience in optimization methodologies, including use of various optimization libraries (e.g. CPLEX, Gurobi, ortools, etc.).  Strong Python coding skills (including Object oriented programming concepts), including using ML libraries and basic working knowledge of SQL Experience working in […]

Client needs help to establish an infrastructure foundation on Google Cloud Platform (GCP) and migrate their current legacy data lake to a manageable, scalable, and secure data lake in the cloud that can provide the data analytics capabilities necessary to meet their growing needs. Client needs help assess, design, plan, […]

Higher educational level within IT or related At least 5 years of experience within data engineering Strong proficiency in Python programming Extensive experience with Azure, including Azure Data Factory and Azure Databricks, and a deep understanding of Azure architecture and services Experience in using Spark, including Spark SQL and understanding […]

Expected, Apache Spark, Google Cloud Platform, AWS, Azure DevOps, Python, Scala, Big Data, Apache Airflow Optional, Docker, Snowflake Data Cloud, Databricks, Kafka Your responsibilities, Our team members tend to stick around for more than 3 years, and when a project wraps up, we don’t let them go – we embark […]

3+ years of experience in Linux administration; Familiarity with containerization and container orchestration platforms such as Kubernetes; Knowledge of the TCP/IP networking stack; Experience with message queue systems such as Apache Kafka; Familiarity with MySQL, PostgreSQL, Aerospike, or other NoSQL solutions; Strong troubleshooting skills and fundamental application debugging skills; Excellent […]

A minimum of 3 years of practical development experience Experience in creating data-oriented products, preferably using Java Willingness to work with Python Experience with distributed databases like Elasticsearch, MongoDB, or Redis Experience in developing microservices-based architecture Proficiency in container-based environments, using tools such as Kubernetes and Helm. Experience as a […]

Wymagane, Jira, Splunk, Postman, SoapUI, SQL O projekcie, Czy kiedykolwiek chciałeś/aś tworzyć rozwiązania ułatwiające życie milionom ludzi? Z nami możesz na co dzień mierzyć się z tym wyzwaniem i dostarczać oprogramowanie dla największych banków w Polsce!, , Od lat współpracujemy z liderami w sektorze finansowym – m.in. Santander, mBank, PKO […]

Expected, Django, Flask Optional, SQL, Vector DB, Docker, Go, AWS About the project, We’re looking for an experienced Python Developer with 4 years of commercial experience , who will join our existing team of 4 working Developers on an AI Product for the Client from the US. The project is […]

Pozíció leírása: What you’ll do: Build data pipelines that soar from legacy warehouses to dynamic data lakes, like airplanes through the clouds. Collaborate with cross-functional BI teams, navigating through diverse business units like Safety, Security, and Crisis Management. Deliver data solutions as sturdy as airplane wings, ensuring seamless operation and […]