Expected, Google Cloud Platform, Big Query, Big Table, Dataflow, Kubernetes, Git
Optional, Python, Scala, Java, Google Cloud Monitoring
About the project, For one of our clients in the pipeline management industry, we are seeking experienced Senior Data Engineers / Infrastructure Programmers., , Suitable candidates should have experience in pipeline transformation projects and a technical domain knowledge in data transformation and data migration acquired through years of practice. The programming language is secondary in this regard.
Your responsibilities, Suitable candidates should have experience in pipeline transformation projects and a technical domain knowledge in data transformation and data migration acquired through years of practice.
a. Programming Experience:, Ability to write data transformation pipelines (ETL pipelines) in any of the following languages: Python, Scala, or Java (or preferably a mix), Knowledge of DataFrame structures and standard binary file formats (such as Parquet), Knowledge of common data lake patterns, b. Infrastructure Experience:, Experience with GCP data and pipeline components such as Big Query, Big Table, Dataflow, Kubernetes, d. DevOPS Experience:, Experience with developing in GCP’s CI/CD environment, Experience with Git, Experience with monitoring one’s own pipelines and components through services such as Google Cloud Monitoring or similar 1.
Team members, architect
Development opportunities we offer, technical knowledge exchange within the company
What we offer, Yearly bonus system, Training budget, Medical care, Sport card, Possibility of remote or hybrid work, Opportunity to work with high-class developers, learn, and share knowledge within and between teams
Benefits, remote work opportunities
SQUARE ONE RESOURCES sp. z o.o., At Square One Poland we link IT experts with the business. With over 25 years of experience, we specialize in recruitment processes on a global scale. Despite years of experience, we still have a startup DNA and this is our advantage. Our offices are located in London and Warsaw, however, we can reach clients from all over the world, from start-ups to big worldwide corporations.
This is how we work,
Architect Git CI/CD Scala Python Data Engineering Google Dataflow DevOps Google Cloud Platform (GCP) Kubernetes Java monitoring parquet