Expected, AWS, Amazon Redshift, Snowflake, Google BigQuery, SQL, Apache Spark, Apache Flink, Kinesis, Kafka
Optional, Python
Operating system, macOS
About the project, We are looking for a Staff Data Engineer who wants to join an outstanding engineering team that will develop a cutting-edge data platform in the insurance sector.
Your responsibilities, build standards and lead architectural efforts of the data processing platform, help to build a new generation data platform in the insurance sector,, gather even the most minuscule insights about what happens on the platform and with the customers and pull insights out of those for stakeholders,, run data experiments defined with Data Scientists, ML Engineers and stakeholders from pricing and analytics teams,, monitor the data trends and embrace innovation continually.
have a minimum of 8 years of hands-on experience in a software engineering team, have experience in leading complex data-related projects, have excellent AWS knowledge, have a proven track record in designing and developing data pipelines and data modelling solutions using modern processing frameworks, have experience with data warehouse technologies, like Amazon Redshift, Snowflake, Google BigQuery, have experience working with both NoSQL and SQL databases, have a very good grasp of batch processing using modern tools like AWS Glue, Apache Spark and Apache Flink, have excellent Python skills, deep understanding of best architecture design and development practices (i.a. TDD, ATDD, BDD, CI/CD), knowledge of test automation practices and techniques, Consumer Driven Contract testing, have an understanding of ML data ops environments i.e. SageMaker, have prior experience with streaming technologies such as Kinesis or Kafka, have prior experience with graph databases, are very well organised and have excellent communication and team skills, have an eye for detail and a curious mind, have a Kaizen mindset and believe continuous improvement is not a job but a habit, have excellent English skills, both written and spoken (C1+)
This is how we work on a project, BDD, TDD, Continuous Deployment, Continuous Integration
What we offer, remote first work environment (or you can work from our office in Wrocław if you fancy ;-), great company on-sites and Team buildings, working environment with experienced, self-driven contributors, ability to participate in international projects, private healthcare and multisport card
Benefits, sharing the costs of sports activities, private medical care, sharing the costs of professional training & courses, remote work opportunities, flexible working time, integration events
Values we stand for:, Getting things done: we are laser-focused on achieving business outcomes in a predictable manner., Built on trust: we are laser-focused on achieving business outcomes in a predictable manner., Baking quality in: we take pride in our craftsmanship and guarantee quality results at every stage., Winning together: partnership and teamwork are at the heart of how we operate.
SHAPED THOUGHTS sp. z o.o., We are a remote-first boutique software house company formed by a group of seasoned software experts (the average experience in the team is 12 years). What connected all of us, despite a long-term relationship, is a passion for building Great Software that matters. We believe in people, and our engineers have a real and direct impact on what and how we build things. We put extra effort into ensuring everyone can make a difference and grow among other experts.
apache-flink CI/CD macOS Python Apache Spark Amazon Web Services (AWS) Amazon Redshift Apache Kafka BDD Amazon Kinesis TDD snowflake-cloud-data-platform SQL Machine Learning atdd google-bigquery NoSQL aws-glue Amazon SageMaker