- 10+ years of Software Engineering experience in data platform/big data software, with a proven track record of delivering highly scalable and efficient solutions
- Substantial experience with Java 8+ (preferred), Scala or Python
- Experience with streaming/data processing technologies such as Beam, Spark, Kafka, Airflow, HBase, Presto
- Experience in building enterprise-grade software in a cloud-native environment (GCP or AWS) using cloud services
- Experience in system architecture and design
- Familiarity with designing CI/CD pipelines with Jenkins, Github Actions, or similar tools
- Experience with Kubernetes using GKE/EKS
- Experience with SQL, particularly performance optimization (nice to have)
- Experience with Graph and Vector databases or processing frameworks (nice to have)
- Bachelorās degree in Computer Science, Software Engineering, or related field
- Excellent communication skills and a pragmatic approach to problem-solving
Donāt worry if you donāt meet all the requirements. What matters most is your passion and willingness to develop. Moreover, B2B does not have to be the only form of cooperation. Apply and find out!
We are #VLteam ā tech enthusiasts constantly striving for growth. The team is our foundation, thatās why we care the most about the friendly atmosphere, a lot of self-development opportunities, and good working conditions. Trust and autonomy are two essential qualities that drive our performance. We simply believe in the idea of āāāmeasuring outcomes, not hoursā. Join us & see for yourself!
Project: Zephyr Data Platform
Project Scope
Our Client is a NASDAQ-listed company with a portfolio of different solutions supporting Go-To-Market strategy. With a comprehensive B2B database, our clientās platform puts sales and marketing professionals in a position to identify, connect, and engage with qualified prospects.
The mission is to provide every company with a 360-degree view of their ideal customer, empowering each phase of their go-to-market strategy and driving their ability to hit their number.
As a Data Platform Engineer on our team, you’ll play a crucial role in designing, implementing, and deploying Data Platforms for our customers.
We seek an experienced software engineer skilled in developing large-scale data pipelines/systems, with strong problem-solving abilities and experience at a vast scale. Youāll lead innovation, swiftly test and validate new concepts, and integrate them, ensuring team collaboration.
Tech Stack
Java, Beam, Spark, Kafka, Airflow, HBase, Presto, AWS and GCP (Dataflow/Glue, Dataproc/EMR, Cloud Function/Lambda, BigQuery/Athena, BigTable/Dynamo).
Challenges
- Design, build, and operate highly scalable and flexible systems that can manage and process billions of records a day and support complex and diversified data pipelines
- Leverage cloud computing architectures to support development needs
- Track and identify relevant new technologies in the market and push their implementation into our pipelines through research and prototyping
- Develop processes and tools to monitor, analyze, maintain, and improve data operation, performance, and usability.
Team
Currently, there is 1 person from VL working there, and there are 9 open positions. The team is primarily based in the US and Israel.
Requirements: Big Data, Beam, Spark, SQL, Kubernetes, AWS, GCP, CI/CD, Java/Scala/Python, Java, Kafka/BigQuery/Airflow Additionally: Building tech community, Flexible hybrid work model, Home office reimbursement, Language lessons, MyBenefit points, Private healthcare, Stretching, Training Package, Virtusity / in-house training, Bike parking, Shower, Free snacks, No dress code, Modern office, Free coffee, Free beverages, Kitchen.
Google Kubernetes Engine (GKE) HBase CI/CD Scala Python Apache Spark Apache Kafka amazon-eks graph SQL Airflow Kubernetes Java presto Vector databases Data Platforms beam Software Engineer