Correct Context is looking for a Senior Spark Scala/Java Developer for Comscore in Poland and around.
Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement.
Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge technology, play a vital role as a trusted partner delivering accurate data to global businesses, and collaborate with industry leaders like Facebook, Disney, and Amazon. Contribute to empowering businesses in the digital era across media, advertising, e-commerce, and technology sectors.
We offer:
- Real big data projects – petabyte scale/thousands of servers / billion of events
- An international team (US/PL/IE/IN/CL/NL) – slack+zoom+english is standard set
- Hands-on experience – you have the power to execute your ideas and improve stuff
- Quite a lot of autonomy in how to execute things
- A small, independent teams’ working environment
- Flexible work time ⏰
- Fully remote or in-office work in Wroclaw, Poland
- Up to 30 000 PLN net/month B2B (optional other forms)
- Private healthcare
- Multikafeteria ️
- Free parking
As a Spark Developer, you’ll:
- Design, implement, and maintain Big data pipelines, petabyte scale
- Play key role in technical decision making
- Have full hands-on responsibility on technical solutions
- Plan out and coordinate technical deliverables
- Optimize – working with Big data is very specific, sometimes it’s IO/CPU-bound, depending on the process, we need to figure out a faster way of doing things. At least empirical knowledge of calculation complexity, as in Big data, even simple operations, when you multiply by the size of the dataset can be costly
- Conducting Proof of Concept (PoC) for enhancements.
- Writing great and performant Big Data processes in pipelines
- Cooperation with other Big data teams
- Work with technologies like AWS, Kubernetes, Airflow, EMR, Hadoop, Linux/Ubuntu, Kafka, and Spark
- Use Slack and Zoom for communication
An ideal candidate would have:
- 5+ years of experience with Linux
- Solid experience in Scala or Java. 5+ years of commercial experience
- Deep understanding of Spark internals
- Huge need to drive projects of the future, improve stuff, risk taking mindset
- Experience with cloud technologies (preferably AWS, but any other cloud technology is acceptable)
- Great communication skills (you can drive end-to-end projects, and guide dev team members)
- Professional working proficiency in English (both oral and written)
- Understanding of API communication patterns (
- Good programming/debugging skills in at least one programming language (on top of Bash)
- Good understanding of Git
If you don’t have all the qualifications, but you’re interested in what we do and you have a solid Linux understanding -> let’s talk!
We are looking for Senior Spark Developers for multiple teams in Comscore. Some of the teams are working in PL, and some of them are working with East or West US.
For East and West US collaboration, there is no full timezone coverage needed, but there is an idea to start with 3x a week EST coverage (up to 9-10 pm PL time) which would potentially decrease over time, and your exp is built, when trust is built and when you know how to run stuff without breaking it.
The recruitment process for the Senior Spark Developer position has four steps:
- Technical screening – 30 min
- Technical task (optional, 1 out of 4 spark teams want to have codility test, async) – ~2h
- Technical interview – 1h
- Interview with Manager – ~30 min
Big data Git Scala Airflow Kubernetes Java Apache Spark Amazon Web Services (AWS) Hadoop Linux Amazon EMR