Correct Context is looking for Spark Scala/Java Developer for Comscore in Poland and around.
Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement.
Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge technology, play a vital role as a trusted partner delivering accurate data to global businesses, and collaborate with industry leaders like Facebook, Disney, and Amazon. Contribute to empowering businesses in the digital era across media, advertising, e-commerce, and technology sectors.
We offer:
- Real big data projects – petabyte scale/thousands of servers / billion of events
- An international team (US/PL/IE/IN/CL/NL) – slack+zoom+english is standard set
- Hands-on experience – you have the power to execute your ideas and improve stuff
- Quite a lot of autonomy in how to execute things
- A small, independent teams’ working environment
- Flexible work time ⏰
- Fully remote or in-office work in Wroclaw, Poland
- 10 000 – 20 000 PLN net/month B2B (optional other forms)
- Private healthcare
- Multikafeteria ️
- Free parking
As a Spark Developer, you’ll:
- Design, implement, and maintain Big data pipelines, petabyte-scale
- Optimize – working with Big data is very specific, sometimes it’s IO/CPU-bound, depending on the process, we need to figure out a faster way of doing things. At least empirical knowledge of calculation complexity, as in Big data, even simple operations, when you multiply by the size of the dataset can be costly
- Conduct Proof of Concept (PoC) for enhancements
- Writing great and performant Big Data processes in pipelines
- Cooperate with other Big data teams
- Work with technologies like AWS, Kubernetes, Airflow, EMR, Hadoop, Linux/Ubuntu, Kafka, and Spark
- Use Slack and Zoom for communication
An ideal candidate would have:
- 3+ years of experience with Linux
- Solid knowledge of Linux (bash, threads, IPC, filesystems, etc)
- Huge need to drive projects of the future, improve stuff, risk taking mindset
- Great communication skills (you can drive end-to-end projects, and guide dev team members)
- Professional working proficiency in English (both oral and written)
- Understanding of API communication patterns (
- Good programming/debugging skills in at least one programming language (on top of Bash)
- Deep understanding of at least one technical area (please let us know which one is this and prepare a story of the biggest battle story about this you had)
- Quite good understanding of Git
If you don’t have all the qualifications, but you’re interested in what we do and you have a solid Linux understanding -> let’s talk!
We are looking for Spark Developers for multiple teams in Comscore. Some of the teams are working in PL, and some of them are working with East or West US.
For East and West US collaboration, there is no full timezone coverage needed, but there is an idea to start with 3x a week EST coverage (up to 9-10 pm PL time) which would potentially decrease over time, and your exp is built, when trust is built and when you know how to run stuff without breaking it.
The recruitment process for the Spark Developer position has four steps:
- Technical screening – 30 min
- Technical task (optional, 1 out of 4 spark teams want to have codility test, async) – ~2h
- Technical interview – 1h
- Interview with Manager – ~30 min
Git API Scala Apache Spark Amazon Web Services (AWS) Apache Kafka Linux Amazon EMR Big data zoom-sdk Airflow Kubernetes Java Hadoop Ubuntu Slack