Correct Context is looking for Senior Spark Scala/Java Developer for Comscore in Poland and around. Comscore is global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement. Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge technology, play a vital role as a trusted partner delivering accurate data to global businesses, and collaborate with industry leaders like Facebook, Disney, and Amazon. Contribute to empowering businesses in the digital era across media, advertising, e-commerce, and technology sectors. We offer: Real big data projects – petabyte scale/thousands of servers / billion of events An international team (US/PL/IE/IN/CL/NL) – slack+zoom+english is standard set Hands-on experience – you have the power to execute your ideas and improve stuff Quite a lot of autonomy in how to execute things A small, independent teams’ working environment Flexible work time Fully remote or in-office work in Wroclaw, Poland Up to28 000 PLN net/month B2B (optional other forms) Private healthcare Multikafeteria ️ Free parking As a Spark Developer, you’ll: Design, implement, and maintain Big data pipelines, petabyte scale Play keyrole in technical decision making Have full hands-on responsibility on technical solutions Plan out and coordinate technical deliverables Optimize – working with Big data is very specific, sometimes it’s IO/CPU-bound, depending on the process, we need to figure out a faster way of doing things. At least empirical knowledge of calculation complexity, as in Big data, even simple operations, when you multiply by the size of the dataset can be costly Conducting Proof of Concept (PoC) for enhancements. Writing great and performant Big Data processes in pipelines Cooperation with other Big data teams Work with technologies like AWS, Kubernetes, Airflow, EMR, Hadoop, Linux/Ubuntu, Kafka, and Spark Use Slack and Zoom for communication An ideal candidate would have: 5+ years of experience with Linux Solid experience in Scala or Java. 5+ years of commercial experience Deep understanding of Spark internals Huge need to drive projects of the future, improve stuff, risk taking mindset Experience with cloud technologies (preferably AWS, but any other cloud technology is acceptable) Great communication skills (you can drive end-to-end projects, and guide dev team members) Professional working proficiency in English (both oral and written) Understanding of API communication patterns ( Good programming/debugging skills in at least one programming language (on top of Bash) Good understanding of Git If you don’t have all the qualifications, but you’re interested in what we do and you have a solid Linux understanding -> let’s talk! We are looking for Senior Spark Developers for multiple teams in Comscore. Some of the teams are working in PL, and some of them are working with East or West US. For East and West US collaboration, there is no full timezone coverage needed, but there is an idea to start with 3x a week EST coverage (up to 9-10 pm PL time) which would potentially decrease over time, and your exp is built, when trust is built and when you know how to run stuff without breaking it. The recruitment process for the Spark Developer position has four steps: Technical screening – 30 min Technical task (optional, 1 out of 4 spark teams want to have codility test, async) – ~2h Technical interview – 1h Interview with Manager – ~30 min #J-18808-Ljbffr
Git API Scala Apache Spark Amazon Web Services (AWS) Linux Amazon EMR comscore zoom-sdk Airflow Kubernetes Java Hadoop Slack