Job Description The Data Engineer will report directly to the VP of Data or team lead and work together with the rest of the data engineers, BI analysts, and product teams. The Data Engineer is responsible for developing, constructing, testing and maintaining the company’s data platform and pipelines. This is achieved by ensuring the infrastructure is reliable and a high level of data quality is maintained. Responsibilities: Create and maintain both batch (ETL/ELT) and real-time data pipelines and architecture Ensure all data provided by Data Platform is of the highest quality and is delivered in a timely manner and in line with agreed SLAs Assemble large and complex data sets that meet functional and non-functional business requirements Identify, design, and implement internal process improvements, including automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure required for optimal extraction, transformation and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies Collaborate with stakeholders including data architects, Executive, Product, Data and IT team members from the beginning to the delivery of a project Build a scalable, modern, and trusted data ecosystem, making sure it is responsive, available and in line with business requirements Take part in sprints, workloads, and deliverables through agile methodologies Manage quality assurance, verification of accuracy and consistency of data, specifically KPI measures sent to the business Qualifications: Bachelor’s degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience Experience Experience working in an online, gaming, or fast-moving industry 3+ years of work experience in data engineers and data platforms Must have experience in successfully implementing data-centric applications, such as data warehouses, operational data stores, and data integration projects Experience with SQL, ETL, data modeling, and Python Experience working with terabyte to petabyte scale data Functional/Technical Skills Strong experience with large-scale production databases and SQL Solid understanding of cloud data services: AWS services such as S3, Athena, EC2, RedShift, EMR, EKS, RDS and Lambda Proficient with one or more big data & new data technologies such as DBT, NIFI, Airflow, Kafka Knowledge in working with time-series/analytics databases such as Elasticsearch Understanding of containerization and orchestration technologies like Docker/Kubernetes Familiarity with Marketing tooling and/or CRM systems is preferred Familiarity with using business intelligence tools such as Domo, Superset or other similar tooling What’s in it for you: Work in a new and thriving industry with high growth potential. Competitive salary and performance bonus. Medical, Dental, and Vision Insurance. 401k employer matching. Unlimited PTO with 15 paid holidays. 100% paid parental leave. Professional training and development opportunities. Gym reimbursement. Free workout classes at Prime Cycle in Hoboken, NJ. 1-year free Apple Fitness+ subscription. Work in an environment with a start-up feeling, backed-up by a leading European sports betting house. We are a high-volume business and are taking off in the US!
Amazon Web Services (AWS) CRM Apache Kafka Data Engineering ELT Amazon EMR Elasticsearch Docker Airflow DBT data-quality Business Intelligence (BI) amazon-s3 Lambdas Python data-warehouse Amazon Redshift apache-nifi Amazon Athena Data Architect BI Analyst Big data domo data-integration amazon-eks SQL Kubernetes ETL Data Platforms amazon-rds apache-superset amazon-ec2