Job Description A large telecommunications client headquartered in Charlotte NC is looking for a REMOTE Data Engineer to join their growing Data Platforms team. This team handles anywhere from a billion to a trillion bits of data on any given day. They are responsible for the ETL process of all of this data to ensure its usability for both internal and external users. Some external users are large enterprise clients. This person will be responsible for 80% development / project based work. You will play a crucial role in developing and maintaining data processing software, including databases. Your responsibilities will involve creating and optimizing data pipelines, collaborating with stakeholders, and ensuring data infrastructure meets business needs. Pay Range $60-65 / Hour Exact compensation may vary based on several factors, including skills, experience, and education. Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law. We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to . To learn more about how we collect, keep, and process your private information, please review Insight Global’s Workforce Privacy Policy: . Skills and Requirements 4-6 years of experience as a Software Engineer or Data Engineer. 3+ years of experience in functional Scala programming, including creation of custom UDF’s. Hands-on experience with Spark Streaming. Strong understanding of real time ETL development to ensure data quality, reliability, and consistency. Knowledge of AWS services, such as EC2 and S3 for scalable data storage and computation. Familiarity with Terraform and/or Kubernetes for managing and integrating infrastructure components Experience with Kafka for building real-time streaming data pipelines and applications Enterprise industry experience SQL DynamoDB null We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to .
amazon-dynamodb spark-streaming amazon-s3 Scala SQL Kubernetes Terraform Amazon Web Services (AWS) Data Engineering Apache Kafka amazon-ec2