Job Description A large telecommunications client headquartered in Charlotte NC is looking for a REMOTE Data Engineer to join their growing Data Platforms team. This team handles anywhere from a billion to a trillion bits of data on any given day. They are responsible for the ETL process of all of this data to ensure its usability for both internal and external users. Some external users are large enterprise clients. This person will be responsible for 80% development / project based work. You will play a crucial role in developing and maintaining data processing software, including databases. Your responsibilities will involve creating and optimizing data pipelines, collaborating with stakeholders, and ensuring data infrastructure meets business needs. We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to . To learn more about how we collect, keep, and process your private information, please review Insight Global’s Workforce Privacy Policy: . Skills and Requirements 4-6 years of experience as a Software Engineer or Data Engineer. 3+ years of experience in functional Scala programming, including creation of custom UDF’s. Hands-on experience with Spark Streaming. Strong understanding of real time ETL development to ensure data quality, reliability, and consistency. Knowledge of AWS services, such as EC2 and S3 for scalable data storage and computation. Familiarity with Terraform and/or Kubernetes for managing and integrating infrastructure components Enterprise industry experience SQL DynamoDB null We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to .
amazon-dynamodb spark-streaming amazon-s3 SQL Kubernetes Terraform Amazon Web Services (AWS) Data Engineering amazon-ec2 Software Engineer