Title: Python / Pyspark Consultant Location: Chicago, IL Required Qualifications
- Able to communicate technical concepts including presenting and whiteboarding
- Ability to design and implement architectures within AWS utilizing Databricks
- Hands on Experience writing Pyspark pipelines in Databricks
- Minimum 5 7 years of experience with Python Spark and the Hadoop ecosystem
- Experience with SQL and relational databases
- Self starter motivated and good communication skills
- Strong sense of ownership and driven to manage tasks to completion
- A core strength in data engineering and not data science
Responsibilities
- Provide thought leadership in the sphere of big data analytics
- Define the target state architecture design assist in implementation and deployment
- Integrate Databricks with AWS to support the architecture
databricks PySpark SQL Python Amazon Web Services (AWS) Hadoop