GSPANN is looking for a Hadoop Technical Lead. As we march ahead on a tremendous growth trajectory, we seek passionate and talented professionals to join our growing family.
Experience Required: 8 - 12 Years
Location: Hyderabad / Pune / Gurugram
Job Type: Permanent
Technical Skill Requirements: Hadoop, Hive, Spark, Scala, Python, GCP, Azure, AWS, KAFKA, BigQuery
Roles & Responsibilities:
8 - 12 years of work experience in data warehousing or data engineering projects.
Over 2 years of experience in leading a team of 10 Hadoop data engineers to deliver Hadoop data integration implementations on an on-premise Hadoop cluster platform or AWS or GCP. Good knowledge of GCP would be an advantage.
Should be very strong in Sqoop, Hive, Spark, Kafka, BigQuery, Oozie, Azkaban, Airflow, etc. Experience of working on Airflow/Azkaban would be an advantage.
Must have experience of working with programming languages, like Python, Java, and Scala.
Good experience in Linux/Unix shell scripting.
Must have a strong knowledge of performance optimized tuning techniques to process the data using Spark and storing the data in BigQuery or any other data warehouse database.
Must possess strong project implementation skills with a test-driven development approach in an agile DEVOPS environment.
Good experience of working in an agile DEVOPS environment and familiarity with its toolsets (GitHub / Gerrit, Jenkins, Tonomi,) would be a plus.
Spearhead the team of 10-15 people.
Communicate with the customer PO, scrum master or the manager to understand the requirement, analyses the requirement, come up with the best possible solutions and implement more optimized solutions.
Must work well with on-site leads during the requirement analysis, design / solutions decisions.
Prepare an STM document for the development team to ensure that the team works as per the designed solutions and delivers the quality of work on time.
Must communicate the progress of the sprint tasks in the daily scrum calls to the customer.
The candidate must make the best usage of their creative and innovative skills to assist in end-to-end business solution activities by creating, reviewing, controlling and improving the processes by providing reusable/unique solutions.
Work with the team to deliver optimized solution to the customer.
Take end-to-end projects delivery ownership and accountability.
Communicate status report on a daily and weekly basis to the management.
Good written and verbal communication skills with an ability to communicate with the team.