Hadoop Technical Lead

GSPANN is looking for a Hadoop Technical Lead. As we march ahead on a tremendous growth trajectory, we seek passionate and talented professionals to join our growing family.


Experience Required: 8 - 12 Years

Location: Hyderabad / Pune / Gurugram

Job Type: Permanent

Technical Skill Requirements: Hadoop, Hive, Spark, Scala, Python, GCP, Azure, AWS, KAFKA, BigQuery


Roles & Responsibilities:

  • 8 - 12 years of work experience in data warehousing or data engineering projects.

  • Over 2 years of experience in leading a team of 10 Hadoop data engineers to deliver Hadoop data integration implementations on an on-premise Hadoop cluster platform or AWS or GCP. Good knowledge of GCP would be an advantage.

  • Should be very strong in Sqoop, Hive, Spark, Kafka, BigQuery, Oozie, Azkaban, Airflow, etc. Experience of working on Airflow/Azkaban would be an advantage.

  • Must have experience of working with programming languages, like Python, Java, and Scala.

  • Good experience in Linux/Unix shell scripting.

  • Must have a strong knowledge of performance optimized tuning techniques to process the data using Spark and storing the data in BigQuery or any other data warehouse database.

  • Must possess strong project implementation skills with a test-driven development approach in an agile DEVOPS environment.

  • Good experience of working in an agile DEVOPS environment and familiarity with its toolsets (GitHub / Gerrit, Jenkins, Tonomi,) would be a plus.

  • Spearhead the team of 10-15 people.

  • Communicate with the customer PO, scrum master or the manager to understand the requirement, analyses the requirement, come up with the best possible solutions and implement more optimized solutions.

  • Must work well with on-site leads during the requirement analysis, design / solutions decisions.

  • Prepare an STM document for the development team to ensure that the team works as per the designed solutions and delivers the quality of work on time.

  • Must communicate the progress of the sprint tasks in the daily scrum calls to the customer.


Required Skills:

  • The candidate must make the best usage of their creative and innovative skills to assist in end-to-end business solution activities by creating, reviewing, controlling and improving the processes by providing reusable/unique solutions.

  • Work with the team to deliver optimized solution to the customer.

  • Take end-to-end projects delivery ownership and accountability.

  • Communicate status report on a daily and weekly basis to the management.

  • Good written and verbal communication skills with an ability to communicate with the team.