Hadoop Technical Lead

GSPANN is looking for Hadoop Technical Lead. As we march ahead on a tremendous growth trajectory, we seek passionate and talented professionals to join our growing family.


Experience Required: 7 - 12 Years

Location: Hyderabad / Pune / Gurugram

Job Type: Permanent

Technical Skill Requirements: Hadoop, Spark, Python, Sqoop, Hive, KAFKA, GCP, AWS, BigQuery, Airflow/Azkaban


Roles & Responsibilities:

  • 6 - 12 years of experience of working in data warehousing or data engineering projects.

  • Over 2 years of experience in leading a team size of 10 Hadoop data engineers.

  • Spearhead a team size of 10-15 developers.

  • Communicate purchase order to the customers.

  • Deliver Hadoop data integration implementations on an on-premise Hadoop cluster/AWS/GCP.

  • GCP Experience would be a plus.

  • Good knowledge of Sqoop, Hive, Spark, KAFKA, BigQuery, Oozie/Azkaban/ Airflow, etc.

  • Must have experience with programming languages, like Python, Java, Scala.

  • Experience in Linux/Unix shell scripting.

  • Strong in performance optimized tuning techniques while processing the data using Spark and storing the data in BigQuery or any other data warehouse database.

  • Expertise of project implementations in Agile DevOps environment with a test-driven development approach.

  • Good experience of working in an Agile DevOps methodology and familiarity with its toolsets (GitHub/Gerrit, Jenkins, Tonomi) would be a plus.

  • The candidate must use their best creative and innovative skills to assist end-to-end business solution activities by creating, reviewing, controlling, and improving processes, reusable/unique solutions.

  • As a Scrum Master, must be able to understand the requirements, analyse the requirement, come up with best possible solutions, and implement more optimized solution.

  • Prepare the STM documents for the development team; ensure that the team works as per the designed solutions and delivers the quality of work on-time.


Required Skills:

  • Good written and verbal communication skills with an ability to communicate with colleagues of all levels.

  • Work well with on-site leads during the requirement analysis, design or solutions decisions.

  • Work with the team to deliver optimized solutions to the customer.

  • Take project delivery ownership and accountability.

  • Communicate the progress of sprint tasks to the customer in daily scrum calls.

  • Prepare daily and weekly status report for the management.