Big Data Leads
Big Data, Spark, Python, AWS, Big Data Analytics
Description
We are looking for Big Data Leads to join our global workforce. Our dynamic team offers valuable opportunities and a tangible career support system for your professional and personal development.
Who We Are
GSPANN has been in business for over a decade, with over 2000 employees worldwide, and servicing some of the largest retail, high technology, and manufacturing clients in North America. We provide an environment that enables career growth while still interacting with company leadership.
Visit Why GSPANN for more information.
Location: San Francisco
Role Type: Full Time
Published On: 17 August 2022
Experience: 6+ Years
Description
We are looking for Big Data Leads to join our global workforce. Our dynamic team offers valuable opportunities and a tangible career support system for your professional and personal development.
Role and Responsibilities
- Participate in all phases of the software development lifecycle, including requirement gathering, functional and technical design, development, testing, roll-out, and support.
- Solve complex business problems by utilizing a disciplined development methodology.
- Produce scalable, flexible, efficient, and supportable solutions using appropriate technologies.
- Analyze the source and target system data. Map the transformation that meets the requirement.
- Interact with the client and onsite teams during different phases of a project.
- Communicate effectively with business stakeholders and architects.
Skills and Experience
- 7+ years of experience in developing Big Data applications.
- Prior work experience with large-scale Big Data and Analytics applications.
- Strong experience in using Agile Scrum.
- Good understanding of distributed systems and handling large amounts of data.
- Hands-on experience in using technologies like Spark, Pyspark, Python, and AWS.
- Thorough understanding of data structures and algorithms.
- Implement solutions with Amazon Virtual Private Cloud, EC2, AWS Data Pipeline, AWS CloudFormation, AWS Auto Scaling, Amazon Simple Storage Service (S3), Amazon Elastic MapReduce (EMR), and other AWS products, along with HIVE and Athena.
- Strong problem-solving, communication, and presentation skills.
