Join the Garuda Portfolio

Discover opportunities across our network of companies

Senior Data Engineer

Pesto Tech

Pesto Tech

Data Science
Gurugram, Haryana, India
Posted on Wednesday, May 8, 2024
Position: Senior Data Engineer
Location: Gurgaon(Work from office 5days/week) / Bangalore(Hybrid)
Accepted Notice Period: Immediate – 30 Days
Years of Experience: 3 - 6 Years
Opportunity Type: Full time
**Note: This position is with one of our hiring partners

Skills Required

  • Proficiency in Hadoop ecosystem technologies such as Hadoop, Hive, and Pyspark/Spark
  • Strong understanding of data engineering concepts and practices
  • Experience in designing, developing, and maintaining data pipelines and ETL processes
  • Ability to optimize and tune data processing workflows for performance and scalability
  • Knowledge of data modeling and schema design
  • Familiarity with cloud platforms like AWS/GCP/Azure is a plus
  • Excellent problem-solving skills and ability to work independently or in a team environment

Responsibilities

  • Design, build, and maintain scalable and reliable data pipelines and systems
  • Collaborate with cross-functional teams to gather and analyze requirements for data projects
  • Develop and implement data processing solutions using Hadoop, Hive, and Spark
  • Optimize and tune data workflows for performance, reliability, and efficiency
  • Ensure data quality, integrity, and security throughout the data lifecycle
  • Stay updated with the latest trends and technologies in the field of data engineering
  • Provide technical guidance and mentorship to junior team members when required
About Pesto Tech:
Pesto is where software developers go to build their career path for the next 5 years. We don't just offer jobs; we provide unparalleled opportunities for your growth and success in the dynamic landscape of Tech Jobs.