Job Description
Job Title - PySpark /SQL Engineer
Experience Range - 6+ years
Technical/Functional Skills
6+ years of software development experience in a professional environment and/or comparable experience
Strong proficiency and Hands-on coding experience in Python/PySpark, SQL
Experience with Big data, ETL pipelines
Exposure to Java and ability to understand Java code logic
Experience with Distributed Computing
Experience with Hadoop ecosystem
Experience in Apache Spark
Experience with Hive, PostgresSQL, Cloud experience
Extensive hands-on experience with designing, building, and optimizing data pipelines and applications
using PySpark and SQL for large-scale data processing and analysis, often in a big data environment.
Optimize data pipeline performance for speed and scalability.
Bachelor's degree in computer science, computer science engineering, or related experience required
Roles & Responsibility :
Design, develop, and maintain data pipelines and applications for large-scale data
Collaborate with cross-functional teams to gather requirements, architect solutions, and implement
features that meet business needs.
Troubleshoot and debug production issues, conduct root cause analysis, and implement solutions to
prevent recurrence.
Stay updated on emerging technologies and industry trends, new tools and frameworks to improve efficiency
and productivity.
Communicate effectively with team members, stakeholders, and management to provide project updates,
status reports, and technical recommendations.
application.
Salary Range - $90000 to $110000 a year
Location
New York, NY
Job Function
TECHNOLOGY
Benefits: ~ Health, Dental, & Vision Insurance. ~ Vacation Time. ~ LTD. ~ Life. ~401k. Welcome to Generacs Dealer Talent Network! If you're passionate about clean energy, energy management, and are looking to be part of a dynamic and growing industry, then...
Overview: The Special Events Coordinator will assist the Special Events team in the planning, preparation, communication, set-up and close-out, and onsite execution of Special Events and Promotions at Golden Nugget, including but not limited to: Slot Tournaments, Table...
...As a Certified Community Behavioral Health Clinic, CNS Healthcare's mission is to serve the people of our communities. The Case Aide Assistant provides highly valued support to the assigned treatment and is responsible for assisting the treatment team in carrying out...
...Social Workers/Counselors | Mens or Adolescent Services F/T | Womens Services P/T Womens (Part-time) CASAC, CASAC-T, CRC, LMHC, LMSW, LMFT, LCSW Mens (Full-time) LCSW, LMHC, LMFT, MHC, MSW LP or higher Adolescent Services (Full-time) CASAC, CASAC-T, CRC,...
...Is a good work environment with good Relationships important to you? Are you looking for a company that is Innovative? If this is you, then please consider Silver Star Construction as the right company for you! Concrete Finisher/Laborer 2401 S. Broadway Ave....