Job Description
Job Title - PySpark /SQL Engineer
Experience Range - 6+ years
Technical/Functional Skills
6+ years of software development experience in a professional environment and/or comparable experience
Strong proficiency and Hands-on coding experience in Python/PySpark, SQL
Experience with Big data, ETL pipelines
Exposure to Java and ability to understand Java code logic
Experience with Distributed Computing
Experience with Hadoop ecosystem
Experience in Apache Spark
Experience with Hive, PostgresSQL, Cloud experience
Extensive hands-on experience with designing, building, and optimizing data pipelines and applications
using PySpark and SQL for large-scale data processing and analysis, often in a big data environment.
Optimize data pipeline performance for speed and scalability.
Bachelor's degree in computer science, computer science engineering, or related experience required
Roles & Responsibility :
Design, develop, and maintain data pipelines and applications for large-scale data
Collaborate with cross-functional teams to gather requirements, architect solutions, and implement
features that meet business needs.
Troubleshoot and debug production issues, conduct root cause analysis, and implement solutions to
prevent recurrence.
Stay updated on emerging technologies and industry trends, new tools and frameworks to improve efficiency
and productivity.
Communicate effectively with team members, stakeholders, and management to provide project updates,
status reports, and technical recommendations.
application.
Salary Range - $90000 to $110000 a year
Location
New York, NY
Job Function
TECHNOLOGY
...Training/LLM). Experience in an early-stage startup technology company is required. Even better if you understand Web3, tokenomics/cryptocurrency principles (but that part can be taught). You must know what a GPU is - and why it matters in this world (specifically H100s...
...offer more than just a jobwe provide stability, growth, and industry-leading benefits for our employees. As a large company serving... ...career while working with top-tier clients in the HVAC and refrigeration industry!Responsibilities: This position is responsible for...
...distributed and in distribution by Erbe USA. Assist in FDA Regulatory Submissions [e.g., 510(k)s, etc.] to meet regulatory requirements... ...regulatory requirements and laws. Assists in performing internal and external audits as well as supports the management of audits...
First United Methodist ChurchLufkin, Texas 75901Full Time , On-SiteFirst United Methodist Church, Lufkin, Texas, seeks a full-time church organist/choirmaster who has a passion for helping people grow as disciples of Jesus Christ in the United Methodist tradition....
...and motivated individuals to join our growing team and help build groundbreaking technology with real-world impact. As an HVAC Sales Engineer, you will be responsible for preparing proposals,developing and maintaining relationships with clients, conducting site visits...