Senior Data Engineer: 24-01817 Jobs in New York NY Data Engineering, Big Data & Hadoop Job Recruiters

Posted: 07/15/2024 Job Category: Data Engineering, Big Data & Hadoop Job Number: 22511132

Job Description

Primary Skills: Scala, Spark, CICD
Contract Type: W2
Duration: 12+ Months Contract
Location: New York, NY (#LI-Hybrid)
Pay Range: $75 - $80 Per Hour W2
#DP

JOB RESPONSIBILITIES:

Contribute to maintaining, updating, and expanding existing Core Data platform data pipelines in Scala and Python / Spark while maintaining strict uptime SLAs
Extend functionality of current Core Data platform offerings, including metadata parsing, extending the Metastore API, and building new integrations with APIs both internal and external to the Data organization
Implement Ingestion of new batch and streaming data pipelines using Scala, Databricks, and Airflow
Implement the Lakehouse architecture, working with customers, partners, and stakeholders to shift towards a Lakehouse centric data platform
Implementation shared libraries in Scala and Python that abstract complex business logic to allow consistent functionality across all data pipelines across the Data organization

JOB REQUIREMENTS:

5+ years of data engineering experience developing large data pipelines
Strong fundamental Scala and Python programming skills
Basic understanding of AWS or other cloud provider resources (S3)
Strong SQL skills and ability to create queries to analyze complex datasets

ABOUT AKRAYA
"Akraya is an award-winning IT staffing firm consistently recognized for our commitment to excellence and a positive work environment. Voted the #1 Best Place to Work in Silicon Valley (2023) and a Glassdoor Best Places to Work (2023 & 2022), Akraya prioritizes a culture of inclusivity and fosters a sense of belonging for all team members. We are staffing solutions providers for Fortune 100 companies, and our industry recognitions solidify our leadership position in the IT staffing space. Let us lead you to your dream career, join Akraya today! "

Apply Now:

Apply Later

Share This Job:

Apply Online Apply with LinkedIn Apply with Facebook Apply with X

Share This Job:

Related Jobs:

About New York, NY

Discover exciting job opportunities in the vibrant area around New York, New York! With its iconic skyline, diverse cultural scene, and endless career growth prospects, the Big Apple and its surroundings promise an unparalleled work-life experience. Nestled between Broadway theaters, world-class art galleries like The Metropolitan Museum of Art, and globally renowned cuisine spots in Little Italy and Chinatown, finding your dream job in New York is your gateway to thriving in a city that never sleeps. Embrace the energy of Times Square, catch a game with the Yankees at Yankee Stadium, or unwind in the serenity of Central Park. Explore our job listings today and unlock your potential in the heart of opportunity.