Akraya Inc.
https://cdn.haleymarketing.com/templates/62697/logos/akraya-hml.png
http://www.akraya.com
http://www.akraya.com
true
Senior Data Engineer: 24-01817
Posted: 07/15/2024
2024-07-15
2024-08-16
Job Category: Data Engineering, Big Data & Hadoop
Job Number: 22511132
Job Description
Primary Skills: Scala, Spark, CICD
Contract Type: W2
Duration: 12+ Months Contract
Location: New York, NY (#LI-Hybrid)
Pay Range: $75 - $80 Per Hour W2
#DP
JOB RESPONSIBILITIES:
"Akraya is an award-winning IT staffing firm consistently recognized for our commitment to excellence and a positive work environment. Voted the #1 Best Place to Work in Silicon Valley (2023) and a Glassdoor Best Places to Work (2023 & 2022), Akraya prioritizes a culture of inclusivity and fosters a sense of belonging for all team members. We are staffing solutions providers for Fortune 100 companies, and our industry recognitions solidify our leadership position in the IT staffing space. Let us lead you to your dream career, join Akraya today! "
Contract Type: W2
Duration: 12+ Months Contract
Location: New York, NY (#LI-Hybrid)
Pay Range: $75 - $80 Per Hour W2
#DP
JOB RESPONSIBILITIES:
- Contribute to maintaining, updating, and expanding existing Core Data platform data pipelines in Scala and Python / Spark while maintaining strict uptime SLAs
- Extend functionality of current Core Data platform offerings, including metadata parsing, extending the Metastore API, and building new integrations with APIs both internal and external to the Data organization
- Implement Ingestion of new batch and streaming data pipelines using Scala, Databricks, and Airflow
- Implement the Lakehouse architecture, working with customers, partners, and stakeholders to shift towards a Lakehouse centric data platform
- Implementation shared libraries in Scala and Python that abstract complex business logic to allow consistent functionality across all data pipelines across the Data organization
- 5+ years of data engineering experience developing large data pipelines
- Strong fundamental Scala and Python programming skills
- Basic understanding of AWS or other cloud provider resources (S3)
- Strong SQL skills and ability to create queries to analyze complex datasets
"Akraya is an award-winning IT staffing firm consistently recognized for our commitment to excellence and a positive work environment. Voted the #1 Best Place to Work in Silicon Valley (2023) and a Glassdoor Best Places to Work (2023 & 2022), Akraya prioritizes a culture of inclusivity and fosters a sense of belonging for all team members. We are staffing solutions providers for Fortune 100 companies, and our industry recognitions solidify our leadership position in the IT staffing space. Let us lead you to your dream career, join Akraya today! "
Share This Job:
Related Jobs:
There are currently no related jobs. Please sign up for Job Alerts.
Loading...
Login to save this search and get notified of similar positions.
About New York, NY
Discover exciting job opportunities in the vibrant area around New York, New York! With its iconic skyline, diverse cultural scene, and endless career growth prospects, the Big Apple and its surroundings promise an unparalleled work-life experience. Nestled between Broadway theaters, world-class art galleries like The Metropolitan Museum of Art, and globally renowned cuisine spots in Little Italy and Chinatown, finding your dream job in New York is your gateway to thriving in a city that never sleeps. Embrace the energy of Times Square, catch a game with the Yankees at Yankee Stadium, or unwind in the serenity of Central Park. Explore our job listings today and unlock your potential in the heart of opportunity.
Are you sure you want to apply for this job?
Please take a moment to verify your personal information and resume are up-to-date before you apply.