Akraya Inc.
https://cdn.haleymarketing.com/templates/62697/logos/akraya-hml.png
http://www.akraya.com
http://www.akraya.com
true
LLM Evaluation Expert (Coding): 24-03428
Posted: 01/22/2025
2025-01-22
2025-02-23
Job Category: Software Engineering & Development
Job Number: 24401329
Job Description
Primary Skills: LLM (Expert), Programming Languages (Expert), AI/ML Knowledge (Advanced), Analytical Skills (Intermediate), Communication (Advanced)
Contract Type: W2
Duration: 6+ Months with possible extension or conversion to FTE
Location: Remote
Pay Range: $50 - $58 Per Hour on W2
Job Summary:
This role Allows only 10 Hours per week, no wiggle room on this
Join our Artificial General Intelligence (AGI) Data Services team as an LLM Evaluation Expert, where you'll be at the heart of AI-driven software development innovation. You'll assess and enhance our large language models' (LLMs) coding abilities, ensuring high-quality, efficient code output that meets customer and industry standards. This role offers the unique opportunity to shape the future of AI-assisted software development while working fully remotely for a duration of 6 months.
Akraya is an award-winning IT staffing firm consistently recognized for our commitment to excellence and a thriving work environment. Most recently, we were recognized Inc's Best Workplaces 2024 and Silicon Valley's Best Places to Work by the San Francisco Business Journal (2024) and Glassdoor's Best Places to Work (2023 & 2022)!
Industry Leaders in IT Staffing
As staffing solutions providers for Fortune 100 companies, Akraya's industry recognitions solidify our leadership position in the IT staffing space. We don't just connect you with great jobs, we connect you with a workplace that inspires!
Join Akraya Today!
Let us lead you to your dream career and experience the Akraya difference. Browse our open positions and join our team!
Contract Type: W2
Duration: 6+ Months with possible extension or conversion to FTE
Location: Remote
Pay Range: $50 - $58 Per Hour on W2
Job Summary:
This role Allows only 10 Hours per week, no wiggle room on this
Join our Artificial General Intelligence (AGI) Data Services team as an LLM Evaluation Expert, where you'll be at the heart of AI-driven software development innovation. You'll assess and enhance our large language models' (LLMs) coding abilities, ensuring high-quality, efficient code output that meets customer and industry standards. This role offers the unique opportunity to shape the future of AI-assisted software development while working fully remotely for a duration of 6 months.
Key Responsibilities:
- Evaluate LLM-generated code across various programming languages and paradigms.
- Select optimal coding solutions from LLM outputs, aligning with client needs and industry standards.
- Develop benchmarks for "what good looks like" in AI-generated code through writing demonstrations.
- Provide detailed feedback to refine the LLM's understanding and output quality.
- Collaborate with the AI research team to enhance the LLM's coding capabilities and stay updated with advancements in the field.
Must-Have Skills:
- Advanced degree in Computer Science with 5+ years of extensive experience in software development across multiple languages and paradigms.
- Proven ability to evaluate code quality, efficiency, and adherence to best practices.
- Strong analytical, decision-making, and communication skills.
Akraya is an award-winning IT staffing firm consistently recognized for our commitment to excellence and a thriving work environment. Most recently, we were recognized Inc's Best Workplaces 2024 and Silicon Valley's Best Places to Work by the San Francisco Business Journal (2024) and Glassdoor's Best Places to Work (2023 & 2022)!
Industry Leaders in IT Staffing
As staffing solutions providers for Fortune 100 companies, Akraya's industry recognitions solidify our leadership position in the IT staffing space. We don't just connect you with great jobs, we connect you with a workplace that inspires!
Join Akraya Today!
Let us lead you to your dream career and experience the Akraya difference. Browse our open positions and join our team!