Senior Software Engineer - LLM Evaluation (Remote)
Joveo Ai
European Union
Remote
Expert
posted 7 hours ago
Vacancies Summary
We're looking for a Senior Software Engineer specializing in LLM Evaluation to join our team remotely. You'll work on innovative datasets for training and benchmarking large language models, collaborating with researchers to refine AI-generated code across various programming languages.
We are seeking a Senior Software Engineer – LLM Evaluation for a full-time remote position. In this role, you will create advanced datasets for training, benchmarking, and enhancing large language models while working closely with researchers. Your responsibilities will include curating code examples, providing accurate solutions, and correcting code across multiple programming languages.
Responsibilities
• Curate code examples, develop solutions, and correct code in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go. • Evaluate and improve AI-generated code to ensure efficiency, scalability, and reliability. • Collaborate with cross-functional teams to enhance enterprise-level AI-driven coding solutions against industry performance benchmarks. • Develop agents that verify code quality and identify error patterns. • Formulate hypotheses on software engineering cycle steps and assess model capabilities based on them.
Requirements
• Several years of software engineering experience, with at least 2 years at a top-tier product company. • Strong expertise in building full-stack applications. • Proficient in Python and JavaScript, including ReactJS. • Knowledgeable in C/C++, Java, Rust, and Go. • Ability to design verification mechanisms for software engineering tasks.
This position offers a remarkable opportunity to work with a global leader in the Technology, Information, and Internet sector, contributing to the development of AI systems that deliver measurable business impact. We encourage all qualified candidates to apply, regardless of background or prior employment history.
Required skills
PYTHON
Training
Verification
Teams
Artificial Intelligence (AI)
Design
AI systems
JavaScript
Programming
Rust
Large Language Models (LLM)
Reliability
Software Engineering
React.js
C++
English level
Fluent
Still searching manually?
Let us do the work for you.
TotaMatch works for you
We scan thousands of jobs daily and notify you when there is a match. No searching needed.
Anonymous, safe and free
Your profile stays anonymous. Your employer will not see it. You choose when to become visible.
Ready in 3 minutes
Answer a few questions and create your profile in minutes. No commitment.
About TotaMatch
TotaMatch helps professionals find work that truly fits their work happiness. We believe work is more than just an income. It is a source of fulfillment, growth, and pride. Instead of endlessly scrolling through job boards, TotaMatch works for you. Our platform continuously analyzes thousands of opportunities and identifies roles that align with what truly matters to you. You focus on your work and the people around you. We make sure you never miss a better opportunity.