LLM Model Response Evaluation Job at Lifted, an Upwork Company™, Maryland

WnBJYVBLMmZxaWJ1OC8rWlE4N3ZKSjhzYnc9PQ==
  • Lifted, an Upwork Company™
  • Maryland

Job Description



Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.

Job Description

  • Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
  • The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
  • The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
  • Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
  • Each task will include detailed project guidelines within the evaluation platform.

Qualifications

  • 3+ years of hands-on experience in LLM / GenAI data evaluation.
  • Bachelor's Degree required 
  • Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
  • Comfortable evaluating content across multiple modalities 

Additional Information



Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours:  Workload may vary weekly

Job Tags

Contract work, Remote work, Flexible hours

Similar Jobs

Merck & Co.

Senior Director, Advanced Pharmacometrics, Quantitative Pharmacology and Pharmacometrics - Immuno-Oncology (Hybrid or Remote) Job at Merck & Co.

Job DescriptionWe are seeking an accomplished scientific leader to join the Quantitative Pharmacology and Pharmacometrics - Immuno-Oncology (QP2-IO) team as-Senior Director, Advanced Pharmacometrics. QP2-IO is part of the Global Clinical Development organization and is ...

MJ Tank Lines

Fuel Tanker Driver - CDL (Class A) Job at MJ Tank Lines

 ...California, seeking highly professional CDL (Class A) Hazmat Fuel Tanker Drivers to join our growing fleet. Our drivers are responsible for...  ...of 36months recent and verifiable commercial vehicle experience. Experience driving trucks totaling gross vehicle weight (... 

Alsum Farms

Machine Operator - 2nd Shift Job at Alsum Farms

Description: Join our dynamic team as a Machine Operator, where your role is vital to ensuring the efficient and high-quality packaging of fresh produce. We are committed to continuous improvement, teamwork, and exceeding expectations every day. If you are detail-oriented...

Remote Recruitment

Accounts Payable Clerk Job at Remote Recruitment

 ...Remote Recruitment is hiring an Accounts Payable Clerk to support a UK-based finance team from South Africa. You will make sure suppliers are paid accurately and on time, and that the ledger tells the truth. It is a good fit if you are careful with numbers, comfortable... 

Social Group

Full Time Lead Generator Job at Social Group

 ...Now Hiring: Lead Generator We are seeking motivated and outgoing Lead Generators to help us connect with potential customers and grow our business. This is an excellent entry-level opportunity for individuals who enjoy talking to people and working in a goal-driven...