1001 Freelance Projects -- LLM Reasoning Benchmark Questions + Python Evaluation Script

Latest Projects from Freelance Marketplaces

Today is: 01-May-2025 04:03 GMT

View this project in detail (Note: you will be redirected to external marketplace)
Project title:	LLM Reasoning Benchmark Questions + Python Evaluation Script
Posted by:	External project from PeoplePerHour
Started:	21-Apr-2025 09:32 GMT
Description:	I need a freelancer to prepare benchmark questions and answers for testing a custom LLM’s reasoning ability. Scope: Question Set: Collect 500–600 LLM benchmark questions with correct answers. Focus areas: logical, mathematical, commonsense, analytical, and multi-step reasoning. Deliver as JSON or CSV. Python Script: Load questions and send them to an LLM (I'll handle API integration). Compare model answers to correct ones. Output a simple accuracy report. Requirements: Knowledge of LLMs, reasoning datasets, or NLP is preferred. Clean, documented code. Use only open or original questions.
Project ID:	3430175
Project category:
Project budget:
View this project in detail (Note: you will be redirected to external marketplace)

Project	Started
Realistic 3D House Exterior & landscape design with 360° Video	30-Apr-2025 20:54 GMT
Looking for an Experience App developer	30-Apr-2025 20:15 GMT
Convert Dropbox file to a court ready legal bundle.	30-Apr-2025 19:41 GMT
Shipping plugin APIs on WeeCommerce shop	30-Apr-2025 18:56 GMT
Medical & Veterinary school address gathering and research	30-Apr-2025 18:55 GMT
Email verification and prioritization	30-Apr-2025 18:50 GMT
Administrative / PA Support USA	30-Apr-2025 18:37 GMT
Senior Software Engineer, Workspaces - Europe (Remote)	30-Apr-2025 18:37 GMT
I need a PDF document - Fire RIsk Assessment amended	30-Apr-2025 18:28 GMT
Require drawings for a church conversion	30-Apr-2025 18:28 GMT
I need a remote property manager	30-Apr-2025 17:42 GMT
Someone to build n8n workflows for data analysis	30-Apr-2025 17:42 GMT
Remote Chat Sales (Non-Voice) – Ph & Serbia Only	30-Apr-2025 17:29 GMT
I will like a logo for my start up business	30-Apr-2025 17:28 GMT
Cash flow and Profit and Loss Projection	30-Apr-2025 17:12 GMT

Browse All Projects

Projects by Skills ...
Projects for 'android' Projects for 'ajax' Projects for 'asp' Projects for 'aspnet' Projects for 'cms' Projects for 'cpp' Projects for 'csharp' Projects for 'css' Projects for 'delphi' Projects for 'design' Projects for 'drupal'	Projects for 'excel' Projects for 'facebook' Projects for 'flash' Projects for 'html' Projects for 'java' Projects for 'javascript' Projects for 'joomla' Projects for 'iphone' Projects for 'mysql' Projects for 'photoshop' Projects for 'php' Projects for 'python'	Projects for 'ruby' Projects for 'seo' Projects for 'sql' Projects for 'sysadm' Projects for 'translate' Projects for 'typing' Projects for 'twitter' Projects for 'vbnet' Projects for 'xml' Projects for 'wordpress' Projects for 'writing'
Read RSS feeds ... New!
RSS feed for 'android' RSS feed for 'ajax' RSS feed for 'asp' RSS feed for 'aspnet' RSS feed for 'cms' RSS feed for 'cpp' RSS feed for 'csharp' RSS feed for 'css' RSS feed for 'delphi' RSS feed for 'design' RSS feed for 'drupal'	RSS feed for 'excel' RSS feed for 'facebook' RSS feed for 'flash' RSS feed for 'html' RSS feed for 'java' RSS feed for 'javascript' RSS feed for 'joomla' RSS feed for 'iphone' RSS feed for 'mysql' RSS feed for 'photoshop' RSS feed for 'php' RSS feed for 'python'	RSS feed for 'ruby' RSS feed for 'seo' RSS feed for 'sql' RSS feed for 'sysadm' RSS feed for 'translate' RSS feed for 'typing' RSS feed for 'twitter' RSS feed for 'vbnet' RSS feed for 'xml' RSS feed for 'wordpress' RSS feed for 'writing'

New!
Проекты на русском (Projects in Russian)	Long URL: www.1001freelanceprojects.com	Mobile version: m.1001fp.com