evaluating-code-models
From the author
Evaluates code generation models across HumanEval, MBPP, MultiPL-E, and 15+ benchmarks with pass@k metrics. Use when benchmarking code models, comparing coding abilities, testing multi-language support, or measuring code generation quality. Industry standard from BigCode Project used by HuggingFace leaderboards.
Install
npx skills add KalarisLabs/research-agent-skills --skill evaluating-code-models -a claude-code
Installs to .claude/skills/evaluating-code-models/ · Each command fetches the skill straight from GitHub with the open skills CLI.
Byte-identical to the scanned commit, with the repository’s licence and a SOURCE.txt.
Want your agent to suggest skills while you type? See how to use skills from your IDE.
Safety checks on SKILL.md
No warnings.
Why 82
aiqbench computes the trust score from public signals. It is not a security audit, so read a skill before you install it.
Similar skills
Closest to this one by what they do and when they are used.
- evaluating-llms-harnessKalarisLabs/research-agent-skillsEvaluates LLMs across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag). Use when benchmarking model quality, comparing models, reporting academic results, or tracking training progress. Industry standard used by EleutherAI, HuggingFace, and major labs. Supports HuggingFace, vLLM, APIs.Other★ 71
- coding-standardsshinpr/ai-coding-project-boilerplateコードの品質問題、アンチパターン、可読性を検査。機能実装、コードレビュー、リファクタリング時に使用。Engineering★ 236
- checking-code-qualitytelagod/code-abyssChecks code quality metrics including complexity, duplication, naming conventions, and function length. Use when running quality gates, reviewing code smells, or checking lint rules. Automatically triggered on complex modules or post-refactor.Engineering★ 244
- evaluating-machine-learning-modelsforyourhealth111-pixel/Vibe-SkillsEvaluate trained machine learning models with the right metrics and comparison logic. Use for benchmark review, threshold selection, calibration, validation, and model comparison; not for feature engineering or leakage auditing.Engineering★ 3.8K
- score-evaltonone-ai/tononeDesign an evaluation framework for a ML model — metrics, splits, and reporting. Use when asked "how should we evaluate this model", "design evaluation metrics", or "plan our train test split".Testing★ 76
- Reviewing CodeMicrock/ordinary-claude-skillsSystematically evaluate code changes for security, correctness, performance, and spec alignment. Use when reviewing PRs, assessing code quality, or verifying implementation against requirements.Engineering★ 408
Ratings & reviews
—
no reviews
Tried this skill? Rate it to help others. Sign in
Discussion
Join the discussion. Sign in