colm-experiments
From the author
Use when designing or auditing the empirical core of a COLM paper — contamination analysis for evaluation data, fair baselines under matched prompting and compute, pinned model versions and decoding parameters, uncertainty over runs and samples, scaling coverage, and honest reporting of API-model comparisons.
Install
npx skills add brycewang-stanford/Awesome-Journal-Skills --skill colm-experiments -a claude-code
Installs to .claude/skills/colm-experiments/ · Each command fetches the skill straight from GitHub with the open skills CLI.
Byte-identical to the scanned commit, with the repository’s licence and a SOURCE.txt.
Want your agent to suggest skills while you type? See how to use skills from your IDE.
Safety checks on SKILL.md
No warnings.
Why 88
aiqbench computes the trust score from public signals. It is not a security audit, so read a skill before you install it.
Similar skills
Closest to this one by what they do and when they are used.
- popl-experimentsbrycewang-stanford/Awesome-Journal-SkillsUse when designing the empirical component of a POPL paper — deciding whether evidence should be a mechanization, a prototype, case studies, or benchmarks; reporting proof effort and case-study coverage honestly; and keeping performance numbers in a supporting role so the formal claim stays the paper's center of gravity.Science★ 1.3K
- acl-experimentsbrycewang-stanford/Awesome-Journal-SkillsUse when designing or auditing experiments for an ACL paper, covering tuned LLM baselines, multi-dataset and multilingual evaluation, statistical significance and variance, human evaluation with agreement reporting, contamination and prompt-sensitivity controls, ablations, and error-analysis expectations in NLP reviewing.Science★ 1.3K
- eacl-experimentsbrycewang-stanford/Awesome-Journal-SkillsUse when designing or auditing the empirical evidence for an EACL paper, covering tuned and LLM baselines, multilingual breadth matched to the claim, significance and variance floors, human-evaluation agreement, data-contamination controls, ablations, and error taxonomies, so that every stated result is measured rather than asserted.Science★ 1.3K
- pods-experimentsbrycewang-stanford/Awesome-Journal-SkillsUse when designing or auditing the analytical "evidence" of an ACM PODS paper — worst-case and average-case analyses, matching upper and lower bounds, dichotomy completeness, correct complexity assumptions, and the occasional empirical validation when a theory paper claims practicality — matching the rigor to the shape of each theoretical claim.Science★ 1.3K
- corl-experimentsbrycewang-stanford/Awesome-Journal-SkillsUse when designing or auditing experiments for a CoRL robot-learning paper — seeds and evaluation-episode counts, task-suite breadth, real-robot versus simulation evidence, sim-to-real gap measurement, baseline fairness across BC/RL/VLA families, generalization splits, and statistics for success-rate claims.Science★ 1.3K
- ase-experimentsbrycewang-stanford/Awesome-Journal-SkillsUse when designing or auditing the evaluation of an ASE (IEEE/ACM Automated Software Engineering) paper, covering real subject systems, fair runnable tool baselines, task-matched effectiveness metrics, ablations that isolate a learned component, oracle and correctness validation, contamination-aware LLM handling, and provenance for mining.Science★ 1.3K
Ratings & reviews
—
no reviews
Tried this skill? Rate it to help others. Sign in
Discussion
Join the discussion. Sign in