alterlab-scholar-eval
From the author
Evaluates scholarly work with a ScholarEval-inspired eight-dimension rubric, producing structured assessment across research-quality dimensions (problem formulation, literature, methodology, data, analysis, results, writing, and citations) with quantitative 1-5 rubric scores, weighted aggregates, and actionable feedback. Use when scoring or grading a paper, thesis, or research output against rubric-style criteria, or benchmarking publication readiness across revisions. For checklist-based narrative reviewer reports prefer alterlab-peer-review; for evidence/claim quality and argument soundness use alterlab-scientific-thinking. Part of the AlterLab Academic Skills suite.
Install
npx skills add AlterLab-IEU/AlterLab-Academic-Skills --skill alterlab-scholar-eval -a claude-code
Installs to .claude/skills/alterlab-scholar-eval/ · Each command fetches the skill straight from GitHub with the open skills CLI.
Byte-identical to the scanned commit, with the repository’s licence and a SOURCE.txt.
Want your agent to suggest skills while you type? See how to use skills from your IDE.
Safety checks on SKILL.md
- Ships scripts we have not reviewedLow
Why 77
aiqbench computes the trust score from public signals. It is not a security audit, so read a skill before you install it.
Similar skills
Closest to this one by what they do and when they are used.
- alterlab-peer-reviewAlterLab-IEU/AlterLab-Academic-SkillsWrites structured, checklist-based single-reviewer reports for manuscripts and grant proposals — assesses methodology, statistical validity, reporting-standards compliance (CONSORT 2025, SPIRIT 2025, STROBE, PRISMA 2020, ARRIVE 2.0), reproducibility, and ethics, and gives constructive, prioritized feedback while respecting reviewer confidentiality and AI-use rules. Use when writing a formal referee report, responding to a journal or grant review invitation, or self-auditing a manuscript against reviewer criteria before submission. For evaluating claims/evidence quality prefer alterlab-scientific-thinking; for a multi-reviewer mock-panel verdict use alterlab-paper-reviewer; for quantitative rubric scoring use alterlab-scholar-eval; to revise a paper in response to reviews use alterlab-paper-writer. Part of the AlterLab Academic Skills suite.Engineering★ 78
- alterlab-scientific-thinkingAlterLab-IEU/AlterLab-Academic-SkillsEvaluate scientific claims and evidence quality using evidence grading frameworks (GRADE, Cochrane risk-of-bias tools such as RoB 2 and ROBINS-I), assessing experimental design validity and identifying biases, confounders, statistical pitfalls, and logical fallacies. Use when judging evidence quality, grading certainty of evidence, spotting design or causal-inference flaws, identifying biases or confounders, naming statistical fallacies, or teaching critical analysis. For writing a formal submittable peer review use alterlab-peer-review; for a multi-reviewer mock panel verdict use alterlab-paper-reviewer; for IRB/consent/conflict-of-interest ethics use alterlab-research-ethics. Part of the AlterLab Academic Skills suite.Science★ 78
- scholar-evaluationK-Dense-AI/scientific-agent-skillsProvides qualitative-first, evidence-traceable developmental review of scholarly works and audit low-stakes research-assessment rubrics with optional local quality controls. Never use for ranking people or consequential decisions.Science★ 54.5K
- alterlab-paper-reviewerAlterLab-IEU/AlterLab-Academic-SkillsSimulates a full multi-reviewer journal review PANEL — 5 personas (Editor-in-Chief + 3 peer reviewers + a Devil's Advocate) debate a manuscript and produce a consensus Editorial Decision (accept/minor/major/reject) plus a prioritized Revision Roadmap. Modes: full, re-review (verify revisions addressed prior comments), quick, methodology-focus, Socratic guided. Use for: simulate peer review, mock review panel, editorial review before submission, multiple reviewer perspectives, re-review of a revised manuscript, or 'critique my paper hard'. For a single-reviewer referee report use alterlab-peer-review; for rubric/grade scoring use alterlab-scholar-eval; to write/revise the paper use alterlab-paper-writer. Part of the AlterLab Academic Skills suite.Science★ 78
- alterlab-research-pipelineAlterLab-IEU/AlterLab-Academic-SkillsOrchestrates the full academic research pipeline (research, write, integrity check, review, revise, re-review, re-revise, final integrity check, finalize), coordinating alterlab-deep-research, alterlab-paper-writer, and alterlab-paper-reviewer into a seamless 10-stage workflow with mandatory integrity verification, two-stage peer review, and reproducible quality gates. Use when the request mentions academic pipeline, research to paper, full paper workflow, paper pipeline, end-to-end paper, research-to-publication, or complete paper workflow. Part of the AlterLab Academic Skills suite.Science★ 78
- research-proposalgaasher/Agent-Loop-SkillsUse when the user has a research proposal (problem + proposed methodology + planned experiments) and wants it iteratively strengthened until it clears a passing grade. ScholarEval grades the proposal against the literature (Soundness + Contribution), a Judge scores that feedback 0-100 on a fixed rubric, and a Reviser rewrites the proposal to fix the worst points without diluting the research question; loops until the grade passes or the budget is hit. Not for generating a proposal from scratch, and not for running a literature survey on its own.Science★ 177
Ratings & reviews
—
no reviews
Tried this skill? Rate it to help others. Sign in
Discussion
Join the discussion. Sign in