⏳ This skill is pending AI review.

Scores will appear once the review pipeline completes.

version unknown

compare

@fcakyon⭐ 412 stars

Same-epoch comparison of training runs across wandb, neptune, tensorboard, or mlflow. Aligns runs at the student's current step (never current-vs-final-of-baseline) and separates proxy metrics from downstream targets. Use when the user asks to compare runs, check if a run is improving, track lag against a baseline, rank experiments, or evaluate run-vs-run performance.

Choose how to use this skill

You do not need every option. Choose the path your AI client supports. The stable page stays the same; versioned files are immutable.

1. Native installer

This listing has no registered native installer command. Use the complete package or source fallback below, depending on what your client supports.

Do not guess an installer command or replace an existing version without reviewing the diff.

2. Complete package recommended

Download the ZIP when available. It includes SKILL.md plus the references, security notes and version metadata.

No complete ProSkills package is published for this listing yet.

3. Prompt-only

Copy the prompt above when the agent can read the stable page or when you want to adopt the workflow without installing a skill.

Need only the instruction file?

Download SKILL.md only if your client requires a single file. The complete ZIP is safer for a full installation because it preserves the references and release context.

No path installs or executes anything by itself. Your agent still needs access to the project files. Before updating, compare the installed version and review the diff.

—/10

// RATINGS

⭐GitHub Stars
⭐⭐⭐ 412 on GitHubGitHub ↗

Popular

🟢ProSkills Score
—
📍

Not yet listed on ClawHub or SkillsMP

// README

phd-skills

Catch AI mistakes before they cost weeks of compute. Reproduce papers from arxiv. Debug runs evidence-first. Compare experiments at the right epoch. Launch with discipline.

Built by Fatih Cagatay Akyon (2000+ citations, 5 patents) after 300+ Claude Code sessions, tens of critical AI mistakes caught the hard way, and thousands of hours of PhD research. Every guardrail in this plugin traces to a real mistake.

Claude Code Plugin MIT License Zero Dependencies No MCP Required


Why This Plugin Exists

Claude Code is powerful, but it makes research-specific mistakes that cost weeks of compute:

  • It typed "done?" as "dont?" and launched an unwanted upload of thousands of files
  • It analyzed my full dataset when I asked for a specific 4k/2k/2k split
  • It claimed a test covered a bug it had never actually verified
  • It never once looked at a figure it generated, just trusted the numbers
  • It restarted a 50-hour training job without diffing the config against the reference run, lost three days
  • It claimed an experiment was diverging based on a non-converged proxy metric, killed it before downstream eval would have shown the truth
  • It ran rm -rf on a path it had hallucinated from memory, lost local checkpoints

Other plugins give you more commands. This plugin gives you guardrails.


Install

claude plugin marketplace add fcakyon/phd-skills
claude plugin install phd-skills@phd-skills

The plugin works correctly the moment it is installed. Optional: run /phd-skills:setup for a 30-second tour of what was auto-detected and to opt into extras (notifications, allowlist, LaTeX).


Usage

Open Claude Code in your project directory, then:

  • /phd-skills:reproduce arxiv 2508.12345 reproduce a paper from arxiv URL through replication runs
  • "why is my loss diverging?" the debug skill auto-triggers, runs evidence-first probes
  • "compare run alpha to baseline" the compare skill auto-triggers, aligns at the same epoch
  • "launch the new training run" the launch skill auto-triggers, runs the pre-flight checklist
  • /loop 30m check experiment logs, notify me if metrics beat the baseline or if loss starts to diverge

Notifications (task completion, background agents) forward to ntfy / Slack / email after /phd-skills:setup.


What You Get

Commands

CommandWhat it does
/phd-skills:xrayAudit paper against code and data (5 parallel dimensions)
/phd-skills:factcheckVerify BibTeX entries and cited claims against DBLP
/phd-skills:gaps <topic>Literature gap analysis with web confirmation
/phd-skills:fortify [venue]Select strongest ablations + anticipate reviewer questions
/phd-skills:setupAuto-detection tour + optional extras
/phd-skills:helpShow all features at a glance

Skills (auto-trigger, just describe what you need)

When you say...Skill activates
"reproduce this arxiv paper"Reproduce
"why is X failing / diverging / OOMing"Debug
"compare run A to baseline"Compare
"launch a new training run" / "kick off training"Launch
"design an ablation study"Experiment Design
"find related papers on X"Literature Research
"check if my numbers match the code"Paper Verification
"review my methods section for consistency"Paper Writing
"analyze dataset bias"Dataset Curation
"prepare code for open-source release"Research Publishing
"what will reviewers ask about this?"Reviewer Defense
"setup latex for CVPR"LaTeX Setup

Agents (Claude delegates automatically)

AgentWhat it doesSpecial
paper-auditorCross-checks paper claims vs code and dataRuns in isolated worktree, remembers patterns across sessions
experiment-analyzerAnalyzes results from wandb / neptune / tensorboard / mlflow / localHands off to compare and debug skills for discipline

Research Guardrails (run silently, you never invoke these)


// HOW IT'S BUILT

KEY FILES

plugin/skills/compare/SKILL.mdREADME.md

// REPO STATS

412 stars