Skip to content

feat(research-paper-writing): fill coverage gaps, integrate AI-Scientist & GPT-Researcher patterns - #5421

Merged
SHL0MS merged 1 commit into
mainfrom
fix/research-paper-writing-gaps
Apr 6, 2026
Merged

SHL0MS merged 1 commit into
mainfrom
fix/research-paper-writing-gaps

Conversation

@SHL0MS

@SHL0MS SHL0MS commented Apr 6, 2026

Copy link
Copy Markdown

Summary

Addresses 13 coverage gaps in the research-paper-writing skill and integrates proven patterns from AI-Scientist (SakanaAI), AI-Scientist v2, and GPT-Researcher.

Changes

Bug fixes

  • Fix duplicate step numbers: two Step 5.3 (Introduction/Methods), two Step 7.3 (Formatting/Compilation), missing Step 7.5
  • Bump version 1.0.0 → 1.1.0

New coverage (13 gaps filled)

# Gap Location
1 Human evaluation / user studies Step 2.5 + references/human-evaluation.md (new, 476 lines)
2 Theory papers / mathematical proofs "Paper Types" section + references/paper-types.md (new, 481 lines)
3 Ethics / broader impact statements Step 5.10
4 arXiv & preprint strategy Step 7.9
5 Research code packaging Step 7.10
6 Negative / null results Step 4.3 expansion
7 Workshop & short papers New top-level section
8 Multi-author coordination Step 0.7
9 Cost / compute estimation Step 0.6
10 Post-acceptance deliverables (poster, talk, blog) Phase 8 (new)
12 Survey / position / benchmark paper types "Paper Types" section + reference
13 Datasheets / model cards Step 5.11

Patterns integrated from external repos

Pattern Source Location
Ensemble reviewing (N reviews + meta-reviewer + score averaging) AI-Scientist Phase 6 Step 6.1 (rewritten)
Negative bias reviewer prompt AI-Scientist Phase 6 Step 6.1
VLM visual review pass AI-Scientist v2 Phase 6 Step 6.1b (new)
Claim verification via fresh sub-agent Anthropic patterns Phase 6 Step 6.1c (new)
Two-pass refinement (per-section + global) AI-Scientist Phase 5 new subsection
LaTeX error checklist constant AI-Scientist Phase 5 new subsection
Pre-compilation validation (chktex + 4 automated checks) AI-Scientist Phase 7 Step 7.4 (new)
Experiment-to-writeup bridge (experiment_log.md) AI-Scientist Phase 4 Step 4.6 (new)
Experiment journal with tree structure AI-Scientist v2 Phase 3 Step 3.5 (new)
Breadth/depth iterative literature search GPT-Researcher Phase 1 Step 1.2b (new)
Context management for large projects GPT-Researcher Phase 5 new subsection

Stats

  • SKILL.md: 1,599 → 2,357 lines (+758)
  • references/sources.md: +26 lines (new source references)
  • New: references/human-evaluation.md (476 lines)
  • New: references/paper-types.md (481 lines)
  • Total: +1,774 lines inserted, 33 removed

Not changed

  • Templates directory (no template modifications)
  • Existing reference files other than sources.md
  • Hermes Agent Integration section (no tool API changes)
  • Autoreason methodology reference

…ns from AI-Scientist, GPT-Researcher

Fix duplicate step numbers (5.3, 7.3) and missing 7.5. Add coverage for
human evaluation, theory/survey/benchmark/position papers, ethics/broader
impact, arXiv strategy, code packaging, negative results, workshop papers,
multi-author coordination, compute budgeting, and post-acceptance
deliverables. Integrate ensemble reviewing with meta-reviewer and negative
bias, pre-compilation validation pipeline, experiment journal with tree
structure, breadth/depth literature search, context management for large
projects, two-pass refinement, VLM visual review, and claim verification.

New references: human-evaluation.md, paper-types.md.
@SHL0MS
SHL0MS merged commit 033e971 into main Apr 6, 2026
2 of 3 checks passed
angelburgosrosado pushed a commit to angelburgosrosado/hermes-agent that referenced this pull request Apr 27, 2026
…aper-writing-gaps

feat(research-paper-writing): fill coverage gaps, integrate AI-Scientist & GPT-Researcher patterns
02356abc pushed a commit to 02356abc/hermes-agent that referenced this pull request May 14, 2026
…aper-writing-gaps

feat(research-paper-writing): fill coverage gaps, integrate AI-Scientist & GPT-Researcher patterns
gweeteve pushed a commit to gweeteve/hermes-agent that referenced this pull request Jun 2, 2026
…aper-writing-gaps

feat(research-paper-writing): fill coverage gaps, integrate AI-Scientist & GPT-Researcher patterns
waefrebeorn pushed a commit to waefrebeorn/slermes that referenced this pull request Jul 2, 2026
…aper-writing-gaps

feat(research-paper-writing): fill coverage gaps, integrate AI-Scientist & GPT-Researcher patterns
DavidMetcalfe added a commit to DavidMetcalfe/hermes-agent that referenced this pull request Aug 7, 2026
…PowerShell 5.1

Start-Process -NoNewWindow -PassThru returns a Process object whose
handle was never acquired on Windows PowerShell 5.1 (and pwsh 7.4.0 on
Windows; fixed upstream in 7.4.1), so WaitForExit()/ExitCode silently
read as $null (PowerShell issues NousResearch#20400 / NousResearch#5421). Touching .Handle
right after Start-Process forces the underlying handle open, which is
what WaitForExit() and .ExitCode need.

Caught by CI: installer-tests on windows-latest failed the fast-child
exit-code assertion under 5.1 (pwsh 7 passed).
melon-xf added a commit to melon-xf/hermes-agent that referenced this pull request Sep 3, 2026
…aper-writing-gaps

feat(research-paper-writing): fill coverage gaps, integrate AI-Scientist & GPT-Researcher patterns
fsca8 pushed a commit to fsca8/hermes-agent that referenced this pull request Oct 6, 2026
…aper-writing-gaps

feat(research-paper-writing): fill coverage gaps, integrate AI-Scientist & GPT-Researcher patterns
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant