RigorCheckRigorCheck
    Sign In

    This is a sample critique

    This demo shows what a full paid RigorCheck critique looks like. The free report includes the Strategic Summary, Readiness Snapshot, Review Risks, and a preview of the Rejection Risk Grades. Unlock the full report for detailed Revision Priorities, Consistency Flags, the complete Fix Checklist, and Section-by-Section Feedback.

    Effects of Cognitive Load on Working Memory Performance in Academic Settings

    Field: Psychology|Target: Journal of Experimental Psychology

    Note: This AI peer review simulates common peer review comments and highlights likely concerns. It does not replace journal-specific peer review.

    Strategic SummaryFREE

    The core experiment is strong and theoretically grounded. However, analytical transparency gaps around moderation and inconsistent effect size reporting will likely dominate reviewer attention. Addressing these before submission significantly increases probability of minor rather than major revision.

    What reviewers will perceive

    A well-designed study undermined by incomplete reporting of moderation analyses and inconsistent effect size metrics.

    Manuscript Readiness SnapshotFREE

    Attention Level
    Moderate–High
    Reviewer Focus Area

    Major revision likely due to Methods transparency gaps and unreported moderation measures

    Contribution Strength

    Strong core contribution to cognitive load theory if replication details and effect size consistency are addressed

    Bottom Line

    These issues are fixable without new data collection—primarily reporting and transparency improvements needed.

    Primary Review RisksFREE

    • 1Unreported measures regarding conceptual moderation questions.
    • 2Inconsistent effect size metrics across summary and detailed reporting.
    • 3Insufficient procedural detail for replication.

    What's Working WellFREE

    • Statistical power analysis explicitly justifies sample size, addressing a common reviewer concern.
    • Randomized controlled design with manipulation check enables stronger causal inferences.
    • Adherence to cognitive load theory provides clear theoretical framing and testable predictions.

    Rejection Risk Area GradesFREE PREVIEW

    Study Rationale

    B+

    Issues

    • Moderation RQ introduced without operational definition
    • Theoretical gap clearly stated

    Likely Reviewer Concern

    The rationale for examining individual differences lacks specificity, weakening the case for Hypothesis 3.

    Methodological Rigor

    C+

    Issues

    • Missing individual difference measures
    • Load task parameters unspecified
    • No procedure table
    • Power analysis well-documented

    Likely Reviewer Concern

    Insufficient procedural detail will raise replication concerns and likely trigger a major revision request.

    Discussion Completeness

    B-

    Issues

    • Null moderation result not discussed
    • No link to capacity vs. efficiency debate
    • Core findings connected to theory

    Likely Reviewer Concern

    Selective reporting of only supported hypotheses may be perceived as lacking objectivity.

    Writing Quality

    B

    Issues

    • Inconsistent effect size metrics across sections
    • Abstract omits response time findings
    • Clear theoretical framing throughout

    Likely Reviewer Concern

    Switching between Cohen's d and partial eta-squared without explanation disrupts cross-study comparability.

    Top Revision PrioritiesFULL REPORT

    • 1
      The moderation hypothesis is tested in Results without definition in Methods. This disconnect will likely prompt reviewers to question whether the analysis was planned or exploratory. Define specific individual difference measures (e.g., working memory capacity, prior knowledge) and the analysis strategy in the Methods section before reporting results.
    • 2
      Effect size reporting varies between Cohen's d and partial eta-squared, making cross-study comparison difficult and potentially confusing reviewers. Standardize on Cohen's d for pairwise comparisons throughout, and include 95% confidence intervals for all estimates using the formula: d ± 1.96 × SE(d).
    • 3
      Procedural descriptions lack the granularity required for JEP replication standards. Add a table listing: image resolution (px), presentation duration (ms), inter-stimulus interval, load task specifications (e.g., digit span length, retention interval), and total trial count per condition.

    Consistency Flags (3)FULL REPORT

    AbstractMentions accuracy outcomes only
    ResultsReports both Accuracy and Response Time findings
    Update Abstract to include RT finding: 'Response times were significantly slower under high cognitive load (p < .01)' to ensure all key outcomes are represented.
    IntroductionProposes moderation RQ regarding individual differences
    MethodsNo individual difference measures described
    ResultsTests and rejects Hypothesis 3 regarding moderation
    Add a 'Measures' subsection in Methods describing the individual difference instrument (e.g., operation span task), or remove the moderation research question if data were not collected.
    AbstractReports d = 0.65 (Cohen's d)
    ResultsReports partial η² = .10 as primary effect size
    Standardize effect size reporting by using Cohen's d throughout both sections, or add a note explaining the conversion (d ≈ 0.67 from η² = .10 for this design).

    Submission Fix ChecklistFULL REPORT(0/11 done)

    • Define moderation construct in Introduction
    • Add Measures subsection in Methods
    • Report Cronbach's α reliability for all instruments
    • Specify load task parameters (digit span, retention interval, recall method)
    • Add procedure table with stimuli details and trial counts
    • Standardize effect size reporting to Cohen's d throughout
    • Add 95% confidence intervals to all effect sizes
    • Label Hypothesis 3 as exploratory or add rationale in Introduction
    • Include response time findings in Abstract
    • Discuss null moderation result in Discussion
    • Link Discussion back to capacity vs. efficiency mechanisms

    Section-by-Section FeedbackFULL REPORT(5 sections, 11 items)

    We use cookies for analytics to improve your experience. Read our Privacy Policy for details.