Peer reviewers do not read papers looking for reasons to accept—they read looking for reasons to trust. The dimensions they check are predictable: novelty, soundness, clarity, methodology, citations, and ethics. Understanding what each one actually tests is the difference between a paper that survives review and one that fails it.
Reviewers are not a single homogeneous audience. They bring different expertise, priorities, and biases. But the dimensions they evaluate are remarkably stable across fields, because they map to the basic question every paper has to answer: does this claim, supported by this evidence, deserve to be in the literature?
What are the main dimensions peer reviewers check?
Novelty and contribution
The first thing a reviewer asks: what is new here, and is the new thing worth publishing? Novelty is not the same as originality for its own sake. A paper is novel when it contributes something the literature does not already contain—a new result, method, dataset, analysis, or synthesis.
The failure mode is a paper whose contribution is implicit. If the reviewer cannot state your contribution in one sentence after reading the abstract and introduction, they will assume there is not one. State it explicitly, as an action: “we derive,” “we measure,” “we show.”
Soundness of claims
Soundness is the fit between claims and evidence. A sound paper claims only what its evidence supports; an unsound paper overreaches.
Reviewers test this by asking, for each claim: where is the evidence? If the paper says “X outperforms Y,” the reviewer looks for the comparison, the metric, the statistical test, and the conditions under which it holds. If any of these are missing or weak, the claim is unsupported.
The most common soundness failure is overgeneralization. An experiment run on one dataset under specific conditions does not support a universal claim. Reviewers will catch this and the paper will come back for revision or rejection.
Methodology and reproducibility
Reviewers check whether the methodology can answer the question the paper asks, and whether someone else could reproduce the results from the description given. This includes:
- Study design that matches the research question
- Sample sizes justified by power analysis or domain convention
- Baselines that represent the actual state of the art
- Statistical tests appropriate to the data
- Sufficient detail to reproduce the experiment
Reproducibility is not optional. Reviewers increasingly expect data, code, or configuration to be available, and many journals require it. See the FAIR principles for the emerging standard on data stewardship.
Clarity and presentation
Clarity is not decoration. A paper that is hard to read is hard to evaluate, and reviewers under time pressure will not give you the benefit of the doubt.
Reviewers check:
- Is the contribution stated explicitly in the first page?
- Is terminology stable (the same concept should not have three names)?
- Are figures legible and self-explanatory?
- Does the structure follow the standard for the field?
- Are the abstract, introduction, and conclusion mutually consistent?
Citation and related work coverage
Reviewers check whether you have positioned your work in the literature honestly. The failures they look for:
- Missing the obvious baselines or direct predecessors
- Citing only your own group’s work
- Decorative citations that do no work in the sentence
- Outdated references when the field has moved
Use Google Scholar and Semantic Scholar to walk citation chains, and check arXiv for recent work in fast-moving fields. A reference manager like Zotero keeps your bibliography consistent.
Ethics and integrity
Reviewers look for:
- Plagiarism or excessive self-plagiarism
- Data fabrication or manipulation
- Undisclosed conflicts of interest
- Ethical approval for human or animal subjects
- Citation manipulation (coercive citation, citation rings)
These are not soft checks. They are the things that get papers retracted and careers ended. The Committee on Publication Ethics (COPE) maintains the standards most journals follow.
How do reviewers decide on novelty?
Novelty is the dimension most authors worry about and the one most poorly understood. Reviewers do not look for “something no one has ever thought of.” They look for a contribution that is positioned clearly against existing work.
The test is comparative: against the closest existing work, what does this paper add? If you cannot answer that in one paragraph in your Related Work section, the reviewer will conclude the contribution is unclear, and the paper will struggle.
How do reviewers evaluate methodology?
Methodology evaluation is not about whether your method is the best possible one. It is about whether your method can answer the question you are asking.
A reviewer asks:
- Does the method match the claim? (A correlational method cannot support a causal claim.)
- Are the assumptions stated? (Hiding assumptions is worse than having them.)
- Are the limitations acknowledged? (Every method has limits; pretending otherwise is a red flag.)
- Is there a sensible baseline? (No baseline, no paper.)
How do reviewers handle unclear writing?
Unclear writing is treated as a substantive problem, not a cosmetic one. Reviewers assume that if you cannot explain your work clearly, you may not understand it well enough yourself. This is unfair in some cases, but it is how the system works.
The implication is concrete: invest in clarity before submission. Run your paper through a structured external review that evaluates clarity the way a reviewer would, and fix the issues while you still can.
What do reviewers want in the cover letter?
A cover letter is not where you make the case for the paper—the paper does that. The cover letter is where you (1) state the contribution in two sentences, (2) explain why it fits this journal, and (3) declare any conflicts or special considerations. Editors read cover letters first, and they decide whether your paper goes to reviewers at all.
Frequently asked questions
What do peer reviewers actually look for in a paper? Peer reviewers check six core dimensions: novelty (what is new and worth publishing), soundness (do claims match evidence), methodology (can the method answer the question), clarity (can the paper be understood), citation coverage (is the work positioned in the literature), and ethics (no plagiarism, fabrication, or undisclosed conflicts).
How do reviewers judge novelty? Reviewers judge novelty comparatively: against the closest existing work, what does this paper add? Novelty is not originality for its own sake—it is a contribution the literature does not already contain. If you cannot state the contribution in one paragraph in Related Work, reviewers will conclude it is unclear.
What makes a methodology sound for reviewers? A methodology is sound when it matches the claim being made, states its assumptions explicitly, acknowledges its limitations, and includes a sensible baseline. Reviewers test whether the method can answer the research question and whether someone else could reproduce the results from the description given.
How important is clarity in peer review? Very important, and often underestimated. Reviewers treat unclear writing as a substantive problem: if you cannot explain your work clearly, they assume you may not understand it well enough. Clarity is not decoration—it is part of how your work gets evaluated.
What ethical issues do reviewers check for? Reviewers check for plagiarism and excessive self-plagiarism, data fabrication or manipulation, undisclosed conflicts of interest, missing ethical approval for human or animal subjects, and citation manipulation such as coercive citation or citation rings. These are the issues that lead to retraction under COPE guidance.