By now you know why peer review matters, and why it’s important to be a better critic and accept constructive criticism. But to learn is to do, so let’s test your improved critiquing skills before really putting them to use.
Answer the following questions about TWO research projects (studies, media coverage about a study, journal article, etc). Use the Curated Library or any online resource to find the projects you want to critique.
Describe
- What was your first thought when you reviewed the study?
- Who is impacted by the research?
- What is/was the point of the study?
Analyze
- What is the name of the study? What’s the research question?
- How is the study presented? Is it accurate and reflective of the actual research or is it overselling its purpose/value?
- In your opinion, who is the main benefactor of the study? The environment? Industry? Government? All of the above?
- Were stakeholders consulted? Is/was the study welcomed by the community where it took place?
- Is the research addressing a gap in knowledge or is it improving/deepening existing information?
- Is/was the research question big enough? Is/was it focused? Does it include enough context?
- Is/was the research (question or otherwise) free of bias? Is/was the question leading or trying to pre-determine the outcome?
- Is/was the study realistic?
- Is/was the study missing any important elements?
Interpret
- Why do you think the study is/was funded?
- What is the purpose of the study? To offer a solution? To incent an action? To fix a problem?
- What message does the study send to the public?
- Has the study’s outcome been impactful? Will it be?
- Is there anything confusing that needs clarification?
Evaluate
- Is/was the research worthwhile? Is/was it a good use of resources?
- What do you like the most about it? What do you dislike?
- How has the study been received? How do you think it will be received? In the peer review process? In the scientific community? By the media and the public more generally?
- Can you think of any improvements?
- Why do you think the research was successful/unsuccessful? Why do you think it will be successful/unsuccessful?
Now compare and contrast your reviews and determine which scientific project is more successful. Point out what specific elements led you to this decision and remember to keep these ideas in mind as you work on your final project.