CS 3551: Paper Review Guidelines
Notes
In general, each student will be responsible for writing a review for
one paper for each class meeting (although we may discuss multiple papers
in a single meeting).
Reviews must be submitted by 2pm the day of the class
in which the paper will be discussed (this gives me time to read them ahead of time).
Submit reviews here: https://pitt-cs3551-2020.hotcrp.com
Review format
Each review must include the following sections:
- Summary
- What problem does the paper address?
- What is the main contribution of the paper? What is the key idea
behind how it solves (part of) the problem it addresses? How is that
different from what was done in the past?
- Brief summary of approach, techniques used, results.
- Strengths (at least 2 bullet points)
- Weaknesses (at least 2 bullet points)
- Detailed Comments
- Explain your thoughts and give your overall opinion of the paper.
Do its strengths outweigh its weaknesses? Why or why not?
- Some things to consider:
- Is the problem new? Is it real? Is it important?
- What assumptions does the paper make? Are those assumptions realistic?
- Is the solution new? Is it practical? Is it better than previous solutions (and if so, how? is it strictly better or is there some tradeoff?)? Does the solution involve new techniques, or combining existing techniques in a new way?
- Is the system implemented? Does the evaluation convince you that the authors' conclusions are correct?
- Discussion Points (at least 2): this wouldn't be included in a
conference review, but will help guide our class meetings
- What did you learn from the paper?
- What questions did the paper raise for you?
- What new ideas did the paper give you for future work? Can you
think of a new/better solution? Is there a related problem that needs
to be solved?
- How does this paper connect to other papers you've read (either in this class or elsewhere)?
- Can you use any of the ideas from the paper in your own research?
Note: this format is partially borrowed from Xin Jin's Advanced Computer
Networks course at JHU.