HOME SCHEDULE REVIEWS POLICIES PROJECTS

CS 3551: Paper Review Guidelines

Notes

Reviews must be submitted by 11:59pm the day before the class in which the paper will be discussed.

Reviews will be submitted in Canvas

Review format

Your paper reviews should use the following format. Please summarize in your own words (i.e. do not cut and paste from the paper).

1. Problem (1-3 sentences): What problem does the paper address?

2. Contribution (1-3 sentences): What is the main contribution of the paper? That is, what is the "new thing" that this paper makes possible? What is the key idea behind how it solves (part of) the problem it addresses?

3. Approach and techniques (1-2 paragraphs): Summarize the main ideas of the paper. How does the solution work? What are the most important techniques that are used?

4. Results (1 paragraph): How do the authors demonstrate that they were successful in achieving their goals?

5. Strengths (2 bullet points): List two things you thought the paper did well

6. Weaknesses / Improvements (2 bullet points): List two things you think the paper could improve

7. Discussion points (2 bullet points): List two things you would like to discuss in class.

Things to consider in strengths/weaknesses:

  • Is the problem new? Is it real? Is it important?
  • What assumptions does the paper make? Are those assumptions realistic?
  • Is the solution new? Is it practical? Is it better than previous solutions (and if so, how? is it strictly better or is there some tradeoff?)? Does the solution involve new techniques, or combining existing techniques in an interesting new way?
  • Is the system implemented? Does the evaluation convince you that the authors' conclusions are correct? 
  • Were the ideas explained clearly? Or were there parts that were difficult to understand?

To get started with discussion points, consider answering the questions below. Any ideas or questions you had while reading the paper are welcome!

  • What did you learn from the paper?
  • What questions did the paper raise for you?
  • What new ideas did the paper give you for future work? Can you think of a new/better solution? Is there a related problem that needs to be solved?
  • How does this paper connect to other papers you've read (either in this class or elsewhere)?
  • Can you use any of the ideas from the paper in your own research? 

Note: you should think carefully about the paper, but the review does not need to be long. About one page should be sufficient.