Visualization evaluation has been addressed through a range of techniques, algorithms, and assessment frameworks. Many of these approaches focus on features that can be measured objectively, such as visual structure, design choices, accuracy, or perceptual effectiveness. However, evaluating visualization work also requires subjective judgment. Instructors need ways to assess whether students’ visualizations communicate effectively, and students need opportunities to develop the ability to critically evaluate visual work produced by others.
Visual Peer Review was developed to support this process. The project combines a structured visualization rubric with a peer-review workflow designed for classroom and professional contexts. The goal is to help students evaluate visualizations more carefully, provide more meaningful feedback, and learn visualization principles through the act of review.
A dedicated Visual Peer Review website is now available at visualpeerreview.org. The site includes a live demonstration of the Visual Peer Review experience and provides access to project materials, publications, funding information, and related demonstrations.
Below are selected publications, funding details, and live demonstrations associated with the project:
2026 Friedman, A., Rahman, M. D., Dinh, L., & Rosen, P. “Designing for engagement: A comparison of Canvas and a visual peer review dashboard.” ACM Transactions on Computing Education
2024 Friedman, A, Hawley, K. Rosen, P, Rahman, Md D. “Enhancing Student Feedback Using Predictive Models in Visual Literacy Courses” IEEE EDUCON 2024, IEEE Global Engineering Education Conference , Kos, Greece.
2024 Dinh, L., Friedman, A, and Hawley, K .“Examining peer review network dynamics in higher education visual communication courses using ERGM.” Computers and Education Open.
2024 Friedman, A., Hawley, K., Rosen, P., and Rahman, Md.D. “Enhancing Student Feedback Using Predictive Models in Visual Literacy Courses.” IEEE EDUCON, Kos, Greece, 2024
2023. Friedman, A and Hawley, K. “Visual Peer Review: Examining Students’ Parts of Speech Comments vs. Grade.” EdMedia + Innovate Learning. The Association for the Advancement of Computing in Education (AACE).
2022. Z Beasley, A Friedman, P Rosen. “Through the Looking Glass: Insights into Visualization Pedagogy through Sentiment Analysis of Peer Review Text.” IEEE Computer Graphics and Applications
2020. Z Beasley, A Friedman, L Pier, P Rosen.”Leveraging Peer Feedback to Improve Visualization Education.” IEEE Pacific Visualization conference.
2019. Friedman, A.”Toward peer-review software and a rubric application in visual analytics classes: A case study.” Education for Information Special issue: Visual Learning by Education for Information
2018. Friedman, A. & Rosen, P. “MyReviewers Visualization Peer Review.” The 5th International Conference on Writing Analytics . St. Petersburg, FL.
2017. Friedman, A. & Rosen, P. “Leveraging Peer Review in Visualization Education: A Proposal for a New Mode.” IEEE Pedagogy of Data Visualization Workshop , Phoenix, AZ
FundingMay 26, 2022 NSF Award III-2216227: “Using Behavioral Nudges in Peer Review to Improve Critical Analysis in STEM Courses”. Total Awarded: $297,604.00Live Demonstration www.visualpeerreview.org
