{"id":333,"date":"2014-11-08T00:00:51","date_gmt":"2014-11-08T08:00:51","guid":{"rendered":"http:\/\/steveharoz.com\/blog\/?p=333"},"modified":"2014-11-08T00:00:51","modified_gmt":"2014-11-08T08:00:51","slug":"guide-to-user-performance-evaluation-at-infovis-2014","status":"publish","type":"post","link":"http:\/\/steveharoz.com\/blog\/2014\/guide-to-user-performance-evaluation-at-infovis-2014\/","title":{"rendered":"Guide to user performance evaluation at InfoVis 2014"},"content":{"rendered":"<p>The goal of this guide is to help highlight papers that demonstrate\u00a0evidence of a user performance benefit. I used two criteria:<\/p>\n<ol>\n<li>The paper includes an\u00a0experiment measuring user performance (e.g. accuracy or speed)<\/li>\n<li>Analysis of statistical differences determined whether\u00a0results were reliable.<\/li>\n<\/ol>\n<p>I\u00a0did not discriminate beyond those two criteria. However, I am using a gold star <span style=\"color: #ffcc00; font-size:1.15rem; line-height:100%;\">&#x2605;<\/span> to highlight one property\u00a0that only a few papers have: a generalizable explanation for why the results occurred. You can read more about explanatory hypotheses <a title=\"Mysterious Origins of Hypotheses in Visualization and CHI\" href=\"http:\/\/steveharoz.com\/blog\/?p=304\">here<\/a>.<\/p>\n<p><!--more--><strong>DimpVis: Exploring Time-varying Information Visualizations by Direct Manipulation<\/strong>\u00a0&#8211; Brittany Kondo, Christopher Collins. \u00a0<a id=\"6a2c8f6409415\" rel=\"wp-video-lightbox\" href=\"https:\/\/vimeo.com\/102605824?width=1920&#038;height=1080\" title=\"\">video<\/a>    <script>\r\n    \/* <![CDATA[ *\/\r\n    jQuery(document).ready(function($){\r\n        $(function(){\r\n            var width = $(window).innerWidth();\r\n            var setwidth = parseFloat(1920);\r\n            var ratio = parseFloat(0.5625);\r\n            var height = parseFloat(1080);\r\n            var link = 'https:\/\/vimeo.com\/102605824?width=1920&amp;height=1080';\r\n            if(width < setwidth)\r\n            {\r\n                height = Math.floor(width * 0.5625);\r\n                \/\/console.log(\"device width \"+width+\", set width \"+1920+\", ratio \"+0.5625+\", new height \"+ height);\r\n                var new_url = wpvl_paramReplace('width', link, width);\r\n                var new_url = wpvl_paramReplace('height', new_url, height);\r\n                $(\"a#6a2c8f6409415\").attr('href', new_url);\r\n                \/\/console.log(new_url);\r\n            }\r\n        });\r\n    });\r\n    \/* ]]> *\/\r\n    <\/script>\u00a0<a href=\"http:\/\/vialab.science.uoit.ca\/wordpress\/wp-content\/papercite-data\/pdf\/kon2014b.pdf\">pdf<\/a><br \/>\n<em>Tuesday 11:10<\/em><\/p>\n<p><strong><span class=\"star\"> <a title=\"Explanatory\" href=\"http:\/\/steveharoz.com\/blog\/?p=304\">Explanatory <\/a><\/span>Tree Colors: color schemes for tree structured data<\/strong>\u00a0&#8211; Martijn Tennekes, Edwin de Jonge.\u00a0 <a id=\"6a2c8f6409473\" rel=\"wp-video-lightbox\" href=\"https:\/\/vimeo.com\/102604515?width=1920&#038;height=1080\" title=\"\">video<\/a>    <script>\r\n    \/* <![CDATA[ *\/\r\n    jQuery(document).ready(function($){\r\n        $(function(){\r\n            var width = $(window).innerWidth();\r\n            var setwidth = parseFloat(1920);\r\n            var ratio = parseFloat(0.5625);\r\n            var height = parseFloat(1080);\r\n            var link = 'https:\/\/vimeo.com\/102604515?width=1920&amp;height=1080';\r\n            if(width < setwidth)\r\n            {\r\n                height = Math.floor(width * 0.5625);\r\n                \/\/console.log(\"device width \"+width+\", set width \"+1920+\", ratio \"+0.5625+\", new height \"+ height);\r\n                var new_url = wpvl_paramReplace('width', link, width);\r\n                var new_url = wpvl_paramReplace('height', new_url, height);\r\n                $(\"a#6a2c8f6409473\").attr('href', new_url);\r\n                \/\/console.log(new_url);\r\n            }\r\n        });\r\n    });\r\n    \/* ]]> *\/\r\n    <\/script> [not public]<br \/>\n<em>Tuesday 15:20<\/em><\/p>\n<p><strong>(TVCG) GraphDiaries: Animated Transitions and Temporal Navigation for Dynamic Networks<\/strong>\u00a0&#8211; Benjamin Bach, Emmanuel Pietriga, Jean-Daniel Fekete.\u00a0 <a id=\"6a2c8f64094a8\" rel=\"wp-video-lightbox\" href=\"https:\/\/vimeo.com\/102526646?width=1920&#038;height=1080\" title=\"\">video<\/a>    <script>\r\n    \/* <![CDATA[ *\/\r\n    jQuery(document).ready(function($){\r\n        $(function(){\r\n            var width = $(window).innerWidth();\r\n            var setwidth = parseFloat(1920);\r\n            var ratio = parseFloat(0.5625);\r\n            var height = parseFloat(1080);\r\n            var link = 'https:\/\/vimeo.com\/102526646?width=1920&amp;height=1080';\r\n            if(width < setwidth)\r\n            {\r\n                height = Math.floor(width * 0.5625);\r\n                \/\/console.log(\"device width \"+width+\", set width \"+1920+\", ratio \"+0.5625+\", new height \"+ height);\r\n                var new_url = wpvl_paramReplace('width', link, width);\r\n                var new_url = wpvl_paramReplace('height', new_url, height);\r\n                $(\"a#6a2c8f64094a8\").attr('href', new_url);\r\n                \/\/console.log(new_url);\r\n            }\r\n        });\r\n    });\r\n    \/* ]]> *\/\r\n    <\/script> <a href=\"https:\/\/hal.inria.fr\/hal-00906597\/document\">pdf<\/a><br \/>\n<em>Tuesday 17:15<\/em><\/p>\n<p><strong>(TVCG) Visual Adjacency Lists for Dynamic Graphs<\/strong>\u00a0&#8211; Marcel Hlawatsch, Michael Burch, Daniel Weiskopf. \u00a0<a id=\"6a2c8f64094d7\" rel=\"wp-video-lightbox\" href=\"https:\/\/vimeo.com\/103884936?width=1920&#038;height=1080\" title=\"\">video<\/a>    <script>\r\n    \/* <![CDATA[ *\/\r\n    jQuery(document).ready(function($){\r\n        $(function(){\r\n            var width = $(window).innerWidth();\r\n            var setwidth = parseFloat(1920);\r\n            var ratio = parseFloat(0.5625);\r\n            var height = parseFloat(1080);\r\n            var link = 'https:\/\/vimeo.com\/103884936?width=1920&amp;height=1080';\r\n            if(width < setwidth)\r\n            {\r\n                height = Math.floor(width * 0.5625);\r\n                \/\/console.log(\"device width \"+width+\", set width \"+1920+\", ratio \"+0.5625+\", new height \"+ height);\r\n                var new_url = wpvl_paramReplace('width', link, width);\r\n                var new_url = wpvl_paramReplace('height', new_url, height);\r\n                $(\"a#6a2c8f64094d7\").attr('href', new_url);\r\n                \/\/console.log(new_url);\r\n            }\r\n        });\r\n    });\r\n    \/* ]]> *\/\r\n    <\/script> <a href=\"http:\/\/www.visus.uni-stuttgart.de\/uploads\/tx_vispublications\/TVCG2322594.pdf\">pdf<\/a><br \/>\n<em>Tuesday 17:35<\/em><\/p>\n<p><strong>(TVCG) How to Display Group Information on Node-Link Diagrams: an Evaluation<\/strong>\u00a0&#8211; Radu Jianu, Adrian Rusu, Yifan Hu, Douglas Taggart.\u00a0 <a id=\"6a2c8f6409503\" rel=\"wp-video-lightbox\" href=\"https:\/\/vimeo.com\/102526993?width=1920&#038;height=1080\" title=\"\">video<\/a>    <script>\r\n    \/* <![CDATA[ *\/\r\n    jQuery(document).ready(function($){\r\n        $(function(){\r\n            var width = $(window).innerWidth();\r\n            var setwidth = parseFloat(1920);\r\n            var ratio = parseFloat(0.5625);\r\n            var height = parseFloat(1080);\r\n            var link = 'https:\/\/vimeo.com\/102526993?width=1920&amp;height=1080';\r\n            if(width < setwidth)\r\n            {\r\n                height = Math.floor(width * 0.5625);\r\n                \/\/console.log(\"device width \"+width+\", set width \"+1920+\", ratio \"+0.5625+\", new height \"+ height);\r\n                var new_url = wpvl_paramReplace('width', link, width);\r\n                var new_url = wpvl_paramReplace('height', new_url, height);\r\n                $(\"a#6a2c8f6409503\").attr('href', new_url);\r\n                \/\/console.log(new_url);\r\n            }\r\n        });\r\n    });\r\n    \/* ]]> *\/\r\n    <\/script> <a href=\"http:\/\/users.cis.fiu.edu\/~rdjianu\/paper_TVCG2014_groupinfo.pdf\">pdf<\/a><br \/>\n<em>Tuesday 17:55<\/em><\/p>\n<p><strong>The Effects of Interactive Latency on Exploratory Visual Analysis\u00a0<\/strong>&#8211;\u00a0Zhicheng Liu, Jeffrey Heer.  <a id=\"6a2c8f640952e\" rel=\"wp-video-lightbox\" href=\"https:\/\/vimeo.com\/102604512?width=1920&#038;height=1080\" title=\"\">video<\/a>    <script>\r\n    \/* <![CDATA[ *\/\r\n    jQuery(document).ready(function($){\r\n        $(function(){\r\n            var width = $(window).innerWidth();\r\n            var setwidth = parseFloat(1920);\r\n            var ratio = parseFloat(0.5625);\r\n            var height = parseFloat(1080);\r\n            var link = 'https:\/\/vimeo.com\/102604512?width=1920&amp;height=1080';\r\n            if(width < setwidth)\r\n            {\r\n                height = Math.floor(width * 0.5625);\r\n                \/\/console.log(\"device width \"+width+\", set width \"+1920+\", ratio \"+0.5625+\", new height \"+ height);\r\n                var new_url = wpvl_paramReplace('width', link, width);\r\n                var new_url = wpvl_paramReplace('height', new_url, height);\r\n                $(\"a#6a2c8f640952e\").attr('href', new_url);\r\n                \/\/console.log(new_url);\r\n            }\r\n        });\r\n    });\r\n    \/* ]]> *\/\r\n    <\/script> <a href=\"http:\/\/idl.cs.washington.edu\/files\/2014-Latency-InfoVis.pdf\">pdf<\/a><br \/>\n<em>Wednesday 10:30<\/em><\/p>\n<p><strong>Error Bars Considered Harmful: Exploring Alternate Encodings for Mean and Error\u00a0<\/strong>&#8211; Michael Correll, Michael Gleicher.  <a href=\"https:\/\/graphics.cs.wisc.edu\/Papers\/2014\/CG14\/Preprint.pdf\">pdf<\/a><br \/>\n<em>Wednesday 11:10<\/em><\/p>\n<p><strong>Four Experiments on the Perception of Bar Charts<\/strong>&#8211; Justin Talbot, Vidya Setlur, Anushka Anand.  [not public]<br \/>\n<em>Wednesday 11:30<\/em><\/p>\n<p><strong><span class=\"star\"><a title=\"Explanatory\" href=\"http:\/\/steveharoz.com\/blog\/?p=304\">Explanatory <\/a><\/span>The Persuasive Power of Data Visualization\u00a0<\/strong>&#8211; Anshul Vikram Pandey, Anjali Manivannan, Oded Nov, Margaret Satterthwaite, Enrico Bertini.  <a id=\"6a2c8f6409557\" rel=\"wp-video-lightbox\" href=\"https:\/\/vimeo.com\/102604990?width=1920&#038;height=1080\" title=\"\">video<\/a>    <script>\r\n    \/* <![CDATA[ *\/\r\n    jQuery(document).ready(function($){\r\n        $(function(){\r\n            var width = $(window).innerWidth();\r\n            var setwidth = parseFloat(1920);\r\n            var ratio = parseFloat(0.5625);\r\n            var height = parseFloat(1080);\r\n            var link = 'https:\/\/vimeo.com\/102604990?width=1920&amp;height=1080';\r\n            if(width < setwidth)\r\n            {\r\n                height = Math.floor(width * 0.5625);\r\n                \/\/console.log(\"device width \"+width+\", set width \"+1920+\", ratio \"+0.5625+\", new height \"+ height);\r\n                var new_url = wpvl_paramReplace('width', link, width);\r\n                var new_url = wpvl_paramReplace('height', new_url, height);\r\n                $(\"a#6a2c8f6409557\").attr('href', new_url);\r\n                \/\/console.log(new_url);\r\n            }\r\n        });\r\n    });\r\n    \/* ]]> *\/\r\n    <\/script> <a href=\"http:\/\/lsr.nellco.org\/cgi\/viewcontent.cgi?article=1476&#038;context=nyu_plltwp\">pdf<\/a><br \/>\n<em>Wednesday 15:20<\/em><\/p>\n<p><strong>Comparative Eye Tracking Study on Node-Link Visualizations of Trajectories<\/strong>\u00a0&#8211; Rudolf Netzel, Michael Burch, Daniel Weiskopf.  <a id=\"6a2c8f640957f\" rel=\"wp-video-lightbox\" href=\"https:\/\/vimeo.com\/102605490?width=1920&#038;height=1080\" title=\"\">video<\/a>    <script>\r\n    \/* <![CDATA[ *\/\r\n    jQuery(document).ready(function($){\r\n        $(function(){\r\n            var width = $(window).innerWidth();\r\n            var setwidth = parseFloat(1920);\r\n            var ratio = parseFloat(0.5625);\r\n            var height = parseFloat(1080);\r\n            var link = 'https:\/\/vimeo.com\/102605490?width=1920&amp;height=1080';\r\n            if(width < setwidth)\r\n            {\r\n                height = Math.floor(width * 0.5625);\r\n                \/\/console.log(\"device width \"+width+\", set width \"+1920+\", ratio \"+0.5625+\", new height \"+ height);\r\n                var new_url = wpvl_paramReplace('width', link, width);\r\n                var new_url = wpvl_paramReplace('height', new_url, height);\r\n                $(\"a#6a2c8f640957f\").attr('href', new_url);\r\n                \/\/console.log(new_url);\r\n            }\r\n        });\r\n    });\r\n    \/* ]]> *\/\r\n    <\/script>\u00a0[not public]<br \/>\n<em>Thursday 8:30<\/em><\/p>\n<p><strong>Node, Node-Link, and Node-Link-Group Diagrams: An Evaluation<\/strong>\u00a0&#8211; Bahador Saket, Paolo Simonetto, Stephen Kobourov, Katy Borner.  <a id=\"6a2c8f64095a6\" rel=\"wp-video-lightbox\" href=\"https:\/\/vimeo.com\/102606410?width=1920&#038;height=1080\" title=\"\">video<\/a>    <script>\r\n    \/* <![CDATA[ *\/\r\n    jQuery(document).ready(function($){\r\n        $(function(){\r\n            var width = $(window).innerWidth();\r\n            var setwidth = parseFloat(1920);\r\n            var ratio = parseFloat(0.5625);\r\n            var height = parseFloat(1080);\r\n            var link = 'https:\/\/vimeo.com\/102606410?width=1920&amp;height=1080';\r\n            if(width < setwidth)\r\n            {\r\n                height = Math.floor(width * 0.5625);\r\n                \/\/console.log(\"device width \"+width+\", set width \"+1920+\", ratio \"+0.5625+\", new height \"+ height);\r\n                var new_url = wpvl_paramReplace('width', link, width);\r\n                var new_url = wpvl_paramReplace('height', new_url, height);\r\n                $(\"a#6a2c8f64095a6\").attr('href', new_url);\r\n                \/\/console.log(new_url);\r\n            }\r\n        });\r\n    });\r\n    \/* ]]> *\/\r\n    <\/script>\u00a0<a href=\"http:\/\/cns.iu.edu\/docs\/publications\/2014-saket-ieee.pdf\">pdf<\/a><br \/>\n<em>Thursday 8:50<\/em><\/p>\n<p><strong><span class=\"star\"><a title=\"Explanatory\" href=\"http:\/\/steveharoz.com\/blog\/?p=304\">Explanatory <\/a><\/span>The Not-so-Staggering Effect of Staggered Animated Transitions on Visual Tracking<\/strong>\u00a0&#8211; Fanny Chevalier, Pierre Dragicevic, Steven Franconeri.  <a id=\"6a2c8f64095cc\" rel=\"wp-video-lightbox\" href=\"https:\/\/vimeo.com\/102606411?width=1920&#038;height=1080\" title=\"\">video<\/a>    <script>\r\n    \/* <![CDATA[ *\/\r\n    jQuery(document).ready(function($){\r\n        $(function(){\r\n            var width = $(window).innerWidth();\r\n            var setwidth = parseFloat(1920);\r\n            var ratio = parseFloat(0.5625);\r\n            var height = parseFloat(1080);\r\n            var link = 'https:\/\/vimeo.com\/102606411?width=1920&amp;height=1080';\r\n            if(width < setwidth)\r\n            {\r\n                height = Math.floor(width * 0.5625);\r\n                \/\/console.log(\"device width \"+width+\", set width \"+1920+\", ratio \"+0.5625+\", new height \"+ height);\r\n                var new_url = wpvl_paramReplace('width', link, width);\r\n                var new_url = wpvl_paramReplace('height', new_url, height);\r\n                $(\"a#6a2c8f64095cc\").attr('href', new_url);\r\n                \/\/console.log(new_url);\r\n            }\r\n        });\r\n    });\r\n    \/* ]]> *\/\r\n    <\/script> <a href=\"https:\/\/hal.inria.fr\/hal-01054408\/document\">pdf<\/a><br \/>\n<em>Thursday 9:10<\/em><\/p>\n<p><strong><span class=\"star\"><a title=\"Explanatory\" href=\"http:\/\/steveharoz.com\/blog\/?p=304\">Explanatory <\/a><\/span>The Influence of Contour on Similarity Perception of Star Glyphs<\/strong>\u00a0&#8211; Johannes Fuchs, Petra Isenberg, Anastasia Bezerianos, Fabian Fischer, Enrico Bertini.  <a id=\"6a2c8f64095f2\" rel=\"wp-video-lightbox\" href=\"https:\/\/vimeo.com\/102605822?width=1920&#038;height=1080\" title=\"\">video<\/a>    <script>\r\n    \/* <![CDATA[ *\/\r\n    jQuery(document).ready(function($){\r\n        $(function(){\r\n            var width = $(window).innerWidth();\r\n            var setwidth = parseFloat(1920);\r\n            var ratio = parseFloat(0.5625);\r\n            var height = parseFloat(1080);\r\n            var link = 'https:\/\/vimeo.com\/102605822?width=1920&amp;height=1080';\r\n            if(width < setwidth)\r\n            {\r\n                height = Math.floor(width * 0.5625);\r\n                \/\/console.log(\"device width \"+width+\", set width \"+1920+\", ratio \"+0.5625+\", new height \"+ height);\r\n                var new_url = wpvl_paramReplace('width', link, width);\r\n                var new_url = wpvl_paramReplace('height', new_url, height);\r\n                $(\"a#6a2c8f64095f2\").attr('href', new_url);\r\n                \/\/console.log(new_url);\r\n            }\r\n        });\r\n    });\r\n    \/* ]]> *\/\r\n    <\/script> <a href=\"http:\/\/www.computer.org\/csdl\/trans\/tg\/preprint\/06875973.pdf\">pdf<\/a><br \/>\n<em>Thursday 9:30<\/em><\/p>\n<p><strong>Order of Magnitude Markers: An Empirical Study on Large Magnitude Number Detection<\/strong>\u00a0&#8211; Rita Borgo, Joel Dearden, Mark W. Jones.  <a id=\"6a2c8f6409617\" rel=\"wp-video-lightbox\" href=\"https:\/\/vimeo.com\/102606149?width=1920&#038;height=1080\" title=\"\">video<\/a>    <script>\r\n    \/* <![CDATA[ *\/\r\n    jQuery(document).ready(function($){\r\n        $(function(){\r\n            var width = $(window).innerWidth();\r\n            var setwidth = parseFloat(1920);\r\n            var ratio = parseFloat(0.5625);\r\n            var height = parseFloat(1080);\r\n            var link = 'https:\/\/vimeo.com\/102606149?width=1920&amp;height=1080';\r\n            if(width < setwidth)\r\n            {\r\n                height = Math.floor(width * 0.5625);\r\n                \/\/console.log(\"device width \"+width+\", set width \"+1920+\", ratio \"+0.5625+\", new height \"+ height);\r\n                var new_url = wpvl_paramReplace('width', link, width);\r\n                var new_url = wpvl_paramReplace('height', new_url, height);\r\n                $(\"a#6a2c8f6409617\").attr('href', new_url);\r\n                \/\/console.log(new_url);\r\n            }\r\n        });\r\n    });\r\n    \/* ]]> *\/\r\n    <\/script> <a href=\"http:\/\/cs.swansea.ac.uk\/~csmark\/PDFS\/2014_infovis_order_of_magnitude_markers.pdf\">pdf<\/a><br \/>\n<em>Thursday 9:50<\/em><\/p>\n<p><strong><span class=\"star\"><a title=\"Explanatory\" href=\"http:\/\/steveharoz.com\/blog\/?p=304\">Explanatory <\/a><\/span>Learning Perceptual Kernels for Visualization Design<\/strong>\u00a0&#8211; \u00c7a\u011fatay Demiralp, Michael Bernstein, Jeffrey Heer.  <a href=\"http:\/\/hci.stanford.edu\/publications\/2014\/perceptualkernels\/perceptualkernels-infovis2014.pdf\">pdf<\/a><br \/>\n<em>Thursday 16:15<\/em><\/p>\n<p><strong><span class=\"star\"><a title=\"Explanatory\" href=\"http:\/\/steveharoz.com\/blog\/?p=304\">Explanatory <\/a><\/span>Ranking Visualization of Correlation Using Weber\u2019s Law<\/strong>\u00a0&#8211;\u00a0Lane Harrison, Fumeng Yang, Steven Franconeri, Remco Chang.  <a id=\"6a2c8f640963b\" rel=\"wp-video-lightbox\" href=\"https:\/\/vimeo.com\/102605825?width=1920&#038;height=1080\" title=\"\">video<\/a>    <script>\r\n    \/* <![CDATA[ *\/\r\n    jQuery(document).ready(function($){\r\n        $(function(){\r\n            var width = $(window).innerWidth();\r\n            var setwidth = parseFloat(1920);\r\n            var ratio = parseFloat(0.5625);\r\n            var height = parseFloat(1080);\r\n            var link = 'https:\/\/vimeo.com\/102605825?width=1920&amp;height=1080';\r\n            if(width < setwidth)\r\n            {\r\n                height = Math.floor(width * 0.5625);\r\n                \/\/console.log(\"device width \"+width+\", set width \"+1920+\", ratio \"+0.5625+\", new height \"+ height);\r\n                var new_url = wpvl_paramReplace('width', link, width);\r\n                var new_url = wpvl_paramReplace('height', new_url, height);\r\n                $(\"a#6a2c8f640963b\").attr('href', new_url);\r\n                \/\/console.log(new_url);\r\n            }\r\n        });\r\n    });\r\n    \/* ]]> *\/\r\n    <\/script> <a href=\"http:\/\/www.cs.tufts.edu\/~remco\/publications\/2014\/InfoVis2014-JND.pdf\">pdf<\/a><br \/>\n<em>Thursday 16:35<\/em><\/p>\n<p><strong><span class=\"star\"><a title=\"Explanatory\" href=\"http:\/\/steveharoz.com\/blog\/?p=304\">Explanatory <\/a><\/span>The relation between visualization size, grouping, and user performance<\/strong>\u00a0&#8211; Connor Gramazio, Karen Schloss, David Laidlaw. \u00a0<a id=\"6a2c8f640966d\" rel=\"wp-video-lightbox\" href=\"https:\/\/vimeo.com\/102606409?width=1920&#038;height=1080\" title=\"\">video<\/a>    <script>\r\n    \/* <![CDATA[ *\/\r\n    jQuery(document).ready(function($){\r\n        $(function(){\r\n            var width = $(window).innerWidth();\r\n            var setwidth = parseFloat(1920);\r\n            var ratio = parseFloat(0.5625);\r\n            var height = parseFloat(1080);\r\n            var link = 'https:\/\/vimeo.com\/102606409?width=1920&amp;height=1080';\r\n            if(width < setwidth)\r\n            {\r\n                height = Math.floor(width * 0.5625);\r\n                \/\/console.log(\"device width \"+width+\", set width \"+1920+\", ratio \"+0.5625+\", new height \"+ height);\r\n                var new_url = wpvl_paramReplace('width', link, width);\r\n                var new_url = wpvl_paramReplace('height', new_url, height);\r\n                $(\"a#6a2c8f640966d\").attr('href', new_url);\r\n                \/\/console.log(new_url);\r\n            }\r\n        });\r\n    });\r\n    \/* ]]> *\/\r\n    <\/script> [not public]<br \/>\n<em>Thursday\u00a016:55<\/em><\/p>\n<p><strong>A Principled Way of Assessing Visualization Literacy<\/strong>\u00a0&#8211; Authors: Jeremy Boy, Ronald Rensink, Enrico Bertini, Jean-Daniel Fekete.  <a href=\"https:\/\/hal.inria.fr\/hal-01027582\/PDF\/vLiteracy.pdf\">pdf<\/a><br \/>\n<em>Thursday 17:15<\/em><\/p>\n<p><strong>Reinforcing Visual Grouping Cues to Communicate Complex Informational Structure<\/strong>\u00a0&#8211;\u00a0Juhee Bae, Benjamin Watson.  <a id=\"6a2c8f6409693\" rel=\"wp-video-lightbox\" href=\"https:\/\/vimeo.com\/102604991?width=1920&#038;height=1080\" title=\"\">video<\/a>    <script>\r\n    \/* <![CDATA[ *\/\r\n    jQuery(document).ready(function($){\r\n        $(function(){\r\n            var width = $(window).innerWidth();\r\n            var setwidth = parseFloat(1920);\r\n            var ratio = parseFloat(0.5625);\r\n            var height = parseFloat(1080);\r\n            var link = 'https:\/\/vimeo.com\/102604991?width=1920&amp;height=1080';\r\n            if(width < setwidth)\r\n            {\r\n                height = Math.floor(width * 0.5625);\r\n                \/\/console.log(\"device width \"+width+\", set width \"+1920+\", ratio \"+0.5625+\", new height \"+ height);\r\n                var new_url = wpvl_paramReplace('width', link, width);\r\n                var new_url = wpvl_paramReplace('height', new_url, height);\r\n                $(\"a#6a2c8f6409693\").attr('href', new_url);\r\n                \/\/console.log(new_url);\r\n            }\r\n        });\r\n    });\r\n    \/* ]]> *\/\r\n    <\/script> [not public]<br \/>\n<em>Thursday 17:35<\/em><\/p>\n<p><strong>How Hierarchical Topics Evolve in Large Text Corpora<\/strong>\u00a0&#8211; Weiwei Cui, Shixia Liu, Zhuofeng Wu, Hao Wei.  <a id=\"6a2c8f64096b6\" rel=\"wp-video-lightbox\" href=\"https:\/\/vimeo.com\/102604283?width=1920&#038;height=1080\" title=\"\">video<\/a>    <script>\r\n    \/* <![CDATA[ *\/\r\n    jQuery(document).ready(function($){\r\n        $(function(){\r\n            var width = $(window).innerWidth();\r\n            var setwidth = parseFloat(1920);\r\n            var ratio = parseFloat(0.5625);\r\n            var height = parseFloat(1080);\r\n            var link = 'https:\/\/vimeo.com\/102604283?width=1920&amp;height=1080';\r\n            if(width < setwidth)\r\n            {\r\n                height = Math.floor(width * 0.5625);\r\n                \/\/console.log(\"device width \"+width+\", set width \"+1920+\", ratio \"+0.5625+\", new height \"+ height);\r\n                var new_url = wpvl_paramReplace('width', link, width);\r\n                var new_url = wpvl_paramReplace('height', new_url, height);\r\n                $(\"a#6a2c8f64096b6\").attr('href', new_url);\r\n                \/\/console.log(new_url);\r\n            }\r\n        });\r\n    });\r\n    \/* ]]> *\/\r\n    <\/script> <a href=\"http:\/\/research.microsoft.com\/en-us\/um\/people\/weiweicu\/images\/roseriver.pdf\">pdf<\/a><br \/>\n<em>Friday 8:50<\/em><\/p>\n<p><strong>(TVCG) Similarity Preserving Snippet-Based\u00a0Visualization of Web Search Results<\/strong> &#8211;\u00a0Erick Gomez-Nieto, Frizzi San Roman, Paulo Pagliosa, Wallace Casaca, Elias S. Helou,\u00a0Maria Cristina F. de Oliveira, Luis Gustavo Nonato.  <a id=\"6a2c8f64096da\" rel=\"wp-video-lightbox\" href=\"https:\/\/vimeo.com\/102525332?width=1920&#038;height=1080\" title=\"\">video<\/a>    <script>\r\n    \/* <![CDATA[ *\/\r\n    jQuery(document).ready(function($){\r\n        $(function(){\r\n            var width = $(window).innerWidth();\r\n            var setwidth = parseFloat(1920);\r\n            var ratio = parseFloat(0.5625);\r\n            var height = parseFloat(1080);\r\n            var link = 'https:\/\/vimeo.com\/102525332?width=1920&amp;height=1080';\r\n            if(width < setwidth)\r\n            {\r\n                height = Math.floor(width * 0.5625);\r\n                \/\/console.log(\"device width \"+width+\", set width \"+1920+\", ratio \"+0.5625+\", new height \"+ height);\r\n                var new_url = wpvl_paramReplace('width', link, width);\r\n                var new_url = wpvl_paramReplace('height', new_url, height);\r\n                $(\"a#6a2c8f64096da\").attr('href', new_url);\r\n                \/\/console.log(new_url);\r\n            }\r\n        });\r\n    });\r\n    \/* ]]> *\/\r\n    <\/script> <a href=\"http:\/\/www.lcad.icmc.usp.br\/~nonato\/pubs\/sbv.pdf\">pdf<\/a><br \/>\n<em>Friday 9:30<\/em><\/p>\n<p><strong>Effects of Presentation Mode and Pace Control on Performance in Image Classification<\/strong>\u00a0&#8211; Paul van der Corput, Jarke J. van Wijk.\u00a0 <a id=\"6a2c8f64096fc\" rel=\"wp-video-lightbox\" href=\"https:\/\/vimeo.com\/102603566?width=1920&#038;height=1080\" title=\"\">video<\/a>    <script>\r\n    \/* <![CDATA[ *\/\r\n    jQuery(document).ready(function($){\r\n        $(function(){\r\n            var width = $(window).innerWidth();\r\n            var setwidth = parseFloat(1920);\r\n            var ratio = parseFloat(0.5625);\r\n            var height = parseFloat(1080);\r\n            var link = 'https:\/\/vimeo.com\/102603566?width=1920&amp;height=1080';\r\n            if(width < setwidth)\r\n            {\r\n                height = Math.floor(width * 0.5625);\r\n                \/\/console.log(\"device width \"+width+\", set width \"+1920+\", ratio \"+0.5625+\", new height \"+ height);\r\n                var new_url = wpvl_paramReplace('width', link, width);\r\n                var new_url = wpvl_paramReplace('height', new_url, height);\r\n                $(\"a#6a2c8f64096fc\").attr('href', new_url);\r\n                \/\/console.log(new_url);\r\n            }\r\n        });\r\n    });\r\n    \/* ]]> *\/\r\n    <\/script> [not public]<br \/>\n<em>Friday 9:50<\/em><\/p>\n<h2>Huge Growth<\/h2>\n<p>At <strong>40%<\/strong> of InfoVis conference papers, this list is much longer than <a title=\"Guide to user performance evaluation at InfoVis 2013\" href=\"http:\/\/steveharoz.com\/blog\/?p=249\">last year&#8217;s (26%)<\/a>. For TVCG InfoVis, 4 out of 6 papers (67%)\u00a0evaluated user performance.<\/p>\n<p>It&#8217;s interesting to see this huge shift happen from last year. I don&#8217;t know the cause or whether it will be a long term increase as opposed to a spike.<\/p>\n<h2>SciVis too<\/h2>\n<p>I limited the list to InfoVis because that tends to be where the majority of generalizable experiments occur. Also, I&#8217;m not such\u00a0a masochist that I&#8217;m going to read through all the papers in both conferences. However, SciVis appears to have some <a href=\"http:\/\/openaccess.city.ac.uk\/3752\/1\/Perceptually%20Uniform%20Motion%20Space.pdf\">great<\/a> <a href=\"https:\/\/vimeo.com\/103884934\">papers<\/a> <a href=\"https:\/\/vimeo.com\/102508934\">too<\/a>.<\/p>\n<h2>Generalizability<\/h2>\n<p>Despite a large number of papers with quantitative experiments, only a\u00a0few\u00a0proposed an explanation for the results. I was very generous here, as I categorized any paper with a cited explanation for the results as &#8220;explanatory&#8221; even if the paper didn&#8217;t explicitly make the connection.\u00a0This topic probably warrants its own post, but a critical question to ask about any experiment\u00a0is how broadly applicable the results are. How much\u00a0can you change about a tested technique before the experiments results become invalid?\u00a0What is the grounds for assuming\u00a0that the results are applicable to\u00a0any circumstance\u00a0beyond the specific\u00a0implementation, data type, and users in the study?<\/p>\n<p><em>Obviously, please let me know if you find any mistakes. Also, please hassle any\u00a0authors who didn&#8217;t make their\u00a0pdf available.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>The goal of this guide is to help highlight papers that demonstrate\u00a0evidence of a user performance benefit. I used two criteria: The paper includes an\u00a0experiment measuring user performance (e.g. accuracy or speed) Analysis of statistical differences determined whether\u00a0results were reliable. I\u00a0did not discriminate beyond those two criteria. However, I am using a gold star &#x2605; [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"activitypub_content_warning":"","activitypub_content_visibility":"","activitypub_max_image_attachments":3,"activitypub_interaction_policy_quote":"anyone","activitypub_status":"","footnotes":""},"categories":[6],"tags":[15],"class_list":["post-333","post","type-post","status-publish","format-standard","hentry","category-visualization","tag-infovis"],"_links":{"self":[{"href":"http:\/\/steveharoz.com\/blog\/wp-json\/wp\/v2\/posts\/333","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/steveharoz.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/steveharoz.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/steveharoz.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/steveharoz.com\/blog\/wp-json\/wp\/v2\/comments?post=333"}],"version-history":[{"count":0,"href":"http:\/\/steveharoz.com\/blog\/wp-json\/wp\/v2\/posts\/333\/revisions"}],"wp:attachment":[{"href":"http:\/\/steveharoz.com\/blog\/wp-json\/wp\/v2\/media?parent=333"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/steveharoz.com\/blog\/wp-json\/wp\/v2\/categories?post=333"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/steveharoz.com\/blog\/wp-json\/wp\/v2\/tags?post=333"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}