{"id":1058,"date":"2019-11-11T11:05:41","date_gmt":"2019-11-11T10:05:41","guid":{"rendered":"http:\/\/steveharoz.com\/blog\/?p=1058"},"modified":"2019-11-12T00:34:52","modified_gmt":"2019-11-11T23:34:52","slug":"open-access-vis-2019-part-3-whos-who","status":"publish","type":"post","link":"http:\/\/steveharoz.com\/blog\/2019\/open-access-vis-2019-part-3-whos-who\/","title":{"rendered":"Open Access VIS 2019 &#8211; Part 3 &#8211; Who&#8217;s Who"},"content":{"rendered":"<p>This is part 3 of a multi-part post summarizing open practices in visualization research for 2019, as displayed on <b><a href=\"http:\/\/oavis.org\">Open Access Vis<\/a><\/b>. Research openness can either rely on policy or individual behavior. In this part, I&#8217;ll look at the individuals. Who in the visualization community is consistently sharing the most research? And who is not?<\/p>\n<p><em>Related posts: <a href=\"http:\/\/steveharoz.com\/blog\/2017\/open-access-vis\/\">2017 overview<\/a>, <a href=\"http:\/\/steveharoz.com\/blog\/2018\/open-access-vis-updates-for-2018\/\">2018 overview<\/a>, <a href=\"http:\/\/steveharoz.com\/blog\/2019\/open-access-vis-2019-part-1-updates-and-papers\/\">2019 part 1 &#8211; Updates and Papers<\/a>, <a href=\"http:\/\/steveharoz.com\/blog\/2019\/open-access-vis-2019-part-2-research-practices\/\">2019 part 2 &#8211; Research Practices<\/a><\/em><\/p>\n<h2>Whose papers are open?<\/h2>\n<p>Many authors are sharing most or even all of their papers on open repositories, which is fantastic progress. But many are not, despite encouragement after acceptance. <a href=\"https:\/\/osf.io\/4n372\/\">Easier options<\/a>, better training, and\u00a0formal policies will likely be necessary for a field-wide change in behavior.<!--more--><\/p>\n<p>It&#8217;s certainly possible that I&#8217;ve missed some papers and artifacts, so please let me know if I&#8217;ve made any mistakes.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1045\" src=\"http:\/\/steveharoz.com\/blog\/wp-content\/uploads\/2019\/11\/open-by-author.png\" alt=\"\" width=\"1000\" height=\"1200\" srcset=\"http:\/\/steveharoz.com\/blog\/wp-content\/uploads\/2019\/11\/open-by-author.png 1000w, http:\/\/steveharoz.com\/blog\/wp-content\/uploads\/2019\/11\/open-by-author-250x300.png 250w, http:\/\/steveharoz.com\/blog\/wp-content\/uploads\/2019\/11\/open-by-author-768x922.png 768w, http:\/\/steveharoz.com\/blog\/wp-content\/uploads\/2019\/11\/open-by-author-853x1024.png 853w, http:\/\/steveharoz.com\/blog\/wp-content\/uploads\/2019\/11\/open-by-author-624x749.png 624w\" sizes=\"auto, (max-width: 1000px) 100vw, 1000px\" \/><\/p>\n<h2>Whose research artifacts are open?<\/h2>\n<p>While paper sharing has substantially increased, open research artifacts are still uncommon. Here, I&#8217;m again using the generous &#8220;Is anything open?&#8221; measure from part 2.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1085\" src=\"http:\/\/steveharoz.com\/blog\/wp-content\/uploads\/2019\/11\/open-practices-by-author.png\" alt=\"\" width=\"1100\" height=\"1430\" \/><\/p>\n<h2>VIS Leadership<\/h2>\n<p>It is disappointing to see members of nearly every VIS organizing group (including the Visualization Executive Committee, steering committees, and paper chairs) among those who do not make their research open.\u00a0The VEC recently released a\u00a0<a href=\"https:\/\/drive.google.com\/file\/d\/1-9bwz78kXLyOZEQhnvbvT8DnAUlJbkBQ\/view\">statement<\/a>\u00a0which claims to strongly support an encouragement approach to open\u00a0research practices. I was curious whether that support translates into behavior, so I compared papers that have a VEC member as a coauthor with those that don&#8217;t.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1075\" src=\"http:\/\/steveharoz.com\/blog\/wp-content\/uploads\/2019\/11\/open-overview-VEC.png\" alt=\"\" width=\"3200\" height=\"1920\" srcset=\"http:\/\/steveharoz.com\/blog\/wp-content\/uploads\/2019\/11\/open-overview-VEC.png 3200w, http:\/\/steveharoz.com\/blog\/wp-content\/uploads\/2019\/11\/open-overview-VEC-300x180.png 300w, http:\/\/steveharoz.com\/blog\/wp-content\/uploads\/2019\/11\/open-overview-VEC-768x461.png 768w, http:\/\/steveharoz.com\/blog\/wp-content\/uploads\/2019\/11\/open-overview-VEC-1024x614.png 1024w, http:\/\/steveharoz.com\/blog\/wp-content\/uploads\/2019\/11\/open-overview-VEC-624x374.png 624w\" sizes=\"auto, (max-width: 3200px) 100vw, 3200px\" \/><\/p>\n<p>For both paper sharing and availability of research artifacts, papers with VEC members are slightly behind the rest of the field. With only half of VEC-coauthored papers shared and only 1 out of 16 sharing any research artifact, it seems that setting a good example for transparency is not a part of an encouragement approach.<\/p>\n<h2>Notable Exemplars<\/h2>\n<p><strong>Niklas Elmqvist<\/strong> was a coauthor on the most papers with open research practices. All three papers are on a persistent repository and have at least one research artifact shared. The work of Niklas and his coauthors is discoverable and transparent, making it more credible and reusable.<\/p>\n<ul>\n<li><a href=\"https:\/\/osf.io\/zsv9t\">Common Fate for Animated Transitions in Visualization<\/a><br \/>\nAmira Chalbi, Jacob Ritchie, Deokgun Park, Jungu Choi, Nicolas Roussel, Niklas Elmqvist, Fanny Chevalier<br \/>\n<img loading=\"lazy\" decoding=\"async\" class=\"\" style=\"opacity: 0.1;\" src=\"http:\/\/oavis.org\/images\/preregistered.svg\" width=\"23\" height=\"25\" \/><span style=\"font-size: 1rem;\">\u00a0\u00a0<\/span><img loading=\"lazy\" decoding=\"async\" class=\"\" style=\"font-size: 1rem;\" src=\"http:\/\/oavis.org\/images\/materials.svg\" width=\"23\" height=\"25\" \/><span style=\"font-size: 1rem;\">\u00a0\u00a0<\/span><img loading=\"lazy\" decoding=\"async\" class=\"\" style=\"font-size: 1rem;\" src=\"http:\/\/oavis.org\/images\/data.svg\" width=\"23\" height=\"25\" \/><span style=\"font-size: 1rem;\">\u00a0\u00a0<\/span><img loading=\"lazy\" decoding=\"async\" class=\"\" style=\"font-size: 1rem;\" src=\"http:\/\/oavis.org\/images\/reproducible.svg\" width=\"23\" height=\"25\" \/><\/li>\n<li><a style=\"font-size: 1rem;\" href=\"https:\/\/osf.io\/wzqbu\">There Is No Spoon: Evaluating Performance, Space Use, and Presence with Expert Domain Users in Immersive Analytics<\/a><br \/>\nAndrea Batch, Andrew Cunningham, Maxime Cordeil, Niklas Elmqvist, Tim Dwyer, Bruce H Thomas, Kim Marriott<br \/>\n<img loading=\"lazy\" decoding=\"async\" class=\"\" src=\"http:\/\/oavis.org\/images\/preregistered.svg\" width=\"23\" height=\"25\" \/><span style=\"font-size: 1rem;\">\u00a0\u00a0<\/span><img loading=\"lazy\" decoding=\"async\" class=\"\" style=\"opacity: 0.1;\" src=\"http:\/\/oavis.org\/images\/materials.svg\" width=\"23\" height=\"25\" \/><span style=\"font-size: 1rem;\">\u00a0\u00a0<\/span><img loading=\"lazy\" decoding=\"async\" class=\"\" style=\"opacity: 0.1;\" src=\"http:\/\/oavis.org\/images\/data.svg\" width=\"23\" height=\"25\" \/><span style=\"font-size: 1rem;\">\u00a0\u00a0<\/span><img loading=\"lazy\" decoding=\"async\" class=\"\" style=\"opacity: 0.1;\" src=\"http:\/\/oavis.org\/images\/reproducible.svg\" width=\"23\" height=\"25\" \/><\/li>\n<li><a style=\"font-size: 1rem;\" href=\"https:\/\/osf.io\/ykmt7\">The Perceptual Proxies of Visual Comparison<\/a><br \/>\nNicole Jardine, Brian David Ondov, Niklas Elmqvist, Steven Franconeri<br \/>\n<img loading=\"lazy\" decoding=\"async\" class=\"\" style=\"opacity: 0.1;\" src=\"http:\/\/oavis.org\/images\/preregistered.svg\" width=\"23\" height=\"25\" \/><span style=\"font-size: 1rem;\">\u00a0\u00a0<\/span><img loading=\"lazy\" decoding=\"async\" class=\"\" style=\"opacity: 0.1;\" src=\"http:\/\/oavis.org\/images\/materials.svg\" width=\"23\" height=\"25\" \/><span style=\"font-size: 1rem;\">\u00a0\u00a0<\/span><img loading=\"lazy\" decoding=\"async\" class=\"\" style=\"font-size: 1rem;\" src=\"http:\/\/oavis.org\/images\/data.svg\" width=\"23\" height=\"25\" \/><span style=\"font-size: 1rem;\">\u00a0\u00a0<\/span><img loading=\"lazy\" decoding=\"async\" class=\"\" style=\"opacity: 0.1;\" src=\"http:\/\/oavis.org\/images\/reproducible.svg\" width=\"23\" height=\"25\" \/><\/li>\n<\/ul>\n<p>For the first time at VIS, a paper shares <strong>all measured research artifacts<\/strong>. Better yet, two of them do! You can find their preregistrations, data collection material, raw empirical data, and analysis\/computational material in the papers.<\/p>\n<ul>\n<li><a href=\"https:\/\/osf.io\/2msfd\">Evaluating Gradient Perception in Color-coded Scalar Fields<\/a><br \/>\nKhairi Reda, Michael E. Papka<br \/>\n<img loading=\"lazy\" decoding=\"async\" class=\"\" src=\"http:\/\/oavis.org\/images\/preregistered.svg\" width=\"23\" height=\"25\" \/>\u00a0\u00a0<img loading=\"lazy\" decoding=\"async\" class=\"\" src=\"http:\/\/oavis.org\/images\/materials.svg\" width=\"23\" height=\"25\" \/>\u00a0\u00a0<img loading=\"lazy\" decoding=\"async\" class=\"\" src=\"http:\/\/oavis.org\/images\/data.svg\" width=\"23\" height=\"25\" \/>\u00a0\u00a0<img loading=\"lazy\" decoding=\"async\" class=\"\" src=\"http:\/\/oavis.org\/images\/reproducible.svg\" width=\"23\" height=\"25\" \/><\/li>\n<li><a style=\"font-size: 1rem;\" href=\"https:\/\/osf.io\/fcna4\">Evidence for Area as the Primary Visual Cue in Pie Charts<\/a><br \/>\nRobert Kosara<br \/>\n<img loading=\"lazy\" decoding=\"async\" class=\"\" style=\"font-size: 1rem;\" src=\"http:\/\/oavis.org\/images\/preregistered.svg\" width=\"23\" height=\"25\" \/><span style=\"font-size: 1rem;\">\u00a0\u00a0<\/span><img loading=\"lazy\" decoding=\"async\" class=\"\" style=\"font-size: 1rem;\" src=\"http:\/\/oavis.org\/images\/materials.svg\" width=\"23\" height=\"25\" \/><span style=\"font-size: 1rem;\">\u00a0\u00a0<\/span><img loading=\"lazy\" decoding=\"async\" class=\"\" style=\"font-size: 1rem;\" src=\"http:\/\/oavis.org\/images\/data.svg\" width=\"23\" height=\"25\" \/><span style=\"font-size: 1rem;\">\u00a0\u00a0<\/span><img loading=\"lazy\" decoding=\"async\" class=\"\" style=\"font-size: 1rem;\" src=\"http:\/\/oavis.org\/images\/reproducible.svg\" width=\"23\" height=\"25\" \/><\/li>\n<\/ul>\n<h2>Moving VIS forward<\/h2>\n<p>What you can do:<\/p>\n<ul>\n<li>Practice! Try putting one artifact of your research on a repository like <a href=\"http:\/\/osf.io\">OSF<\/a>. See <a href=\"https:\/\/help.osf.io\/hc\/en-us\/sections\/360003569654-Handling-Data\">tips and guides for data management<\/a>\u00a0and\u00a0<a href=\"https:\/\/osf.io\/gt47j\">various FAQs on open practices in visualization research<\/a>.<\/li>\n<li>Learn more about <a href=\"https:\/\/osf.io\/cyaj7\">preregistration for empirical research<\/a>\u00a0to make the timing of your decisions more transparent.<\/li>\n<li>Account for openness or a lack thereof in your reviewing. Consider signing the <a href=\"https:\/\/opennessinitiative.org\/the-initiative\/\">Peer Reviewers&#8217; Openness Initiative<\/a>.<\/li>\n<li>Set the norm. Put your research on a persistent open repository like <a href=\"http:\/\/osf.io\">OSF<\/a>, and encourage others to do the same.<\/li>\n<\/ul>\n<p>Visualization research owes its existence to others sharing the data they&#8217;ve collected. For visualization research to not be similarly transparent is selfish and hypocritical. Moreover, preventing others from scrutinizing the research raises questions about the field&#8217;s credibility. A norm of research openness will greatly benefit those doing credible research and could benefit other fields just as visualization has benefited from the openness of others.<\/p>\n<blockquote><p>Transparency doesn\u2019t guarantee credibility &#8211; it guarantees you\u2019ll get the credibility you deserve.<br \/>\n&#8211; <a href=\"https:\/\/twitter.com\/deborahapthorp\/status\/1192206814634377216\">Simine Vazire<\/a><\/p><\/blockquote>\n<p>All code and data for this series of posts is available at\u00a0<a href=\"https:\/\/osf.io\/4njyf\">https:\/\/osf.io\/4njyf<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>This is part 3 of a multi-part post summarizing open practices in visualization research for 2019, as displayed on Open Access Vis. Research openness can either rely on policy or individual behavior. In this part, I&#8217;ll look at the individuals. Who in the visualization community is consistently sharing the most research? And who is not? [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":1038,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"activitypub_content_warning":"","activitypub_content_visibility":"","activitypub_max_image_attachments":3,"activitypub_interaction_policy_quote":"anyone","activitypub_status":"","footnotes":""},"categories":[29],"tags":[],"class_list":["post-1058","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-open-science"],"_links":{"self":[{"href":"http:\/\/steveharoz.com\/blog\/wp-json\/wp\/v2\/posts\/1058","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/steveharoz.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/steveharoz.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/steveharoz.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/steveharoz.com\/blog\/wp-json\/wp\/v2\/comments?post=1058"}],"version-history":[{"count":17,"href":"http:\/\/steveharoz.com\/blog\/wp-json\/wp\/v2\/posts\/1058\/revisions"}],"predecessor-version":[{"id":1099,"href":"http:\/\/steveharoz.com\/blog\/wp-json\/wp\/v2\/posts\/1058\/revisions\/1099"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/steveharoz.com\/blog\/wp-json\/wp\/v2\/media\/1038"}],"wp:attachment":[{"href":"http:\/\/steveharoz.com\/blog\/wp-json\/wp\/v2\/media?parent=1058"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/steveharoz.com\/blog\/wp-json\/wp\/v2\/categories?post=1058"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/steveharoz.com\/blog\/wp-json\/wp\/v2\/tags?post=1058"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}