Sven Lieber

<p>Hello everyone,</p><p>welcome to today’s Halloween edition about <em>data anti-patterns</em> that hopefully will scare you so much you don’t do them :-) Things you better avoid when aiming for FAIR data.</p><p>Anti patterns? In short they are the <strong>opposite of best practices</strong>. Common or obvious solutions that are not only <em>ineffective </em>but also <em>risky</em>. Similar to biases, it is good to know about them so you can try avoiding them. I mainly know the term from software engineering, but apparently it is at least also known for project management and business processes (<a href="https://www.wikidata.org/wiki/Q76438">Q76438</a>, <a href="https://en.wikipedia.org/wiki/Anti-pattern">Wikipedia</a>). </p><p>In the following I will list some anti patterns I have seen “in the wild” that directly relate to the FAIR principles, their evil twins if you like 🧛 </p><div class="captioned-image-container"><figure><a class="image-link is-viewable-img image2" target="_blank" href="https://substackcdn.com/image/fetch/f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76805904-80e4-4327-a1d9-207dc9916382_1280x960.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76805904-80e4-4327-a1d9-207dc9916382_1280x960.jpeg 424w, https://substackcdn.com/image/fetch/w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76805904-80e4-4327-a1d9-207dc9916382_1280x960.jpeg 848w, https://substackcdn.com/image/fetch/w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76805904-80e4-4327-a1d9-207dc9916382_1280x960.jpeg 1272w, https://substackcdn.com/image/fetch/w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76805904-80e4-4327-a1d9-207dc9916382_1280x960.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76805904-80e4-4327-a1d9-207dc9916382_1280x960.jpeg" width="1280" height="960" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/76805904-80e4-4327-a1d9-207dc9916382_1280x960.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:960,&quot;width&quot;:1280,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76805904-80e4-4327-a1d9-207dc9916382_1280x960.jpeg 424w, https://substackcdn.com/image/fetch/w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76805904-80e4-4327-a1d9-207dc9916382_1280x960.jpeg 848w, https://substackcdn.com/image/fetch/w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76805904-80e4-4327-a1d9-207dc9916382_1280x960.jpeg 1272w, https://substackcdn.com/image/fetch/w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76805904-80e4-4327-a1d9-207dc9916382_1280x960.jpeg 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><svg xmlns="http://www.w3.org/2000/svg" width="16" height="16" viewBox="0 0 24 24" fill="none" stroke="#FFFFFF" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></div></div></a><figcaption class="image-caption">daryl_mitchell from Saskatoon, Saskatchewan, Canada, CC BY-SA 2.0, via Wikimedia Commons</figcaption></figure></div><div><hr></div><h2>Findability: the needle in the haystack</h2><p>Findability is probably <em>the </em>most important principle to get started: if you don’t know that something exists or you know it but you don’t know where it is, then you simply cannot use it.</p><p>Providing unique and <strong>persistent identifiers</strong> for things is the common solution to deal with findability. As easy as it sounds, there are many possible pitfalls, some obvious and some more tricky. </p><ul><li><p>😱 reusing identifiers </p><p>➡️ Recycling is good, but reusing identifiers is bad: identifiers should be <strong>unique</strong>!</p></li><li><p>😱 implementation details as part of the identifier </p><p>➡️ If you change your software or provider the identifier will change, hence “identifiers” such as <code>http://my-url.com/items?query=abc</code> are bad.</p></li><li><p>😱 thinking that persistent identifiers are only a technical problem for the ICT department </p><p>➡️ Providing and maintaining the technical infrastructure is important, but knowing the data, use cases, stakeholders and community best practices is just as important</p></li></ul><p>From a very practical perspective, searching nowadays often happen via Google. Did you ever try to google a persistent identifier? Often you won’t find much. The following paper investigates how FAIR persistent identifiers actually are and which role validity can play (DOI: <a href="https://doi.org/10.3233/DS-190024">10.3233/DS-190024</a>).</p><p>By the way, there are different ways to implement persistent identifiers. You can check out the Persistent Identifier Guide of the Dutch Digital Heritage Network to know which system works best for you. Just answer 25 questions.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://www.pidwijzer.nl/en/&quot;,&quot;text&quot;:&quot;Read the Persistent Identifier Guide&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://www.pidwijzer.nl/en/"><span>Read the Persistent Identifier Guide</span></a></p><div><hr></div><h2>Accessibility: what’s in the box?!</h2><p>To stay in the Halloween theme, imagine you’ve <em>found </em>a secret door, but you don’t know how to open it. You would be more than happy getting some <em>information </em>about how to <em>access </em>the room behind it: that would be metadata about accessibility.</p><ul><li><p>😱 not providing any metadata</p><p>➡️ <em>“<s>Pics</s> metadata or it didn’t happen”</em>. Help others to find out more about something (something that possibly is no longer available). I have heard that the phone number of a research projects’ PI can be the most valuable piece of metadata :-) (DOI: <a href="https://doi.org/10.5281/zenodo.8344854">10.5281/zenodo.8344854</a>, <a href="https://www.youtube.com/watch?v=3J-jAFldeac">YouTube</a>)</p></li><li><p>😱 not using an open standard for metadata</p><p>➡️ After all the effort of making data available, please go the extra mile of easy accessible metadata, your users will thank you!</p></li></ul><div><hr></div><h2>Interoperability: it just works</h2><p>FAIR's tongue-twister that even grammar checkers have trouble with. Exchanging information between computer systems without re-inventing the wheel each time. It’s all about standards (again).</p><ul><li><p>😱 not using a standard</p><p>➡️ Standards are important, not just to charge your devices via USB, also for your data! Think of the amazing feeling when you can simply double click on a file and it just opens without problems.</p></li><li><p>😱 using a standard in the wrong way</p><p>➡️ Read the docs to use the standard (vocabulary) you are using to describe your data in the correct way. Imagine you annotate your website wrong and therefore it will rank worse on Google and other search engines.</p></li><li><p>😱 using a proprietary format</p><p>➡️ You have done an amazing job to create some valuable data, don’t make its value and success dependent on an untrustworthy commercial product that may cease to exist or that only a fraction of your users are able to use.</p></li></ul><div><hr></div><h2>Reusability:</h2><p>You found something online, for free … how valuable do you think is it for your use case and to which extend are you allowed to use it? Likewise, if you create something you probably want to be credited for, so you should indicate how someone else can reuse what you created. These questions concern the reusability (of data). There are a few things to avoid.</p><ul><li><p>😱 no license</p><p>➡️ No one likes to be sued! Indicate a license to give security to your users on the one hand, and tell them how you would like them to use it on the other hand. </p></li><li><p>😱 don’t mention any sources or provenance</p><p>➡️ Everything has its origin, knowing it is important to assess its value for reuse. Based on which criteria did you curate the data? Which software did you use? Which data sources?</p></li><li><p>😱 too complicated</p><p>➡️ make it easy for anyone to reuse your data/software. Once again, this can be achieved by following standards. For example, when providing code try to follow common coding and installation guidelines.</p></li></ul><p></p><p>These were just a few anti patterns standing opposite to some of the FAIR principles. Feel free to google to find more specific data anti patterns. Happy Halloween 🎃</p><div><hr></div><p>That’s it for this week of the FAIR Data Digest. If you found the content interesting, please share and subscribe. See you <em>in two weeks</em>!</p><p>Sven</p><div class="subscription-widget-wrap" data-attrs="{&quot;url&quot;:&quot;https://fairdata.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading FAIR Data Digest! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email…" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>

the Halloween edition on scary data anti-patterns


Rogue Scholar Posts

FAIR Data Digest #20