University of Glasgow

Roderic Page

![Ipni
logo](https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgbNLv3sCt51ZErRVlGEG_lfswi_071ddl1zxQn2bURR1r2Rucl8aJl3sJ0lfZ7nua-P00qjFshFDzoli77b_bQe8Yyc9WC83ykZF_p0nRFr4v_p2Tpi5A77k9hB4HAeTA1SZg3/s0/ipni_logo.png "ipni_logo.png"){border="0"
width="128" height="128" style="float:right;"} I\'ve written a short
paper entitled \"Liberating links between datasets using lightweight
data publishing: an example using plant names and the taxonomic
literature\" (phew) and put a preprint on bioRxiv
(<https://doi.org/10.1101/343996>) while I figure out where to publish
it. Here\'s the abstract:

> Constructing a biodiversity knowledge graph will require making
> millions of cross links between diversity entities in different
> datasets. Researchers trying to bootstrap the growth of the
> biodiversity knowledge graph by constructing databases of links
> between these entities lack obvious ways to publish these sets of
> links. One appealing and lightweight approach is to create a
> \"datasette\", a database that is wrapped together with a simple web
> server that enables users to query the data. Datasettes can be
> packaged into Docker containers and hosted online with minimal effort.
> This approach is illustrated using a dataset of links between globally
> unique identifiers for plant taxonomic names, and identifiers for the
> taxonomic articles that published those names.

In some ways the paper is simply a record of me trying to figure out how
to publish a project that I\'ve been working on for several years,
namely linking names from
[BioNames](http://www.ipni.org%3EIPNI%3C/a%3E%20to%20the%20primary%20literature.%20This%20is%20basically%20the%20plant%20version%20of%20%3Ca%20href=){http:=""
bionames.org\"=""}. The preprint discusses various options, before
settling on
\"[datasettes](https://simonwillison.net/2017/Nov/13/datasette/)\",
which is a nice method developed by Simon Willison
([@simonw](https://twitter.com/simonw)) to wrap up simple databases with
their own web server and query API and make them accessible on the web.
These can run on a local machine, or be packaged up as a Docker
container, which is what I\'ve done. You play with the database here:
<https://ipni.sloppy.zone>. If this link is offline, then you can grab
the container here <https://hub.docker.com/r/rdmpage/ipni/> and run it
yourself. If, like me, you\'re new to Docker, then I recommend grabbing
a copy of [Kitematic](https://kitematic.com).

The datasette interface is simple but gives you lots of freedom to
explore the data.

![Fig1](https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgLzLehOA-GnKeDoqkUzm7SBQ4ii_IKf4C1SVx01ULHQFJnuNmjGkMfUJE7ubeJIiFbEdDiyTyBhyFHjphzdcwnPlgmsAbvm_JIbgFd6v1LYatV-WaBQEaMN_I3tVbXqqFSyXfc/s0/fig1.png "fig1.png"){style="display:block; margin-left:auto; margin-right:auto;"
border="0" width="510" height="459"}

For example, you have ability to query the data using SQL, e.g.:

![Fig2](https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgOn1_kpWqn-Ha7zt2fcBZTVZnG90-eCxqSHsaWwejn8Kb_lzVDzNqo728HfqPfUynVV3PJRMLkdLLE6TF2IL4cnd4n3IfkGZ2XXy91DJtZK5Ghe879Tr3INHsYIENpMrl3rBCy/s0/fig2.png "fig2.png"){style="display:block; margin-left:auto; margin-right:auto;"
border="0" width="468" height="395"}

One advantage of this approach is that the data is more accessible. I
could just dump the database somewhere but then you\'d have to download
a large file and figure out how query it. This way, you can play with it
straight away. It also means people can make use of it before I make up
my mind how best to package it (for example, as part of a larger
database of eukaryote names). This is one of the main motivations behind
the paper, how to avoid the trap of spending years cleaning and
augmenting data and not making it available to others because of the
overhead of building a web site around the data. I may look at
liberating some other datasets using this approach.


I've written a short paper entitled "Liberating links between datasets using lightweight data publishing: an example using plant names and the taxonomic literature" (phew) and put a preprint on bioRxiv (https://doi.org/10.1101/343996) while I figure out where to publish it. Here's the abstract:  In some ways the paper is simply a record of me trying to figure out how to publish a project that I've been working on for several years, namely

Messaggi di Rogue Scholar

Liberating links between datasets using lightweight data publishing: an example using IPNI and the taxonomic literature