Mark Rubin

The Centre for Open Science’s symposium on “Critical Perspectives on the Metascience Reform Movement” took place on 7
<sup>
 th
</sup>
March 2024. It was organised by Sven Ulpts, and it includes presentations by Bart Penders, Tom Hostler, Stephan Guttinger, Sarahanne Field, Nicole Nelson, and Berna Devezer.

Critical Perspectives on the Metascience Reform Movement

[Tom Hostler](https://www.researchgate.net/profile/Thomas-Hostler-2) has
just published an article titled "[The invisible workload of open
research](https://doi.org/10.36850/mr5)" in the *Journal of Trial and
Error's* special issue on the "[Consequences of the scientific reform
movement: Is the scientific reform movement headed in the right
direction](https://journal.trialanderror.org/special-issue-consequences-of-the-scientific-reform-movement)?"
It's an insightful and thought-provoking piece that uncovers the
potential workload costs of open research, considers why these costs may
be ignored by university management, and makes some useful
recommendations for moving forward. Here's a few quotes to whet your
appetite.

::: {.captioned-image-container}
<figure>
<a href="https://doi.org/10.36850/mr5" class="image-link image2"
target="_blank" data-component-name="Image2ToDOM"></a>
<div class="image2-inset">
<img
src="https://substackcdn.com/image/fetch/w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F45026131-ae6b-4dac-8fbf-6f228053a4d9_1333x796.png"
class="sizing-normal"
data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/45026131-ae6b-4dac-8fbf-6f228053a4d9_1333x796.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:796,&quot;width&quot;:1333,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:184638,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:&quot;https://doi.org/10.36850/mr5&quot;,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null}"
srcset="https://substackcdn.com/image/fetch/w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F45026131-ae6b-4dac-8fbf-6f228053a4d9_1333x796.png 424w, https://substackcdn.com/image/fetch/w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F45026131-ae6b-4dac-8fbf-6f228053a4d9_1333x796.png 848w, https://substackcdn.com/image/fetch/w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F45026131-ae6b-4dac-8fbf-6f228053a4d9_1333x796.png 1272w, https://substackcdn.com/image/fetch/w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F45026131-ae6b-4dac-8fbf-6f228053a4d9_1333x796.png 1456w"
sizes="100vw" data-fetchpriority="high" width="1333" height="796" />
<div>

</div>
</div>
</figure>
:::

#### **The Problem**

> The benefits of open research practices have been widely discussed
> (Munafò et al., 2017), and generally speaking researchers have
> positive attitudes towards adopting open research practices, finding
> them worthwhile (Eynden et al., 2016; Lowndes et al., 2017), and
> recommending their use to others (Sarafoglou et al., 2022). However,
> high time cost is repeatedly identified as one of the main barriers to
> the adoption of open practices (Eynden et al., 2016; Gownaris et al.,
> 2022; Tenopir et al., 2011) and time is the main thing that
> researchers lack, with workloads at capacity across the sector, having
> already reached "untenable" levels (Long et al., 2020; Papadopoulos,
> 2017).

In short, implementing open science reforms take work, and work takes
time, which academics have very little of!

#### **University Management are Not Motivated to Help!**

> The theory of academic capitalism suggests that the responsibility for
> addressing potential discrepancies between modelled and actual
> workload will not be taken up voluntarily by university management,
> who may at best ignore such issues, or at worse tacitly approve of
> them as a form of capitalist efficiency (Lyons & Ingersoll, 2010). In
> other words, if university management can choose not to incorporate
> open research into workload models, then they won't.

I don't think many working academics need to refer to the theory of
academic capitalism to appreciate this point! But to quell any doubt,
Hostler refers to empirical work by Kenny and Fluck
([2022](https://doi.org/10.1007/s10734-021-00747-y)) and Miller
([2019](https://doi.org/10.1080/1360080X.2019.1635328)). For example,
Kenny and Fluck (2022) found that:

> Management knows that academics will do research (and other work) in
> their own time and exploit that....What is written on paper in terms
> of hours re admin or research does not correspond to the actual time
> spent. It all looks fine on paper but has enormous hidden workloads.

Hence, Hostler concludes:

> There is a high potential for expectations to engage in open research
> to become widespread, but without additional time on academics'
> workloads dedicated to the activity.

#### **Some Open Research Advocates Do Not Acknowledge Open Research Workload**

> Suggestions that concerns about the workload of open research are an
> example of a "myth" (Bastiaansen, 2019) or a "misconception" that can
> be corrected by "positive advocacy" (Hagger, 2022) are unhelpful to
> having honest conversations about the practical negative consequences
> of conducting open research.

This is an important point. Some open science advocates engage in a
pretty hard sell, and this can include omitting or downplaying some of
the costs of open science. However, like Hostler says, it's worth having
"honest conversations" about the pros and cons of open science in order
to set more realistic expectations.

#### **A Key Recommendation**

I've just picked out one of Hostler's recommendations below to keep
things brief, but note that he makes several more in his article:

> When promoting open research reforms in universities or conducting
> open practices themselves \[open research advocates\] should advocate
> not only for investments in open research infrastructure and training
> but to receive extra time in workload allocations to acknowledge the
> additional burden of open research.

Getting open research work acknowledged in university workload models is
likely to be easier said than done! As Hostler explains, open research
work often consists of many small tasks, rather than a few large tasks,
and so it's easily overlooked in workload models. Nonetheless,
cumulatively, open research workload can be substantial and, as Hostler
notes, if it's ignored, we risk "death by a thousand 10-minute tasks"
(Bozeman et al., 2021).

::: {.captioned-image-container}
<figure>
<a
href="https://substackcdn.com/image/fetch/f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F926ef13c-9658-42d0-a89f-5ea0abfb214f_583x500.jpeg"
class="image-link is-viewable-img image2" target="_blank"
data-component-name="Image2ToDOM"></a>
<div class="image2-inset">
<img
src="https://substackcdn.com/image/fetch/w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F926ef13c-9658-42d0-a89f-5ea0abfb214f_583x500.jpeg"
class="sizing-normal"
data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/926ef13c-9658-42d0-a89f-5ea0abfb214f_583x500.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:500,&quot;width&quot;:583,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:75314,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null}"
srcset="https://substackcdn.com/image/fetch/w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F926ef13c-9658-42d0-a89f-5ea0abfb214f_583x500.jpeg 424w, https://substackcdn.com/image/fetch/w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F926ef13c-9658-42d0-a89f-5ea0abfb214f_583x500.jpeg 848w, https://substackcdn.com/image/fetch/w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F926ef13c-9658-42d0-a89f-5ea0abfb214f_583x500.jpeg 1272w, https://substackcdn.com/image/fetch/w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F926ef13c-9658-42d0-a89f-5ea0abfb214f_583x500.jpeg 1456w"
sizes="100vw" loading="lazy" width="583" height="500" />
<div class="image-link-expand">
<img
src="data:image/svg+xml;base64,PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIHdpZHRoPSIxNiIgaGVpZ2h0PSIxNiIgdmlld2JveD0iMCAwIDI0IDI0IiBmaWxsPSJub25lIiBzdHJva2U9IiNGRkZGRkYiIHN0cm9rZS13aWR0aD0iMiIgc3Ryb2tlLWxpbmVjYXA9InJvdW5kIiBzdHJva2UtbGluZWpvaW49InJvdW5kIiBjbGFzcz0ibHVjaWRlIGx1Y2lkZS1tYXhpbWl6ZTIgIj48cG9seWxpbmUgcG9pbnRzPSIxNSAzIDIxIDMgMjEgOSI+PC9wb2x5bGluZT48cG9seWxpbmUgcG9pbnRzPSI5IDIxIDMgMjEgMyAxNSI+PC9wb2x5bGluZT48bGluZSB4MT0iMjEiIHgyPSIxNCIgeTE9IjMiIHkyPSIxMCI+PC9saW5lPjxsaW5lIHgxPSIzIiB4Mj0iMTAiIHkxPSIyMSIgeTI9IjE0Ij48L2xpbmU+PC9zdmc+"
class="lucide lucide-maximize2" />
</div>
</div>
</figure>
:::

#### The Article

Hostler, T. J. (2023). The invisible workload of open research. *Journal
of Trial & Error.* <https://doi.org/10.36850/mr5> 

::: {.subscription-widget-wrap attrs="{\"url\":\"https://markrubin.substack.com/subscribe?\",\"text\":\"Subscribe\",\"language\":\"en\"}" component-name="SubscribeWidgetToDOM"}
::: {.subscription-widget .show-subscribe}
::: {.preamble}
Thanks for reading Critical Metascience ! Subscribe for free to receive
new posts and support my work.
:::

::: {.fake-input-wrapper}
::: {.fake-input}
:::

::: {.fake-button}
:::
:::
:::
:::


Tom Hostler has just published an article titled “The invisible workload of open research” in the
<em>
 Journal of Trial and Error’s
</em>
special issue on the “Consequences of the scientific reform movement: Is the scientific reform movement headed in the right direction?” It’s an insightful and thought-provoking piece that uncovers the potential workload costs of open research, considers why these costs may be ignored by university management,

Messaggi di Rogue Scholar

Critical Perspectives on the Metascience Reform Movement

Open Science and Overwork