Rogue Scholar Posts

language
Published in Politics, Science, Political Science
Author Ingo Rohlfing

The debate between Yann LeCun and Elon Musk, reported in Nature, questions whether science necessitates publishing results. My position is that science depends on how you produce your knowledge, not necessarily requiring publication. Only if you face the public, you need to publish about your work.

Published in Politics, Science, Political Science
Author Ingo Rohlfing

Is Open Science passé? is the question asked by Xenia Schmalz in this blogpost. I recommend reading it before I share brief thoughts on some points that are raised. I wish an open science movement was not needed anymore, but I agree this is most likely not the answer to the leading question. Neither has the open science movement failed; progress toward more transparent and credible science is simply slow.

Published in Stories by Mark Rubin on Medium
Author Mark Rubin

In this new article, I consider questionable research practices in the field of metascience. A questionable metascience practice (QMP) is a research practice, assumption, or perspective that’s been questioned by several commentators as being potentially problematic for metascience and/or the science reform movement. I discuss 10 QMPs that relate to criticism, replication, bias, generalization, and the characterization of science.

Published in Politics, Science, Political Science
Author Ingo Rohlfing

The LSE Impact blog has a post from May 2021 raising some reservations about the idea of ‘Slow Science’. The ‘Slow Science’ idea hasn’t really picked up in academia, as far as I can tell. The post presents some good thoughts about why the “slowness-idea” is problematic in general. I agree that slowness is not a value in itself. Sometimes, developments and events like a pandemic demand it to do research faster than one would do it otherwise.

Published in Stories by Mark Rubin on Medium
Author Mark Rubin

The Costs of HARKing: Does it Matter if Researchers Engage in Undisclosed Hypothesizing After the Results are Known? While no-one’s looking, a Texas sharpshooter fires his gun at a barn wall, walks up to his bullet holes, and paints targets around them. When his friends arrive, he points at the targets and claims he’s a good shot.

Published in Stories by Mark Rubin on Medium
Author Mark Rubin

Preregistration entails researchers registering their planned research hypotheses, methods, and analyses in a time-stamped document before they undertake their data collection and analyses. This document is then made available with the published research report in order to allow readers to identify discrepancies between what the researchers originally planned to do and what they actually ended up doing.

Published in Stories by Mark Rubin on Medium
Author Mark Rubin

In this new paper (Rubin, 2021), I consider when researchers should adjust their alpha level (significance threshold) during multiple testing and multiple comparisons. I consider three types of multiple testing (disjunction, conjunction, and individual), and I argue that an alpha adjustment is only required for one of these three types.