More "potential reproducibility"

Giving Open Notebook Science a Try

06:18 14/07/2007, open access/open science, Open Reading Frame

BillH: Openness is spreading, one researcher at a time: Jeremiah Faith, a Boston U graduate student in bioinformatics, has put his lab notes online:

Open Notebook Science […] is a term coined by Jean-Claude Bradley. The idea is simply that the heart of every person's research – their lab notebook – should be open to the world.Since most of our scientific work is funded by tax payers who expect their money to be well-spent, it's interesting that openness isn't required. Science typically builds on the body of available knowledge – the more knowledge available the faster science goes. It's striking when you visit other labs in person; you see all of their unpublished work, and you know that most of their results and data won't be available to the bulk of the scientific community until a year after each particular scientific project is finished. By the time papers are in print, it's old news to the insiders. More striking is when you visit labs whose work you've thought about replicating and expanding on. It's not too uncommon to find that only one person in the entire lab is able to get the technique to work, and even for him the technique only works on Wednesdays. This type of information would be useful to know before you embark on a useless three months trying to adapt their method. But scientific publications are covered in a thick coat of high-gloss finish, making these unacknowledged difficulties hard to detect.
Lab notebooks on the other hand are flat black. As long as people keep them regularly updated, they contain the good, the bad, and the completely nonsensical results.
Today I test the waters of Open Notebook Science.
The latest version of my lab notebook is now automatically posted on J's Lab Notebook Page each night. I've been using an electronic lab notebook for two years now, so there's quite a bit of data in there – good and bad (300+ pages).

BillH: This is simply fantastic. One of the things that Open Science advocates most sorely lack is concrete examples. Doing research in public, instead of in secret, is a new and somewhat unnerving idea for most scientists; early adopters like Jeremiah are essential to take the edge off that unfamiliarity.(It's also, to be honest, just plain fun to snoop around in someone else's lab notes! I was amused to note that Jeremiah talks to and about himself in his notebook, the same way I do — "if I weren't so stupid I'd…", "next time load the control first, doofus", etc. I wonder if everyone does that?)

PMR: This is simpy fantastic. An interesting thing is that this is zero-cost innovation. J-C coined the term "Open Notebook Science" after he had posted to the Open Data entry on Wikipedia and he and I had discussed possible terms. So after J-C blogged about it and set up his own site, Jeremiah used the idea to help think about, and promote, his own desire to communicate.
This is the power of the blogosphere – a good, well fashioned, idea can spread. Young scientists care about reproducibility. They are the ones that suffer from made-up, fuzzy, under-reported material. Do the lab heads and professors encourage reproducibility? I expect that most do but the pressures to publish in high-impact is too great to be ignored.
Jeremiah and J-C are gambling their scientific future on publishing their work openly. Some "high-impact" publishers would have knee-jerk reaction and refuse to consider manuscripts because the work had already been published. This would be rubbish. Any responsible science publisher should take very seriously the requirement to publish good science. Science that is created in an Open environment adds an extra dimension to "good". It isn't necessarily better, but it has less chance of being worse.
So, publishers, give us something to suggest that you are excited by these new developments. That you want to change science practice for the better. I'm guessing that Open Science (sensu J-C, not RSC) will help to promote the work better. And isn't that what science publishing is about? Communication, not hiding.
And J-C and JF I can't promise anything but I would bet that by gambling on Open Science you will be doing yourselves a lot of good. The world is waiting for this and will welcome you.