Is open science feasible with human subjects? | The Incidental Economist

“... I haven’t been able to get this question out of my mind since attending a session on open notebook laboratory science at the ScienceOnline 2012 conference last week at N.C. State University. Is there something of use from open science techniques that could be brought to the health policy/health economics work that we do?...Open science is the practice of immediately making all results of the research enterprise publicly available, while open notebook is the practice of making a lesser amount of data publicly available, with other information withheld for a variety of reasons... The idea is that immediate disclosure of results increases transparency and allows for the possibility of feedback along the way in a research project (Open Science Federation, @openscience are advocates of the general approach)... My initial reaction upon hearing an example at the conference... was to say this doesn’t apply to what I do, since most of my work is based on human subject data that we collect, or on secondary data (like Medicare claims); in both cases, access to the data is expressly limited by legally binding data use agreements and IRB restrictions... I am thinking of trying an experiment of sorts and taking a specific paper from a grant, and blogging (on a new blog, not here) a few times a week about the conduct of the research process for that paper. I will tell the IRB ahead of time, and ensure I don’t violate any restrictions. This will really be blogging about how we are thinking about answering a question. Here are the papers we have reviewed, have we missed some? Here is how we are dealing with missing value issues with the explanatory variables. These are the regression models being considered, anyone got a better idea, etc. Does anyone have experience with this type of approach in health policy research, or other work using human subjects data?”