Measuring Research Transparency

peter.suber's bookmarks 2022-05-18

Summary:

"Measuring the transparency and credibility of research is fundamental to our mission. By having measures of transparency and credibility we can learn about the current state of research practice, we can evaluate the impact of our interventions, we can track progress on culture change, and we can investigate whether adopting transparency behaviors is associated with increasing credibility of findings....

Many groups have conducted research projects that manually code a sample of papers from a field to assess current practices. These are useful but highly effortful. If machines can be trained to do the work, we will get much more data, more consistently, and much faster. There are at least three groups that have made meaningful progress creating scalable solutions: RipetaSciScore, and DataSeer. These groups are trying to make it possible, accurate, and easy to assess many papers for whether the authors shared data, used reporting standards, identified their conflicts of interest, and other transparency relevant actions...."

Link:

https://www.cos.io/blog/measuring-research-transparency

From feeds:

Open Access Tracking Project (OATP) » peter.suber's bookmarks

Tags:

oa.new oa.transparency oa.culture oa.cos oa.credibility oa.trust oa.top oa.metrics oa.quality

Date tagged:

05/18/2022, 11:12

Date published:

05/18/2022, 07:13