Thursday, 25 May 2017

Research data management in academic institutions: A scoping review

Article in PLOS by Laure Perrier et al
 
 

Objective

The purpose of this study is to describe the volume, topics, and methodological nature of the existing research literature on research data management in academic institutions.

Materials and methods

We conducted a scoping review by searching forty literature databases encompassing a broad range of disciplines from inception to April 2016. We included all study types and data extracted on study design, discipline, data collection tools, and phase of the research data lifecycle.

Results

We included 301 articles plus 10 companion reports after screening 13,002 titles and abstracts and 654 full-text articles. Most articles (85%) were published from 2010 onwards and conducted within the sciences (86%). More than three-quarters of the articles (78%) reported methods that included interviews, cross-sectional, or case studies. Most articles (68%) included the Giving Access to Data phase of the UK Data Archive Research Data Lifecycle that examines activities such as sharing data. When studies were grouped into five dominant groupings (Stakeholder, Data, Library, Tool/Device, and Publication), data quality emerged as an integral element.

Conclusion

Most studies relied on self-reports (interviews, surveys) or accounts from an observer (case studies) and we found few studies that collected empirical evidence on activities amongst data producers, particularly those examining the impact of research data management interventions. As well, fewer studies examined research data management at the early phases of research projects. The quality of all research outputs needs attention, from the application of best practices in research data management studies, to data producers depositing data in repositories for long-term use.

Monday, 22 May 2017

DMRs, making DMPs relevant again


A Data Management Record (DMR) is an active record of working data that can be curated and form part of a Data Management Plan (DMP).   

Why are we placing the emphasis on planning for good data management for possible future projects, when that time could be spent curating working research data from projects you are currently working on? 

Data Management Plans (DMP's) have become synonymous with research data management best-practice, often with the view of the more comprehensive the better. Universities and organisations have created lengthy checklists of questions which over time have grown into labyrinthine forms requiring a significant amount of time to complete with any kind of rigour. The Australian researcher faced with no mandate or reward to complete a lengthy DMP resorts to writing a throw-away DMP or none at all.

It is thus unsurprising that no study has shown any benefit from completing traditional DMPs. In fact, when asked, the largest DMP provider in the UK mentioned that researchers rarely go back to visit the documentation created to meet funder mandates. Researchers may write DMPs to satisfy funders, but they don't refer back to them or keep them active or updated. There is no inherent reason to because DMP's are typically not linked to any reward or outcome. They become static artefacts which, due to the very nature of research, quickly become out of date.

This lack of up-front planning of data management leads to multiple and potentially serious problems for the researcher, their colleagues, institution and indeed science in general.  This is evidenced by the reproducibility crisis we are now facing[1]  A recent survey of 1500 participants regarding this problem concluded that 34% of researchers do not have established procedures in order to increase reproducibility[2].

So, what is the right alternative to present researchers with? Arguably not no DMP at all, but perhaps something more relevant to the research process. Something practical that can minimise the risks related to “bad” data management practice. Researchers need to actively manage data at the project level, with adequate documentation at all stages of the data lifecycle, not just the planning stage. Therefore, we would like to propose new terminology for a more relevant, useful, actionable metadata record. A Data Management Record (DMR) can be further broken down as either active (aDMR) or curated (cDMR).

By shifting the wording from plan to record the result is dramatic. The DMP becomes more than a plan. It becomes a critical record through which the researcher directly manages their data and potentially engages with other university systems. Given that multiple parts of the proposed DMR relate to systems and processes around data much of it can also be auto-populated as the data lifecycle progresses.

DMRs are associated with research projects and as such there is potential for institutions to utilise them for multiple purposes. They can be the means by which a researcher manages storage for a research project. They could control who gets access to the data at any point in time and collect relevant metadata about the research project throughout the entire data lifecycle, from conception or idea stage to publication and archiving. This information likely exists for the majority of research projects already, but is scattered across multiple systems with little linking information. The linking of this data via an identifier such as RAiD[3] has significant benefits for long term provenance, and as such, the DMR should also contain other persistent identifiers (PIDs) such as ORCID, GRID and DOI where relevant.

Any and all metadata entered into the DMR will be stored and add value beyond the planning stage. Indeed, it is envisaged to be published with the final data record in the institutional repository at the completion of a project or when a publication results from the data.

It is time - we need to grow beyond talking about traditional DMPs. What we have now is the next generation of DMPs which require and deserve a name that accurately describes that they do more for everyone involved in the research process. Data Management Records are project based active and actionable online “forms” that ultimately turn into curated Data Management Records upon publication of the metadata they hold, along with the associated PID to the research data generated by the project.

By creating DMR's at the start of a research project and then adding information as the project progresses, it gives us the opportunity to formalise the data chain of command from day one. This chain of command can be built based upon who has access, which department the data is associated with, where it is or has been stored and which institutions have oversight. This will dramatically ease data access problems when they arise as this information will be ready and to hand to parties that require it. This approach will reduce the propensity towards orphaned data, and data silos as it challenges attitudes towards data ownership by associating all data with projects rather than individuals.

Our take is that all projects likely already have a DMR, be it written down or not. It's somewhere. By formalising the notion of DMRs and assisting researchers to capture it as part of normal process everyone’s a winner!


By Ms Helen Morgan and Dr Andrew Janke
Helen Morgan - helen.morgan@uq.edu.au
Dr Andrew Janke - andrew.janke@uq.edu.au


[1] doi:10.1038/s41562-016-0021 and https://doi.org/10.1371/journal.pbio.1002165
[2] http://www.nature.com/news/1-500-scientists-lift-the-lid-on-reproducibility-1.19970
[3] www.raid.org.au

Saturday, 20 May 2017

ORCID and WDS Partner to support reuse of research data

"Given our shared objectives, we have agreed to enter into a formal partnership, the ultimate goal of which is to build levels of trust to enable sharing of research data."
- ORCID blog post by Laure Haak, 18 May 2017

See: https://orcid.org/blog/2017/05/18/orcid-wds-partner
 

Advantages of a Truly Open-Access Data-Sharing Model

Monica M. Bertagnolli, M.D., Oliver Sartor, M.D., Bruce A. Chabner, M.D., Mace L. Rothenberg, M.D., Sean Khozin, M.D., M.P.H., Charles Hugh-Jones, M.D., David M. Reese, M.D., and Martin J. Murphy, D.Med.Sc., Ph.D.
N Engl J Med 2017; 376:1178-1181March 23, 2017http://doi.org/10.1056/NEJMsb1702054 

"A substantial body of readily available data from clinical trials can be shared with minimal risk to patients or researchers. Examples include data sets of already published trials, particularly if the treatments that were tested are not undergoing review for regulatory approval."

A Data Citation Roadmap for Scientific Publishers

A Data Citation Roadmap for Scientific Publishers
Helena Cousijn, Amye Kenall, Emma Ganley, Melissa Harrison, David Kernohan, FionaMurphy,  
Patrick Polischuk, Maryann Martone, Timothy Clark

This article presents a practical roadmap for scholarly publishers to implement data citation in accordance with the Joint Declaration of Data Citation Principles (JDDCP), a synopsis and harmonization of the recommendations of major science policy bodies. It was developed by the Publishers Early Adopters Expert Group as part of the Data Citation Implementation Pilot (DCIP) project, an initiative of FORCE11.org and the NIH BioCADDIE program. The structure of the roadmap presented here follows the 'life of a paper' workflow and includes the categories Pre-submission, Submission, Production, and Publication. The roadmap is intended to be publisher-agnostic so that all publishers can use this as a starting point when implementing JDDCP-compliant data citation.

Reproducible and reusable research: are journal data sharing policies meeting the mark?

Vasilevsky NA, Minnier J, Haendel MA, Champieux RE. (2017) Reproducible and reusable research: are journal data sharing policies meeting the mark? PeerJ 5:e3208 

 

Background

There is wide agreement in the biomedical research community that research data sharing is a primary ingredient for ensuring that science is more transparent and reproducible. Publishers could play an important role in facilitating and enforcing data sharing; however, many journals have not yet implemented data sharing policies and the requirements vary widely across journals. This study set out to analyze the pervasiveness and quality of data sharing policies in the biomedical literature.

Methods

The online author’s instructions and editorial policies for 318 biomedical journals were manually reviewed to analyze the journal’s data sharing requirements and characteristics. The data sharing policies were ranked using a rubric to determine if data sharing was required, recommended, required only for omics data, or not addressed at all. The data sharing method and licensing recommendations were examined, as well any mention of reproducibility or similar concepts. The data was analyzed for patterns relating to publishing volume, Journal Impact Factor, and the publishing model (open access or subscription) of each journal.

Results

A total of 11.9% of journals analyzed explicitly stated that data sharing was required as a condition of publication. A total of 9.1% of journals required data sharing, but did not state that it would affect publication decisions. 23.3% of journals had a statement encouraging authors to share their data but did not require it. A total of 9.1% of journals mentioned data sharing indirectly, and only 14.8% addressed protein, proteomic, and/or genomic data sharing. There was no mention of data sharing in 31.8% of journals. Impact factors were significantly higher for journals with the strongest data sharing policies compared to all other data sharing criteria. Open access journals were not more likely to require data sharing than subscription journals.

Discussion

Our study confirmed earlier investigations which observed that only a minority of biomedical journals require data sharing, and a significant association between higher Impact Factors and journals with a data sharing requirement. Moreover, while 65.7% of the journals in our study that required data sharing addressed the concept of reproducibility, as with earlier investigations, we found that most data sharing policies did not provide specific guidance on the practices that ensure data is maximally available and reusable.

Monday, 15 May 2017

Senior management engagement in RDM

A blog from the iDCC 2017 'Birds of a Feather' session centred around the idea that the successful engagement of senior management when developing Research Data Management services can present a particular a set of onerous but not unique problems; problems which are not insurmountable, but which can benefit from the shared experience of the community.

Making Progress Toward Open Data

Reflections on Data Sharing at PLOS ONE

 

Blog post by Meg Byrne

http://blogs.plos.org/everyone/2017/05/08/making-progress-toward-open-data/ 

Thursday, 11 May 2017

Researchers must stand up to funders that insist on gagging clauses.

Nature Editorial: Censorship of addiction research is an abuse of science
"Since his experience in 2012, Kypri has begun to systematically collect examples of clauses in government contracts that could enable interference in research. He worries that in some areas, particularly his own Australia, the clauses have become so common that they are viewed as normal. But his experience shows that it is possible to push back and perhaps even find compromises that satisfy both funder and researcher — without compromising research integrity."

Monday, 1 May 2017

Data visualisation under the dome

http://www.nature.com/news/planetariums-not-just-for-kids-1.21888

Planetariums — not just for kids

"Rather than chasing grants for immersive- visualization infrastructure, researchers should use what is already available. With up to 20 high-performance video projectors linked to advanced graphics computers, digital dome planetariums host some of the most sophisticated and flexible systems for scientific visualization. The IPS estimates that there are around 1,300 digital domes in operation globally, each measuring between 3 and 30 metres across, and that one is available within easy reach of most academic facilities."