Showing posts with label DMP Interest Group. Show all posts
Showing posts with label DMP Interest Group. Show all posts

Monday, 22 May 2017

DMRs, making DMPs relevant again


A Data Management Record (DMR) is an active record of working data that can be curated and form part of a Data Management Plan (DMP).   

Why are we placing the emphasis on planning for good data management for possible future projects, when that time could be spent curating working research data from projects you are currently working on? 

Data Management Plans (DMP's) have become synonymous with research data management best-practice, often with the view of the more comprehensive the better. Universities and organisations have created lengthy checklists of questions which over time have grown into labyrinthine forms requiring a significant amount of time to complete with any kind of rigour. The Australian researcher faced with no mandate or reward to complete a lengthy DMP resorts to writing a throw-away DMP or none at all.

It is thus unsurprising that no study has shown any benefit from completing traditional DMPs. In fact, when asked, the largest DMP provider in the UK mentioned that researchers rarely go back to visit the documentation created to meet funder mandates. Researchers may write DMPs to satisfy funders, but they don't refer back to them or keep them active or updated. There is no inherent reason to because DMP's are typically not linked to any reward or outcome. They become static artefacts which, due to the very nature of research, quickly become out of date.

This lack of up-front planning of data management leads to multiple and potentially serious problems for the researcher, their colleagues, institution and indeed science in general.  This is evidenced by the reproducibility crisis we are now facing[1]  A recent survey of 1500 participants regarding this problem concluded that 34% of researchers do not have established procedures in order to increase reproducibility[2].

So, what is the right alternative to present researchers with? Arguably not no DMP at all, but perhaps something more relevant to the research process. Something practical that can minimise the risks related to “bad” data management practice. Researchers need to actively manage data at the project level, with adequate documentation at all stages of the data lifecycle, not just the planning stage. Therefore, we would like to propose new terminology for a more relevant, useful, actionable metadata record. A Data Management Record (DMR) can be further broken down as either active (aDMR) or curated (cDMR).

By shifting the wording from plan to record the result is dramatic. The DMP becomes more than a plan. It becomes a critical record through which the researcher directly manages their data and potentially engages with other university systems. Given that multiple parts of the proposed DMR relate to systems and processes around data much of it can also be auto-populated as the data lifecycle progresses.

DMRs are associated with research projects and as such there is potential for institutions to utilise them for multiple purposes. They can be the means by which a researcher manages storage for a research project. They could control who gets access to the data at any point in time and collect relevant metadata about the research project throughout the entire data lifecycle, from conception or idea stage to publication and archiving. This information likely exists for the majority of research projects already, but is scattered across multiple systems with little linking information. The linking of this data via an identifier such as RAiD[3] has significant benefits for long term provenance, and as such, the DMR should also contain other persistent identifiers (PIDs) such as ORCID, GRID and DOI where relevant.

Any and all metadata entered into the DMR will be stored and add value beyond the planning stage. Indeed, it is envisaged to be published with the final data record in the institutional repository at the completion of a project or when a publication results from the data.

It is time - we need to grow beyond talking about traditional DMPs. What we have now is the next generation of DMPs which require and deserve a name that accurately describes that they do more for everyone involved in the research process. Data Management Records are project based active and actionable online “forms” that ultimately turn into curated Data Management Records upon publication of the metadata they hold, along with the associated PID to the research data generated by the project.

By creating DMR's at the start of a research project and then adding information as the project progresses, it gives us the opportunity to formalise the data chain of command from day one. This chain of command can be built based upon who has access, which department the data is associated with, where it is or has been stored and which institutions have oversight. This will dramatically ease data access problems when they arise as this information will be ready and to hand to parties that require it. This approach will reduce the propensity towards orphaned data, and data silos as it challenges attitudes towards data ownership by associating all data with projects rather than individuals.

Our take is that all projects likely already have a DMR, be it written down or not. It's somewhere. By formalising the notion of DMRs and assisting researchers to capture it as part of normal process everyone’s a winner!


By Ms Helen Morgan and Dr Andrew Janke
Helen Morgan - helen.morgan@uq.edu.au
Dr Andrew Janke - andrew.janke@uq.edu.au


[1] doi:10.1038/s41562-016-0021 and https://doi.org/10.1371/journal.pbio.1002165
[2] http://www.nature.com/news/1-500-scientists-lift-the-lid-on-reproducibility-1.19970
[3] www.raid.org.au

Friday, 7 April 2017

Machine-actionable data management plans (maDMPs)

White paper: Machine-actionable data management plans (maDMPs)

This report presents outputs of the International Digital Curation Conference 2017 workshop on machine-actionable data management plans. It contains community-generated use cases covering eight broad topics that reflect the needs of various stakeholders. It also articulates a consensus about the need for a common standard for machine-actionable data management plans to enable future work in this area.

See: http://riojournal.com/articles.php?id=13086 

Citation: Simms S, Jones S, Mietchen D, Miksa T (2017) Machine-actionable data management plans (maDMPs). Research Ideas and Outcomes 3: e13086. https://doi.org/10.3897/rio.3.e13086

Thursday, 23 March 2017

Introducing the Data Management Plans (DMPs) Interest Group

Do you have questions about Data Management Plans such as: Why do we have them and are they really useful? What DMP tools are others using? What might the next generation of DMPs look like? What voice should researchers have in their development? How do we define best practice?


These are just a few of the questions that staff at Australian institutions are asking when evaluating DMPs, DMP tools and their effectiveness. To help facilitate the discussion, a new DMP Interest Group has been formed, facilitated by the Australian National Data Service. If DMPs keep you up at night, we warmly invite you to join in the discussion.


Why DMPs?
Significant technical and human efforts have been, and are continuing to be, directed towards the development and use of data management plans (DMPs) for research. These efforts are driven by a number of factors. An increasing number of research funders, such as Wellcome Trust, ask researchers to provide a DMP. Institutions are also looking to provide DMP tools to their researchers for a range of reasons such as risk management, to provide a useful tool, and to collect information that enables them to plan technical and human support. Some institutions, such as Curtin University, are even making DMPs mandatory for researchers under certain conditions. Others, such as the University of Colorado, sponsor a competition for the best DMP. But how useful are DMPs?
In the beginning, it’s fair to say that DMP tools were designed to capture absolutely everything to do with data management during the research lifecycle by asking a seemingly endless series of questions: what data will be created? Who will own and access the data? What facilities and equipment will be required? What metadata will be used to describe the data? Where will the data be stored? and so on. Some DMPs are huge, bewildering and somewhat terrifying documents for researchers, especially those new to data management. Nick Smale from the University of Melbourne explained at the ANDS DMP webinar in February that their initial DMP asked 90 questions and was 40 pages long! Not surprisingly, uptake was minimal. This got Nick thinking about the usefulness of DMPs in general. As he points out in his blog post, there is a surprising lack of evidence base behind DMP use and he calls for further research into the benefits of DMPs. Such research would help those looking to implement DMP tools understand how to better design those tools and encourage researchers to use them.
Next generation DMPs
While the benefits of DMPs are a work in progress, institutions are beginning to move from those long early versions of DMPs to what Victoria Stodden coins ‘DMP v2.0”. Stodden, from the University of Illinois at Urbana-Champaign, is working on an EAGER project funded by NSF. At the Research Data Alliance plenary last September, she outlined characteristics of DMPs v.2.0, including DMPs that are:
  • public not private documents
  • machine readable as well as human readable
  • flexible living documents that can be changed through the course of a research project
  • measurable (i.e. did researcher X do what they said they would do in their DMP?)
  • connected to at least one other system rather than stand alone forms.
This is food for thought and moves DMP tools in a whole new direction. With such changes happening, and with more institutions launching or upgrading their DMP tools, now is the right time to launch an Interest Group to discuss this important topic. Why not join in?
Join the discussion!
Sign up for the Data Librarians Google Group or ANDS News to be notified of DMP Interest Group events.

Next DMP IG online catch-up:
See listing at the bottom of the DMP Interest Group page on the ANDS website:

http://www.ands.org.au/partners-and-communities/ands-communities/dmps-interest-group