Wednesday, 17 June 2020

Complex data workflows contribute to the reproducibility crisis in science

Via O'Reilly Data Newsletter:

Complex data workflows contribute to the reproducibility crisis in science

70 independent teams, given the same data and a common analysis challenge, came to very different conclusions in a recent Stanford study that highlights the challenges of data analysis in an era of huge datasets and highly flexible processing workflows.

"Simply put, no two groups of researchers are necessarily crunching data the same way. And with so much data to get through and so many ways to process it, researchers can arrive at totally different conclusions."