Shoddy Science Uncovered in New Research

by Linda Tunesi

shoddy science
Konrad Kording, Ph.D.

Konrad Kording, professor in the Department of Bioengineering, and colleagues have a new technique for identifying fraudulent scientific papers by spotting reused images. Rather than scrap a failed study, for example, a researcher might attempt to pass off images from a different experiment to give the false impression that their own was a success.

Kording, a Penn Integrates Knowledge (PIK) Professor who also has an appointment in the Department of Neuroscience in Penn’s Perelman School of Medicine, and his collaborators developed an algorithm that can compare images across journal articles and detect such replicas, even if the image has been resized, rotated, or cropped.

They describe their technique in a paper recently published on the BioRxiv preprint server.

“Any fraudulent paper damages science,” Kording says. “In biology, many times fraud is detected when someone looks at a few papers and says ‘hey, these images look a little similar.’ We reckoned we could make an algorithm that does the same thing.”

“Science depends on building upon other people’s work,” adds Daniel Acuna, lead author on the paper, and a student in Kording’s lab at Northwestern University at the time the study was conducted. “If you cannot trust other people’s work, the scientific process collapses and, worse, the general public loses trust in us. Some websites were doing this, anonymously, but at a painstakingly slow rate.” Acuna is now an assistant professor in the School of Information Studies at Syracuse University.

While much of Kording’s work focuses on using data science to understand the brain, he is also curious about the process of research itself, or, as he puts it, “the science of science.” One of the Kording lab’s previous projects closely analyzed common methods of neuroscience research, and another turned a mirror on itself, describing how to structure a scientific paper.

Continued at the Penn Engineering Medium blog.