Binder Workshop on Reproducibility at SIPS, July 7th-9th, 2019

The Society for the Improvement of Psychological Science held their fourth annual meeting in Rotterdam earlier this summer. This is the first time that the Society has met outside the U.S.A. and the first time that many European-based early career researchers have had the opportunity to attend. As a reflection of the level of interest, registration for the conference reached capacity well in advance of the closing of the early-bird registration rate. In response to this, the organizers booked an additional neighboring venue to allow 17 sessions to run in parallel. The sessions consisted of Hackathons, Workshops, Unconferences, and Lightning Talks with a huge variety of topics including sessions on teaching reproducibility in the classroom, promoting diversity within the Psychological Open Research community, data management and documentation, and how to develop your own workflow for reproducible research. The total number of people registered ended up being just over 500, most of whom were early career researchers.

On the second day of the conference Oli Clark (from Manchester Metropolitan University) and I ran a 3 hour workshop on Reproducible Data Visualizations Using R and Binder. The purpose of the workshop was to encourage the attendees to use Binder as a way of capturing their computational environments alongside their code and data to ensure full reproducibility of their research workflows. The workshop was oversubscribed and ended up being standing room only!


Following a 45 minute overview of data visualization, reproducibility, and Binder, attendees were tasked with reproducing the code for 6 different data visualizations based on a Tidy Tuesday dataset of SNCF train delay data. After each visualization, they then built a Binder to capture their data, code, and computational environment with links to the Binders added to a Hackmd document. It was interesting seeing so many coding styles and approaches to reproducing code for the 6 different data visualization challenges. People seemed to really like the idea of building Binders – and about a week or so after the workshop I was Tweeted @ by one of the attendees who had just Binderised the empirical work in her M.Sc. thesis and was submitting it alongside the thesis itself.

Nice to see such positive and immediate impact!

Andrew Stewart
Fellow of the Software Sustainability Institute and Senior Lecturer

My interests include open research and reproducibility, data science, experimental psychology, and psycholinguistics. I am a fellow of the Software Sustainability Institute.