Fourth Workshop on Sustainable Software for Science: Practice and Experiences (WSSSPE4)

Daniel S. Katz; Kyle E. Niemeyer; Sandra Gesing; Lorraine Hwang; Wolfgang Bangerth; Simon Hettrick; Ray Idaszak; Jean Salac; Neil Chue Hong; Santiago Núñez-Corrales; Alice Allen; R. Stuart Geiger; Jonah Miller; Emily Chen; Anshu Dubey; Patricia Lago

doi:10.5334/jors.184

Fourth Workshop on Sustainable Software for Science: Practice and Experiences (WSSSPE4)

Volume 6 (2018): Issue 1

By: Daniel S. Katz , Kyle E. Niemeyer , Sandra Gesing , Lorraine Hwang , Wolfgang Bangerth , Simon Hettrick , Ray Idaszak , Jean Salac , Neil Chue Hong , Santiago Núñez-Corrales , Alice Allen , R. Stuart Geiger , Jonah Miller , Emily Chen , Anshu Dubey and Patricia Lago

Open Access

|Feb 2018

Abstract

This article summarizes motivations, organization, and activities of the Fourth Workshop on Sustainable Software for Science: Practice and Experiences (WSSSPE4). The WSSSPE series promotes sustainable research software by positively impacting principles and best practices, careers, learning, and credit. This article discusses the code of conduct; the mission and vision statements that were drafted at the workshop and finalized shortly after it; the keynote and idea papers, position papers, experience papers, demos, and lightning talks presented during the workshop; and a panel discussion on best practices. The main part of the article discusses the set of working groups that formed during the meeting, along with contact information for readers who may want to join a group. Finally, it discusses a survey of the workshop attendees.

References

Katz, D S, Allen, G, Chue Hong, N, Parashar, M and Proctor, D 2013 First Workshop on Sustainable Software for Science: Practice and Experiences (WSSSPE): Submission and Peer-Review Process, and Results. arXiv, 1311–3523. Available from: http://arxiv.org/abs/1311.3523.
Search in Google Scholar Back to article
Katz, DS, Choi, SCT, Lapp, H, Maheshwari, K, Löffler, F, Turk, M, et al. 2014 Summary of the First Workshop on Sustainable Software for Science: Practice and Experiences (WSSSPE1). Journal of Open Research Software, 2(1). DOI: 10.5334/jors.an
Open DOI Search in Google Scholar Back to article
Katz, DS, Allen, G, Chue Hong, N, Cranston, K, Parashar, M, Proctor, D, et al. 2014 Second Workshop on Sustainable Software for Science: Practice and Experiences (WSSSPE2): Submission, Peer-Review and Sorting Process, and Results. arXiv, 1411–3464. Available from: http://arxiv.org/abs/1411.3464.
Search in Google Scholar Back to article
Katz, D S, Choi, S T, Wilkins-Diehr, N, Chue Hong, N, Venters, C C, Howison, J, et al. 2016 Report on the Second Workshop on Sustainable Software for Science: Practice and Experiences (WSSSPE2). Journal of Open Research Software, 4(1). e7. DOI: 10.5334/jors.85
Open DOI Search in Google Scholar Back to article
Katz, D S, Choi, S T, Niemeyer, K E, Hetherington, J, Löffler, F, Gunter, D, et al. 2016 Report on the Third Workshop on Sustainable Software for Science: Practice and Experiences (WSSSPE3). Journal of Open Research Software, 4(1). e37. DOI: 10.5334/jors.118
Open DOI Search in Google Scholar Back to article
Katz, D S, Niemeyer, K E, Gesing, S, Hwang, L, Bangerth, W, Hettrick, S, et al. 2017 Report on the Fourth Workshop on Sustainable Software for Science: Practice and Experiences (WSSSPE4). arXiv, 1705–02607. Available from: http://arxiv.org/abs/1705.02607.
Search in Google Scholar Back to article
Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.) 2016 Proceedings of the Fourth Workshop on Sustainable Software for Science: Practice and Experiences, (WSSSPE4). Aachen. Urn:nbn:de: 0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/.
Search in Google Scholar Back to article
Ilik, V, Thaney, K, Katz, D S, others. 2016 FORCE11 Conference Code of Conduct. Accessed: 2016-09-15. https://www.force11.org/meetings/force2016/code-conduct.
Search in Google Scholar Back to article
Code4 Lib 2015 Code Of Conduct 4 Lib, Accessed: 2016-09-15. Git hash 4270594fdbe28eeeb 45256ea6304c8bd800e6a86. https://github.com/code4lib/antiharassment-policy/blob/master/code_of_conduct.md.
Search in Google Scholar Back to article
Lago, P, Koçak, S A, Crnkovic, I and Penzenstadler, B 2015 Framing sustainability as a property of software quality. Communications of the ACM, 58(10). 70–78. DOI: 10.1145/2714560
Open DOI Search in Google Scholar Back to article
Heroux, M 2016 Sustainable & Productive: Improving incentives for quality software. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences. No. 1686 in CEUR Workshop Proceedings, Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_10.pdf.
Search in Google Scholar Back to article
Allen, G 2016 Establishing a professional society for research software. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences. No. 1686 in CEUR Workshop Proceedings, Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceurws.org/Vol-1686/WSSSPE4_paper_24.pdf.
Search in Google Scholar Back to article
Philippe, O, Hettrick, S and Chue Hong, N A 2016 A survey of Research Software Engineers in the UK. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences, No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_19.pdf.
Search in Google Scholar Back to article
Gwilliams, C 2016 Using industrial engagement to create and develop research ties within academia. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences, No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_1.pdf.
Search in Google Scholar Back to article
Dubey, A and Riley, K 2016 Software engineering and community codes track in ATPESC. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences, No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_17.pdf.
Search in Google Scholar Back to article
Chue Hong, N 2016 Why do we need to compare research software, and how should we do it? In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences, No. 1686 in CEUR Workshop Proceedings, Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_29.pdf.
Search in Google Scholar Back to article
Dubey, A and McInnes, L C 2016 The lifecycle of software for scientific simulation. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences, No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_16.pdf.
Search in Google Scholar Back to article
Queiroz, F and Spitz, R 2016 Collaborative gamification design for scientific software. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences, No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_6.pdf.
Search in Google Scholar Back to article
Childers, B, Davidson, J, Graves, W, Rous, B and Wilkinson, D 2016 Active curation of artifacts is changing the way digital libraries will operate. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences, No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_8.pdf.
Search in Google Scholar Back to article
Ganguly, D, Garrison, W, Wilkinson, D, Childers, B, Lee, A and Mosse, D 2016 Composing, reproducing, and sharing simulations. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences. No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_33.pdf.
Search in Google Scholar Back to article
Shende, S and Malony, A 2016 Using TAU for performance evaluation of scientific software. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences, No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_12.pdf.
Search in Google Scholar Back to article
Sallai, J, Iacovella, C, Klein, C and Ma, T 2016 Development of a software framework for formalizing forcefield atomtyping for molecular simulation. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences, No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_35.pdf.
Search in Google Scholar Back to article
Sufi, S 2016 The Software Sustainability Institute Fellowship programme; supporting the social side of research software. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences. No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_27.pdf.
Search in Google Scholar Back to article
Gesing, S, Dahan, M, Hayden, LB, Lawrence, K, Marru, S, Pierce, M, et al. 2016 The Science Gateways Community Institute – Supporting communities to achieve sustainability for their science gateways. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences. No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_32.pdf.
Search in Google Scholar Back to article
Ram, K, Ross, N and Chamberlain, S 2016 A model for peer review and onboarding research software. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, MR, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences. No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_13.pdf.
Search in Google Scholar Back to article
Löffler, F and Brandt, S 2016 A vision of computing in 10 + years. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences, No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_9.pdf.
Search in Google Scholar Back to article
Katz, D S, Niemeyer, K E, Smith, A M and FORCE11 Software Citation Working Group 2016. Software citation: Process, principles, and implementation. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences, No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_31.pdf.
Search in Google Scholar Back to article
Idaszak, R, Tarboton, DG, Yi, H, Stealey, M, Dash, P, Couch, A, et al. 2016 HydroShare: A case study in software engineering best practices and culture change for developing sustainable community software. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences, No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_5.pdf.
Search in Google Scholar Back to article
Hwang, L, Bangerth, W, Heister, T and Kellogg, L 2016 ASPECT: Hackathons as an example of sustaining an open source community. In: Allen, G, Carve, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences, No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_7.pdf.
Search in Google Scholar Back to article
Goble, C 2016 A simple profiling framework for software user-producer maturity review. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences, No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_2.pdf.
Search in Google Scholar Back to article
Druskat, S 2016 A proposal for the measurement and documentation of research software sustainability in interactive metadata repositories. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences. No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_20.pdf.
Search in Google Scholar Back to article
Contrastin, M, Danish, M, Orchard, D and Rice, A 2016 Supporting software sustainability with lightweight specifications. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences. No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_23.pdf.
Search in Google Scholar Back to article
Allen, A, Aragon, C, Becker, C, Carver, J, Chis, A, Combemale, B, et al. 2016 I solemnly pledge: A manifesto for personal responsibility in the engineering of academic software. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences, No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_15.pdf.
Search in Google Scholar Back to article
Chue Hong, N 2016 Making it easier to understand research software impact. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences, No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_30.pdf.
Search in Google Scholar Back to article
van Hage, W R, Maassen, J and van Nieuwpoort, R 2016 Software impact measurement at the Netherlands eScience Center. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences, No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_4.pdf.
Search in Google Scholar Back to article
Allen, G, Chen, E, Idaszak, R and Katz, D S 2016 Report on software metrics for research software. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences, No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_26.pdf.
Search in Google Scholar Back to article
Seidel, E L and Allen, G 2016 Bringing techniques from software engineering into scientific software. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences, No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_28.pdf.
Search in Google Scholar Back to article
Emsley, I and De Roure, D 2016 Sustaining the social: Connecting the lives of Drupal community. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences. No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_34.pdf.
Search in Google Scholar Back to article
Dongarra, J, Hammarling, S, Higham, N J, Relton, S D, Valero-Lara, P and Zounon, M 2016 Creating a standardised set of batched BLAS routines. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences, No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_3.pdf.
Search in Google Scholar Back to article
Breitwieser, L, Bauer, R, Meglio, A D, Johard, L, Kaiser, M, Manca, M, et al. 2016 The BioDynaMo Project. In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences, No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_14.pdf.
Search in Google Scholar Back to article
Aldabjan, A, Haines, R and Jay, C 2016 How should we measure the relationship between code quality and software sustainability? In: Allen, G, Carver, J, Choi, S C T, Crick, T, Crusoe, M R, Gesing, S, et al. (eds.), Workshop on Sustainable Software for Science: Practice and Experiences, No. 1686 in CEUR Workshop Proceedings. Aachen. Urn:nbn:de:0074-1686-8. Available from: http://ceur-ws.org/Vol-1686/WSSSPE4_paper_22.pdf.
Search in Google Scholar Back to article
WSSSPE Organization 2016 WSSSPE Slack. Accessed: 2016-12-11. https://wssspe.signup.team/.
Search in Google Scholar Back to article
Barstow, D, Duffey, R, Smoliar, S and Vestal, S 1982 An automatic programming system to support an experimental science. In: Proceedings of the 6th international conference on Software engineering. IEEE Computer Society Press, 360–366.
Search in Google Scholar Back to article
Towns, J, Cockerill, T, Dahan, M, Foster, I, Gaither, K, Grimshaw, A, et al. 2014 XSEDE: accelerating scientific discovery. Computing in Science & Engineering, 16(5). 62–74. DOI: 10.1109/MCSE.2014.80
Open DOI Search in Google Scholar Back to article
Jones, M B, Boettiger, C, Mayes, A C, Smith, A, Slaughter, P, Niemeyer, K, et al. 2016 CodeMeta: an exchange schema for software metadata. KNB Data Repository. DOI: 10.5063/SCHEMA/CODEMETA-1.0.
Open DOI Search in Google Scholar Back to article

Articles in this issue

DOI: https://doi.org/10.5334/jors.184 | Journal eISSN: 2049-9647

Journal RSS Feed

Language: English

Submitted on: Jun 18, 2017

Accepted on: Jan 25, 2018

Published on: Feb 15, 2018

Published by: Ubiquity Press

In partnership with: Paradigm Publishing Services

Publication frequency: 1 issue per year

Keywords:

sustainability,

sustainable software,

open source software,

software development

© 2018 Daniel S. Katz, Kyle E. Niemeyer, Sandra Gesing, Lorraine Hwang, Wolfgang Bangerth, Simon Hettrick, Ray Idaszak, Jean Salac, Neil Chue Hong, Santiago Núñez-Corrales, Alice Allen, R. Stuart Geiger, Jonah Miller, Emily Chen, Anshu Dubey, Patricia Lago, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.

Volume 6 (2018): Issue 1