Open ScienceREFSQ 2024
Open Science Policy
Open Science is a movement that seeks to make scientific research more transparent, accessible, and reproducible. Open Science is about increased rigour, accountability, and reproducibility for research. It aims to make research more open to participation, review/refutation, improvement and (re)use for the community to benefit through making research material available.
We expect authors to include an explicit availability statement in their submissions. Specifically, authors should provide details about any material disclosed alongside their submission such as data, or code, and other relevant material. Otherwise, the authors should justify the reasons why disclosure is not possible (e.g., due to IP agreements). While including an availability statement does not affect the review process, it certainly increases the credibility of results.
We strongly encourage authors to read and apply the following best practices to contribute to open science:
Before submission:
- Adequately document the material associated with your submission to allow for, to the best extent possible, replicability, reproducibility, and reusability.
- Prepare a README file that lists precisely what is being shared and how to use and re-use the research material.
- Introduce a running example that helps reviewers and the community validate and reuse the shared material.
- If you are sharing a code, think thoroughly about the requirements for running the code and how to facilitate this process (e.g., use virtual environments such as Docker where possible).
Upon submission:
- Establish a good intent by making data, code, and evaluation material available on a persistent repository with a public link.
Upon acceptance:
- Attribute an appropriate open licence to the shared material and make sure you share this licence together with the material under the same folder in a LICENSE.md file.
Further reading
- Open Science – Artefact Management Guideline Link
- General introduction into Open Science in Software Engineering and generally recommended practices: D. Mendez, D. Graziotin, S. Wagner, H. Seibold. Open Science in Software Engineering. In: M. Felderer, G.-H. Travassos (eds.) Contemporary Empirical Methods in Software Engineering, Springer, 2020
Link
ORKG Initiative
We encourage authors to annotate their papers using the OKRG latex package, which allows the replication-relevant information of their paper to be easier to retrieve.
The ORKG (Open Research Knowledge Graph) is an initiative and repository that aims to open scientific knowledge and improve its FAIRness (Findability, Accessibility, Interoperability, and Reusability).
You can find the packages and more information at the following links.
Annotations relevant for the open science track include replication package, code repository and dataset. They can be used as follows:
\contribution{replication package}{URL to replication package}.
\contribution{code repository}{URL to code repository}
\contribution{dataset}{URL to dataset}
Example of using these tags within your latex code:
We provide our replication package at \contribution{replication package}{https://doi.org/10.5281/zenodo.6544552}. The dataset is also available at \contribution{dataset}{https://doi.org/10.5281/zenodo.6544552}. In addition, we provide our source code at \contribution{code repository}{https://github.com/Christof93/SciKGTeX} and \contribution{code repository}{https://github.com/ldrbmrtv/PDF2ORKG}
After annotating, you can upload your annotated preprint to the ORKG repository as follows Youtube: Import of SciKGTeX annotated PDF into the ORKG
It takes less than 90 seconds to add the annotated paper and thus increase its visibility in the ORKG knowledge graph.
For additional information, please get in touch with Oliver Karras (oliver.karras@tib.eu)
