Sample

“To identify articles about teaching Open Science I used the following search strings: “teaching open science” OR teaching “open science” OR teach „open science“. The topic search looked for the search strings in title, abstract and keywords of articles. Since these are very narrow search terms, I decided to broaden the method. I searched in the reference lists of all articles that appear from this search for further relevant literature. Using Google Scholar I checked which other authors cited the articles in the sample. If the so checked articles met my methodological criteria, I included them in the sample and looked through the reference lists and citations at Google Scholar. This process has not yet been completed.”
The following criteria were crucial for the selection of further articles from the reference lists:
  1. Focus on teaching.
  2. At least one aspect of Open Science has to be addressed and had to be related to open science. Therefore, I searched the articles for the following words, which I took from the “Fair Principles” (https://www.go-fair.org/fair-principles/), and read the respective passages: re-use, reuse, open, free, accessible, share and fair. This means, for example, I included an article when it deals with the use of FOSS in class and addresses the aspects of openness of FOSS. I did not include articles when the authors describe the use of a particular free and open source software for teaching but did not address the principles of openness or re-use.
  3. Language: I only include English and German articles in the sample, as I speak these languages – but articles in other languages are very welcome, if there are people who can interpret them!
  4. Type of literature: In the sample only journal articles, articles in edited volumes, working papers and conference papers from proceedings were included.
  5. I checked whether the journals were predatory journals – such articles were not included. For checking I used the list of predatory journals (https://predatoryjournals.com/journals/)
  6. I did not include blogposts, books or articles from newspapers.
  7. I only included articles that fulltexts are accessible via my institution (University of Kassel). As a result, recently published articles at Elsevier could not be included because of the special situation in Germany regarding the Project DEAL (https://www.projekt-deal.de/about-deal/). For articles that are not freely accessible, I have checked whether there is an accessible version in a repository or whether preprint is available. If this was not the case, the article was not included.
  8. I started the analysis in May 2019.
  9. All articles found so far can be viewed here: https://www.zotero.org/groups/2359061/teaching_open_science
  10. It is not yet a completed process, as I have not yet checked all of the reference lists.
What do you think about the sample and the creation of the sample? Should we continue under these parameters? If not, what is your alternative suggestion?
If we continue, it is crucial that several persons of you evaluate my selection. That means looking at the references of texts and select which articles he/she would include in the sample. Then we have to check how big the differences are.
We have to decide when to stop searching.
And we have to decide how we analyse the content of the articles in the sample to generate the systematic review (or an other article).
Kwok: I suggest for papers that you cannot access (like from elsevier) to be written up in a list, and then regularly updated so that others can help download it. 
Max: See my answer above. I feel we might need to use additional search strings.
Tobias: See above for +1 re broadening the search scope
Olmo: Yes, I think it would be good to make a list of open science practices that we want to investigate and use those search terms specifically (e.g., preregistration, open access, etc.). Also, we might need some synonyms to "teaching" like "educating" or "training"
Tarandeep:  I have recently enrolled at the University of Durham, and I’m in the process of setting up my IT credentials which will be completed in the next couple of weeks. I will then have access to many  articles behind a pay wall, and will be happy to help you  download them.  I am of the opinion that new advances in open source software can be central to the teaching of open source principles (for example the jazz project at the University about the I am of the opinion that new advances in open source software that is central to the teaching of open source principles (for example the JASP project at the University  of Amsterdam to encourage the use of Bayes) and we might therefore want to make this a section in the review. Isabel, I’m aware that wasn’t your original plan, what does everybody else think? If it’s a terrible idea please let me know!