Tag: Workshop

I have written an editorial piece for the Swedish Pathogens Portal in which I reflect a bit on the upcoming EU legislation requiring monitoring of AMR in major wastewater treatment plants (1). I also veer a bit into where environmental monitoring outside of sewage may play a role, using our review paper resulting from EMBARK as the starting point (2).

This is timed to coincide with the registration deadlines for two upcoming workshops on AMR surveillance in the environment; the first being the DDLS Symposium on Data-Driven Environmental Monitoring of Infectious Disease on 7th-8th October in Uppsala, which I have been part of organising. The second is a workshop organised by CARe in Gothenburg on 28th October on the theme of sewage surveillance of antibiotic resistance, focusing on the new EU requirements.

My hope is that you will be a bit provoked by this and come to one of these workshops to discuss AMR surveillance and where to go next!

1. Bengtsson-Palme J: Surveillance of antimicrobial resistance – flying blind or flying behind? The Swedish Pathogens Portal, Editorial (2024). doi: 10.17044/scilifelab.27045433 [Link]
2. Bengtsson-Palme J, Abramova A, Berendonk TU, Coelho LP, Forslund SK, Gschwind R, Heikinheimo A, Jarquin-Diaz VH, Khan AA, Klümper U, Löber U, Nekoro M, Osińska AD, Ugarcina Perovic S, Pitkänen T, Rødland EK, Ruppé E, Wasteson Y, Wester AL, Zahra R: Towards monitoring of antimicrobial resistance in the environment: For what reasons, how to implement it, and what are the data needs? Environment International, 178, 108089 (2023). doi: 10.1016/j.envint.2023.108089 [Paper link]

The newly formed BIOCIDE program, seeking to determine how antibacterial biocides contribute to the development of biocide resistance and spread of antibiotic resistant bacteria, is organizing a workshop on risk assessment of biocide and antibiotic resistance on the 9th of March this year. I will be giving a talk on the BacMet database and how that will be integrated in risk assessment and the research program. If you have an interest in the risk associated with biocides, or antibiotic resistance development, I strongly suggest that you take part in this exciting workshop, particularly if you are working for a regulatory authority.

The program targets biocide resistance and cross-resistance to antibiotics, guidance development for assessment of biocide resistance, the BacMet biocide resistance database, and the assessment of environmental exposure to biocides and risks for co-selection. The workshop will include speakers such as Joakim Larsson, Nabila Haddache, Marlene Ågerstrand and Frank Schreiber.

More information can be found here: https://www.gu.se/en/biocide/risk-assessment-of-biocide-and-antibiotic-resistance

Since F1000Research uses a somewhat different publication scheme than most journals, I still haven’t understood if this paper is formally published after peer review, but I start to assume it is. There have been very little changes since the last version, so hence I will be lazy and basically repost what I wrote in April when the first version (the “preprint”) was posted online. The paper (1) is the result of a workshop arranged by the JRC in Italy in 2017. It describes various challenges arising from the process of designing a benchmark strategy for bioinformatics pipelines in the identification of antimicrobial resistance genes in next generation sequencing data.

The paper discusses issues about the benchmarking datasets used, testing samples, evaluation criteria for the performance of different tools, and how the benchmarking dataset should be created and distributed. Specially, we address the following questions:

• How should a benchmark strategy handle the current and expanding universe of NGS platforms?
• What should be the quality profile (in terms of read length, error rate, etc.) of in silico reference materials?
• Should different sets of reference materials be produced for each platform? In that case, how to ensure no bias is introduced in the process?
• Should in silico reference material be composed of the output of real experiments, or simulated read sets? If a combination is used, what is the optimal ratio?
• How is it possible to ensure that the simulated output has been simulated “correctly”?
• For real experiment datasets, how to avoid the presence of sensitive information?
• Regarding the quality metrics in the benchmark datasets (e.g. error rate, read quality), should these values be fixed for all datasets, or fall within specific ranges? How wide can/should these ranges be?
• How should the benchmark manage the different mechanisms by which bacteria acquire resistance?
• What is the set of resistance genes/mechanisms that need to be included in the benchmark? How should this set be agreed upon?
• Should datasets representing different sample types (e.g. isolated clones, environmental samples) be included in the same benchmark?
• Is a correct representation of different bacterial species (host genomes) important?
• How can the “true” value of the samples, against which the pipelines will be evaluated, be guaranteed?
• What is needed to demonstrate that the original sample has been correctly characterised, in case real experiments are used?
• How should the target performance thresholds (e.g. specificity, sensitivity, accuracy) for the benchmark suite be set?
• What is the impact of these performance thresholds on the required size of the sample set?
• How can the benchmark stay relevant when new resistance mechanisms are regularly characterized?
• How is the continued quality of the benchmark dataset ensured?
• Who should generate the benchmark resource?
• How can the benchmark resource be efficiently shared?

Of course, we have not answered all these questions, but I think we have come down to a decent description of the problems, which we see as an important foundation for solving these issues and implementing the benchmarking standard. Some of these issues were tackled in our review paper from last year on using metagenomics to study resistance genes in microbial communities (2). The paper also somewhat connects to the database curation paper we published in 2016 (3), although this time the strategies deal with the testing datasets rather than the actual databases. The paper is the first outcome of the workshop arranged by the JRC on “Next-generation sequencing technologies and antimicrobial resistance” held October 4-5 2017 in Ispra, Italy. You can find the paper here (it’s open access).

On another note, the new paper describing the UNITE database (4) has now got a formal issue assigned to it, as has the paper on tandem repeat barcoding in fungi published in Molecular Ecology Resources last year (5).

References and notes

1. Angers-Loustau A, Petrillo M, Bengtsson-Palme J, Berendonk T, Blais B, Chan KG, Coque TM, Hammer P, Heß S, Kagkli DM, Krumbiegel C, Lanza VF, Madec J-Y, Naas T, O’Grady J, Paracchini V, Rossen JWA, Ruppé E, Vamathevan J, Venturi V, Van den Eede G: The challenges of designing a benchmark strategy for bioinformatics pipelines in the identification of antimicrobial resistance determinants using next generation sequencing technologies. F1000Research, 7, 459 (2018). doi: 10.12688/f1000research.14509.1
2. Bengtsson-Palme J, Larsson DGJ, Kristiansson E: Using metagenomics to investigate human and environmental resistomes. Journal of Antimicrobial Chemotherapy, 72, 2690–2703 (2017). doi: 10.1093/jac/dkx199
3. Bengtsson-Palme J, Boulund F, Edström R, Feizi A, Johnning A, Jonsson VA, Karlsson FH, Pal C, Pereira MB, Rehammar A, Sánchez J, Sanli K, Thorell K: Strategies to improve usability and preserve accuracy in biological sequence databases. Proteomics, 16, 18, 2454–2460 (2016). doi: 10.1002/pmic.201600034
4. Nilsson RH, Larsson K-H, Taylor AFS, Bengtsson-Palme J, Jeppesen TS, Schigel D, Kennedy P, Picard K, Glöckner FO, Tedersoo L, Saar I, Kõljalg U, Abarenkov K: The UNITE database for molecular identification of fungi: handling dark taxa and parallel taxonomic classifications. Nucleic Acids Research, 47, D1, D259–D264 (2019). doi: 10.1093/nar/gky1022
5. Wurzbacher C, Larsson E, Bengtsson-Palme J, Van den Wyngaert S, Svantesson S, Kristiansson E, Kagami M, Nilsson RH: Introducing ribosomal tandem repeat barcoding for fungi. Molecular Ecology Resources, 19, 1, 118–127 (2019). doi: 10.1111/1755-0998.12944

The outcomes from a workshop arranged by JPIAMR, the Swedish Research Council (VR) and CARe were just published as a short review paper in Environment International. In the paper, which was mostly moved forward by Prof. Joakim Larsson at CARe, we describe four major areas of knowledge gaps in the realm of environmental antibiotic resistance (1). We then highlight several important sub-questions within these areas. The broad areas we define are:

• What are the relative contributions of different sources of antibiotics and antibiotic resistant bacteria into the environment?
• What is the role of the environment as affected by anthropogenic inputs (e.g. pollution and other activities) on the evolution (mobilization, selection, transfer, persistence etc.) of antibiotic resistance?
• How significant is the exposure of humans to antibiotic resistant bacteria via different environmental routes, and what is the impact on human health?
• What technological, social, economic and behavioral interventions are effective to mitigate the emergence and spread of antibiotic resistance via the environment?

Although much has been written on the topic before (e.g. 2-12), I think it is unique that we collect and explicitly point out areas in which we are lacking important knowledge to build accurate risk models and devise appropriate intervention strategies. The workshop was held in Gothenburg on the 27–28th of September 2017. The workshop leaders Joakim Larsson, Ana-Maria de Roda Husman and Ramanan Laxminarayan were each responsible for moderating a breakout group, and every breakout group was tasked to deal with knowledge gaps related to either evolution, transmission or interventions. The reports of the breakout groups were then discussed among all participants to clarify and structure the areas where more research is needed, which boiled down to the four overarching critical knowledge gaps described in the paper (1).

This is a short paper, and I think everyone with an interest in environmental antibiotic resistance should read it and reflect over its content (because, we may of course have overlooked some important aspect). You can find the paper here.

References

1. Larsson DGJ, Andremont A, Bengtsson-Palme J, Brandt KK, de Roda Husman AM, Fagerstedt P, Fick J, Flach C-F, Gaze WH, Kuroda M, Kvint K, Laxminarayan R, Manaia CM, Nielsen KM, Ploy M-C, Segovia C, Simonet P, Smalla K, Snape J, Topp E, van Hengel A, Verner-Jeffreys DW, Virta MPJ, Wellington EM, Wernersson A-S: Critical knowledge gaps and research needs related to the environmental dimensions of antibiotic resistance. Environment International, 117, 132–138 (2018). doi: 10.1016/j.envint.2018.04.041
2. Bengtsson-Palme J, Kristiansson E, Larsson DGJ: Environmental factors influencing the development and spread of antibiotic resistance. FEMS Microbiology Reviews, 42, 1, 68–80 (2018). doi: 10.1093/femsre/fux053
3. Martinez JL, Coque TM, Baquero F: What is a resistance gene? Ranking risk in resistomes. Nature Reviews Microbiology 2015, 13:116–123. doi:10.1038/nrmicro3399
4. Bengtsson-Palme J, Larsson DGJ: Antibiotic resistance genes in the environment: prioritizing risks. Nature Reviews Microbiology, 13, 369 (2015). doi: 10.1038/nrmicro3399-c1
5. Ashbolt NJ, Amézquita A, Backhaus T, Borriello P, Brandt KK, Collignon P, et al.: Human Health Risk Assessment (HHRA) for Environmental Development and Transfer of Antibiotic Resistance. Environmental Health Perspectives, 121, 993–1001 (2013)
6. Pruden A, Larsson DGJ, Amézquita A, Collignon P, Brandt KK, Graham DW, et al.: Management options for reducing the release of antibiotics and antibiotic resistance genes to the environment. Environmental Health Perspectives, 121, 878–85 (2013).
7. Gillings MR: Evolutionary consequences of antibiotic use for the resistome, mobilome and microbial pangenome. Frontiers in Microbiology, 4, 4 (2013).
8. Baquero F, Alvarez-Ortega C, Martinez JL: Ecology and evolution of antibiotic resistance. Environmental Microbiology Reports, 1, 469–476 (2009).
9. Baquero F, Tedim AP, Coque TM: Antibiotic resistance shaping multi-level population biology of bacteria. Frontiers in Microbiology, 4, 15 (2013).
10. Berendonk TU, Manaia CM, Merlin C et al.: Tackling antibiotic resistance: the environmental framework. Nature Reviews Microbiology, 13, 310–317 (2015).
11. Hiltunen T, Virta M, Laine A-L: Antibiotic resistance in the wild: an eco-evolutionary perspective. Philosophical Transactions of the Royal Society B: Biological Sciences, 372 (2017) doi: 10.1098/rstb.2016.0039.
12. Martinez JL: Bottlenecks in the transferability of antibiotic resistance from natural ecosystems to human bacterial pathogens. Frontiers in Microbiology, 2, 265 (2011).

This weekend, F1000Research put online the non-peer-reviewed version of the paper resulting from a workshop arranged by the JRC in Italy last year (1). (I will refer to this as a preprint, but at F1000Research the line is quite blurry between preprint and published paper.) The paper describes various challenges arising from the process of designing a benchmark strategy for bioinformatics pipelines (2) in the identification of antimicrobial resistance genes in next generation sequencing data.

The paper discusses issues about the benchmarking datasets used, testing samples, evaluation criteria for the performance of different tools, and how the benchmarking dataset should be created and distributed. Specially, we address the following questions:

• How should a benchmark strategy handle the current and expanding universe of NGS platforms?
• What should be the quality profile (in terms of read length, error rate, etc.) of in silico reference materials?
• Should different sets of reference materials be produced for each platform? In that case, how to ensure no bias is introduced in the process?
• Should in silico reference material be composed of the output of real experiments, or simulated read sets? If a combination is used, what is the optimal ratio?
• How is it possible to ensure that the simulated output has been simulated “correctly”?
• For real experiment datasets, how to avoid the presence of sensitive information?
• Regarding the quality metrics in the benchmark datasets (e.g. error rate, read quality), should these values be fixed for all datasets, or fall within specific ranges? How wide can/should these ranges be?
• How should the benchmark manage the different mechanisms by which bacteria acquire resistance?
• What is the set of resistance genes/mechanisms that need to be included in the benchmark? How should this set be agreed upon?
• Should datasets representing different sample types (e.g. isolated clones, environmental samples) be included in the same benchmark?
• Is a correct representation of different bacterial species (host genomes) important?
• How can the “true” value of the samples, against which the pipelines will be evaluated, be guaranteed?
• What is needed to demonstrate that the original sample has been correctly characterised, in case real experiments are used?
• How should the target performance thresholds (e.g. specificity, sensitivity, accuracy) for the benchmark suite be set?
• What is the impact of these performance thresholds on the required size of the sample set?
• How can the benchmark stay relevant when new resistance mechanisms are regularly characterized?
• How is the continued quality of the benchmark dataset ensured?
• Who should generate the benchmark resource?
• How can the benchmark resource be efficiently shared?

Of course, we have not answered all these questions, but I think we have come down to a decent description of the problems, which we see as an important foundation for solving these issues and implementing the benchmarking standard. Some of these issues were tackled in our review paper from last year on using metagenomics to study resistance genes in microbial communities (3). The paper also somewhat connects to the database curation paper we published in 2016 (4), although this time the strategies deal with the testing datasets rather than the actual databases. The paper is the first outcome of the workshop arranged by the JRC on “Next-generation sequencing technologies and antimicrobial resistance” held October 4-5 last year in Ispra, Italy. You can find the paper here (it’s open access).

References and notes

1. Angers-Loustau A, Petrillo M, Bengtsson-Palme J, Berendonk T, Blais B, Chan KG, Coque TM, Hammer P, Heß S, Kagkli DM, Krumbiegel C, Lanza VF, Madec J-Y, Naas T, O’Grady J, Paracchini V, Rossen JWA, Ruppé E, Vamathevan J, Venturi V, Van den Eede G: The challenges of designing a benchmark strategy for bioinformatics pipelines in the identification of antimicrobial resistance determinants using next generation sequencing technologies. F1000Research, 7, 459 (2018). doi: 10.12688/f1000research.14509.1
2. You may remember that I hate the term “pipeline” for bioinformatics protocols. I would have preferred if it was called workflows or similar, but the term “pipeline” has taken hold and I guess this is a battle where I have essentially lost. The bioinformatics workflows will be known as pipelines, for better and worse.
3. Bengtsson-Palme J, Larsson DGJ, Kristiansson E: Using metagenomics to investigate human and environmental resistomes. Journal of Antimicrobial Chemotherapy, 72, 2690–2703 (2017). doi: 10.1093/jac/dkx199
4. Bengtsson-Palme J, Boulund F, Edström R, Feizi A, Johnning A, Jonsson VA, Karlsson FH, Pal C, Pereira MB, Rehammar A, Sánchez J, Sanli K, Thorell K: Strategies to improve usability and preserve accuracy in biological sequence databases. Proteomics, 16, 18, 2454–2460 (2016). doi: 10.1002/pmic.201600034

MycoKeys earlier this week published a paper describing the results of a workshop in Aberdeen in April last year, where we refined annotations for fungal ITS sequences from the built environment (1). This was a follow-up on a workshop in May 2016 (2) and the results have been implemented in the UNITE database and shared with other online resources. The paper has also been highlighted at microBEnet. I have very little time to further comment on this at this very moment, but I believe, as I wrote last time, that distributed initiatives like this (and the ones I have been involved in in the past (3,4)) serve a very important purpose for establishing better annotation of sequence data (5). The full paper can be found here.

References

1. Nilsson RH, Taylor AFS, Adams RI, Baschien C, Bengtsson-Palme J, Cangren P, Coleine C, Daniel H-M, Glassman SI, Hirooka Y, Irinyi L, Iršenaite R, Martin-Sánchez PM, Meyer W, Oh S-O, Sampaio JP, Seifert KA, Sklenár F, Stubbe D, Suh S-O, Summerbell R, Svantesson S, Unterseher M, Visagie CM, Weiss M, Woudenberg J, Wurzbacher C, Van den Wyngaert S, Yilmaz N, Yurkov A, Kõljalg U, Abarenkov K: Annotating public fungal ITS sequences from the built environment according to the MIxS-Built Environment standard – a report from an April 10-11, 2017 workshop (Aberdeen, UK). MycoKeys, 28, 65–82 (2018). doi: 10.3897/mycokeys.28.20887 [Paper link]
2. Abarenkov K, Adams RI, Laszlo I, Agan A, Ambrioso E, Antonelli A, Bahram M, Bengtsson-Palme J, Bok G, Cangren P, Coimbra V, Coleine C, Gustafsson C, He J, Hofmann T, Kristiansson E, Larsson E, Larsson T, Liu Y, Martinsson S, Meyer W, Panova M, Pombubpa N, Ritter C, Ryberg M, Svantesson S, Scharn R, Svensson O, Töpel M, Untersehrer M, Visagie C, Wurzbacher C, Taylor AFS, Kõljalg U, Schriml L, Nilsson RH: Annotating public fungal ITS sequences from the built environment according to the MIxS-Built Environment standard – a report from a May 23-24, 2016 workshop (Gothenburg, Sweden). MycoKeys, 16, 1–15 (2016). doi: 10.3897/mycokeys.16.10000
3. Kõljalg U, Nilsson RH, Abarenkov K, Tedersoo L, Taylor AFS, Bahram M, Bates ST, Bruns TT, Bengtsson-Palme J, Callaghan TM, Douglas B, Drenkhan T, Eberhardt U, Dueñas M, Grebenc T, Griffith GW, Hartmann M, Kirk PM, Kohout P, Larsson E, Lindahl BD, Lücking R, Martín MP, Matheny PB, Nguyen NH, Niskanen T, Oja J, Peay KG, Peintner U, Peterson M, Põldmaa K, Saag L, Saar I, Schüßler A, Senés C, Smith ME, Suija A, Taylor DE, Telleria MT, Weiß M, Larsson KH: Towards a unified paradigm for sequence-based identification of Fungi. Molecular Ecology, 22, 21, 5271–5277 (2013). doi: 10.1111/mec.12481
4. Nilsson RH, Hyde KD, Pawlowska J, Ryberg M, Tedersoo L, Aas AB, Alias SA, Alves A, Anderson CL, Antonelli A, Arnold AE, Bahnmann B, Bahram M, Bengtsson-Palme J, Berlin A, Branco S, Chomnunti P, Dissanayake A, Drenkhan R, Friberg H, Frøslev TG, Halwachs B, Hartmann M, Henricot B, Jayawardena R, Jumpponen A, Kauserud H, Koskela S, Kulik T, Liimatainen K, Lindahl B, Lindner D, Liu J-K, Maharachchikumbura S, Manamgoda D, Martinsson S, Neves MA, Niskanen T, Nylinder S, Pereira OL, Pinho DB, Porter TM, Queloz V, Riit T, Sanchez-García M, de Sousa F, Stefaczyk E, Tadych M, Takamatsu S, Tian Q, Udayanga D, Unterseher M, Wang Z, Wikee S, Yan J, Larsson E, Larsson K-H, Kõljalg U, Abarenkov K: Improving ITS sequence data for identification of plant pathogenic fungi. Fungal Diversity, 67, 1, 11–19 (2014). doi: 10.1007/s13225-014-0291-8
5. Bengtsson-Palme J, Boulund F, Edström R, Feizi A, Johnning A, Jonsson VA, Karlsson FH, Pal C, Pereira MB, Rehammar A, Sánchez J, Sanli K, Thorell K: Strategies to improve usability and preserve accuracy in biological sequence databases. Proteomics, Early view (2016). doi: 10.1002/pmic.201600034

In March, I attended a workshop on the role of NGS technologies in the coordinated action plan against antimicrobial resistance, organised by JRC in Italy. I was, together with 14 other experts, invited to discuss where and how sequencing can be used to investigate and manage antibiotic resistance. The report from the workshop has just recently been published, and is available here. There will be follow-up activities on this workshop, which I also hope that I will be able to participate in, since this is an important and very interesting pet topic of mine.

Reference

I am part of the organizing committee for the newly invented annual meeting for GOTBIN – the Gothenburg Bioinformatics Network. We will arrange a meeting on December 6 to get the networking activities for 2017 kickstarted, and every bioinformatician in Gothenburg is invited!

GOTBIN was launched to bridge and bring together all researchers in Gothenburg who fully or partially dealt with bioinformatics in their research. Through the network it should be possible to quickly find other local researchers tackling the same research problems as you are; to find appropriate resources to run your analyses; and to discuss research or infrastructure problems as they arise. To keep the network alive and kicking, it is crucial to keep relations active. Furthermore, it is also crucial to interact with key persons in the GOTBIN network to keep the lists of active researchers, resources and discussion forums up to date.

To facilitate future communication, we invite everyone who works with bioinformatics in Gothenburg to participate in a get-together workshop. The purpose of this workshop is to find out who is working with what and where, and to better get to know each other. This is a great opportunity to meet your next collaboration partner, post-doc or supervisor! The event will take place in Birgit Thilander at Medicinareberget (just next to the large lecture hall Arvid Carlsson) on December 6th, from 9.00 to 12.00. Fika will be provided and we will arrange ice-breaker activities suitable for the number of participants, so please register at: https://goo.gl/forms/KYdiiZMBDf0F9hvp2 by the 16th of November.

We hope to find everyone with a research interest in bioinformatics there and that this will be the launch of the next era of GOTBIN in 2017! See you there!

I just want to highlight that the paper on strategies to improve database accuracy and usability we recently published in Proteomics (1) has been included in their most recent issue, which is a special issue focusing on Data Quality Issues in Proteomics. I highly recommend reading our paper (of course) and many of the other in the special issue. Happy reading!

On another note, I will be giving a talk next Wednesday (October 5th) on a seminar day on next generation sequencing in clinical microbiology, titled “Antibiotic resistance in the clinic and the environment – There and back again“. You are very welcome to the lecture hall at floor 3 in our building at Guldhedsgatan 10A here in Gothenburg if you are interested! (Bear in mind though that it all starts at 8.15 in the morning.)

Finally, it seems that I am going to the Next Generation Sequencing Congress in London this year, which will be very fun! Hope to see some of you dealing with sequencing there!

References

1. Bengtsson-Palme J, Boulund F, Edström R, Feizi A, Johnning A, Jonsson VA, Karlsson FH, Pal C, Pereira MB, Rehammar A, Sánchez J, Sanli K, Thorell K: Strategies to improve usability and preserve accuracy in biological sequence databases. Proteomics, 16, 18, 2454–2460 (2016). doi: 10.1002/pmic.201600034 [Paper link]

MycoKeys today put a paper online which I was involved in. The paper describes the results of a workshop in May, when we added and refined annotations for fungal ITS sequences according to the MIxS-Built Environment annotation standard (1). Fungi have been associated with a range of unwanted effects in the built environment, including asthma, decay of building materials, and food spoilage. However, the state of the metadata annotation of fungal DNA sequences from the built environment is very much incomplete in public databases. The workshop aimed to ease a little part of this problem, by distributing the re-annotation of public fungal ITS sequences across 36 persons. In total, we added or changed of 45,488 data points drawing from published literature, including addition of 8,430 instances of countries of collection, 5,801 instances of building types, and 3,876 instances of surface-air contaminants. The results have been implemented in the UNITE database and shared with other online resources. I believe, that distributed initiatives like this (and the ones I have been involved in in the past (2,3)) serve a very important purpose for establishing better annotation of sequence data, an issue I have brought up also for sequences outside of barcoding genes (4). The full paper can be found here.

References

1. Abarenkov K, Adams RI, Laszlo I, Agan A, Ambrioso E, Antonelli A, Bahram M, Bengtsson-Palme J, Bok G, Cangren P, Coimbra V, Coleine C, Gustafsson C, He J, Hofmann T, Kristiansson E, Larsson E, Larsson T, Liu Y, Martinsson S, Meyer W, Panova M, Pombubpa N, Ritter C, Ryberg M, Svantesson S, Scharn R, Svensson O, Töpel M, Untersehrer M, Visagie C, Wurzbacher C, Taylor AFS, Kõljalg U, Schriml L, Nilsson RH: Annotating public fungal ITS sequences from the built environment according to the MIxS-Built Environment standard – a report from a May 23-24, 2016 workshop (Gothenburg, Sweden). MycoKeys, 16, 1–15 (2016). doi: 10.3897/mycokeys.16.10000
2. Kõljalg U, Nilsson RH, Abarenkov K, Tedersoo L, Taylor AFS, Bahram M, Bates ST, Bruns TT, Bengtsson-Palme J, Callaghan TM, Douglas B, Drenkhan T, Eberhardt U, Dueñas M, Grebenc T, Griffith GW, Hartmann M, Kirk PM, Kohout P, Larsson E, Lindahl BD, Lücking R, Martín MP, Matheny PB, Nguyen NH, Niskanen T, Oja J, Peay KG, Peintner U, Peterson M, Põldmaa K, Saag L, Saar I, Schüßler A, Senés C, Smith ME, Suija A, Taylor DE, Telleria MT, Weiß M, Larsson KH: Towards a unified paradigm for sequence-based identification of Fungi. Molecular Ecology, 22, 21, 5271–5277 (2013). doi: 10.1111/mec.12481
3. Nilsson RH, Hyde KD, Pawlowska J, Ryberg M, Tedersoo L, Aas AB, Alias SA, Alves A, Anderson CL, Antonelli A, Arnold AE, Bahnmann B, Bahram M, Bengtsson-Palme J, Berlin A, Branco S, Chomnunti P, Dissanayake A, Drenkhan R, Friberg H, Frøslev TG, Halwachs B, Hartmann M, Henricot B, Jayawardena R, Jumpponen A, Kauserud H, Koskela S, Kulik T, Liimatainen K, Lindahl B, Lindner D, Liu J-K, Maharachchikumbura S, Manamgoda D, Martinsson S, Neves MA, Niskanen T, Nylinder S, Pereira OL, Pinho DB, Porter TM, Queloz V, Riit T, Sanchez-García M, de Sousa F, Stefaczyk E, Tadych M, Takamatsu S, Tian Q, Udayanga D, Unterseher M, Wang Z, Wikee S, Yan J, Larsson E, Larsson K-H, Kõljalg U, Abarenkov K: Improving ITS sequence data for identification of plant pathogenic fungi. Fungal Diversity, 67, 1, 11–19 (2014). doi: 10.1007/s13225-014-0291-8
4. Bengtsson-Palme J, Boulund F, Edström R, Feizi A, Johnning A, Jonsson VA, Karlsson FH, Pal C, Pereira MB, Rehammar A, Sánchez J, Sanli K, Thorell K: Strategies to improve usability and preserve accuracy in biological sequence databases. Proteomics, Early view (2016). doi: 10.1002/pmic.201600034