DAIRYdb added to Metaxa2
Last week, I uploaded a new database to the Metaxa2 Database Repository, called DAIRYdb. DAIRYdb (1) is a manually curated reference database for 16S rRNA amplicon sequences from dairy products. Significant efforts have been put into improving annotation algorithms, such as Metaxa2 (2), while less attention has been put into curation of reliable and consistent databases (3). Previous studies have shown that databases restricted to the studied environment improve unambiguous taxonomy annotation to the species level, thanks to consistent taxonomy, lack of blanks and reduced competition between different reference taxonomies (4-5). The usage of DAIRYdb in combination with different classification tools allows taxonomy annotation accuracy of over 90% at species level for microbiome samples from dairy products, where species identification is mandatory due to the affiliation to few closely related genera of most dominant lactic acid bacteria.
The database can be added to your Metaxa2 (version 2.2 or later) installation by using the following command:
metaxa2_install_database -g SSU_DAIRYdb_v1.1.2
Further adaptations of the DAIRYdb can be found on GitHub and the preprint has been deposited in BioRxiv (1). DAIRYdb was developed by Marco Meola, Etienne Rifa and their collaborators, who also provided most of the text for this post. Thanks Marco for this excellent addition to the database collection!
References
- Meola M, Rifa E, Shani N, Delbes C, Berthoud H, Chassard C: DAIRYdb: A manually curated gold standard reference database for improved taxonomy annotation of 16S rRNA gene sequences from dairy products. bioRxiv, 386151 (2018). doi: 10.1101/386151
- Bengtsson-Palme J, Hartmann M, Eriksson KM, Pal C, Thorell K, Larsson DGJ, Nilsson RH: Metaxa2: Improved identification and taxonomic classification of small and large subunit rRNA in metagenomic data. Molecular Ecology Resources, 15, 6, 1403–1414 (2015). doi: 10.1111/1755-0998.12399
- Edgar RC: Accuracy of taxonomy prediction for 16S rRNA and fungal ITS sequences. PeerJ, 6, e4652 (2018). doi: 10.7717/peerj.4652
- Ritari J, Salojärvi J, Last L, de Vos WM: Improved taxonomic assignment of human intestinal 16S rRNA sequences by a dedicated reference database. BMC Genomics, 16, 1, 1056 (2015). doi: 10.1186/s12864-015-2265-y
- Newton ILG, Roeselers G: The effect of training set on the classification of honey bee gut microbiota using the naïve bayesian classifier. BMC Microbiology, 12, 1, 221 (2012). doi: 10.1186/1471-2180-12-221
Published paper: The global topsoil microbiome
I’m really late at this ball for a number of reasons, but last week Nature published our paper on the structure and function of the global topsoil microbiome (1). This paper has a long story, but in short I got contacted by Mohammad Bahram (the first author) about two years ago about a project using metagenomic sequencing to look at a lot of soil samples for patterns of antibiotic resistance gene abundances and diversity. The project had made the interesting discovery that resistance gene abundances were linked to the ratio of fungi and bacteria (so that more fungi was linked to more resistance genes). During the following year, we together worked on deciphering these discoveries, which are now published in Nature. The paper also deals with the taxonomic patterns linked to geography (1), but as evident from the above, my main contribution here has been on the antibiotic resistance side.
In short, we find that:
- Bacterial diversity is highest in temperate habitats, and lower both closer to the equator and the poles
- For bacteria, the diversity of biological functions follows the same pattern, but for fungi, the functional diversity is higher closer to the poles and the equator
- Higher abundance of fungi is linked to higher abundance and diversity of antibiotic resistance genes. Specifically, this is related to known antibiotic producing fungal lineages, such as Penicillium and Oidiodendron. There also seems to be a link between the Actinobacteria, encompassing the antibiotic-producing bacterial genus of Streptomyces and higher resistance gene diversity.
- Similar relationships between the fungus-like Oomycetes and resistance genes was also found in ocean samples from the Tara Oceans project (2)
The results of this study indicate that both environmental filtering and niche differentiation determine soil microbial composition, and that the role of dispersal limitation is minor at this scale. Soil pH and precipitation seems to be the strongest drivers of community composition. Furthermore, we interpret our data to reveal that inter-kingdom antagonism is important in structuring microbial communities. This speaks against the notion put forward that antibiotic resistance genes might not have a resistance function in natural settings (3). That said, the most likely explanation here is probably a bit of both warfare and repurposing of genes. Soil seems to be the largest untapped source of resistance genes for human pathogens (4), and the finding that natural antagonism may be driving resistance gene diversification and enrichment may be important for future management of environmental antibiotic resistance (5,6).
It was really great to work with Mohammad and his team, and I sure hope that we will collaborate again in the future. The entire paper can be found in the issue of Nature coming out this week, and is already online at Nature’s website.
References
- Bahram M°, Hildebrand F°, Forslund SK, Anderson JL, Soudzilovskaia NA, Bodegom PM, Bengtsson-Palme J, Anslan S, Coelho LP, Harend H, Huerta-Cepas J, Medema MH, Maltz MR, Mundra S, Olsson PA, Pent M, Põlme S, Sunagawa S, Ryberg M, Tedersoo L, Bork P: Structure and function of the global topsoil microbiome. Nature, 560, 233–237 (2018). doi: 10.1038/s41586-018-0386-6
- Sunagawa S et al. Structure and function of the global ocean microbiome. Science 348, 6237, 1261359 (2015). doi: 10.1126/science.1261359
- Aminov RI: The role of antibiotics and antibiotic resistance in nature. Environmental Microbiology, 11, 12, 2970-2988 (2009). doi: 10.1111/j.1462-2920.2009.01972.x
- Bengtsson-Palme J: The diversity of uncharacterized antibiotic resistance genes can be predicted from known gene variants – but not always. Microbiome, 6, 125 (2018). doi: 10.1186/s40168-018-0508-2
- Bengtsson-Palme J, Kristiansson E, Larsson DGJ: Environmental factors influencing the development and spread of antibiotic resistance. FEMS Microbiology Reviews, 42, 1, 68–80 (2018). doi: 10.1093/femsre/fux053
- Larsson DGJ, Andremont A, Bengtsson-Palme J, Brandt KK, de Roda Husman AM, Fagerstedt P, Fick J, Flach C-F, Gaze WH, Kuroda M, Kvint K, Laxminarayan R, Manaia CM, Nielsen KM, Ploy M-C, Segovia C, Simonet P, Smalla K, Snape J, Topp E, van Hengel A, Verner-Jeffreys DW, Virta MPJ, Wellington EM, Wernersson A-S: Critical knowledge gaps and research needs related to the environmental dimensions of antibiotic resistance. Environment International, 117, 132–138 (2018).
Published paper: Predicting the uncharacterized resistome
Over the weekend, Microbiome put online my most recent paper (1) – a project which started as an idea I got when I finished up my PhD thesis in 2016. One of my main points in the thesis (2), which was also made again on our recent review on environmental factors influencing resistance development (3), is that the greatest risks associated with antibiotic resistance in the environment may not be the resistance genes already circulating in pathogens (which are relatively easily quantified), but the ones associated with recruitment of novel resistance genes from bacteria in the environment (2-4). The latter genes are, however, impossible to quantify due to the fact that they are unknown. But what if we could use knowledge of the diversity and abundance of known resistance genes to estimate the same properties of the yet uncharacterized resistome? That would be a great advantage in e.g. ranking of risk environments, as then some property that is easily monitored can be used to inform risk management of both known and unknown resistance factors.
This just published paper explores this possibility, by quantifying the abundance and diversity of resistance genes in 1109 metagenomes from various environments (1). I have taken two different approaches. First, I took out smaller subsets of genes from the reference database (in this case Resqu, a database of antibiotic resistance genes with verified resistance functions, detected on mobile genetic elements), and used those subsets to estimate resistome diversity and abundance in the 1109 metagenomes. Then these predictions were compared to the results of the entire database. I then, in a second step, investigated if these predictions could be extended to a set of truly novel resistance genes, i.e. the resistance genes present in the FARME database, collecting data from functional metagenomics inserts (5,6).
The results show that generally the diversity and abundance of known antibiotic resistance genes can be used to predict the same properties of undescribed resistance genes (see figure above). However, the extent of this predictability is, importantly, dependent on the type of environment investigated. The study also shows that carefully selected small sets of resistance genes can describe total resistance gene diversity remarkably well. This means that knowledge gained from large-scale quantifications of known resistance genes can be utilized as a proxy for unknown resistance factors. This is important for current and proposed monitoring efforts for environmental antibiotic resistance (7-11) and has implications for the design of risk ranking strategies and the choices of measures and methods for describing resistance gene abundance and diversity in the environment.
The study also investigated which diversity measures were best suited to estimate total diversity. Surprisingly, some diversity measures described the total diversity of resistance genes remarkably bad. Most prominently, the Simpson diversity index consistently showed poor performance, and while the Shannon index performed relatively better, there is still no reason to select the Shannon index over normalized (rarefied) richness of resistance genes. The ACE estimator fluctuated substantially compared to the other diversity measures, while the Chao1 estimator more consistently showed performance very similar to richness. Therefore, either richness or the Chao1 estimator should be used for ranking resistance gene diversity, while the Shannon, Simpson, and ACE measures should be avoided.
Importantly, this study implies that the recruitment of novel antibiotic resistance genes from the environment to human pathogens is essentially random. Therefore, when ranking risks associated with antibiotic resistance in environmental settings, the knowledge gained from large-scale quantification of known resistance genes can be utilized as a proxy for the unknown resistance factors (although this proxy is not perfect). Thus, high-risk environments for resistance development and dissemination would, for example, be aquaculture, animal husbandry, discharges from antibiotic manufacturing, and untreated sewage (3,8,12-15). Further attention should probably be paid to antibiotic contaminated soils, as this study points to soils as a vast source of resistance genes not yet encountered in human pathogens. This has also been suggested previously by others (16-19). The results of this study can be used to guide monitoring efforts for environmental antibiotic resistance, to design risk ranking strategies, and to choose appropriate measures and methods for describing resistance gene abundance and diversity in the environment. The entire open access paper is available here.
References
- Bengtsson-Palme J: The diversity of uncharacterized antibiotic resistance genes can be predicted from known gene variants – but not always. Microbiome, 6, 125 (2018). doi: 10.1186/s40168-018-0508-2
- Bengtsson-Palme J: Antibiotic resistance in the environment: a contribution from metagenomic studies. Doctoral thesis (medicine), Department of Infectious Diseases, Institute of Biomedicine, Sahlgrenska Academy, University of Gothenburg, 2016. [Link]
- Bengtsson-Palme J, Kristiansson E, Larsson DGJ: Environmental factors influencing the development and spread of antibiotic resistance. FEMS Microbiology Reviews, 42, 1, 68–80 (2018). doi: 10.1093/femsre/fux053
- Bengtsson-Palme J, Larsson DGJ: Antibiotic resistance genes in the environment: prioritizing risks. Nature Reviews Microbiology, 13, 369 (2015). doi: 10.1038/nrmicro3399-c1
- Wallace JC, Port JA, Smith MN, Faustian EM: FARME DB: a functional antibiotic resistance element database. Database, 2017, baw165 (2017).
- Handelsman J, Rondon MR, Brady SF, Clardy J, Goodman RM: Molecular biological access to the chemistry of unknown soil microbes: a new frontier for natural products. Chemical Biology, 5, R245–249 (1998).
- Berendonk TU, Manaia CM, Merlin C, Fatta-Kassinos D, Cytryn E, Walsh F, et al.: Tackling antibiotic resistance: the environmental framework. Nature Reviews Microbiology, 13, 310–317 (2015).
- Pruden A, Larsson DGJ, Amézquita A, Collignon P, Brandt KK, Graham DW, et al.: Management options for reducing the release of antibiotics and antibiotic resistance genes to the environment. Environmental Health Perspectives, 121, 878–885 (2013).
- Review on Antimicrobial Resistance: Antimicrobials in agriculture and the environment: reducing unnecessary use and waste. O’Neill J, ed. London: Wellcome Trust & HM Government (2015).
- Angers-Loustau A, Petrillo M, Bengtsson-Palme J, Berendonk T, Blais B, Chan KG, Coque TM, Hammer P, Heß S, Kagkli DM, Krumbiegel C, Lanza VF, Madec J-Y, Naas T, O’Grady J, Paracchini V, Rossen JWA, Ruppé E, Vamathevan J, Venturi V, Van den Eede G: The challenges of designing a benchmark strategy for bioinformatics pipelines in the identification of antimicrobial resistance determinants using next generation sequencing technologies. F1000Research, 7, 459 (2018). doi: 10.12688/f1000research.14509.1
- Larsson DGJ, Andremont A, Bengtsson-Palme J, Brandt KK, de Roda Husman AM, Fagerstedt P, Fick J, Flach C-F, Gaze WH, Kuroda M, Kvint K, Laxminarayan R, Manaia CM, Nielsen KM, Ploy M-C, Segovia C, Simonet P, Smalla K, Snape J, Topp E, van Hengel A, Verner-Jeffreys DW, Virta MPJ, Wellington EM, Wernersson A-S: Critical knowledge gaps and research needs related to the environmental dimensions of antibiotic resistance. Environment International, 117, 132–138 (2018). doi: 10.1016/j.envint.2018.04.041
- Allen HK, Donato J, Wang HH, Cloud-Hansen KA, Davies J, Handelsman J: Call of the wild: antibiotic resistance genes in natural environments. Nature Reviews Microbiology, 8, 251–259 (2010).
- Graham DW, Collignon P, Davies J, Larsson DGJ, Snape J: Underappreciated role of regionally poor water quality on globally increasing antibiotic resistance. Environmental Science & Technology, 48,11746–11747 (2014).
- Larsson DGJ: Pollution from drug manufacturing: review and perspectives. Philosophical Transactions of the Royal Society of London, Series B Biological Sciences, 369, 20130571 (2014).
- Cabello FC, Godfrey HP, Buschmann AH, Dölz HJ: Aquaculture as yet another environmental gateway to the development and globalisation of antimicrobial resistance. Lancet Infectious Diseases, 16, e127–133 (2016).
- Forsberg KJ, Reyes A, Wang B, Selleck EM, Sommer MOA, Dantas G: The shared antibiotic resistome of soil bacteria and human pathogens. Science, 337, 1107–1111 (2012).
- Allen HK, Moe LA, Rodbumrer J, Gaarder A, Handelsman J: Functional metagenomics reveals diverse beta-lactamases in a remote Alaskan soil. ISME Journal, 3, 243–251 (2009).
- Riesenfeld CS, Goodman RM, Handelsman J: Uncultured soil bacteria are a reservoir of new antibiotic resistance genes. Environmental Microbiology, 6, 981–989 (2004).
- McGarvey KM, Queitsch K, Fields S: Wide variation in antibiotic resistance proteins identified by functional metagenomic screening of a soil DNA library. Applied and Environmental Microbiology, 78, 1708–1714 (2012).
Published paper: A Metaxa2 database for the arthropod COI locus
A few days ago I posted about that Bioinformatics had published our paper on the Metaxa2 Database Builder (1). Today, I am happy to report that PeerJ has published the first paper in which the database builder is used to create a new Metaxa2 (2) database! My colleagues at Ohio State University has used the software to build a database for the COI gene (3), which is commonly used in arthropod barcoding. The used region was extracted from COI sequences from arthropod whole mitochondrion genomes, and employed to create a database containing sequences from all major arthropod clades, including all insect orders, all arthropod classes and the Onychophora, Tardigrada and Mollusca outgroups.
Similar to what we did in our evaluation of taxonomic classifiers used on non-rRNA barcoding regions (4), we performed a cross-validation analysis to characterize the relationship between the Metaxa2 reliability score, an estimate of classification confidence, and classification error probability. We used this analysis to select a reliability score threshold which minimized error. We then estimated classification sensitivity, false discovery rate and overclassification, the propensity to classify sequences from taxa not represented in the reference database.
Since the database builder was still in its early inception stages when we started doing this work, the software itself saw several improvements because of this project. We believe that our work on the COI database, as well as on the recently released database builder software, will help researchers in designing and evaluating classification databases for metabarcoding on arthropods and beyond. The database is included in the new Metaxa2 2.2 release, and is also downloadable from the Metaxa2 Database Repository (1). The open access paper can be found here.
References
- Bengtsson-Palme J, Richardson RT, Meola M, Wurzbacher C, Tremblay ED, Thorell K, Kanger K, Eriksson KM, Bilodeau GJ, Johnson RM, Hartmann M, Nilsson RH: Metaxa2 Database Builder: Enabling taxonomic identification from metagenomic and metabarcoding data using any genetic marker. Bioinformatics, advance article (2018). doi: 10.1093/bioinformatics/bty482
- Bengtsson-Palme J, Hartmann M, Eriksson KM, Pal C, Thorell K, Larsson DGJ, Nilsson RH: Metaxa2: Improved identification and taxonomic classification of small and large subunit rRNA in metagenomic data. Molecular Ecology Resources, 15, 6, 1403–1414 (2015). doi: 10.1111/1755-0998.12399
- Richardson RT, Bengtsson-Palme J, Gardiner MM, Johnson RM: A reference cytochrome c oxidase subunit I database curated for hierarchical classification of arthropod metabarcoding data. PeerJ, 6, e5126 (2018). doi: 10.7717/peerj.5126
- Richardson RT, Bengtsson-Palme J, Johnson RM: Evaluating and Optimizing the Performance of Software Commonly Used for the Taxonomic Classification of DNA Sequence Data. Molecular Ecology Resources, 17, 4, 760–769 (2017). doi: 10.1111/1755-0998.12628
Published paper: Selective concentrations for ciprofloxacin
My colleagues in Gothenburg have published a new paper in Environment International, in which I was involved in the bioinformatics analyses. In the paper, for which Nadine Kraupner did the lion’s share of the work, we establish minimal selective concentrations (MSCs) for resistance to the antibiotic ciprofloxacin in Escherichia coli grown in complex microbial communities (1). We also determine the community responses at the taxonomic and resistance gene levels. Nadine has made use of Sara Lundström’s aquarium system (2) to grow biofilms in the exposure of sublethal levels of antibiotics. Using the system, we find that 1 μg/L ciprofloxacin selects for the resistance gene qnrD, while 10 μg/L ciprofloxacin is required to detect changes of phenotypic resistance. In short, the different endpoints studied (and their corresponding MSCs) were:
- CFU counts from test tubes, grown on R2A plates with 2 mg/L ciprofloxain – MSC = 5 μg/L
- CFU counts from aquaria, grown on R2A plates with 0.25 or 2 mg/L ciprofloxain – MSC = 10 μg/L
- Chromosomal resistance mutations – MSC ~ 10 μg/L
- Increased resistance gene abundances, metagenomics – MSC range: 1 μg/L
- Changes to taxonomic diversity – 1 µg/L
- Changes to taxonomic community composition – MSC ~ 1-10 μg/L
We have previously reported a predicted no-effect concentration for resistance of 0.064 µg/L for ciprofloxacin (3), which corresponds fairly well with the MSCs determined experimentally here, being around a factor of ten off. However, we cannot exclude that in other experimental systems, the selective effects of ciprofloxacin could be even lower and thus the predicted PNEC may still be relevant. The selective concentrations we report for ciprofloxacin are close to those that have been reported in sewage treatment plants (3-5), suggesting the possibility for weak selection of resistance. Several recent reports have underscored the need to populate the this far conceptual models for resistance development in the environment with actual numbers (6-10). Determining selective concentrations for different antibiotics in actual community settings is an important step on the road towards building accurate quantitative models for resistance emergence and propagation.
References
- Kraupner N, Ebmeyer S, Bengtsson-Palme J, Fick J, Kristiansson E, Flach C-F, Larsson DGJ: Selective concentration for ciprofloxacin in Escherichia coli grown in complex aquatic bacterial biofilms. Environment International, 116, 255–268 (2018). doi: 10.1016/j.envint.2018.04.029 [Paper link]
- Lundström SV, Östman M, Bengtsson-Palme J, Rutgersson C, Thoudal M, Sircar T, Blanck H, Eriksson KM, Tysklind M, Flach C-F, Larsson DGJ: Minimal selective concentrations of tetracycline in complex aquatic bacterial biofilms. Science of the Total Environment, 553, 587–595 (2016). doi: 10.1016/j.scitotenv.2016.02.103 [Paper link]
- Bengtsson-Palme J, Larsson DGJ: Concentrations of antibiotics predicted to select for resistant bacteria: Proposed limits for environmental regulation. Environment International, 86, 140-149 (2016). doi: 10.1016/j.envint.2015.10.015
- Michael I, Rizzo L, McArdell CS, Manaia CM, Merlin C, Schwartz T, Dagot C, Fatta-Kassinos D: Urban wastewater treatment plants as hotspots for the release of antibiotics in the environment: a review. Water Research, 47, 957–995 (2013). doi:10.1016/j.watres.2012.11.027
- Bengtsson-Palme J, Hammarén R, Pal C, Östman M, Björlenius B, Flach C-F, Kristiansson E, Fick J, Tysklind M, Larsson DGJ: Elucidating selection processes for antibiotic resistance in sewage treatment plants using metagenomics. Science of the Total Environment, 572, 697–712 (2016). doi: 10.1016/j.scitotenv.2016.06.228
- Ågerstrand M, Berg C, Björlenius B, Breitholtz M, Brunstrom B, Fick J, Gunnarsson L, Larsson DGJ, Sumpter JP, Tysklind M, Rudén C: Improving environmental risk assessment of human pharmaceuticals. Environmental Science and Technology (2015). doi:10.1021/acs.est.5b00302
- Bengtsson-Palme J, Kristiansson E, Larsson DGJ: Environmental factors influencing the development and spread of antibiotic resistance. FEMS Microbiology Reviews, 42, 1, 68–80 (2018). doi: 10.1093/femsre/fux053
- Joint Programming Initiative on Antimicrobial Resistance: JPIAMR Workshop on Environmental Dimensions of AMR: Summary and recommendations. JPIAMR (2017). [Link]
- Angers A, Petrillo P, Patak, A, Querci M, Van den Eede G: The Role and Implementation of Next-Generation Sequencing Technologies in the Coordinated Action Plan against Antimicrobial Resistance. JRC Conference and Workshop Report, EUR 28619 (2017). doi: 10.2760/745099
- Larsson DGJ, Andremont A, Bengtsson-Palme J, Brandt KK, de Roda Husman AM, Fagerstedt P, Fick J, Flach C-F, Gaze WH, Kuroda M, Kvint K, Laxminarayan R, Manaia CM, Nielsen KM, Ploy M-C, Segovia C, Simonet P, Smalla K, Snape J, Topp E, van Hengel A, Verner-Jeffreys DW, Virta MPJ, Wellington EM, Wernersson A-S: Critical knowledge gaps and research needs related to the environmental dimensions of antibiotic resistance. Environment International, in press (2018). doi: 10.1016/j.envint.2018.04.041
New preprint: benchmarking resistance gene identification
This weekend, F1000Research put online the non-peer-reviewed version of the paper resulting from a workshop arranged by the JRC in Italy last year (1). (I will refer to this as a preprint, but at F1000Research the line is quite blurry between preprint and published paper.) The paper describes various challenges arising from the process of designing a benchmark strategy for bioinformatics pipelines (2) in the identification of antimicrobial resistance genes in next generation sequencing data.
The paper discusses issues about the benchmarking datasets used, testing samples, evaluation criteria for the performance of different tools, and how the benchmarking dataset should be created and distributed. Specially, we address the following questions:
- How should a benchmark strategy handle the current and expanding universe of NGS platforms?
- What should be the quality profile (in terms of read length, error rate, etc.) of in silico reference materials?
- Should different sets of reference materials be produced for each platform? In that case, how to ensure no bias is introduced in the process?
- Should in silico reference material be composed of the output of real experiments, or simulated read sets? If a combination is used, what is the optimal ratio?
- How is it possible to ensure that the simulated output has been simulated “correctly”?
- For real experiment datasets, how to avoid the presence of sensitive information?
- Regarding the quality metrics in the benchmark datasets (e.g. error rate, read quality), should these values be fixed for all datasets, or fall within specific ranges? How wide can/should these ranges be?
- How should the benchmark manage the different mechanisms by which bacteria acquire resistance?
- What is the set of resistance genes/mechanisms that need to be included in the benchmark? How should this set be agreed upon?
- Should datasets representing different sample types (e.g. isolated clones, environmental samples) be included in the same benchmark?
- Is a correct representation of different bacterial species (host genomes) important?
- How can the “true” value of the samples, against which the pipelines will be evaluated, be guaranteed?
- What is needed to demonstrate that the original sample has been correctly characterised, in case real experiments are used?
- How should the target performance thresholds (e.g. specificity, sensitivity, accuracy) for the benchmark suite be set?
- What is the impact of these performance thresholds on the required size of the sample set?
- How can the benchmark stay relevant when new resistance mechanisms are regularly characterized?
- How is the continued quality of the benchmark dataset ensured?
- Who should generate the benchmark resource?
- How can the benchmark resource be efficiently shared?
Of course, we have not answered all these questions, but I think we have come down to a decent description of the problems, which we see as an important foundation for solving these issues and implementing the benchmarking standard. Some of these issues were tackled in our review paper from last year on using metagenomics to study resistance genes in microbial communities (3). The paper also somewhat connects to the database curation paper we published in 2016 (4), although this time the strategies deal with the testing datasets rather than the actual databases. The paper is the first outcome of the workshop arranged by the JRC on “Next-generation sequencing technologies and antimicrobial resistance” held October 4-5 last year in Ispra, Italy. You can find the paper here (it’s open access).
References and notes
- Angers-Loustau A, Petrillo M, Bengtsson-Palme J, Berendonk T, Blais B, Chan KG, Coque TM, Hammer P, Heß S, Kagkli DM, Krumbiegel C, Lanza VF, Madec J-Y, Naas T, O’Grady J, Paracchini V, Rossen JWA, Ruppé E, Vamathevan J, Venturi V, Van den Eede G: The challenges of designing a benchmark strategy for bioinformatics pipelines in the identification of antimicrobial resistance determinants using next generation sequencing technologies. F1000Research, 7, 459 (2018). doi: 10.12688/f1000research.14509.1
- You may remember that I hate the term “pipeline” for bioinformatics protocols. I would have preferred if it was called workflows or similar, but the term “pipeline” has taken hold and I guess this is a battle where I have essentially lost. The bioinformatics workflows will be known as pipelines, for better and worse.
- Bengtsson-Palme J, Larsson DGJ, Kristiansson E: Using metagenomics to investigate human and environmental resistomes. Journal of Antimicrobial Chemotherapy, 72, 2690–2703 (2017). doi: 10.1093/jac/dkx199
- Bengtsson-Palme J, Boulund F, Edström R, Feizi A, Johnning A, Jonsson VA, Karlsson FH, Pal C, Pereira MB, Rehammar A, Sánchez J, Sanli K, Thorell K: Strategies to improve usability and preserve accuracy in biological sequence databases. Proteomics, 16, 18, 2454–2460 (2016). doi: 10.1002/pmic.201600034
Published paper: Annotating fungi from the built environment part II
MycoKeys earlier this week published a paper describing the results of a workshop in Aberdeen in April last year, where we refined annotations for fungal ITS sequences from the built environment (1). This was a follow-up on a workshop in May 2016 (2) and the results have been implemented in the UNITE database and shared with other online resources. The paper has also been highlighted at microBEnet. I have very little time to further comment on this at this very moment, but I believe, as I wrote last time, that distributed initiatives like this (and the ones I have been involved in in the past (3,4)) serve a very important purpose for establishing better annotation of sequence data (5). The full paper can be found here.
References
- Nilsson RH, Taylor AFS, Adams RI, Baschien C, Bengtsson-Palme J, Cangren P, Coleine C, Daniel H-M, Glassman SI, Hirooka Y, Irinyi L, Iršenaite R, Martin-Sánchez PM, Meyer W, Oh S-O, Sampaio JP, Seifert KA, Sklenár F, Stubbe D, Suh S-O, Summerbell R, Svantesson S, Unterseher M, Visagie CM, Weiss M, Woudenberg J, Wurzbacher C, Van den Wyngaert S, Yilmaz N, Yurkov A, Kõljalg U, Abarenkov K: Annotating public fungal ITS sequences from the built environment according to the MIxS-Built Environment standard – a report from an April 10-11, 2017 workshop (Aberdeen, UK). MycoKeys, 28, 65–82 (2018). doi: 10.3897/mycokeys.28.20887 [Paper link]
- Abarenkov K, Adams RI, Laszlo I, Agan A, Ambrioso E, Antonelli A, Bahram M, Bengtsson-Palme J, Bok G, Cangren P, Coimbra V, Coleine C, Gustafsson C, He J, Hofmann T, Kristiansson E, Larsson E, Larsson T, Liu Y, Martinsson S, Meyer W, Panova M, Pombubpa N, Ritter C, Ryberg M, Svantesson S, Scharn R, Svensson O, Töpel M, Untersehrer M, Visagie C, Wurzbacher C, Taylor AFS, Kõljalg U, Schriml L, Nilsson RH: Annotating public fungal ITS sequences from the built environment according to the MIxS-Built Environment standard – a report from a May 23-24, 2016 workshop (Gothenburg, Sweden). MycoKeys, 16, 1–15 (2016). doi: 10.3897/mycokeys.16.10000
- Kõljalg U, Nilsson RH, Abarenkov K, Tedersoo L, Taylor AFS, Bahram M, Bates ST, Bruns TT, Bengtsson-Palme J, Callaghan TM, Douglas B, Drenkhan T, Eberhardt U, Dueñas M, Grebenc T, Griffith GW, Hartmann M, Kirk PM, Kohout P, Larsson E, Lindahl BD, Lücking R, Martín MP, Matheny PB, Nguyen NH, Niskanen T, Oja J, Peay KG, Peintner U, Peterson M, Põldmaa K, Saag L, Saar I, Schüßler A, Senés C, Smith ME, Suija A, Taylor DE, Telleria MT, Weiß M, Larsson KH: Towards a unified paradigm for sequence-based identification of Fungi. Molecular Ecology, 22, 21, 5271–5277 (2013). doi: 10.1111/mec.12481
- Nilsson RH, Hyde KD, Pawlowska J, Ryberg M, Tedersoo L, Aas AB, Alias SA, Alves A, Anderson CL, Antonelli A, Arnold AE, Bahnmann B, Bahram M, Bengtsson-Palme J, Berlin A, Branco S, Chomnunti P, Dissanayake A, Drenkhan R, Friberg H, Frøslev TG, Halwachs B, Hartmann M, Henricot B, Jayawardena R, Jumpponen A, Kauserud H, Koskela S, Kulik T, Liimatainen K, Lindahl B, Lindner D, Liu J-K, Maharachchikumbura S, Manamgoda D, Martinsson S, Neves MA, Niskanen T, Nylinder S, Pereira OL, Pinho DB, Porter TM, Queloz V, Riit T, Sanchez-García M, de Sousa F, Stefaczyk E, Tadych M, Takamatsu S, Tian Q, Udayanga D, Unterseher M, Wang Z, Wikee S, Yan J, Larsson E, Larsson K-H, Kõljalg U, Abarenkov K: Improving ITS sequence data for identification of plant pathogenic fungi. Fungal Diversity, 67, 1, 11–19 (2014). doi: 10.1007/s13225-014-0291-8
- Bengtsson-Palme J, Boulund F, Edström R, Feizi A, Johnning A, Jonsson VA, Karlsson FH, Pal C, Pereira MB, Rehammar A, Sánchez J, Sanli K, Thorell K: Strategies to improve usability and preserve accuracy in biological sequence databases. Proteomics, Early view (2016). doi: 10.1002/pmic.201600034
New beta brings major Metaxa2 updates
I am very happy to announce that a first public beta version of Metaxa2 version 2.2 has been released today! This new version brings two big and a number of small improvements to the Metaxa2 software (1). The first major addition is the introduction of the Metaxa2 Database Builder, which allows the user to create custom databases for virtually any genetic barcoding region. The second addition, which is related to the first, is that the classifier has been rewritten to have a more solid mathematical foundation. I have been promising that these updates were coming “soon” for one and a half years, but finally the end-product is good enough to see some real world testing. Bear in mind though that this is still a beta version that could contain obscure bugs. Here follows a list of new features (with further elaboration on a few below):
- The Metaxa2 Database Builder
- Support for additional barcoding genes, virtually any genetic region can now be used for taxonomic classification in Metaxa2
- The Metaxa2 database repository, which can be accessed through the new metaxa2_install_database tool
- Improved classification scoring model for better clarity and sensitivity
- A bundled COI database for athropods, showing off the capabilities of the database builder
- Support for compressed input files (gzip, zip, bzip, dsrc)
- Support for auto-detection of database locations
- Added output of probable taxonomic origin for sequences with reliability scores at each rank, made possible by the updated classifier
- Added the -x option for running only the extraction without the classification step
- Improved memory handling for very large rRNA datasets in the classifier (millions of sequences)
- This update also fixes a bug in the metaxa2_rf tool that could cause bias in very skewed datasets with small numbers of taxa
The new version of Metaxa2 can be downloaded here, and for those interested I will spend the rest of this post outlining the Metaxa2 Database Builder. The information below is also available in a slightly extended version in the software manual.
The major enhancement in Metaxa2 version 2.2 is the ability to use custom databases for classification. This means that the user can now make their own database for their own barcoding region of choice, or download additional databases from the Metaxa2 Database Repository. The selection of other databases is made through the “-g” option already existing in Metaxa2. As part of these changes, we have also updated the classification scoring model for better stringency and sensitivity across multiple databases and different genes. The old scoring system can still be used by specifying the –scoring_model option to “old”.
There are two different main operating modes of the Metaxa2 Database Builder, as well as a hybrid mode combining the features of the two other modes. The divergent and conserved modes work in almost completely different ways and deal with two different types of barcoding regions. The divergent mode is designed to deal with barcoding regions that exhibit fairly large variation between taxa within the same taxonomic domain. Such regions include, e.g., the eukaryotic ITS region, or the trnL gene used for plant barcoding. In the other mode – the conserved mode – a highly conserved barcoding region is expected (at least within the different taxonomic domains). Genes that fall into this category would be, e.g., the 16S SSU rRNA, and the bacterial rpoB gene. This option would most likely also be suitable for barcoding within certain groups of e.g. plants, where similarity of the barcoding regions can be expected to be high. There is also a third mode – the hybrid mode – that incorporates features of both the other. The hybrid mode is more experimental in nature, but could be useful in situations where both the other modes perform poorer than desired.
In the divergent (default) mode, the database builder will start by clustering the input sequences at 20% identity using USEARCH (2). All clusters generated from this process are then individually aligned using MAFFT (3). Those alignments are split into two regions, which are used to build two hidden Markov models for each cluster of sequences. These models will be less precise, but more sensitive than those generated in the conserved mode. In the divergent mode, the database builder will attempt to extract full-length sequences from the input data, but this may be less successful than in the conserved mode.
In the conserved mode, on the other hand, the database builder will first extract the barcoding region from the input sequences using models built from a reference sequence provided (see above) and the Metaxa2 extractor (1). It will then align all the extracted sequences using MAFFT and determine the conservation of each position in the alignment. When the criteria for degree of conservation are met, all conserved regions are extracted individually and are then re-aligned separately using MAFFT. The re-aligned sequences are used to build hidden Markov models representing the conserved regions with HMMER (4). In this mode, the classification database will only consist of the extracted full-length sequences.
In the hybrid mode, finally, the database builder will cluster the input sequences at 20% identity using USEARCH, and then proceed with the conserved mode approach on each cluster separately .
The actual taxonomic classification in Metaxa2 is done using a sequence database. It was shown in the original Metaxa2 paper that replacing the built-in database with a generic non-processed one was detrimental to performance in terms of accuracy (1). In the database builder, we have tried to incorporate some of the aspects of the manual database curation we did for the built-in database that can be automated. By default, all these filtration steps are turned off, but enabling them might drastically increase the accuracy of classifications based on the database.
To assess the accuracy of the constructed database, the Metaxa2 Database Builder allows for testing the detection ability and classification accuracy of the constructed database. This is done by sub-dividing the database sequences into subsets and rebuilding the database using a smaller (by default 90%), randomly selected, set of the sequence data (5). The remaining sequences (10% by default) are then classified using Metaxa2 with the subset database. The number of detections, and the numbers of correctly or incorrectly classified entries are recorded and averaged over a number of iterations (10 by default). This allows for obtaining a picture of the lower end of the accuracy of the database. However, since the evaluation only uses a subset of all sequences included in the full database, the performance of the full database actually constructed is likely to be slightly better. The evaluation can be turned on using the “–evaluate T” option.
Metaxa2 2.2 also introduces the database repository, from which the user can download additional databases for Metaxa2. To download new databases from the repository, the metaxa2_install_database command is used. This is a simple piece of software but requires internet access to function.
References
- Bengtsson-Palme J, Hartmann M, Eriksson KM, Pal C, Thorell K, Larsson DGJ, Nilsson RH: Metaxa2: Improved Identification and Taxonomic Classification of Small and Large Subunit rRNA in Metagenomic Data. Molecular Ecology Resources (2015). doi: 10.1111/1755-0998.12399 [Paper link]
- Edgar RC: Search and clustering orders of magnitude faster than BLAST. Bioinformatics, 26, 2460–2461 (2010).
- Katoh K, Standley DM: MAFFT multiple sequence alignment software version 7: improvements in performance and usability. Molecular Biology and Evolution, 30, 772–780 (2013).
- Eddy SR: Accelerated profile HMM searches. PLoS Computational Biology, 7, e1002195 (2011).
- Richardson RT, Bengtsson-Palme J, Johnson RM: Evaluating and Optimizing the Performance of Software Commonly Used for the Taxonomic Classification of DNA Sequence Data. Molecular Ecology Resources, 17, 4, 760–769 (2017). doi: 10.1111/1755-0998.12628
Published paper: Blastocystis and the intestinal microbiota
Yesterday, BMC Microbiology published a paper which I have co-authored with Joakim Forsell and his colleagues in at Umeå University. The paper (1) investigates the prevalence and subtype composition of Blastocystis – a eukaryotic microbe commonly present in the human intestine – among the 35 Swedish university students that we investigated for antibiotic resistance before and after travel to the Indian peninsula or Central Africa using shotgun metagenomics, and published in 2015 (2). In this paper, we used the same metagenomic data, but to assess the impact of travel on Blastocystis carriage and to understand the associations between Blastocystis and the bacterial gut microbiota. We found that 46% of the students carried Blastocystis before travel and 43% after. The two most commonly identified Blastocystis subtypes were ST3 and ST4, accounting for 20 of the 31 samples positive for Blastocystis. Interestingly, we detected no mixed subtype carriage in any individual, and all the ten individuals with a typable subtype before and after travel maintained their initial subtype.
Furthermore, we found that the composition of the gut bacterial community was not significantly altered between Blastocystis-carriers and non-carriers. Curiously, Blastocystis was accompanied with higher abundances of the bacterial genera Sporolactobacillus and Candidatus Carsonella. As perviously observed (3), Blastocystis carriage was positively associated with higher bacterial genus richness, and negatively correlated to the Bacteroides-driven enterotype. We, however, took this observation further, and could show that these associations were both largely driven by ST4 – a subtype commonly described in Europe – while the globally prevalent ST3 did not show such significant relationships.
The persistence of Blastocystis subtypes before and after travel indicates that long-term carriage of Blastocystis is common. The associations between Blastocystis and the bacterial microbiota found in this study could imply a link between Blastocystis and a healthy microbiota, as well as with diets high in vegetables. However, we cannot answer whether the associations between Blastocystis and the microbiota are resulting from the presence of Blastocystis per se, or are a prerequisite for colonization with Blastocystis, which are interesting opportunities for follow-up studies.
I think this type of data reuse for completely different questions is highly useful, and I am very happy that Joakim Forsell and his colleagues contacted me to hear if it was possible to do a Blastocystis screen of this data. The full paper can be read here.
References
- Forsell J, Bengtsson-Palme J, Angelin M, Johansson A, Evengård B, Granlund M: The relation between Blastocystis and the intestinal microbiota in Swedish travellers. BMC Microbiology, 17, 231 (2017). doi: 10.1186/s12866-017-1139-7 [Paper link]
- Bengtsson-Palme J, Angelin M, Huss M, Kjellqvist S, Kristiansson E, Palmgren H, Larsson DGJ, Johansson A: The human gut microbiome as a transporter of antibiotic resistance genes between continents. Antimicrobial Agents and Chemotherapy, 59, 10, 6551–6560 (2015). doi: 10.1128/AAC.00933-15 [Paper link]
- Andersen LO, Bonde I, Nielsen HB, Stensvold CR: A retrospective metagenomics approach to studying Blastocystis. FEMS Microbiology Ecology, 91, fiv072 (2015). doi: 10.1093/femsec/fiv072 [Paper link]
Published paper: 76 new metallo-beta-lactamases
Today, Microbiome put online a paper lead-authored by my colleague Fanny Berglund – one of Erik Kristiansson‘s brilliant PhD students – in which we identify 76 novel metallo-ß-lactamases (1). This feat was made possible because of a new computational method designed by Fanny, which uses a hidden Markov model based on known B1 metallo-ß-lactamases. We analyzed over 10,000 bacterial genomes and plasmids and over 5 terabases of metagenomic data and could thereby predict 76 novel genes. These genes clustered into 59 new families of metallo-β-lactamases (given a 70% identity threshold). We also verified the functionality of 21 of these genes experimentally, and found that 18 were able to hydrolyze imipenem when inserted into Escherichia coli. Two of the novel genes contained atypical zinc-binding motifs in their active sites. Finally, we show that the B1 metallo-β-lactamases can be divided into five major groups based on their phylogenetic origin. It seems that nearly all of the previously characterized mobile B1 β-lactamases we identify in this study were likely to have originated from chromosomal genes present in species within the Proteobacteria, particularly Shewanella spp.
This study more than doubles the number of known B1 metallo-β-lactamases. As with the study by Boulund et al. (2) which we published last month on computational discovery of novel fluoroquinolone resistance genes (which used a very similar approach but on a completely different type of genes), this study also supports the hypothesis that environmental bacterial communities act as sources of uncharacterized antibiotic resistance genes (3-7). Fanny have done a fantastic job on this paper, and I highly recommend reading it in its entirety (it’s open access so you have virtually no excuse not to). It can be found here.
References
- Berglund F, Marathe NP, Österlund T, Bengtsson-Palme J, Kotsakis S, Flach C-F, Larsson DGJ, Kristiansson E: Identification of 76 novel B1 metallo-β-lactamases through large-scale screening of genomic and metagenomic data. Microbiome, 5, 134 (2017). doi: 10.1186/s40168-017-0353-8
- Boulund F, Berglund F, Flach C-F, Bengtsson-Palme J, Marathe NP, Larsson DGJ, Kristiansson E: Computational discovery and functional validation of novel fluoroquinolone resistance genes in public metagenomic data sets. BMC Genomics, 18, 682 (2017). doi: 10.1186/s12864-017-4064-0
- Bengtsson-Palme J, Larsson DGJ: Antibiotic resistance genes in the environment: prioritizing risks. Nature Reviews Microbiology, 13, 369 (2015). doi: 10.1038/nrmicro3399-c1
- Allen HK, Donato J, Wang HH et al.: Call of the wild: antibiotic resistance genes in natural environments. Nature Reviews Microbiology, 8, 251–259 (2010).
- Berendonk TU, Manaia CM, Merlin C et al.: Tackling antibiotic resistance: the environmental framework. Nature Reviews Microbiology, 13, 310–317 (2015).
- Martinez JL: Bottlenecks in the transferability of antibiotic resistance from natural ecosystems to human bacterial pathogens. Frontiers in Microbiology, 2, 265 (2011).
- Finley RL, Collignon P, Larsson DGJ et al.: The scourge of antibiotic resistance: the important role of the environment. Clinical Infectious Diseases, 57, 704–710 (2013).