ZooKeys 365: 279–305, doi: 10.3897/zookeys.365.5819
Half of the European fruit fly species barcoded (Diptera, Tephritidae); a feasibility test for molecular identification
John Smit 1, Bastian Reijnen 2, Frank Stokvis 2
1 European Invertebrate Survey – the Netherlands, P.O. Box 9517, 2300 RA, Leiden, the Netherlands
2 Naturalis Biodiversity Centre, P.O. Box 9517, 2300 RA Leiden, the Netherlands

Corresponding author: John Smit (john.smit@naturalis.nl)

Academic editor: Z. T. Nagy

received 18 June 2013 | accepted 18 October 2013 | Published 30 December 2013


(C) 2013 John Smit. This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.


For reference, use of the paginated PDF or printed version of this article is recommended.

Citation: Smit J, Reijnen B, Stokvis F (2013) Half of the European fruit fly species barcoded (Diptera, Tephritidae); a feasibility test for molecular identification. In: Nagy ZT, Backeljau T, De Meyer M, Jordaens K (Eds) DNA barcoding: a practical tool for fundamental and applied biodiversity research. ZooKeys 365: 279–305. doi: 10.3897/zookeys.365.5819

Abstract

A feasibility test of molecular identification of European fruit flies (Diptera: Tephritidae) based on COI barcode sequences has been executed. A dataset containing 555 sequences of 135 ingroup species from three subfamilies and 42 genera and one single outgroup species has been analysed. 73.3% of all included species could be identified based on their COI barcode gene, based on similarity and distances. The low success rate is caused by singletons as well as some problematic groups: several species groups within the genus Terellia and especially the genus Urophora. With slightly more than 100 sequences – almost 20% of the total – this genus alone constitutes the larger part of the failure for molecular identification for this dataset. Deleting the singletons and Urophora results in a success-rate of 87.1% of all queries and 93.23% of the not discarded queries as correctly identified. Urophora is of special interest due to its economic importance as beneficial species for weed control, therefore it is desirable to have alternative markers for molecular identification.

We demonstrate that the success of DNA barcoding for identification purposes strongly depends on the contents of the database used to BLAST against. Especially the necessity of including multiple specimens per species of geographically distinct populations and different ecologies for the understanding of the intra- versus interspecific variation is demonstrated. Furthermore thresholds and the distinction between true and false positives and negatives should not only be used to increase the reliability of the success of molecular identification but also to point out problematic groups, which should then be flagged in the reference database suggesting alternative methods for identification.

Keywords

COI, DNA barcoding, reference database

Introduction

Tephritidae, or true fruit flies, are a large group of flies (Diptera) with some 4 500 species described (Norrbom et al. 1999). The majority of the species are phytophagous. About 35% of them attack soft fruits, including many commercial crops, and some 250 species are considered mild to severe pests (White and Elson-Harris 1992, McPheron and Steck 1996). On the other hand some 40% attack flower heads of or induce galls on Asteraceae, some of which are considered beneficial for the control of invasive weeds outside their natural range (White et al. 1990, White and Elson-Harris 1992, Turner 1996).

Among the economically important taxa five genera have been listed on the quarantine list of the European Union: Anastrepha Schiner, 1868, Bactrocera Macquart, 1835, Ceratitis Macleay, 1829, Dacus Fabricius, 1805 and Rhagoletis Loew, 1862 (Annex IAI of the Council Directive 2000/29/EC). Most species within these genera are notoriously difficult to identify, therefore the genera are placed on the quarantine list as a whole, despite the fact that not all are pest species. Interceptions on commercial products almost always concern larvae, which are next to impossible to identify. Moreover the number of species that can attack a specific host plant is unknown and the geographic ranges of many species are poorly documented. Therefore there is a desperate need for an alternative method for unambiguous identification of these Tephritid species, especially among plant protection organizations. Hebert et al. (2003) proposed a molecular identification based on a 658 base pair region sequence of the cytochrome c oxidase subunit I gene of the mitochondrial DNA (mtDNA), the so-called DNA barcode region (partial COI or CoxI gene). Their proposal for the use of the barcoding gene for a molecular identification system initiated the Consortium of the Barcoding of Life (CBOL) in 2004 (http://www.barcoding.si.edu/AboutCBOL.htm). CBOL’s aim is to explore and develop the potential of DNA barcoding for research as a practical tool for species identification. One of the pilot projects was the Tephritid Barcoding Initiative (TBI) with the ambitious aim of gathering barcodes of some 2000 species of fruit flies, focusing mainly on pest and beneficial species. Several studies have been published over the last decade comparing COI sequence datasets with morphological ones for identification purposes among fruit flies, most of which focused on a single genus or a species group within a genus or at most a few closely related genera (Smith-Caldas et al. 2001, Barr et al. 2006, Boykin et al. 2006, Schutze et al. 2007, Nakahara and Muraj 2008, Virgilio et al. 2008, Kohnen et al. 2009, Zhang et al. 2010, Jackson et al. 2011). Virgilio et al. (2012) are the only ones testing DNA barcoding on an extensive dataset of fruit flies, comparable to ours it contains 602 sequences of 153 species. However, it still covers only a limited part of the family, for all species belong to just 10 genera and all are of the same subfamily.

In our study we chose a different approach: instead of focussing on certain species groups or genera, we sequenced as many European species that we could get a hold of, including multiple specimens from distinct geographical populations for as many species as possible. This generated a dataset containing 555 sequences of half of the European species; 124 of the approximately 240 (Smit 2010), from all three subfamilies that are present on the continent. As a result the feasibility of DNA barcoding as an identification tool could be tested over a wide range of species within the family, meanwhile providing a significant contribution to the COI dataset of the Tephritid barcoding database based on morphologically identified specimens. Additional aims were to shed some light on the amount of inter- versus intraspecific variation over a large dataset of fruit fly species belonging to various tribes from different subfamilies as well as testing the phylogenetic signal within the COI barcoding gene.

Material and methods
Specimen acquisition

Data on the voucher specimens are provided in Appendix. The vast majority of specimens was collected throughout Europe in 2009 (n = 494). Specimens were directly stored in ethanol 96%. Some of the older material, collected before 2009, has been either directly collected in ethanol 96% (n = 23) or was collected with a Malaise trap (ethanol 70%) and later transferred to ethanol 96% (n = 38).

The oldest material included in this study is from 1999, collected in Kyrgyzstan by Valery Korneyev; this material was stored in 70% ethanol until DNA extraction and amplification. Of the 18 specimens collected, only four resulted in full barcode sequences, hence these are the only ones included in the dataset.

We have included up to eight specimens from geographically distinct populations in order to test the intraspecific variation for as many species as possible. However, we were unable to obtain more than one specimen for a number of species, whereas we have included between 9 and 15 specimens for species with uncertain taxonomy due to species complexes or host races (Table 1). For Chaetostomella cylindrica (Robineau-Desvoidy, 1830) we included 23 specimens in order to cover as much of the host races as possible (Knio et al. 2007, Smith et al. 2009).

Table 1.

The number of species with their range of specimens included in our dataset.

Specimens per species No. species
1 41
2–8 78
9–15 15
> 15 1

The dataset contains 13 specimens of 11 species originating from Peru, some of which have their congeners among European taxa. These were added to see whether these more distant related taxa have any affect the molecular identification of a dataset of primarily European species. Thus adding a second geographical scale, besides multiple populations per species.

Additionally one outgroup specimen from the closely related family Ulidiidae was used to root the tree: Ulidia nigripennis Loew, 1845.

The dataset includes 554 sequences of 135 ingroup species from three different subfamilies and 42 genera and one outgroup sequence.

DNA extraction and amplification

One or two legs per specimen were used for genomic DNA extraction using the 96 wells Qiagen DNeasy Blood and Tissue Kit with a modified protocol. Due to the small size of the legs the tissue was manually ground with a disposable pestle in a 1.5 ml tube. The lysate was transferred to 96 well plates. Elution was performed in 50 µl elution buffer. 658 bp products were amplified using PCR primers LCO1490 and HCO2198 (Folmer et al. 1994) in most specimens. Amplification failed in some specimens therefore different primer sets were developed based on the full mitochondrial genomes of Bactrocera oleae (Rossi, 1790) (GU108464) and Ceratitis capitata (Wiedemann, 1824) (AJ242872) obtained from GenBank. Primers can be found in Table 2, their corresponding positions within the COI region are depicted in Figure 1.

Figure 1.

Primer positions within the COI region.

Table 2.

Primer pairs used for amplification of the COI marker.

Primer name Primer sequence Length (in bp)
L1490 (Folmer et al. 1994) 5’ - GGTCAACAAATCATAAAGATATTGG - 3’ 658
H2198 (Folmer et al. 1994) 5’ - TAAACTTCAGGGTGACCAAAAAATCA - 3’
TEP_F2 5’ - TAGGAGCAGTAAATTTTAT - 3’ (+H2198) 211
TEP_R2 5’ - CAAAAACTTATATTATTTAT - 3’ (+L1490) 241
TEP_F4 5’ - ATTATAATTGGAGGATTTGG - 3’ 268
TEP_R4 5’ - GTAATTCCTGTTGATCGTATATTAAT - 3’
TEPCOIF 5’ - TAAACTTCAGCCATTTAATC - 3’ 777
TEPCOIR 5’ - TTTTCCTGATTCTTGTCTAA - 3’

The 25 μl PCR reaction mixes contained 18.75 μl of ddH2O, 2.5 μl of 10 × CoralLoad PCR Buffer (Qiagen), 1 μl of each primer (10 pM), 1.25 U of Taq DNA Polymerase (Qiagen), 0.5 μl of dNTP’s and 1 μl of DNA template. The amplification protocol consisted of 3 min at 94 °C followed by 40 to 50 cycles of 15 s at 94 °C, 30 s at 60 °C to 35 °C and 40 s at, 72 °C and a final 5 min at 72 °C.

Direct sequencing was performed at Macrogen, Korea on a ABI 3730XL sequencer.

Data analysis

Sequences recovered did not contain any insertions, deletions, or stop codons. 555 specimens representing 136 different species from various geographical locations were included in the dataset, resulting in a final alignment of 554 ingroup taxa and a single outgroup. Sequences were assembled and adjusted with Sequencher v4.10.1 (Gene Codes Corp.). Bioedit version v7.0.9.0 (Hall 1999) was used to align the sequences and MacClade version v4.08 (Maddison and Maddison 2000) was used to check for stopcodons. All sequence data, additional geographic and ecological data as well as photographs of the specimens were uploaded to the BOLD database, which ID codes are included in Appendix.

Molecular identification

The Neighbour-Joining analyses were performed using MEGA5 (Tamura et al. 2011). Distance analysis was conducted using the Kimura 2-parameter model (K2P) (Kimura 1980), and will simply be referred to as distance. The values given in brackets after the mean distance are ranges. The number of informative nucleotide characters in the dataset was 302. Success of the NJ tree-based identification (NJT) is assessed as described Hebert et al. (2003); i.e., sequences were considered successfully identified as long as they formed species-specific clusters. Species with sequences at multiple positions in the tree were considered misidentifications and singletons were counted as ambiguous. Second we used the revised criteria (NJT_M) as described by Meier et al. (2006); where identification is considered successful when a sequence is found at least one node into a cluster of exclusively conspecific sequences or in a polytomy with conspecifics. Species with sequences at least one node into an allospecific cluster or polytomy of allospecific sequences are considered misidentifications. Singletons, sequences as a sister group to conspecifics as well as sequences within a polytomy with at least one conspecific and allospecific sequence are considered ambiguous.

Additional to the tree-based identification we used an identification based on direct sequence comparison by using each sequence as a query to all other sequences in the dataset. SpeciesIdentifier v1.7.8 (Meier et al. 2006) was used to calculate distances, to find the closest barcode match and to determine the threshold value below which 95% of all intraspecific distances are found. The identification criteria used are ‘Best Match’ (BM) and ‘Best Close Match’ (BCM) as described by Meier et al. (2006). The identification is considered successful in BM when the closest match is from the same species. When the species are different it is considered a misidentification. Several equally good best matches from more than one species is considered ambiguous. In BCM the criteria are the same as BM, but the results have to fall within the 95th percentile of all intraspecific distances.

Finally we included the “All species barcodes” (ASB) criteria as described by Meier et al. (2006). This analyses uses the same threshold as used in BCM and identifications were only considered successful when all conspecific sequences top the list of best matches. When at least one allospecific sequence is more similar than the least similar conspecific sequence identification is considered ambiguous, if the query is more similar to all sequences from another species it is considered a misidentification.

Virgilio et al. (2012) introduced a method to improve the accuracy of the interpretation of the success-rates by distinguishing between true and false positives and negatives. True positives (TP) are the queries that have been correctly identified and are below the threshold value, false positives (FP) are incorrectly identified and below the threshold value. True negatives (TN) are correctly rejected because they are misidentified and above the threshold value, false negatives (FN) are correctly identified queries that are rejected because their distance is above the threshold value. Distinguishing these categories allows statements on the accuracy ((TP+TN/n.queries), precision (TP/(TP+FP)), overall ID error ((FP+FN)/n.queries) and relative ID error (FP/(TP+FP)), see Virgilio et al. (2012). These values are assessed for the dataset at hand.

Results
DNA extraction and amplification

The DNA of the majority of the specimens could be amplified with the standard PCR primers (Folmer et al. 1994). However, 23 out of the 555 samples needed alternative primers (Table 2). Nearly half only needed one alternative primer (Table 3), whereas others, like the Kyrgyzstan material, needed a cocktail of primers and the amplification protocol needed adjustment as given above.

Table 3.

The species for which alternative primers have been used for DNA amplification.

Taxon (no specimens) Probable reason for failure Used primer(s) Additional sequences with Folmer et al. (1994)
Acanthiophilus walkeri (1) DNA degraded, specimen stored in ethanol 70% for 7 years All 0
Bactrocera oleae (1) DNA degraded, specimen stored in ethanol 70% All 1
Plaumannimyia sp. (1) ? TEPCOI 0
Rhagoletis cerasi (1) ? TEPCOI 4
Rhagoletis cingulata (3) Taxon-specific mutation at primer site? TEPCOI 0
Rhagoletis samojlovitshae (1) DNA degraded, specimen stored in ethanol 70% for 10 years All 0
Sphenella marginata (7) Taxon-specific mutation at primer site? TEPCOI, TEP_F2, TEP_R2 & Folmer et al. (1994) 0
Tephritis nebulosa (1) DNA degraded, specimen stored in ethanol 70% for 10 years All 0
Terellia colon (1) ? TEPCOI 11
Terellia luteola (1) DNA degraded, specimen stored in ethanol 70% for 10 years TEPCOI, TEP_F2, TEP_R2 & Folmer et al. (1994) 1
Trupanea cf. metoeca (1) DNA degraded, specimen stored in ethanol 70% for 2 years TEPCOI 0
Trypeta artemisiae (2) ? TEPCOI 1
Ulidia nigripennis (1) ? TEPCOI 0
Urophora ivannikovi (1) DNA degraded, specimen stored in ethanol 70% for 10 years All 0
Sequence alignment and analyses

The data are presented in a Neighbour-Joining tree only (Figure 2) for we are merely interested in a distance-based clustering of species based on similarity of the sequences and not a character based clustering of the sequences. Despite the fact that the NJ tree fits very well to both the morphological phylogenetic tree (Korneyev 2000) as well as the recent molecular ones (Han et al. 2006, Han and Ro 2009) it is stressed here that this tree may not reflect the true phylogenetic tree, because running the data through a Maximum Parsimony (MP) and Maximum Likelihood (ML) analyses result in different topologies.

Figure 2.

The Neighbour-Joining tree of the entire dataset based on COI barcodes. Terminal branches have been collapsed in order to save space, the total number of specimens is given in brackets and the area surface of the triangle represents the amount of variation. When a terminal branch contains two species, both names are provided as well as their respective number of specimens. If a branch contains more than two species only the number of species as well as the number of specimens are given. Bootstrap values above 50 (1000 replicates) are given at the nodes.

We only focus on the feasibility of DNA barcoding for molecular identification, any probable taxonomic implications of the data generated are not dealt with in this paper.

Molecular identification

With some exceptions the COI barcodes in general seem to provide a good molecular marker for identification of European fruit fly species. The mean distances between species was on average 13.2% (0.15–25.27%) whereas within a species this was a mere 0.24% (0–2.80%) (Figure 3). There is no clear barcode-gap for 2.7% of all pairwise comparisons fell between the minimum interspecific distance (0.15%) and the maximum intraspecific distance (2.8%). Among the genera the mean distances were 1.49% (0–8.78%) within and 14.96% (5.92–23.61%) between the genera. The distances between the ingroup genera and the outgroup was 21.18% (17.11–25.72%).

Figure 3.

Box plots depicting the variation in mean distances using K2P-distance modeling of sequence divergence for intraspecific, interspecific difference among the species and genera, as well as the ingroup genera with the outgroup genus.

Identification success-rates of all five criteria are given in Table 4. Several species groups within the genus Terellia Robineau-Desvoidy, 1830 and apparently none of the species of Urophora Robineau-Desvoidy, 1830 could reliably be identified using COI barcodes.

Table 4.

Identification rates of all five criteria: Neighbour-Joining (NJT) sensu Hebert et al. (2003), revised criteria (NJT_M) according to Meier et al. (2006), and Best Match (BM), Best Close Match (BCM) and All Species Barcodes (ASB) also described by Meier et al. (2006).

Criteria Correct ID Ambiguous Incorrect ID No match
NJT 63.25% 7.38% 29.37% -
NJT_M 61.89% 36.22% 1.80% -
BM 78.19% 12.25% 9.54% -
BCM (threshold 0.3%) 73.33% 10.45% 3.06% 13.15%
ASB (threshold 0.3%) 59.63% 27.02% 0.18% 13.15%
Tree-based identification

Both criteria NJT and NJT_M give comparable results with the correct identified sequences: 351 and 344 sequences respectively (Table 4). The main difference is among the number of incorrect and ambiguous sequences, for multiple placement immediately identifies the sequences as incorrect according to NJT, whereas if they still have conspecifics at the different nodes they are regarded as ambiguous according to NJT_M: 41 and 163 versus 201 and 10 sequences.

The Neotropical taxa with European congeners clustered within the appropriate genus, often with a distance greater than those among the European taxa of that particular genus.

Campiglossa absinthii (Fabricius, 1805) is placed at three different branches within the NJ tree with slightly lower though similar mean distances as among the other closely related species (Table 5). All three groups originate from different Artemisia host-plants and might therefore represent different host-races, or perhaps even different species. Host-plant names are given in Figure 2 and are abbreviated in Figure 8.

Furthermore the NJ analysis places the genus Dioxyna Frey, 1945 within the genus Campiglossa Randani, 1876 and Heringina Aczél, 1940 within Tephritis Latreille, 1804 both of which are corroborated with the ML and MP analyses.

Table 5.

Mean K2P-distances in percentages between the species of the Campiglossa loewiana-group.

Campiglossa malaris
Campiglossa absinthii / on A. vulgaris 1.07
Campiglossa loewiana 1.23 0.46
Campiglossa punctella 1.23 0.77 0.92
Campiglossa absinthii / on A. absinthium 1.23 0.77 0.92 0.30
Campiglossa absinthii / on A. maritima 1.38 0.92 1.08 0.46 0.46
Campiglossa plantaginis 1.54 0.76 0.61 0.92 0.92 1.07
Similarity-based identification

Under the BM criteria 434 sequences were regarded as correctly identified, 53 incorrectly and 68 as ambiguous. The dataset contains 394 sequences with a closest match at 0%, 56 (14, 21%) of them having an allospecific identical match.

The threshold for the 95th percentile of the intraspecific distances has been calculated at 0.3%. Success under BCM is 73.33% (84.44% of the non-discarded queries), whereas 17 sequences were regarded as incorrectly identified, 58 ambiguous and 73 did not have a match below the threshold, the proportions of TP, FP, FN and TN were 0.733, 0.135, 0.048 and 0.082 respectively.

Under the ASB criteria 331 sequences were correctly identified, 150 were ambiguous, one was misidentified and, like BCM, 73 did not have a match below the threshold.

Discussion
Molecular identification

The discussion is confined to the success-rates of the tree-based identification criteria NJT_M and the similarity-based identification according to the BCM criteria. The numbers are given for the other criteria as well but they are not discussed further (Figure 4). The NJT criteria gives an overrepresentation of incorrectly identified sequences, whereas BM seems to have an overoptimistic prediction of correctly identified sequences (Figure 4) (Meier et al. 2006, Virgilio et al. 2012). Like BM the ASB criteria does not take into account the possibility of multiple haplotypes for a single species and regards them, contrary to BM, as ambiguous instead of incorrect identified (Figure 4) (Meier et al. 2006).

Figure 4.

Identification rates of all five criteria: Neighbour-Joining (NJT) sensu Hebert et al. (2003), revised criteria (NJT_M) according to Meier et al. (2006), and Best Match (BM), Best Close Match (BCM) and All Species Barcodes (ASB) also described by Meier et al. (2006) for four different datasets, including singletons and with (n = 555) or without (n = 452) Urophora, and the same excluding singletons (n = 514) and (n = 414) respectively.

The low success-rate is in part due to singletons and the genus Urophora. Of the 135 species 38 (41 when three Urophora singletons are included) cannot have a match simply because they lack conspecifics (7.39% of the sequences) (Meier et al. 2006, Virgilio et al. 2010, 2012). Deleting them from the dataset as to simulate a perfect world scenario with 100% taxon-coverage, for every sequences has at least one conspecific, results in a higher success-rate, increasing 5.03% and 7.72% respectively and nearly halves the discarded queries (Figure 4). Urophora makes up 18.56% of the entire dataset. Deleting them results in different identification-rates, for which success increases a staggering 16.21% in NJT_M and 5.43% in BCM (Figure 4). Combining the two, e.g. deleting both the singletons and Urophora, provides an increase correct identified queries of 23.38% and 13.77% respectively (Figure 4). Comparing these identification-rates it becomes clear that Urophora is largely responsible for the lack of success with molecular identification in this dataset. The ambiguity caused by the Urophora sequences here is due to the fact that there are not only conspecific sequences per species but also in several cases per population. These of course are identical but in most cases different from conspecific sequences from other populations, interpreted by BCM as ambiguous for they might represent different haplotypes of the same species or are in fact two different species, whereas morphologically they clearly belong to the same species. Moreover more than half of the allospecific matches are caused by the genus Urophora, the rest being caused by the problematic Terellia groups.

This stripped dataset, e.g. without singletons and without the genus Urophora, results in 87.1% of all queries and 93.23% of the not discarded queries as correctly identified, which is similar though slightly lower than the dataset of interceptions of Virgilio et al. (2012).

The threshold value in BCM is of strong influence on the results, as already noted by Virgilio et al. (2012). The success-rates have been calculated for a range of arbitrary threshold values between the largest observed distance and 0.00 (Figure 5). A rapid increase of accuracy can be seen to 0.84 at a threshold of 0.5%, after which it declines again to 0.78, similarly TP increases and FN decreases. Precision however never exceeds 0.86. Thus when calculating the relative ID error, linear regression shows that for a relative ID error < 0.05 the threshold value is lower than 0.00 (Figure 7a). Even when the stripped dataset is used precision only reaches 0.94 (Figure 6), therefore again producing a threshold value lower than 0.00 for a relative ID error < 0.05 (Figure 7b). This linear regression function is used by Virgilio et al. (2012) to infer the ad hoc threshold for the 95th percentile of the correctly identified queries and where the relative ID error does not exceed 5%. When this threshold value is lower than 0.00 the dataset should be regarded as unreliable (Virgilio et al. 2012). Only when the problematic Terellia groups are deleted from our already stripped dataset an ad hoc threshold value > 0 can be inferred (Figure 7c). Therefore the dataset created here is unreliable for molecular identification. This was also clear by the number of allospecific matches as well as the ambiguity among the success-rates, resulting in an low overall success-rate. Several other groups have recently been studied in which DNA barcoding was shown to have a limited performance (Armstrong and Ball 2005, Kaila and Stahls 2006, Meier et al. 2006, Elias et al. 2007, Neigel et al. 2007, Skevington et al. 2007, Virgilio et al. 2008, Dasmahapatra et al. 2009, Jackson et al. 2011, Barr et al. 2012).

Figure 5.

Best Close Match (BCM) identification of the entire dataset (n = 555). Proportions of true positives (TP), false positives (FP), false negatives (FN) and true negatives (TN) are given for 30 arbitrary distance thresholds ranging from 0.15 to 0.00. For each threshold the percentages of precision, accuracy and discarded queries were calculated.

Figure 6.

Best Close Match (BCM) identification of the stripped dataset, e.g. excluding singletons and Urophora (n = 414). Proportions of true positives (TP), false positives (FP), false negatives (FN) and true negatives (TN) are given for 30 arbitrary distance thresholds ranging from 0.15 to 0.00. For each threshold the percentages of precision, accuracy and discarded queries were calculated.

Figure 7.

Relative ID errors at 30 arbitrary threshold values for a. the entire dataset (n = 555), b. the stripped dataset, e.g. excluding singletons and Urophora (n = 414) and c. the stripped dataset excluding the problematic Terellia groups. Linear regression was used to infer the ad hoc threshold for the 95th percentile of the correctly identified queries and the relative ID error does not exceed 5%. In (a) and (b) this value is below 0.00, only in (c) this value is positive: 0.051 (R-square 0.91).

Distinguishing between true and false positives and negatives is based on morphological identification of the voucher specimens. Therefore taxonomic specialists are needed to build and check the reference database that can be used for molecular identification. Adding more morphologically correctly identified specimens will increase the understanding of the limitations of molecular identification for that particular group (Meyer and Paulay 2005, Ekrem et al. 2007, Kwong et al. 2012). Incorrectly identified sequences will be added to the reference database like BOLD, for it is only human to make errors. Introducing threshold values for molecular identification will point out the obviously incorrectly identified specimens (Meier et al. 2006), but will not help with problematic groups containing for example very low interspecific distances or allospecific matches. Based on our dataset we were able to identify some problematic groups causing limitations for molecular identification of Tephritids illustrated by some examples given below.

Varying mean distances between different species groups of the same genus

The species of the genus Campiglossa can be identified using DNA barcodes, showing a neat mean distance of 5.2%. Looking in detail, however, shows it has a very broad range of interspecific distances, from 0.3 to 8.7%. Grouping the species into their known morphological species complexes (Merz 1992, 1994) results in a mean distances of 6.2% (4.2–8.6%), because all but one of the groups are represented by just one species (Figure 8). The five species of the loewiana group show a mean distance of a mere 0.9% (0.3–1.5%) (Table 5), revealing that these very closely related species are apparently difficult to separate using COI, something which has been noted before in various groups as well as Tephritids (Armstrong and Ball 2005, Kaila and Stahls 2006, Virgilio et al. 2008, Barr et al. 2012, Nieukerken et al. 2012).

Figure 8.

The Neighbour-Joining tree of the genus Campiglossa with Sphenella marginata as outgroup inferred from COI barcodes. Bootstrap values above 50 (1000 replicates) are given at the nodes.

Executing a BLAST on the BOLD database with one sequence of Campiglossa malaris Séguy, 1938 from our dataset retrieved no less than 18 sequences with a similarity of over 98%, belonging to 5 different species apart from the target species. Excluding Campiglossa malaris itself, the sequence with the highest similarity was one belonging to a Nearctic species, Campiglossa farinata (Novak, 1974) with a similarity of 99.08%. Furthermore, no less than six sequences showed a similarity of 98.93% belonging to two different species.

These differences in mean distances, especially the short ones among the loewiana group, indicate that it is important to include as many sequences of distinct populations per species as possible in a reference database like BOLD to preclude misidentification.

Multiple specimens

Adding specimens from geographically distinct populations is necessary in order to shed some light on the intraspecific variation caused by geography (Bergsten et al. 2012). This is clearly illustrated by adding two specimens of Orellia falcata (Scopoli, 1763) from Spain, which resulted in a paraphyletic placement, including the second species present in the dataset: Orellia stictica (Gmelin, 1790) (Figure 9). Both species are morphologically quite distinct and easy to recognize. Therefore either both species are so closely related that they cannot be separated based on the barcode gene and perhaps a more sensitive marker is needed, or Orellia falcata represents a complex of cryptic species.

Figure 9.

The Neighbour-Joining tree of the genus Orellia inferred from COI barcodes. Bootstrap values above 50 (1000 replicates) are given at the nodes.

Likewise it is necessary to add specimens of ecologically distinct populations as well, as is shown by the three ‘host-races’ of Campiglossa absinthii and by Smith et al. (2009) for Chaetostomella cylindrica.

Low interspecific variation compared to a high intraspecific variation

Looking at the NJ tree (Figure 2, 10) it is immediately obvious that the species of the genus Urophora cannot be separated using DNA barcodes. Jackson et al. (2011) already reported that the species of the genus Urophora could not be identified using DNA barcodes, having included 10 sequences belonging to three different species. In our dataset we included over 100 sequences of 16 morphologically identified species, resulting in multiple placement of several species and a mean distance of a mere 1.65% (0.3-2.45%). This limited or entire lack of performance of molecular identification is of special interest for it concerns a genus of economic importance with several species regarded as beneficiary for weed control (White and Clement 1987, White and Elson-Harris 1992). Additional genetic markers should be tested for the molecular identification of these species like Elongation Factor 1-α (EF1-α) or ribosomal Internal Transcribed Spacer 2 (ITS2) (Alvarez and Hoy 2003, Farris et al. 2010, Nieukerken et al. 2012).

Figure 10.

The Neighbour-Joining tree of the genus Urophora inferred from COI barcodes. Bootstrap values above 50 (1000 replicates) are given at the nodes.

The limitations of DNA barcodes for molecular identification

As is shown above, the feasibility of the use of DNA barcodes for molecular identifications relies heavily on the contents of the database used to BLAST against (Meyer and Paulay 2005, Meier et al. 2006, Ekrem et al. 2007, Virgilio et al. 2010, 2012, Kwong et al. 2012). The addition of multiple specimens per species to the database, preferably from geographically distinct populations, as well as different ecologies, provides a much needed insight in the intraspecific versus interspecific variation of the species. Adding more species is a necessity too, because incorporating different species of the Campiglossa loewiana-complex clearly demonstrated that the perceived mean distance of 5.2% between the species actually represents the mean distance of the different species groups in this dataset. The mean distance of the species within the Campiglossa loewiana-group was a mere 0.9%. Hence threshold values like a ≥ 98% similarity as used by Li et al. (2011) or the 97% used by BOLD for a positive identification do not hold. Introducing the 95th percentile threshold value increases the reliability of the identification success. Further improvement can be achieved by introducing the ad hoc threshold as proposed by Virgilio et al. (2012). However, as is shown by our dataset, this is not always possible. Instead of discarding the dataset as unreliable it should be used to identify the problematic groups by looking at the amount of allospecific matches, TP, FP, FN and TN. In that case these problematic groups can be flagged in the reference database so that the user can look for alternative means for identification.

Conclusion

We conclude that molecular identification of Tephritids using DNA barcoding is possible but should be treated with care due to varying performance within this group as is shown by the dataset analysed here. Even when threshold values are added groups will remain that cannot reliably be identified. We stress that a better performance is strongly dependent on an increasing input of morphologically identified specimens, containing multiple specimens of different geographical populations and different ecologies covering as much of the range of the species as possible, otherwise it remains difficult to detect cryptic species and estimate true diversity. Threshold values for both distance and relative ID error, as well as distinction between positives and negatives, both true and false, should not only be used to improve the reliability of the success for molecular identification but also to identify the problematic groups for molecular identification. These groups should be flagged in the reference database and alternative markers for molecular identification should be tested.

Acknowledgements

We thank the following persons for providing material used in this study: Kees van Achterberg (Leiden, the Netherlands), Berend Aukema (Wageningen, the Netherlands), Theodoor Heijerman (Wageningen, the Netherlands), Guido Keijl (Bakkum, the Netherlands), Roy Kleukers (Leiden, the Netherlands), Severin and Valery Korneyev (Kiev, Ukraine), Kim Meijer (Groningen, the Netherlands), Gerard Pennards (Zeist, the Netherlands), Gordon Ramel (Serron, Greece), Jeff Skevington (Ottawa, Canada), J. Smit (Duiven, the Netherlands), Wouter van Steenis (Breukelen, the Netherlands) and Theo Zeegers (Soest, the Netherlands). Furthermore we thank Menno Reemer for the help and discussions on the analysis. We also thank Valery Korneyev and Ho-Yeon Han for valuable comments on an earlier draft of this paper. Lastly we thank Allan Norrbom and two other anonymous reviewers for their valuable comments.

References
Alvarez JM, Hoy MA (2003) Evaluation of the ribosomal ITS2 DNA sequences in separating closely related populations of the parasitoid Ageniaspis (Hymenoptera: Encyrtidae). Annals of the Entomological Society of America 95: 250-256. doi: 10.1603/0013-8746(2002)095[0250:EOTRID]2.0.CO;2
Armstrong KF, Ball SL (2005) DNA barcodes for biosecurity: invasive species identification. Philosophical Transactions of the Royal Society B 360: 1813-1823. doi: 10.1098/rstb.2005.1713
Barr NB, Copeland RS, De Meyer M, Masiga D, Kibogo HG, Billah MK, Osir E, Wharton RA, McPheron BA (2006) Molecular diagnostics of economically important Ceratitis fruit fly species (Diptera: Tephritidae) in Africa using PCR and RFLP analyses. Bulletin of Entomological Research 96: 505-521. doi: 10.1079/BER2006452
Barr NB, Islam MS, Meyer M De, McPheron BA (2012) Molecular identification of Ceratitis capitata (Diptera: Tephritidae) using DNA sequences of the COI barcode region. Annals of the Entomological Society of America 105: 339-350. doi: https://doi.org/10.1603/AN11100
Bergsten J, Bilton DT, Fujisawa T, Elliott M, Monaghan MT, Balke M, Hendrich L, Geijer J, Herrmann J, Foster GN, Ribera I, Nilsson AN, Barraclough TG, Vogler AP (2012) The effect of geographical scale of sampling on DNA sarcoding. Systematic Biology 61: 851–869. doi: 10.1093/sysbio/sys037
Boykin LM, Shatters Jr RG, Hall DG, Burns RE, Franqui RA (2006) Analysis of host preference and geographical distribution of Anastrepha suspensa (Diptera: Tephritidae) using phylogenetic analyses of mitochondrial cytochrome oxidase I DNA sequence data. Bulletin of Entomological Research 96: 457-469. doi: 10.1079/BER2006438
Buhay JE (2009) ‘‘COI-like’’ sequences are becoming problematic in molecular systematic and DNA barcoding studies. Journal of Crustacean Biology 29: 96-110. doi: 10.1651/08-3020.1
Cognato AI (2006) Standard percent DNA sequence difference for insects does not predict species boundaries. Journal of Economic Entomology 99: 1037-1045. doi: 10.1603/0022-0493-99.4.1037
DeSalle R, Egan MG, Siddall M (2005) The unholy Trinity: taxonomy, species delimitation and DNA barcoding. Philosophical Transactions of the Royal Society B 360: 1905–1916. doi: 10.1098/rstb.2005.1722
Dasmahapatra KK, Elias M, Hill RI, Hoffmans JI, Mallet J (2009) Mitochondrial barcoding detects some species that are real, and some that are not. Molecular Ecology Resources 10: 264–273. doi: 10.1111/j.1755-0998.2009.02763.x
Ekrem T, Willassen E, Stur E (2007) A comprehensive DNA sequence library is essential for identification with DNA barcodes. Molecular Phylogenetics and Evolution 43: 530-542. doi: 10.1016/j.ympev.2006.11.021
Elias M, Hill RI, Willmott KR, Dasmahapatra KK, Brower AVZ, Mallet J, Jiggins CD (2007) Limited performance of DNA barcoding in a diverse community of tropical butterflies. Proceedings of the Royal Society B 274: 2881-2889. doi: 10.1098/rspb.2007.1035
Farris RE, Ruiz-Arce R, Ciomperlik M, Vasquez JD, DeLeon R (2010) Development of a ribosomal DNA ITS2 marker for the identification of the thrips, Scirtothrips dorsalis. Journal of Insect Science 10: 1-15. doi: 10.1673/031.010.2601
Folmer O, Black M, Hoeh W, Lutz R, Vrijenhoek R (1994) DNA primers for amplification of mitochondrial cytochrome c oxidase subunit I from diverse metazoan invertebrates. Molecular Marine Biology and Biotechnology 3: 294-299.
Hall TA (1999) BioEdit: a user-friendly biological sequence alignment editor and analysis program for Windows 95/98/NT. Nucleic Acids Symposium Series 41: 95–98. http://www.mbio.ncsu.edu/bioedit/page2.html
Han HY, Ro KE (2009) Molecular phylogeny of the family Tephritidae (Insecta: Diptera): new insight from combined analysis of the mitochondrial 12S, 16S en COII genes. Molecules and Cells 27: 55-66. doi: 10.1007/s10059-009-0005-3
Han HY, Ro KE, McPheron BA (2006) Molecular phylogeny of the subfamily Tephritinae (Diptera: Tephritidae) based on mitochondrial 16S rDNA sequences. Molecules and Cells 22: 78-88.
Hebert PDN, Cywinska A, Ball SL, deWaard JR (2003) Biological identifications through DNA barcodes. Proceedings of the Royal Society of London B 270: 313-322. doi: 10.1098/rspb.2002.2218
Jackson MD, Marshall SA, Hanner R, Norrbom AL (2011) The fruit flies (Tephritidae) of Ontario. Canadian Journal of Arthropod Identification 15: 1-251. doi: 10.3752/cjai.2011.15
Kaila L, Stahls G (2006) DNA barcodes: Evaluating the potential of COI to differentiate closely related species of Elachista (Lepidoptera: Gelechioidea: Elachistidae) from Australia. Zootaxa 1170: 1–26. http://www.mapress.com/zootaxa/2006f/zt01170p026.pdf
Kimura M (1980) A simple method for estimating evolutionary rate of base substitutions through comparative studies of nucleotide sequences. Journal of Molecular Evolution 16: 111–120. http://www.ncbi.nlm.nih.gov/pubmed/7463489
Knio KM, White IM, Al-Zein M (2007) Host race formation in Chaetostomella cylindrica (Diptera: Tephritidae): morphological and morphometric evidence. Journal of Natural History 41: 1697-1715. doi: 10.1080/00222930701494486
Kohnen A, Wisseman V, Brandl R (2009) No genetic differentiation in the rose-infesting fruit flies Rhagoletis alternata and Carpomyia schineri (Diptera: Tephritidae) across Central Europe. European Journal of Entomology 106: 315-321.
Korneyev VA (2000) Phylogenetic relationships among higher groups of Tephritidae. In: Aluja M, Norrbom AL (eds) Fruit flies (Tephritidae): Phylogeny and evolution of behavior. CRC Press, London, 73-113.
Kwong S, Srivathsan A, Meier R (2012) An update on DNA barcoding: low species coverage and numerous unidentified sequences. Cladistics 28: 639-644. doi: 10.1111/j.1096-0031.2012.00408.x
Li Z, Li Z, Wang F, Lin W, Wu J (2011) TBIS: A web-based expert system for identification of Tephritid fruit flies in China based on DNA barcodes. Advances in Information and Communication Technology 346: 563-571. doi: 10.1007/978-3-642-18354-6_66
Maddison DR, Maddison WP (2000) MacClade 4: Analysis of phylogeny and character evolution. Version 4.0. Sinauer Associates, Sunderland, MA. http://macclade.org/macclade.html
McPheron BA, Steck GJ (1996) Fruit Fly Pests. A world assessment of their biology and management. St Lucie Press, Delray Beach, Florida, USA.
Meier R, Shiyang K, Vaidya G, Ng PKL (2006) DNA barcoding and taxonomy in Diptera: A tale of high intraspecific variability and low identification success. Systematic Biology 55: 715–728. doi: 10.1080/10635150600969864
Merz B (1992) Revision der westpalaearktischen Gattungen und Arten der Paroxyna-Gruppe und Revision der Fruchtfliegen der Schweiz (Diptera: Tephritidae). Dissertation ETH 9902: 342 pp.
Merz B (1994) Diptera Tephritidae. Insecta Helvetica fauna 10: 198 pp.
Meyer CP, Paulay G (2005) DNA Barcoding: error rates based on comprehensive sampling. PloS Biology 3: 2229-2238. doi: 10.1371/journal.pbio.0030422
Nakahara S, Muraj M (2008) Phylogenetic analyses of Bactrocera fruit flies (Diptera: Tephritidae) based on nucleotide sequences of the mitochondrial COI and COII genes. Research Bulletin of Plant Protection Japan 44: 1-12.
Neigel J, Domingo A, Stake J (2007) DNA barcoding as a tool for coral reef conservation. Coral Reefs 26: 487-499. doi: 10.1007/s00338-007-0248-4
Nieukerken EJ van, Doorenweerd C, Stokvis FR, Groenenberg DSJ (2012) DNA barcoding of the leaf-mining moth subgenus Ectodemia s. str. (Lepidoptera: Nepticulidae) with COI and EF1-α; two are better than one in recognising cryptic species. Contributions to Zoology 81: 1-24.
Norrbom AL, Carroll LE, Thompson FC, White IM, Freidberg A (1999) Systematic database of names. In: Thompson FC (Ed) Fruitfly Expert Identification System and Systematic Information Database. - MYIA vol. 9, Backhuys, Leiden, 65-299.
Rindal E, Brower AVZ (2011) Do model-based phylogenetic analyses perform better than parsimony? A test with empirical data. Cladistics 27: 331-334. doi: 10.1111/j.1096-0031.2010.00342.x
Schutze MH, Yeates DK, Graham GC, Dodson G (2007) Phylogenetic relationships of antlered flies, Phytalmia Gerstaecker (Diptera: Tephritidae): the evolution of the antler shape and mating behaviour. Australian Journal of Entomology 46: 281-293. doi: 10.1111/j.1440-6055.2007.00614.x
Skevington JH, Kehlmaier C, Stahls G (2007) DNA barcoding: Mixed results for big-headed flies (Diptera: Pipunculidae). Zootaxa 1423: 1–26. http://www.mapress.com/zootaxa/2007f/zt01423p026.pdf
Smit JT (2010) De Nederlandse boorvliegen (Tephritidae). Entomologische tabellen 5: 1-159.
Smith CA, Al-Zein MS, Sayar NP, Knio KM (2009) Host races in Chaetostomella cylindrica (Diptera: Tephritidae): genetic and behavioural evidence. Bulletin of Entomological Research 99: 425-432. doi: 10.1017/S0007485308006482
Smith-Caldas MRB, McPheron BA, Silva JG, Zucchi RA (2001) Phylogenetic relationships among species of the fraterculus group (Anastrepha: Diptera: Tephritidae) inferred from DNA sequences of mitochondrial cytochrome oxidase I. Neotropical Entomology 30: 565–573. doi: 10.1590/S1519-566X2001000400009
Tamura K, Peterson D, Peterson N, Stecher G, Nei M, Kumar S (2011) MEGA5: Molecular Evolutionary Genetics Analysis using maximum likelihood, evolutionary distance, and maximum parsimony methods. Molecular Biology and Evolution 28: 2731-2739. doi: 10.1093/molbev/msr121
Turner CE (1996) Tephritidae in the biological control of weeds. In: McPheron BA, Steck GJ (Eds) Fruit Fly Pests: A world assessment of their biology and management. St. Lucie Press, Delray Beach, Florida, 157-164.
Virgilio M, Backeljau T, Barr N, De Meyer M (2008) Molecular evaluation of nominal species in the Ceratitis fasciventris, C. anonae, C. rosa complex (Diptera: Tephritidae). Molecular Phylogenetics and Evolution 48: 270-280. doi: 10.1016/j.ympev.2008.04.018
Virgilio M, Backeljau T, Nevado B, De Meyer M (2010) Comparative performances of DNA barcoding across insect orders. BMC Bioinformatics 11: 206. http://www.biomedcentral.com/1471-2105/11/206, doi: 10.1186/1471-2105-11-206
Virgilio M, Jordaens K, Breman FC, Backeljau T, De Meyer M (2012) Identifying insects with incomplete DNA barcode libraries, African fruit flies (Diptera: Tephritidae) as a test case. PLoS ONE 7: 1-8. doi: 10.1371/journal.pone.0031581
Wheeler QD (2008) Undisciplined thinking: morphology and Hennig’s unfinished revolution. Systematic Entomology 33: 2–7. http://www.life.illinois.edu/ib/514/wheeler08.pdf, doi: 10.1111/j.1365-3113.2007.00411.x
White IM, Clement SL (1987) Systematic notes on Urophora (Diptera: Tephritidae) species associated with Centaurea solstitialis (Asteraceae: Cardueae) and other Palaearctic weeds adventives in North America. Proceedings of the Entomological Society of Washington 89: 571–580.
White IM, Elson-Harris MM (1992) Fruit flies of economic significance: their identification and bionomics. CAB International, London.
White IM, Groppe K, Sobhian R (1990) Tephritids of knapweeds, starthistles and safflower: results of a host choice experiment and the taxonomy of Terellia luteola (Wiedemann) (Diptera: Tephritidae). Bulletin of Entomological Research 80: 107-111. doi: 10.1017/S0007485300045983
White IM, Korneyev VA (1989) A revision of the western Palearctic species of Urophora Robineau-Desvoidy (Dipt., Tephritidae). Systematic Entomology 14: 327-374. doi: 10.1111/j.1365-3113.1989.tb00289.x
Will KW, Rubinoff D (2004) Myth of the molecule: DNA barcodes for species cannot replace morphology for identification and classification. Cladistics 20: 47-55. doi: 10.1111/j.1096-0031.2003.00008.x
Zhang B, Liu YH, Wu WX, Wang ZL (2010) Molecular phylogeny of Bactrocera species (Diptera: Tephritidae: Dacini) inferred from mitochondrial sequences of 16S rDNA And COI Sequences. Florida Entomologist 93: 369-377. doi: 10.1653/024.093.0308
Appendix

Collection data of all specimens included in this study. (doi: 10.3897/zookeys.365.5819.app) File format: Adobe PDF file (pdf).