<p>In case if you are really dedicated to obtain perfect results, you can use strategy described <a href="http://www.nature.com/nature/journal/v526/n7571/full/nature15394.html" rel="nofollow noreferrer">there</a>, in 1000GP 3rd Phase SV detection paper - use these tools, validate your calls with IRS test, merge calls into one callset. </p>

<p>If you do not wanna spend thousands human-hours as was spent during this paper preparation, from my experience, it is better to use 1 paired-end insert distance method and one read-depth based method. Each of them cover "different" regions in the genome. (even thou they have huge overlap, paired-end detection requires both SV breakpoints to be located within the regions with good mappability which is not always the case, but resolution of read-depth methods is lower in general, paired-ends works well for deletions/tandem duplications/inversions, but have troubles with non-tandem duplications).</p>

<p>Hope it helps.</p>

CC BY-SA 3.0
2017-05-20T14:39:39.893Z
I went though the supplement of the paper, it is really crazy - it seems that there is very little overlap of different computational methods, but the False discovery rate is for non inversions types of SVs pretty good (2 - 10%). However, they have used a huge population dataset, I have sequencing of 9 individuals including the reference.
Kamil S Jaron
CC BY-SA 3.0
2017-05-20T15:51:43.333Z
Yeap, the overlap is kinda small, but this is mainly because different tools look for different type of CNVs (as I explained above comparing Read Depth vs Insert Distance-based methods). This is the best accuracy you can get. Having only 9 individuals, you'd better exclude CNVs that happen with frequency >1% in the population (see the paper) and then use eg DELLY and cn.mops (just an example, not sure if this is an ideal choice, but both of them are quite good).
German Demidov
CC BY-SA 3.0
2017-05-20T08:33:58.813Z
2017-05-20T08:33:58.813Z
German Demidov
<p>I think the best method or combination of methods will depend on aspects of the data that might vary from one dataset to another. E.g. the type, size, and frequency of structural variants, the number SNVs, the quality of the reference, contaminants or other issues (e.g. read quality, sequencing errors) etc.</p>

<p>For that reason, I'd take two approaches:</p>

<ol>
<li>Try a lot of methods, and look at their overlap</li>
<li>Validate a subset of calls from different methods by wet lab experiments - in the end this is the only real way of knowing the accuracy for a particular case.</li>
</ol>

CC BY-SA 3.0
2017-05-20T14:37:05.650Z
What do you mean by "Validate a subset of calls from different methods"?
Kamil S Jaron
CC BY-SA 3.0
2017-05-20T15:14:04.140Z
Funny, the review paper (sim data) kind of agree with you - all methods have lot of false positives - it is better to take overlap. 
However, the paper "An integrated map of structural variation" (Germain's answer) have done opposite - tweaking every software to reduce false positives and than taking them all.
Kamil S Jaron
CC BY-SA 3.0
2017-05-21T02:58:36.147Z
By validate, I mean go in and resequence a bunch of predicted variants. All of the bioninformatic methods will give lots of false positives (and lots of false negatives, though it's harder to find the negatives of course). So the only genuine way to know the accuracy of your calls is to get independent information e.g. from resequencing.
roblanf
CC BY-SA 3.0
2017-05-19T10:18:40.500Z
2017-05-22T03:36:59.117Z
2017-05-22T03:36:59.117Z
roblanf
<p>I have a reference genome and now I would like to call structural variants from Illumina pair-end whole genome resequencing data (insert size 700bp). </p>

<p>There are many tools for SV calls (I made an incomplete list of tools bellow). There is also a tool for merging SV calls from multiple methods / samples - <a href="https://github.com/fritzsedlazeck/SURVIVOR" rel="noreferrer">SURVIVOR</a>. Is there a combination of methods for SV detection with optimal balance between sensitivity and specificity?</p>

<p>There is a <a href="http://www.ijpmbs.com/uploadfile/2016/1017/20161017025004545.pdf" rel="noreferrer">benchmarking paper</a>, evaluating sensitivity and specificity of SV calls of individual methods using simulated pair-end reads. However, there is no elaboration on the combination of methods.</p>

<p>List of tools for calling structural variants:</p>

<ul>
<li><a href="https://github.com/arq5x/lumpy-sv" rel="noreferrer">Lumpy</a></li>
<li><a href="http://breakdancer.sourceforge.net/" rel="noreferrer">BreakDancer</a></li>
<li><a href="https://github.com/Illumina/manta" rel="noreferrer">Manta</a></li>
<li><a href="https://github.com/dellytools/delly" rel="noreferrer">Delly</a></li>
<li><a href="https://github.com/PapenfussLab/gridss" rel="noreferrer">GRIDSS</a></li>
<li><a href="http://compbio.med.harvard.edu/Meerkat/" rel="noreferrer">Meerkat</a></li>
<li><a href="https://github.com/genome/pindel" rel="noreferrer">Pindel</a></li>
<li><a href="https://sourceforge.net/projects/softsv/" rel="noreferrer">Softsv</a></li>
<li><a href="http://compbio.cs.toronto.edu/prism/" rel="noreferrer">Prism</a></li>
</ul>

CC BY-SA 3.0
2017-05-18T15:12:14.967Z
I will just add a comment, as it's not a complete answer. Check the Genome in a Bottle consortium. There are discussions now on how to determine the best caller(s) and definition on a standard set of calls for benchmarking and testing new approaches. In my work I had good results with Socrates, now replaced with [GRIDSS](https://github.com/PapenfussLab/gridss).
nuin
CC BY-SA 3.0
2017-05-20T15:10:52.557Z
@nuin - I didn't know about Genome in a Bottle consortium, looks interesting, but I could not find any public record of a discussion. Do you have a link?
Kamil S Jaron
<ngs><structural-variation><variant-calling>
How can I call structural variants (SVs) from pair-end short read resequencing data?
# How can I call structural variants (SVs) from pair-end short read resequencing data?

(Asked by: username_0 on 2017-05-18)

I have a reference genome and now I would like to call structural variants from Illumina pair-end whole genome resequencing data (insert size 700bp).

There are many tools for SV calls (I made an incomplete list of tools bellow). There is also a tool for merging SV calls from multiple methods / samples - [SURVIVOR](https://github.com/fritzsedlazeck/SURVIVOR). Is there a combination of methods for SV detection with optimal balance between sensitivity and specificity?

There is a [benchmarking paper](http://www.ijpmbs.com/uploadfile/2016/1017/20161017025004545.pdf), evaluating sensitivity and specificity of SV calls of individual methods using simulated pair-end reads. However, there is no elaboration on the combination of methods.

List of tools for calling structural variants:

* [Lumpy](https://github.com/arq5x/lumpy-sv)
* [BreakDancer](http://breakdancer.sourceforge.net/)
* [Manta](https://github.com/Illumina/manta)
* [Delly](https://github.com/dellytools/delly)
* [GRIDSS](https://github.com/PapenfussLab/gridss)
* [Meerkat](http://compbio.med.harvard.edu/Meerkat/)
* [Pindel](https://github.com/genome/pindel)
* [Softsv](https://sourceforge.net/projects/softsv/)
* [Prism](http://compbio.cs.toronto.edu/prism/)

**Tags:** ngs, structural-variation, variant-calling
> **Comments:**
> **username_1**: I will just add a comment, as it's not a complete answer. Check the Genome in a Bottle consortium. There are discussions now on how to determine the best caller(s) and definition on a standard set of calls for benchmarking and testing new approaches. In my work I had good results with Socrates, now replaced with [GRIDSS](https://github.com/PapenfussLab/gridss).  
> **username_0**: @nuin - I didn't know about Genome in a Bottle consortium, looks interesting, but I could not find any public record of a discussion. Do you have a link?  

---

## 2 answers

### Answer by username_3 on 2017-05-19. Score: 6 | Accepted answer

I think the best method or combination of methods will depend on aspects of the data that might vary from one dataset to another. E.g. the type, size, and frequency of structural variants, the number SNVs, the quality of the reference, contaminants or other issues (e.g. read quality, sequencing errors) etc.

For that reason, I'd take two approaches:

1. Try a lot of methods, and look at their overlap
2. Validate a subset of calls from different methods by wet lab experiments - in the end this is the only real way of knowing the accuracy for a particular case.

> **Comments:**
> **username_0**: What do you mean by "Validate a subset of calls from different methods"?  
> **username_0**: Funny, the review paper (sim data) kind of agree with you - all methods have lot of false positives - it is better to take overlap.  However, the paper "An integrated map of structural variation" (Germain's answer) have done opposite - tweaking every software to reduce false positives and than taking them all.  
> **username_3**: By validate, I mean go in and resequence a bunch of predicted variants. All of the bioninformatic methods will give lots of false positives (and lots of false negatives, though it's harder to find the negatives of course). So the only genuine way to know the accuracy of your calls is to get independent information e.g. from resequencing.  

---

### Answer by username_2 on 2017-05-20. Score: 3

In case if you are really dedicated to obtain perfect results, you can use strategy described [there](http://www.nature.com/nature/journal/v526/n7571/full/nature15394.html), in 1000GP 3rd Phase SV detection paper - use these tools, validate your calls with IRS test, merge calls into one callset.

If you do not wanna spend thousands human-hours as was spent during this paper preparation, from my experience, it is better to use 1 paired-end insert distance method and one read-depth based method. Each of them cover "different" regions in the genome. (even thou they have huge overlap, paired-end detection requires both SV breakpoints to be located within the regions with good mappability which is not always the case, but resolution of read-depth methods is lower in general, paired-ends works well for deletions/tandem duplications/inversions, but have troubles with non-tandem duplications).

Hope it helps.

> **Comments:**
> **username_0**: I went though the supplement of the paper, it is really crazy - it seems that there is very little overlap of different computational methods, but the False discovery rate is for non inversions types of SVs pretty good (2 - 10%). However, they have used a huge population dataset, I have sequencing of 9 individuals including the reference.  
> **username_2**: Yeap, the overlap is kinda small, but this is mainly because different tools look for different type of CNVs (as I explained above comparing Read Depth vs Insert Distance-based methods). This is the best accuracy you can get. Having only 9 individuals, you'd better exclude CNVs that happen with frequency >1% in the population (see the paper) and then use eg DELLY and cn.mops (just an example, not sure if this is an ideal choice, but both of them are quite good).  

---

