This is an important heads-up regarding the GATK 3.0 release.

The purpose of the ReduceReads algorithm was to enable joint analysis of large cohorts by the UnifiedGenotyper. The new workflow for joint discovery, which involves doing a single-sample pass with the HaplotypeCaller in gVCF mode followed by a joint analysis on multiple sample gVCFs, renders the compression step obsolete.

In addition, based on our most recent analyses, we have come to the conclusion that the quality of variant calls made on BAMs compressed with ReduceReads is inferior to the standard targeted by GATK tools. In comparison, the results obtained with the new workflow are far superior.

For these reasons, we have made the difficult decision to remove the ReduceReads tool from version 3.0 of the toolkit. To be clear, reduced BAMs will NOT be supported in GATK 3.0.

We realize that this may cause some disruption to your existing workflows, and for that we apologize. Please understand that we are driven to provide tools that produce the best possible results. Now that all the data is in, we have found that the best results cannot be achieved with reduced BAMs, so we feel that the best thing to do is to remove this inferior tool from the toolkit, and promote the new tools.

As always we welcome your comments, and we look forward to showing you how the new calling workflow will yield superior results.


jpitt


Hi @Geraldine_VdAuwera, Thanks for the heads up on this! Since I saw this post I've looked around without much success. Is HaplotypeCaller's gVCF and subsequent multi-sample gVCF calling implemented in the current 2.8.1 build of GATK, or do we need to wait until 3.0 is released? Also, for multi-sample calling you say that ReducedReads + UnifiedGenotyper perform subotimally compared to HaplotypeCaller + gVCF. Does this mean that the calls obtained from ReducedReads bams are inherently poor? More specifically, are ReducedReads + UnifiedGenotyper calls of much lower quality than regular bams + UnifiedGenotyper calls? Assuming that HaplotypeCaller gVCF is coming in version 3.0, would your team advise against using ReducedReads bams in the meantime? Thanks!

Tue 4 Mar 2014

Geraldine_VdAuwera


Hi @jpitt, The gVCF (or reference model) is already implemented in 2.8, though it is further improved in the 3.0 code. However the tools for making joint analyses based on gVCFs of multiple samples (which is what replaces RR+UG) are not yet available; they will be in the new release. Which, if all goes well, will be released tomorrow! So I would advise waiting a day or two for the new version to be available. > are ReducedReads + UnifiedGenotyper calls of much lower quality than regular bams + UnifiedGenotyper calls? It's all relative, but let's say that they are inferior enough (particularly to the results we get with the new method) that we absolutely encourage you to switch over to the new method.

Tue 4 Mar 2014

BretH


How will you be filtering out low-information reads (like pcr duplicates)? Or are these included in the joint varient analysis step?

Tue 4 Mar 2014

Geraldine_VdAuwera


Hi @BretH, We mark duplicates using Picard tools in pre-processing, same as previously. This causes GATK tools to ignore dupes in subsequent analyses.

Tue 4 Mar 2014

BretH


Thank you for your answer.

Tue 4 Mar 2014




At a glance



Follow us on Twitter

GATK Dev Team

@gatk_dev

#GATK workshop crew is in Basel, ready to roll! @ISBSIB https://t.co/m56JzpC1bN
25 Sep 16
@thatdnaguy That's right, we've retired it, see https://t.co/epbvwOQVTt
23 Sep 16
@geoffjentry @BroadGenomics Ah, you should ask @WDL_dev on the WDL forum then :)
21 Sep 16
@geoffjentry @BroadGenomics If you're in a hurry to get answers, consider posting in our support forum ;)
21 Sep 16
We'll be at #ASHG16 along with @BroadGenomics. Come talk to us at booth 329! https://t.co/NvMHDNGTmo
20 Sep 16

Our favorite tweets from others

I've easily written my first custom ReadFilter for GATK. The @gatk_dev 's toolkit is a great example of programming.
21 Sep 16
@gatk_dev "make it so"
8 Sep 16
it's the nightly build owl for GATK :D https://t.co/OwTRrk6KHA https://t.co/rfmAbdIIQp
11 Aug 16
We're going to make an hg38 version of ExAC. And we'll make @dgmacarthur pay for it. #BioinformaticsCampaignPromises
2 Aug 16
You’re right @gatk_dev honesty is key! About variants manual filtering: “In any case you're probably in for a world of pain.” Ha now I know!
11 Jul 16
See more of our favorite tweets...
Search blog by tag

ad appistry ashg benchmarks best-practices bug bug-fixed cancer catvariants challenge cloud cluster commandline commandlinegatk community competition compute conferences cram cromwell denovo depthofcoverage diagnosetargets error fix forum gatk3 gatk4 genotype genotype-refinement genotypegvcfs google grch38 gvcf haploid haplotypecaller hg38 holiday hts htsjdk ibm java8 job job-offer jobs license meetings mendelianviolations multithreading mutect mutect2 ngs nt outreach pairhmm parallelism patch performance phone-home picard pipeline plans ploidy polyploid poster presentations printreads profile promote reference-model release release-notes rnaseq runtime saas script search selectvariants sequencing service slides snow speed status sting support syntax talks team terminology third-party-tools topstory trivia troll tutorial unifiedgenotyper variantannotator variantrecalibrator vcf-gz version-highlights versions vqsr wdl webinar workflow workshop