News

ATAV 6.6.3

Added by Nick Ren about 1 month ago

Bugs fixed:
  • Collapsing function ran out of memory when system call to run permutation based empirical Q-Q plots. (issue #2732)
  • --mtr-centile input cutoff value changed from "0-1" to "0-100". (issue #2708)

Note: if your atav log only includes "ATAV command" after the collapsing runs, that means it ran out of memory when calling perm qq plot script. The gene summary file and gene matrix file should be completed already.

ATAV 6.6.2

Added by Nick Ren 2 months ago

New Feature:
  • Support to output and filter by MTR dataset (issue #2708)

more MTR related command options, check Variant Level Filter Options.

Improvements:
  • Updated TraP score to version 2.0. (issue #2690)
  • Fixed 'Out of memory' issue for regional collapsing permutation QQ plot creation. (issue #2732)

ATAV 6.6.1

Added by Nick Ren 4 months ago

Bugs fixed:
  • Wrong values in "Case Maf" and "Ctrl Maf" columns from the output (--list-var-geno only) (issue #2632)
New Feature:
  • Support to output and filter by DiscovEHR (regeneron popn ctrls) AFs (issue #2591)
  • Add gene demain / exon filters (SubRVIS & Bis scores) (issue #2560)

please referred to Variant Level Filter Options for command details.

Improvements:
  • Update KnownVar 2017 Q2 (issue #2600)

Submit ATAV to cluster

Added by Nick Ren 4 months ago

As part of our efforts to increase operational efficiency, we are migrating the ATAV application to use the IGM cluster. One important distinction in this framework is that these nodes are lightweight nodes – they SHOULD NOT be used for any compute intensive applications. Please DO NOT run ATAV or any other programs locally on that submit host server as any these will crash the submit host and make it unavailable for all users.

We have setup two submit host servers for ATAV jobs submission to cluster. For internal users who can access igm-atav03 and igm-atav04, please ssh to: 10.73.52.20 (igm-atav-qsub01).
For external users who can access igm-atav05, please ssh to: 10.73.50.99 (igm-atav-qsub02)
These host are designed to be used to submit jobs using qsub, So all submit commands should be prefixed with this – and your job will automatically be submitted to cluster.

Ex.

qsub /nfs/goldstein/software/sh/atav.sh \
--list-var-geno \
--sample /nfs/goldstein/software/atav_home/data/sample/ALS_1424_DukeGr_ctrl.txt \
--function /nfs/goldstein/software/atav_home/data/function/functional.txt \
--gene TBK1 \
--ctrl-maf 0.01 \
--min-coverage 10 \
--out ~/hello_atav

We will keep the current ATAV servers accessible for another week after which we plan to slowly repurpose them. Feel free to contact us if you have any questions or concerns.

Updated Note (11/20/2017):
We have completed the infrastructure change. For detail guide on how to run ATAV jobs, please refer to https://redmine.igm.cumc.columbia.edu/projects/atav/wiki/SGE_Cluster_Guide.

ATAV 6.6

Added by Nick Ren 5 months ago

New Feature:
  • Added a new filter option --min-covered-sample-binomial-p to Collapsing function. (issue #2385)

Ex. --min-covered-sample-binomial-p 0.05
We recommend using a standard nominal significance threshold of 0.05 in order to exclude variants at sites with statistically significant coverage differences between cases and controls. Thresholds greater than 0.05 will exclude more variants. Care should be taken using thresholds below 0.05, as inflation can be an issue as the number of permitted variants increases.
This test is performed using the user-provided --min-coverage threshold (e.g. 10x or 20x) to determine covered/not covered status for each sample at each site.
See attached PDF for a detailed description of the binomial coverage comparison test, as well as testing results from two cohorts.
Attachment: https://redmine.igm.cumc.columbia.edu/attachments/download/1301/binomial_coverage_comparison_description.pdf

  • Added gnomAD Genome dataset and command options (issue #2445):
    --gnomad-genome-pop
    --gnomad-genome-maf
    --gnomad-genome-as-rf-snv
    --gnomad-genome-as-rf-indel
    --include-genome-exome
    
Improvements:
  • Warn users of duplicate CHGVIDs. (issue #2462)
  • Added a new toolkit Cohort Selection to generate ATAV input sample file:

run /nfs/goldstein/software/cohort_selection/build_cohort.py --help to see options.

ATAV 6.5.9

Added by Nick Ren 7 months ago

Improvements:
  • Update KnownVar 2017 Q2 (issue #2345)
Changes:
  • Polyphen score for CCDS transcripts (issue #2362)

ATAV 6.5.8

Added by Nick Ren 8 months ago

New features:
  • Added new genotype QC filter command options that can be used separately for SNVs and indels. (issue #2338)

Ex. --snv-fs 60, --indel-fs 200
For more QC filter options, check Genotype Level Filter Options.

ATAV 6.5.7

Added by Nick Ren 9 months ago

New Features:
  • Added gnomAD Exome dataset and command options (issue #2284):
    --gnomad-exome-pop
    --gnomad-exome-maf
    --gnomad-exome-as-rf-snv
    --gnomad-exome-as-rf-indel
    --include-gnomad-exome
    
Changes:
  • All ExAC command options refer to use v0.3 dataset (ATAV 6.5.5 and ATAV 6.5.6 used gnomAD Exome dataset for the following command options):
    --exac-pop
    --exac-maf
    --min-exac-vqslod-snv
    --min-exac-vqslod-indel
    --include-exac
    
  • --include-all-external-data command option disabled, check here for the command options to include external dataset in your analysis.

Please note that IGM has contributed samples in gnomAD, you need to check before using gnomAD data or continue using ExAC data.

ATAV 6.5.6

Added by Nick Ren 9 months ago

Bugs fixed:
  • Fixed wrong genotype count issue and missing values (ExAC Sample Covered 10x, ExAC AB MEDIAN, ExAC GQ MEDIAN, ExAC AS RF) in ExAC v2. (issue #2213)
New Features:
  • Added new ExAC filter --min-exac-as-rf-snv and --min-exac-as-rf-indel. (issue #2213)

Suggested cutoffs are prob >= 0.1 (high-confidence SNVs) and prob >= 0.2 (high-confidence indels)

ATAV 6.5.5

Added by Nick Ren 9 months ago

Improvements:
  • Update ExAC from version 0.3 to 2.0 (issue #2213) - beta version

Added one more population: ASJ
Added four additional fields:

ExAC filter
ExAC AB MEDIAN
ExAC GQ MEDIAN
ExAC AS RF

--min-exac-vqslod-snv and --min-exac-vqslod-indel is no longer support since VQSLOD doesn't perform well at large scale joint-calling.

1 2 3 ... 8 (1-10/74)

Also available in: Atom