Samtools说明文档网址变更
很多地方都有这个连接：
samtools的说明文档：http://samtools.sourceforge.net/samtools.shtml
但是连不上了，所以现在的地址为：
http://www.htslib.org/doc/samtools.html
分析原因：
连接超时
samtools.sourceforge.net 的服务器响应时间过长。
此站点暂时不可用或者太忙。请稍后再试。
如果您无法载入任何页面，请检查您计算机的网络连接。
如果您的计算机或网络受到防火墙或者代理服务器的保护，请确认 Firefox 已被授权访问网络。
检查原因：
hadoop@Mcnode1:~/cloud/adam/xubo/code$ curl http://samtools.sourceforge.net/samtools.shtml <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN"> <html><head> <title>301 Moved Permanently</title> </head><body> <h1>Moved Permanently</h1> <p>The document has moved <a href="http://www.htslib.org/doc/samtools.html">here</a>.</p> <hr> <address>Apache/2.2.15 (CentOS) Server at samtools.sourceforge.net Port 80</address> </body></html> hadoop@Mcnode1:~/cloud/adam/xubo/code$
原来
Moved Permanently
curl还有这功能。
所以现在的地址为：
http://www.htslib.org/doc/samtools.html
Samtools
Home
Download
Workflows
Documentation
Support
Manual page from samtools-1.3
released on 15 December 2015
NAME
samtools – Utilities for the Sequence Alignment/Map (SAM) format
SYNOPSIS
samtools view -bt ref_list.txt -o aln.bam aln.sam.gz
samtools sort -T /tmp/aln.sorted -o aln.sorted.bam aln.bam
samtools index aln.sorted.bam
samtools idxstats aln.sorted.bam
samtools flagstat aln.sorted.bam
samtools stats aln.sorted.bam
samtools bedcov aln.sorted.bam
samtools depth aln.sorted.bam
samtools view aln.sorted.bam chr2:20,100,000-20,200,000
samtools merge out.bam in1.bam in2.bam in3.bam
samtools faidx ref.fasta
samtools tview aln.sorted.bam ref.fasta
samtools split merged.bam
samtools quickcheck in1.bam in2.cram
samtools dict -a GRCh38 -s "Homo sapiens" ref.fasta
samtools fixmate in.namesorted.sam out.bam
samtools mpileup -C50 -gf ref.fasta -r chr3:1,000-2,000 in1.bam in2.bam
samtools flags PAIRED,UNMAP,MUNMAP
samtools fastq input.bam > output.fastq
samtools fasta input.bam > output.fasta
samtools addreplacerg -r 'ID:fish' -r 'LB:1334' -r 'SM:alpha' -o output.bam input.bam
samtools collate aln.sorted.bam aln.name_collated.bam
samtools depad input.bam
DESCRIPTION
Samtools is a set of utilities that manipulate alignments in the BAM format. It imports from and exports to the SAM (Sequence Alignment/Map) format, does sorting, merging and indexing, and allows to retrieve reads in any regions swiftly.
Samtools is designed to work on a stream. It regards an input file `-' as the standard input (stdin) and an output file `-' as the standard output (stdout). Several commands can thus be combined with Unix pipes. Samtools always output warning and error messages to the standard error output (stderr).
Samtools is also able to open a BAM (not SAM) file on a remote FTP or HTTP server if the BAM file name starts with `ftp://' or `http://'. Samtools checks the current working directory for the index file and will download the index upon absence. Samtools does not retrieve the entire alignment file unless it is asked to do so.
COMMANDS AND OPTIONS
view
samtools view [options] in.sam|in.bam|in.cram [region...]
With no options or regions specified, prints all alignments in the specified input alignment file (in SAM, BAM, or CRAM format) to standard output in SAM format (with no header).
You may specify one or more space-separated region specifications after the input filename to restrict output to only those alignments which overlap the specified region(s). Use of region specifications requires a coordinate-sorted and indexed input file (in BAM or CRAM format).
The -b, -C, -1, -u, -h, -H, and -c options change the output format from the default of headerless SAM, and the -o and -U options set the output file name(s).
The -t and -T options provide additional reference data. One of these two options is required when SAM input does not contain @SQ headers, and the -T option is required whenever writing CRAM output.
The -L, -r, -R, -q, -l, -m, -f, and -F options filter the alignments that will be included in the output to only those alignments that match certain criteria.
The -x, -B, and -s options modify the data which is contained in each alignment.
Finally, the -@ option can be used to allocate additional threads to be used for compression, and the -? option requests a long help message.
REGIONS:
Regions can be specified as: RNAME[:STARTPOS[-ENDPOS]] and all position coordinates are 1-based.
Important note: when multiple regions are given, some alignments may be output multiple times if they overlap more than one of the specified regions.
Examples of region specifications:
chr1
Output all alignments mapped to the reference sequence named `chr1' (i.e. @SQ SN:chr1).
chr2:1000000
The region on chr2 beginning at base position 1,000,000 and ending at the end of the chromosome.
chr3:1000-2000
The 1001bp region on chr3 beginning at base position 1,000 and ending at base position 2,000 (including both end positions).
'*'
Output the unmapped reads at the end of the file. (This does not include any unmapped reads placed on a reference sequence alongside their mapped mates.)
.
Output all alignments. (Mostly unnecessary as not specifying a region at all has the same effect.)
OPTIONS:
-b
Output in the BAM format.
-C
Output in the CRAM format (requires -T).
-1
Enable fast BAM compression (implies -b).
-u
Output uncompressed BAM. This option saves time spent on compression/decompression and is thus preferred when the output is piped to another samtools command.
-h
Include the header in the output.
-H
Output the header only.
-c
Instead of printing the alignments, only count them and print the total number. All filter options, such as -f, -F, and -q, are taken into account.
-?
Output long help and exit immediately.
-o FILE
Output to FILE [stdout].
-U FILE
Write alignments that are not selected by the various filter options to FILE. When this option is used, all alignments (or all alignments intersecting the regions specified) are written to either the output file or this file, but never both.
-t FILE
A tab-delimited FILE. Each line must contain the reference name in the first column and the length of the reference in the second column, with one line for each distinct reference. Any additional fields beyond the second column are ignored. This file also defines the order of the reference sequences in sorting. If you run: `samtools faidx <ref.fa>', the resulting index file <ref.fa>.fai can be used as this FILE.
-T FILE
A FASTA format reference FILE, optionally compressed by bgzip and ideally indexed by samtools faidx. If an index is not present, one will be generated for you.
-L FILE
Only output alignments overlapping the input BED FILE [null].
-r STR
Only output alignments in read group STR [null].
-R FILE
Output alignments in read groups listed in FILE [null].
-q INT
Skip alignments with MAPQ smaller than INT [0].
-l STR
Only output alignments in library STR [null].
-m INT
Only output alignments with number of CIGAR bases consuming query sequence ≥ INT [0]
-f INT
Only output alignments with all bits set in INT present in the FLAG field. INT can be specified in hex by beginning with `0x' (i.e. /^0x[0-9A-F]+/) or in octal by beginning with `0' (i.e. /^0[0-7]+/) [0].
-F INT
Do not output alignments with any bits set in INT present in the FLAG field. INT can be specified in hex by beginning with `0x' (i.e. /^0x[0-9A-F]+/) or in octal by beginning with `0' (i.e. /^0[0-7]+/) [0].
-x STR
Read tag to exclude from output (repeatable) [null]
-B
Collapse the backward CIGAR operation.
-s FLOAT
Integer part is used to seed the random number generator [0]. Part after the decimal point sets the fraction of templates/pairs to subsample [no subsampling].
-@ INT
Number of BAM compression threads to use in addition to main thread [0].
-S
Ignored for compatibility with previous samtools versions. Previously this option was required if input was in SAM format, but now the correct format is automatically detected by examining the first few characters of input.
sort
samtools sort [-l level] [-m maxMem] [-o out.bam] [-O format] [-n] [-T tmpprefix] [-@ threads] [in.sam|in.bam|in.cram]
Sort alignments by leftmost coordinates, or by read name when -n is used. An appropriate @HD-SO sort order header tag will be added or an existing one updated if necessary.
The sorted output is written to standard output by default, or to the specified file (out.bam) when -o is used. This command will also create temporary files tmpprefix.%d.bam as needed when the entire alignment data cannot fit into memory (as controlled via the -m option).
Options:
-l INT
Set the desired compression level for the final output file, ranging from 0 (uncompressed) or 1 (fastest but minimal compression) to 9 (best compression but slowest to write), similarly to gzip(1)'s compression level setting.
If -l is not used, the default compression level will apply.
-m INT
Approximately the maximum required memory per thread, specified either in bytes or with a K, M, or G suffix. [768 MiB]
-n
Sort by read names (i.e., the QNAME field) rather than by chromosomal coordinates.
-o FILE
Write the final sorted output to FILE, rather than to standard output.
-O FORMAT
Write the final output as sam, bam, or cram.
By default, samtools tries to select a format based on the -o filename extension; if output is to standard output or no format can be deduced, bam is selected.
-T PREFIX
Write temporary files to PREFIX.nnnn.bam. By default, any temporary files are written alongside the input file, as in.bam.tmp.nnnn.bam.
-@ INT
Set number of sorting and compression threads. By default, operation is single-threaded.
Historically samtools sort also accepted a less flexible way of specifying the final and temporary output filenames:
samtools sort [-f] [-o] in.bam out.prefix
This has now been removed. The previous out.prefix argument (and -f option, if any) should be changed to an appropriate combination of -T PREFIX and -o FILE. The previous -o option should be removed, as output defaults to standard output.
index
samtools index [-bc] [-m INT] aln.bam|aln.cram [out.index]
Index a coordinate-sorted BAM or CRAM file for fast random access. (Note that this does not work with SAM files even if they are bgzip compressed — to index such files, use tabix(1) instead.)
This index is needed when region arguments are used to limit samtools view and similar commands to particular regions of interest.
If an output filename is given, the index file will be written to out.index. Otherwise, for a CRAM file aln.cram, index file aln.cram.crai will be created; for a BAM file aln.bam, either aln.bam.bai or aln.bam.csi will be created, depending on the index format selected.
Options:
-b
Create a BAI index. This is currently the default when no format options are used.
-c
Create a CSI index. By default, the minimum interval size for the index is 2^14, which is the same as the fixed value used by the BAI format.
-m INT
Create a CSI index, with a minimum interval size of 2^INT.
idxstats
samtools idxstats in.sam|in.bam|in.cram
Retrieve and print stats in the index file corresponding to the input file. Before calling idxstats, the input BAM file must be indexed by samtools index.
The output is TAB-delimited with each line consisting of reference sequence name, sequence length, # mapped reads and # unmapped reads. It is written to stdout.
flagstat
samtools flagstat in.sam|in.bam|in.cram
Does a full pass through the input file to calculate and print statistics to stdout.
Provides counts for each of 13 categories based primarily on bit flags in the FLAG field. Each category in the output is broken down into QC pass and QC fail, which is presented as "#PASS + #FAIL" followed by a description of the category.
The first row of output gives the total number of reads that are QC pass and fail (according to flag bit 0x200). For example:
122 + 28 in total (QC-passed reads + QC-failed reads)
Which would indicate that there are a total of 150 reads in the input file, 122 of which are marked as QC pass and 28 of which are marked as "not passing quality controls"
Following this, additional categories are given for reads which are:
secondary
0x100 bit set
supplementary
0x800 bit set
duplicates
0x400 bit set
mapped
0x4 bit not set
paired in sequencing
0x1 bit set
read1
both 0x1 and 0x40 bits set
read2
both 0x1 and 0x80 bits set
properly paired
both 0x1 and 0x2 bits set and 0x4 bit not set
with itself and mate mapped
0x1 bit set and neither 0x4 nor 0x8 bits set
singletons
both 0x1 and 0x8 bits set and bit 0x4 not set
And finally, two rows are given that additionally filter on the reference name (RNAME), mate reference name (MRNM), and mapping quality (MAPQ) fields:
with mate mapped to a different chr
0x1 bit set and neither 0x4 nor 0x8 bits set and MRNM not equal to RNAME
with mate mapped to a different chr (mapQ>=5)
0x1 bit set and neither 0x4 nor 0x8 bits set and MRNM not equal to RNAME and MAPQ >= 5
stats
samtools stats [options] in.sam|in.bam|in.cram [region...]
samtools stats collects statistics from BAM files and outputs in a text format. The output can be visualized graphically using plot-bamstats.
Options:
-c, --coverage MIN,MAX,STEP
Set coverage distribution to the specified range (MIN, MAX, STEP all given as integers) [1,1000,1]
-d, --remove-dups
Exclude from statistics reads marked as duplicates
-f, --required-flag STR|INT
Required flag, 0 for unset. See also `samtools flags` [0]
-F, --filtering-flag STR|INT
Filtering flag, 0 for unset. See also `samtools flags` [0]
--GC-depth FLOAT
the size of GC-depth bins (decreasing bin size increases memory requirement) [2e4]
-h, --help
This help message
-i, --insert-size INT
Maximum insert size [8000]
-I, --id STR
Include only listed read group or sample name []
-l, --read-length INT
Include in the statistics only reads with the given read length []
-m, --most-inserts FLOAT
Report only the main part of inserts [0.99]
-P, --split-prefix STR
A path or string prefix to prepend to filenames output when creating categorised statistics files with -S/--split. [input filename]
-q, --trim-quality INT
The BWA trimming parameter [0]
-r, --ref-seq FILE
Reference sequence (required for GC-depth and mismatches-per-cycle calculation). []
-S, --split TAG
In addition to the complete statistics, also output categorised statistics based on the tagged field TAG (e.g., use --split RG to split into read groups).
Categorised statistics are written to files named <prefix>_<value>.bamstat, where prefix is as given by --split-prefix (or the input filename by default) and value has been encountered as the specified tagged field's value in one or more alignment records.
-t, --target-regions FILE
Do stats in these regions only. Tab-delimited file chr,from,to, 1-based, inclusive. []
-x, --sparse
Suppress outputting IS rows where there are no insertions.
bedcov
samtools bedcov region.bed in1.sam|in1.bam|in1.cram[...]
Reports read depth per genomic region, as specified in the supplied BED file.
depth
samtools depth [options] [in1.sam|in1.bam|in1.cram [in2.sam|in2.bam|in2.cram] [...]]
Computes the depth at each position or region.
Options:
-a
Output all positions (including those with zero depth)
-a -a, -aa
Output absolutely all positions, including unused reference sequences
-b FILE
Compute depth at list of positions or regions in specified BED FILE. []
-f FILE
Use the BAM files specified in the FILE (a file of filenames, one file per line) []
-l INT
Ignore reads shorter than INT
-m, -d INT
Truncate reported depth at a maximum of INT reads. [8000]
-q INT
Only count reads with base quality greater than INT
-Q INT
Only count reads with mapping quality greater than INT
-r CHR:FROM-TO
Only report depth in specified region.
merge
samtools merge [-nur1f] [-h inh.sam] [-R reg] [-b <list>] <out.bam> <in1.bam> [<in2.bam> <in3.bam> ... <inN.bam>]
Merge multiple sorted alignment files, producing a single sorted output file that contains all the input records and maintains the existing sort order.
If -h is specified the @SQ headers of input files will be merged into the specified header, otherwise they will be merged into a composite header created from the input headers. If in the process of merging @SQ lines for coordinate sorted input files, a conflict arises as to the order (for example input1.bam has @SQ for a,b,c and input2.bam has b,a,c) then the resulting output file will need to be re-sorted back into coordinate order.
Unless the -c or -p flags are specified then when merging @RG and @PG records into the output header then any IDs found to be duplicates of existing IDs in the output header will have a suffix appended to them to diffientiate them from similar header records from other files and the read records will be updated to reflect this.
OPTIONS:
-1
Use zlib compression level 1 to compress the output.
-b FILE
List of input BAM files, one file per line.
-f
Force to overwrite the output file if present.
-h FILE
Use the lines of FILE as `@' headers to be copied to out.bam, replacing any header lines that would otherwise be copied from in1.bam. (FILE is actually in SAM format, though any alignment records it may contain are ignored.)
-n
The input alignments are sorted by read names rather than by chromosomal coordinates
-R STR
Merge files in the specified region indicated by STR [null]
-r
Attach an RG tag to each alignment. The tag value is inferred from file names.
-u
Uncompressed BAM output
-c
When several input files contain @RG headers with the same ID, emit only one of them (namely, the header line from the first file we find that ID in) to the merged output file. Combining these similar headers is usually the right thing to do when the files being merged originated from the same file.
Without -c, all @RG headers appear in the output file, with random suffices added to their IDs where necessary to differentiate them.
-p
Similarly, for each @PG ID in the set of files to merge, use the @PG line of the first file we find that ID in rather than adding a suffix to differentiate similar IDs.
faidx
samtools faidx <ref.fasta> [region1 [...]]
Index reference sequence in the FASTA format or extract subsequence from indexed reference sequence. If no region is specified, faidx will index the file and create <ref.fasta>.fai on the disk. If regions are specified, the subsequences will be retrieved and printed to stdout in the FASTA format.
The input file can be compressed in the BGZF format.
The sequences in the input file should all have different names. If they do not, indexing will emit a warning about duplicate sequences and retrieval will only produce subsequences from the first sequence with the duplicated name.
tview
samtools tview [-p chr:pos] [-s STR] [-d display] <in.sorted.bam> [ref.fasta]
Text alignment viewer (based on the ncurses library). In the viewer, press `?' for help and press `g' to check the alignment start from a region in the format like `chr10:10,000,000' or `=10,000,000' when viewing the same reference sequence.
Options:
-d display
Output as (H)tml or (C)urses or (T)ext
-p chr:pos
Go directly to this position
-s STR
Display only alignments from this sample or read group
split
samtools split [options] merged.sam|merged.bam|merged.cram
Splits a file by read group.
Options:
-u FILE1
Put reads with no RG tag or an unrecognised RG tag into FILE1
-u FILE1:FILE2
As above, but assigns an RG tag as given in the header of FILE2
-f STRING
Output filename format string (see below) ["%*_%#.%."]
-v
Verbose output
Format string expansions:
%% %
%* basename
%# @RG index
%! @RG ID
%. output format filename extension
quickcheck
samtools quickcheck [options] in.sam|in.bam|in.cram [ ... ]
Quickly check that input files appear to be intact. Checks that beginning of the file contains a valid header (all formats) containing at least one target sequence and then seeks to the end of the file and checks that an end-of-file (EOF) is present and intact (BAM only).
Data in the middle of the file is not read since that would be much more time consuming, so please note that this command will not detect internal corruption, but is useful for testing that files are not truncated before performing more intensive tasks on them.
This command will exit with a non-zero exit code if any input files don't have a valid header or are missing an EOF block. Otherwise it will exit successfully (with a zero exit code).
Options:
-v
Verbose output: will additionally print the names of all input files that don't pass the check to stdout. Multiple -v options will cause additional messages regarding check results to be printed to stderr.
dict
samtools dict <ref.fasta|ref.fasta.gz>
Create a sequence dictionary file from a fasta file.
OPTIONS:
-a, --assembly STR
Specify the assembly for the AS tag.
-H, --no-header
Do not print the @HD header line.
-o, --output FILE
Output to FILE [stdout].
-s, --species STR
Specify the species for the SP tag.
-u, --uri STR
Specify the URI for the UR tag. Defaults to the absolute path of ref.fasta unless reading from stdin.
fixmate
samtools fixmate [-rpc] [-O format] in.nameSrt.bam out.bam
Fill in mate coordinates, ISIZE and mate related flags from a name-sorted alignment.
OPTIONS:
-r
Remove secondary and unmapped reads.
-p
Disable FR proper pair check.
-c
Add template cigar ct tag.
-O FORMAT
Write the final output as sam, bam, or cram.
By default, samtools tries to select a format based on the output filename extension; if output is to standard output or no format can be deduced, bam is selected.
mpileup
samtools mpileup [-EBugp] [-C capQcoef] [-r reg] [-f in.fa] [-l list] [-Q minBaseQ] [-q minMapQ] in.bam [in2.bam [...]]
Generate VCF, BCF or pileup for one or multiple BAM files. Alignment records are grouped by sample (SM) identifiers in @RG header lines. If sample identifiers are absent, each input file is regarded as one sample.
In the pileup format (without -u or -g), each line represents a genomic position, consisting of chromosome name, 1-based coordinate, reference base, the number of reads covering the site, read bases, base qualities and alignment mapping qualities. Information on match, mismatch, indel, strand, mapping quality and start and end of a read are all encoded at the read base column. At this column, a dot stands for a match to the reference base on the forward strand, a comma for a match on the reverse strand, a '>' or '<' for a reference skip, `ACGTN' for a mismatch on the forward strand and `acgtn' for a mismatch on the reverse strand. A pattern `\\+[0-9]+[ACGTNacgtn]+' indicates there is an insertion between this reference position and the next reference position. The length of the insertion is given by the integer in the pattern, followed by the inserted sequence. Similarly, a pattern `-[0-9]+[ACGTNacgtn]+' represents a deletion from the reference. The deleted bases will be presented as `*' in the following lines. Also at the read base column, a symbol `^' marks the start of a read. The ASCII of the character following `^' minus 33 gives the mapping quality. A symbol `$' marks the end of a read segment.
Input Options:
-6, --illumina1.3+
Assume the quality is in the Illumina 1.3+ encoding.
-A, --count-orphans
Do not skip anomalous read pairs in variant calling.
-b, --bam-list FILE
List of input BAM files, one file per line [null]
-B, --no-BAQ
Disable probabilistic realignment for the computation of base alignment quality (BAQ). BAQ is the Phred-scaled probability of a read base being misaligned. Applying this option greatly helps to reduce false SNPs caused by misalignments.
-C, --adjust-MQ INT
Coefficient for downgrading mapping quality for reads containing excessive mismatches. Given a read with a phred-scaled probability q of being generated from the mapped position, the new mapping quality is about sqrt((INT-q)/INT)*INT. A zero value disables this functionality; if enabled, the recommended value for BWA is 50. [0]
-d, --max-depth INT
At a position, read maximally INT reads per input BAM. [250]
-E, --redo-BAQ
Recalculate BAQ on the fly, ignore existing BQ tags
-f, --fasta-ref FILE
The faidx-indexed reference file in the FASTA format. The file can be optionally compressed by bgzip. [null]
-G, --exclude-RG FILE
Exclude reads from readgroups listed in FILE (one @RG-ID per line)
-l, --positions FILE
BED or position list file containing a list of regions or sites where pileup or BCF should be generated. If BED, positions are 0-based half-open [null]
-q, -min-MQ INT
Minimum mapping quality for an alignment to be used [0]
-Q, --min-BQ INT
Minimum base quality for a base to be considered [13]
-r, --region STR
Only generate pileup in region. Requires the BAM files to be indexed. If used in conjunction with -l then considers the intersection of the two requests. STR [all sites]
-R, --ignore-RG
Ignore RG tags. Treat all reads in one BAM as one sample.
--rf, --incl-flags STR|INT
Required flags: skip reads with mask bits unset [null]
--ff, --excl-flags STR|INT
Filter flags: skip reads with mask bits set [UNMAP,SECONDARY,QCFAIL,DUP]
-x, --ignore-overlaps
Disable read-pair overlap detection.
Output Options:
-o, --output FILE
Write pileup or VCF/BCF output to FILE, rather than the default of standard output.
(The same short option is used for both --open-prob and --output. If -o's argument contains any non-digit characters other than a leading + or - sign, it is interpreted as --output. Usually the filename extension will take care of this, but to write to an entirely numeric filename use -o ./123 or --output 123.)
-g, --BCF
Compute genotype likelihoods and output them in the binary call format (BCF). As of v1.0, this is BCF2 which is incompatible with the BCF1 format produced by previous (0.1.x) versions of samtools.
-v, --VCF
Compute genotype likelihoods and output them in the variant call format (VCF). Output is bgzip-compressed VCF unless -u option is set.
Output Options for mpileup format (without -g or -v):
-O, --output-BP
Output base positions on reads.
-s, --output-MQ
Output mapping quality.
Output Options for VCF/BCF format (with -g or -v):
-D
Output per-sample read depth [DEPRECATED - use -t DP instead]
-S
Output per-sample Phred-scaled strand bias P-value [DEPRECATED - use -t SP instead]
-t, --output-tags LIST
Comma-separated list of FORMAT and INFO tags to output (case-insensitive): AD (Allelic depth, FORMAT), INFO/AD (Total allelic depth, INFO), ADF (Allelic depths on the forward strand, FORMAT), INFO/ADF (Total allelic depths on the forward strand, INFO), ADR (Allelic depths on the reverse strand, FORMAT), INFO/ADR (Total allelic depths on the reverse strand, INFO), DP (Number of high-quality bases, FORMAT), DV (Deprecated in favor of AD; Number of high-quality non-reference bases, FORMAT), DPR (Deprecated in favor of AD; Number of high-quality bases for each observed allele, FORMAT), INFO/DPR (Number of high-quality bases for each observed allele, INFO), DP4 (Deprecated in favor of ADF and ADR; Number of high-quality ref-forward, ref-reverse, alt-forward and alt-reverse bases, FORMAT), SP (Phred-scaled strand bias P-value, FORMAT) [null]
-u, --uncompressed
Generate uncompressed VCF/BCF output, which is preferred for piping.
-V
Output per-sample number of non-reference reads [DEPRECATED - use -t DV instead]
Options for SNP/INDEL Genotype Likelihood Computation (for -g or -v):
-e, --ext-prob INT
Phred-scaled gap extension sequencing error probability. Reducing INT leads to longer indels. [20]
-F, --gap-frac FLOAT
Minimum fraction of gapped reads [0.002]
-h, --tandem-qual INT
Coefficient for modeling homopolymer errors. Given an l-long homopolymer run, the sequencing error of an indel of size s is modeled as INT*s/l. [100]
-I, --skip-indels
Do not perform INDEL calling
-L, --max-idepth INT
Skip INDEL calling if the average per-sample depth is above INT. [250]
-m, --min-ireads INT
Minimum number gapped reads for indel candidates INT. [1]
-o, --open-prob INT
Phred-scaled gap open sequencing error probability. Reducing INT leads to more indel calls. [40]
(The same short option is used for both --open-prob and --output. When -o's argument contains only an optional + or - sign followed by the digits 0 to 9, it is interpreted as --open-prob.)
-p, --per-sample-mF
Apply -m and -F thresholds per sample to increase sensitivity of calling. By default both options are applied to reads pooled from all samples.
-P, --platforms STR
Comma-delimited list of platforms (determined by @RG-PL) from which indel candidates are obtained. It is recommended to collect indel candidates from sequencing technologies that have low indel error rate such as ILLUMINA. [all]
flags
samtools flags INT|STR[,...]
Convert between textual and numeric flag representation.
FLAGS:
0x1 PAIRED paired-end (or multiple-segment) sequencing technology
0x2 PROPER_PAIR each segment properly aligned according to the aligner
0x4 UNMAP segment unmapped
0x8 MUNMAP next segment in the template unmapped
0x10 REVERSE SEQ is reverse complemented
0x20 MREVERSE SEQ of the next segment in the template is reverse complemented
0x40 READ1 the first segment in the template
0x80 READ2 the last segment in the template
0x100 SECONDARY secondary alignment
0x200 QCFAIL not passing quality controls
0x400 DUP PCR or optical duplicate
0x800 SUPPLEMENTARY supplementary alignment
fastq/a
samtools fastq [options] in.bam
samtools fasta [options] in.bam
Converts a BAM or CRAM into either FASTQ or FASTA format depending on the command invoked.
OPTIONS:
-n
By default, either '/1' or '/2' is added to the end of read names where the corresponding BAM_READ1 or BAM_READ2 flag is set. Using -n causes read names to be left as they are.
-O
Use quality values from OQ tags in preference to standard quality string if available.
-s FILE
Write singleton reads in FASTQ format to FILE instead of outputting them.
-t
Copy RG, BC and QT tags to the FASTQ header line, if they exist.
-1 FILE
Write reads with the BAM_READ1 flag set to FILE instead of outputting them.
-2 FILE
Write reads with the BAM_READ2 flag set to FILE instead of outputting them.
-0 FILE
Write reads with both or neither of the BAM_READ1 and BAM_READ2 flags set to FILE instead of outputting them.
-f INT
Only output alignments with all bits set in INT present in the FLAG field. INT can be specified in hex by beginning with `0x' (i.e. /^0x[0-9A-F]+/) or in octal by beginning with `0' (i.e. /^0[0-7]+/) [0].
-F INT
Do not output alignments with any bits set in INT present in the FLAG field. INT can be specified in hex by beginning with `0x' (i.e. /^0x[0-9A-F]+/) or in octal by beginning with `0' (i.e. /^0[0-7]+/) [0].
collate
samtools collate [options] in.sam|in.bam|in.cram [out.prefix]
Shuffles and groups reads together by their names. A faster alternative to a full query name sort, collate ensures that reads of the same name are grouped together in contiguous groups, but doesn't make any guarantees about the order of read names between groups.
The output from this command should be suitable for any operation that requires all reads from the same template to be grouped together.
Options:
-O
Output to stdout rather than to files starting with out.prefix
-u
Write uncompressed BAM output
-l INT
Compression level. [1]
-n INT
Number of temporary files to use. [64]
reheader
samtools reheader [-iP] in.header.sam in.bam
Replace the header in in.bam with the header in in.header.sam. This command is much faster than replacing the header with a BAM→SAM→BAM conversion.
By default this command outputs the BAM or CRAM file to standard output (stdout), but for CRAM format files it has the option to perform an in-place edit, both reading and writing to the same file. No validity checking is performed on the header, nor that it is suitable to use with the sequence data itself.
OPTIONS:
-P, --no-PG
Do not generate an @PG header line.
-i, --in-place
Perform the header edit in-place, if possible. This only works on CRAM files and only if there is sufficient room to store the new header. The amount of space available will differ for each CRAM file.
cat
samtools cat [-h header.sam] [-o out.bam] <in1.bam> <in2.bam> [ ... ]
Concatenate BAMs. The sequence dictionary of each input BAM must be identical, although this command does not check this. This command uses a similar trick to reheader which enables fast BAM concatenation.
rmdup
samtools rmdup [-sS] <input.srt.bam> <out.bam>
Remove potential PCR duplicates: if multiple read pairs have identical external coordinates, only retain the pair with highest mapping quality. In the paired-end mode, this command ONLY works with FR orientation and requires ISIZE is correctly set. It does not work for unpaired reads (e.g. two ends mapped to different chromosomes or orphan reads).
OPTIONS:
-s
Remove duplicates for single-end reads. By default, the command works for paired-end reads only.
-S
Treat paired-end reads and single-end reads.
addreplacerg
samtools addreplacerg [-r rg line | -R rg ID] [-m mode] [-l level] [-o out.bam] <input.bam>
Adds or replaces read group tags in a file.
OPTIONS:
-r STRING
Allows you to specify a read group line to append to the header and applies it to the reads specified by the -m option. If repeated it automatically adds in tabs between invocations.
-R STRING
Allows you to specify the read group ID of an existing @RG line and applies it to the reads specified.
-m MODE
If you choose orphan_only then existing RG tags are not overwritten, if you choose overwrite_all, existing RG tags are overwritten. The default is overwrite_all.
-o STRING
Write the final output to STRING. The default is to write to stdout.
By default, samtools tries to select a format based on the output filename extension; if output is to standard output or no format can be deduced, bam is selected.
calmd
samtools calmd [-Eeubr] [-C capQcoef] <aln.bam> <ref.fasta>
Generate the MD tag. If the MD tag is already present, this command will give a warning if the MD tag generated is different from the existing tag. Output SAM by default.
Calmd can also read and write CRAM files although in most cases it is pointless as CRAM recalculates MD and NM tags on the fly. The one exception to this case is where both input and output CRAM files have been / are being created with the no_ref option.
OPTIONS:
-A
When used jointly with -r this option overwrites the original base quality.
-e
Convert a the read base to = if it is identical to the aligned reference base. Indel caller does not support the = bases at the moment.
-u
Output uncompressed BAM
-b
Output compressed BAM
-C INT
Coefficient to cap mapping quality of poorly mapped reads. See the pileup command for details. [0]
-r
Compute the BQ tag (without -A) or cap base quality by BAQ (with -A).
-E
Extended BAQ calculation. This option trades specificity for sensitivity, though the effect is minor.
targetcut
samtools targetcut [-Q minBaseQ] [-i inPenalty] [-0 em0] [-1 em1] [-2 em2] [-f ref] <in.bam>
This command identifies target regions by examining the continuity of read depth, computes haploid consensus sequences of targets and outputs a SAM with each sequence corresponding to a target. When option -f is in use, BAQ will be applied. This command is only designed for cutting fosmid clones from fosmid pool sequencing [Ref. Kitzman et al. (2010)].
phase
samtools phase [-AF] [-k len] [-b prefix] [-q minLOD] [-Q minBaseQ] <in.bam>
Call and phase heterozygous SNPs.
OPTIONS:
-A
Drop reads with ambiguous phase.
-b STR
Prefix of BAM output. When this option is in use, phase-0 reads will be saved in file STR.0.bam and phase-1 reads in STR.1.bam. Phase unknown reads will be randomly allocated to one of the two files. Chimeric reads with switch errors will be saved in STR.chimeric.bam. [null]
-F
Do not attempt to fix chimeric reads.
-k INT
Maximum length for local phasing. [13]
-q INT
Minimum Phred-scaled LOD to call a heterozygote. [40]
-Q INT
Minimum base quality to be used in het calling. [13]
depad
samtools depad [-SsCu1] [-T ref.fa] [-o output] <in.bam>
Converts a BAM aligned against a padded reference to a BAM aligned against the depadded reference. The padded reference may contain verbatim "*" bases in it, but "*" bases are also counted in the reference numbering. This means that a sequence base-call aligned against a reference "*" is considered to be a cigar match ("M" or "X") operator (if the base-call is "A", "C", "G" or "T"). After depadding the reference "*" bases are deleted and such aligned sequence base-calls become insertions. Similarly transformations apply for deletions and padding cigar operations.
OPTIONS:
-S
Ignored for compatibility with previous samtools versions. Previously this option was required if input was in SAM format, but now the correct format is automatically detected by examining the first few characters of input.
-s
Output in SAM format. The default is BAM.
-C
Output in CRAM format. The default is BAM.
-u
Do not compress the output. Applies to either BAM or CRAM output format.
-1
Enable fastest compression level. Only works for BAM or CRAM output.
-T FILE
Provides the padded reference file. Note that without this the @SQ line lengths will be incorrect, so for most use cases this option will be considered as mandatory.
-o FILE
Specifies the output filename. By default output is sent to stdout.
help, --help
Display a brief usage message listing the samtools commands available. If the name of a command is also given, e.g., samtools help view, the detailed usage message for that particular command is displayed.
--version
Display the version numbers and copyright information for samtools and the important libraries used by samtools.
--version-only
Display the full samtools version number in a machine-readable format.
GLOBAL OPTIONS
Several long-options are shared between multiple samtools subcommands: --input-fmt, --input-fmt-options, --output-fmt, --output-fmt-options, and --reference. The input format is typically auto-detected so specifying the format is usually unnecessary and the option is included for completeness. Note that not all subcommands have all options. Consult the subcommand help for more details.
Format strings recognised are "sam", "bam" and "cram". They may be followed by a comma separated list of options as key or key=value. See below for examples.
The fmt-options arguments accept either a single option or option=value. Note that some options only work on some file formats and only on read or write streams. If value is unspecified for a boolean option, the value is assumed to be 1. The valid options are as follows.
nthreads=INT
Specifies the number of threads to use during encoding and/or decoding. For BAM this will be encoding only. In CRAM the threads are dynamically shared between encoder and decoder.
reference=fasta_file
Specifies a FASTA reference file for use in CRAM encoding or decoding. It usually is not required for decoding except in the situation of the MD5 not being obtainable via the REF_PATH or REF_CACHE environment variables.
decode_md=0|1
CRAM decode only; defaults to 1 (on). CRAM does not typically store MD and NM tags, preferring to generate them on the fly. This option controls this behaviour.
ignore_md5=0|1
CRAM decode only; defaults to 0 (off). When enabled, md5 checksum errors on the reference sequence and block checksum errors within CRAM are ignored. Use of this option is strongly discouraged.
required_fields=bit-field
CRAM decode only; specifies which SAM columns need to be populated. By default all fields are used. Limiting the decode to specific columns can have significant performance gains. The bit-field is a numerical value constructed from the following table.
0x1 SAM_QNAME
0x2 SAM_FLAG
0x4 SAM_RNAME
0x8 SAM_POS
0x10 SAM_MAPQ
0x20 SAM_CIGAR
0x40 SAM_RNEXT
0x80 SAM_PNEXT
0x100 SAM_TLEN
0x200 SAM_SEQ
0x400 SAM_QUAL
0x800 SAM_AUX
0x1000 SAM_RGAUX
multi_seq_per_slice=0|1
CRAM encode only; defaults to 0 (off). By default CRAM generates one container per reference sequence, except in the case of many small references (such as a fragmented assembly).
version=major.minor
CRAM encode only. Specifies the CRAM version number. Acceptable values are "2.1" and "3.0".
seqs_per_slice=INT
CRAM encode only; defaults to 10000.
slices_per_container=INT
CRAM encode only; defaults to 1. The effect of having multiple slices per container is to share the compression header block between multiple slices. This is unlikely to have any significant impact unless the number of sequences per slice is reduced. (Together these two options control the granularity of random access.)
embed_ref=0|1
CRAM encode only; defaults to 0 (off). If 1, this will store portions of the reference sequence in each slice, permitting decode without having requiring an external copy of the reference sequence.
no_ref=0|1
CRAM encode only; defaults to 0 (off). If 1, sequences will be stored verbatim with no reference encoding. This can be useful if no reference is available for the file.
For example:
samtools view --input-fmt-option decode_md=0
--output-fmt cram,version=3.0 --output-fmt-option embed_ref
--output-fmt-option seqs_per_slice=2000 -o foo.cram foo.bam
REFERENCE SEQUENCES
The CRAM format requires use of a reference sequence for both reading and writing.
When reading a CRAM the @SQ headers are interrogated to identify the reference sequence MD5sum (M5: tag) and the local reference sequence filename (UR: tag). Note that http:// and ftp:// based URLs in the UR: field are not used, but local fasta filenames (with or without file://) can be used.
To create a CRAM the @SQ headers will also be read to identify the reference sequences, but M5: and UR: tags may not be present. In this case the -T and -t options of samtools view may be used to specify the fasta or fasta.fai filenames respectively (provided the .fasta.fai file is also backed up by a .fasta file).
The search order to obtain a reference is:
Use any local file specified by the command line options (eg -T).
Look for MD5 via REF_CACHE environment variable.
Look for MD5 in each element of the REF_PATH environment variable.
Look for a local file listed in the UR: header tag.
ENVIRONMENT VARIABLES
HTS_PATH
A colon-separated list of directories in which to search for HTSlib plugins. If $HTS_PATH starts or ends with a colon or contains a double colon (::), the built-in list of directories is searched at that point in the search.
If no HTS_PATH variable is defined, the built-in list of directories specified when HTSlib was built is used, which typically includes /usr/local/libexec/htslib and similar directories.
REF_PATH
A colon separated (semi-colon on Windows) list of locations in which to look for sequences identified by their MD5sums. This can be either a list of directories or URLs. Note that if a URL is included then the colon in http:// and ftp:// and the optional port number will be treated as part of the URL and not a PATH field separator. For URLs, the text %s will be replaced by the MD5sum being read.
If no REF_PATH has been specified it will default to http://www.ebi.ac.uk/ena/cram/md5/%s and if REF_CACHE is also unset, it will be set to $XDG_CACHE_HOME/hts-ref/%2s/%2s/%s. If $XDG_CACHE_HOME is unset, $HOME/.cache (or a local system temporary directory if no home directory is found) will be used similarly.
REF_CACHE
This can be defined to a single directory housing a local cache of references. Upon downloading a reference it will be stored in the location pointed to by REF_CACHE. When reading a reference it will be looked for in this directory before searching REF_PATH. To avoid many files being stored in the same directory, a pathname may be constructed using %nums and %s notation, consuming num characters of the MD5sum. For example /local/ref_cache/%2s/%2s/%s will create 2 nested subdirectories with the filenames in the deepest directory being the last 28 characters of the md5sum.
The REF_CACHE directory will be searched for before attempting to load via the REF_PATH search list. If no REF_PATH is defined, both REF_PATH and REF_CACHE will be automatically set (see above), but if REF_PATH is defined and REF_CACHE not then no local cache is used.
To aid population of the REF_CACHE directory a script misc/seq_cache_populate.pl is provided in the Samtools distribution. This takes a fasta file or a directory of fasta files and generates the MD5sum named files.
EXAMPLES
Import SAM to BAM when @SQ lines are present in the header:
samtools view -bS aln.sam > aln.bam
If @SQ lines are absent:
samtools faidx ref.fa
samtools view -bt ref.fa.fai aln.sam > aln.bam
where ref.fa.fai is generated automatically by the faidx command.
Convert a BAM file to a CRAM file using a local reference sequence.
samtools view -C -T ref.fa aln.bam > aln.cram
Attach the RG tag while merging sorted alignments:
perl -e 'print "@RG\\tID:ga\\tSM:hs\\tLB:ga\\tPL:Illumina\\n@RG\\tID:454\\tSM:hs\\tLB:454\\tPL:454\\n"' > rg.txt
samtools merge -rh rg.txt merged.bam ga.bam 454.bam
The value in a RG tag is determined by the file name the read is coming from. In this example, in the merged.bam, reads from ga.bam will be attached RG:Z:ga, while reads from 454.bam will be attached RG:Z:454.
Call SNPs and short INDELs:
samtools mpileup -uf ref.fa aln.bam | bcftools call -mv > var.raw.vcf
bcftools filter -s LowQual -e '%QUAL<20 || DP>100' var.raw.vcf > var.flt.vcf
The bcftools filter command marks low quality sites and sites with the read depth exceeding a limit, which should be adjusted to about twice the average read depth (bigger read depths usually indicate problematic regions which are often enriched for artefacts). One may consider to add -C50 to mpileup if mapping quality is overestimated for reads containing excessive mismatches. Applying this option usually helps BWA-short but may not other mappers.
Individuals are identified from the SM tags in the @RG header lines. Individuals can be pooled in one alignment file; one individual can also be separated into multiple files. The -P option specifies that indel candidates should be collected only from read groups with the @RG-PL tag set to ILLUMINA. Collecting indel candidates from reads sequenced by an indel-prone technology may affect the performance of indel calling.
Generate the consensus sequence for one diploid individual:
samtools mpileup -uf ref.fa aln.bam | bcftools call -c | vcfutils.pl vcf2fq > cns.fq
Phase one individual:
samtools calmd -AEur aln.bam ref.fa | samtools phase -b prefix - > phase.out
The calmd command is used to reduce false heterozygotes around INDELs.
Dump BAQ applied alignment for other SNP callers:
samtools calmd -bAr aln.bam > aln.baq.bam
It adds and corrects the NM and MD tags at the same time. The calmd command also comes with the -C option, the same as the one in pileup and mpileup. Apply if it helps.
LIMITATIONS
Unaligned words used in bam_import.c, bam_endian.h, bam.c and bam_aux.c.
Samtools paired-end rmdup does not work for unpaired reads (e.g. orphan reads or ends mapped to different chromosomes). If this is a concern, please use Picard's MarkDuplicates which correctly handles these cases, although a little slower.
AUTHOR
Heng Li from the Sanger Institute wrote the original C version of samtools. Bob Handsaker from the Broad Institute implemented the BGZF library. James Bonfield from the Sanger Institute developed the CRAM implementation. John Marshall and Petr Danecek contribute to the source code and various people from the 1000 Genomes Project have contributed to the SAM format specification.
SEE ALSO
bcftools(1), sam(5), tabix(1)
Samtools website: <http://www.htslib.org/>
File format specification of SAM/BAM,CRAM,VCF/BCF: <http://samtools.github.io/hts-specs>
Samtools latest source: <https://github.com/samtools/samtools>
HTSlib latest source: <https://github.com/samtools/htslib>
Bcftools website: <http://samtools.github.io/bcftools>
Copyright © 2015 Genome Research Limited (reg no. 2742969) is a charity registered in England with number 1021457. Terms and conditions.