HPCdaligner - Online in the Cloud

PROGRAM:

NAME

HPCdaligner - generate a script to run daligner(1)

SYNOPSIS

HPCdaligner [-vbAI] [-kint(14)] [-wint(6)][-hint(35)] [-tint] [-Mint] [-edouble(.70)]
[-lint(1000)] [-sint(100)] [-Hint] [-mtrack]+ [-dalint(4)] [-degint(25)] path:db|dam
[first:int[-last:int]]

DESCRIPTION

HPCdaligner writes a UNIX shell script to the standard output that consists of a sequence
of commands that effectively run daligner(1) on all pairs of blocks of a split database
and then externally sorts and merges them using LAsort(1) and LAmerge(1) into a collection
of alignment files with names path.#.las where # ranges from 1 to the number of blocks the
database is split into. These sorted files if concatenated by say LAcat(1) would contain
all the alignments in sorted order (of a-read, then b-read, and so on). Moreover, all
overlaps for a given a-read are guaranteed to not be split across files, so one can run
artifact analyzers or error correction on each sorted file in parallel.

The database must have been previously split by DBsplit(1) and all the parameters, except
-v, -dal, and -deg, are passed through to the calls to daligner(1). The defaults for
these parameters are as for daligner(1). The -v flag, for verbose-mode, is also passed to
all calls to LAsort(1) and LAmerge(1). -dal and -deg options are described later.

For a database divided into N sub-blocks, the calls to daligner(1) will produce in total
2TN^2 .las files assuming daligner runs with T threads. These will then be sorted and
merged into N^2 sorted .las files, one for each block pair. These are then merged in
ceil(log_deg N) phases where the number of files decreases geometrically in -deg until
there is 1 file per row of the N x N block matrix. So at the end one has N sorted .las
files that when concatenated would give a single large sorted overlap file.

The -dal option (default 4) gives the desired number of block comparisons per call to
daligner(1). Some must contain dal-1 comparisons, and the first dal-2 block comparisons
even less, but the HPCdaligner "planner" does the best it can to give an average load of
dal block comparisons per command. The -deg option (default 25) gives the maximum number
of files that will be merged in a single LAmerge(1) command. The planner makes the most
even k-ary tree of merges, where the number of levels is ceil(log_deg N).

If the integers first and last are missing, then the script produced is for every block in
the database. If first is present, then HPCdaligner produces an incremental script that
compares blocks first through last (last = first if not present) against each other and
all previous blocks 1 through first-1, and then incrementally updates the .las files for
blocks 1 through first-1, and creates the .las files for blocks first through last.

Each UNIX command line output by the HPCdaligner can be a batch job (we use the &&
operator to combine several commands into one line to make this so). Dependencies between
jobs can be maintained simply by first running all the daligner(1) jobs, then all the
initial sort jobs, and then all the jobs in each phase of the external merge sort. Each
of these phases is separated by an informative comment line for your scripting
convenience.

Use HPCdaligner online using onworks.net services