OnWorks favicon

ids2ngram - Online in the Cloud

Run ids2ngram in OnWorks free hosting provider over Ubuntu Online, Fedora Online, Windows online emulator or MAC OS online emulator

This is the command ids2ngram that can be run in the OnWorks free hosting provider using one of our multiple free online workstations such as Ubuntu Online, Fedora Online, Windows online emulator or MAC OS online emulator



ids2ngram - generate n-gram data file from ids file


ids2ngram [option]... ids_file...


ids2ngram generates idngram file, which is a sorted [id1,..,idN,freq] array, from binary
id stream files. Here, the id stream files are always generated by mmseg or slmseg.
Basically, it finds all occurrence of n-words tuples (i.e. the tuple of (id1,..,idN)), and
sorts these tuples by the lexicographic order of the ids make up the tuples, then write
them to specified output file.


The input file is presented as a binary id stream, which looks like:


All the following options are mandatory.

-n,--NMax N
Generates N-gram result. ids2ngram does only support uni-gram, bi-gram, and trigram,
so any number not in the range of 1..3 is not valid.

-s,--swap swap-file
Specify the temporary intermediate file.

-o, --out output-file
Specify the result idngram file, e.g. the array of [id1, ..., idN, freq]

-p, --para N
Specify the maximum n-gram items per paragraph. ids2ngram writes to the temporary file
on a per-paragraph basis. Every time it writes a paragraph out, it frees the
corresponding memory allocated for it. When your computer system permits, a higher N
is suggested. This can speed up the processing speed because of less I/O.


Following example will use three input idstream file idsfile[1,2,3] to generate the
idngram file all.id3gram. Each para (internal map size or hash size) would be 1024000,
using swap file for temp result. All temp para result would eventually be merged to got
the final result.

ids2ngram -n 3 -s /tmp/swap -o all.id3gram -p 1024000 idsfile1 idsfile2 idsfile3

Use ids2ngram online using onworks.net services

Free Servers & Workstations

Download Windows & Linux apps

  • 1
    Sardi is a complete restyling and
    optimisation of svg code. 6 choices for
    your applications and 10 kind of folders
    to use in your file manager. The sardi
    Download Sardi
  • 2
    LMMS Digital Audio Workstation
    LMMS Digital Audio Workstation
    LMMS is a free cross-platform software
    which allows you to produce music with
    your computer. If you like this project
    consider getting involved in the project
    Download LMMS Digital Audio Workstation
  • 3
    FreeRTOS Real Time Kernel (RTOS)
    FreeRTOS Real Time Kernel (RTOS)
    FreeRTOS is a market-leading real-time
    operating system (RTOS) for
    microcontrollers and small
    microprocessors. Distributed freely
    under the MIT open source lice...
    Download FreeRTOS Real Time Kernel (RTOS)
  • 4
    Avogadro is an advanced molecular
    editor designed for cross-platform use
    in computational chemistry, molecular
    modeling, bioinformatics, materials
    science and ...
    Download Avogadro
  • 5
    XMLTV is a set of programs to process
    TV (tvguide) listings and help manage
    your TV viewing, storing listings in an
    XML-based format. There are utilities to
    Download XMLTV
  • 6
    Strikr Free Software project. Artifacts
    released under a 'intent based'
    dual license: AGPLv3 (community) and
    CC-BY-NC-ND 4.0 international
    Download strikr
  • More »

Linux commands