EnglishFrenchSpanish

Ad


OnWorks favicon

ids2ngram - Online in the Cloud

Run ids2ngram in OnWorks free hosting provider over Ubuntu Online, Fedora Online, Windows online emulator or MAC OS online emulator

This is the command ids2ngram that can be run in the OnWorks free hosting provider using one of our multiple free online workstations such as Ubuntu Online, Fedora Online, Windows online emulator or MAC OS online emulator

PROGRAM:

NAME


ids2ngram - generate n-gram data file from ids file

SYNOPSIS


ids2ngram [option]... ids_file...

DESCRIPTION


ids2ngram generates idngram file, which is a sorted [id1,..,idN,freq] array, from binary
id stream files. Here, the id stream files are always generated by mmseg or slmseg.
Basically, it finds all occurrence of n-words tuples (i.e. the tuple of (id1,..,idN)), and
sorts these tuples by the lexicographic order of the ids make up the tuples, then write
them to specified output file.

INPUT


The input file is presented as a binary id stream, which looks like:
[id0,...,idX]

OPTIONS


All the following options are mandatory.

-n,--NMax N
Generates N-gram result. ids2ngram does only support uni-gram, bi-gram, and trigram,
so any number not in the range of 1..3 is not valid.

-s,--swap swap-file
Specify the temporary intermediate file.

-o, --out output-file
Specify the result idngram file, e.g. the array of [id1, ..., idN, freq]

-p, --para N
Specify the maximum n-gram items per paragraph. ids2ngram writes to the temporary file
on a per-paragraph basis. Every time it writes a paragraph out, it frees the
corresponding memory allocated for it. When your computer system permits, a higher N
is suggested. This can speed up the processing speed because of less I/O.

EXAMPLE


Following example will use three input idstream file idsfile[1,2,3] to generate the
idngram file all.id3gram. Each para (internal map size or hash size) would be 1024000,
using swap file for temp result. All temp para result would eventually be merged to got
the final result.

ids2ngram -n 3 -s /tmp/swap -o all.id3gram -p 1024000 idsfile1 idsfile2 idsfile3

Use ids2ngram online using onworks.net services


Free Servers & Workstations

Download Windows & Linux apps

  • 1
    DivFix++
    DivFix++
    DivFix++ is yours AVI video repair and
    preview software. It designed for repair
    and preview files which are on download
    from ed2k(emule), torrent, gnutella, ftp...
    Download DivFix++
  • 2
    JBoss Community
    JBoss Community
    Community driven projects featuring the
    latest innovations for cutting edge
    apps. Our flagship project JBoss AS is
    the leading Open Source,
    standards-compliant...
    Download JBoss Community
  • 3
    Django Filer
    Django Filer
    django Filer is a file management
    application for django that makes
    handling files and images a breeze.
    django-filer is a file management
    application for djang...
    Download Django Filer
  • 4
    xCAT
    xCAT
    Extreme Cluster Administration Toolkit.
    xCAT is a scalable cluster management
    and provisioning tool that provides
    hardware control, discovery, and OS
    diskful/di...
    Download xCAT
  • 5
    Psi
    Psi
    Psi is cross-platform powerful XMPP
    client designed for experienced users.
    There are builds available for MS
    Windows, GNU/Linux and macOS.. Audience:
    End Users...
    Download Psi
  • 6
    Blobby Volley 2
    Blobby Volley 2
    Official continuation of the famous
    Blobby Volley 1.x arcade game..
    Audience: End Users/Desktop. User
    interface: OpenGL, SDL. Programming
    Language: C++, Lua. C...
    Download Blobby Volley 2
  • More »

Linux commands

Ad