EnglishFrenchSpanish

Ad


OnWorks favicon

buffer - Online in the Cloud

Run buffer in OnWorks free hosting provider over Ubuntu Online, Fedora Online, Windows online emulator or MAC OS online emulator

This is the command buffer that can be run in the OnWorks free hosting provider using one of our multiple free online workstations such as Ubuntu Online, Fedora Online, Windows online emulator or MAC OS online emulator

PROGRAM:

NAME


buffer - very fast reblocking program

SYNTAX


buffer [-S size] [-b blocks] [-s size] [-z size] [-m size] [-p percentage] [-u
microseconds] [-B] [-t] [-Z] [-i filename] [-o filename] [-d]

OPTIONS


-i filename
Use the given file as the input file. The default is stdin.

-o filename
Use the given file as the output file. The default is stdout.

-S size
After every chunk of this size has been written, print out how much has been written
so far. Also prints the total throughput. By default this is not set.

-s size
Size in bytes of each block. The default blocksize is 10k to match the normal output
of the tar(1) program.

-z size
Combines the -S and -s flags.

-b blocks
Number of blocks to allocate to shared memory circular buffer. Defaults to the
number required to fill up the shared memory requested.

-m size
Maximum size of the shared memory chunk to allocate for the circular queue. Defaults
to one megabyte.

-p percentage
Only start a write when the given percentage of the internal queue is full. A
percentage around 75 often proves best. Defaults to zero.

-u microseconds
After every write pause for this many microseconds. Defaults to zero. (Surprisingly
a small sleep, 100 usecs, after each write can greatly enhance throughput on some
drives.)

-B Force each block written to be padded out to the blocksize. This is needed by some
tape and cartridge drives. Defaults to unpadded. This only affects the last block
written.

-t On exiting print to stderr a brief message showing the total number of bytes written.

-Z If reading/writing directly to a character device (like a tape drive) then after each
gigabyte perform an lseek to the start of the file. Use this flag with extreme care.
It can only be used on devices where an lseek does not rewind the tape but does reset
the kernels position flags. It is used to allow more than 2 gigabytes to be written.

-d Print debug information to stderr during operation.

Sizes are a number with an optional trailing character. A 'b' multiplies the size by
512, a 'k' by 1024 and an 'm' by a meg.

DESCRIPTION


Buffer reads from standard input reblocking to the given blocksize and writes each block
to standard output.

Internally buffer is a pair of processes communicating via a large circular queue held in
shared memory. The reader process only has to block when the queue is full and the writer
process when the queue is empty. Buffer is designed to try and keep the writer side
continuously busy so that it can stream when writing to tape drives. When used to write
tapes with an intervening network buffer can result in a considerable increase in
throughput.

The default settings for buffer are normally good enough. If you are a heavy tape user
then it is worth your while trying out various different combinations of options. In
particular running a buffer at both ends of the pipe can provide a substantial increase
(see last example below).

EXAMPLES


$ buffer < /etc/termcap > /dev/rst8

$ tar cf - . | rsh somehost 'buffer > /dev/rst8'

$ dump fu - | rsh somehost 'buffer -s 16k > /dev/nrst8'
$ tar cf - . | buffer |
rsh somehost 'buffer -S 500K -p 75 > /dev/rst0'

BUFFER LIMITS


There are 2 limits in buffer affecting the maximum total buffer size: The maximum number
of blocks (2048) and the maximum size of a block (512kB). This results in a maximum total
buffer size of 1GB.

Note that there is also a kernel limit for the maximum size of a shared memory segment
(used by buffer internally) which is typically much lower than the limits in buffer. So
if buffer complains about not being able to create a shared memory segment, this limit
might have to be raised using the command sysctl kernel.shmmax=XXX (see also sysctl(1) and
proc(5)).

Use buffer online using onworks.net services


Free Servers & Workstations

Download Windows & Linux apps

  • 1
    Eclipse Tomcat Plugin
    Eclipse Tomcat Plugin
    The Eclipse Tomcat Plugin provides
    simple integration of a tomcat servlet
    container for the development of java
    web applications. You can join us for
    discussio...
    Download Eclipse Tomcat Plugin
  • 2
    WebTorrent Desktop
    WebTorrent Desktop
    WebTorrent Desktop is for streaming
    torrents on Mac, Windows or Linux. It
    connects to both BitTorrent and
    WebTorrent peers. Now there's no
    need to wait for...
    Download WebTorrent Desktop
  • 3
    GenX
    GenX
    GenX is a scientific program to refine
    x-ray refelcetivity, neutron
    reflectivity and surface x-ray
    diffraction data using the differential
    evolution algorithm....
    Download GenX
  • 4
    pspp4windows
    pspp4windows
    PSPP is a program for statistical
    analysis of sampled data. It is a free
    replacement for the proprietary program
    SPSS. PSPP has both text-based and
    graphical us...
    Download pspp4windows
  • 5
    Git Extensions
    Git Extensions
    Git Extensions is a standalone UI tool
    for managing Git repositories. It also
    integrates with Windows Explorer and
    Microsoft Visual Studio
    (2015/2017/2019). Th...
    Download Git Extensions
  • 6
    eSpeak: speech synthesis
    eSpeak: speech synthesis
    Text to Speech engine for English and
    many other languages. Compact size with
    clear but artificial pronunciation.
    Available as a command-line program with
    many ...
    Download eSpeak: speech synthesis
  • More »

Linux commands

Ad