This is the command sahara that can be run in the OnWorks free hosting provider using one of our multiple free online workstations such as Ubuntu Online, Fedora Online, Windows online emulator or MAC OS online emulator
PROGRAM:
NAME
saharaclient - Sahara Client
This is a client for OpenStack Sahara API. There's a Python API (the saharaclient module),
and a command-line utility (installed as an OpenStackClient plugin). Each implements the
entire OpenStack Sahara API.
You'll need credentials for an OpenStack cloud that implements the Data Processing API, in
order to use the sahara client.
You may want to read the OpenStack Sahara Docs -- the overview, at least -- to get an
idea of the concepts. By understanding the concepts this library should make more sense.
Contents:
SAHARA CLIENT
Overview
Sahara Client provides a list of Python interfaces to communicate with the Sahara REST
API. Sahara Client enables users to perform most of the existing operations like
retrieving template lists, creating Clusters, submitting EDP Jobs, etc.
Instantiating a Client
To start using the Sahara Client users have to create an instance of the Client class. The
client constructor has a list of parameters to authenticate and locate Sahara endpoint.
class saharaclient.api.client.Client(username=None, api_key=None, project_id=None,
project_name=None, auth_url=None, sahara_url=None, endpoint_type='publicURL',
service_type='data-processing', input_auth_token=None, session=None, auth=None,
insecure=False, cacert=None, region_name=None, **kwargs)
Client for the OpenStack Data Processing v1 API.
Parameters
· username (str) -- Username for Keystone authentication.
· api_key (str) -- Password for Keystone authentication.
· project_id (str) -- Keystone Tenant id.
· project_name (str) -- Keystone Tenant name.
· auth_url (str) -- Keystone URL that will be used for authentication.
· sahara_url (str) -- Sahara REST API URL to communicate with.
· endpoint_type (str) -- Desired Sahara endpoint type.
· service_type (str) -- Sahara service name in Keystone catalog.
· input_auth_token (str) -- Keystone authorization token.
· session -- Keystone Session object.
· auth -- Keystone Authentication Plugin object.
· insecure (boolean) -- Allow insecure.
· cacert (string) -- Path to the Privacy Enhanced Mail (PEM) file which
contains certificates needed to establish SSL connection with the identity
service.
· region_name (string) -- Name of a region to select when choosing an
endpoint from the service catalog.
Important!
It is not a mandatory rule to provide all of the parameters above. The minimum
number should be enough to determine Sahara endpoint, check user authentication and
tenant to operate in.
Authentication check
Passing authentication parameters to Sahara Client is deprecated. Keystone Session object
should be used for this purpose. For example:
from keystoneauth1.identity import v2
from keystoneauth1 import session
from saharaclient import client
auth = v2.Password(auth_url=AUTH_URL,
username=USERNAME,
password=PASSWORD,
tenant_name=PROJECT_ID)
ses = session.Session(auth=auth)
sahara = client.Client('1.1', session=ses)
For more information about Keystone Sessions, see Using Sessions.
Sahara endpoint discovery
If user has a direct URL pointing to Sahara REST API, it may be specified as sahara_url.
If this parameter is missing, Sahara client will use Keystone Service Catalog to find the
endpoint. There are two parameters: service_type and endpoint_type to configure endpoint
search. Both parameters have default values.
from keystoneauth1.identity import v2
from keystoneauth1 import session
from saharaclient import client
auth = v2.Password(auth_url=AUTH_URL,
username=USERNAME,
password=PASSWORD,
tenant_name=PROJECT_ID)
ses = session.Session(auth=auth)
sahara = client.Client('1.1', session=ses,
service_type="non-default-service-type",
endpoint_type="internalURL")
Object managers
Sahara Client has a list of fields to operate with:
· plugins
· clusters
· cluster_templates
· node_group_templates
· images
· data_sources
· job_binaries
· job_binary_internals
· job_executions
· job_types
Each of this fields is a reference to a Manager for a corresponding group of REST calls.
Supported operations
Plugin ops
class saharaclient.api.plugins.PluginManager(api)
convert_to_cluster_template(plugin_name, hadoop_version, template_name,
filecontent)
Convert to cluster template
Create Cluster Template directly, avoiding Cluster Template mechanism.
get(plugin_name)
Get information about a Plugin.
get_version_details(plugin_name, hadoop_version)
Get version details
Get the list of Services and Service Parameters for a specified Plugin and
Plugin Version.
list(search_opts=None)
Get a list of Plugins.
Image Registry ops
class saharaclient.api.images.ImageManager(api)
get(id)
Get information about an image
list(search_opts=None)
Get a list of registered images.
unregister_image(image_id)
Remove an Image from Sahara Image Registry.
update_image(image_id, user_name, desc=None)
Create or update an Image in Image Registry.
update_tags(image_id, new_tags)
Update an Image tags.
Parameters
new_tags (list) -- list of tags that will replace currently assigned
tags
Node Group Template ops
class saharaclient.api.node_group_templates.NodeGroupTemplateManager(api)
create(name, plugin_name, hadoop_version, flavor_id, description=None,
volumes_per_node=None, volumes_size=None, node_processes=None, node_configs=None,
floating_ip_pool=None, security_groups=None, auto_security_group=None,
availability_zone=None, volumes_availability_zone=None, volume_type=None,
image_id=None, is_proxy_gateway=None, volume_local_to_instance=None,
use_autoconfig=None, shares=None, is_public=None, is_protected=None,
volume_mount_prefix=None)
Create a Node Group Template.
delete(ng_template_id)
Delete a Node Group Template.
get(ng_template_id)
Get information about a Node Group Template.
list(search_opts=None)
Get a list of Node Group Templates.
update(ng_template_id, name=NotUpdated, plugin_name=NotUpdated,
hadoop_version=NotUpdated, flavor_id=NotUpdated, description=NotUpdated,
volumes_per_node=NotUpdated, volumes_size=NotUpdated, node_processes=NotUpdated,
node_configs=NotUpdated, floating_ip_pool=NotUpdated, security_groups=NotUpdated,
auto_security_group=NotUpdated, availability_zone=NotUpdated,
volumes_availability_zone=NotUpdated, volume_type=NotUpdated, image_id=NotUpdated,
is_proxy_gateway=NotUpdated, volume_local_to_instance=NotUpdated,
use_autoconfig=NotUpdated, shares=NotUpdated, is_public=NotUpdated,
is_protected=NotUpdated, volume_mount_prefix=NotUpdated)
Update a Node Group Template.
Cluster Template ops
class saharaclient.api.cluster_templates.ClusterTemplateManager(api)
create(name, plugin_name, hadoop_version, description=None, cluster_configs=None,
node_groups=None, anti_affinity=None, net_id=None, default_image_id=None,
use_autoconfig=None, shares=None, is_public=None, is_protected=None)
Create a Cluster Template.
delete(cluster_template_id)
Delete a Cluster Template.
get(cluster_template_id)
Get information about a Cluster Template.
list(search_opts=None)
Get list of Cluster Templates.
update(cluster_template_id, name=NotUpdated, plugin_name=NotUpdated,
hadoop_version=NotUpdated, description=NotUpdated, cluster_configs=NotUpdated,
node_groups=NotUpdated, anti_affinity=NotUpdated, net_id=NotUpdated,
default_image_id=NotUpdated, use_autoconfig=NotUpdated, shares=NotUpdated,
is_public=NotUpdated, is_protected=NotUpdated)
Update a Cluster Template.
Cluster ops
class saharaclient.api.clusters.ClusterManager(api)
create(name, plugin_name, hadoop_version, cluster_template_id=None,
default_image_id=None, is_transient=None, description=None, cluster_configs=None,
node_groups=None, user_keypair_id=None, anti_affinity=None, net_id=None,
count=None, use_autoconfig=None, shares=None, is_public=None, is_protected=None)
Launch a Cluster.
delete(cluster_id)
Delete a Cluster.
get(cluster_id, show_progress=False)
Get information about a Cluster.
list(search_opts=None)
Get a list of Clusters.
scale(cluster_id, scale_object)
Scale an existing Cluster.
Parameters
scale_object -- dict that describes scaling operation
Example
The following scale_object can be used to change the number of instances in
the node group and add instances of new node group to existing cluster:
{
"add_node_groups": [
{
"count": 3,
"name": "new_ng",
"node_group_template_id": "ngt_id"
}
],
"resize_node_groups": [
{
"count": 2,
"name": "old_ng"
}
]
}
update(cluster_id, name=NotUpdated, description=NotUpdated, is_public=NotUpdated,
is_protected=NotUpdated, shares=NotUpdated)
Update a Cluster.
verification_update(cluster_id, status)
Start a verification for a Cluster.
Data Source ops
class saharaclient.api.data_sources.DataSourceManager(api)
create(name, description, data_source_type, url, credential_user=None,
credential_pass=None, is_public=None, is_protected=None)
Create a Data Source.
delete(data_source_id)
Delete a Data Source.
get(data_source_id)
Get information about a Data Source.
list(search_opts=None)
Get a list of Data Sources.
update(data_source_id, update_data)
Update a Data Source.
Parameters
update_data (dict) -- dict that contains fields that should be
updated with new values.
Fields that can be updated:
· name
· description
· type
· url
· is_public
· is_protected
· credentials - dict with user and password keyword arguments
Job Binary Internal ops
class saharaclient.api.job_binary_internals.JobBinaryInternalsManager(api)
create(name, data)
Create a Job Binary Internal.
Parameters
data (str) -- raw data ot script text
update(job_binary_id, name=NotUpdated, is_public=NotUpdated,
is_protected=NotUpdated)
Update a Job Binary Internal.
Job Binary ops
class saharaclient.api.job_binaries.JobBinariesManager(api)
create(name, url, description=None, extra=None, is_public=None, is_protected=None)
Create a Job Binary.
delete(job_binary_id)
Delete a Job Binary.
get(job_binary_id)
Get information about a Job Binary.
get_file(job_binary_id)
Download a Job Binary.
list(search_opts=None)
Get a list of Job Binaries.
update(job_binary_id, data)
Update Job Binary.
Parameters
data (dict) -- dict that contains fields that should be updated with
new values.
Fields that can be updated:
· name
· description
· url
· is_public
· is_protected
· extra - dict with user and password keyword arguments
Job ops
class saharaclient.api.jobs.JobsManager(api)
create(name, type, mains=None, libs=None, description=None, interface=None,
is_public=None, is_protected=None)
Create a Job.
delete(job_id)
Delete a Job
get(job_id)
Get information about a Job
get_configs(job_type)
Get config hints for a specified Job type.
list(search_opts=None)
Get a list of Jobs.
update(job_id, name=NotUpdated, description=NotUpdated, is_public=NotUpdated,
is_protected=NotUpdated)
Update a Job.
Job Execution ops
class saharaclient.api.job_executions.JobExecutionsManager(api)
create(job_id, cluster_id, input_id=None, output_id=None, configs=None,
interface=None, is_public=None, is_protected=None)
Launch a Job.
delete(obj_id)
Delete a Job Execution.
get(obj_id)
Get information about a Job Execution.
list(search_opts=None)
Get a list of Job Executions.
update(obj_id, is_public=NotUpdated, is_protected=NotUpdated)
Update a Job Execution.
Job Types ops
class saharaclient.api.job_types.JobTypesManager(api)
list(search_opts=None)
Get a list of job types supported by plugins.
SAHARA CLI
The Sahara shell utility now is part of the OpenStackClient, so all shell commands take
the following form:
$ openstack dataprocessing <command> [arguments...]
To get a list of all possible commands you can run:
$ openstack help dataprocessing
To get detailed help for the command you can run:
$ openstack help dataprocessing <command>
For more information about commands and their parameters you can refer to the Sahara CLI
commands.
For more information about abilities and features of OpenStackClient CLI you can refer to
OpenStackClient documentation
Configuration
The CLI is configured via environment variables and command-line options which are
described in
http://docs.openstack.org/developer/python-openstackclient/authentication.html.
Authentication using username/password is most commonly used and can be provided with
environment variables:
export OS_AUTH_URL=<url-to-openstack-identity>
export OS_PROJECT_NAME=<project-name>
export OS_USERNAME=<username>
export OS_PASSWORD=<password> # (optional)
or command-line options:
--os-auth-url <url>
--os-project-name <project-name>
--os-username <username>
[--os-password <password>]
Additionally sahara API url can be configured with parameter:
--os-data-processing-url
or with environment variable:
export OS_DATA_PROCESSING_URL=<url-to-sahara-API>
SAHARA CLI COMMANDS
The following commands are currently supported by the Sahara CLI:
Plugins
dataprocessing plugin configs get
Get plugin configs
usage: dataprocessing plugin configs get [-h] [--file <file>]
<plugin> <version>
Positional arguments:
Name of the plugin to provide config information about
Version of the plugin to provide config information about
Options:
--file Destination file (defaults to plugin name)
dataprocessing plugin list
Lists plugins
usage: dataprocessing plugin list [-h] [-f {csv,json,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent]
[--quote {all,minimal,none,nonnumeric}]
[--long]
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: csv, json, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--quote=nonnumeric
when to include quotes, defaults to nonnumeric
Possible choices: all, minimal, none, nonnumeric
--long=False
List additional fields in output
dataprocessing plugin show
Display plugin details
usage: dataprocessing plugin show [-h] [-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX]
[--version VERSION]
<plugin>
Positional arguments:
Name of the plugin to display
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
--version
Version of the plugin to display
Images
dataprocessing image tags add
Add image tags
usage: dataprocessing image tags add [-h] [-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX] --tags
<tag> [<tag> ...]
<image>
Positional arguments:
Name or id of the image
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
--tags Tag(s) to add [REQUIRED]
dataprocessing image list
Lists registered images
usage: dataprocessing image list [-h] [-f {csv,json,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent]
[--quote {all,minimal,none,nonnumeric}]
[--long] [--name <name-regex>]
[--tags <tag> [<tag> ...]]
[--username <username>]
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: csv, json, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--quote=nonnumeric
when to include quotes, defaults to nonnumeric
Possible choices: all, minimal, none, nonnumeric
--long=False
List additional fields in output
--name Regular expression to match image name
--tags List images with specific tag(s)
--username
List images with specific username
dataprocessing image register
Register an image
usage: dataprocessing image register [-h] [-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX] --username
<username> [--description <description>]
<image>
Positional arguments:
Name or ID of the image to register
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
--username
Username of privileged user in the image [REQUIRED]
--description
Description of the image. If not provided, description of the image will be
reset to empty
dataprocessing image tags remove
Remove image tags
usage: dataprocessing image tags remove [-h]
[-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX]
[--tags <tag> [<tag> ...] | --all]
<image>
Positional arguments:
Name or id of the image
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
--tags Tag(s) to remove
--all=False
Remove all tags from image
dataprocessing image tags set
Set image tags (Replace current image tags with provided ones)
usage: dataprocessing image tags set [-h] [-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX] --tags
<tag> [<tag> ...]
<image>
Positional arguments:
Name or id of the image
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
--tags Tag(s) to set [REQUIRED]
dataprocessing image show
Display image details
usage: dataprocessing image show [-h] [-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX]
<image>
Positional arguments:
Name or id of the image to display
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
dataprocessing image unregister
Unregister image(s)
usage: dataprocessing image unregister [-h] <image> [<image> ...]
Positional arguments:
Name(s) or id(s) of the image(s) to unregister
Node Group Templates
dataprocessing node group template create
Creates node group template
usage: dataprocessing node group template create [-h]
[-f {json,shell,table,value,yaml}]
[-c COLUMN]
[--max-width <integer>]
[--noindent]
[--prefix PREFIX]
[--name <name>]
[--plugin <plugin>]
[--version <version>]
[--processes <processes> [<processes> ...]]
[--flavor <flavor>]
[--security-groups <security-groups> [<security-groups> ...]]
[--auto-security-group]
[--availability-zone <availability-zone>]
[--floating-ip-pool <floating-ip-pool>]
[--volumes-per-node <volumes-per-node>]
[--volumes-size <volumes-size>]
[--volumes-type <volumes-type>]
[--volumes-availability-zone <volumes-availability-zone>]
[--volumes-mount-prefix <volumes-mount-prefix>]
[--volumes-locality]
[--description <description>]
[--autoconfig]
[--proxy-gateway] [--public]
[--protected]
[--json <filename>]
[--shares <filename>]
[--configs <filename>]
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
--name Name of the node group template [REQUIRED if JSON is not provided]
--plugin
Name of the plugin [REQUIRED if JSON is not provided]
--version
Version of the plugin [REQUIRED if JSON is not provided]
--processes
List of the processes that will be launched on each instance [REQUIRED if
JSON is not provided]
--flavor
Name or ID of the flavor [REQUIRED if JSON is not provided]
--security-groups
List of the security groups for the instances in this node group
--auto-security-group=False
Indicates if an additional security group should be created for the node
group
--availability-zone
Name of the availability zone where instances will be created
--floating-ip-pool
ID of the floating IP pool
--volumes-per-node
Number of volumes attached to every node
--volumes-size
Size of volumes attached to node (GB). This parameter will be taken into
account only if volumes-per-node is set and non-zero
--volumes-type
Type of the volumes. This parameter will be taken into account only if
volumes-per-node is set and non-zero
--volumes-availability-zone
Name of the availability zone where volumes will be created. This parameter
will be taken into account only if volumes-per-node is set and non-zero
--volumes-mount-prefix
Prefix for mount point directory. This parameter will be taken into account
only if volumes-per-node is set and non-zero
--volumes-locality=False
If enabled, instance and attached volumes will be created on the same
physical host. This parameter will be taken into account only if
volumes-per-node is set and non-zero
--description
Description of the node group template
--autoconfig=False
If enabled, instances of the node group will be automatically configured
--proxy-gateway=False
If enabled, instances of the node group will be used to access other
instances in the cluster
--public=False
Make the node group template public (Visible from other tenants)
--protected=False
Make the node group template protected
--json JSON representation of the node group template. Other arguments will not be
taken into account if this one is provided
--shares
JSON representation of the manila shares
--configs
JSON representation of the node group template configs
dataprocessing node group template delete
Deletes node group template
usage: dataprocessing node group template delete [-h]
<node-group-template>
[<node-group-template> ...]
Positional arguments:
Name(s) or id(s) of the node group template(s) to delete
dataprocessing node group template list
Lists node group templates
usage: dataprocessing node group template list [-h]
[-f {csv,json,table,value,yaml}]
[-c COLUMN]
[--max-width <integer>]
[--noindent]
[--quote {all,minimal,none,nonnumeric}]
[--long] [--plugin <plugin>]
[--version <version>]
[--name <name-substring>]
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: csv, json, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--quote=nonnumeric
when to include quotes, defaults to nonnumeric
Possible choices: all, minimal, none, nonnumeric
--long=False
List additional fields in output
--plugin
List node group templates for specific plugin
--version
List node group templates with specific version of the plugin
--name List node group templates with specific substring in the name
dataprocessing node group template show
Display node group template details
usage: dataprocessing node group template show [-h]
[-f {json,shell,table,value,yaml}]
[-c COLUMN]
[--max-width <integer>]
[--noindent] [--prefix PREFIX]
<node-group-template>
Positional arguments:
Name or id of the node group template to display
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
dataprocessing node group template update
Updates node group template
usage: dataprocessing node group template update [-h]
[-f {json,shell,table,value,yaml}]
[-c COLUMN]
[--max-width <integer>]
[--noindent]
[--prefix PREFIX]
[--name <name>]
[--plugin <plugin>]
[--version <version>]
[--processes <processes> [<processes> ...]]
[--security-groups <security-groups> [<security-groups> ...]]
[--auto-security-group-enable | --auto-security-group-disable]
[--availability-zone <availability-zone>]
[--flavor <flavor>]
[--floating-ip-pool <floating-ip-pool>]
[--volumes-per-node <volumes-per-node>]
[--volumes-size <volumes-size>]
[--volumes-type <volumes-type>]
[--volumes-availability-zone <volumes-availability-zone>]
[--volumes-mount-prefix <volumes-mount-prefix>]
[--volumes-locality-enable | --volumes-locality-disable]
[--description <description>]
[--autoconfig-enable | --autoconfig-disable]
[--proxy-gateway-enable | --proxy-gateway-disable]
[--public | --private]
[--protected | --unprotected]
[--json <filename>]
[--shares <filename>]
[--configs <filename>]
<node-group-template>
Positional arguments:
Name or ID of the node group template
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
--name New name of the node group template
--plugin
Name of the plugin
--version
Version of the plugin
--processes
List of the processes that will be launched on each instance
--security-groups
List of the security groups for the instances in this node group
--auto-security-group-enable
Additional security group should be created for the node group
--auto-security-group-disable
Additional security group should not be created for the node group
--availability-zone
Name of the availability zone where instances will be created
--flavor
Name or ID of the flavor
--floating-ip-pool
ID of the floating IP pool
--volumes-per-node
Number of volumes attached to every node
--volumes-size
Size of volumes attached to node (GB). This parameter will be taken into
account only if volumes-per-node is set and non-zero
--volumes-type
Type of the volumes. This parameter will be taken into account only if
volumes-per-node is set and non-zero
--volumes-availability-zone
Name of the availability zone where volumes will be created. This parameter
will be taken into account only if volumes-per-node is set and non-zero
--volumes-mount-prefix
Prefix for mount point directory. This parameter will be taken into account
only if volumes-per-node is set and non-zero
--volumes-locality-enable
Instance and attached volumes will be created on the same physical host.
This parameter will be taken into account only if volumes-per-node is set
and non-zero
--volumes-locality-disable
Instance and attached volumes creation on the same physical host will not be
regulated. This parameter will be takeninto account only if volumes-per-node
is set and non-zero
--description
Description of the node group template
--autoconfig-enable
Instances of the node group will be automatically configured
--autoconfig-disable
Instances of the node group will not be automatically configured
--proxy-gateway-enable
Instances of the node group will be used to access other instances in the
cluster
--proxy-gateway-disable
Instances of the node group will not be used to access other instances in
the cluster
--public
Make the node group template public (Visible from other tenants)
--private
Make the node group template private (Visible only from this tenant)
--protected
Make the node group template protected
--unprotected
Make the node group template unprotected
--json JSON representation of the node group template update fields. Other
arguments will not be taken into account if this one is provided
--shares
JSON representation of the manila shares
--configs
JSON representation of the node group template configs
Cluster Templates
dataprocessing cluster template create
Creates cluster template
usage: dataprocessing cluster template create [-h]
[-f {json,shell,table,value,yaml}]
[-c COLUMN]
[--max-width <integer>]
[--noindent] [--prefix PREFIX]
[--name <name>]
[--node-groups <node-group:instances_count> [<node-group:instances_count> ...]]
[--anti-affinity <anti-affinity> [<anti-affinity> ...]]
[--description <description>]
[--autoconfig] [--public]
[--protected]
[--json <filename>]
[--shares <filename>]
[--configs <filename>]
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
--name Name of the cluster template [REQUIRED if JSON is not provided]
--node-groups
List of the node groups(names or IDs) and numbers of instances for each one
of them [REQUIRED if JSON is not provided]
--anti-affinity
List of processes that should be added to an anti-affinity group
--description
Description of the cluster template
--autoconfig=False
If enabled, instances of the cluster will be automatically configured
--public=False
Make the cluster template public (Visible from other tenants)
--protected=False
Make the cluster template protected
--json JSON representation of the cluster template. Other arguments will not be
taken into account if this one is provided
--shares
JSON representation of the manila shares
--configs
JSON representation of the cluster template configs
dataprocessing cluster template delete
Deletes cluster template
usage: dataprocessing cluster template delete [-h]
<cluster-template>
[<cluster-template> ...]
Positional arguments:
Name(s) or id(s) of the cluster template(s) to delete
dataprocessing cluster template list
Lists cluster templates
usage: dataprocessing cluster template list [-h]
[-f {csv,json,table,value,yaml}]
[-c COLUMN]
[--max-width <integer>]
[--noindent]
[--quote {all,minimal,none,nonnumeric}]
[--long] [--plugin <plugin>]
[--version <version>]
[--name <name-substring>]
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: csv, json, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--quote=nonnumeric
when to include quotes, defaults to nonnumeric
Possible choices: all, minimal, none, nonnumeric
--long=False
List additional fields in output
--plugin
List cluster templates for specific plugin
--version
List cluster templates with specific version of the plugin
--name List cluster templates with specific substring in the name
dataprocessing cluster template show
Display cluster template details
usage: dataprocessing cluster template show [-h]
[-f {json,shell,table,value,yaml}]
[-c COLUMN]
[--max-width <integer>]
[--noindent] [--prefix PREFIX]
<cluster-template>
Positional arguments:
Name or id of the cluster template to display
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
dataprocessing cluster template update
Updates cluster template
usage: dataprocessing cluster template update [-h]
[-f {json,shell,table,value,yaml}]
[-c COLUMN]
[--max-width <integer>]
[--noindent] [--prefix PREFIX]
[--name <name>]
[--node-groups <node-group:instances_count> [<node-group:instances_count> ...]]
[--anti-affinity <anti-affinity> [<anti-affinity> ...]]
[--description <description>]
[--autoconfig-enable | --autoconfig-disable]
[--public | --private]
[--protected | --unprotected]
[--json <filename>]
[--shares <filename>]
[--configs <filename>]
<cluster-template>
Positional arguments:
Name or ID of the cluster template [REQUIRED]
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
--name New name of the cluster template
--node-groups
List of the node groups(names or IDs) and numbers ofinstances for each one
of them
--anti-affinity
List of processes that should be added to an anti-affinity group
--description
Description of the cluster template
--autoconfig-enable
Instances of the cluster will be automatically configured
--autoconfig-disable
Instances of the cluster will not be automatically configured
--public
Make the cluster template public (Visible from other tenants)
--private
Make the cluster template private (Visible only from this tenant)
--protected
Make the cluster template protected
--unprotected
Make the cluster template unprotected
--json JSON representation of the cluster template. Other arguments will not be
taken into account if this one is provided
--shares
JSON representation of the manila shares
--configs
JSON representation of the cluster template configs
Clusters
dataprocessing cluster create
Creates cluster
usage: dataprocessing cluster create [-h] [-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX]
[--name <name>]
[--cluster-template <cluster-template>]
[--image <image>]
[--description <description>]
[--user-keypair <keypair>]
[--neutron-network <network>]
[--count <count>] [--public]
[--protected] [--transient]
[--json <filename>] [--wait]
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
--name Name of the cluster [REQUIRED if JSON is not provided]
--cluster-template
Cluster template name or ID [REQUIRED if JSON is not provided]
--image
Image that will be used for cluster deployment (Name or ID) [REQUIRED if
JSON is not provided]
--description
Description of the cluster
--user-keypair
User keypair to get acces to VMs after cluster creation
--neutron-network
Instances of the cluster will get fixed IP addresses in this network. (Name
or ID should be provided)
--count
Number of clusters to be created
--public=False
Make the cluster public (Visible from other tenants)
--protected=False
Make the cluster protected
--transient=False
Create transient cluster
--json JSON representation of the cluster. Other arguments (except for --wait) will
not be taken into account if this one is provided
--wait=False
Wait for the cluster creation to complete
dataprocessing cluster delete
Deletes cluster
usage: dataprocessing cluster delete [-h] [--wait] <cluster> [<cluster> ...]
Positional arguments:
Name(s) or id(s) of the cluster(s) to delete
Options:
--wait=False
Wait for the cluster(s) delete to complete
dataprocessing cluster list
Lists clusters
usage: dataprocessing cluster list [-h] [-f {csv,json,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent]
[--quote {all,minimal,none,nonnumeric}]
[--long] [--plugin <plugin>]
[--version <version>]
[--name <name-substring>]
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: csv, json, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--quote=nonnumeric
when to include quotes, defaults to nonnumeric
Possible choices: all, minimal, none, nonnumeric
--long=False
List additional fields in output
--plugin
List clusters with specific plugin
--version
List clusters with specific version of the plugin
--name List clusters with specific substring in the name
dataprocessing cluster scale
Scales cluster
usage: dataprocessing cluster scale [-h] [-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX]
[--instances <node-group-template:instances_count> [<node-group-template:instances_count> ...]]
[--json <filename>] [--wait]
<cluster>
Positional arguments:
Name or ID of the cluster
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
--instances
Node group templates and number of their instances to be scale to [REQUIRED
if JSON is not provided]
--json JSON representation of the cluster scale object. Other arguments (except for
--wait) will not be taken into account if this one is provided
--wait=False
Wait for the cluster scale to complete
dataprocessing cluster show
Display cluster details
usage: dataprocessing cluster show [-h] [-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX]
[--verification]
<cluster>
Positional arguments:
Name or id of the cluster to display
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
--verification=False
List additional fields for verifications
dataprocessing cluster verification
Updates cluster
usage: dataprocessing cluster verification [-h]
[-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX]
[--name <name>]
[--description <description>]
[--shares <filename>]
[--public | --private]
[--protected | --unprotected]
<cluster>
Positional arguments:
Name or ID of the cluster
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
--name New name of the cluster
--description
Description of the cluster
--shares
JSON representation of the manila shares
--public
Make the cluster public (Visible from other tenants)
--private
Make the cluster private (Visible only from this tenant)
--protected
Make the cluster protected
--unprotected
Make the cluster unprotected
dataprocessing cluster verification
Updates cluster verifications
usage: dataprocessing cluster verification [-h]
[-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX]
(--start | --show)
<cluster>
Positional arguments:
Name or ID of the cluster
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
--start
Start health verification for the cluster
--show=False
Show health of the cluster
Data Sources
dataprocessing data source create
Creates data source
usage: dataprocessing data source create [-h]
[-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX] --type
<type> --url <url>
[--username <username>]
[--password <password>]
[--description <description>]
[--public] [--protected]
<name>
Positional arguments:
Name of the data source
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
--type Type of the data source (swift, hdfs, maprfs, manila) [REQUIRED]
Possible choices: swift, hdfs, maprfs, manila
--url Url for the data source [REQUIRED]
--username
Username for accessing the data source url
--password
Password for accessing the data source url
--description
Description of the data source
--public=False
Make the data source public
--protected=False
Make the data source protected
dataprocessing data source delete
Delete data source
usage: dataprocessing data source delete [-h]
<data-source> [<data-source> ...]
Positional arguments:
Name(s) or id(s) of the data source(s) to delete
dataprocessing data source list
Lists data sources
usage: dataprocessing data source list [-h] [-f {csv,json,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent]
[--quote {all,minimal,none,nonnumeric}]
[--long] [--type <type>]
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: csv, json, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--quote=nonnumeric
when to include quotes, defaults to nonnumeric
Possible choices: all, minimal, none, nonnumeric
--long=False
List additional fields in output
--type List data sources of specific type (swift, hdfs, maprfs, manila)
Possible choices: swift, hdfs, maprfs, manila
dataprocessing data source show
Display data source details
usage: dataprocessing data source show [-h] [-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX]
<data-source>
Positional arguments:
Name or id of the data source to display
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
dataprocessing data source update
Update data source
usage: dataprocessing data source update [-h]
[-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX]
[--name <name>] [--type <type>]
[--url <url>] [--username <username>]
[--password <password>]
[--description <description>]
[--public | --private]
[--protected | --unprotected]
<data-source>
Positional arguments:
Name or id of the data source
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
--name New name of the data source
--type Type of the data source (swift, hdfs, maprfs, manila)
Possible choices: swift, hdfs, maprfs, manila
--url Url for the data source
--username
Username for accessing the data source url
--password
Password for accessing the data source url
--description
Description of the data source
--public
Make the data source public (Visible from other tenants)
--private
Make the data source private (Visible only from this tenant)
--protected
Make the data source protected
--unprotected
Make the data source unprotected
Job Binaries
dataprocessing job binary create
Creates job binary
usage: dataprocessing job binary create [-h]
[-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX]
[--name <name>]
[--data <file> | --url <url>]
[--description <description>]
[--username <username>]
[--password <password> | --password-prompt]
[--public] [--protected]
[--json <filename>]
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
--name Name of the job binary [REQUIRED if JSON is not provided]
--data File that will be stored in the internal DB [REQUIRED if JSON and URL are
not provided]
--url URL for the job binary [REQUIRED if JSON and file are not provided]
--description
Description of the job binary
--username
Username for accessing the job binary URL
--password
Password for accessing the job binary URL
--password-prompt=False
Prompt interactively for password
--public=False
Make the job binary public
--protected=False
Make the job binary protected
--json JSON representation of the job binary. Other arguments will not be taken
into account if this one is provided
dataprocessing job binary delete
Deletes job binary
usage: dataprocessing job binary delete [-h] <job-binary> [<job-binary> ...]
Positional arguments:
Name(s) or id(s) of the job binary(ies) to delete
dataprocessing job binary download
Downloads job binary
usage: dataprocessing job binary download [-h] [--file <file>] <job-binary>
Positional arguments:
Name or ID of the job binary to download
Options:
--file Destination file (defaults to job binary name)
dataprocessing job binary list
Lists job binaries
usage: dataprocessing job binary list [-h] [-f {csv,json,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent]
[--quote {all,minimal,none,nonnumeric}]
[--long] [--name <name-substring>]
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: csv, json, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--quote=nonnumeric
when to include quotes, defaults to nonnumeric
Possible choices: all, minimal, none, nonnumeric
--long=False
List additional fields in output
--name List job binaries with specific substring in the name
dataprocessing job binary show
Display job binary details
usage: dataprocessing job binary show [-h] [-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX]
<job-binary>
Positional arguments:
Name or ID of the job binary to display
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
dataprocessing job binary update
Updates job binary
usage: dataprocessing job binary update [-h]
[-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX]
[--name <name>] [--url <url>]
[--description <description>]
[--username <username>]
[--password <password> | --password-prompt]
[--public | --private]
[--protected | --unprotected]
[--json <filename>]
<job-binary>
Positional arguments:
Name or ID of the job binary
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
--name New name of the job binary
--url URL for the job binary [Internal DB URL can not be updated]
--description
Description of the job binary
--username
Username for accessing the job binary URL
--password
Password for accessing the job binary URL
--password-prompt=False
Prompt interactively for password
--public
Make the job binary public (Visible from other tenants)
--private
Make the job binary private (Visible only from this tenant)
--protected
Make the job binary protected
--unprotected
Make the job binary unprotected
--json JSON representation of the update object. Other arguments will not be taken
into account if this one is provided
Job Types
dataprocessing job type configs get
Get job type configs
usage: dataprocessing job type configs get [-h] [--file <file>] <job-type>
Positional arguments:
Type of the job to provide config information about
Possible choices: Hive, Java, MapReduce, Storm, Pig, Shell,
MapReduce.Streaming, Spark
Options:
--file Destination file (defaults to job type)
dataprocessing job type list
Lists job types supported by plugins
usage: dataprocessing job type list [-h] [-f {csv,json,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent]
[--quote {all,minimal,none,nonnumeric}]
[--type <type>] [--plugin <plugin>]
[--version <version>]
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: csv, json, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--quote=nonnumeric
when to include quotes, defaults to nonnumeric
Possible choices: all, minimal, none, nonnumeric
--type Get information about specific job type
Possible choices: Hive, Java, MapReduce, Storm, Pig, Shell,
MapReduce.Streaming, Spark
--plugin
Get only job types supported by this plugin
--version
Get only job types supported by specific version of the plugin. This
parameter will be taken into account only if plugin is provided
Job Templates
dataprocessing job template create
Creates job template
usage: dataprocessing job template create [-h]
[-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX]
[--name <name>] [--type <type>]
[--mains <main> [<main> ...]]
[--libs <lib> [<lib> ...]]
[--description <description>]
[--public] [--protected]
[--interface <filename>]
[--json <filename>]
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
--name Name of the job template [REQUIRED if JSON is not provided]
--type Type of the job (Hive, Java, MapReduce, Storm, Pig, Shell,
MapReduce.Streaming, Spark) [REQUIRED if JSON is not provided]
Possible choices: Hive, Java, MapReduce, Storm, Pig, Shell,
MapReduce.Streaming, Spark
--mains
Name(s) or ID(s) for job's main job binary(s)
--libs Name(s) or ID(s) for job's lib job binary(s)
--description
Description of the job template
--public=False
Make the job template public
--protected=False
Make the job template protected
--interface
JSON representation of the interface
--json JSON representation of the job template
dataprocessing job template delete
Deletes job template
usage: dataprocessing job template delete [-h]
<job-template> [<job-template> ...]
Positional arguments:
Name(s) or id(s) of the job template(s) to delete
dataprocessing job template list
Lists job templates
usage: dataprocessing job template list [-h] [-f {csv,json,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent]
[--quote {all,minimal,none,nonnumeric}]
[--long] [--type <type>]
[--name <name-substring>]
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: csv, json, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--quote=nonnumeric
when to include quotes, defaults to nonnumeric
Possible choices: all, minimal, none, nonnumeric
--long=False
List additional fields in output
--type List job templates of specific type
Possible choices: Hive, Java, MapReduce, Storm, Pig, Shell,
MapReduce.Streaming, Spark
--name List job templates with specific substring in the name
dataprocessing job template show
Display job template details
usage: dataprocessing job template show [-h]
[-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX]
<job-template>
Positional arguments:
Name or ID of the job template to display
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
dataprocessing job template update
Updates job template
usage: dataprocessing job template update [-h]
[-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX]
[--name <name>]
[--description <description>]
[--public | --private]
[--protected | --unprotected]
<job-template>
Positional arguments:
Name or ID of the job template
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
--name New name of the job template
--description
Description of the job template
--public
Make the job template public (Visible from other tenants)
--private
Make the job_template private (Visible only from this tenant)
--protected
Make the job template protected
--unprotected
Make the job template unprotected
Jobs
dataprocessing job binary delete
Deletes job
usage: dataprocessing job binary delete [-h] [--wait] <job> [<job> ...]
Positional arguments:
ID(s) of the job(s) to delete
Options:
--wait=False
Wait for the job(s) delete to complete
dataprocessing job execute
Executes job
usage: dataprocessing job execute [-h] [-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX]
[--job-template <job-template>]
[--cluster <cluster>] [--input <input>]
[--output <output>]
[--params <name:value> [<name:value> ...]]
[--args <argument> [<argument> ...]]
[--public] [--protected]
[--config-json <filename> | --configs <name:value> [<name:value> ...]]
[--interface <filename>] [--json <filename>]
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
--job-template
Name or ID of the job template [REQUIRED if JSON is not provided]
--cluster
Name or ID of the cluster [REQUIRED if JSON is not provided]
--input
Name or ID of the input data source
--output
Name or ID of the output data source
--params
Parameters to add to the job
--args Arguments to add to the job
--public=False
Make the job public
--protected=False
Make the job protected
--config-json
JSON representation of the job configs
--configs
Configs to add to the job
--interface
JSON representation of the interface
--json JSON representation of the job. Other arguments will not be taken into
account if this one is provided
dataprocessing job list
Lists jobs
usage: dataprocessing job list [-h] [-f {csv,json,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent]
[--quote {all,minimal,none,nonnumeric}]
[--long] [--status <status>]
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: csv, json, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--quote=nonnumeric
when to include quotes, defaults to nonnumeric
Possible choices: all, minimal, none, nonnumeric
--long=False
List additional fields in output
--status
List jobs with specific status
Possible choices: done-with-error, failed, killed, pending, running,
succeeded, to-be-killed
dataprocessing job binary show
Display job details
usage: dataprocessing job binary show [-h] [-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX]
<job>
Positional arguments:
ID of the job to display
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
dataprocessing job binary update
Updates job
usage: dataprocessing job binary update [-h]
[-f {json,shell,table,value,yaml}]
[-c COLUMN] [--max-width <integer>]
[--noindent] [--prefix PREFIX]
[--public | --private]
[--protected | --unprotected]
<job>
Positional arguments:
ID of the job to update
Options:
-f=table, --format=table
the output format, defaults to table
Possible choices: json, shell, table, value, yaml
-c=[], --column=[]
specify the column(s) to include, can be repeated
--max-width=0
Maximum display width, 0 to disable
--noindent=False
whether to disable indenting the JSON
--prefix=
add a prefix to all variable names
--public
Make the job public (Visible from other tenants)
--private
Make the job private (Visible only from this tenant)
--protected
Make the job protected
--unprotected
Make the job unprotected
HOW TO PARTICIPATE
Getting started
· Create account on Github (if you don't have one)
· Make sure that your local git is properly configured by executing git config --list.
If not, configure user.name, user.email
· Create account on Launchpad (if you don't have one)
· Subscribe to OpenStack general mail-list
· Subscribe to OpenStack development mail-list
· Create OpenStack profile
· Login to OpenStack Gerrit with your Launchpad id
· Sign OpenStack Individual Contributor License Agreement
· Make sure that your email is listed in identities
· Subscribe to code-reviews. Go to your settings on http://review.openstack.org
· Go to watched projects
· Add openstack/sahara, openstack/sahara-dashboard, openstack/sahara-extra,
openstack/python-saharaclient, openstack/sahara-image-elements, openstack/horizon
How to stay in touch with the community?
· If you have something to discuss use OpenStack development mail-list. Prefix mail
subject with [Sahara]
· Join #openstack-sahara IRC channel on freenode
· Join public weekly meetings on Thursdays at 18:00 UTC on #openstack-meeting-alt IRC
channel
· Join public weekly meetings on Thursdays at 14:00 UTC on #openstack-meeting-3 IRC
channel
How to send your first patch on review?
· Checkout Sahara code from Github
· Carefully read https://wiki.openstack.org/wiki/Gerrit_Workflow
· Pay special attention to
https://wiki.openstack.org/wiki/Gerrit_Workflow#Committing_Changes
· Apply and commit your changes
· Make sure that your code passes PEP8 checks and unit-tests
· Send your patch on review
· Monitor status of your patch review on https://review.openstack.org/#/
Code is hosted in review.o.o and mirrored to github and git.o.o . Submit bugs to the
Sahara project on launchpad and to the Sahara client on launchpad_client. Submit code to
the openstack/python-saharaclient project using gerrit.
Use sahara online using onworks.net services
