Skip to content

AWSKeyspaces

Bases: Spout

__init__(output, state, **kwargs)

Initialize the AWS Keyspaces class.

Parameters:

Name Type Description Default
output BatchOutput

An instance of the BatchOutput class for saving the data.

required
state State

An instance of the State class for maintaining the state.

required
**kwargs

Additional keyword arguments.

{}

Using geniusrise to invoke via command line

genius AWSKeyspaces rise \
    batch \
        --output_s3_bucket my_bucket \
        --output_s3_folder s3/folder \
    none \
    fetch \
        --args region_name=us-east-1 cluster_name=mycluster table_name=mytable

Using geniusrise to invoke via YAML file

version: "1"
spouts:
    my_aws_keyspaces_spout:
        name: "AWSKeyspaces"
        method: "fetch"
        args:
            region_name: "us-east-1"
            cluster_name: "mycluster"
            table_name: "mytable"
        output:
            type: "batch"
            args:
                bucket: "my_bucket"
                s3_folder: "s3/folder"

fetch(region_name, cluster_name, table_name)

📖 Fetch data from an AWS Keyspaces table and save it in batch.

Parameters:

Name Type Description Default
region_name str

The AWS region name.

required
cluster_name str

The AWS Keyspaces cluster name.

required
table_name str

The name of the AWS Keyspaces table.

required

Raises:

Type Description
Exception

If unable to connect to the AWS Keyspaces cluster or execute the query.