Packages

  • package root
    Definition Classes
    root
  • package com
    Definition Classes
    root
  • package datastax
    Definition Classes
    com
  • package spark
    Definition Classes
    datastax
  • package connector

    The root package of Cassandra connector for Apache Spark.

    The root package of Cassandra connector for Apache Spark. Offers handy implicit conversions that add Cassandra-specific methods to SparkContext and RDD.

    Call cassandraTable method on the SparkContext object to create a CassandraRDD exposing Cassandra tables as Spark RDDs.

    Call RDDFunctions saveToCassandra function on any RDD to save distributed collection to a Cassandra table.

    Example:

    CREATE KEYSPACE test WITH replication = {'class': 'SimpleStrategy', 'replication_factor': 1 };
CREATE TABLE test.words (word text PRIMARY KEY, count int);
INSERT INTO test.words(word, count) VALUES ("and", 50);
    import com.datastax.spark.connector._

val sparkMasterHost = "127.0.0.1"
val cassandraHost = "127.0.0.1"
val keyspace = "test"
val table = "words"

// Tell Spark the address of one Cassandra node:
val conf = new SparkConf(true).set("spark.cassandra.connection.host", cassandraHost)

// Connect to the Spark cluster:
val sc = new SparkContext("spark://" + sparkMasterHost + ":7077", "example", conf)

// Read the table and print its contents:
val rdd = sc.cassandraTable(keyspace, table)
rdd.toArray().foreach(println)

// Write two rows to the table:
val col = sc.parallelize(Seq(("of", 1200), ("the", "863")))
col.saveToCassandra(keyspace, table)

sc.stop()
    Definition Classes
    spark
  • package rdd

    Contains com.datastax.spark.connector.rdd.CassandraTableScanRDD class that is the main entry point for analyzing Cassandra data from Spark.

    Contains com.datastax.spark.connector.rdd.CassandraTableScanRDD class that is the main entry point for analyzing Cassandra data from Spark.

    Definition Classes
    connector
  • package partitioner

    Provides components for partitioning a Cassandra table into smaller parts of appropriate size.

    Provides components for partitioning a Cassandra table into smaller parts of appropriate size. Each partition can be processed locally on at least one cluster node.

    Definition Classes
    rdd
  • package dht
    Definition Classes
    partitioner
  • BigIntToken
  • LongToken
  • Token
  • TokenFactory
  • TokenRange

package dht

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. All

Type Members

  1. case class BigIntToken(value: BigInt) extends Token[BigInt] with Product with Serializable
  2. case class LongToken(value: Long) extends Token[Long] with Product with Serializable
  3. trait Token[T] extends Ordered[Token[T]]
  4. trait TokenFactory[V, T <: Token[V]] extends Serializable
  5. case class TokenRange[V, T <: Token[V]](start: T, end: T, replicas: Set[InetAddress], tokenFactory: TokenFactory[V, T]) extends Product with Serializable

Value Members

  1. object BigIntToken extends Serializable
  2. object LongToken extends Serializable
  3. object TokenFactory extends Serializable

Ungrouped