Packages

  • package root
    Definition Classes
    root
  • package com
    Definition Classes
    root
  • package datastax
    Definition Classes
    com
  • package spark
    Definition Classes
    datastax
  • package connector

    The root package of Cassandra connector for Apache Spark.

    The root package of Cassandra connector for Apache Spark. Offers handy implicit conversions that add Cassandra-specific methods to SparkContext and RDD.

    Call cassandraTable method on the SparkContext object to create a CassandraRDD exposing Cassandra tables as Spark RDDs.

    Call RDDFunctions saveToCassandra function on any RDD to save distributed collection to a Cassandra table.

    Example:

    CREATE KEYSPACE test WITH replication = {'class': 'SimpleStrategy', 'replication_factor': 1 };
    CREATE TABLE test.words (word text PRIMARY KEY, count int);
    INSERT INTO test.words(word, count) VALUES ("and", 50);
    import com.datastax.spark.connector._
    
    val sparkMasterHost = "127.0.0.1"
    val cassandraHost = "127.0.0.1"
    val keyspace = "test"
    val table = "words"
    
    // Tell Spark the address of one Cassandra node:
    val conf = new SparkConf(true).set("spark.cassandra.connection.host", cassandraHost)
    
    // Connect to the Spark cluster:
    val sc = new SparkContext("spark://" + sparkMasterHost + ":7077", "example", conf)
    
    // Read the table and print its contents:
    val rdd = sc.cassandraTable(keyspace, table)
    rdd.toArray().foreach(println)
    
    // Write two rows to the table:
    val col = sc.parallelize(Seq(("of", 1200), ("the", "863")))
    col.saveToCassandra(keyspace, table)
    
    sc.stop()
    Definition Classes
    spark
  • package rdd

    Contains com.datastax.spark.connector.rdd.CassandraTableScanRDD class that is the main entry point for analyzing Cassandra data from Spark.

    Contains com.datastax.spark.connector.rdd.CassandraTableScanRDD class that is the main entry point for analyzing Cassandra data from Spark.

    Definition Classes
    connector
  • package partitioner

    Provides components for partitioning a Cassandra table into smaller parts of appropriate size.

    Provides components for partitioning a Cassandra table into smaller parts of appropriate size. Each partition can be processed locally on at least one cluster node.

    Definition Classes
    rdd
  • package dht
    Definition Classes
    partitioner
  • object TokenFactory extends Serializable
    Definition Classes
    dht
  • Murmur3TokenFactory
  • RandomPartitionerTokenFactory

implicit object Murmur3TokenFactory extends TokenFactory[Long, LongToken]

Linear Supertypes
TokenFactory[Long, LongToken], Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. Murmur3TokenFactory
  2. TokenFactory
  3. Serializable
  4. Serializable
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native() @HotSpotIntrinsicCandidate()
  6. def distance(token1: LongToken, token2: LongToken): BigInt

    Number of tokens in a range from token1 to token2.

    Number of tokens in a range from token1 to token2. If token2 < token1, then range wraps around.

    Definition Classes
    Murmur3TokenFactoryTokenFactory
  7. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  8. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  9. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  10. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  11. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  12. val maxToken: LongToken
    Definition Classes
    Murmur3TokenFactoryTokenFactory
  13. val minToken: LongToken
    Definition Classes
    Murmur3TokenFactoryTokenFactory
  14. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  15. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  16. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  17. def ringFraction(token1: LongToken, token2: LongToken): Double

    Fraction of the ring in a range from token1 to token2.

    Fraction of the ring in a range from token1 to token2. If token2 < token1, then range wraps around. Returns 1.0 for a full ring range, 0.0 for an empty range.

    Definition Classes
    TokenFactory
  18. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  19. def toString(): String
    Definition Classes
    AnyRef → Any
  20. def tokenBucketing: MonotonicBucketing[LongToken]

    Defines how to group tokens into buckets, useful for partitioning

    Defines how to group tokens into buckets, useful for partitioning

    Definition Classes
    Murmur3TokenFactoryTokenFactory
  21. def tokenFromString(string: String): LongToken

    Creates a token from its string representation

    Creates a token from its string representation

    Definition Classes
    Murmur3TokenFactoryTokenFactory
  22. def tokenOrdering: Ordering[LongToken]

    Defines how to compare tokens

    Defines how to compare tokens

    Definition Classes
    Murmur3TokenFactoryTokenFactory
  23. def tokenToString(token: LongToken): String

    Converts a token to its string representation

    Converts a token to its string representation

    Definition Classes
    Murmur3TokenFactoryTokenFactory
  24. val totalTokenCount: BigInt

    Total token count in a ring.

    Total token count in a ring.

    Definition Classes
    Murmur3TokenFactoryTokenFactory
  25. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  26. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  27. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] ) @Deprecated @deprecated
    Deprecated

    (Since version ) see corresponding Javadoc for more information.

Inherited from TokenFactory[Long, LongToken]

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped