Packages

  • package root
    Definition Classes
    root
  • package com
    Definition Classes
    root
  • package datastax
    Definition Classes
    com
  • package spark
    Definition Classes
    datastax
  • package connector

    The root package of Cassandra connector for Apache Spark.

    The root package of Cassandra connector for Apache Spark. Offers handy implicit conversions that add Cassandra-specific methods to SparkContext and RDD.

    Call cassandraTable method on the SparkContext object to create a CassandraRDD exposing Cassandra tables as Spark RDDs.

    Call RDDFunctions saveToCassandra function on any RDD to save distributed collection to a Cassandra table.

    Example:

    CREATE KEYSPACE test WITH replication = {'class': 'SimpleStrategy', 'replication_factor': 1 };
    CREATE TABLE test.words (word text PRIMARY KEY, count int);
    INSERT INTO test.words(word, count) VALUES ("and", 50);
    import com.datastax.spark.connector._
    
    val sparkMasterHost = "127.0.0.1"
    val cassandraHost = "127.0.0.1"
    val keyspace = "test"
    val table = "words"
    
    // Tell Spark the address of one Cassandra node:
    val conf = new SparkConf(true).set("spark.cassandra.connection.host", cassandraHost)
    
    // Connect to the Spark cluster:
    val sc = new SparkContext("spark://" + sparkMasterHost + ":7077", "example", conf)
    
    // Read the table and print its contents:
    val rdd = sc.cassandraTable(keyspace, table)
    rdd.toArray().foreach(println)
    
    // Write two rows to the table:
    val col = sc.parallelize(Seq(("of", 1200), ("the", "863")))
    col.saveToCassandra(keyspace, table)
    
    sc.stop()
    Definition Classes
    spark
  • package japi
    Definition Classes
    connector
  • package rdd
    Definition Classes
    japi
  • CassandraJavaPairRDD
  • CassandraJavaRDD
  • CassandraJoinJavaRDD
  • CassandraTableScanJavaRDD
c

com.datastax.spark.connector.japi.rdd

CassandraTableScanJavaRDD

class CassandraTableScanJavaRDD[R] extends CassandraJavaRDD[R]

Linear Supertypes
CassandraJavaRDD[R], JavaRDD[R], AbstractJavaRDDLike[R, JavaRDD[R]], JavaRDDLike[R, JavaRDD[R]], Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. CassandraTableScanJavaRDD
  2. CassandraJavaRDD
  3. JavaRDD
  4. AbstractJavaRDDLike
  5. JavaRDDLike
  6. Serializable
  7. Serializable
  8. AnyRef
  9. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new CassandraTableScanJavaRDD(rdd: CassandraTableScanRDD[R], classTag: ClassTag[R])
  2. new CassandraTableScanJavaRDD(rdd: CassandraTableScanRDD[R], clazz: Class[R])

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. def aggregate[U](zeroValue: U)(seqOp: Function2[U, R, U], combOp: Function2[U, U, U]): U
    Definition Classes
    JavaRDDLike
  5. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  6. def cache(): JavaRDD[R]
    Definition Classes
    JavaRDD
  7. def cartesian[U](other: JavaRDDLike[U, _]): JavaPairRDD[R, U]
    Definition Classes
    JavaRDDLike
  8. def cassandraCount(): Long
    Definition Classes
    CassandraJavaRDD
  9. def checkpoint(): Unit
    Definition Classes
    JavaRDDLike
  10. implicit val classTag: ClassTag[R]
    Definition Classes
    JavaRDD → JavaRDDLike
  11. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native() @HotSpotIntrinsicCandidate()
  12. def coalesce(numPartitions: Int, shuffle: Boolean): JavaRDD[R]
    Definition Classes
    JavaRDD
  13. def coalesce(numPartitions: Int): JavaRDD[R]
    Definition Classes
    JavaRDD
  14. def collect(): List[R]
    Definition Classes
    JavaRDDLike
  15. def collectAsync(): JavaFutureAction[List[R]]
    Definition Classes
    JavaRDDLike
  16. def collectPartitions(partitionIds: Array[Int]): Array[List[R]]
    Definition Classes
    JavaRDDLike
  17. def context: SparkContext
    Definition Classes
    JavaRDDLike
  18. def count(): Long
    Definition Classes
    JavaRDDLike
  19. def countApprox(timeout: Long): PartialResult[BoundedDouble]
    Definition Classes
    JavaRDDLike
  20. def countApprox(timeout: Long, confidence: Double): PartialResult[BoundedDouble]
    Definition Classes
    JavaRDDLike
  21. def countApproxDistinct(relativeSD: Double): Long
    Definition Classes
    JavaRDDLike
  22. def countAsync(): JavaFutureAction[Long]
    Definition Classes
    JavaRDDLike
  23. def countByValue(): Map[R, Long]
    Definition Classes
    JavaRDDLike
  24. def countByValueApprox(timeout: Long): PartialResult[Map[R, BoundedDouble]]
    Definition Classes
    JavaRDDLike
  25. def countByValueApprox(timeout: Long, confidence: Double): PartialResult[Map[R, BoundedDouble]]
    Definition Classes
    JavaRDDLike
  26. def distinct(numPartitions: Int): JavaRDD[R]
    Definition Classes
    JavaRDD
  27. def distinct(): JavaRDD[R]
    Definition Classes
    JavaRDD
  28. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  29. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  30. def filter(f: Function[R, Boolean]): JavaRDD[R]
    Definition Classes
    JavaRDD
  31. def first(): R
    Definition Classes
    JavaRDDLike
  32. def flatMap[U](f: FlatMapFunction[R, U]): JavaRDD[U]
    Definition Classes
    JavaRDDLike
  33. def flatMapToDouble(f: DoubleFlatMapFunction[R]): JavaDoubleRDD
    Definition Classes
    JavaRDDLike
  34. def flatMapToPair[K2, V2](f: PairFlatMapFunction[R, K2, V2]): JavaPairRDD[K2, V2]
    Definition Classes
    JavaRDDLike
  35. def fold(zeroValue: R)(f: Function2[R, R, R]): R
    Definition Classes
    JavaRDDLike
  36. def foreach(f: VoidFunction[R]): Unit
    Definition Classes
    JavaRDDLike
  37. def foreachAsync(f: VoidFunction[R]): JavaFutureAction[Void]
    Definition Classes
    JavaRDDLike
  38. def foreachPartition(f: VoidFunction[Iterator[R]]): Unit
    Definition Classes
    JavaRDDLike
  39. def foreachPartitionAsync(f: VoidFunction[Iterator[R]]): JavaFutureAction[Void]
    Definition Classes
    JavaRDDLike
  40. def getCheckpointFile(): Optional[String]
    Definition Classes
    JavaRDDLike
  41. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  42. def getNumPartitions: Int
    Definition Classes
    JavaRDDLike
    Annotations
    @Since( "1.6.0" )
  43. def getResourceProfile(): ResourceProfile
    Definition Classes
    JavaRDD
  44. def getStorageLevel: StorageLevel
    Definition Classes
    JavaRDDLike
  45. def glom(): JavaRDD[List[R]]
    Definition Classes
    JavaRDDLike
  46. def groupBy[U](f: Function[R, U], numPartitions: Int): JavaPairRDD[U, Iterable[R]]
    Definition Classes
    JavaRDDLike
  47. def groupBy[U](f: Function[R, U]): JavaPairRDD[U, Iterable[R]]
    Definition Classes
    JavaRDDLike
  48. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  49. def id: Int
    Definition Classes
    JavaRDDLike
  50. def intersection(other: JavaRDD[R]): JavaRDD[R]
    Definition Classes
    JavaRDD
  51. def isCheckpointed: Boolean
    Definition Classes
    JavaRDDLike
  52. def isEmpty(): Boolean
    Definition Classes
    JavaRDDLike
  53. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  54. def iterator(split: Partition, taskContext: TaskContext): Iterator[R]
    Definition Classes
    JavaRDDLike
  55. def keyAndApplyPartitionerFrom[K](rrf: RowReaderFactory[K], rwf: RowWriterFactory[K], keyClass: Class[K], otherRDD: CassandraJavaPairRDD[K, _]): CassandraJavaPairRDD[K, R]
  56. def keyBy[K](rrf: RowReaderFactory[K], rwf: RowWriterFactory[K], keyClass: Class[K]): CassandraJavaPairRDD[K, R]
  57. def keyBy[K](rrf: RowReaderFactory[K], rwf: RowWriterFactory[K], keyClass: Class[K], columnNames: <repeated...>[String]): CassandraJavaPairRDD[K, R]
  58. def keyBy[K](rrf: RowReaderFactory[K], rwf: RowWriterFactory[K], keyClass: Class[K], columns: <repeated...>[ColumnRef]): CassandraJavaPairRDD[K, R]
  59. def keyBy[K](keyClassTag: ClassTag[K], rrf: RowReaderFactory[K], rwf: RowWriterFactory[K], columns: <repeated...>[ColumnRef]): CassandraJavaPairRDD[K, R]
  60. def keyBy[U](f: Function[R, U]): JavaPairRDD[U, R]
    Definition Classes
    JavaRDDLike
  61. def limit(rowsNumber: Long): CassandraTableScanJavaRDD[R]
  62. def map[R](f: Function[R, R]): JavaRDD[R]
    Definition Classes
    JavaRDDLike
  63. def mapPartitions[U](f: FlatMapFunction[Iterator[R], U], preservesPartitioning: Boolean): JavaRDD[U]
    Definition Classes
    JavaRDDLike
  64. def mapPartitions[U](f: FlatMapFunction[Iterator[R], U]): JavaRDD[U]
    Definition Classes
    JavaRDDLike
  65. def mapPartitionsToDouble(f: DoubleFlatMapFunction[Iterator[R]], preservesPartitioning: Boolean): JavaDoubleRDD
    Definition Classes
    JavaRDDLike
  66. def mapPartitionsToDouble(f: DoubleFlatMapFunction[Iterator[R]]): JavaDoubleRDD
    Definition Classes
    JavaRDDLike
  67. def mapPartitionsToPair[K2, V2](f: PairFlatMapFunction[Iterator[R], K2, V2], preservesPartitioning: Boolean): JavaPairRDD[K2, V2]
    Definition Classes
    JavaRDDLike
  68. def mapPartitionsToPair[K2, V2](f: PairFlatMapFunction[Iterator[R], K2, V2]): JavaPairRDD[K2, V2]
    Definition Classes
    JavaRDDLike
  69. def mapPartitionsWithIndex[R](f: Function2[Integer, Iterator[R], Iterator[R]], preservesPartitioning: Boolean): JavaRDD[R]
    Definition Classes
    JavaRDDLike
  70. def mapToDouble[R](f: DoubleFunction[R]): JavaDoubleRDD
    Definition Classes
    JavaRDDLike
  71. def mapToPair[K2, V2](f: PairFunction[R, K2, V2]): JavaPairRDD[K2, V2]
    Definition Classes
    JavaRDDLike
  72. def max(comp: Comparator[R]): R
    Definition Classes
    JavaRDDLike
  73. def min(comp: Comparator[R]): R
    Definition Classes
    JavaRDDLike
  74. def name(): String
    Definition Classes
    JavaRDDLike
  75. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  76. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  77. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  78. def partitioner: Optional[Partitioner]
    Definition Classes
    JavaRDDLike
  79. def partitions: List[Partition]
    Definition Classes
    JavaRDDLike
  80. def perPartitionLimit(rowsNumber: Long): CassandraJavaRDD[R]
    Definition Classes
    CassandraJavaRDD
  81. def persist(newLevel: StorageLevel): JavaRDD[R]
    Definition Classes
    JavaRDD
  82. def pipe(command: List[String], env: Map[String, String], separateWorkingDir: Boolean, bufferSize: Int, encoding: String): JavaRDD[String]
    Definition Classes
    JavaRDDLike
  83. def pipe(command: List[String], env: Map[String, String], separateWorkingDir: Boolean, bufferSize: Int): JavaRDD[String]
    Definition Classes
    JavaRDDLike
  84. def pipe(command: List[String], env: Map[String, String]): JavaRDD[String]
    Definition Classes
    JavaRDDLike
  85. def pipe(command: List[String]): JavaRDD[String]
    Definition Classes
    JavaRDDLike
  86. def pipe(command: String): JavaRDD[String]
    Definition Classes
    JavaRDDLike
  87. def randomSplit(weights: Array[Double], seed: Long): Array[JavaRDD[R]]
    Definition Classes
    JavaRDD
  88. def randomSplit(weights: Array[Double]): Array[JavaRDD[R]]
    Definition Classes
    JavaRDD
  89. def rdd(): CassandraTableScanRDD[R]
    Definition Classes
    CassandraTableScanJavaRDDCassandraJavaRDD → JavaRDD → JavaRDDLike
  90. def reduce(f: Function2[R, R, R]): R
    Definition Classes
    JavaRDDLike
  91. def repartition(numPartitions: Int): JavaRDD[R]
    Definition Classes
    JavaRDD
  92. def sample(withReplacement: Boolean, fraction: Double, seed: Long): JavaRDD[R]
    Definition Classes
    JavaRDD
  93. def sample(withReplacement: Boolean, fraction: Double): JavaRDD[R]
    Definition Classes
    JavaRDD
  94. def saveAsObjectFile(path: String): Unit
    Definition Classes
    JavaRDDLike
  95. def saveAsTextFile(path: String, codec: Class[_ <: CompressionCodec]): Unit
    Definition Classes
    JavaRDDLike
  96. def saveAsTextFile(path: String): Unit
    Definition Classes
    JavaRDDLike
  97. def select(columns: <repeated...>[ColumnRef]): CassandraTableScanJavaRDD[R]
  98. def select(columnNames: <repeated...>[String]): CassandraTableScanJavaRDD[R]
  99. def selectedColumnNames(): Array[String]
    Definition Classes
    CassandraJavaRDD
  100. def selectedColumnRefs(): Array[ColumnRef]
    Definition Classes
    CassandraJavaRDD
  101. def setName(name: String): JavaRDD[R]
    Definition Classes
    JavaRDD
  102. def sortBy[S](f: Function[R, S], ascending: Boolean, numPartitions: Int): JavaRDD[R]
    Definition Classes
    JavaRDD
  103. def spanBy[K](f: Function[R, K], keyClass: Class[K]): JavaPairRDD[K, Iterable[R]]
    Definition Classes
    CassandraJavaRDD
  104. def spanBy[K](f: Function[R, K], keyClassTag: ClassTag[K]): JavaPairRDD[K, Iterable[R]]
    Definition Classes
    CassandraJavaRDD
  105. def subtract(other: JavaRDD[R], p: Partitioner): JavaRDD[R]
    Definition Classes
    JavaRDD
  106. def subtract(other: JavaRDD[R], numPartitions: Int): JavaRDD[R]
    Definition Classes
    JavaRDD
  107. def subtract(other: JavaRDD[R]): JavaRDD[R]
    Definition Classes
    JavaRDD
  108. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  109. def take(num: Int): List[R]
    Definition Classes
    JavaRDDLike
  110. def takeAsync(num: Int): JavaFutureAction[List[R]]
    Definition Classes
    JavaRDDLike
  111. def takeOrdered(num: Int): List[R]
    Definition Classes
    JavaRDDLike
  112. def takeOrdered(num: Int, comp: Comparator[R]): List[R]
    Definition Classes
    JavaRDDLike
  113. def takeSample(withReplacement: Boolean, num: Int, seed: Long): List[R]
    Definition Classes
    JavaRDDLike
  114. def takeSample(withReplacement: Boolean, num: Int): List[R]
    Definition Classes
    JavaRDDLike
  115. def toDebugString(): String
    Definition Classes
    JavaRDDLike
  116. def toEmptyCassandraRDD(): CassandraJavaRDD[R]
    Definition Classes
    CassandraJavaRDD
  117. def toLocalIterator(): Iterator[R]
    Definition Classes
    JavaRDDLike
  118. def toString(): String
    Definition Classes
    JavaRDD → AnyRef → Any
  119. def top(num: Int): List[R]
    Definition Classes
    JavaRDDLike
  120. def top(num: Int, comp: Comparator[R]): List[R]
    Definition Classes
    JavaRDDLike
  121. def treeAggregate[U](zeroValue: U, seqOp: Function2[U, R, U], combOp: Function2[U, U, U]): U
    Definition Classes
    JavaRDDLike
  122. def treeAggregate[U](zeroValue: U, seqOp: Function2[U, R, U], combOp: Function2[U, U, U], depth: Int): U
    Definition Classes
    JavaRDDLike
  123. def treeReduce(f: Function2[R, R, R]): R
    Definition Classes
    JavaRDDLike
  124. def treeReduce(f: Function2[R, R, R], depth: Int): R
    Definition Classes
    JavaRDDLike
  125. def union(other: JavaRDD[R]): JavaRDD[R]
    Definition Classes
    JavaRDD
  126. def unpersist(blocking: Boolean): JavaRDD[R]
    Definition Classes
    JavaRDD
  127. def unpersist(): JavaRDD[R]
    Definition Classes
    JavaRDD
  128. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  129. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  130. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  131. def where(cqlWhereClause: String, args: <repeated...>[AnyRef]): CassandraTableScanJavaRDD[R]
  132. def withAscOrder(): CassandraTableScanJavaRDD[R]
  133. def withConnector(connector: CassandraConnector): CassandraTableScanJavaRDD[R]
  134. def withDescOrder(): CassandraTableScanJavaRDD[R]
  135. def withReadConf(config: ReadConf): CassandraTableScanJavaRDD[R]
  136. def withResources(rp: ResourceProfile): JavaRDD[R]
    Definition Classes
    JavaRDD
  137. def wrap(newRDD: CassandraRDD[R]): CassandraTableScanJavaRDD[R]
    Attributes
    protected[japi.rdd]
    Definition Classes
    CassandraTableScanJavaRDDCassandraJavaRDD
  138. def wrapRDD(rdd: RDD[R]): JavaRDD[R]
    Definition Classes
    JavaRDD → JavaRDDLike
  139. def zip[U](other: JavaRDDLike[U, _]): JavaPairRDD[R, U]
    Definition Classes
    JavaRDDLike
  140. def zipPartitions[U, V](other: JavaRDDLike[U, _], f: FlatMapFunction2[Iterator[R], Iterator[U], V]): JavaRDD[V]
    Definition Classes
    JavaRDDLike
  141. def zipWithIndex(): JavaPairRDD[R, Long]
    Definition Classes
    JavaRDDLike
  142. def zipWithUniqueId(): JavaPairRDD[R, Long]
    Definition Classes
    JavaRDDLike

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] ) @Deprecated @deprecated
    Deprecated

    (Since version ) see corresponding Javadoc for more information.

Inherited from CassandraJavaRDD[R]

Inherited from JavaRDD[R]

Inherited from AbstractJavaRDDLike[R, JavaRDD[R]]

Inherited from JavaRDDLike[R, JavaRDD[R]]

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped