Class

com.datastax.spark.connector.streaming

CassandraStreamingRDD

Related Doc: package streaming

Permalink

class CassandraStreamingRDD[R] extends CassandraTableScanRDD[R]

RDD representing a Cassandra table for Spark Streaming.

See also

com.datastax.spark.connector.rdd.CassandraTableScanRDD

Linear Supertypes
CassandraTableScanRDD[R], SplitSizeEstimator[R], CassandraTableRowReaderProvider[R], CassandraRDD[R], RDD[R], Logging, Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. CassandraStreamingRDD
  2. CassandraTableScanRDD
  3. SplitSizeEstimator
  4. CassandraTableRowReaderProvider
  5. CassandraRDD
  6. RDD
  7. Logging
  8. Serializable
  9. Serializable
  10. AnyRef
  11. Any
Implicitly
  1. by rddToPairRDDFunctions
  2. by numericRDDToDoubleRDDFunctions
  3. by doubleRDDToDoubleRDDFunctions
  4. by rddToOrderedRDDFunctions
  5. by rddToSequenceFileRDDFunctions
  6. by rddToAsyncRDDActions
  7. by toCassandraTableScanRDDPairFunctions
  8. by toPairRDDFunctions
  9. by toCassandraTableScanFunctions
  10. by toRDDFunctions
  11. by any2stringadd
  12. by StringFormat
  13. by Ensuring
  14. by ArrowAssoc
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. type Self = CassandraTableScanRDD[R]

    Permalink

    This is slightly different than Scala this.type.

    This is slightly different than Scala this.type. this.type is the unique singleton type of an object which is not compatible with other instances of the same type, so returning anything other than this is not really possible without lying to the compiler by explicit casts. Here SelfType is used to return a copy of the object - a different instance of the same type

    Definition Classes
    CassandraTableScanRDDCassandraRDD

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. def +(other: String): String

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to any2stringadd[CassandraStreamingRDD[R]] performed by method any2stringadd in scala.Predef.
    Definition Classes
    any2stringadd
  4. def ++(other: RDD[R]): RDD[R]

    Permalink
    Definition Classes
    RDD
  5. def ->[B](y: B): (CassandraStreamingRDD[R], B)

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to ArrowAssoc[CassandraStreamingRDD[R]] performed by method ArrowAssoc in scala.Predef. This conversion will take place only if R is a superclass of Any and a subclass of (Nothing, Nothing) with Double (R >: Any <: (Nothing, Nothing) with Double).
    Definition Classes
    ArrowAssoc
    Annotations
    @inline()
  6. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  7. def aggregate[U](zeroValue: U)(seqOp: (U, R) ⇒ U, combOp: (U, U) ⇒ U)(implicit arg0: ClassTag[U]): U

    Permalink
    Definition Classes
    RDD
  8. def aggregateByKey[U](zeroValue: U)(seqOp: (U, V) ⇒ U, combOp: (U, U) ⇒ U)(implicit arg0: ClassTag[U]): RDD[(K, U)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  9. def aggregateByKey[U](zeroValue: U, numPartitions: Int)(seqOp: (U, V) ⇒ U, combOp: (U, U) ⇒ U)(implicit arg0: ClassTag[U]): RDD[(K, U)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  10. def aggregateByKey[U](zeroValue: U, partitioner: Partitioner)(seqOp: (U, V) ⇒ U, combOp: (U, U) ⇒ U)(implicit arg0: ClassTag[U]): RDD[(K, U)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  11. def applyPartitioner[TokenValue, T <: Token[TokenValue]](partitioner: CassandraPartitioner[K, TokenValue, T]): CassandraTableScanRDD[(K, V)]

    Permalink

    Use a specific CassandraPartitioner to use with this PairRDD.

    Use a specific CassandraPartitioner to use with this PairRDD.

    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to CassandraTableScanPairRDDFunctions[K, V] performed by method toCassandraTableScanRDDPairFunctions in com.datastax.spark.connector. This conversion will take place only if R is (K, V) (R =:= (K, V)).
    Definition Classes
    CassandraTableScanPairRDDFunctions
  12. def applyPartitionerFrom[X](thatRdd: CassandraTableScanRDD[(K, X)]): CassandraTableScanRDD[(K, V)]

    Permalink

    Use the CassandraPartitioner from another CassandraTableScanRDD which shares the same key type.

    Use the CassandraPartitioner from another CassandraTableScanRDD which shares the same key type. All Partition Keys columns must also be present in the keys of the target RDD.

    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to CassandraTableScanPairRDDFunctions[K, V] performed by method toCassandraTableScanRDDPairFunctions in com.datastax.spark.connector. This conversion will take place only if R is (K, V) (R =:= (K, V)).
    Definition Classes
    CassandraTableScanPairRDDFunctions
  13. def as[B, A0, A1, A2, A3, A4, A5, A6, A7, A8, A9, A10, A11](f: (A0, A1, A2, A3, A4, A5, A6, A7, A8, A9, A10, A11) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0], arg2: TypeConverter[A1], arg3: TypeConverter[A2], arg4: TypeConverter[A3], arg5: TypeConverter[A4], arg6: TypeConverter[A5], arg7: TypeConverter[A6], arg8: TypeConverter[A7], arg9: TypeConverter[A8], arg10: TypeConverter[A9], arg11: TypeConverter[A10], arg12: TypeConverter[A11]): CassandraRDD[B]

    Permalink
    Definition Classes
    CassandraRDD
  14. def as[B, A0, A1, A2, A3, A4, A5, A6, A7, A8, A9, A10](f: (A0, A1, A2, A3, A4, A5, A6, A7, A8, A9, A10) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0], arg2: TypeConverter[A1], arg3: TypeConverter[A2], arg4: TypeConverter[A3], arg5: TypeConverter[A4], arg6: TypeConverter[A5], arg7: TypeConverter[A6], arg8: TypeConverter[A7], arg9: TypeConverter[A8], arg10: TypeConverter[A9], arg11: TypeConverter[A10]): CassandraRDD[B]

    Permalink
    Definition Classes
    CassandraRDD
  15. def as[B, A0, A1, A2, A3, A4, A5, A6, A7, A8, A9](f: (A0, A1, A2, A3, A4, A5, A6, A7, A8, A9) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0], arg2: TypeConverter[A1], arg3: TypeConverter[A2], arg4: TypeConverter[A3], arg5: TypeConverter[A4], arg6: TypeConverter[A5], arg7: TypeConverter[A6], arg8: TypeConverter[A7], arg9: TypeConverter[A8], arg10: TypeConverter[A9]): CassandraRDD[B]

    Permalink
    Definition Classes
    CassandraRDD
  16. def as[B, A0, A1, A2, A3, A4, A5, A6, A7, A8](f: (A0, A1, A2, A3, A4, A5, A6, A7, A8) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0], arg2: TypeConverter[A1], arg3: TypeConverter[A2], arg4: TypeConverter[A3], arg5: TypeConverter[A4], arg6: TypeConverter[A5], arg7: TypeConverter[A6], arg8: TypeConverter[A7], arg9: TypeConverter[A8]): CassandraRDD[B]

    Permalink
    Definition Classes
    CassandraRDD
  17. def as[B, A0, A1, A2, A3, A4, A5, A6, A7](f: (A0, A1, A2, A3, A4, A5, A6, A7) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0], arg2: TypeConverter[A1], arg3: TypeConverter[A2], arg4: TypeConverter[A3], arg5: TypeConverter[A4], arg6: TypeConverter[A5], arg7: TypeConverter[A6], arg8: TypeConverter[A7]): CassandraRDD[B]

    Permalink
    Definition Classes
    CassandraRDD
  18. def as[B, A0, A1, A2, A3, A4, A5, A6](f: (A0, A1, A2, A3, A4, A5, A6) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0], arg2: TypeConverter[A1], arg3: TypeConverter[A2], arg4: TypeConverter[A3], arg5: TypeConverter[A4], arg6: TypeConverter[A5], arg7: TypeConverter[A6]): CassandraRDD[B]

    Permalink
    Definition Classes
    CassandraRDD
  19. def as[B, A0, A1, A2, A3, A4, A5](f: (A0, A1, A2, A3, A4, A5) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0], arg2: TypeConverter[A1], arg3: TypeConverter[A2], arg4: TypeConverter[A3], arg5: TypeConverter[A4], arg6: TypeConverter[A5]): CassandraRDD[B]

    Permalink
    Definition Classes
    CassandraRDD
  20. def as[B, A0, A1, A2, A3, A4](f: (A0, A1, A2, A3, A4) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0], arg2: TypeConverter[A1], arg3: TypeConverter[A2], arg4: TypeConverter[A3], arg5: TypeConverter[A4]): CassandraRDD[B]

    Permalink
    Definition Classes
    CassandraRDD
  21. def as[B, A0, A1, A2, A3](f: (A0, A1, A2, A3) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0], arg2: TypeConverter[A1], arg3: TypeConverter[A2], arg4: TypeConverter[A3]): CassandraRDD[B]

    Permalink
    Definition Classes
    CassandraRDD
  22. def as[B, A0, A1, A2](f: (A0, A1, A2) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0], arg2: TypeConverter[A1], arg3: TypeConverter[A2]): CassandraRDD[B]

    Permalink
    Definition Classes
    CassandraRDD
  23. def as[B, A0, A1](f: (A0, A1) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0], arg2: TypeConverter[A1]): CassandraRDD[B]

    Permalink
    Definition Classes
    CassandraRDD
  24. def as[B, A0](f: (A0) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0]): CassandraRDD[B]

    Permalink

    Maps each row into object of a different type using provided function taking column value(s) as argument(s).

    Maps each row into object of a different type using provided function taking column value(s) as argument(s). Can be used to convert each row to a tuple or a case class object:

    sc.cassandraTable("ks", "table")
      .select("column1")
      .as((s: String) => s)                 // yields CassandraRDD[String]
    
    sc.cassandraTable("ks", "table")
      .select("column1", "column2")
      .as((_: String, _: Long))             // yields CassandraRDD[(String, Long)]
    
    case class MyRow(key: String, value: Long)
    sc.cassandraTable("ks", "table")
      .select("column1", "column2")
      .as(MyRow)                            // yields CassandraRDD[MyRow]
    Definition Classes
    CassandraRDD
  25. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  26. def cache(): CassandraStreamingRDD.this.type

    Permalink
    Definition Classes
    RDD
  27. def cartesian[U](other: RDD[U])(implicit arg0: ClassTag[U]): RDD[(R, U)]

    Permalink
    Definition Classes
    RDD
  28. def cassandraCount(): Long

    Permalink

    Counts the number of items in this RDD by selecting count(*) on Cassandra table

    Counts the number of items in this RDD by selecting count(*) on Cassandra table

    Definition Classes
    CassandraTableScanRDDCassandraRDD
  29. lazy val cassandraPartitionerClassName: String

    Permalink
    Attributes
    protected
    Definition Classes
    CassandraTableRowReaderProvider
  30. def checkColumnsExistence(columns: Seq[ColumnRef]): Seq[ColumnRef]

    Permalink
    Attributes
    protected
    Definition Classes
    CassandraTableRowReaderProvider
  31. def checkpoint(): Unit

    Permalink
    Definition Classes
    RDD
  32. implicit val classTag: ClassTag[R]

    Permalink
  33. def clearDependencies(): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    RDD
  34. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  35. def clusteringOrder(order: ClusteringOrder): Self

    Permalink

    Adds a CQL ORDER BY clause to the query.

    Adds a CQL ORDER BY clause to the query. It can be applied only in case there are clustering columns and primary key predicate is pushed down in where. It is useful when the default direction of ordering rows within a single Cassandra partition needs to be changed.

    Definition Classes
    CassandraRDD
  36. val clusteringOrder: Option[ClusteringOrder]

    Permalink
    Definition Classes
    CassandraTableScanRDDCassandraRDD
  37. def coalesce(numPartitions: Int, shuffle: Boolean = false, partitionCoalescer: Option[PartitionCoalescer])(implicit ord: Ordering[R] = null): RDD[R]

    Permalink

    This method overrides the default spark behavior and will not create a CoalesceRDD.

    This method overrides the default spark behavior and will not create a CoalesceRDD. Instead it will reduce the number of partitions by adjusting the partitioning of C* data on read. Using this method will override spark.cassandra.input.split.size. The method is useful with where() method call, when actual size of data is smaller then the table size. It has no effect if a partition key is used in where clause.

    numPartitions

    number of partitions

    shuffle

    whether to call shuffle after

    partitionCoalescer

    is ignored if no shuffle, or just passed to shuffled CoalesceRDD

    returns

    new CassandraTableScanRDD with predefined number of partitions

    Definition Classes
    CassandraTableScanRDD → RDD
  38. def cogroup[W1, W2, W3](other1: RDD[(K, W1)], other2: RDD[(K, W2)], other3: RDD[(K, W3)], numPartitions: Int): RDD[(K, (Iterable[V], Iterable[W1], Iterable[W2], Iterable[W3]))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  39. def cogroup[W1, W2](other1: RDD[(K, W1)], other2: RDD[(K, W2)], numPartitions: Int): RDD[(K, (Iterable[V], Iterable[W1], Iterable[W2]))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  40. def cogroup[W](other: RDD[(K, W)], numPartitions: Int): RDD[(K, (Iterable[V], Iterable[W]))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  41. def cogroup[W1, W2](other1: RDD[(K, W1)], other2: RDD[(K, W2)]): RDD[(K, (Iterable[V], Iterable[W1], Iterable[W2]))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  42. def cogroup[W](other: RDD[(K, W)]): RDD[(K, (Iterable[V], Iterable[W]))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  43. def cogroup[W1, W2, W3](other1: RDD[(K, W1)], other2: RDD[(K, W2)], other3: RDD[(K, W3)]): RDD[(K, (Iterable[V], Iterable[W1], Iterable[W2], Iterable[W3]))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  44. def cogroup[W1, W2](other1: RDD[(K, W1)], other2: RDD[(K, W2)], partitioner: Partitioner): RDD[(K, (Iterable[V], Iterable[W1], Iterable[W2]))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  45. def cogroup[W](other: RDD[(K, W)], partitioner: Partitioner): RDD[(K, (Iterable[V], Iterable[W]))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  46. def cogroup[W1, W2, W3](other1: RDD[(K, W1)], other2: RDD[(K, W2)], other3: RDD[(K, W3)], partitioner: Partitioner): RDD[(K, (Iterable[V], Iterable[W1], Iterable[W2], Iterable[W3]))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  47. def collect[U](f: PartialFunction[R, U])(implicit arg0: ClassTag[U]): RDD[U]

    Permalink
    Definition Classes
    RDD
  48. def collect(): Array[R]

    Permalink
    Definition Classes
    RDD
  49. def collectAsMap(): Map[K, V]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  50. def collectAsync(): FutureAction[Seq[R]]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to AsyncRDDActions[R] performed by method rddToAsyncRDDActions in org.apache.spark.rdd.RDD. This conversion will take place only if R is accompanied by a ClassTag, which is a runtime representation of its type that survives erasure (R: ClassTag).
    Definition Classes
    AsyncRDDActions
  51. val columnNames: ColumnSelector

    Permalink
  52. def combineByKey[C](createCombiner: (V) ⇒ C, mergeValue: (C, V) ⇒ C, mergeCombiners: (C, C) ⇒ C): RDD[(K, C)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  53. def combineByKey[C](createCombiner: (V) ⇒ C, mergeValue: (C, V) ⇒ C, mergeCombiners: (C, C) ⇒ C, numPartitions: Int): RDD[(K, C)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  54. def combineByKey[C](createCombiner: (V) ⇒ C, mergeValue: (C, V) ⇒ C, mergeCombiners: (C, C) ⇒ C, partitioner: Partitioner, mapSideCombine: Boolean, serializer: Serializer): RDD[(K, C)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  55. def combineByKeyWithClassTag[C](createCombiner: (V) ⇒ C, mergeValue: (C, V) ⇒ C, mergeCombiners: (C, C) ⇒ C)(implicit ct: ClassTag[C]): RDD[(K, C)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
    Annotations
    @Experimental()
  56. def combineByKeyWithClassTag[C](createCombiner: (V) ⇒ C, mergeValue: (C, V) ⇒ C, mergeCombiners: (C, C) ⇒ C, numPartitions: Int)(implicit ct: ClassTag[C]): RDD[(K, C)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
    Annotations
    @Experimental()
  57. def combineByKeyWithClassTag[C](createCombiner: (V) ⇒ C, mergeValue: (C, V) ⇒ C, mergeCombiners: (C, C) ⇒ C, partitioner: Partitioner, mapSideCombine: Boolean, serializer: Serializer)(implicit ct: ClassTag[C]): RDD[(K, C)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
    Annotations
    @Experimental()
  58. def compute(split: Partition, context: TaskContext): Iterator[R]

    Permalink
    Definition Classes
    CassandraTableScanRDD → RDD
  59. val connector: CassandraConnector

    Permalink
  60. def consistencyLevel: ConsistencyLevel

    Permalink
    Attributes
    protected
    Definition Classes
    CassandraTableRowReaderProvider
  61. def context: SparkContext

    Permalink
    Definition Classes
    RDD
  62. def convertTo[B](implicit arg0: ClassTag[B], arg1: RowReaderFactory[B]): CassandraTableScanRDD[B]

    Permalink
    Attributes
    protected
    Definition Classes
    CassandraTableScanRDDCassandraRDD
  63. def copy(columnNames: ColumnSelector = columnNames, where: CqlWhereClause = where, limit: Option[CassandraLimit] = limit, clusteringOrder: Option[ClusteringOrder] = None, readConf: ReadConf = readConf, connector: CassandraConnector = connector): Self

    Permalink

    Allows to copy this RDD with changing some of the properties

    Allows to copy this RDD with changing some of the properties

    Attributes
    protected
    Definition Classes
    CassandraTableScanRDDCassandraRDD
  64. def count(): Long

    Permalink
    Definition Classes
    RDD
  65. def countApprox(timeout: Long, confidence: Double): PartialResult[BoundedDouble]

    Permalink
    Definition Classes
    RDD
  66. def countApproxDistinct(relativeSD: Double): Long

    Permalink
    Definition Classes
    RDD
  67. def countApproxDistinct(p: Int, sp: Int): Long

    Permalink
    Definition Classes
    RDD
  68. def countApproxDistinctByKey(relativeSD: Double): RDD[(K, Long)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  69. def countApproxDistinctByKey(relativeSD: Double, numPartitions: Int): RDD[(K, Long)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  70. def countApproxDistinctByKey(relativeSD: Double, partitioner: Partitioner): RDD[(K, Long)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  71. def countApproxDistinctByKey(p: Int, sp: Int, partitioner: Partitioner): RDD[(K, Long)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  72. def countAsync(): FutureAction[Long]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to AsyncRDDActions[R] performed by method rddToAsyncRDDActions in org.apache.spark.rdd.RDD. This conversion will take place only if R is accompanied by a ClassTag, which is a runtime representation of its type that survives erasure (R: ClassTag).
    Definition Classes
    AsyncRDDActions
  73. def countByKey(): Map[K, Long]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  74. def countByKeyApprox(timeout: Long, confidence: Double): PartialResult[Map[K, BoundedDouble]]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  75. def countByValue()(implicit ord: Ordering[R]): Map[R, Long]

    Permalink
    Definition Classes
    RDD
  76. def countByValueApprox(timeout: Long, confidence: Double)(implicit ord: Ordering[R]): PartialResult[Map[R, BoundedDouble]]

    Permalink
    Definition Classes
    RDD
  77. def deleteFromCassandra(keyspaceName: String, tableName: String, deleteColumns: ColumnSelector = SomeColumns(), keyColumns: ColumnSelector = PrimaryKeyColumns, writeConf: WriteConf = ...)(implicit connector: CassandraConnector = CassandraConnector(sparkContext), rwf: RowWriterFactory[R]): Unit

    Permalink

    Delete data from Cassandra table, using data from the RDD as primary keys.

    Delete data from Cassandra table, using data from the RDD as primary keys. Uses the specified column names.

    keyspaceName

    the name of the Keyspace to use

    tableName

    the name of the Table to use

    deleteColumns

    The list of column names to delete, empty ColumnSelector means full row.

    keyColumns

    Primary key columns selector, Optional. All RDD primary columns columns will be checked by default

    writeConf

    additional configuration object allowing to set consistency level, batch size, etc.

    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to RDDFunctions[R] performed by method toRDDFunctions in com.datastax.spark.connector.
    Definition Classes
    RDDFunctionsWritableToCassandra
    See also

    com.datastax.spark.connector.writer.WritableToCassandra

  78. final def dependencies: Seq[Dependency[_]]

    Permalink
    Definition Classes
    RDD
  79. def distinct(): RDD[R]

    Permalink
    Definition Classes
    RDD
  80. def distinct(numPartitions: Int)(implicit ord: Ordering[R]): RDD[R]

    Permalink
    Definition Classes
    RDD
  81. def ensuring(cond: (CassandraStreamingRDD[R]) ⇒ Boolean, msg: ⇒ Any): CassandraStreamingRDD[R]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to Ensuring[CassandraStreamingRDD[R]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  82. def ensuring(cond: (CassandraStreamingRDD[R]) ⇒ Boolean): CassandraStreamingRDD[R]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to Ensuring[CassandraStreamingRDD[R]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  83. def ensuring(cond: Boolean, msg: ⇒ Any): CassandraStreamingRDD[R]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to Ensuring[CassandraStreamingRDD[R]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  84. def ensuring(cond: Boolean): CassandraStreamingRDD[R]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to Ensuring[CassandraStreamingRDD[R]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  85. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  86. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  87. def estimateSplitCount(splitSize: Long): Int

    Permalink
    Definition Classes
    SplitSizeEstimator
  88. def fetchSize: Int

    Permalink
    Attributes
    protected
    Definition Classes
    CassandraTableRowReaderProvider
  89. def filter(f: (R) ⇒ Boolean): RDD[R]

    Permalink
    Definition Classes
    RDD
  90. def filterByRange(lower: K, upper: K): RDD[(K, V)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to OrderedRDDFunctions[K, V, (K, V)] performed by method rddToOrderedRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type Ordering[K] is in scope
    2. an implicit value of type ClassTag[K] is in scope
    3. an implicit value of type ClassTag[V] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    OrderedRDDFunctions
  91. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  92. def first(): R

    Permalink
    Definition Classes
    RDD
  93. def firstParent[U](implicit arg0: ClassTag[U]): RDD[U]

    Permalink
    Attributes
    protected[org.apache.spark]
    Definition Classes
    RDD
  94. def flatMap[U](f: (R) ⇒ TraversableOnce[U])(implicit arg0: ClassTag[U]): RDD[U]

    Permalink
    Definition Classes
    RDD
  95. def flatMapValues[U](f: (V) ⇒ TraversableOnce[U]): RDD[(K, U)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  96. def fold(zeroValue: R)(op: (R, R) ⇒ R): R

    Permalink
    Definition Classes
    RDD
  97. def foldByKey(zeroValue: V)(func: (V, V) ⇒ V): RDD[(K, V)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  98. def foldByKey(zeroValue: V, numPartitions: Int)(func: (V, V) ⇒ V): RDD[(K, V)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  99. def foldByKey(zeroValue: V, partitioner: Partitioner)(func: (V, V) ⇒ V): RDD[(K, V)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  100. def foreach(f: (R) ⇒ Unit): Unit

    Permalink
    Definition Classes
    RDD
  101. def foreachAsync(f: (R) ⇒ Unit): FutureAction[Unit]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to AsyncRDDActions[R] performed by method rddToAsyncRDDActions in org.apache.spark.rdd.RDD. This conversion will take place only if R is accompanied by a ClassTag, which is a runtime representation of its type that survives erasure (R: ClassTag).
    Definition Classes
    AsyncRDDActions
  102. def foreachPartition(f: (Iterator[R]) ⇒ Unit): Unit

    Permalink
    Definition Classes
    RDD
  103. def foreachPartitionAsync(f: (Iterator[R]) ⇒ Unit): FutureAction[Unit]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to AsyncRDDActions[R] performed by method rddToAsyncRDDActions in org.apache.spark.rdd.RDD. This conversion will take place only if R is accompanied by a ClassTag, which is a runtime representation of its type that survives erasure (R: ClassTag).
    Definition Classes
    AsyncRDDActions
  104. def formatted(fmtstr: String): String

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to StringFormat[CassandraStreamingRDD[R]] performed by method StringFormat in scala.Predef.
    Definition Classes
    StringFormat
    Annotations
    @inline()
  105. def fullOuterJoin[W](other: RDD[(K, W)], numPartitions: Int): RDD[(K, (Option[V], Option[W]))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  106. def fullOuterJoin[W](other: RDD[(K, W)]): RDD[(K, (Option[V], Option[W]))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  107. def fullOuterJoin[W](other: RDD[(K, W)], partitioner: Partitioner): RDD[(K, (Option[V], Option[W]))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  108. def getCheckpointFile: Option[String]

    Permalink
    Definition Classes
    RDD
  109. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  110. def getDependencies: Seq[Dependency[_]]

    Permalink
    Attributes
    protected
    Definition Classes
    RDD
  111. final def getNumPartitions: Int

    Permalink
    Definition Classes
    RDD
    Annotations
    @Since( "1.6.0" )
  112. def getPartitions: Array[Partition]

    Permalink
    Definition Classes
    CassandraTableScanRDD → RDD
  113. def getPreferredLocations(split: Partition): Seq[String]

    Permalink
    Definition Classes
    CassandraTableScanRDD → RDD
  114. def getStorageLevel: StorageLevel

    Permalink
    Definition Classes
    RDD
  115. def glom(): RDD[Array[R]]

    Permalink
    Definition Classes
    RDD
  116. def groupBy[K](f: (R) ⇒ K, p: Partitioner)(implicit kt: ClassTag[K], ord: Ordering[K]): RDD[(K, Iterable[R])]

    Permalink
    Definition Classes
    RDD
  117. def groupBy[K](f: (R) ⇒ K, numPartitions: Int)(implicit kt: ClassTag[K]): RDD[(K, Iterable[R])]

    Permalink
    Definition Classes
    RDD
  118. def groupBy[K](f: (R) ⇒ K)(implicit kt: ClassTag[K]): RDD[(K, Iterable[R])]

    Permalink
    Definition Classes
    RDD
  119. def groupByKey(): RDD[(K, Iterable[V])]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  120. def groupByKey(numPartitions: Int): RDD[(K, Iterable[V])]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  121. def groupByKey(partitioner: Partitioner): RDD[(K, Iterable[V])]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  122. def groupWith[W1, W2, W3](other1: RDD[(K, W1)], other2: RDD[(K, W2)], other3: RDD[(K, W3)]): RDD[(K, (Iterable[V], Iterable[W1], Iterable[W2], Iterable[W3]))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  123. def groupWith[W1, W2](other1: RDD[(K, W1)], other2: RDD[(K, W2)]): RDD[(K, (Iterable[V], Iterable[W1], Iterable[W2]))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  124. def groupWith[W](other: RDD[(K, W)]): RDD[(K, (Iterable[V], Iterable[W]))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  125. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  126. val id: Int

    Permalink
    Definition Classes
    RDD
  127. def initializeLogIfNecessary(isInterpreter: Boolean): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  128. def intersection(other: RDD[R], numPartitions: Int): RDD[R]

    Permalink
    Definition Classes
    RDD
  129. def intersection(other: RDD[R], partitioner: Partitioner)(implicit ord: Ordering[R]): RDD[R]

    Permalink
    Definition Classes
    RDD
  130. def intersection(other: RDD[R]): RDD[R]

    Permalink
    Definition Classes
    RDD
  131. def isCheckpointed: Boolean

    Permalink
    Definition Classes
    RDD
  132. def isEmpty(): Boolean

    Permalink
    Definition Classes
    RDD
  133. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  134. def isTraceEnabled(): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  135. final def iterator(split: Partition, context: TaskContext): Iterator[R]

    Permalink
    Definition Classes
    RDD
  136. def join[W](other: RDD[(K, W)], numPartitions: Int): RDD[(K, (V, W))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  137. def join[W](other: RDD[(K, W)]): RDD[(K, (V, W))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  138. def join[W](other: RDD[(K, W)], partitioner: Partitioner): RDD[(K, (V, W))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  139. def joinWithCassandraTable[R](keyspaceName: String, tableName: String, selectedColumns: ColumnSelector = AllColumns, joinColumns: ColumnSelector = PartitionKeyColumns)(implicit connector: CassandraConnector = CassandraConnector(sparkContext), newType: ClassTag[R], rrf: RowReaderFactory[R], ev: ValidRDDType[R], currentType: ClassTag[R], rwf: RowWriterFactory[R]): CassandraJoinRDD[R, R]

    Permalink

    Uses the data from RDD to join with a Cassandra table without retrieving the entire table.

    Uses the data from RDD to join with a Cassandra table without retrieving the entire table. Any RDD which can be used to saveToCassandra can be used to joinWithCassandra as well as any RDD which only specifies the partition Key of a Cassandra Table. This method executes single partition requests against the Cassandra Table and accepts the functional modifiers that a normal com.datastax.spark.connector.rdd.CassandraTableScanRDD takes.

    By default this method only uses the Partition Key for joining but any combination of columns which are acceptable to C* can be used in the join. Specify columns using joinColumns as a parameter or the on() method.

    Example With Prior Repartitioning:

    val source = sc.parallelize(keys).map(x => new KVRow(x))
    val repart = source.repartitionByCassandraReplica(keyspace, tableName, 10)
    val someCass = repart.joinWithCassandraTable(keyspace, tableName)

    Example Joining on Clustering Columns:

    val source = sc.parallelize(keys).map(x => (x, x * 100))
    val someCass = source.joinWithCassandraTable(keyspace, wideTable).on(SomeColumns("key", "group"))
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to RDDFunctions[R] performed by method toRDDFunctions in com.datastax.spark.connector.
    Definition Classes
    RDDFunctions
  140. def keyAndApplyPartitionerFrom[K, X](thatRDD: CassandraTableScanRDD[(K, X)], columnSelector: ColumnSelector = PartitionKeyColumns)(implicit classTag: ClassTag[K], rrf: RowReaderFactory[K], rwf: RowWriterFactory[K]): CassandraTableScanRDD[(K, R)]

    Permalink

    Shortcut for rdd.keyBy[K].applyPartitionerFrom(thatRDD[K, V]) where K is the key type of the target RDD.

    Shortcut for rdd.keyBy[K].applyPartitionerFrom(thatRDD[K, V]) where K is the key type of the target RDD. This guarentees that the partitioner applied to this rdd will match the key type.

    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to CassandraTableScanRDDFunctions[R] performed by method toCassandraTableScanFunctions in com.datastax.spark.connector.
    Definition Classes
    CassandraTableScanRDDFunctions
  141. def keyBy[K]()(implicit classtag: ClassTag[K], rrf: RowReaderFactory[K], rwf: RowWriterFactory[K]): CassandraTableScanRDD[(K, R)]

    Permalink

    Extracts a key of the given class from all the available columns.

    Extracts a key of the given class from all the available columns.

    Definition Classes
    CassandraTableScanRDD
    See also

    keyBy(ColumnSelector)

  142. def keyBy[K](columns: ColumnRef*)(implicit classtag: ClassTag[K], rrf: RowReaderFactory[K], rwf: RowWriterFactory[K]): CassandraTableScanRDD[(K, R)]

    Permalink

    Extracts a key of the given class from the given columns.

    Extracts a key of the given class from the given columns.

    Definition Classes
    CassandraTableScanRDD
    See also

    keyBy(ColumnSelector)

  143. def keyBy[K](columns: ColumnSelector)(implicit classtag: ClassTag[K], rrf: RowReaderFactory[K], rwf: RowWriterFactory[K]): CassandraTableScanRDD[(K, R)]

    Permalink

    Selects a subset of columns mapped to the key and returns an RDD of pairs.

    Selects a subset of columns mapped to the key and returns an RDD of pairs. Similar to the builtin Spark keyBy method, but this one uses implicit RowReaderFactory to construct the key objects. The selected columns must be available in the CassandraRDD.

    If the selected columns contain the complete partition key a CassandraPartitioner will also be created.

    columns

    column selector passed to the rrf to create the row reader, useful when the key is mapped to a tuple or a single value

    Definition Classes
    CassandraTableScanRDD
  144. def keyBy[K](f: (R) ⇒ K): RDD[(K, R)]

    Permalink
    Definition Classes
    RDD
  145. def keyByCassandraReplica(keyspaceName: String, tableName: String, partitionKeyMapper: ColumnSelector = PartitionKeyColumns)(implicit connector: CassandraConnector = CassandraConnector(sparkContext), currentType: ClassTag[R], rwf: RowWriterFactory[R]): RDD[(Set[InetAddress], R)]

    Permalink

    Key every row in the RDD by with the IP Adresses of all of the Cassandra nodes which a contain a replica of the data specified by that row.

    Key every row in the RDD by with the IP Adresses of all of the Cassandra nodes which a contain a replica of the data specified by that row. The calling RDD must have rows that can be converted into the partition key of the given Cassandra Table.

    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to RDDFunctions[R] performed by method toRDDFunctions in com.datastax.spark.connector.
    Definition Classes
    RDDFunctions
  146. def keys: RDD[K]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  147. val keyspaceName: String

    Permalink
  148. def leftJoinWithCassandraTable[R](keyspaceName: String, tableName: String, selectedColumns: ColumnSelector = AllColumns, joinColumns: ColumnSelector = PartitionKeyColumns)(implicit connector: CassandraConnector = CassandraConnector(sparkContext), newType: ClassTag[R], rrf: RowReaderFactory[R], ev: ValidRDDType[R], currentType: ClassTag[R], rwf: RowWriterFactory[R]): CassandraLeftJoinRDD[R, R]

    Permalink

    Uses the data from RDD to left join with a Cassandra table without retrieving the entire table.

    Uses the data from RDD to left join with a Cassandra table without retrieving the entire table. Any RDD which can be used to saveToCassandra can be used to leftJoinWithCassandra as well as any RDD which only specifies the partition Key of a Cassandra Table. This method executes single partition requests against the Cassandra Table and accepts the functional modifiers that a normal com.datastax.spark.connector.rdd.CassandraTableScanRDD takes.

    By default this method only uses the Partition Key for joining but any combination of columns which are acceptable to C* can be used in the join. Specify columns using joinColumns as a parameter or the on() method.

    Example With Prior Repartitioning:

    val source = sc.parallelize(keys).map(x => new KVRow(x))
    val repart = source.repartitionByCassandraReplica(keyspace, tableName, 10)
    val someCass = repart.leftJoinWithCassandraTable(keyspace, tableName)

    Example Joining on Clustering Columns:

    val source = sc.parallelize(keys).map(x => (x, x * 100))
    val someCass = source.leftJoinWithCassandraTable(keyspace, wideTable).on(SomeColumns("key", "group"))
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to RDDFunctions[R] performed by method toRDDFunctions in com.datastax.spark.connector.
    Definition Classes
    RDDFunctions
  149. def leftOuterJoin[W](other: RDD[(K, W)], numPartitions: Int): RDD[(K, (V, Option[W]))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  150. def leftOuterJoin[W](other: RDD[(K, W)]): RDD[(K, (V, Option[W]))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  151. def leftOuterJoin[W](other: RDD[(K, W)], partitioner: Partitioner): RDD[(K, (V, Option[W]))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  152. def limit(rowLimit: Long): Self

    Permalink

    Adds the limit clause to CQL select statement.

    Adds the limit clause to CQL select statement. The limit will be applied for each created Spark partition. In other words, unless the data are fetched from a single Cassandra partition the number of results is unpredictable.

    The main purpose of passing limit clause is to fetch top n rows from a single Cassandra partition when the table is designed so that it uses clustering keys and a partition key predicate is passed to the where clause.

    Definition Classes
    CassandraRDD
  153. val limit: Option[CassandraLimit]

    Permalink
    Definition Classes
    CassandraTableScanRDDCassandraRDD
  154. def localCheckpoint(): CassandraStreamingRDD.this.type

    Permalink
    Definition Classes
    RDD
  155. def log: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  156. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  157. def logDebug(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  158. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  159. def logError(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  160. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  161. def logInfo(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  162. def logName: String

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  163. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  164. def logTrace(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  165. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  166. def logWarning(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  167. def lookup(key: K): Seq[V]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  168. def map[U](f: (R) ⇒ U)(implicit arg0: ClassTag[U]): RDD[U]

    Permalink
    Definition Classes
    RDD
  169. def mapPartitions[U](f: (Iterator[R]) ⇒ Iterator[U], preservesPartitioning: Boolean)(implicit arg0: ClassTag[U]): RDD[U]

    Permalink
    Definition Classes
    RDD
  170. def mapPartitionsWithIndex[U](f: (Int, Iterator[R]) ⇒ Iterator[U], preservesPartitioning: Boolean)(implicit arg0: ClassTag[U]): RDD[U]

    Permalink
    Definition Classes
    RDD
  171. def mapValues[U](f: (V) ⇒ U): RDD[(K, U)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  172. def max()(implicit ord: Ordering[R]): R

    Permalink
    Definition Classes
    RDD
  173. def min()(implicit ord: Ordering[R]): R

    Permalink
    Definition Classes
    RDD
  174. var name: String

    Permalink
    Definition Classes
    RDD
  175. def narrowColumnSelection(columns: Seq[ColumnRef]): Seq[ColumnRef]

    Permalink

    Filters currently selected set of columns with a new set of columns

    Filters currently selected set of columns with a new set of columns

    Definition Classes
    CassandraTableRowReaderProvider
  176. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  177. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  178. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  179. def parent[U](j: Int)(implicit arg0: ClassTag[U]): RDD[U]

    Permalink
    Attributes
    protected[org.apache.spark]
    Definition Classes
    RDD
  180. def partitionBy(partitioner: Partitioner): RDD[(K, V)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  181. lazy val partitionGenerator: CassandraPartitionGenerator[V, T]

    Permalink
    Definition Classes
    CassandraTableScanRDD
  182. val partitioner: Option[Partitioner]

    Permalink
    Definition Classes
    CassandraTableScanRDD → RDD
  183. final def partitions: Array[Partition]

    Permalink
    Definition Classes
    RDD
  184. def perPartitionLimit(rowLimit: Long): Self

    Permalink

    Adds the PER PARTITION LIMIT clause to CQL select statement.

    Adds the PER PARTITION LIMIT clause to CQL select statement. The limit will be applied for every Cassandra Partition. Only Valid For Cassandra 3.6+

    Definition Classes
    CassandraRDD
  185. def persist(): CassandraStreamingRDD.this.type

    Permalink
    Definition Classes
    RDD
  186. def persist(newLevel: StorageLevel): CassandraStreamingRDD.this.type

    Permalink
    Definition Classes
    RDD
  187. def pipe(command: Seq[String], env: Map[String, String], printPipeContext: ((String) ⇒ Unit) ⇒ Unit, printRDDElement: (R, (String) ⇒ Unit) ⇒ Unit, separateWorkingDir: Boolean, bufferSize: Int, encoding: String): RDD[String]

    Permalink
    Definition Classes
    RDD
  188. def pipe(command: String, env: Map[String, String]): RDD[String]

    Permalink
    Definition Classes
    RDD
  189. def pipe(command: String): RDD[String]

    Permalink
    Definition Classes
    RDD
  190. final def preferredLocations(split: Partition): Seq[String]

    Permalink
    Definition Classes
    RDD
  191. def randomSplit(weights: Array[Double], seed: Long): Array[RDD[R]]

    Permalink
    Definition Classes
    RDD
  192. val readConf: ReadConf

    Permalink
  193. def reduce(f: (R, R) ⇒ R): R

    Permalink
    Definition Classes
    RDD
  194. def reduceByKey(func: (V, V) ⇒ V): RDD[(K, V)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  195. def reduceByKey(func: (V, V) ⇒ V, numPartitions: Int): RDD[(K, V)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  196. def reduceByKey(partitioner: Partitioner, func: (V, V) ⇒ V): RDD[(K, V)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  197. def reduceByKeyLocally(func: (V, V) ⇒ V): Map[K, V]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  198. def repartition(numPartitions: Int)(implicit ord: Ordering[R]): RDD[R]

    Permalink
    Definition Classes
    RDD
  199. def repartitionAndSortWithinPartitions(partitioner: Partitioner): RDD[(K, V)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to OrderedRDDFunctions[K, V, (K, V)] performed by method rddToOrderedRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type Ordering[K] is in scope
    2. an implicit value of type ClassTag[K] is in scope
    3. an implicit value of type ClassTag[V] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    OrderedRDDFunctions
  200. def repartitionByCassandraReplica(keyspaceName: String, tableName: String, partitionsPerHost: Int = 10, partitionKeyMapper: ColumnSelector = PartitionKeyColumns)(implicit connector: CassandraConnector = CassandraConnector(sparkContext), currentType: ClassTag[R], rwf: RowWriterFactory[R]): CassandraPartitionedRDD[R]

    Permalink

    Repartitions the data (via a shuffle) based upon the replication of the given keyspaceName and tableName.

    Repartitions the data (via a shuffle) based upon the replication of the given keyspaceName and tableName. Calling this method before using joinWithCassandraTable will ensure that requests will be coordinator local. partitionsPerHost Controls the number of Spark Partitions that will be created in this repartitioning event. The calling RDD must have rows that can be converted into the partition key of the given Cassandra Table.

    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to RDDFunctions[R] performed by method toRDDFunctions in com.datastax.spark.connector.
    Definition Classes
    RDDFunctions
  201. def rightOuterJoin[W](other: RDD[(K, W)], numPartitions: Int): RDD[(K, (Option[V], W))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  202. def rightOuterJoin[W](other: RDD[(K, W)]): RDD[(K, (Option[V], W))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  203. def rightOuterJoin[W](other: RDD[(K, W)], partitioner: Partitioner): RDD[(K, (Option[V], W))]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  204. lazy val rowReader: RowReader[R]

    Permalink
  205. implicit val rowReaderFactory: RowReaderFactory[R]

    Permalink

    RowReaderFactory and ClassTag should be provided from implicit parameters in the constructor of the class implementing this trait

    RowReaderFactory and ClassTag should be provided from implicit parameters in the constructor of the class implementing this trait

    Definition Classes
    CassandraTableScanRDDCassandraTableRowReaderProvider
    See also

    CassandraTableScanRDD

  206. implicit val rrf: RowReaderFactory[R]

    Permalink
  207. def sample(withReplacement: Boolean, fraction: Double, seed: Long): RDD[R]

    Permalink
    Definition Classes
    RDD
  208. def sampleByKey(withReplacement: Boolean, fractions: Map[K, Double], seed: Long): RDD[(K, V)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  209. def sampleByKeyExact(withReplacement: Boolean, fractions: Map[K, Double], seed: Long): RDD[(K, V)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  210. def saveAsCassandraTable(keyspaceName: String, tableName: String, columns: ColumnSelector = AllColumns, writeConf: WriteConf = ...)(implicit connector: CassandraConnector = CassandraConnector(sparkContext), rwf: RowWriterFactory[R], columnMapper: ColumnMapper[R]): Unit

    Permalink

    Saves the data from RDD to a new table with definition taken from the ColumnMapper for this class.

    Saves the data from RDD to a new table with definition taken from the ColumnMapper for this class.

    keyspaceName

    keyspace where to create a new table

    tableName

    name of the table to create; the table must not exist

    columns

    Selects the columns to save data to. Uses only the unique column names, and you must select at least all primary key columns. All other fields are discarded. Non-selected property/column names are left unchanged. This parameter does not affect table creation.

    writeConf

    additional configuration object allowing to set consistency level, batch size, etc.

    connector

    optional, implicit connector to Cassandra

    rwf

    factory for obtaining the row writer to be used to extract column values from items of the RDD

    columnMapper

    a column mapper determining the definition of the table

    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to RDDFunctions[R] performed by method toRDDFunctions in com.datastax.spark.connector.
    Definition Classes
    RDDFunctions
  211. def saveAsCassandraTableEx(table: TableDef, columns: ColumnSelector = AllColumns, writeConf: WriteConf = ...)(implicit connector: CassandraConnector = CassandraConnector(sparkContext), rwf: RowWriterFactory[R]): Unit

    Permalink

    Saves the data from RDD to a new table defined by the given TableDef.

    Saves the data from RDD to a new table defined by the given TableDef.

    First it creates a new table with all columns from the TableDef and then it saves RDD content in the same way as saveToCassandra. The table must not exist prior to this call.

    table

    table definition used to create a new table

    columns

    Selects the columns to save data to. Uses only the unique column names, and you must select at least all primary key columns. All other fields are discarded. Non-selected property/column names are left unchanged. This parameter does not affect table creation.

    writeConf

    additional configuration object allowing to set consistency level, batch size, etc.

    connector

    optional, implicit connector to Cassandra

    rwf

    factory for obtaining the row writer to be used to extract column values from items of the RDD

    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to RDDFunctions[R] performed by method toRDDFunctions in com.datastax.spark.connector.
    Definition Classes
    RDDFunctions
  212. def saveAsHadoopDataset(conf: JobConf): Unit

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  213. def saveAsHadoopFile(path: String, keyClass: Class[_], valueClass: Class[_], outputFormatClass: Class[_ <: OutputFormat[_, _]], conf: JobConf, codec: Option[Class[_ <: CompressionCodec]]): Unit

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  214. def saveAsHadoopFile(path: String, keyClass: Class[_], valueClass: Class[_], outputFormatClass: Class[_ <: OutputFormat[_, _]], codec: Class[_ <: CompressionCodec]): Unit

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  215. def saveAsHadoopFile[F <: OutputFormat[K, V]](path: String, codec: Class[_ <: CompressionCodec])(implicit fm: ClassTag[F]): Unit

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  216. def saveAsHadoopFile[F <: OutputFormat[K, V]](path: String)(implicit fm: ClassTag[F]): Unit

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  217. def saveAsNewAPIHadoopDataset(conf: Configuration): Unit

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  218. def saveAsNewAPIHadoopFile(path: String, keyClass: Class[_], valueClass: Class[_], outputFormatClass: Class[_ <: OutputFormat[_, _]], conf: Configuration): Unit

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  219. def saveAsNewAPIHadoopFile[F <: OutputFormat[K, V]](path: String)(implicit fm: ClassTag[F]): Unit

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  220. def saveAsObjectFile(path: String): Unit

    Permalink
    Definition Classes
    RDD
  221. def saveAsSequenceFile(path: String, codec: Option[Class[_ <: CompressionCodec]]): Unit

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to SequenceFileRDDFunctions[K, V] performed by method rddToSequenceFileRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type WritableFactory[K] is in scope
    4. an implicit value of type WritableFactory[V] is in scope
    5. R is (K, V) (R =:= (K, V))
    Definition Classes
    SequenceFileRDDFunctions
  222. def saveAsTextFile(path: String, codec: Class[_ <: CompressionCodec]): Unit

    Permalink
    Definition Classes
    RDD
  223. def saveAsTextFile(path: String): Unit

    Permalink
    Definition Classes
    RDD
  224. def saveToCassandra(keyspaceName: String, tableName: String, columns: ColumnSelector = AllColumns, writeConf: WriteConf = ...)(implicit connector: CassandraConnector = CassandraConnector(sparkContext), rwf: RowWriterFactory[R]): Unit

    Permalink

    Saves the data from RDD to a Cassandra table.

    Saves the data from RDD to a Cassandra table. Uses the specified column names.

    keyspaceName

    the name of the Keyspace to use

    tableName

    the name of the Table to use

    writeConf

    additional configuration object allowing to set consistency level, batch size, etc.

    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to RDDFunctions[R] performed by method toRDDFunctions in com.datastax.spark.connector.
    Definition Classes
    RDDFunctionsWritableToCassandra
    See also

    com.datastax.spark.connector.writer.WritableToCassandra

  225. val sc: SparkContext

    Permalink
    Definition Classes
    CassandraTableScanRDD
  226. def select(columns: ColumnRef*): Self

    Permalink

    Narrows down the selected set of columns.

    Narrows down the selected set of columns. Use this for better performance, when you don't need all the columns in the result RDD. When called multiple times, it selects the subset of the already selected columns, so after a column was removed by the previous select call, it is not possible to add it back.

    The selected columns are ColumnRef instances. This type allows to specify columns for straightforward retrieval and to read TTL or write time of regular columns as well. Implicit conversions included in com.datastax.spark.connector package make it possible to provide just column names (which is also backward compatible) and optional add .ttl or .writeTime suffix in order to create an appropriate ColumnRef instance.

    Definition Classes
    CassandraRDD
  227. def selectedColumnNames: Seq[String]

    Permalink
    Definition Classes
    CassandraRDD
  228. lazy val selectedColumnRefs: Seq[ColumnRef]

    Permalink

    Returns the columns to be selected from the table.

    Returns the columns to be selected from the table.

    Definition Classes
    CassandraTableRowReaderProvider
  229. def setName(_name: String): CassandraStreamingRDD.this.type

    Permalink
    Definition Classes
    RDD
  230. def sortBy[K](f: (R) ⇒ K, ascending: Boolean, numPartitions: Int)(implicit ord: Ordering[K], ctag: ClassTag[K]): RDD[R]

    Permalink
    Definition Classes
    RDD
  231. def sortByKey(ascending: Boolean, numPartitions: Int): RDD[(K, V)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to OrderedRDDFunctions[K, V, (K, V)] performed by method rddToOrderedRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type Ordering[K] is in scope
    2. an implicit value of type ClassTag[K] is in scope
    3. an implicit value of type ClassTag[V] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    OrderedRDDFunctions
  232. def spanBy[U](f: (R) ⇒ U): RDD[(U, Iterable[R])]

    Permalink

    Applies a function to each item, and groups consecutive items having the same value together.

    Applies a function to each item, and groups consecutive items having the same value together. Contrary to groupBy, items from the same group must be already next to each other in the original collection. Works locally on each partition, so items from different partitions will never be placed in the same group.

    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to RDDFunctions[R] performed by method toRDDFunctions in com.datastax.spark.connector.
    Definition Classes
    RDDFunctions
  233. def spanByKey: RDD[(K, Seq[V])]

    Permalink

    Groups items with the same key, assuming the items with the same key are next to each other in the collection.

    Groups items with the same key, assuming the items with the same key are next to each other in the collection. It does not perform shuffle, therefore it is much faster than using much more universal Spark RDD groupByKey. For this method to be useful with Cassandra tables, the key must represent a prefix of the primary key, containing at least the partition key of the Cassandra table.

    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to PairRDDFunctions[K, V] performed by method toPairRDDFunctions in com.datastax.spark.connector. This conversion will take place only if R is (K, V) (R =:= (K, V)).
    Definition Classes
    PairRDDFunctions
  234. def sparkContext: SparkContext

    Permalink
    Definition Classes
    RDD
  235. def splitCount: Option[Int]

    Permalink
    Attributes
    protected
    Definition Classes
    CassandraTableRowReaderProvider
  236. def splitSize: Long

    Permalink
    Attributes
    protected[com.datastax.spark.connector]
    Definition Classes
    CassandraTableRowReaderProvider
  237. def subtract(other: RDD[R], p: Partitioner)(implicit ord: Ordering[R]): RDD[R]

    Permalink
    Definition Classes
    RDD
  238. def subtract(other: RDD[R], numPartitions: Int): RDD[R]

    Permalink
    Definition Classes
    RDD
  239. def subtract(other: RDD[R]): RDD[R]

    Permalink
    Definition Classes
    RDD
  240. def subtractByKey[W](other: RDD[(K, W)], p: Partitioner)(implicit arg0: ClassTag[W]): RDD[(K, V)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  241. def subtractByKey[W](other: RDD[(K, W)], numPartitions: Int)(implicit arg0: ClassTag[W]): RDD[(K, V)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  242. def subtractByKey[W](other: RDD[(K, W)])(implicit arg0: ClassTag[W]): RDD[(K, V)]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  243. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  244. lazy val tableDef: TableDef

    Permalink
  245. val tableName: String

    Permalink
  246. def take(num: Int): Array[R]

    Permalink
    Definition Classes
    CassandraRDD → RDD
  247. def takeAsync(num: Int): FutureAction[Seq[R]]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to AsyncRDDActions[R] performed by method rddToAsyncRDDActions in org.apache.spark.rdd.RDD. This conversion will take place only if R is accompanied by a ClassTag, which is a runtime representation of its type that survives erasure (R: ClassTag).
    Definition Classes
    AsyncRDDActions
  248. def takeOrdered(num: Int)(implicit ord: Ordering[R]): Array[R]

    Permalink
    Definition Classes
    RDD
  249. def takeSample(withReplacement: Boolean, num: Int, seed: Long): Array[R]

    Permalink
    Definition Classes
    RDD
  250. def toDebugString: String

    Permalink
    Definition Classes
    RDD
  251. def toEmptyCassandraRDD: EmptyCassandraRDD[R]

    Permalink
    Definition Classes
    CassandraTableScanRDDCassandraRDD
  252. def toJavaRDD(): JavaRDD[R]

    Permalink
    Definition Classes
    RDD
  253. def toLocalIterator: Iterator[R]

    Permalink
    Definition Classes
    RDD
  254. def toString(): String

    Permalink
    Definition Classes
    RDD → AnyRef → Any
  255. implicit lazy val tokenFactory: TokenFactory[V, T]

    Permalink
    Definition Classes
    SplitSizeEstimator
  256. def top(num: Int)(implicit ord: Ordering[R]): Array[R]

    Permalink
    Definition Classes
    RDD
  257. def treeAggregate[U](zeroValue: U)(seqOp: (U, R) ⇒ U, combOp: (U, U) ⇒ U, depth: Int)(implicit arg0: ClassTag[U]): U

    Permalink
    Definition Classes
    RDD
  258. def treeReduce(f: (R, R) ⇒ R, depth: Int): R

    Permalink
    Definition Classes
    RDD
  259. def union(other: RDD[R]): RDD[R]

    Permalink
    Definition Classes
    RDD
  260. def unpersist(blocking: Boolean): CassandraStreamingRDD.this.type

    Permalink
    Definition Classes
    RDD
  261. def values: RDD[V]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V] performed by method rddToPairRDDFunctions in org.apache.spark.rdd.RDD.
    This conversion will take place only if all of the following constraints are met:
    1. an implicit value of type ClassTag[K] is in scope
    2. an implicit value of type ClassTag[V] is in scope
    3. an implicit value of type Ordering[K] is in scope
    4. R is (K, V) (R =:= (K, V))
    Definition Classes
    PairRDDFunctions
  262. def verify(): RowReader[R]

    Permalink

    Checks for existence of keyspace and table.

    Checks for existence of keyspace and table.

    Definition Classes
    CassandraTableRowReaderProvider
  263. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  264. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  265. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  266. def where(cql: String, values: Any*): Self

    Permalink

    Adds a CQL WHERE predicate(s) to the query.

    Adds a CQL WHERE predicate(s) to the query. Useful for leveraging secondary indexes in Cassandra. Implicitly adds an ALLOW FILTERING clause to the WHERE clause, however beware that some predicates might be rejected by Cassandra, particularly in cases when they filter on an unindexed, non-clustering column.

    Definition Classes
    CassandraRDD
  267. val where: CqlWhereClause

    Permalink
    Definition Classes
    CassandraTableScanRDDCassandraRDD
  268. def withAscOrder: Self

    Permalink
    Definition Classes
    CassandraRDD
  269. def withConnector(connector: CassandraConnector): Self

    Permalink

    Returns a copy of this Cassandra RDD with specified connector

    Returns a copy of this Cassandra RDD with specified connector

    Definition Classes
    CassandraRDD
  270. def withDescOrder: Self

    Permalink
    Definition Classes
    CassandraRDD
  271. def withReadConf(readConf: ReadConf): Self

    Permalink

    Allows to set custom read configuration, e.g.

    Allows to set custom read configuration, e.g. consistency level or fetch size.

    Definition Classes
    CassandraRDD
  272. def zip[U](other: RDD[U])(implicit arg0: ClassTag[U]): RDD[(R, U)]

    Permalink
    Definition Classes
    RDD
  273. def zipPartitions[B, C, D, V](rdd2: RDD[B], rdd3: RDD[C], rdd4: RDD[D])(f: (Iterator[R], Iterator[B], Iterator[C], Iterator[D]) ⇒ Iterator[V])(implicit arg0: ClassTag[B], arg1: ClassTag[C], arg2: ClassTag[D], arg3: ClassTag[V]): RDD[V]

    Permalink
    Definition Classes
    RDD
  274. def zipPartitions[B, C, D, V](rdd2: RDD[B], rdd3: RDD[C], rdd4: RDD[D], preservesPartitioning: Boolean)(f: (Iterator[R], Iterator[B], Iterator[C], Iterator[D]) ⇒ Iterator[V])(implicit arg0: ClassTag[B], arg1: ClassTag[C], arg2: ClassTag[D], arg3: ClassTag[V]): RDD[V]

    Permalink
    Definition Classes
    RDD
  275. def zipPartitions[B, C, V](rdd2: RDD[B], rdd3: RDD[C])(f: (Iterator[R], Iterator[B], Iterator[C]) ⇒ Iterator[V])(implicit arg0: ClassTag[B], arg1: ClassTag[C], arg2: ClassTag[V]): RDD[V]

    Permalink
    Definition Classes
    RDD
  276. def zipPartitions[B, C, V](rdd2: RDD[B], rdd3: RDD[C], preservesPartitioning: Boolean)(f: (Iterator[R], Iterator[B], Iterator[C]) ⇒ Iterator[V])(implicit arg0: ClassTag[B], arg1: ClassTag[C], arg2: ClassTag[V]): RDD[V]

    Permalink
    Definition Classes
    RDD
  277. def zipPartitions[B, V](rdd2: RDD[B])(f: (Iterator[R], Iterator[B]) ⇒ Iterator[V])(implicit arg0: ClassTag[B], arg1: ClassTag[V]): RDD[V]

    Permalink
    Definition Classes
    RDD
  278. def zipPartitions[B, V](rdd2: RDD[B], preservesPartitioning: Boolean)(f: (Iterator[R], Iterator[B]) ⇒ Iterator[V])(implicit arg0: ClassTag[B], arg1: ClassTag[V]): RDD[V]

    Permalink
    Definition Classes
    RDD
  279. def zipWithIndex(): RDD[(R, Long)]

    Permalink
    Definition Classes
    RDD
  280. def zipWithUniqueId(): RDD[(R, Long)]

    Permalink
    Definition Classes
    RDD
  281. def [B](y: B): (CassandraStreamingRDD[R], B)

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to ArrowAssoc[CassandraStreamingRDD[R]] performed by method ArrowAssoc in scala.Predef. This conversion will take place only if R is a superclass of Any and a subclass of (Nothing, Nothing) with Double (R >: Any <: (Nothing, Nothing) with Double).
    Definition Classes
    ArrowAssoc

Shadowed Implicit Value Members

  1. def histogram(buckets: Array[Double], evenBuckets: Boolean): Array[Long]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to DoubleRDDFunctions performed by method numericRDDToDoubleRDDFunctions in org.apache.spark.rdd.RDD. This conversion will take place only if R is a numeric class, such as Int, Long, Float or Double (R: Numeric).
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: DoubleRDDFunctions).histogram(buckets, evenBuckets)
    Definition Classes
    DoubleRDDFunctions
  2. def histogram(bucketCount: Int): (Array[Double], Array[Long])

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to DoubleRDDFunctions performed by method numericRDDToDoubleRDDFunctions in org.apache.spark.rdd.RDD. This conversion will take place only if R is a numeric class, such as Int, Long, Float or Double (R: Numeric).
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: DoubleRDDFunctions).histogram(bucketCount)
    Definition Classes
    DoubleRDDFunctions
  3. def histogram(buckets: Array[Double], evenBuckets: Boolean): Array[Long]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to DoubleRDDFunctions performed by method doubleRDDToDoubleRDDFunctions in org.apache.spark.rdd.RDD. This conversion will take place only if R is Double (R =:= Double).
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: DoubleRDDFunctions).histogram(buckets, evenBuckets)
    Definition Classes
    DoubleRDDFunctions
  4. def histogram(bucketCount: Int): (Array[Double], Array[Long])

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to DoubleRDDFunctions performed by method doubleRDDToDoubleRDDFunctions in org.apache.spark.rdd.RDD. This conversion will take place only if R is Double (R =:= Double).
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: DoubleRDDFunctions).histogram(bucketCount)
    Definition Classes
    DoubleRDDFunctions
  5. def mean(): Double

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to DoubleRDDFunctions performed by method numericRDDToDoubleRDDFunctions in org.apache.spark.rdd.RDD. This conversion will take place only if R is a numeric class, such as Int, Long, Float or Double (R: Numeric).
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: DoubleRDDFunctions).mean()
    Definition Classes
    DoubleRDDFunctions
  6. def mean(): Double

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to DoubleRDDFunctions performed by method doubleRDDToDoubleRDDFunctions in org.apache.spark.rdd.RDD. This conversion will take place only if R is Double (R =:= Double).
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: DoubleRDDFunctions).mean()
    Definition Classes
    DoubleRDDFunctions
  7. def meanApprox(timeout: Long, confidence: Double): PartialResult[BoundedDouble]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to DoubleRDDFunctions performed by method numericRDDToDoubleRDDFunctions in org.apache.spark.rdd.RDD. This conversion will take place only if R is a numeric class, such as Int, Long, Float or Double (R: Numeric).
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: DoubleRDDFunctions).meanApprox(timeout, confidence)
    Definition Classes
    DoubleRDDFunctions
  8. def meanApprox(timeout: Long, confidence: Double): PartialResult[BoundedDouble]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to DoubleRDDFunctions performed by method doubleRDDToDoubleRDDFunctions in org.apache.spark.rdd.RDD. This conversion will take place only if R is Double (R =:= Double).
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: DoubleRDDFunctions).meanApprox(timeout, confidence)
    Definition Classes
    DoubleRDDFunctions
  9. def sampleStdev(): Double

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to DoubleRDDFunctions performed by method numericRDDToDoubleRDDFunctions in org.apache.spark.rdd.RDD. This conversion will take place only if R is a numeric class, such as Int, Long, Float or Double (R: Numeric).
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: DoubleRDDFunctions).sampleStdev()
    Definition Classes
    DoubleRDDFunctions
  10. def sampleStdev(): Double

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to DoubleRDDFunctions performed by method doubleRDDToDoubleRDDFunctions in org.apache.spark.rdd.RDD. This conversion will take place only if R is Double (R =:= Double).
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: DoubleRDDFunctions).sampleStdev()
    Definition Classes
    DoubleRDDFunctions
  11. def sampleVariance(): Double

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to DoubleRDDFunctions performed by method numericRDDToDoubleRDDFunctions in org.apache.spark.rdd.RDD. This conversion will take place only if R is a numeric class, such as Int, Long, Float or Double (R: Numeric).
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: DoubleRDDFunctions).sampleVariance()
    Definition Classes
    DoubleRDDFunctions
  12. def sampleVariance(): Double

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to DoubleRDDFunctions performed by method doubleRDDToDoubleRDDFunctions in org.apache.spark.rdd.RDD. This conversion will take place only if R is Double (R =:= Double).
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: DoubleRDDFunctions).sampleVariance()
    Definition Classes
    DoubleRDDFunctions
  13. val sparkContext: SparkContext

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to RDDFunctions[R] performed by method toRDDFunctions in com.datastax.spark.connector.
    Shadowing
    This implicitly inherited member is shadowed by one or more members in this class.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: RDDFunctions[R]).sparkContext
    Definition Classes
    RDDFunctionsWritableToCassandra
  14. def stats(): StatCounter

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to DoubleRDDFunctions performed by method numericRDDToDoubleRDDFunctions in org.apache.spark.rdd.RDD. This conversion will take place only if R is a numeric class, such as Int, Long, Float or Double (R: Numeric).
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: DoubleRDDFunctions).stats()
    Definition Classes
    DoubleRDDFunctions
  15. def stats(): StatCounter

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to DoubleRDDFunctions performed by method doubleRDDToDoubleRDDFunctions in org.apache.spark.rdd.RDD. This conversion will take place only if R is Double (R =:= Double).
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: DoubleRDDFunctions).stats()
    Definition Classes
    DoubleRDDFunctions
  16. def stdev(): Double

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to DoubleRDDFunctions performed by method numericRDDToDoubleRDDFunctions in org.apache.spark.rdd.RDD. This conversion will take place only if R is a numeric class, such as Int, Long, Float or Double (R: Numeric).
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: DoubleRDDFunctions).stdev()
    Definition Classes
    DoubleRDDFunctions
  17. def stdev(): Double

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to DoubleRDDFunctions performed by method doubleRDDToDoubleRDDFunctions in org.apache.spark.rdd.RDD. This conversion will take place only if R is Double (R =:= Double).
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: DoubleRDDFunctions).stdev()
    Definition Classes
    DoubleRDDFunctions
  18. def sum(): Double

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to DoubleRDDFunctions performed by method numericRDDToDoubleRDDFunctions in org.apache.spark.rdd.RDD. This conversion will take place only if R is a numeric class, such as Int, Long, Float or Double (R: Numeric).
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: DoubleRDDFunctions).sum()
    Definition Classes
    DoubleRDDFunctions
  19. def sum(): Double

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to DoubleRDDFunctions performed by method doubleRDDToDoubleRDDFunctions in org.apache.spark.rdd.RDD. This conversion will take place only if R is Double (R =:= Double).
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: DoubleRDDFunctions).sum()
    Definition Classes
    DoubleRDDFunctions
  20. def sumApprox(timeout: Long, confidence: Double): PartialResult[BoundedDouble]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to DoubleRDDFunctions performed by method numericRDDToDoubleRDDFunctions in org.apache.spark.rdd.RDD. This conversion will take place only if R is a numeric class, such as Int, Long, Float or Double (R: Numeric).
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: DoubleRDDFunctions).sumApprox(timeout, confidence)
    Definition Classes
    DoubleRDDFunctions
  21. def sumApprox(timeout: Long, confidence: Double): PartialResult[BoundedDouble]

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to DoubleRDDFunctions performed by method doubleRDDToDoubleRDDFunctions in org.apache.spark.rdd.RDD. This conversion will take place only if R is Double (R =:= Double).
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: DoubleRDDFunctions).sumApprox(timeout, confidence)
    Definition Classes
    DoubleRDDFunctions
  22. def variance(): Double

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to DoubleRDDFunctions performed by method numericRDDToDoubleRDDFunctions in org.apache.spark.rdd.RDD. This conversion will take place only if R is a numeric class, such as Int, Long, Float or Double (R: Numeric).
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: DoubleRDDFunctions).variance()
    Definition Classes
    DoubleRDDFunctions
  23. def variance(): Double

    Permalink
    Implicit information
    This member is added by an implicit conversion from CassandraStreamingRDD[R] to DoubleRDDFunctions performed by method doubleRDDToDoubleRDDFunctions in org.apache.spark.rdd.RDD. This conversion will take place only if R is Double (R =:= Double).
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraStreamingRDD: DoubleRDDFunctions).variance()
    Definition Classes
    DoubleRDDFunctions

Inherited from CassandraTableScanRDD[R]

Inherited from SplitSizeEstimator[R]

Inherited from CassandraRDD[R]

Inherited from RDD[R]

Inherited from Logging

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Inherited by implicit conversion rddToPairRDDFunctions from CassandraStreamingRDD[R] to org.apache.spark.rdd.PairRDDFunctions[K, V]

Inherited by implicit conversion numericRDDToDoubleRDDFunctions from CassandraStreamingRDD[R] to DoubleRDDFunctions

Inherited by implicit conversion doubleRDDToDoubleRDDFunctions from CassandraStreamingRDD[R] to DoubleRDDFunctions

Inherited by implicit conversion rddToOrderedRDDFunctions from CassandraStreamingRDD[R] to OrderedRDDFunctions[K, V, (K, V)]

Inherited by implicit conversion rddToSequenceFileRDDFunctions from CassandraStreamingRDD[R] to SequenceFileRDDFunctions[K, V]

Inherited by implicit conversion rddToAsyncRDDActions from CassandraStreamingRDD[R] to AsyncRDDActions[R]

Inherited by implicit conversion toCassandraTableScanRDDPairFunctions from CassandraStreamingRDD[R] to CassandraTableScanPairRDDFunctions[K, V]

Inherited by implicit conversion toPairRDDFunctions from CassandraStreamingRDD[R] to PairRDDFunctions[K, V]

Inherited by implicit conversion toCassandraTableScanFunctions from CassandraStreamingRDD[R] to CassandraTableScanRDDFunctions[R]

Inherited by implicit conversion toRDDFunctions from CassandraStreamingRDD[R] to RDDFunctions[R]

Inherited by implicit conversion any2stringadd from CassandraStreamingRDD[R] to any2stringadd[CassandraStreamingRDD[R]]

Inherited by implicit conversion StringFormat from CassandraStreamingRDD[R] to StringFormat[CassandraStreamingRDD[R]]

Inherited by implicit conversion Ensuring from CassandraStreamingRDD[R] to Ensuring[CassandraStreamingRDD[R]]

Inherited by implicit conversion ArrowAssoc from CassandraStreamingRDD[R] to ArrowAssoc[CassandraStreamingRDD[R]]

Ungrouped