Packages

class ReplicaPartitioner[T] extends Partitioner

The replica partitioner will work on an RDD which is keyed on sets of InetAddresses representing Cassandra Hosts . It will group keys which share a common IP address into partitionsPerReplicaSet Partitions.

Linear Supertypes
Partitioner, Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ReplicaPartitioner
  2. Partitioner
  3. Serializable
  4. Serializable
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ReplicaPartitioner(table: String, keyspace: String, partitionsPerReplicaSet: Int, partitionKeyMapper: ColumnSelector, connector: CassandraConnector)(implicit currentType: ClassTag[T], rwf: RowWriterFactory[T])

    partitionsPerReplicaSet

    The number of Spark Partitions to make Per Unique Endpoint

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. val _keyspace: CqlIdentifier
  5. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  6. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  7. val connector: CassandraConnector
  8. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  9. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  10. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  11. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  12. def getEndpointPartition(partition: Partition): ReplicaPartition
  13. def getPartition(key: Any): Int

    Given a set of endpoints, pick a random endpoint, and then a random partition owned by that endpoint.

    Given a set of endpoints, pick a random endpoint, and then a random partition owned by that endpoint. If the requested host doesn't exist chose another random host. Only uses valid hosts from the connected datacenter.

    key

    A Set[InetAddress] of replicas for this Cassandra Partition

    returns

    An integer between 0 and numPartitions

    Definition Classes
    ReplicaPartitioner → Partitioner
  14. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  15. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  16. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  17. val nodeAddresses: NodeAddresses
  18. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  19. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  20. def numPartitions: Int
    Definition Classes
    ReplicaPartitioner → Partitioner
  21. val rowWriter: RowWriter[T]
  22. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  23. val tableDef: TableDef
  24. def toString(): String
    Definition Classes
    AnyRef → Any
  25. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  26. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  27. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from Partitioner

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped