com.datastax.spark.connector.util

ConfigCheck

object ConfigCheck

Helper class to throw exceptions if there are environment variables in the spark.cassandra namespace which don't map to Spark Cassandra Connector known properties.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. ConfigCheck
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Type Members

  1. class ConnectorConfigurationException extends ConfigurationException

    Exception to be thrown when unknown properties are found in the SparkConf

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. val MatchThreshold: Double

  7. val Prefix: String

  8. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  9. def checkConfig(conf: SparkConf): Unit

    Checks the SparkConf Object for any unknown spark.

    Checks the SparkConf Object for any unknown spark.cassandra.* properties and throws an exception with suggestions if an unknown property is found.

    conf

    SparkConf object to check

  10. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  11. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  12. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  13. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  14. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  15. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  16. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  17. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  18. final def notify(): Unit

    Definition Classes
    AnyRef
  19. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  20. def suggestedProperties(unknownProp: String, extraProps: Set[String] = Set.empty): Seq[String]

    For a given unknown property determine if we have any guesses as to what the property should be.

    For a given unknown property determine if we have any guesses as to what the property should be. Suggestions are found by breaking the unknown property into fragments. spark.cassandra.foo.bar => [foo,bar] Any known property which has some fragments which fuzzy match all of the fragments of the unknown property are considered a suggestion.

    Fuzziness is determined by MatchThreshold

  21. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  22. def toString(): String

    Definition Classes
    AnyRef → Any
  23. def unknownProperties(conf: SparkConf, extraProps: Set[String] = Set.empty): Seq[String]

  24. val validStaticProperties: Set[ConfigParameter[_]]

    Set of valid static properties hardcoded in the connector.

    Set of valid static properties hardcoded in the connector. Custom CassandraConnectionFactory and AuthConf properties are not listed here.

  25. val validStaticPropertyNames: Set[String]

  26. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  27. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  28. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped