object ConfigCheck
Helper class to throw exceptions if there are environment variables in the spark.cassandra namespace which don't map to Spark Cassandra Connector known properties.
- Alphabetic
- By Inheritance
- ConfigCheck
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Type Members
- class ConnectorConfigurationException extends Exception
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- val MatchThreshold: Double
- val Prefix: String
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
checkConfig(conf: SparkConf): Unit
Checks the SparkConf Object for any unknown spark.cassandra.* properties and throws an exception with suggestions if an unknown property is found.
Checks the SparkConf Object for any unknown spark.cassandra.* properties and throws an exception with suggestions if an unknown property is found.
- conf
SparkConf object to check
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
- val deprecatedProperties: Set[DeprecatedConfigParameter[_]]
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
def
suggestedProperties(unknownProp: String, extraProps: Set[String] = Set.empty): Seq[String]
For a given unknown property determine if we have any guesses as to what the property should be.
For a given unknown property determine if we have any guesses as to what the property should be. Suggestions are found by breaking the unknown property into fragments. spark.cassandra.foo.bar => [foo,bar] Any known property which has some fragments which fuzzy match all of the fragments of the unknown property are considered a suggestion.
Fuzziness is determined by MatchThreshold
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
- def unknownProperties(conf: SparkConf, extraProps: Set[String] = Set.empty): Seq[String]
-
val
validStaticProperties: Set[ConfigParameter[_]]
Set of valid static properties hardcoded in the connector.
Set of valid static properties hardcoded in the connector. Custom CassandraConnectionFactory and AuthConf properties are not listed here.
- val validStaticPropertyNames: Set[String]
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()