Skip to content
Michael Nitschinger edited this page May 6, 2015 · 9 revisions

The first thing you need to do is get the spark-connector as a dependency in your project. If you already know everything about spark, here is the maven coordinate:

  • groupId: com.couchbase.client
  • artifactId: spark-connector
  • version: 1.0.0-dp2
libraryDependencies += "com.couchbase.client" %% "spark-connector" % "1.0.0-dp2"

resolvers += "Couchbase Repository" at "http://files.couchbase.com/maven2/"

If you are not just running it locally you need to make sure to deploy it as a fat jar so that all couchbase dependencies are included on the executors classpath. You can also put the dependencies manually on the executors classpath, but this is not recommended and error prone.

If you have no clue how to create a spark project and bundle it with a fat jar, read on.

Getting Started with SBT

Getting Started with Gradle

Getting Started with Maven

Clone this wiki locally