-
Notifications
You must be signed in to change notification settings - Fork 43
Setup
Michael Nitschinger edited this page May 6, 2015
·
9 revisions
The first thing you need to do is get the spark-connector
as a dependency in your project. If you already know everything about spark, here is the maven coordinate:
-
groupId:
com.couchbase.client
-
artifactId:
spark-connector
-
version:
1.0.0-dp2
libraryDependencies += "com.couchbase.client" %% "spark-connector" % "1.0.0-dp2"
resolvers += "Couchbase Repository" at "http://files.couchbase.com/maven2/"
If you are not just running it locally you need to make sure to deploy it as a fat jar so that all couchbase dependencies are included on the executors classpath. You can also put the dependencies manually on the executors classpath, but this is not recommended and error prone.
If you have no clue how to create a spark project and bundle it with a fat jar, read on.