File tree Expand file tree Collapse file tree 2 files changed +7
-6
lines changed Expand file tree Collapse file tree 2 files changed +7
-6
lines changed Original file line number Diff line number Diff line change @@ -8,8 +8,8 @@ https://isarn.github.io/isarn-sketches-spark/latest/api/#org.isarnproject.sketch
8
8
9
9
``` scala
10
10
// Note that the version of spark is part of the release name.
11
- // This example is for spark 3.0 :
12
- libraryDependencies += " org.isarnproject" %% " isarn-sketches-spark" % " 0.5.2 -sp3.0 "
11
+ // This example is for spark 3.2 :
12
+ libraryDependencies += " org.isarnproject" %% " isarn-sketches-spark" % " 0.6.0 -sp3.2 "
13
13
14
14
// This package builds against some `% Provided` Apache Spark dependencies:
15
15
libraryDependencies += " org.apache.spark" %% " spark-core" % sparkVersion
@@ -29,15 +29,16 @@ Some context on these changes is available in this Spark Summmit
29
29
30
30
Versions of Spark and Scala that are currently supported:
31
31
32
- - spark 3.0, scala 2.12
32
+ - v0.6.0: spark 3.2, scala 2.12
33
+ - v0.5.2: spark 3.0, scala 2.12
33
34
34
35
If you are interested in a spark/scala build that is not listed above, please contact me and/or file an issue!
35
36
36
37
## How to use from the Spark CLI
37
38
Several Spark CLI tools accept the ` --packages ` argument, including spark-shell and pyspark.
38
39
Following is an example using ` spark-shell ` :
39
40
``` bash
40
- $ spark-shell --packages " org.isarnproject:isarn-sketches-spark_2.12:0.5.2 -sp3.0 "
41
+ $ spark-shell --packages " org.isarnproject:isarn-sketches-spark_2.12:0.6.0 -sp3.2 "
41
42
```
42
43
Note that you need to explicitly include the scala version as part of the package name.
43
44
Original file line number Diff line number Diff line change @@ -12,9 +12,9 @@ name := "isarn-sketches-spark"
12
12
13
13
organization := " org.isarnproject"
14
14
15
- val packageVersion = " 0.5.3-SNAPSHOT "
15
+ val packageVersion = " 0.6.0 "
16
16
17
- val sparkVersion = " 3.0.1 "
17
+ val sparkVersion = " 3.2.0 "
18
18
19
19
val sparkSuffix = s """ sp ${sparkVersion.split('.' ).take(2 ).mkString(" ." )}"""
20
20
You can’t perform that action at this time.
0 commit comments