diff --git a/README.md b/README.md index 60d91e107..53167d512 100644 --- a/README.md +++ b/README.md @@ -74,13 +74,13 @@ You can link against this library in your program at the following coordinates: -
groupId: za.co.absa.cobrix
artifactId: spark-cobol_2.11
version: 2.7.10
+
groupId: za.co.absa.cobrix
artifactId: spark-cobol_2.11
version: 2.8.0
-
groupId: za.co.absa.cobrix
artifactId: spark-cobol_2.12
version: 2.7.10
+
groupId: za.co.absa.cobrix
artifactId: spark-cobol_2.12
version: 2.8.0
-
groupId: za.co.absa.cobrix
artifactId: spark-cobol_2.13
version: 2.7.10
+
groupId: za.co.absa.cobrix
artifactId: spark-cobol_2.13
version: 2.8.0
@@ -91,17 +91,17 @@ This package can be added to Spark using the `--packages` command line option. F ### Spark compiled with Scala 2.11 ``` -$SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.11:2.7.10 +$SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.11:2.8.0 ``` ### Spark compiled with Scala 2.12 ``` -$SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.12:2.7.10 +$SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.12:2.8.0 ``` ### Spark compiled with Scala 2.13 ``` -$SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.13:2.7.10 +$SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.13:2.8.0 ``` ## Usage @@ -246,7 +246,7 @@ The jars that you need to get are: After that you can specify these jars in `spark-shell` command line. Here is an example: ``` -$ spark-shell --packages za.co.absa.cobrix:spark-cobol_2.12:2.7.10 +$ spark-shell --packages za.co.absa.cobrix:spark-cobol_2.12:2.8.0 or $ spark-shell --master yarn --deploy-mode client --driver-cores 4 --driver-memory 4G --jars spark-cobol_2.12-2.8.0.jar,cobol-parser_2.12-2.8.0.jar @@ -319,7 +319,7 @@ The fat jar will have '-bundle' suffix. You can also download pre-built bundles Then, run `spark-shell` or `spark-submit` adding the fat jar as the option. ```sh -$ spark-shell --jars spark-cobol_2.12_3.3-2.7.11-SNAPSHOT-bundle.jar +$ spark-shell --jars spark-cobol_2.12_3.3-2.8.1-SNAPSHOT-bundle.jar ``` > A note for building and running tests on Windows @@ -1778,6 +1778,9 @@ at org.apache.hadoop.io.nativeio.NativeIO$POSIX.getStat(NativeIO.java:608) A: Update hadoop dll to version 3.2.2 or newer. ## Changelog +- #### 2.8.0 released 8 January 2025. + - [#258](https://github.com/AbsaOSS/cobrix/issues/258) Removed dependency on `scodec` so that it doesn't cause conflicts with Spark distributions and other libraries. + - #### 2.7.10 released 19 December 2024. - [#728](https://github.com/AbsaOSS/cobrix/issues/728) Added CP1145 code page (Spain and Latin America). - [#731](https://github.com/AbsaOSS/cobrix/issues/731) Added an option to copy data type when copying metadata. @@ -1872,6 +1875,9 @@ A: Update hadoop dll to version 3.2.2 or newer. .option("enable_indexes", "true") // true by default so can me omitted ``` +
Older versions +

+ - #### 2.6.11 released 8 April 2024. - [#659](https://github.com/AbsaOSS/cobrix/issues/659) Fixed record length option when record id generation is turned on. @@ -1931,9 +1937,6 @@ A: Update hadoop dll to version 3.2.2 or newer. - [#521](https://github.com/AbsaOSS/cobrix/issues/521) Fixed index generation and improved performance of variable block length files processing (record_format='VB'). -

Older versions -

- - #### 2.5.1 released 24 August 2022. - [#510](https://github.com/AbsaOSS/cobrix/issues/510) Fixed dropping of FILLER fields in Spack Schema if the FILLER has OCCURS of GROUPS. diff --git a/cobol-converters/pom.xml b/cobol-converters/pom.xml index c605ebdcd..d174b6a84 100644 --- a/cobol-converters/pom.xml +++ b/cobol-converters/pom.xml @@ -22,7 +22,7 @@ za.co.absa.cobrix cobrix_2.12 - 2.7.11-SNAPSHOT + 2.8.1-SNAPSHOT ../pom.xml diff --git a/cobol-parser/pom.xml b/cobol-parser/pom.xml index c19dd66ea..82d3ae765 100644 --- a/cobol-parser/pom.xml +++ b/cobol-parser/pom.xml @@ -22,7 +22,7 @@ za.co.absa.cobrix cobrix_2.12 - 2.7.11-SNAPSHOT + 2.8.1-SNAPSHOT ../pom.xml diff --git a/examples/examples-collection/pom.xml b/examples/examples-collection/pom.xml index db6f933a8..667e40ffd 100644 --- a/examples/examples-collection/pom.xml +++ b/examples/examples-collection/pom.xml @@ -31,7 +31,7 @@ 2.11 2.4.8 2.4.16 - 2.7.10 + 2.8.0 diff --git a/examples/spark-cobol-app/build.sbt b/examples/spark-cobol-app/build.sbt index 84566f20f..d21f7aa7c 100644 --- a/examples/spark-cobol-app/build.sbt +++ b/examples/spark-cobol-app/build.sbt @@ -20,7 +20,7 @@ ThisBuild / version := "0.1.0-SNAPSHOT" ThisBuild / scalaVersion := "2.12.17" val sparkVersion = "3.5.3" -val sparkCobolVersion = "2.7.10" +val sparkCobolVersion = "2.8.0" val scalatestVersion = "3.2.14" ThisBuild / libraryDependencies ++= Seq( diff --git a/examples/spark-cobol-app/pom.xml b/examples/spark-cobol-app/pom.xml index 1b218476b..bc6fbaa47 100755 --- a/examples/spark-cobol-app/pom.xml +++ b/examples/spark-cobol-app/pom.xml @@ -31,7 +31,7 @@ 2.12 3.2.14 3.5.3 - 2.7.10 + 2.8.0 diff --git a/pom.xml b/pom.xml index 08be4d936..af5b6e1be 100644 --- a/pom.xml +++ b/pom.xml @@ -22,7 +22,7 @@ za.co.absa.cobrix cobrix_2.12 - 2.7.11-SNAPSHOT + 2.8.1-SNAPSHOT pom diff --git a/spark-cobol/pom.xml b/spark-cobol/pom.xml index e8ed466ed..3fe0cb062 100644 --- a/spark-cobol/pom.xml +++ b/spark-cobol/pom.xml @@ -22,7 +22,7 @@ za.co.absa.cobrix cobrix_2.12 - 2.7.11-SNAPSHOT + 2.8.1-SNAPSHOT ../pom.xml