Skip to content

Official Release: PySpark3 with Python3

Latest
Compare
Choose a tag to compare
@ByteMeDirk ByteMeDirk released this 02 Dec 08:16
· 4 commits to main since this release

A single node PySpark3 docker container based on OpenJDK. Using Python 3, PySpark 3.0.3 with Spark 3.1.2 and Hadoop 2.7.

Functionality for AWS included as was-cli and boto3, with fully integrated Python3 and OpenJDK with Hadoop for extended development.

Full Changelog: v0.0.3...v1.0.0