TFX 0.23.0 Release

PiperOrigin-RevId: 327377289

Author: dhruvesh09

README.md

@@ -61,7 +61,9 @@ but other *untested* combinations may also work.
 
 tfx                                                                       | apache-beam[gcp] | ml-metadata | pyarrow | tensorflow        | tensorflow-data-validation | tensorflow-metadata | tensorflow-model-analysis | tensorflow-transform | tfx-bsl |
 ------------------------------------------------------------------------- | ---------------- | ----------- | --------| ----------------- | -------------------------- | ------------------- | ------------------------- | -------------------- | ------- |
-[GitHub master](https://github.com/tensorflow/tfx/blob/master/RELEASE.md) | 2.21.0           | 0.22.0      | 0.16.0  | nightly (1.x/2.x) | 0.22.0                     | 0.22.0              | 0.22.1                    | 0.22.0               | 0.22.0  |
+[GitHub master](https://github.com/tensorflow/tfx/blob/master/RELEASE.md) | 2.23.0           | 0.23.0      | 0.17.0  | nightly (1.x/2.x) | 0.23.0                     | 0.23.0              | 0.23.0                    | 0.23.0               | 0.23.0  |
+0.23.0                                                                    | 2.23.0           | 0.23.0      | 0.17.0  | 1.15.0 / 2.3.0    | 0.23.0                     | 0.23.0              | 0.23.0                    | 0.23.0               | 0.23.0  |
+0.22.1                                                                    | 2.21.0           | 0.22.1      | 0.16.0  | 1.15.0 / 2.2.0    | 0.22.2                     | 0.22.2              | 0.22.2                    | 0.22.0               | 0.22.1  |
 0.22.0                                                                    | 2.21.0           | 0.22.0      | 0.16.0  | 1.15.0 / 2.2.0    | 0.22.0                     | 0.22.0              | 0.22.1                    | 0.22.0               | 0.22.0  |
 0.21.4                                                                    | 2.17.0           | 0.21.2      | 0.15.0  | 1.15.0 / 2.1.0    | 0.21.5                     | 0.21.1              | 0.21.5                    | 0.21.2               | 0.21.4  |
 0.21.3                                                                    | 2.17.0           | 0.21.2      | 0.15.0  | 1.15.0 / 2.1.0    | 0.21.5                     | 0.21.1              | 0.21.5                    | 0.21.2               | 0.21.4  |

RELEASE.md

@@ -1,5 +1,21 @@
 # Current Version(Still in Development)
 
+## Major Features and Improvements
+
+## Bug fixes and other changes
+
+## Breaking changes
+
+### For pipeline authors
+
+### For component authors
+
+## Documentation updates
+
+## Deprecations
+
+# Version 0.23.0
+
 ## Major Features and Improvements
 *   Added TFX DSL IR compiler that encodes a TFX pipeline into a DSL proto.
 *   Supported feature based split partition in ExampleGen.
@@ -8,7 +24,7 @@
     Deprecated ExampleGen input (external) artifact.
 *   Added ModelRun artifact for Trainer for storing training related files,
     e.g., Tensorboard logs. Trainer's Model artifact now only contain pure
-    models (check utils/path_utils.py for details).
+    models (check `tfx/utils/path_utils.py` for details).
 *   Added support for `tf.train.SequenceExample` in ExampleGen:
     *   ImportExampleGen now supports `tf.train.SequenceExample` importing.
     *   base_example_gen_executor now supports `tf.train.SequenceExample` as
@@ -29,7 +45,8 @@
     data through `tfx.components.util.tfxio_utils`. As TFX is going to
     support more data payload formats and data container formats, using
     `tfxio_utils` is encouraged to avoid dealing directly with each combination.
-    TFXIO is the interface of [Standardized TFX Inputs](https://github.com/tensorflow/community/blob/master/rfcs/20191017-tfx-standardized-inputs.md).
+    TFXIO is the interface of [Standardized TFX Inputs](
+    https://github.com/tensorflow/community/blob/master/rfcs/20191017-tfx-standardized-inputs.md).
 *   Added experimental BaseStubExecutor and StubComponentLauncher to test TFX
     pipelines.
 *   Added experimental TFX Pipeline Recorder to record output artifacts of the
@@ -38,8 +55,8 @@
     Channel's artifact count. This enables Transform component to process
     multiple artifacts.
 *   Transform component's transformed examples output is now optional (enabled
-    by default) -- specify parameter `materialize=False` when constructing
-    the component to disable.
+    by default). This can be disabled by specifying parameter
+    `materialize=False` when constructing the component.
 *   Supported `Version` spec in input config for file based ExampleGen.
 *   Added custom config to Transform component and made it available to
     pre-processing fn.
@@ -54,26 +71,39 @@
     comprehensive solution for idempotent execution.
 *   Made evaluator output optional (while still recommended) for pusher.
 *   Moved BigQueryExampleGen to `tfx.extensions.google_cloud_big_query`.
+*   Moved BigQuery ML Pusher to `tfx.extensions.google_cloud_big_query.pusher`.
 *   Removed Tuner from custom_components/ as it's supported under components/
     now.
 *   Added support of non tf.train.Example protos as internal data payload
     format by ImportExampleGen.
 *   Used thread local storage for `label_utils.scoped_labels()` to make it
     thread safe.
-*   Stopped requiring `avro-python3`.
 *   Requires [Bazel](https://bazel.build/) to build TFX source code.
 *   Upgraded python version in TFX docker images to 3.7. Older version of
     python (2.7/3.5/3.6) is not available anymore in `tensorflow/tfx` images
     on docker hub. Virtualenv is not used anymore.
+*   Stopped requiring `avro-python3`.
+*   Depends on `absl-py>=0.7,<0.9`.
+*   Depends on `apache-beam[gcp]>=2.23,<3`.
 *   Depends on `pyarrow>=0.17,<0.18`.
 *   Depends on `attrs>=19.3.0,<20`.
+*   Depends on `ml-metadata>=0.23,<0.24`.
+*   Depends on `tensorflow>=1.15.2,!=2.0.*,!=2.1.*,!=2.2.*,<3`.
+    * Note: Dependency like `tensorflow-transform` might impose a narrower
+      range of `tensorflow`.
+*   Depends on `tensorflow-data-validation>=0.23,<0.24`.
+*   Depends on `tensorflow-model-analysis>=0.23,<0.24`.
+*   Depends on `tensorflow-serving-api>=1.15,!=2.0.*,!=2.1.*,!=2.2.*,<3`.
+*   Depends on `tensorflow-transform>=0.23,<0.24`.
+*   Depends on `tfx-bsl>=0.23,<0.24`.
 
 ## Breaking changes
 *   Changed the URIs of the value artifacts to point to files.
 
 ### For pipeline authors
 *   Moved BigQueryExampleGen to `tfx.extensions.google_cloud_big_query`. The
-    previous module path from `tfx.components` is not available anymore.
+    previous module path from `tfx.components` is not available anymore. This is
+    a breaking change.
 *   Moved BigQuery ML Pusher to `tfx.extensions.google_cloud_big_query.pusher`.
     The previous module path from `tfx.extensions.google_cloud_big_query_ml`
     is not available anymore.
@@ -83,29 +113,34 @@
     FileBaseExampleGen.
 *   Changed ExampleGen to take a string as input source directly instead of a
     Channel of external artifact:
-    *   `input` Channel is deprecated. The use of `input` is valid but
-        should change to string type `input_base` ASAP.
     *   Previously deprecated `input_base` Channel is changed to string type
         instead of Channel. This is a breaking change, users should pass string
         directly to `input_base`.
-*   ExternalArtifact and `external_input` function are deprecated. The use
-    of `external_input` with ExampleGen `input` is still valid but should change
-    to use `input_base` ASAP.
 *   Fully removed csv_input and tfrecord_input in dsl_utils. This is a breaking
     change, users should pass string directly to `input_base`.
+
+### For component authors
 *   Changed GetInputSourceToExamplePTransform interface by removing input_dict.
     This is a breaking change, custom ExampleGens need to follow the interface
     change.
-
-### For component authors
+*   Changed ExampleGen to take a string as input source directly instead of a
+    Channel of external artifact:
+    *   `input` Channel is deprecated. The use of `input` is valid but
+        should change to string type `input_base` ASAP.
 
 ## Documentation updates
+* N/A
 
 ## Deprecations
+*   ExternalArtifact and `external_input` function are deprecated. The use
+    of `external_input` with ExampleGen `input` is still valid but should change
+    to use `input_base` ASAP.
+*   Note: We plan to remove Python 3.5 support after this release.
 
 # Version 0.22.1
 
 ## Major Features and Improvements
+* N/A
 
 ## Bug fixes and other changes
 *   Depends on 'tensorflowjs>=2.0.1.post1,<3' for `[all]` dependency.
@@ -118,12 +153,16 @@
 ## Breaking changes
 
 ### For pipeline authors
+* N/A
 
 ### For component authors
+* N/A
 
 ## Documentation updates
+* N/A
 
 ## Deprecations
+* N/A
 
 # Version 0.22.0
 

tfx/dependencies.py

@@ -20,9 +20,9 @@ def make_required_install_packages():
   # six, and protobuf) with TF.
   # TODO(b/130767399): add flask once the frontend is exposed externally.
   return [
-      'absl-py>=0.1.6,<0.9',
+      'absl-py>=0.7,<0.9',
       # LINT.IfChange
-      'apache-beam[gcp]>=2.22,<3',
+      'apache-beam[gcp]>=2.23,<3',
       # LINT.ThenChange(examples/chicago_taxi_pipeline/setup/setup_beam.sh)
       'attrs>=19.3.0,<20',
       'click>=7,<8',
@@ -41,11 +41,11 @@ def make_required_install_packages():
       'pyarrow>=0.17,<0.18',
       'pyyaml>=3.12,<6',
       'six>=1.10,<2',
-      'tensorflow>=1.15,!=2.0.*,!=2.1.*,!=2.2.*,<3',
-      'tensorflow-data-validation>=0.22.2,<0.23',
-      'tensorflow-model-analysis>=0.22.2,<0.23',
-      'tensorflow-serving-api>=1.15,<3',
-      'tensorflow-transform>=0.22,<0.23',
+      'tensorflow>=1.15.2,!=2.0.*,!=2.1.*,!=2.2.*,<3',
+      'tensorflow-data-validation>=0.23,<0.24',
+      'tensorflow-model-analysis>=0.23,<0.24',
+      'tensorflow-serving-api>=1.15,!=2.0.*,!=2.1.*,!=2.2.*,<3',
+      'tensorflow-transform>=0.23,<0.24',
       'tfx-bsl>=0.23,<0.24',
   ]
 

tfx/examples/chicago_taxi_pipeline/setup/setup_beam.sh

@@ -19,7 +19,7 @@ BEAM_DIR="$WORK_DIR/beam"
 GIT_COMMAND=`which git`
 BEAM_REPO="https://github.com/apache/beam"
 # LINT.IfChange
-BEAM_BRANCH="release-2.22.0"
+BEAM_BRANCH="release-2.23.0"
 # LINT.ThenChange(../../../dependencies.py)
 
 

tfx/examples/cifar10/setup.py

@@ -51,7 +51,7 @@
     ],
     namespace_packages=[],
     install_requires=[
-        'tfx>=0.22.0,<=0.23.0.dev',
+        'tfx>=0.23.0,<=0.24.0.dev',
         'tflite-support>=0.1.0a1,<0.1.1',
         'flatbuffers>=1.12,<1.13',
         'tensorflowjs>=2.0.1,<2.0.2',

tfx/examples/custom_components/hello_world/setup.py

@@ -57,7 +57,7 @@
         'Topic :: Software Development :: Libraries :: Python Modules',
     ],
     namespace_packages=[],
-    install_requires=['tfx>=0.22.0,<0.23.0.dev'],
+    install_requires=['tfx>=0.23.0,<0.24.0.dev'],
     python_requires='>=3.5,<4',
     packages=find_packages(),
     include_package_data=True,

tfx/examples/custom_components/presto_example_gen/setup.py

@@ -95,7 +95,7 @@ def generate_proto():
     namespace_packages=[],
     install_requires=[
         'presto-python-client>=0.7,<0.8',
-        'tfx>=0.22.0,<=0.23.0.dev',
+        'tfx>=0.23.0,<=0.24.0.dev',
     ],
     python_requires='>=3.5,<4',
     packages=find_packages(),

tfx/examples/custom_components/slack/setup.py

@@ -25,7 +25,7 @@ def _make_required_install_packages():
   # six, and protobuf) with TF.
   return [
       'slackclient>=2.0.0,<2.0.1',
-      'tfx>=0.22.0,<=0.23.0.dev',
+      'tfx>=0.23.0,<=0.24.0.dev',
       'websocket-client>=0.56,<0.60',
   ]
 

tfx/version.py

@@ -15,4 +15,4 @@
 """Contains the version string of TFX."""
 
 # Note that setup.py uses this version.
-__version__ = '0.23.0.dev'
+__version__ = '0.24.0.dev'