Skip to content

Commit

Permalink
add half_md5 func, biweekly update, tp ext stream
Browse files Browse the repository at this point in the history
  • Loading branch information
jovezhong committed Jan 17, 2025
1 parent bdd3672 commit b3aadd0
Show file tree
Hide file tree
Showing 5 changed files with 21 additions and 6 deletions.
3 changes: 3 additions & 0 deletions docs/functions_for_hash.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,9 @@ Hash functions can be used for the deterministic pseudo-random shuffling of elem

`md4(string)` Calculates the MD4 from a string and returns the resulting set of bytes as `fixed_string(16)`.

### half_md5
`half_md5(par1,..) ` Interprets all the input arguments strings and calculates the MD5 hash value for each of them. Then combines the MD5 hash values, takes the first 8 bytes of the result, and interprets them as `uint64` in big-endian order.

### weak_hash32

`weak_hash32(data)` Calculates a `uint32` from any data type.
1 change: 1 addition & 0 deletions docs/release-notes.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,7 @@
This page summarizes changes for Timeplus Enterprise and Timeplus Proton, including new features and important bug fixes.

Release notes by version:
- [Timeplus Enterprise 2.6](/enterprise-v2.6)
- [Timeplus Enterprise 2.5](/enterprise-v2.5)
- [Timeplus Enterprise 2.4](/enterprise-v2.4)
- [Timeplus Enterprise 2.3](/enterprise-v2.3)
Expand Down
7 changes: 2 additions & 5 deletions docs/timeplus-external-stream.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Timeplus External Stream

In addition to [Kafka External Stream](/proton-kafka), Timeplus Enterprise also supports another type of external stream to read/write data from/to another Timeplus Enterprise deployment.
In addition to [Kafka External Stream](/proton-kafka) and [Pulsar External Stream](/pulsar-external-stream), Timeplus also supports another type of external stream to read/write data from/to another Timeplus Enterprise or Timeplus Proton deployment.

## Use Cases

Expand Down Expand Up @@ -40,10 +40,6 @@ For example, there is a stream `streamA` in Timeplus Proton, running on host1.

In your Timeplus Enterprise, you can create the stream with the same name and same schema. Then use `INSERT INTO .. SELECT` to load all data from Timeplus Proton to Timeplus Enterprise.

:::warning
It's a known issue that you cannot create a materialized view with a Timeplus external stream as the target.
:::

```sql
CREATE STREAM streamA(..);

Expand Down Expand Up @@ -71,3 +67,4 @@ SELECT * FROM local_stream WHERE http_code>=400;
* [window functions](/functions_for_streaming) like tumble/hop are not working yet.
* can't read virtual columns on remote streams.
* [table function](/functions_for_streaming#table) is not supported in timeplusd 2.3.21 or earlier version. This has been enhanced since timeplusd 2.3.22.
* Timeplus Proton eariler than 1.6.9 doesn't support the Timeplus External Stream.
15 changes: 15 additions & 0 deletions docs/v2-release-notes.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,21 @@

This page summarizes changes for Timeplus Enterprise and Timeplus Proton, on a biweekly basis, including new features and important bug fixes.

## Jan 20, 2025

### Timeplus Enterprise v2.6
[Timeplus Enterprise v2.6](/enterprise-v2.6) is now Generally Available! Key breakthroughs:
* **Revolutionary hybrid hash table technology.** For streaming SQL with JOINs or aggregations, by default a memory based hash table is used. This is helpful for preventing the memory limits from being exceeded for large data streams with hundreds of GB of data. You can adjust the query setting to apply the new hybrid hash table, which uses both the memory and the local disk to store the internal state as a hash table.
* **Enhanced operational visibility.** Gain complete transparency into your system's performance through comprehensive monitoring of materialized views and streams. Track state changes, errors, and throughput metrics via [system.stream_state_log](/system-stream-state-log) and [system.stream_metric_log](/system-stream-metric-log).
* **Advanced cross-deployment integration.** Seamlessly write data to remote Timeplus deployments by configuring [Timeplus external stream](/timeplus-external-stream) as targets in materialized views.
* **Improved data management capabilities.** Add new columns to an existing stream. Truncate historical data for streams. Create new databases to organize your streams and materialized views.
* **Optimized ClickHouse integration.** Significant performance improvements for read/write operations with ClickHouse external tables.
* **Enhanced user experience.** New UI wizards for Coinbase data sources and Apache Pulsar external streams, alongside a redesigned SQL Console and SQL Helper interface for improved usability. Quick access to streams, dashboards, and common actions via Command+K (Mac) or Windows+K (PC) keyboard shortcuts.

### Timeplus Proton v1.6.9
* Timeplus external stream is now available in Timeplus Proton. You can read or write data across Timeplus deployments. [Learn more](/timeplus-external-stream).


## Jan 6, 2025

Happy New Year 🎉
Expand Down
1 change: 0 additions & 1 deletion sidebars.js
Original file line number Diff line number Diff line change
Expand Up @@ -79,7 +79,6 @@ const sidebars = {
{
type: "doc",
id: "timeplus-external-stream",
customProps: { tag: "Enterprise" },
},
{
type: "doc",
Expand Down

0 comments on commit b3aadd0

Please sign in to comment.