-
Notifications
You must be signed in to change notification settings - Fork 3.1k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Co-authored-by: Manfred Moser <manfred@simpligility.ca>
- Loading branch information
Showing
2 changed files
with
47 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
44 changes: 44 additions & 0 deletions
44
docs/src/main/sphinx/object-storage/file-system-alluxio.md
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,44 @@ | ||
# Alluxio file system support | ||
|
||
Trino includes a native implementation to access | ||
[Alluxio](https://docs.alluxio.io/os/user/stable/en/Overview.html) as a file | ||
system with a catalog using the Delta Lake, Hive, Hudi, or Iceberg connectors. | ||
An Alluxio cluster acts as caching layer for one or more Trino catalogs and even | ||
clusters or other systems, in front of the actual object storage. | ||
|
||
For comparison the [](/object-storage/file-system-cache) caches data locally on | ||
the Trino cluster nodes and is separate for each catalog and cluster. | ||
|
||
Enable the Alluxio file system with `fs.alluxio.enabled=true` in your catalog | ||
properties file. | ||
|
||
## Configuration | ||
|
||
Use the following properties to configure general aspects of Alluxio file system | ||
support in your catalog properties file: | ||
|
||
:::{list-table} | ||
:widths: 40, 60 | ||
:header-rows: 1 | ||
|
||
* - Property | ||
- Description | ||
* - `fs.alluxio.enabled` | ||
- Activate the Alluxio file system support. Defaults to `false`. | ||
::: | ||
|
||
## Alluxio client configuration | ||
|
||
The Alluxio cluster connection is configured in the `alluxio-site.properties` | ||
properties file. The same config file must be located in `/opt/alluxio/conf` on | ||
all Trino cluster nodes. Follow the [Alluxio client configuration | ||
documentation](https://docs.alluxio.io/os/user/stable/en/operation/Configuration.html) | ||
for more details. | ||
|
||
Example content of `alluxio-site.properties`: | ||
|
||
```properties | ||
alluxio.master.hostname=127.0.0.1 | ||
alluxio.master.port=19998 | ||
alluxio.security.authentication.type=NOSASL | ||
``` |