Skip to content

Commit a058ef6

Browse files
authored
add: troubleshooting, rt starvation (#391)
1 parent 2f86a78 commit a058ef6

File tree

1 file changed

+34
-0
lines changed

1 file changed

+34
-0
lines changed

docs/fluvio/troubleshooting.mdx

Lines changed: 34 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -62,7 +62,41 @@ if you are having issues with the producer, like the error `record size (3570720
6262
fluvio produce hello-node --max-request-size 37748736
6363
```
6464

65+
# Fluvio Client Disconnects
66+
67+
If you frequently experience Fluvio client disconnects or reconnects for either
68+
the producer, consumer, or both, you may see error messages like:
69+
70+
- `Error: the produce request retry timeout limit reached`
71+
- `Error: Reconnecting to stream consumer`
72+
73+
These issues often stem from network reliability or insufficient async task
74+
scheduling time.
75+
76+
### Troubleshooting Steps
77+
78+
1. **Check Network Connectivity**:
79+
- Review network logs to ensure a stable connection to the Fluvio cluster.
80+
81+
2. **Verify CPU Allocation**:
82+
- Ensure sufficient CPUs are allocated to the application and the async
83+
runtime. Running all async tasks on a single CPU can starve the Fluvio
84+
client, causing timeouts and reconnections.
85+
86+
3. **Inspect Async Runtime Configuration**:
87+
- If using the Tokio crate, ensure the `full` or `rt-multi-thread` feature is
88+
enabled in your `Cargo.toml`:
89+
```toml
90+
[dependencies]
91+
tokio = { version = "1.0", features = ["full"] }
92+
```
93+
94+
For more details on handling CPU-bound tasks, refer to the Tokio documentation
95+
on [CPU bound tasks].
96+
97+
6598
[`fluvio cluster upgrade`]: cli/fluvio/cluster.mdx#fluvio-cluster-upgrade
6699
[filtering tracing log]: https://docs.rs/tracing-subscriber/latest/tracing_subscriber/filter/struct.EnvFilter.html
67100
[Discord]: https://discord.com/invite/bBG2dTz
101+
[CPU bound tasks]: https://docs.rs/tokio/latest/tokio/#cpu-bound-tasks-and-blocking-code
68102

0 commit comments

Comments
 (0)