Skip to content

Commit 2c3264b

Browse files
committedJan 22, 2024
readme.md.
1 parent 3de4aa8 commit 2c3264b

File tree

2 files changed

+5
-0
lines changed

2 files changed

+5
-0
lines changed
 

‎.github/8raspi2.jpg

298 KB
Loading

‎README.md

+5
Original file line numberDiff line numberDiff line change
@@ -39,6 +39,11 @@ You always need the root node and you can add 2^n - 1 worker nodes to speed up t
3939

4040
**Raspberry Pi 4B 8 GB**
4141

42+
<p align="center">
43+
<img src=".github/8raspi2.jpg" width="50%" alt="Distributed Llama running on 8 Raspberry Pi 4B devices" /><br />
44+
<sub><sup>8 Raspberry Pi 4B 8GB devices</sup></sub>
45+
</p>
46+
4247
All tests below utilized Q40 weights and a Q80 buffer. The generation time encompasses the inference time, network transfer time, sampling time, and multi-thread synchronization time. Number of samples: 16. All Raspberry Pi units were connected via Gigabit Ethernet to the TP-Link LS1008G Switch.
4348

4449
| Model | 1 x RasPi 4B 8 GB | 2 x RasPi 4B 8 GB | 4 x RasPi 4B 8 GB | 8 x RasPi 4B 8 GB |

0 commit comments

Comments
 (0)
Failed to load comments.