Skip to content

Commit de3fab6

Browse files
committed
Update TesseraCT performance doc with the latest data
1 parent fe7687c commit de3fab6

File tree

7 files changed

+34
-34
lines changed

7 files changed

+34
-34
lines changed
Loading
Loading
Binary file not shown.
Loading
Loading

docs/performance.md

Lines changed: 34 additions & 34 deletions
Original file line numberDiff line numberDiff line change
@@ -11,15 +11,15 @@ The performance tests were conducted in a controlled environment with determinis
1111

1212
### GCP
1313

14-
The indicative figures below were measured using the [CT hammer tool](/internal/hammer/) as of [commit `2872ea2`](https://github.com/transparency-dev/tesseract/commit/2872ea2387b2d3077eb832112277eb19a7a907bd).
14+
The indicative figures below were measured using the [CT hammer tool](/internal/hammer/) as of [commit `fe7687c`](https://github.com/transparency-dev/tesseract/commit/fe7687c9ed35d11f42a211ee35544ff6c5610ee6).
1515

1616
The table below shows the measured performance over 12 hours in each instance type:
1717

18-
| Instance Type | Cloud Spanner | Write QPS |
19-
| -------------------------------- | ------------- | --------- |
20-
| e2-micro (2 vCPUs, 1 GB Memory) | 100 PUs | 60 |
21-
| e2-medium (2 vCPUs, 4 GB Memory) | 100 PUs | 150 |
22-
| e2-medium (2 vCPUs, 4 GB Memory) | 200 PUs | 350 |
18+
| Instance Type | Cloud Spanner | Write QPS |
19+
| ------------------------------------ | ------------- | --------- |
20+
| e2-micro (2 vCPUs, 1 GB Memory) | 100 PUs | 60 |
21+
| e2-medium (2 vCPUs, 4 GB Memory) | 100 PUs | 250 |
22+
| e2-standard-2 (2 vCPUs, 8 GB Memory) | 100 PUs | 600 |
2323

2424
#### Free Tier e2-micro VM Instance + Cloud Spanner 100 PUs
2525

@@ -59,27 +59,27 @@ MiB Swap: 0.0 total, 0.0 free, 0.0 used. 156.1 avail Mem
5959

6060
- e2-medium (2 vCPUs, 4 GB Memory)
6161

62-
The write QPS is around 150. The bottleneck is Cloud Spanner CPU. Utilization is always around 100%, most of which is used for deduplication. The VM CPU usage is around 50%.
62+
The write QPS is around 250. The bottleneck comes from the VM CPU utilization which is always around 100%. The Cloud Spanner CPU utilization is around 20%.
6363

6464
```
6565
┌──────────────────────────────────────────────────────────────────────┐
66-
│Read (8 workers): Current max: 0/s. Oversupply in last second: 0 │
67-
│Write (256 workers): Current max: 188/s. Oversupply in last second: 0 │
68-
│TreeSize: 22722738158qps over 30s) │
69-
│Time-in-queue: 6ms/236ms/1726ms (min/avg/max)
70-
│Observed-time-to-integrate: 824ms/5290ms/9706ms (min/avg/max)
66+
│Read (0 workers): Current max: 0/s. Oversupply in last second: 0 │
67+
│Write (512 workers): Current max: 302/s. Oversupply in last second: 0 │
68+
│TreeSize: 11084877224qps over 30s) │
69+
│Time-in-queue: 48ms/627ms/1717ms (min/avg/max) │
70+
│Observed-time-to-integrate: 1480ms/5401ms/8748ms (min/avg/max) │
7171
└──────────────────────────────────────────────────────────────────────┘
7272
```
7373

7474
```
75-
top - 12:26:28 up 1 day, 14:27, 1 user, load average: 0.85, 0.73, 0.64
76-
Tasks: 92 total, 1 running, 91 sleeping, 0 stopped, 0 zombie
77-
%Cpu(s): 22.7 us, 2.7 sy, 0.0 ni, 71.7 id, 0.0 wa, 0.0 hi, 1.8 si, 1.0 st
78-
MiB Mem : 3924.7 total, 2374.0 free, 892.0 used, 895.3 buff/cache
79-
MiB Swap: 0.0 total, 0.0 free, 0.0 used. 3032.7 avail Mem
75+
top - 19:16:15 up 21:43, 2 users, load average: 1.60, 1.46, 1.50
76+
Tasks: 96 total, 2 running, 94 sleeping, 0 stopped, 0 zombie
77+
%Cpu(s): 86.8 us, 4.0 sy, 0.0 ni, 6.2 id, 0.0 wa, 0.0 hi, 2.2 si, 0.9 st
78+
MiB Mem : 3924.7 total, 1204.9 free, 2422.4 used, 519.0 buff/cache
79+
MiB Swap: 0.0 total, 0.0 free, 0.0 used. 1502.3 avail Mem
8080
8181
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
82-
4885 user 20 0 2910800 279060 31420 S 52.2 6.9 18,26 gcp
82+
72343 user 20 0 5082652 1.5g 22856 R 182.7 39.5 6,24 gcp
8383
```
8484

8585
<details>
@@ -92,40 +92,40 @@ MiB Swap: 0.0 total, 0.0 free, 0.0 used. 3032.7 avail Mem
9292

9393
</details>
9494

95-
#### e2-medium VM Instance + Cloud Spanner 200 PUs
95+
#### e2-standard-2 VM Instance + Cloud Spanner 100 PUs
9696

97-
- e2-medium (2 vCPUs, 4 GB Memory)
97+
- e2-standard-2 (2 vCPUs, 8 GB Memory)
9898

99-
The write QPS is around 350. The bottleneck comes from the VM CPU usage which is always around 90%. The Cloud Spanner CPU utilization is around 50%.
99+
The write QPS is around 600. The bottleneck comes from the VM CPU utilization which is always around 100%. The Cloud Spanner CPU utilization is around 50%.
100100

101101
```
102102
┌──────────────────────────────────────────────────────────────────────┐
103-
│Read (8 workers): Current max: 0/s. Oversupply in last second: 0
104-
│Write (350 workers): Current max: 350/s. Oversupply in last second: 0 │
105-
│TreeSize: 43920322317qps over 30s) │
106-
│Time-in-queue: 35ms/198ms/326ms (min/avg/max)
107-
│Observed-time-to-integrate: 1024ms/4892ms/6951ms (min/avg/max) │
103+
│Read (342 workers): Current max: 0/s. Oversupply in last second: 0 │
104+
│Write (683 workers): Current max: 655/s. Oversupply in last second: 0 │
105+
│TreeSize: 14103952583qps over 30s) │
106+
│Time-in-queue: 57ms/506ms/1139ms (min/avg/max) │
107+
│Observed-time-to-integrate: 642ms/4855ms/9637ms (min/avg/max)
108108
└──────────────────────────────────────────────────────────────────────┘
109109
```
110110

111111
```
112-
top - 12:00:51 up 2 days, 14:02, 1 user, load average: 1.01, 1.02, 1.17
113-
Tasks: 93 total, 1 running, 92 sleeping, 0 stopped, 0 zombie
114-
%Cpu(s): 38.5 us, 5.3 sy, 0.0 ni, 48.6 id, 0.0 wa, 0.0 hi, 1.6 si, 5.9 st
115-
MiB Mem : 3924.7 total, 2380.1 free, 935.5 used, 845.7 buff/cache
116-
MiB Swap: 0.0 total, 0.0 free, 0.0 used. 2989.2 avail Mem
112+
top - 11:12:32 up 58 min, 2 users, load average: 1.94, 1.94, 1.91
113+
Tasks: 96 total, 1 running, 95 sleeping, 0 stopped, 0 zombie
114+
%Cpu(s): 88.0 us, 3.7 sy, 0.0 ni, 5.6 id, 0.0 wa, 0.0 hi, 2.7 si, 0.0 st
115+
MiB Mem : 7950.7 total, 4980.7 free, 2029.3 used, 1179.2 buff/cache
116+
MiB Swap: 0.0 total, 0.0 free, 0.0 used. 5921.5 avail Mem
117117
118118
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
119-
4885 user 20 0 2911056 297500 23760 S 97.7 7.4 33,59 gcp
119+
2114 user 20 0 5211120 1.1g 28572 S 186.7 13.6 78:15.01 gcp
120120
```
121121

122122
<details>
123123

124124
<summary>Graphs</summary>
125125

126-
![e2-medium VM CPU Utilization](./assets/gcp/e2-medium-cloud-spanner-200pu/vm-cpu-utilization.png)
126+
![e2-standard-2 VM CPU Utilization](./assets/gcp/e2-standard-2-cloud-spanner-100pu/vm-cpu-utilization.png)
127127

128-
![Cloud Spanner 200 PUs CPU Utilization](./assets/gcp/e2-medium-cloud-spanner-200pu/cloud-spanner-total-cpu-utilization.png)
128+
![Cloud Spanner 100 PUs CPU Utilization](./assets/gcp/e2-standard-2-cloud-spanner-100pu/cloud-spanner-total-cpu-utilization.png)
129129

130130
</details>
131131

0 commit comments

Comments
 (0)