Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

.github/workflows: move heavy workflows to GCP #1449

Closed
wants to merge 13 commits into from
Closed
8 changes: 2 additions & 6 deletions .github/workflows/dynamodb.yml
Original file line number Diff line number Diff line change
Expand Up @@ -33,16 +33,12 @@ permissions:
jobs:

test:
runs-on: ubuntu-latest-8-cores
timeout-minutes: 30
runs-on: gcp-large
timeout-minutes: 45

steps:
- uses: actions/checkout@v3
- uses: Twey/setup-rust-toolchain@v1
- name: Install Protoc
uses: arduino/setup-protoc@v1
with:
repo-token: ${{ secrets.GITHUB_TOKEN }}
- name: Build example applications
run: |
cd examples
Expand Down
6 changes: 1 addition & 5 deletions .github/workflows/kubernetes.yml
Original file line number Diff line number Diff line change
Expand Up @@ -29,17 +29,13 @@ permissions:

jobs:
kind-deployment-e2e-tests:
runs-on: ubuntu-latest-16-cores
runs-on: gcp-large

steps:
- uses: actions/checkout@v3
with:
fetch-depth: 0
- uses: Twey/setup-rust-toolchain@v1
- name: Install Protoc
uses: arduino/setup-protoc@v1
with:
repo-token: ${{ secrets.GITHUB_TOKEN }}
- name: Build client binary
run: |
cargo build --release --locked --bin linera --bin linera-proxy --bin linera-server --bin linera-db --features scylladb,rocksdb,kubernetes
Expand Down
92 changes: 44 additions & 48 deletions .github/workflows/rust.yml
Original file line number Diff line number Diff line change
Expand Up @@ -34,22 +34,16 @@ permissions:

jobs:
test:
runs-on: ubuntu-latest-16-cores
timeout-minutes: 45
runs-on: gcp-large
timeout-minutes: 120

steps:
- uses: actions/checkout@v3
- uses: Twey/setup-rust-toolchain@v1
- name: Clear up some space
run: |
sudo rm -rf /usr/share/dotnet
sudo rm -rf /opt/ghc
sudo rm -rf "/usr/local/share/boost"
sudo rm -rf "$AGENT_TOOLSDIRECTORY"
- name: Install Protoc
uses: arduino/setup-protoc@v1
with:
repo-token: ${{ secrets.GITHUB_TOKEN }}
fetch-depth: 0
# - name: Enable `sccache` for Rust builds
# run: echo "RUSTC_WRAPPER=sccache" >> $GITHUB_ENV
- uses: actions-rust-lang/setup-rust-toolchain@v1
- name: Build example applications
run: |
cd examples
Expand All @@ -60,42 +54,44 @@ jobs:
- name: Compile the workspace with the default features (build)
run: |
cargo build --locked
- name: Run all tests using the default features
run: |
cargo test --locked
- name: Run some extra execution tests with wasmtime
run: |
cargo test --locked -p linera-execution --features wasmtime
- name: Run the benchmark test
run: |
cargo build --locked -p linera-service --bin linera-benchmark --features benchmark
cargo test --locked -p linera-service --features benchmark benchmark
- name: Build Wasm test runner
# use debug mode to avoid building wasmtime in release mode
run: |
cargo build --locked --bin linera-wasm-test-runner
- name: Run Linera SDK Wasm tests
env:
CARGO_TARGET_WASM32_UNKNOWN_UNKNOWN_RUNNER: "target/debug/linera-wasm-test-runner"
run: |
cargo test --locked -p linera-sdk-wasm-tests --target wasm32-unknown-unknown
- name: Run Wasm application tests
run: |
cd examples
CARGO_TARGET_WASM32_UNKNOWN_UNKNOWN_RUNNER=../target/debug/linera-wasm-test-runner cargo test --target wasm32-unknown-unknown
cargo test --locked --target x86_64-unknown-linux-gnu
- name: Run Witty integration tests
run: |
cargo build -p linera-witty-test-modules --target wasm32-unknown-unknown
cargo test -p linera-witty --features wasmer,wasmtime
- name: Check for outdated CLI.md
run: |
if ! diff CLI.md <(cargo run --bin linera -- help-markdown)
then
echo '`CLI.md` differs from the output of `linera help-markdown`'
echo 'Run `linera help-markdown > CLI.md` to update it.'
exit 1
fi
- name: Check what's going on with the cache
run: |
pwd
ls target
# cargo test --locked
# - name: Run some extra execution tests with wasmtime
# run: |
# cargo test --locked -p linera-execution --features wasmtime
# - name: Run the benchmark test
# run: |
# cargo build --locked -p linera-service --bin linera-benchmark --features benchmark
# cargo test --locked -p linera-service --features benchmark benchmark
# - name: Build Wasm test runner
# # use debug mode to avoid building wasmtime in release mode
# run: |
# cargo build --locked --bin linera-wasm-test-runner
# - name: Run Linera SDK Wasm tests
# env:
# CARGO_TARGET_WASM32_UNKNOWN_UNKNOWN_RUNNER: "target/debug/linera-wasm-test-runner"
# run: |
# cargo test --locked -p linera-sdk-wasm-tests --target wasm32-unknown-unknown
# - name: Run Wasm application tests
# run: |
# cd examples
# CARGO_TARGET_WASM32_UNKNOWN_UNKNOWN_RUNNER=../target/debug/linera-wasm-test-runner cargo test --target wasm32-unknown-unknown
# cargo test --locked --target x86_64-unknown-linux-gnu
# - name: Run Witty integration tests
# run: |
# cargo build -p linera-witty-test-modules --target wasm32-unknown-unknown
# cargo test -p linera-witty --features wasmer,wasmtime
# - name: Check for outdated CLI.md
# run: |
# if ! diff CLI.md <(cargo run --bin linera -- help-markdown)
# then
# echo '`CLI.md` differs from the output of `linera help-markdown`'
# echo 'Run `linera help-markdown > CLI.md` to update it.'
# exit 1
# fi

lint:
runs-on: ubuntu-latest
Expand Down
8 changes: 2 additions & 6 deletions .github/workflows/scylladb.yml
Original file line number Diff line number Diff line change
Expand Up @@ -33,16 +33,12 @@ permissions:
jobs:

test:
runs-on: ubuntu-latest-8-cores
timeout-minutes: 30
runs-on: gcp-large
timeout-minutes: 120

steps:
- uses: actions/checkout@v3
- uses: Twey/setup-rust-toolchain@v1
- name: Install Protoc
uses: arduino/setup-protoc@v1
with:
repo-token: ${{ secrets.GITHUB_TOKEN }}
- name: Build example applications
run: |
cd examples
Expand Down
1 change: 1 addition & 0 deletions linera-service/src/cli_wrappers/helmfile.rs
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,7 @@ impl HelmFile {
.env("LINERA_HELMFILE_SET_NUM_SHARDS", num_shards.to_string())
.arg("sync")
.arg("--wait")
.arg("--debug")
.args(["--kube-context", &format!("kind-{}", cluster_id)])
.spawn_and_wait()
.await
Expand Down
Loading