Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI: Run fuzzer daily #683

Merged
merged 1 commit into from
May 2, 2024
Merged

Conversation

tcharding
Copy link
Member

Update the fuzz/generate-files.sh script to mimic that in rust-bitcoin and generate a new fuzz job that runs the fuzz tests daily for an hour.

Run the fuzz job the time that rust-bitcoin fuzz job finishes - I don't know if that matters. I still don't know if there are org wide limits or just repo limits but it doesn't hurt to run at a different time.

Update the `fuzz/generate-files.sh` script to mimic that in
`rust-bitcoin` and generate a new fuzz job that runs the fuzz tests
daily for an hour.

Run the fuzz job the time that `rust-bitcoin` fuzz job finishes - I
don't know if that matters. I still don't know if there are org wide
limits or just repo limits but it doesn't hurt to run at a different
time.
Copy link
Contributor

@storopoli storopoli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ACK 44ddbe3

# - 11pm PDT
# - 7am CET
# - 5pm AEDT
- cron: '00 06 * * *'
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is 6AM right?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need to change this to 05 or update the comment above.
I know that this is "copy-pasta" left over from the another PR that I saw earlier that had both 06 and 6am

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yep. (At least, that's how I read it.)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh woops, I changed the three bottom ones and missed the top one (not shown here). While investigating I noticed that I totally botched this PR, I didn't change the output file to cron-fuzz-daily.yml and I didn't run the script either - god damn, it is hard to get good help. Will follow up.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Man, now I'm confused. A job cron-daily-fuzz ran last night.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh, I must have created the yaml file manually and not run generate-files.sh - face palm.

Copy link
Member Author

@tcharding tcharding May 2, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

#684

Thanks for finding by bugs @storopoli!

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm also confused -- I ran the script locally and the diff was clean (didn't even create any other files). Are you saying it did nothing?

Copy link
Member Author

@tcharding tcharding May 3, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems its too early in the morning for my brain to context switch back into this properly but if you check cron-daily-fuzz.sh you will ask yourself "who wrote this rubbish and how did it get in master?" For example it still runs on pull_request - all fixed in #684. As for postmortem I'm not sure how I botched it so badly.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think I must have tested the fuzz script in a different repo or something. This is definitely broken as hell :).

Copy link
Member

@apoelstra apoelstra left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ACK 44ddbe3

@apoelstra apoelstra merged commit 4590488 into rust-bitcoin:master May 2, 2024
16 checks passed
tcharding added a commit to tcharding/rust-miniscript that referenced this pull request May 2, 2024
I royally botched up PR rust-bitcoin#683 which changed fuzzing to run daily, fix it
up by doing:

- Use the correct yaml file name in `generate-files.sh`.
- Actually run `generate-files.sh` to generate the yaml file.
- Fix the time UTC comment (the other times were correctly set).
@tcharding tcharding deleted the 05-02-fuzz-daily branch May 7, 2024 21:45
tcharding added a commit to tcharding/rust-miniscript that referenced this pull request May 13, 2024
I royally botched up PR rust-bitcoin#683 which changed fuzzing to run daily, fix it
up by doing:

- Use the correct yaml file name in `generate-files.sh`.
- Actually run `generate-files.sh` to generate the yaml file.
- Fix the time UTC comment (the other times were correctly set).
apoelstra added a commit that referenced this pull request May 14, 2024
bd1df30 Sort fuzz files when finding (Tobin C. Harding)
73d81e5 Follow up from cron-daily-fuzz PR (Tobin C. Harding)

Pull request description:

  I royally botched up PR #683 which changed fuzzing to run daily, fix it up by doing:

  - Use the correct yaml file name in `generate-files.sh`.
  - Actually run `generate-files.sh` to generate the yaml file.
  - Fix the time UTC comment (the other times were correctly set).

ACKs for top commit:
  apoelstra:
    ACK bd1df30

Tree-SHA512: 2af4c030398a79d1de2b2b5d49a399806e21681e5783d97bc139deb6004fed6b34461fb3547070a767d6fff1f76421c775a0a7d1ddc1de05dc50a3d08682618d
pythcoiner pushed a commit to pythcoiner/rust-miniscript that referenced this pull request Aug 27, 2024
I royally botched up PR rust-bitcoin#683 which changed fuzzing to run daily, fix it
up by doing:

- Use the correct yaml file name in `generate-files.sh`.
- Actually run `generate-files.sh` to generate the yaml file.
- Fix the time UTC comment (the other times were correctly set).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants