-
-
Notifications
You must be signed in to change notification settings - Fork 2.8k
chore: website test: use waitUntil domcontentloaded #7436
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
chore: website test: use waitUntil domcontentloaded #7436
Conversation
Thanks for the PR, @rubiesonthesky! typescript-eslint is a 100% community driven project, and we are incredibly grateful that you are contributing to that community. The core maintainers work on this in their personal time, so please understand that it may not be possible for them to review your work immediately. Thanks again! 🙏 Please, if you or your company is finding typescript-eslint valuable, help us sustain the project by sponsoring it transparently on https://opencollective.com/typescript-eslint. |
✅ Deploy Preview for typescript-eslint ready!
To edit notification comments on pull requests, go to your Netlify site configuration. |
@JoshuaKGoldberg It looks like this change makes test little bit less flaky? If the last run will return green then I think merging this will be positive change. Seems that most PRs are failing but not all. it could be also that this is why the test were not run locally. But until more long term solution, it looks like this change could help. (If indeed the CI run that I triggered does not fail) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The waitUntil
works for me, but let's revert retries
?
Triggered 2nd run after changing retries to 0. (I want to have at least 2 passing runs before merge. Maybe 3 would be ideal but it’s easiest to trigger it after main has updated) |
Got a failure on a 3rd run :/ https://github.com/typescript-eslint/typescript-eslint/actions/runs/5821190200/job/15784867250 |
Okay. My next idea is that we need to same as with netlify, we need to ping the site until it’s actually running before doing tests. Though, I think with this kind of test, flakiness is not so bad. Well, it’s better to have flaky test than no test. Test report should show were the test flaky when retries was set to 1. I need to check that later when I’m on computer. It could be that it did not even help but the problem is somewhere else. |
If someone else has ideas how to fix this or is quicker to try something out, I’m happy to close PR. I’m not sure how quickly I will have time to experiment with this. :) I’ll keep the PR open for now to be reminder for myself and also show what was already tried. If there are no updates in few weeks, please do not hesitate to close this for repo upkeeping. |
PR Checklist
Overview
I don't know if the failing test is just flaky or what is going on. In this PR, all website tests are again passing. 🤷