Skip to content

Build: Skip checking code-of-conduct.openjsf.org & x.com in the hydra crawler#1298

Merged
mgol merged 1 commit intojquery:mainfrom
mgol:spider-check-coc-openjs-exclusion
Mar 10, 2026
Merged

Build: Skip checking code-of-conduct.openjsf.org & x.com in the hydra crawler#1298
mgol merged 1 commit intojquery:mainfrom
mgol:spider-check-coc-openjs-exclusion

Conversation

@mgol
Copy link
Member

@mgol mgol commented Mar 10, 2026

We're getting 429 Too Many Requests on almost every spider-check run.

We're already skipping twitter.com, let's do the same for x.com.

Example: https://github.com/jquery/api.jquery.com/actions/runs/22923413262/job/66527539538

@mgol mgol requested a review from Krinkle March 10, 2026 20:53
@mgol mgol requested a review from timmywil March 10, 2026 20:54
@timmywil
Copy link
Member

I see twitter.com in that list. We'll be adding x.com links soon, so how about we add x.com as well?

@mgol
Copy link
Member Author

mgol commented Mar 10, 2026

@timmywil good callout! PR updated.

@mgol mgol force-pushed the spider-check-coc-openjs-exclusion branch 2 times, most recently from 6a36c81 to 0fc65e7 Compare March 10, 2026 21:05
… crawler

We're getting 429 Too Many Requests on almost every spider-check run.

We're already skipping twitter.com, let's do the same for x.com.
@mgol mgol force-pushed the spider-check-coc-openjs-exclusion branch from 0fc65e7 to 9d301d2 Compare March 10, 2026 21:07
@mgol mgol changed the title Build: Skip checking https://code-of-conduct.openjsf.org/ in the hydra crawler Build: Skip checking code-of-conduct.openjsf.org & x.com in the hydra crawler Mar 10, 2026
@mgol mgol merged commit bec46e6 into jquery:main Mar 10, 2026
4 checks passed
@mgol mgol removed the Needs review label Mar 10, 2026
@mgol mgol deleted the spider-check-coc-openjs-exclusion branch March 10, 2026 21:08
@mgol
Copy link
Member Author

mgol commented Mar 10, 2026

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

2 participants