Collaborate With Scrubnet

What collaboration means

Scrubnet works with SEO teams, agencies, developers, researchers and crawler operators who want to test specific questions about search and AI bot behaviour. Custom feeds and public access logs provide a shared experimental environment; collaborators add hypotheses, site context, analysis and peer challenge.

Good collaboration projects

• Comparing crawler discovery and revisit patterns across feed formats.
• Testing how timestamps, status codes or content changes affect fetch behaviour.
• Building multi-site technical SEO or GEO case studies.
• Reviewing crawler verification, access controls and observability methods.
• Turning repeatable findings into open guidance or practical tools.

How a project works

1. Define the question: agree a narrow hypothesis and the evidence needed to assess it.
2. Select participating sites: add suitable volunteer sites to Scrubnet for free.
3. Configure and observe: publish the relevant feeds and monitor crawler requests over an agreed period.
4. Analyse carefully: separate access-log observations from indexing, ranking and visibility outcomes.
5. Share what is useful: document the method, limitations and findings as a case study or tool.

Roles

What this is not

This is not paid distribution, a reseller programme or a promise of rankings, indexing, AI citations or traffic. Scrubnet is an independent research environment. Any visibility claim requires evidence beyond a crawler request.

Propose a collaboration

Email contact@scrubnet.org with the question you want to investigate and the sites or data you can contribute.