Collaborate With Scrubnet

What collaboration means

Scrubnet works with SEO teams, agencies, developers, researchers and crawler operators who want to examine specific questions about search and AI bot behaviour. Public feeds and verified access logs provide a shared observational dataset; collaborators add site context, descriptive analysis and peer challenge.

Good collaboration topics

• Comparing crawler discovery and revisit patterns across feed formats.
• Describing how requests coincide with timestamps, status codes or content changes.
• Building multi-site technical SEO or GEO case studies.
• Reviewing crawler verification, access controls and observability methods.
• Turning repeatable findings into open guidance or practical tools.

How a project works

1. Define the question: agree a narrow observational question and the evidence needed to describe it.
2. Select participating sites: add suitable volunteer sites to Scrubnet for free.
3. Configure and observe: publish the relevant feeds and monitor crawler requests over an agreed period.
4. Analyse carefully: separate access-log observations from indexing, ranking and visibility outcomes.
5. Share what is useful: document the method, limitations and findings as a case study or tool.

Roles

What this is not

This is not paid distribution, a reseller programme or a promise of rankings, indexing, AI citations or traffic. Scrubnet is an independent research environment. Any visibility claim requires evidence beyond a crawler request.

Propose a collaboration

Email contact@scrubnet.org with the question you want to investigate and the sites or data you can contribute.