What agents see: compare an AI assistant and a browser · Rebilder Help

How the comparison works

What agents see is a tab of Website review. It works on every plan, even before you connect your site. Enter a page address and press Preview.

We request the page twice, one after the other. The first request asks for text/markdown, the way an AI assistant does, and names itself rebilder-preview. The second asks as a regular browser. Nothing is saved and nothing on your site changes.

Each panel shows the response status, its format, its size and an approximate token count at about four characters per token, then the start of the response. The Page size card compares the two versions.

The result line

• Green: “Your site serves AI assistants a clean version of this page.” When both requests succeed, it adds the two approximate token counts.
• Amber: “AI assistants currently get your full web page. Connect your website to serve them a clean version.”
• Grey: “We could not get the AI assistant version of this page”, followed by the reason, such as a timeout or an error status.

Why some addresses cannot be checked

Rebilder’s servers request the address you enter, so the preview reaches public pages only:

• Only https:// addresses on the standard port.
• No localhost, private network addresses or IPv6 addresses. Use your site’s public domain.
• No user name or password in the address.
• The page must answer within 5 seconds with a success status, after at most two redirects. Each redirect is checked against the same rules.
• Each response is read up to 2 MB.
• After many checks in a short time, wait a minute and try again.