INDIVIDUAL MCP TOOL

citefiles_crawler_access

Test how a website answers the real AI crawlers — GPTBot, ClaudeBot, PerplexityBot and Google-Extended — by requesting its homepage as a browser and again as each crawler, then comparing.

citefiles.comnone authenticationAvailability not checked

LIVE ENDPOINT

https://citefiles.com/mcp

No auth detected

Connect to this endpoint to inspect the live schema for citefiles_crawler_access and invoke it with your own arguments.

Indexed input schema

{}

Risk classification

Inferred read-only · medium confidence · heuristic, not a guarantee.

A tool name or description suggests retrieving external content.

Parent server

citefiles.com

CONNECT WITH APPROVAL

Client installation

Review this server and its permissions before adding it. Secret placeholders must be set locally.

Codex

~/.codex/config.toml

[mcp_servers.citefiles]
url = "https://citefiles.com/mcp"
enabled = true

Claude Code

.mcp.json

{
  "mcpServers": {
    "citefiles": {
      "type": "http",
      "url": "https://citefiles.com/mcp"
    }
  }
}

Claude Desktop

Settings → Connectors → Add custom connector

Name: citefiles
Remote MCP URL: https://citefiles.com/mcp

Add this remote URL as a custom connector in Claude Desktop. Availability depends on the user plan and workspace policy.

Cursor

.cursor/mcp.json

{
  "mcpServers": {
    "citefiles": {
      "url": "https://citefiles.com/mcp"
    }
  }
}

Visual Studio Code

.vscode/mcp.json

Add to Visual Studio Code

{
  "servers": {
    "citefiles": {
      "type": "http",
      "url": "https://citefiles.com/mcp"
    }
  }
}

Generic MCP

Client-specific MCP configuration

{
  "name": "citefiles",
  "transport": "streamable-http",
  "url": "https://citefiles.com/mcp"
}

MCP Inspector

Run the official MCP Inspector locally and enter the indexed Streamable HTTP endpoint.

Related tools

citefiles_scan — Check whether AI assistants can reach, read and cite a public website.
citefiles_fix_prompt — Get a task list for making a website readable and citable by AI assistants, derived from a real scan of it.
citefiles_check_files — Check which AI-facing discovery files a website actually serves: llms.txt, llms-full.txt, ai.txt, robots.txt, sitemap.xml, AGENTS.md, .well-known/mcp.json and others.
citefiles_agent_commerce — Requires an API token (Authorization: Bearer cf_…).