AI Site Scout

=== AI Site Scout ===
Contributors: anthonyacosta
Tags: ai, llm, sitemap, crawler, gptbot, claudebot, seo, optimization, ai-crawler
Requires at least: 6.0
Tested up to: 6.9
Stable tag: 1.0.4
Requires PHP: 7.4
License: GPLv2 or later
License URI: https://www.gnu.org/licenses/gpl-2.0.html

Auto-generates clean, LLM-optimized llms.txt, llms-full.txt, and llms-sitemap.xml from published content. Respects Yoast & Rank Math noindex. Dashboard settings, AI crawler logs, responsive shortcode.

== Description ==

AI Site Scout is a lightweight WordPress plugin that automatically creates clean, crawler-friendly files optimized for large language models (LLMs) and AI training bots such as GPTBot, ClaudeBot, Google-Extended, and CCBot.

The plugin dynamically serves three files at fixed URLs:

/llms.txt – concise version with titles, descriptions, URLs, and image references
/llms-full.txt – extended version including short excerpts
/llms-sitemap.xml – XML sitemap with image tags, lastmod dates, and crawl priorities

All content is pulled from your published posts, pages, and (optionally) WooCommerce products. It respects existing SEO settings (Yoast SEO and Rank Math noindex/nofollow flags) so private or excluded content is never exposed.

Features include:

Dashboard widget with settings & one-click regeneration
Automatic updates on publish (optional) and scheduled regeneration
AI crawler visit logging (last 30 visits shown in dashboard)
Responsive front-end shortcode [ ai_site_scout ] to display content cards
No physical files created — everything served dynamically for performance & security
Follows WordPress coding standards (sanitized, escaped, secure)

Perfect for site owners who want to make content easily discoverable and usable by AI systems without manual exports or complex configurations.

== Installation ==

Download the latest release or clone this repository.
Upload the ai-site-scout folder to your /wp-content/plugins/ directory
OR install via Plugins → Add New → Upload Plugin in WordPress admin.
Activate the plugin through the Plugins menu in WordPress.
Go to your Dashboard — you’ll see the new AI Site Scout Manager widget.
Adjust settings (post types, schedule, etc.) and click Regenerate Files Now if needed.
Visit these URLs to verify:

https://yoursite.com/llms.txt
https://yoursite.com/llms-full.txt
https://yoursite.com/llms-sitemap.xml

Note: After activation, flush permalinks (Settings → Permalinks → Save Changes) if the URLs return 404.

== Usage ==

=== Dashboard Widget ===
The widget lets you:

Choose which post types to include (Posts, Pages, WooCommerce Products)
Set regeneration schedule (Daily, Weekly, None)
Toggle auto-update on publish
Manually regenerate files anytime
View last generation time
See recent AI crawler visits (GPTBot, ClaudeBot, etc.)
Display shortcode usage reminder

=== Shortcode ===
Display a responsive grid of your site's content cards anywhere:

Privacy Policy

Updated: 2026-03-20

Privacy Policy

Anthony Acosta

AI Prompt Vault

Agent Native Prep

AI Site Scout

Terms of Service and Privacy Policy

Spread your brand

Our Bold Mission

Kennedy Media Group Home

About us

Kennedy Media’s awesome Portfolio

Captivating Photography Services: Unbeatable Pricing Guide

Articles

Area Links

Contact Kennedy Media

Effective Search Engine Optimization Service (SEO) to get you to #1

7 Powerful Reasons McAllen SEO Is Transforming Local Business Growth

The Importance of a Visually Appealing Website and How it Can Improve a Business’s Online Presence

A Beautiful Union: Crafting a Stunning Website for Two Become One Wedding Officiant

How Adaptive Business Strategy Drives Growth in a Changing Market

Boost Your Foot Traffic: Proven Strategies to Drive More Customers to Your Retail Store

9 Cardinal Rules for Content Marketing That Actually Work

Power Words

Six Essential Keyboard Shortcuts that will save you a ton of time

Google Now Featuring “Slow To Load” Warning Label In Mobile Results

Facebook pages are a questionable investment for some small businesses

Putting together a marketing plan

5 things you need to do for running a successful online contest

Pediatric Gastroenterology Center of South Texas

Doctors Hospital at Renaissance

McAllen Furniture

SMC McAllen Presentation

WP Equal Columns (WordPress Plugin)

WP-Text-Sizer (WordPress Plugin)

The magic of global electronic commerce

Impressive mcallen web design 956

Convenient Retainers Available 4 You

Recent Work

Sitemap