=== AI Site Scout ===
Contributors: anthonyacosta
Tags: ai, llm, sitemap, crawler, gptbot, claudebot, seo, optimization, ai-crawler
Requires at least: 6.0
Tested up to: 6.9
Stable tag: 1.0.4
Requires PHP: 7.4
License: GPLv2 or later
License URI: https://www.gnu.org/licenses/gpl-2.0.html
Auto-generates clean, LLM-optimized llms.txt, llms-full.txt, and llms-sitemap.xml from published content. Respects Yoast & Rank Math noindex. Dashboard settings, AI crawler logs, responsive shortcode.
== Description ==
AI Site Scout is a lightweight WordPress plugin that automatically creates clean, crawler-friendly files optimized for large language models (LLMs) and AI training bots such as GPTBot, ClaudeBot, Google-Extended, and CCBot.
The plugin dynamically serves three files at fixed URLs:
/llms.txt – concise version with titles, descriptions, URLs, and image references
/llms-full.txt – extended version including short excerpts
/llms-sitemap.xml – XML sitemap with image tags, lastmod dates, and crawl priorities
All content is pulled from your published posts, pages, and (optionally) WooCommerce products. It respects existing SEO settings (Yoast SEO and Rank Math noindex/nofollow flags) so private or excluded content is never exposed.
Features include:
- Dashboard widget with settings & one-click regeneration
- Automatic updates on publish (optional) and scheduled regeneration
- AI crawler visit logging (last 30 visits shown in dashboard)
- Responsive front-end shortcode
[ ai_site_scout ] to display content cards
- No physical files created — everything served dynamically for performance & security
- Follows WordPress coding standards (sanitized, escaped, secure)
Perfect for site owners who want to make content easily discoverable and usable by AI systems without manual exports or complex configurations.
== Installation ==
- Download the latest release or clone this repository.
- Upload the
ai-site-scout folder to your /wp-content/plugins/ directory
OR install via Plugins → Add New → Upload Plugin in WordPress admin.
- Activate the plugin through the Plugins menu in WordPress.
- Go to your Dashboard — you’ll see the new AI Site Scout Manager widget.
- Adjust settings (post types, schedule, etc.) and click Regenerate Files Now if needed.
- Visit these URLs to verify:
https://yoursite.com/llms.txt
https://yoursite.com/llms-full.txt
https://yoursite.com/llms-sitemap.xml
Note: After activation, flush permalinks (Settings → Permalinks → Save Changes) if the URLs return 404.
== Usage ==
=== Dashboard Widget ===
The widget lets you:
- Choose which post types to include (Posts, Pages, WooCommerce Products)
- Set regeneration schedule (Daily, Weekly, None)
- Toggle auto-update on publish
- Manually regenerate files anytime
- View last generation time
- See recent AI crawler visits (GPTBot, ClaudeBot, etc.)
- Display shortcode usage reminder
=== Shortcode ===
Display a responsive grid of your site's content cards anywhere:
Privacy Policy
Updated: 2026-03-20
View →
Anthony Acosta
*As of 2021Project Communications Strategy Consultant. Author, Award Winning Marketing Campaign Creator, Full Stack Developer.Lives in McAllen, Texas Anthony Acosta SummaryAnthony Acosta is an Award-Winning Marketing Campaign Creator/Director,...
Updated: 2026-03-20
View →
AI Prompt Vault
A simple, private dashboard tool to save, organize, and reuse your best AI prompts — with AJAX management and a clean front-end shortcode display.
Updated: 2026-03-20
View →Agent Native Prep
Track and showcase the steps you're taking to make your SaaS or product "agent-native" — before autonomous AI agents become the primary buyers of software.
Updated: 2026-03-20
View →
AI Site Scout
=== AI Site Scout ===Contributors: anthonyacostaTags: ai, llm, sitemap, crawler, gptbot, claudebot, seo, optimization, ai-crawlerRequires at least: 6.0Tested up to: 6.9Stable tag: 1.0.4Requires PHP: 7.4License: GPLv2 or laterLicense...
Updated: 2026-03-19
View →Terms of Service and Privacy Policy
Updated: 2026-03-19
View →
Spread your brand
Updated: 2026-03-19
View →
Our Bold Mission
Updated: 2026-03-19
View →
Kennedy Media Group Home
Digital Marketing Optimization is our specialty. Anthony Acosta will analyze your current marketing, and he will provide you with the tweaked processes and roadmaps to reach your desired...
Updated: 2026-03-09
View →
About us
Kennedy Media Group was founded by Anthony Acosta in 1997. We have been working behind the scenes helping to build successful businesses all over the world.
Updated: 2026-03-05
View →Kennedy Media’s awesome Portfolio
Updated: 2026-03-05
View →
Captivating Photography Services: Unbeatable Pricing Guide
Anthony's passion for photography is evident in every frame, making him a sought-after talent for clients seeking a truly memorable experience.
Updated: 2026-03-05
View →
Articles
Updated: 2026-03-04
View →
Area Links
Updated: 2026-03-04
View →
Contact Kennedy Media
Updated: 2026-03-04
View →
Effective Search Engine Optimization Service (SEO) to get you to #1
Search engine optimization is a process that improves your website's content, structure, meta data and more to gain the attention and a stamp of credibility from the...
Updated: 2026-03-04
View →
7 Powerful Reasons McAllen SEO Is Transforming Local Business Growth
Discover how McAllen SEO helps businesses thrive with local strategies from Kennedy Media Group. Boost your growth in McAllen, TX today!
Updated: 2026-03-04
View →
The Importance of a Visually Appealing Website and How it Can Improve a Business’s Online Presence
Updated: 2026-03-04
View →
A Beautiful Union: Crafting a Stunning Website for Two Become One Wedding Officiant
We take pride in designing websites that truly reflect the essence of our clients' businesses. We recently had the pleasure of working with Charlene Garza, Wedding Officiant
Updated: 2026-03-04
View →
How Adaptive Business Strategy Drives Growth in a Changing Market
Success in today’s unpredictable market isn’t just about having a plan—it’s about knowing when to pivot. Learn how adaptive business strategies help organizations stay resilient, foster innovation, and...
Updated: 2026-03-04
View →
Boost Your Foot Traffic: Proven Strategies to Drive More Customers to Your Retail Store
Updated: 2026-03-04
View →
9 Cardinal Rules for Content Marketing That Actually Work
Want to attract customers and grow your brand online? These 9 powerful content marketing rules will help you stand out, connect with your audience, and drive long-term success—without...
Updated: 2026-03-04
View →Power Words
Updated: 2026-03-04
View →
Six Essential Keyboard Shortcuts that will save you a ton of time
Updated: 2026-03-04
View →
Google Now Featuring “Slow To Load” Warning Label In Mobile Results
Updated: 2026-03-04
View →
Facebook pages are a questionable investment for some small businesses
Updated: 2026-03-04
View →
Putting together a marketing plan
Updated: 2026-03-04
View →
5 things you need to do for running a successful online contest
Updated: 2026-03-04
View →
Pediatric Gastroenterology Center of South Texas
Updated: 2026-03-04
View →
Doctors Hospital at Renaissance
Updated: 2026-03-04
View →
McAllen Furniture
Updated: 2026-03-04
View →
SMC McAllen Presentation
Updated: 2026-03-04
View →
WP Equal Columns (WordPress Plugin)
Updated: 2026-03-04
View →
WP-Text-Sizer (WordPress Plugin)
Updated: 2026-03-04
View →
The magic of global electronic commerce
Updated: 2026-03-04
View →
Impressive mcallen web design 956
Kennedy Media Group is a professional mcallen web design and marketing company located in the heart of the Rio Grande Valley of South Texas. We specialize in website...
Updated: 2022-01-27
View →
Convenient Retainers Available 4 You
Kennedy Media Group offers payment options to best suit the scale of your project. Our retainers make life simple with less paperwork and streamlined billing...best of all you...
Updated: 2021-08-04
View →
Recent Work
Updated: 2016-06-06
View →Sitemap
Updated: 2011-09-15
View →