AI Website Systems Standards & Architecture
Technical specifications and standards for building AI-native, machine-readable websites.
📋 Quick Reference
Required Endpoints
/ai/manifest.json/ai/health.json/ai/catalog.json/ai/karma.json
Optional Endpoints
/ai/federation.json/ai/datasets/*.json/ai/llm.json/llm.txt
Content-Type
- All JSON:
application/json - Structured data:
application/ld+json - CORS:
enabled - Encoding:
UTF-8
Timestamps
- Format: ISO 8601
- Timezone: UTC
- Example:
2026-01-15T10:30:00Z
🌐 Federation Protocol v6.1
The Digital Karma Web Federation enables AI-ready websites to discover, understand, and trust each other through standardized endpoints and transparent reputation scoring.
Core Principles
- Discoverability — Sites expose predictable endpoints at
/ai/* - Interoperability — All endpoints use standard JSON formats
- Transparency — Quality scores are calculated openly
- Decentralization — No central authority required
- Versioning — Protocol versioning for backward compatibility
Compliance Levels
| Level | Requirements | Badge |
|---|---|---|
| Basic | manifest.json + health.json | Federation Member |
| Standard | + catalog.json | Federation Compliant |
| Full | + karma.json + federation.json | Federation Complete |
| Elite | + datasets + automation | Federation Elite |
📄 Manifest Specification (/ai/manifest.json)
The manifest.json file is your site's identity card — the first file AI agents query to understand what your site is and what it offers.
Required Fields
{
"name": "string", // Site name
"description": "string", // Short description
"url": "string", // Canonical URL
"federation_version": "string", // e.g., "6.1"
"last_updated": "ISO8601", // UTC timestamp
"contact": {
"email": "string",
"website": "string"
},
"ai_endpoints": [ // Array of AI endpoint URLs
"/ai/health.json",
"/ai/catalog.json",
"/ai/karma.json"
]
}
Optional Fields
related_sites— Array of federation partner URLsdatasets— Array of available dataset URLsservices— Array of service offeringsapi_base_url— Base URL for API accessschema_org_types— Implemented Schema.org types
💚 Health Endpoint (/ai/health.json)
Real-time system health and operational metrics.
Required Fields
{
"status": "healthy|degraded|down",
"last_check": "ISO8601",
"uptime_percent": 0.0-100.0,
"response_time_ms": number,
"metrics": {
"total_pages": number,
"total_datasets": number,
"last_content_update": "ISO8601"
}
}
Health Status Definitions
- healthy — All systems operational
- degraded — Partial functionality
- down — Service unavailable
📚 Catalog Endpoint (/ai/catalog.json)
Machine-readable inventory of all content and resources on the site.
Structure
{
"site_url": "string",
"generated_at": "ISO8601",
"total_items": number,
"categories": [
{
"name": "string",
"items": [
{
"id": "string",
"title": "string",
"url": "string",
"type": "string", // e.g., "website", "tool", "service"
"updated": "ISO8601",
"schema_type": "string" // Schema.org type
}
]
}
]
}
⭐ Digital Karma Scoring v2.1
Transparent, automated quality and trust scoring for AI websites.
Scoring Formula
Signal Breakdown
| Signal | Weight | Measurement |
|---|---|---|
| Schema Coverage | 20% | Presence and quality of Schema.org markup |
| Content Freshness | 15% | Last update timestamp, update frequency |
| AI Endpoints | 25% | Required endpoint presence and completeness |
| Federation Presence | 15% | Network participation, bidirectional links |
| External Links | 10% | Quality and relevance of outbound links |
| Technical Quality | 10% | Performance, security, accessibility scores |
| Dataset Quality | 5% | Structured dataset availability and validity |
Badge Thresholds
- 🏅 Karma Bronze: Score ≥ 0.70 (Solid foundation)
- ⭐ Karma Pro: Score ≥ 0.85 (Professional quality)
- 💎 Karma Elite: Score ≥ 0.95 (Exceptional execution)
🔗 Schema.org Implementation Standards
Structured data markup requirements for AI discovery and understanding.
Required Entity Types
Organization— Business/project identityWebSite— Site-level metadataWebPage— Individual page context
Recommended Entity Types
Service— Offerings and capabilitiesDataset— Data resourcesSoftwareApplication— Tools and platformsBrand— Brand identity
Implementation Format
Use JSON-LD in <script type="application/ld+json"> tags. Place in <head> or end of <body>.
<script type="application/ld+json">
{
"@context": "https://schema.org",
"@type": "Organization",
"name": "AI Website Systems",
"url": "https://www.aiwebsitesystems.com",
"description": "Directory and knowledge base for AI-native website systems"
}
</script>
📝 LLM.txt Standard
Plain text file format optimized for LLM consumption and site understanding.
Location
/llm.txt at site root (alongside robots.txt)
Structure
# Site Name
> One-line description
## About
Brief overview of the site's purpose and content
## Core Content
- Homepage: /
- Primary section: /section/
- Key resource: /resource/
## AI Endpoints
- Manifest: /ai/manifest.json
- Health: /ai/health.json
- Catalog: /ai/catalog.json
## Datasets
- Main dataset: /datasets/data.json
## Context for LLMs
Additional context that helps LLMs understand your site
💾 Dataset Standards
Structured data file formats for AI consumption.
Recommended Format
JSON with Schema.org Dataset metadata
Required Metadata
name— Dataset titledescription— Dataset purposeversion— Version string (e.g., "1.0")datePublished— ISO 8601 timestamplicense— Data license URL
Storage Location
/datasets/ or /ai/datasets/
✅ Implementation Checklist
Use this checklist to ensure full federation compliance.
Level 1: Basic Compliance
- ☐ Create /ai/manifest.json with all required fields
- ☐ Create /ai/health.json with system metrics
- ☐ Add Schema.org Organization markup
- ☐ Implement proper CORS headers
- ☐ Use UTF-8 encoding
Level 2: Standard Compliance
- ☐ Create /ai/catalog.json with content inventory
- ☐ Add Schema.org WebSite and WebPage markup
- ☐ Create /llm.txt
- ☐ Implement ISO 8601 timestamps
Level 3: Full Compliance
- ☐ Create /ai/karma.json with calculated score
- ☐ Create /ai/federation.json with network links
- ☐ Implement automated scoring script
- ☐ Add at least one dataset
- ☐ Establish bidirectional federation links
Level 4: Elite Compliance
- ☐ Automate all endpoint updates
- ☐ Implement continuous validation
- ☐ Publish multiple high-quality datasets
- ☐ Achieve Karma Score ≥ 0.85
- ☐ Document implementation for others
🔧 Validation Tools
Tools for validating your AI website system implementation.
- Federation Validator:
node validators/validate-ai-folder.js - Schema Validator:
node validators/validate-json-schema.js - Link Checker:
node validators/validate-links.js - Karma Calculator:
python ai/calculate_karma.py
Have Feedback on These Standards?
The Digital Karma Web Federation standards are community-driven. Suggest improvements or report issues.
Contact Us