I will add llms txt, ai crawler rules and markdown pages to your website

A
austinnorgaard
A
austinnorgaard
Austin

About this gig

AI assistants like ChatGPT, Claude, Perplexity and Gemini increasingly answer questions by reading websites directly. If your site is hard for them to read, they skip it or get it wrong.


I'll make your site easy for AI to read and cite, using the same setup that runs on my own business website, which passes 22 of 23 checks on a public AI-agent-readiness scanner.


What you get:

- An llms txt index file that tells AI tools what your site offers

- AI crawler rules that welcome the bots you want and block the ones you don't

- Sitemap and canonical fixes so AI tools find the right pages

- A Markdown version of each page (Standard and Premium)

- Content negotiation and Link headers for AI agents (Premium)

- A before/after readiness report


Works with static sites, Next.js, Cloudflare and most hosts that let you add files. WordPress, Wix or Shopify: message me first so I can check what your host allows.


This does not change what human visitors or Google see.

Get to know Austin

Austin

MCP servers and AI ready websites

  • FromUnited States
  • Member sinceDec 2016
  • Languages

    English
I build websites that AI agents can read, book and buy from: llms.txt, MCP servers, agent OAuth and payments. My own site passes 22 of 23 checks on a public AI-agent-readiness scanner. I also do remote Home Assistant, Proxmox and Cloudflare setup. Clear notes, tested handoff.