Your CDN may be blocking CCBot without telling you, keeping your pages out of the archive that trains most models.
Edge LLMs and embedding models perform well even on NAS CPUs ...