robots.txt
User-agent: * Allow: /wp-admin/admin-ajax.php Allow: /.css Allow: /.js Disallow: /profiles/ Disallow: /awsm_team_filters/human-resources/ Disallow: /calendar/action* Disallow: /events/action* Disallow: /*?
Ahrefs site-audit crawlers - deliberate full access
User-agent: AhrefsBot Allow: /
User-agent: AhrefsSiteAudit Allow: /
Sitemap: https://thriveagency.com/sitemap_index.xml Sitemap: https://thriveagency.com/sitemap-video.xml