Shownotes
David and Katherine discuss:
- Google Search Console crawl stats data report
- Hosts
- How Google is crawling your subdomains
- Robots.txt
- DNS resolution - domain provider
- Server connectivity
- HTTP Response
- File Type - HTML, javascript, images or videos
- Purpose - Discovery and refresh
- Googlebot