One of the ways that you can enhance your website foundation is to combine high technical SEO standards with great user experience, shares Iva Jovanovic.

Iva says: “Technical SEO and user experience will remain the foundation for websites, even when optimizing for AI chatbots.”

Why do AI chatbots like user experience?

“To start with, crawlability has been a topic in SEO for years and years. It's now gaining even more importance because of the way that chatbots crawl websites. They crawl a bit differently.

We're used to Googlebot and other search engine bots adapting to what the websites are serving, and adapting to crawling them. Chatbots are not exactly the same. A lot of studies and research confirm that many of the chatbots do not crawl JavaScript, for example. So, a lot of websites that have been using JavaScript, that Googlebot has been able to crawl, are now not going to be as accessible to chatbots. GPTBot, ClaudeBot, and even Perplexity don't crawl JavaScript.

Aside from that, the bots crawl websites a little more simply, and it's really important to structure your website properly for that, so that the chatbots can access your link. Also, make sure all the links are there, avoid having 404s and redirects, have a pure structure of the website, pure links, and make sure the link juice is going on.

Even before, websites that used JavaScript were not rendered as much. A long time ago, using JavaScript, you could hide links and do spammy stuff. Later on, Googlebot developed a way to make sure your JavaScript is crawled properly, and Martin Splitt has talked about it many times.

However, it is frustrating for developers who are used to using JavaScript in frameworks like React and Vue to create their websites, especially in SaaS businesses. Now, the way that the bots will render it is a bit different. It's going to be a bit difficult for developers and SEOs to find common ground in that.”