We usually think of AI running on web-connected servers in the cloud somewhere, but what about AI running on a stand-alone device, not connected to the internet? There are actually more examples of this than you may realise. To start with, security cameras detect motion or objects locally without sending data to the cloud. Self-driving…
One mantra regarding large language models (LLMs) is that bigger is better. Parameters are the learned weights of a model, while tokens represent the pieces of text used to train it. The more training tokens an LLM sees, the more fluent the answers it produces. This assumption that bigger is better is what has driven…
Imagine giving a robot a multiple-choice exam, but then realising it already knows all the answers. When a new version of an AI model is released by a major vendor like OpenAI, Anthropic, or Google, it usually comes with a series of statements about how well the model performs on benchmark tests. These benchmarks may…
The web browsing market has been relatively stable for some years, with Google Chrome holding 72% market share in 2025, ahead of Apple’s Safari at 12%. These are followed by Microsoft Edge, Firefox and Opera. Recently, the AI chatbot vendors have decided to muscle in on this market, and existing incumbents have added AI features…
Large language models (LLMs) have developed significantly since ChatGPT burst onto the public scene in late 2022, built on the GPT-3 model. There have been increases in scale, with GPT-4 being several times larger than GPT-3 in terms of the numbers of parameters. Context windows increased from a few thousand tokens to over a million.…
Large language models (LLMs) such as ChatGPT have excellent linguistic skills, but to use them for a specific business process, they need additional knowledge. For example, a customer service chatbot would not be much use unless it knew things like the products that the company sold and who had purchased them and when. To supplement…
I recently stumbled across an AI curiosity via a post on LinkedIn. Before we explore this, a little background is necessary. When a large language model (LLM) gets a prompt then it has to decide how long to make its answer – a few sentences, or something longer? The LLM actually generates an “end of…
We are all being deluged by news stories about artificial intelligence (AI) and the large language models (LLMs) at the heart of the latest AI trend, generative AI. But how do they actually work? Some level of understanding of this would seem quite useful for a technology that now creates over half of the content…