Named recognition refers to the process of identifying and classifying proper names, such as people, organisations, or places, within a body of text. This task is often handled by computer systems that scan documents to pick out and categorise these names. It is a foundational technique in natural language processing used to make sense of…
Text simplification is the process of making written content easier to read and understand. This is done by using simpler words, shorter sentences, and clearer structure, while keeping the original meaning. It helps more people, including those with reading difficulties or those learning a new language, access information more easily.
A token window refers to the amount of text, measured in tokens, that an AI model can process at one time. Tokens are pieces of words or characters that the model uses to understand and generate language. The size of the token window limits how much information the model can consider for a single response…
Intent resolution is the process of figuring out what a user wants to do when they give a command or make a request, especially in software and digital assistants. It takes the input, such as a spoken phrase or typed command, and matches it to a specific action or outcome. This process often involves analysing…
Lexical filters are tools or algorithms used to include or exclude words or phrases based on specific criteria. They help process text by filtering out unwanted or irrelevant terms, making analysis and search tasks more efficient. These filters are commonly used in applications like search engines, spam detection, and text analysis to improve the quality…
Syntax parsing is the process of analysing a sequence of words or symbols according to the rules of a language to determine its grammatical structure. It breaks down sentences or code into parts, making it easier for computers to understand their meaning. Syntax parsing is a key step in tasks like understanding human language or…
Dialogue memory is a system or method that allows a programme, such as a chatbot or virtual assistant, to remember and refer back to previous exchanges in a conversation. This helps the software understand context, track topics, and respond more naturally to users. With dialogue memory, interactions feel more coherent and less repetitive, as the…
Prompt routing is the process of directing user prompts or questions to the most suitable AI model or system based on their content or intent. This helps ensure that the response is accurate and relevant by leveraging the strengths of different models or tools. It is often used in systems that handle a wide variety…
Embedding injection is a security vulnerability that occurs when untrusted input is inserted into a system that uses vector embeddings, such as those used in natural language processing or search. Attackers can exploit this by crafting inputs that manipulate or poison the embedding space, causing systems to retrieve incorrect or harmful results. This can lead…
Token drift refers to the gradual change in the meaning, value, or usage of a digital token over time. This can happen as a result of changes in the underlying technology, platform updates, or shifts in the way users interact with the token. Token drift can cause confusion, unexpected behaviour, or compatibility issues if not…