📌 Catastrophic Forgetting Summary
Catastrophic forgetting is a problem in machine learning where a model trained on new data quickly loses its ability to recall or perform well on tasks it previously learned. This happens most often when a neural network is trained on one task, then retrained on a different task without access to the original data. As a result, the model forgets important information from earlier tasks, making it unreliable for multiple uses. Researchers are working on methods to help models retain old knowledge while learning new things.
🙋🏻♂️ Explain Catastrophic Forgetting Simply
Imagine trying to learn a new language, but every time you start a new one, you completely forget the last one you studied. Your brain cannot hold onto both at the same time. Catastrophic forgetting in machine learning is like this, where a computer forgets old skills when it learns something new.
📅 How Can it be used?
Apply techniques to prevent catastrophic forgetting when updating a chatbot with new conversation topics so it still remembers older ones.
🗺️ Real World Examples
A voice assistant trained to answer questions about home automation may forget how to answer questions about music controls if it is later updated with only home automation data. This makes the assistant less useful for users who expect it to handle both tasks.
An image recognition system in a factory is updated to detect new types of defects, but if catastrophic forgetting occurs, it may lose its ability to spot the defects it was originally designed to find, causing quality control issues.
✅ FAQ
📚 Categories
🔗 External Reference Links
Ready to Transform, and Optimise?
At EfficiencyAI, we don’t just understand technology — we understand how it impacts real business operations. Our consultants have delivered global transformation programmes, run strategic workshops, and helped organisations improve processes, automate workflows, and drive measurable results.
Whether you're exploring AI, automation, or data strategy, we bring the experience to guide you from challenge to solution.
Let’s talk about what’s next for your organisation.
💡Other Useful Knowledge Cards
Digital Enablement Strategies
Digital enablement strategies are structured plans that help organisations use digital tools and technologies to improve their operations, services, and customer experiences. These strategies identify where technology can make work more efficient, support new ways of working, or open up new business opportunities. They often involve training, updating systems, and changing processes to make the most of digital solutions.
Browser Isolation
Browser isolation is a security technique that separates web browsing activity from the rest of a computer or network. It works by running browser sessions in a secure, isolated environment, often on a remote server or a virtual machine. This way, if a user visits a malicious website, any harmful code or malware is contained and cannot affect the user's device or sensitive data. Organisations use browser isolation to protect against web-based threats, such as phishing attacks and drive-by downloads, without restricting access to the internet.
Shadow IT Discovery
Shadow IT Discovery is the process of finding and identifying software, applications, or devices used within an organisation without official approval or oversight by the IT department. These unauthorised tools can include cloud services, messaging apps, or hardware that employees use to do their jobs more efficiently or conveniently. Discovering shadow IT helps organisations understand what is being used, assess potential risks, and ensure compliance with security policies.
Contrastive Learning Optimization
Contrastive learning optimisation is a technique in machine learning where a model learns to tell apart similar and dissimilar items by comparing them in pairs or groups. The goal is to bring similar items closer together in the modelnulls understanding while pushing dissimilar items further apart. This approach helps the model create more useful and meaningful representations, especially when labelled data is limited.
Intelligent Process Discovery
Intelligent Process Discovery is the use of artificial intelligence and data analysis to automatically identify and map out how business processes happen within an organisation. It gathers data from system logs, user actions, and other digital traces to understand the real steps people take to complete tasks. This helps businesses see where work can be improved or automated, often revealing hidden inefficiencies.