Catastrophic Forgetting

Catastrophic Forgetting

πŸ“Œ Catastrophic Forgetting Summary

Catastrophic forgetting is a problem in machine learning where a model trained on new data quickly loses its ability to recall or perform well on tasks it previously learned. This happens most often when a neural network is trained on one task, then retrained on a different task without access to the original data. As a result, the model forgets important information from earlier tasks, making it unreliable for multiple uses. Researchers are working on methods to help models retain old knowledge while learning new things.

πŸ™‹πŸ»β€β™‚οΈ Explain Catastrophic Forgetting Simply

Imagine trying to learn a new language, but every time you start a new one, you completely forget the last one you studied. Your brain cannot hold onto both at the same time. Catastrophic forgetting in machine learning is like this, where a computer forgets old skills when it learns something new.

πŸ“… How Can it be used?

Apply techniques to prevent catastrophic forgetting when updating a chatbot with new conversation topics so it still remembers older ones.

πŸ—ΊοΈ Real World Examples

A voice assistant trained to answer questions about home automation may forget how to answer questions about music controls if it is later updated with only home automation data. This makes the assistant less useful for users who expect it to handle both tasks.

An image recognition system in a factory is updated to detect new types of defects, but if catastrophic forgetting occurs, it may lose its ability to spot the defects it was originally designed to find, causing quality control issues.

βœ… FAQ

πŸ“š Categories

πŸ”— External Reference Links

Catastrophic Forgetting link

πŸ‘ Was This Helpful?

If this page helped you, please consider giving us a linkback or share on social media! πŸ“Ž https://www.efficiencyai.co.uk/knowledge_card/catastrophic-forgetting

Ready to Transform, and Optimise?

At EfficiencyAI, we don’t just understand technology β€” we understand how it impacts real business operations. Our consultants have delivered global transformation programmes, run strategic workshops, and helped organisations improve processes, automate workflows, and drive measurable results.

Whether you're exploring AI, automation, or data strategy, we bring the experience to guide you from challenge to solution.

Let’s talk about what’s next for your organisation.


πŸ’‘Other Useful Knowledge Cards

Agile Portfolio Management

Agile Portfolio Management is a way for organisations to manage multiple projects and programmes by using agile principles. It helps teams prioritise work, allocate resources, and respond quickly to changes. Instead of following rigid, long-term plans, it encourages frequent review and adjustment to ensure that the work being done aligns with business goals. This approach supports better decision-making by focusing on delivering value and adapting to real-world developments. It aims to balance strategic objectives with the need for flexibility and continuous improvement.

Secure Model Inference

Secure model inference refers to techniques and methods used to protect data and machine learning models during the process of making predictions. It ensures that sensitive information in both the input data and the model itself cannot be accessed or leaked by unauthorised parties. This is especially important when working with confidential or private data, such as medical records or financial information.

Blockchain for Digital Twins

Blockchain for digital twins refers to the use of blockchain technology to securely store, share, and verify data linked to digital replicas of physical objects, processes, or systems. This approach ensures that all changes and interactions with the digital twin are recorded in a transparent, tamper-proof ledger. It helps maintain trust and data integrity, especially when multiple parties need to collaborate or access the digital twin's information.

Network Intrusion Prevention

Network Intrusion Prevention refers to technology and methods used to monitor and analyse network traffic in real time to stop unauthorised or harmful activities before they can cause damage. These systems inspect data moving through a network and automatically block or prevent suspicious actions, such as hacking attempts or the spread of malware. By acting quickly, network intrusion prevention helps protect sensitive information and maintain the proper functioning of computer systems.

Conditional Generative Models

Conditional generative models are a type of artificial intelligence that creates new data based on specific input conditions or labels. Instead of generating random outputs, these models use extra information to guide what they produce. This allows for more control over the type of data generated, such as producing images of a certain category or text matching a given topic.