Search results for: continual learning - Bridge of Knowledge

Search

Search results for: continual learning
Przykład wyników znalezionych w innych katalogach

Search results for: continual learning

  • Revisiting Supervision for Continual Representation Learning

    Publication
    • D. Marczak
    • S. Cygert
    • T. Trzciński
    • B. Twardowski

    - Year 2024

    "In the field of continual learning, models are designed to learn tasks one after the other. While most research has centered on supervised continual learning, there is a growing interest in unsupervised continual learning, which makes use of the vast amounts of unlabeled data. Recent studies have highlighted the strengths of unsupervised methods, particularly self-supervised learning, in providing robust representations. The improved...

    Full text to download in external service

  • MagMax: Leveraging Model Merging for Seamless Continual Learning

    Publication
    • D. Marczak
    • B. Twardowski
    • T. Trzciński
    • S. Cygert

    - Year 2024

    This paper introduces a continual learning approach named MagMax, which utilizes model merging to enable large pre-trained models to continuously learn from new data without forgetting previously acquired knowledge. Distinct from traditional continual learning methods that aim to reduce forgetting during task training, MagMax combines sequential fine-tuning with a maximum magnitude weight selection for effective knowledge integration...

    Full text to download in external service

  • Divide and not forget: Ensemble of selectively trained experts in Continual Learning

    Publication
    • G. Rypeść
    • S. Cygert
    • V. Khan
    • T. Trzciński
    • B. Zieliński
    • B. Twardowski

    - Year 2024

    Class-incremental learning is becoming more popular as it helps models widen their applicability while not forgetting what they already know. A trend in this area is to use a mixture-of-expert technique, where different models work together to solve the task. However, the experts are usually trained all at once using whole task data, which makes them all prone to forgetting and increasing computational burden. To address this limitation,...

    Full text available to download

  • CONTINUUM MECHANICS AND THERMODYNAMICS

    Journals

    ISSN: 0935-1175 , eISSN: 1432-0959

  • Looking through the past: better knowledge retention for generative replay in continual learning

    Publication
    • V. Khan
    • S. Cygert
    • K. Deja
    • T. Trzciński
    • B. Twardowski

    - IEEE Access - Year 2024

    In this work, we improve the generative replay in a continual learning setting to perform well on challenging scenarios. Because of the growing complexity of continual learning tasks, it is becoming more popular, to apply the generative replay technique in the feature space instead of image space. Nevertheless, such an approach does not come without limitations. In particular, we notice the degradation of the continually trained...

    Full text available to download

  • Adapt Your Teacher: Improving Knowledge Distillation for Exemplar-free Continual Learning

    Publication
    • F. Szatkowski
    • M. Pyła
    • M. Przewięźlikowski
    • S. Cygert
    • B. Twardowski
    • T. Trzciński

    - Year 2024

    In this work, we investigate exemplar-free class incremental learning (CIL) with knowledge distillation (KD) as a regularization strategy, aiming to prevent forgetting. KDbased methods are successfully used in CIL, but they often struggle to regularize the model without access to exemplars of the training data from previous tasks. Our analysis reveals that this issue originates from substantial representation shifts in the teacher...

    Full text to download in external service

  • CONTINUUM Lifelong Learning in Neurology

    Journals

    ISSN: 1080-2371

  • Acrodermatitis continua Hallopeau

    Publication

    - Przegląd Dermatologiczny - Year 2021

    Full text to download in external service

  • Optics Continuum

    Journals

    eISSN: 2770-0208

  • Hybrid model of moving or rotating continua

    Publication

    - Year 2009

    The paper introduces the method of the model reduction of systems that experience a Coriolis acceleration or gyroscopic effect component. In such causes that corresponding system equations are non-self-adjoined. Modal reduced model is built up for the system without Coriolis or gyroscopic effect terms. These phenomena are next included by application of any lumping technique. Hence, the final reduced model is a hybrid one, obtained...

    Full text to download in external service