Object detection has improved significantly in recent years [4, 13, 23, 40] on challenging benchmarks, such as PASCAL VOC [10] and MS COCO [24]. However, most existing detectors are domain-specific, lack generalization ability to new domains and categories. Recently, Wang et al. [47] proposed a multi-task universal object detector by domain attention across eleven diverse datasets. They show that a single network with marginally more parameters can handle detection on multiple domains, even outper-
Figure 1. Given A, B two object detection tasks, corresponding domains, and
their corresponding categories, there are four different scenarios when learning A and B sequentially: more training data (top-left), same categories but different domains (top-right), different categories but same domains (bottom-left), and different categories and domains (bottom-right).
forming single-domain detectors in most cases. However, a major drawback of such a multi-task universal detector is that all the data has to be accessible during the model training. Moreover, once the model is trained, it is hard to adapt it to new domains without retraining all seen domains again. Unfortunately, in real-world scenarios, legacy data from previous domains can be lost, proprietary, or simply too expensive to use in new domains [22]. For example, for models deployed on mobile devices, it is unlikely that they can still access the original training data. Even if they do have access, the limited resources on mobile devices make it difficult to retrain with full training data. Uploading the new training data to the cloud might not be an option due to privacy concerns. If we want to learn to detect/localize new concepts from new domains on devices for these models without losing the detection ability in previous domains, we need to develop a new learning scheme.
Multi-Task incremental learning learns new knowledge
by updating a model trained from previous datasets incre- mentally. It is well analyzed in image classification [7, 32], while it has rarely been explored in object detection. Most work focus on incremental object detection in a single domain [19, 45, 53]. In this paper, we propose three scenarios to learn an object detector across multiple datasets incrementally varying categories and domains, as shown in Figure 1. For instance, Watercolor and Comic [18] share the same categories, but they are from different domains, how would domain shift affect the continual learning process? VOC and COCO are from similar domains, but COCO has 60 more categories, how would category difference affect? KITTI [11] and Kitchen [12] have disjoint categories and significant domain discrepancies, how difficult is it to learn sequentially? To answer these questions and better understand forgetting across domains, we conducted a comprehensive analysis in different scenarios.
Distillation is widely used in image classification to avoid catastrophic forgetting [2, 8, 22, 41]. It is ineffective to apply them directly to object detection, since in state-of-the-art two-stage and some one-stage detectors [39, 40], majority of box hypotheses (“proposals”) are background (provided by either regional proposal networks or dense sampling). Due to complexity of background and various sizes/numbers of foreground objects, treating the whole image and all region proposals equally will lead to relatively weak guidance from the important foreground objects. Therefore, we need to have top-down attention from the ground-truth bounding boxes to guide the distillation process. Also, it has been shown in [6, 46] that context information is very important for object detection. Thus, we cannot discard all background information and need to preserve useful background information and context around foreground objects. Therefore, we propose attentive feature distillation to apply both top-down attention and bottom-up attention on feature maps for object detection.
We show in our experiments that category differences cause a bigger problem of forgetting, and just using attentive feature distillation is not enough to prevent forgetting in these difficult cases. Storing a small number of exemplars from previous tasks is commonly used in classification, but it is unclear how it would affect in object detection. Therefore, we explore three different ways to use of a small number of exemplars from previous tasks to further mitigate forgetting. Especially, our proposed adaptive sampling method can balance between the number of bounding boxes and the diversity of exemplars.
To summarize, we make the following contributions:
• We propose three scenarios across multiple datasets and analyze the effects of domain gaps and category differences on catastrophic forgetting for incremental object detection.
• We propose an attentive feature distillation approach to distill important knowledge using both top-down and bottom-up attentions.
• We explore three different exemplar sampling methods for object detection and propose an adaptive exemplar sampling to choose informative and diverse samples for difficult cases.
Experimental results across seven datasets demonstrate the effectiveness of our proposed method and show interesting behaviors in different scenarios.
Object Detection Object detection networks can be divided into two categories: one and two-stage. FasterRCNN [40] is a representative two-stage method with a region proposal network (RPN) and a classification and regression network (Fast-RCNN [13]). YOLO [38] and SSD [25] are representatives of one-stage methods, which predict bounding boxes and class probabilities directly from full images in one step. Object detection has achieved sig-nificant improvement on multiple large datasets, such as PASCAL VOC [10], MSCOCO [24]. However, most of the existing detectors are domain and category specific. Recently, Wang et al. [47] proposed to train a single network across datasets jointly. In this work, the network is learned incrementally and dynamically across multiple datasets. Incremental Learning Exiting work on incremental learning mostly focus on classification problems, which can be roughly divided into three main families [7, 32]: regularization-based, parameter-isolated and rehearsal-based methods. Regularization-based methods contain both data-focused and prior-focused approaches. Data-focused methods are composed of distillation approaches such as LwF [22] using probability distillation and LwM [8] using attention distillation. Prior-focused methods estimate the importance of parameters, and it applies a higher penalty on those that show a significant change when switching from one task to another [3, 20, 22, 26, 52]. The next family prevents catastrophic forgetting by growing a sub-network or learning a mask for each task [21, 28, 29, 42, 43]. Finally, rehearsal-based approaches form the last family, which either store a small number of training samples from previous tasks [5, 27, 37], or use a generative model to sample synthetic data from previously learned distributions [44, 48].
There are relatively few methods for incremental object detection learning. Shmelkov et al. [45] proposed the first method to learn an object detector incrementally by adding one or a few classes at a time within one single domain. It leverages the distillation loss for both object localization and object classification. Distillation-based methods are further improved by [15, 36, 49, 53]. However, they still suffer from noisy backgrounds and noisy region pro- posals. Meta-learning was proposed for incremental object detection to reshape model gradients for optimally sharing information [19]. All these methods are applied to incremental object detection in a single domain. In this work, we propose three scenarios across multiple datasets. Recently, It has also been studied on few-shot incremental object detection [34, 35] and online object detection [1].
Transfer Learning Convolutional neural networks (CNNs) models trained on ImageNet have been widely used for transfer learning; either using a pre-trained model as a feature extractor[9] or fine-tuning the model on the target data[14, 30]. After transfer learning, performance on target task is only considered important and performance on the original task is ignored. We refer to [31] for a comprehensive survey on transfer learning. In this paper, we transfer knowledge of the object detector across domains incrementally but aim at avoiding the catastrophic forgetting of previous domains. Since there is no prior work on analyzing the relation between the forgetting and domain-category differences, we conduct in-depth forgetting analysis during transfer learning.
In this section, we introduce the notation for object detection in multi-task incremental learning and present the proposed approach in Sec. 4.
3.1. Object Detection
An object detector is a function that maps an image to an output
which consists of multiple bounding box and their labels. Object detectors are typically trained from a dataset
of size N, by minimizing a loss or objective L. In the case of a typical two-stage detector, the function is composed of three elements, a feature extractor F that maps a (region of the) image onto a vector or probability space, z = F(x), a region proposal network (RPN), R that samples hypotheses
, and a classifier, or head H that measures the fit of the hypothesis,
.
where detection loss accounts for both label classifica-tion error and bounding box(es) regression error.
, where
and
are defined as cross entropy loss and smooth-
loss, respectively. The functions F, R, H are typically implemented using deep neural networks (DNNs), and training or learning corresponds to minimizing the loss with respect to their parameters.
3.2. Incremental Multi-Task Object Detection
In continual/incremental learning, T tasks are presented sequentially, each corresponding to a different dataset of domains and categories
. Since training T models independently is inefficient both statistically and computationally, in typical incremental/continual learning setting, parts of the model are shared across all tasks, most notably the feature extractor F. Then, multi-task incremental learning methods focus on solving the catastrophic forgetting problem when training the tasks sequentially with shared backbone features and separate heads [7]. Due to the complexity of background and diversity in sizes and numbers of foreground objects, compared to incremental classification, incremental detection needs more specially designed to mitigate forgetting, which we will introduce in Section 4. Without loss of generality, we present and analyze our approach for the case of two-task incremental detection. Extensions to more tasks is straightforward and we validate this claim by showing experiments on more than two tasks in Section 5.3.
We decompose two-task incremental learning into four different scenarios for in-depth understanding of how domain gaps and category differences contribute to catastrophic forgetting. Then we describe our overall framework on multi-task incremental detection. It is followed by attentive feature distillation that uses both bottom-up and top-down attentions, and proposed exemplar sampling methods.
4.1. Three Scenarios for Incremental Detection
We consider four different scenarios (three non-trivial scenarios) in two-task incremental detection, using the two tasks A and B for reference (Fig. 1): (i) both domains and classes are the same, so there is no covariate shift; (ii) Same domain, different categories, and
, corresponding to intra-domain sequential learning. (iii) Domain shift,
but
, corresponding to domain adaptation, say from real to synthetic images. Finally (iv) both domains and categories differ,
and
. For example, KITTI and Kitchen datasets have different domain (indoor vs. outdoor imagery) and categories. In the following sections, we focus on the last three non-trivial scenarios.
4.2. Framework
Our incremental detection system is based on a generic two-stage object detection algorithms (FasterRCNN [40], FPN [23]). We assume ResNet-style networks (ResNet [16], SE-ResNet [17]) as backbone. Specifically, for the two-task case, as shown in Figure 2, we train the first task A using Faster-RCNN with data . Then we
Figure 2. The proposed framework for learning tasks A, B sequentially based on Faster-RCNN (Best view in color). White modules on top are frozen after learning task A. When learning task B, we first duplicate the blue modules (including the RPN) and add a new head. Then, we combine data from task ) and exemplars from task
). In green, our proposed approach combines bottom-up attention (
) from the outputs of the feature extractors with top-down attention (
) from the output bounding boxes of the RPN. The attentive feature distillation loss (
) is then combined with the usual object detection losses (
). The same procedure can be easily extended to more tasks.
train on task B with data using our proposed attentive feature distillation (Section 4.3) and adaptive exemplar sampling method (Section 4.4). After learning on the current task, only current model is needed to do inference for all tasks and previous model is removed from the memory. This framework could be easily extend to more tasks.
By fusing the usual object detection loss functions with the proposed attentive feature distillation loss, the final objective function for incremental object detection learning from task A to task B is defined as:
where and
are the standard Faster-RCNN detec- tion loss, which is updated using data from current task B and a few exemplars (in Section 4.4) selected from previous task A, respectively.
is our propsoed attentive feature distillation loss and we will explain it in the next section.
is a trade-off parameter to balance the current learning objective and distillation objective to avoid forgetting.
4.3. Attentive Feature Distillation (AFD)
After learning on the first task A, we train on task B incrementally, the bottom-up AFD is defined as integrating self-attention maps and feature maps. Here self-attention maps are summation of all channels of the feature maps. They capture the important blobs in the feature maps based on network itself. By combining self-attention maps and feature maps, we can capture the important context and background information smoothly and naturally during training, as shown in the middle row in Figure 3. Formally,
we define bottom-up AFD as:
Here and
are the feature extractors of current task B and previous task A (Fig. 2) and the self-attention maps are
where c is the number of channels per activation.
Top-down attention is computed using the ground truth information. For each ground truth bounding box , intersection-over-union (IoU)
is computed for each box proposal
provided by the RPN. The overlapping region between
and
is defined as
:
A threshold th is set as to decide the correct predictions. |P| is the number of region proposals. The top-down attention M is initialized as all zeros
and accumulated for all ground truth bounding boxes:
where |G| is the number of ground truth bounding boxes. We do the same normalization as in Eq. 3, using the top-
Figure 3. Examples of attention maps. Original images (top), bottom-up attention (middle), top-down attention (bottom) from Comic (left) and Kitchen (right) object detection datasets.
down attention maps M instead of the self-attention maps. Therefore, the top-down AFD objective is defined as:
(7) Top-down AFD focuses on distillation on foreground objects, which is crucial for object detection algorithms. To leverage both rich context information and foreground objects, The final AFD loss function is defined as:
4.4. Adaptive Exemplar Sampling
In incremental learning for classification, it is common to store a small number of samples (“exemplars”) to avoid catastrophic forgetting [5, 37] while still maintaining training efficiency. However, it is unclear how effective the exemplars are for object detection. Thus, we analyze three different ways of using exemplars for object detection.
Random sampling is effective for classification problems [5], so we use it as a baseline in object detection. Since the number of bounding boxes can vary in each sample image, we propose hard sampling as another baseline, which consists of images with the most bounding boxes as exemplars. However, for object detection datasets (e.g., KITTI or Kitchen), the diversity of samples can be reduced by using hard sampling, as the images with more bounding boxes are more likely to be sampled from consecutive frames.
To avoid this drawback, we propose adaptive sampling: For each category, we rank all K samples in decreasing order by number of bounding boxes. Given a budget of s exemplars per class with and
, we randomly sample s exemplars from the ordered list (1,
). We de-fine three different sampling cases: when
, we select the samples with the most bounding boxes (hard sampling), when
we sample among all images randomly (ran- dom sampling), and when
and
, it balances the number of bounding boxes and diversity of exemplars through the choice of
. It is defined as:
In the experimental section, we compare three different sampling methods and show the superior performance of the adaptive sampling.
We use a Pytorch [33] implementation of FasterRCNN [50] with SE-ResNet-50 [17] pre-trained on ImageNet. We fix the first convolution layer, the first residual block, and all BN layers during training. This is common practise in detection [40, 47]. We consider different combinations of the following datasets: Watercolor [18], Clipart [18], Comic [18], Kitchen [12], KITTI [11], Pascal VOC [10], COCO [24]. All train and test splits are the same as in [47]. Specifically, for Pascal VOC, we trained on VOC2007 and VOC2012 trainval set and tested on VOC2007 test set. For COCO, we trained on COCO 2014 valminusminival and tested on minival, to shorten the experimental period. The Pascal VOC mean average precision (mAP) metric is used for evaluation.
Training details. Following [50], we use the default parameters for Faster-RCNN with 4 anchor scales and 3 anchor ratios. Learning rate is set to 0.01 for 10 epochs and 0.001 for the last 2. For small datasets (Watercolor, Clipart, Comic) we use a batch size of 8 on 4 synchronized GPUs. For the other datasets, we use a batch size of 16. For all experiments, we set from Eq. 2.
Comparison methods. We compare AFD with LwF Detection [45], Feature Distillation [41], Attention Distillation [51], EWC [20], MAS [3] and two other baselines (joint training and fine-tuning). For LwF Detection, we follow [45] to embed the loss function into our framework. For joint training, we train a detector using all training data at the same time, which can be seen as upper bound for incremental learning. Fine-tuning is done by training all object detection tasks sequentially without any additional loss. Unless specified, the adaptive sampling is used for all methods using exemplars for fair comparison.
Table 1. Analysis of performance (mAP) and forgetting on different scenarios without any exemplars. Arrows indicate order of learning. We evaluate on both datasets after training on the second dataset incrementally.
5.1. Analysis of the AFD on Three Scenarios
In this section, we analyze the effect of forgetting on different scenarios without using any exemplars to understand which factor impacts forgetting the most.
As discussed in Section 4.1, we decompose two-task incremental learning into 4 scenarios with different domains and categories differences. We focus on the three non-trivial scenarios, as show in Table 1: 1) KITTI and Kitchen ; 2) Watercolor and Comic (
,
); 3) VOC and COCO (
).
One interesting observation we can see from the results is that domain gaps have less impact in forgetting. Specifically, in Watercolor and Comic, forgetting is less severe compared to other two scenarios by a large margin, even for just fine-tuning. By using our proposed AFD, we can achieve similar performance as joint training. The drops are just 2.2 and 0.6 for each direction, respectively. One possible explanation for this phenomenon is that, although there exists domain discrepancy between Watercolor and Comic, since the categories and general perspective of the objects remain the same, the backbone features are quite similar between the two tasks. Training the RPN and detection head for the new task also would not disturb the backbone features much due to same categories. This can be seen from the low forgetting of vanilla fine-tuning.
The other observation is that if we continually train on a new task in the same domain, with all the classes from the previous task, i.e., VOC to COCO, there is no forgetting for our proposed AFD. On the other hand, there is severe forgetting of up to 20% mAP when continually train on a new task with less classes from the previous task, i.e., COCO to VOC. In this case, neither fine-tuning nor AFD can avoid the forgetting, though AFD still manages to improve over Fine-tuning from . Therefore, learning the RPN and detection head on tasks with more classes actually enhance the backbone features for the previous task, while learning on tasks with less classes can cause severe forgetting. In the latter case, the same feature maps that produce positive signal in the previous RPN and detection head could be negative in new heads. Thus the gradients propagated back to the backbone are significantly different, causing severe forgetting.
Table 2. Results on KITTI and Kitchen (100 exemplars in total). The mAP is evaluated on both datasets after training on the second dataset. Arrows indicate order of learning. ‘Average’ means the average of numbers in the same row for easy comparison. ‘*’ indicates the methods with exemplars.
Table 3. Results on Comic and Watercolor (without exemplars).
Unsurprisingly, for Kitchen and KITTI, where there are the vast differences in categories and domains, we observe severe forgetting. Fine-tuning forgets the first task almost completely while our proposed AFD can reduce the performance drops from and
, respectively. However, with just attention, it is hard to mitigate the forgetting effect even with the best distillation methods for this scenario. To solve the forgetting problem in the dif-ficult cases for the last two scenarios, we explore the usage of exemplars in the following sections.
Overall, EWC and MAS performs worse than our proposed AFD in most cases, while MAS achieves good performance from COCO to VOC and Watercolor to Comic.
5.2. Comparisons on Two-Task Setting
In this section, we compare to all methods in three different scenarios for two-task setting. We have shown in previous section, for difficult cases, forgetting is severe. Keeping exemplars can further mitigate forgetting. We add ‘*’ to indicate methods combining with exemplars.
Table 4. Results from COCO to VOC (500 exemplars in total). ‘*’ indicates the methods with exemplars.
KITTI and Kitchen. As shown in Table 2, Finetuning suffers from catastrophic forgetting without exemplars, however with 100 exemplars we can see that Finetuning* performs quite well and obtains similar accuracy as LwF Detection* [45]. Feature Distillation* is worse in both cases, while Attention Distillation* performs better by fil-tering out the noisy information. It is interesting that EWC* and MAS* outperforms other methods by integrating with exemplars. Our AFD* outperforms all other methods and baselines and is close to joint training with only 100 exemplars (less than 3% of whole datasets). Comic and Watercolor. In the scenario of domain shift when we have the same categories but different domains, we compare with the methods and baselines without using exemplars due to much less forgetting, as demonstrated in Table 1. As seen in Table 3, Attention Distillation and MAS achieve the best among baselines but they are worse than ours. our AFD achieves 46.6 mAP compared to Joint Training with 47.5 in average. It shows that we can avoid forgetting in this scenario even without using any data from previous tasks, which is much efficient than Joint training. COCO to VOC. We present results on this relatively larger datasets in Table 4. Since there is no forgetting from VOC to COCO (seen in Table 1), we only report results from COCO to VOC. COCO is a more challenging dataset compared to others because of the large amount of data and categories. Our AFD* surpasses the Attention Distillation* methods by 5.2. EWC* and MAS* are the best baselines in this case, still our method is superior to them. However, there is still space for improvement until achieving similar performance as joint training. We also show some qualitative results on COCO before and after training on VOC (see Figure 5). We can clearly see that Fine-tuning* with exemplars outputs less bounding boxes or has lower prediction confidence on COCO after learning on VOC. Our proposed AFD* closes the gap between fine-tuning and joint training by forgetting less and predicting more confident scores.
5.3. Comparisons on More Tasks
In this section, we show that our method is capable of extending to many tasks. Specifically we compare on two settings of learning three tasks and six tasks incrementally.
Figure 4. Forgetting matrix for Fine-tuning* and AFD* (right) on sequential learning of six tasks (300 exemplars per task). Horizontal axis represents the sequential learning order of different tasks. Vertical axis is forgetting mAP for each task after learning on the task in the horizontal axis. Each Row represents forgetting progression of each dataset over the learning sequence. The lighter the color, the less the forgetting.
Table 5. Results on KITTI, VOC and Kitchen (300 exemplars per task). The Pascal mAP is reported on all datasets after learning on the last. ‘*’ indicates the methods with exemplars.
Table 6. Ablation study on different sampling methods (100 exem- plars in total).
On three tasks. We show results in more realistic and challenging settings learning incrementally with three tasks. In Table 5, we perform a sequence of incremental training on KITTI, VOC, and Kitchen. We compare our method with a competitive baseline, as demonstrated in previous experiments. The performances are evaluated after training the last task. Our proposed approach clearly outperforms Finetuning w/ exemplars by a large margin (5.6 in average of three tasks).
On six tasks. To further scale-up our incremental object detector, we conduct experiments on a sequence of six different datasets: VOC, Clipart, KITTI, Watercolor, Comic, and Kitchen. To illustrate the dynamic process of forgetting after training on each dataset, we show in Figure 4 a forgetting matrix, which reflects the dynamic of forgetting after training on each task. The overall forgetting of VOC, Clipart, KITTI, Watercolor and Comic is calculated by adding all values on each row. It is 19.5 / 12.5 / 3.7 / 7.3 / 2.5 For our method and 27.1 / 16.3 / 7.2 / 8.4 / 4.6 for Fine-tuning w/ exemplars, respectively. It shows that our method scales well when it applies to many more tasks.
Figure 5. Examples of predictions on COCO after training on VOC for Fine-tuning* (top), Joint Training (bottom) and Ours* (middle). Finetuning* tends to forget objects, such as the hydrant, the tie or the keyboard. Ours* is capable of detecting all those objects and only misses the ball and the bicycle. Joint Training is capable of detecting all the objects missed by the other methods, but is not capable of differentiating between the two elephants. In the last column, Ours* predicts the objects with higher confidence than the other methods.
5.4. Ablation Study
Ablation study for different sampling methods As shown in Table 6, we compare with the different sampling strategies introduced in Section 4.4. All results are reported with the proposed AFD. Hard sampling performs better than random sampling from Kitchen to KITTI, but is much worse from KITTI to Kitchen. When looking at the selected samples, we found that many consecutive frames have a very similar scene, which reduces the diversity of samples. By choosing different values of , we observe that adaptive sampling outperforms both random and hard sampling with
being the best.
Ablation study for number of exemplars Although we have shown that AFD can mitigate forgetting by a large margin, there is still a gap with Joint Training in the more challenging scenario (i.e. KITTI - Kitchen). Therefore, we experiment with exemplar sampling by keeping a small number of exemplars from the previous task. As shown in Figure 6, it is notable that with only 100 randomly sampled exemplars (less than 3% fraction of data), Fine-tuning increases by from Kitchen to KITTI, and by
from KITTI to Kitchen. Combined with our distillation methods, the accuracy from previous task gets closer to Joint Training. Performance improves as more exemplars are added. AFD is superior to both individual bottom-up
Figure 6. Ablation study on different number of exemplars. Evaluation on the first dataset after training on the second dataset.
and top-down attentions.
In this paper, we study the problem of multi-task incremental detection by decomposing the two-task case into three different scenarios. With the proposed attentive feature distillation (AFD) on the three non-trivial scenarios, we gain insights on how domain gaps and category differences impact forgetting. Specifically, in our experiments, domain gaps cause less forgetting, and the category differences are actually the bigger problem (See Section 5.1). In these difficult cases, sampling a small number of exemplars can largely mitigate forgetting.
[1] Manoj Acharya, Tyler L Hayes, and Christopher Kanan. Rodeo: Replay for online object detection. In BMVC, 2020. 3
[2] Alessandro Achille, Tom Eccles, Loic Matthey, Chris Burgess, Nicholas Watters, Alexander Lerchner, and Irina Higgins. Life-long disentangled representation learning with cross-domain latent homologies. In NeurIPS, pages 9873– 9883, 2018. 2
[3] Rahaf Aljundi, Francesca Babiloni, Mohamed Elhoseiny, Marcus Rohrbach, and Tinne Tuytelaars. Memory aware synapses: Learning what (not) to forget. In ECCV, pages 139–154, 2018. 2, 5, 6, 7
[4] Zhaowei Cai and Nuno Vasconcelos. Cascade r-cnn: Delving into high quality object detection. In CVPR, pages 6154– 6162, 2018. 1
[5] Arslan Chaudhry, Puneet K Dokania, Thalaiyasingam Ajan- than, and Philip HS Torr. Riemannian walk for incremental learning: Understanding forgetting and intransigence. In ECCV, pages 532–547, 2018. 2, 5
[6] Zhe Chen, Shaoli Huang, and Dacheng Tao. Context refine- ment for object detection. In Vittorio Ferrari, Martial Hebert, Cristian Sminchisescu, and Yair Weiss, editors, Computer Vision - ECCV 2018 - 15th European Conference, Munich, Germany, September 8-14, 2018, Proceedings, Part VIII, volume 11212 of Lecture Notes in Computer Science, pages 74–89, 2018. 2
[7] Matthias De Lange, Rahaf Aljundi, Marc Masana, Sarah Parisot, Xu Jia, Ales Leonardis, Gregory Slabaugh, and Tinne Tuytelaars. Continual learning: A comparative study on how to defy forgetting in classification tasks. arXiv preprint arXiv:1909.08383, 2019. 2, 3
[8] Prithviraj Dhar, Rajat Vikram Singh, Kuan-Chuan Peng, Ziyan Wu, and Rama Chellappa. Learning without memorizing. In CVPR, pages 5138–5146, 2019. 2
[9] Jeff Donahue, Yangqing Jia, Oriol Vinyals, Judy Hoffman, Ning Zhang, Eric Tzeng, and Trevor Darrell. Decaf: A deep convolutional activation feature for generic visual recognition. In ICML, pages 647–655, 2014. 3
[10] Mark Everingham, Luc Van Gool, Christopher KI Williams, John Winn, and Andrew Zisserman. The pascal visual object classes (voc) challenge. International journal of computer vision, 88(2):303–338, 2010. 1, 2, 5
[11] Andreas Geiger, Philip Lenz, and Raquel Urtasun. Are we ready for autonomous driving? the kitti vision benchmark suite. In CVPR, pages 3354–3361. IEEE, 2012. 2, 5
[12] Georgios Georgakis, Md Alimoor Reza, Arsalan Mousavian, Phi-Hung Le, and Jana Koˇseck´a. Multiview rgb-d dataset for object instance detection. In 2016 Fourth International Conference on 3D Vision (3DV), pages 426–434. IEEE, 2016. 2, 5
[13] Ross Girshick. Fast r-cnn. In ICCV, pages 1440–1448, 2015. 1, 2
[14] Ross Girshick, Jeff Donahue, Trevor Darrell, and Jitendra Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In CVPR, pages 580–587, 2014. 3
[15] Yu Hao, Yanwei Fu, Yu-Gang Jiang, and Qi Tian. An end-to- end architecture for class-incremental object detection with knowledge distillation. In ICME, pages 1–6. IEEE, 2019. 2
[16] Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. In CVPR, pages 770–778, 2016. 3
[17] Jie Hu, Li Shen, and Gang Sun. Squeeze-and-excitation net- works. In CVPR, pages 7132–7141, 2018. 3, 5
[18] Naoto Inoue, Ryosuke Furuta, Toshihiko Yamasaki, and Kiy- oharu Aizawa. Cross-domain weakly-supervised object detection through progressive domain adaptation. In CVPR, pages 5001–5009, 2018. 2, 5
[19] KJ Joseph, Jathushan Rajasegaran, Salman Khan, Fa- had Shahbaz Khan, Vineeth Balasubramanian, and Ling Shao. Incremental object detection via meta-learning. arXiv preprint arXiv:2003.08798, 2020. 2, 3
[20] James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka GrabskaBarwinska, et al. Overcoming catastrophic forgetting in neural networks. Proceedings of the national academy of sciences, 114(13):3521–3526, 2017. 2, 5, 6, 7
[21] Jeongtae Lee, Jaehong Yun, Sungju Hwang, and Eunho Yang. Lifelong learning with dynamically expandable networks. In ICLR, 2018. 2
[22] Zhizhong Li and Derek Hoiem. Learning without forgetting. IEEE transactions on pattern analysis and machine intelligence, 40(12):2935–2947, 2017. 1, 2
[23] Tsung-Yi Lin, Piotr Doll´ar, Ross Girshick, Kaiming He, Bharath Hariharan, and Serge Belongie. Feature pyramid networks for object detection. In CVPR, pages 2117–2125, 2017. 1, 3
[24] Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Doll´ar, and C Lawrence Zitnick. Microsoft coco: Common objects in context. In ECCV, pages 740–755. Springer, 2014. 1, 2, 5
[25] Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed, Cheng-Yang Fu, and Alexander C Berg. Ssd: Single shot multibox detector. In ECCV, pages 21–37. Springer, 2016. 2
[26] Xialei Liu, Marc Masana, Luis Herranz, Joost Van de Weijer, Antonio M Lopez, and Andrew D Bagdanov. Rotate your networks: Better weight consolidation and less catastrophic forgetting. In ICPR, pages 2262–2268. IEEE, 2018. 2
[27] David Lopez-Paz and Marc’Aurelio Ranzato. Gradient episodic memory for continual learning. In NeurIPS, pages 6467–6476, 2017. 2
[28] Arun Mallya, Dillon Davis, and Svetlana Lazebnik. Piggy- back: Adapting a single network to multiple tasks by learning to mask weights. In ECCV, pages 67–82, 2018. 2
[29] Arun Mallya and Svetlana Lazebnik. Packnet: Adding mul- tiple tasks to a single network by iterative pruning. In CVPR, pages 7765–7773, 2018. 2
[30] Maxime Oquab, Leon Bottou, Ivan Laptev, and Josef Sivic. Learning and transferring mid-level image representations using convolutional neural networks. In CVPR, pages 1717– 1724, 2014. 3
[31] Sinno Jialin Pan and Qiang Yang. A survey on transfer learn- ing. IEEE Transactions on knowledge and data engineering, 22(10):1345–1359, 2009. 3
[32] German I Parisi, Ronald Kemker, Jose L Part, Christopher Kanan, and Stefan Wermter. Continual lifelong learning with neural networks: A review. Neural Networks, 2019. 2
[33] Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer. Automatic differentiation in PyTorch. In NeurIPS Autodiff Workshop, 2017. 5
[34] Juan-Manuel Perez-Rua, Xiatian Zhu, Timothy M. Hospedales, and Tao Xiang. Incremental few-shot object detection. In CVPR, June 2020. 3
[35] Shafin Rahman, Salman Khan, Nick Barnes, and Fa- had Shahbaz Khan. Any-shot object detection. arXiv preprint arXiv:2003.07003, 2020. 3
[36] Kandan Ramakrishnan, Rameswar Panda, Quanfu Fan, John Henning, Aude Oliva, and Rogerio Feris. Relationship matters: Relation guided knowledge transfer for incremental learning of object detectors. In CVPR Workshops, June 2020. 2
[37] Sylvestre-Alvise Rebuffi, Alexander Kolesnikov, Georg Sperl, and Christoph H Lampert. icarl: Incremental classi-fier and representation learning. In CVPR, pages 2001–2010, 2017. 2, 5
[38] Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. You only look once: Unified, real-time object detection. In CVPR, pages 779–788, 2016. 2
[39] Joseph Redmon and Ali Farhadi. Yolov3: An incremental improvement. CoRR, abs/1804.02767, 2018. 2
[40] Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. Faster r-cnn: Towards real-time object detection with region proposal networks. In NeurIPS, pages 91–99, 2015. 1, 2, 3, 5
[41] Adriana Romero, Nicolas Ballas, Samira Ebrahimi Kahou, Antoine Chassang, Carlo Gatta, and Yoshua Bengio. Fitnets: Hints for thin deep nets. arXiv preprint arXiv:1412.6550, 2014. 2, 5, 6, 7
[42] Andrei A Rusu, Neil C Rabinowitz, Guillaume Desjardins, Hubert Soyer, James Kirkpatrick, Koray Kavukcuoglu, Razvan Pascanu, and Raia Hadsell. Progressive neural networks. arXiv preprint arXiv:1606.04671, 2016. 2
[43] Joan Serra, Didac Suris, Marius Miron, and Alexandros Karatzoglou. Overcoming catastrophic forgetting with hard attention to the task. In ICML, pages 4555–4564, 2018. 2
[44] Hanul Shin, Jung Kwon Lee, Jaehong Kim, and Jiwon Kim. Continual learning with deep generative replay. In NeurIPS, pages 2990–2999, 2017. 2
[45] Konstantin Shmelkov, Cordelia Schmid, and Karteek Ala- hari. Incremental learning of object detectors without catastrophic forgetting. In ICCV, pages 3400–3409, 2017. 2, 5, 6, 7
[46] Tao Wang, Li Yuan, Xiaopeng Zhang, and Jiashi Feng. Dis- tilling object detectors with fine-grained feature imitation. In CVPR, pages 4933–4942, 2019. 2
[47] Xudong Wang, Zhaowei Cai, Dashan Gao, and Nuno Vas- concelos. Towards universal object detection by domain attention. In CVPR, pages 7289–7298, 2019. 1, 2, 5
[48] Chenshen Wu, Luis Herranz, Xialei Liu, Yaxing Wang, Joost van de Weijer, and Bogdan Raducanu. Memory replay GANs: learning to generate images from new categories without forgetting. In NeurIPS, 2018. 2
[49] Dongbao Yang, Yu Zhou, Dayan Wu, Can Ma, Fei Yang, and Weiping Wang. Two-level residual distillation based triple network for incremental object detection. arXiv preprint arXiv:2007.13428, 2020. 2
[50] Jianwei Yang, Jiasen Lu, Dhruv Batra, and Devi Parikh. A faster pytorch implementation of faster r-cnn. https://github.com/jwyang/faster-rcnn.pytorch, 2017. 5
[51] Sergey Zagoruyko and Nikos Komodakis. Paying more at- tention to attention: Improving the performance of convolutional neural networks via attention transfer. In ICRL, 2017. 5, 6, 7
[52] Friedemann Zenke, Ben Poole, and Surya Ganguli. Contin- ual learning through synaptic intelligence. In ICML, pages 3987–3995. JMLR. org, 2017. 2
[53] Wang Zhou, Shiyu Chang, Norma Sosa, Hendrik Hamann, and David Cox. Lifelong object detection. arXiv preprint arXiv:2009.01129, 2020. 2