Online Weighted One-Class Ensemble for Feature Selection in Background/Foreground Separation
Background subtraction (BS) is one of the key elements for detecting moving objects in video surveillance applications. In the last few years, researchers have been worked to develop BS methods to handle the different type of challenges in BS. However, at the present time, the role and the relevance of the visual features in BS has been less investigated. In this work, we present an Online Weighted Ensemble of One-Class SVMs able to select suitable features for each pixel to distinguish the foreground objects from the background. In addition, our framework uses a mechanism to update these importances features over time. Moreover, a efficient heuristic approach is used to background model maintenance. Experimental results on multispectral video sequences are shown to demonstrate the potential of the proposed approach.
Highlights
* An incremental version of the WOC algorithm, called IncrementalWeighted One-Class Support Vector Machine (IWOC-SVM).
* An online weighted version of random subspace (OWRS) to increase the diversity of classifiers pool.
* A mechanism called Adaptive Importance Calculation (AIC) to suitably update the relative importance of each feature over time.
* A heuristic approach for IWOC-SVM model updating to improve speed.
Fig. 1. Brief overview of the proposed framework. A set of multispectral features jointly with well-known features (ie. color, texture, etc.) are extracted from
the trainning image sequence. Next, a weighted version of random subspace creates a diversity of classifiers pool, each classifier represented by a weighted version of one-class SVM. A heuristic approach called Small Votes Instance Selection (SVIS) is used in the SVM model updating step. Only the best week classifiers are selected and combined to form a strong classifier. Finally, we use a mechanism called Adaptive Importance (AI) computation to update the importance of the classifiers pool over time. The whole framework described here works as online manner.
ONLINE WEIGHTED ONE-CLASS ENSEMBLE FOR FEATURE SELECTION
A. Generate multiple weak models
B. Adaptive Importance (AI)
C. Background Detection
EXPERIMENTAL RESULTS
Visual results
Fig. 1. Background subtraction results using the MSVS dataset – (a) original frame, (b) ground truth and (c) proposed method. The true positives (TP) pixels are in white, true negatives (TN) pixels in black, false positives (FP) pixels in red and false negatives (FN) pixels in green.
Quantitative results
Fig. 2. Illustration of the visual features importance through video scenes from the MSVS dataset. For each pixel, certain features are ignored or receive relatively low importance in favor of other more informative features.
TABLE I
THE MOST (+) AND LESS (-) SIGNIFICANT FEATURES FROM MSVS SCENES.
TABLE II
PERFORMANCE OF THE DIFFERENT METHODS USING THE MSVS DATASET.
PUBLICATION AND SOURCE CODE
2016 - Silva, Caroline; Bouwmans, Thierry; Frélicot, Carl. "Online Weighted One-Class Ensemble for Feature Selection in Background/Foreground Separation". The International Conference on Pattern Recognition (ICPR), Cancun, Mexico (oral presentation), December, 2016. [PDF] [CODE]
2016 - Bouwmans, T. and Silva, C. and Marghes, C. and Zitouni, S. and Bhaskar, H. and Frélicot, C. “On the Role and the Importance of Features for Background Modeling and Foreground Detection”. Computer Science Review, 2016. [PDF]
