SOLO
SOLO: Segmenting Objects by Locations
Abstract
We present a new, embarrassingly simple approach to instance segmentation in images. Compared to many other dense prediction tasks, e.g., semantic segmentation, it is the arbitrary number of instances that have made instance segmentation much more challenging. In order to predict a mask for each instance, mainstream approaches either follow the 'detect-thensegment' strategy as used by Mask R-CNN, or predict category masks first then use clustering techniques to group pixels into individual instances. We view the task of instance segmentation from a completely new perspective by introducing the notion of "instance categories", which assigns categories to each pixel within an instance according to the instance's location and size, thus nicely converting instance mask segmentation into a classification-solvable problem. Now instance segmentation is decomposed into two classification tasks. We demonstrate a much simpler and flexible instance segmentation framework with strong performance, achieving on par accuracy with Mask R-CNN and outperforming recent singleshot instance segmenters in accuracy. We hope that this very simple and strong framework can serve as a baseline for many instance-level recognition tasks besides instance segmentation.
Results and Models
SOLO
| Backbone |
Style |
MS train |
Lr schd |
Mem (GB) |
Inf time (fps) |
mask AP |
Download |
| R-50 |
pytorch |
N |
1x |
8.0 |
14.0 |
33.1 |
model | log |
| R-50 |
pytorch |
Y |
3x |
7.4 |
14.0 |
35.9 |
model | log |
Decoupled SOLO
| Backbone |
Style |
MS train |
Lr schd |
Mem (GB) |
Inf time (fps) |
mask AP |
Download |
| R-50 |
pytorch |
N |
1x |
7.8 |
12.5 |
33.9 |
model | log |
| R-50 |
pytorch |
Y |
3x |
7.9 |
12.5 |
36.7 |
model | log |
- Decoupled SOLO has a decoupled head which is different from SOLO head.
Decoupled SOLO serves as an efficient and equivalent variant in accuracy
of SOLO. Please refer to the corresponding config files for details.
Decoupled Light SOLO
| Backbone |
Style |
MS train |
Lr schd |
Mem (GB) |
Inf time (fps) |
mask AP |
Download |
| R-50 |
pytorch |
Y |
3x |
2.2 |
31.2 |
32.9 |
model | log |
- Decoupled Light SOLO using decoupled structure similar to Decoupled
SOLO head, with light-weight head and smaller input size, Please refer
to the corresponding config files for details.
Citation
@inproceedings{wang2020solo,
title = {{SOLO}: Segmenting Objects by Locations},
author = {Wang, Xinlong and Kong, Tao and Shen, Chunhua and Jiang, Yuning and Li, Lei},
booktitle = {Proc. Eur. Conf. Computer Vision (ECCV)},
year = {2020}
}
