skip to main content
Language:
Search Limited to: Search Limited to: Resource type Show Results with: Show Results with: Search type Index

BiSeNet V2: Bilateral Network with Guided Aggregation for Real-Time Semantic Segmentation

International journal of computer vision, 2021-11, Vol.129 (11), p.3051-3068 [Peer Reviewed Journal]

The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2021 ;COPYRIGHT 2021 Springer ;The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2021. ;ISSN: 0920-5691 ;EISSN: 1573-1405 ;DOI: 10.1007/s11263-021-01515-2

Full text available

Citations Cited by
  • Title:
    BiSeNet V2: Bilateral Network with Guided Aggregation for Real-Time Semantic Segmentation
  • Author: Yu, Changqian ; Gao, Changxin ; Wang, Jingbo ; Yu, Gang ; Shen, Chunhua ; Sang, Nong
  • Subjects: Accuracy ; Agglomeration ; Artificial Intelligence ; Channel capacity ; Channels ; Computer Imaging ; Computer Science ; Image Processing and Computer Vision ; Inference ; Pattern Recognition ; Pattern Recognition and Graphics ; Real time ; Representations ; Segmentation ; Semantics ; Vision
  • Is Part Of: International journal of computer vision, 2021-11, Vol.129 (11), p.3051-3068
  • Description: Low-level details and high-level semantics are both essential to the semantic segmentation task. However, to speed up the model inference, current approaches almost always sacrifice the low-level details, leading to a considerable decrease in accuracy. We propose to treat these spatial details and categorical semantics separately to achieve high accuracy and high efficiency for real-time semantic segmentation. For this purpose, we propose an efficient and effective architecture with a good trade-off between speed and accuracy, termed Bilateral Segmentation Network (BiSeNet V2). This architecture involves the following: (i) A detail branch, with wide channels and shallow layers to capture low-level details and generate high-resolution feature representation; (ii) A semantics branch, with narrow channels and deep layers to obtain high-level semantic context. The detail branch has wide channel dimensions and shallow layers, while the semantics branch has narrow channel dimensions and deep layers. Due to the reduction in the channel capacity and the use of a fast-downsampling strategy, the semantics branch is lightweight and can be implemented by any efficient model. We design a guided aggregation layer to enhance mutual connections and fuse both types of feature representation. Moreover, a booster training strategy is designed to improve the segmentation performance without any extra inference cost. Extensive quantitative and qualitative evaluations demonstrate that the proposed architecture shows favorable performance compared to several state-of-the-art real-time semantic segmentation approaches. Specifically, for a 2048 × 1024 input, we achieve 72.6% Mean IoU on the Cityscapes test set with a speed of 156 FPS on one NVIDIA GeForce GTX 1080 Ti card, which is significantly faster than existing methods, yet we achieve better segmentation accuracy. The code and trained models are available online at https://git.io/BiSeNet .
  • Publisher: New York: Springer US
  • Language: English
  • Identifier: ISSN: 0920-5691
    EISSN: 1573-1405
    DOI: 10.1007/s11263-021-01515-2
  • Source: ProQuest Central
Back to results list
INSPIRE LIBRARY - TON DUC THANG UNIVERSITY (84-028) 37 755 057 Feedback
19 Nguyen Huu Tho St. Dist.7, HCM thuvien@tdtu.edu.vn

Copyright © 2017 INSPIRE LIBRARY - TON DUC THANG UNIVERSITY

Searching Remote Databases, Please Wait