skip to main content
Language:
Search Limited to: Search Limited to: Resource type Show Results with: Show Results with: Search type Index

Selective Combination of Visual and Thermal Imaging for Resilient Localization in Adverse Conditions: Day and Night, Smoke and Fire

Journal of field robotics, 2013-07, Vol.30 (4), p.641-666 [Peer Reviewed Journal]

2013 Wiley Periodicals, Inc. ;Copyright © 2013 Wiley Periodicals, Inc. ;ISSN: 1556-4959 ;EISSN: 1556-4967 ;DOI: 10.1002/rob.21464

Full text available

Citations Cited by
  • Title:
    Selective Combination of Visual and Thermal Imaging for Resilient Localization in Adverse Conditions: Day and Night, Smoke and Fire
  • Author: Brunner, Christopher ; Peynot, Thierry ; Vidal-Calleja, Teresa ; Underwood, James
  • Subjects: Cameras ; Fires ; Localization ; Night ; Perception ; Position (location) ; Sensors ; Smoke ; Studies ; Visual
  • Is Part Of: Journal of field robotics, 2013-07, Vol.30 (4), p.641-666
  • Description: Long‐term autonomy in robotics requires perception systems that are resilient to unusual but realistic conditions that will eventually occur during extended missions. For example, unmanned ground vehicles (UGVs) need to be capable of operating safely in adverse and low‐visibility conditions, such as at night or in the presence of smoke. The key to a resilient UGV perception system lies in the use of multiple sensor modalities, e.g., operating at different frequencies of the electromagnetic spectrum, to compensate for the limitations of a single sensor type. In this paper, visual and infrared imaging are combined in a Visual‐SLAM algorithm to achieve localization. We propose to evaluate the quality of data provided by each sensor modality prior to data combination. This evaluation is used to discard low‐quality data, i.e., data most likely to induce large localization errors. In this way, perceptual failures are anticipated and mitigated. An extensive experimental evaluation is conducted on data sets collected with a UGV in a range of environments and adverse conditions, including the presence of smoke (obstructing the visual camera), fire, extreme heat (saturating the infrared camera), low‐light conditions (dusk), and at night with sudden variations of artificial light. A total of 240 trajectory estimates are obtained using five different variations of data sources and data combination strategies in the localization method. In particular, the proposed approach for selective data combination is compared to methods using a single sensor type or combining both modalities without preselection. We show that the proposed framework allows for camera‐based localization resilient to a large range of low‐visibility conditions.
  • Publisher: Hoboken: Blackwell Publishing Ltd
  • Language: English;Japanese
  • Identifier: ISSN: 1556-4959
    EISSN: 1556-4967
    DOI: 10.1002/rob.21464
  • Source: Alma/SFX Local Collection

Searching Remote Databases, Please Wait