skip to main content
Language:

Visually Grounded Models of Spoken Language: A Survey of Datasets, Architectures and Evaluation Techniques

The Journal of artificial intelligence research, 2022-01, Vol.73, p.673-707 [Peer Reviewed Journal]

2022. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the associated terms available at https://www.jair.org/index.php/jair/about ;ISSN: 1076-9757 ;EISSN: 1943-5037 ;DOI: 10.1613/jair.1.12967

Full text available

Citations Cited by
  • Title:
    Visually Grounded Models of Spoken Language: A Survey of Datasets, Architectures and Evaluation Techniques
  • Author: Chrupała, Grzegorz
  • Subjects: Computer vision ; Datasets ; Language ; Machine learning ; Modelling ; Natural language processing ; Speech processing ; Visual signals
  • Is Part Of: The Journal of artificial intelligence research, 2022-01, Vol.73, p.673-707
  • Description: This survey provides an overview of the evolution of visually grounded models of spoken language over the last 20 years. Such models are inspired by the observation that when children pick up a language, they rely on a wide range of indirect and noisy clues, crucially including signals from the visual modality co-occurring with spoken utterances. Several fields have made important contributions to this approach to modeling or mimicking the process of learning language: Machine Learning, Natural Language and Speech Processing, Computer Vision and Cognitive Science. The current paper brings together these contributions in order to provide a useful introduction and overview for practitioners in all these areas. We discuss the central research questions addressed, the timeline of developments, and the datasets which enabled much of this work. We then summarize the main modeling architectures and offer an exhaustive overview of the evaluation metrics and analysis techniques.
  • Publisher: San Francisco: AI Access Foundation
  • Language: English
  • Identifier: ISSN: 1076-9757
    EISSN: 1943-5037
    DOI: 10.1613/jair.1.12967
  • Source: Freely Accessible Journals
    Alma/SFX Local Collection
    ProQuest Central
    DOAJ Directory of Open Access Journals
    American Association for Artificial Intelligence publications
Back to results list
Go to Previous pagePrevious Result  14 NextGo to Next page
INSPIRE LIBRARY - TON DUC THANG UNIVERSITY (84-028) 37 755 057 Feedback
19 Nguyen Huu Tho St. Dist.7, HCM thuvien@tdtu.edu.vn

Copyright © 2017 INSPIRE LIBRARY - TON DUC THANG UNIVERSITY

Searching Remote Databases, Please Wait