skip to main content
Guest
My Research
My Account
Sign out
Sign in
This feature requires javascript
Library Search
Find Databases
Browse Search
E-Journals A-Z
E-Books A-Z
Citation Linker
Help
Language:
English
Vietnamese
This feature required javascript
This feature requires javascript
Primo Search
All Library Resources
All
Course Materials
Course Materials
Search For:
Clear Search Box
Search in:
All Library Resources
Or hit Enter to replace search target
Or select another collection:
Search in:
All Library Resources
Search in:
Print Resources
Search in:
Digital Resources
Search in:
Online E-Resources
Advanced Search
Browse Search
This feature requires javascript
Search Limited to:
Search Limited to:
Resource type
criteria input
All items
Books
Articles
Images
Audio Visual
Maps
Graduate theses
Show Results with:
criteria input
that contain my query words
with my exact phrase
starts with
Show Results with:
Search type Index
criteria input
anywhere in the record
in the title
as author/creator
in subject
Full Text
ISBN
ISSN
TOC
Keyword
Field
Show Results with:
in the title
Show Results with:
anywhere in the record
in the title
as author/creator
in subject
Full Text
ISBN
ISSN
TOC
Keyword
Field
This feature requires javascript
Foundation Models for Natural Language Processing: Pre-trained Language Models Integrating Media
ISBN: 3031231899 ;ISBN: 9783031231902 ;ISBN: 9783031231896 ;ISBN: 3031231902 ;DOI: 10.1007/978-3-031-23190-2
Digital Resources/Online E-Resources
Citations
Cited by
View Online
Details
Recommendations
Reviews
Times Cited
External Links
This feature requires javascript
Actions
Add to My Research
Remove from My Research
E-mail
Print
Permalink
Citation
EasyBib
EndNote
RefWorks
Delicious
Export RIS
Export BibTeX
This feature requires javascript
Title:
Foundation Models for Natural Language Processing: Pre-trained Language Models Integrating Media
Author:
Paaß, Gerhard
;
Giesselbach, Sven
Subjects:
Artificial intelligence
;
Attention Models
;
BERT
;
Book Industry Communication
;
Chatbot
;
Computational linguistics
;
Computer science
;
Computing & information technology
;
Deep Learning
;
Expert systems / knowledge-based systems
;
Foundation Models
;
GPT
;
Information Extraction
;
Language
;
linguistics
;
Machine learning
;
Multilingual Models
;
Natural
language
& machine translation
;
Natural
Language
Generation
;
Natural
Language
Processing
;
Natural
Language
Understanding
;
Pre-trained
Language
Models
;
Text Generation
;
Transformer Models
Description:
This open access book provides a comprehensive overview of the state of the art in research and applications of Foundation Models and is intended for readers familiar with basic Natural Language Processing (NLP) concepts. Over the recent years, a revolutionary new paradigm has been developed for training models for NLP. These models are first pre-trained on large collections of text documents to acquire general syntactic knowledge and semantic information. Then, they are fine-tuned for specific tasks, which they can often solve with superhuman accuracy. When the models are large enough, they can be instructed by prompts to solve new tasks without any fine-tuning. Moreover, they can be applied to a wide range of different media and problem domains, ranging from image and video processing to robot control learning. Because they provide a blueprint for solving many tasks in artificial intelligence, they have been called Foundation Models. After a brief introduction to basic NLP models the main pre-trained language models BERT, GPT and sequence-to-sequence transformer are described, as well as the concepts of self-attention and context-sensitive embedding. Then, different approaches to improving these models are discussed, such as expanding the pre-training criteria, increasing the length of input texts, or including extra knowledge. An overview of the best-performing models for about twenty application areas is then presented, e.g., question answering, translation, story generation, dialog systems, generating images from text, etc. For each application area, the strengths and weaknesses of current models are discussed, and an outlook on further developments is given. In addition, links are provided to freely available program code. A concluding chapter summarizes the economic opportunities, mitigation of risks, and potential developments of AI.
Related Titles:
Artificial Intelligence: Foundations, Theory, and Algorithms
Publisher:
Cham: Springer Nature
Creation Date:
2023
Format:
436
Language:
English
Identifier:
ISBN: 3031231899
ISBN: 9783031231902
ISBN: 9783031231896
ISBN: 3031231902
DOI: 10.1007/978-3-031-23190-2
Source:
OAPEN
This feature requires javascript
This feature requires javascript
Back to results list
This feature requires javascript
This feature requires javascript
Searching Remote Databases, Please Wait
Searching for
in
scope:(TDTS),scope:(SFX),scope:(TDT),scope:(SEN),primo_central_multiple_fe
Show me what you have so far
This feature requires javascript
This feature requires javascript