[go: up one dir, main page]

Quek, 2004 - Google Patents

The catchment feature model: A device for multimodal fusion and a bridge between signal and sense

Quek, 2004

View PDF @Full View
Document ID
5350446022200116477
Author
Quek F
Publication year
Publication venue
EURASIP Journal on Advances in Signal Processing

External Links

Snippet

The catchment feature model addresses two questions in the field of multimodal interaction: how we bridge video and audio processing with the realities of human multimodal communication, and how information from the different modes may be fused. We argue from …
Continue reading at link.springer.com (PDF) (other versions)

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06K—RECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00—Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00335—Recognising movements or behaviour, e.g. recognition of gestures, dynamic facial expressions; Lip-reading
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/08—Speech classification or search
    • G10L15/18—Speech classification or search using natural language modelling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06K—RECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00—Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00221—Acquiring or recognising human faces, facial parts, facial sketches, facial expressions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06K—RECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00—Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/62—Methods or arrangements for recognition using electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/20—Handling natural language data
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00—Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001—Teaching or communicating with blind persons

Similar Documents

Publication Publication Date Title
US20240070405A1 (en) Computer vision based sign language interpreter
Oviatt Multimodal interfaces
Balomenos et al. Emotion analysis in man-machine interaction systems
Morency et al. Contextual recognition of head gestures
Quek et al. Multimodal human discourse: gesture and speech
Hong et al. Real-time speech-driven face animation with expressions using neural networks
Wu et al. Survey on audiovisual emotion recognition: databases, features, and data fusion strategies
Bauer et al. Towards an automatic sign language recognition system using subunits
Sharma et al. Speech-gesture driven multimodal interfaces for crisis management
US8224652B2 (en) Speech and text driven HMM-based body animation synthesis
Shahbazian Multimodal input fusion in human-computer interaction
Turk et al. Perceptual interfaces
Pitsikalis et al. Multimodal gesture recognition via multiple hypotheses rescoring
Quek The catchment feature model: A device for multimodal fusion and a bridge between signal and sense
Jebali et al. Extension of hidden markov model for recognizing large vocabulary of sign language
Ravanbakhsh et al. Perturbed message passing for constraint satisfaction problems
D’Ulizia Exploring multimodal input fusion strategies
Wazalwar et al. Multimodal Interface for deaf and dumb communication
Karpouzis et al. Facial expression and gesture analysis for emotionally-rich man-machine interaction
Lücking et al. Framing multimodal technical communication
Argyropoulos et al. Multimodal user interface for the communication of the disabled
Pentland Perceptual intelligence
Vogler et al. Toward computational understanding of sign language
Vidalón et al. Continuous sign recognition of brazilian sign language in a healthcare setting
Courty et al. Why is the creation of a virtual signer challenging computer animation?