SIMILAR Dreams

A European vision of multimodal interfaces in our future life
Première édition

Édité par Similar

This book presents the SIMILAR European research consortium in the field, the work under way and the great challenges posed by the development of the future multimodal interfaces. Lire la suite

Research has for many years concentrated on unimodal systems for human-computer interaction. Now, research systems are combining several input and output modalities, as in talking heads, in-car applications and games using computer vision, voice inpu


Livre broché - En anglais 50,00 €
Info Les commandes en ligne se font via notre partenaire i6doc.

Spécifications


Éditeur
Presses universitaires de Louvain
Édité par
Similar,
Collection
SIMILAR
Langue
anglais
Catégorie (éditeur)
Sciences appliquées > Informatique
BISAC Subject Heading
COM000000 COMPUTERS
Code publique Onix
06 Professionnel et académique
CLIL (Version 2013-2019 )
3238 Réseaux et Télécommunications
Date de première publication du titre
01 janvier 2005
Subject Scheme Identifier Code
Classification thématique Thema: Technologie des communications / télécommunications
Type d'ouvrage
Monographie

Livre broché


Date de publication
2005
ISBN-13
978-2-93034-491-1
Ampleur
Nombre de pages de contenu principal : 352
Code interne
72040
Format
21 x 29,7 x 2 cm
Poids
915 grammes
Prix
50,00 €
ONIX XML
Version 2.1, Version 3

Google Livres Aperçu


Publier un commentaire sur cet ouvrage

Si vous avez une question, utilisez plutôt notre formulaire de contact

Sommaire


ACKNOWLEDGEMENT................................................................... 7

TABLE OF CONTENTS .................................................................... 9

CHAPTER 1: INTRODUCTION..................................................... 19

1.1. SIMILAR.................................................................................. 19

1.2. COMPUTER ASSISTED HUMAN ACTIVITIES ................................ 20

1.2.1. Image-guided surgery ....................................................... 22

1.2.2. Large Information Space visualization ............................. 23

1.2.3. Trans-modality for handicapped persons and car drivers 24

1.2.4. Edutainment ...................................................................... 25

1.3. SIMILAR PLATFORMS AND METHODOLOGY............................ 25

CHAPTER 2: FUSION AND FISSION........................................... 29

2.1. AUTHORS .................................................................................. 29

2.2. INTRODUCTION ......................................................................... 30

2.3. FUSION AND FISSION AT THE SIGNAL LEVEL............................. 31

2.3.1. SP for Human multimodal signals fusion-fission .............. 31

2.3.2. Fusion-fission in medical applications ............................. 33

2.3.3. Towards a Theoretical Framework................................... 35

2.3.4. Multimodal communications and distributed coding........ 36

2.4. FUSION AND FISSION FOR DESIGNING HCI................................ 36

2.4.1. Design of multimodal interaction and Fusion-Fission ..... 37

2.4.2. Context aware fusion and fission ...................................... 40

2.4.3. Fusion and fission in Natural Interaction Systems ........... 41

CHAPTER 3: OPENINTERFACE.................................................. 43

3.1. INTRODUCTION ......................................................................... 43

3.2. STATE OF THE ART: SOFTWARE PLATFORMS ............................ 44

3.2.1. Multimodal data fusion ..................................................... 44

3.2.2. Software Engineering: Component-based platforms ....... 45

3.2.3. Existing platforms/framework ........................................... 46

3.2.4. Conclusions: Component-based platforms........................ 49

3.3. GOALS....................................................................................... 50

3.4. FEATURES ................................................................................. 51

3.5. CONCEPTUAL ARCHITECTURE PROPOSAL ................................. 51

3.6. HOW IT WORKS.......................................................................... 53

3.7. EDITOR...................................................................................... 53

3.8. FUSION AND FISSIONMECHANISMS.......................................... 55

3.9. USERS........................................................................................ 58

3.10. POTENTIAL APPLICATIONS ...................................................... 58

3.11. CONCLUSIONS ......................................................................... 59

3.12. REFERENCES ........................................................................... 59

3.12.1. State-of-the-art ................................................................ 59

3.12.2. OpenInterface.................................................................. 61

CHAPTER 4: MEDICAL APPLICATIONS .................................. 63

4.1. INTRODUCTION ......................................................................... 63

4.2.MEDICAL STUDIO FRAMEWORK ............................................... 64

4.2.1. Platform Architecture........................................................ 64

4.2.2. GENERAL PURPOSE COMPONENTS............................ 67

4.2.3. PROCEDURE-SPECIFIC SCENARIOS........................... 69

4.3. OMICS DATA SUPPORT............................................................ 73

4.4. REFERENCES ............................................................................. 75

CHAPTER 5: BUILDING USABLE MULTIMODAL NIS .......... 77

5.1. INTRODUCTION ......................................................................... 77

5.2. STATE OF THE ART IN BRIEF ..................................................... 79

5.3. THE SIMILAR USABILITY SIG APPROACH.............................. 83

5.3.1. General objectives in brief ................................................ 83

5.3.2. A bottom-up approach....................................................... 85

5.4. APPLICATION DESCRIPTION STRUCTURE.................................. 86

5.4.1. Introduction....................................................................... 87

5.4.2. Application description ..................................................... 87

5.4.3. Technical issues................................................................. 91

5.4.4. Functionality ..................................................................... 94

5.4.5. Interface and usability....................................................... 97

5.4.6. Evaluation ....................................................................... 100

5.4.7. Conclusions..................................................................... 102

5.4.8. References ....................................................................... 103

5.5. NEXT STEPS ............................................................................ 103

5.6. REFERENCES ........................................................................... 105

CHAPTER 6: MULTIMODAL INTERFACES FOR PEOPLE WITH DISABILITIES.... 107

6.1. INTRODUCTION ....................................................................... 107

6.2.MODALITY REPLACEMENT IN MULTIMODAL INTERFACES .... 110

6.2.1. Multimodal Interfaces ..................................................... 110

6.2.2. Modality Replacement..................................................... 110

6.3.MAIN RESEARCH AREAS WITHIN SIMILAR .......................... 112

6.3.1. Haptic Applications for the Blind ................................... 113

6.3.2. Haptic Tool to Access Presentations............................... 113

6.3.3. Virtual Interactive Training Environments for the Blind 117

6.3.4. Sign Language Analysis .................................................. 120

6.3.5. Sign Language Synthesis................................................. 123

6.3.6. Cued Speech Recognition................................................ 125

6.4. THE DREAM SCENARIO............................................................ 126

6.5. CONCLUSIONS......................................................................... 128

6.6. REFERENCES ........................................................................... 129

CHAPTER 7: MIGRATORY MULTIMODAL UI...................... 133

7.1. PROCESS.................................................................................. 134

7.2. ARCHITECTURE....................................................................... 136

7.3. HIIS PROFILE .......................................................................... 138

CHAPTER 8: SIMILAR WORK ’04............................................. 143

1.1 INTEGRATION THROUGH ENTERFACE................................... 144

1.2 INTEGRATION THROUGH EXCHANGES AND TWINNINGS .......... 146

1.3 PUBLIC AWARENESS THROUGH SIMILAR WEBSITE................ 148

1.4 PUBLIC AWARENESS THROUGH THE SIMILAR NEWSLETTER . 149

1.5 PUBLIC AWARENESS THROUGH CONFERENCES........................ 150

1.6 PUBLIC AWARENESS THROUGH BOOKS AND PAPERS ............... 153

1.7 PUBLIC AWARENESS THROUGH BEST SUMMER SCHOOL........ 154

1.8 PUBLIC AWARENESS THROUGH A SOFTWARE CONTEST........... 155

1.9 SIG ON INFORMATION FUSION AND FISSION ............................ 157

Multimodal sources representation in a HCI context ............... 157

1.10 SIG ON USABILITY................................................................. 159

1.11 SIG ON CONTEXT AWARE ADAPTATION................................. 160

1.12 SIG ON MULTIMODAL ANALYSIS AND SYNTHESIS ................. 162

1.13 SIG ON MEDICAL APPLICATIONS............................................ 163

1.14 SIG ON DISABILITY APPLICATIONS ........................................ 164

1.15 SIG ON EDUTAINMENT APPLICATIONS................................... 165

Virtual sculpturing .................................................................... 166

Artistic performance using 3D Body Tracking.......................... 167

Pointing interaction................................................................... 168

Multimodal Speaker Identification............................................ 170

Surveillance and assistance in learning environments ............. 170

1.16 COMMUNICATION BETWEEN PARTNERS................................. 171

1.17 SUBMISSION OF EUROPEAN RESEARCH PROJECTS ................. 173

CHAPTER 9: INTRODUCTION................................................... 177

9.1. THE “10-10-10”....................................................................... 177

9.2. INTERVIEWS ............................................................................ 178

CHAPTER 10: TEN MAJOR ACHIEVEMENTS ....................... 179

10.1. RELIABILITY-ORDERED CASCADE......................................... 179

10.2.MUTUAL INFORMATION IN MULTIMODAL SP........................ 180

10.2.1. Mutual information ....................................................... 180

10.2.2. Mutual information in multimodal signal processing ... 181

10.3.MULTIMODAL EMOTION DETECTION .................................... 182

10.3.1. Introduction................................................................... 182

10.3.2. Achievements................................................................. 183

10.3.3. Future research work .................................................... 184

10.4.MULTIMODAL BIOMETRICS................................................... 184

10.4.1. Introduction................................................................... 184

10.4.2. Different Fusion Strategies ........................................... 185

10.5.MULTIMODAL MEDICAL IMAGE REGISTRATION.................... 188

10.5.1. Image registration ......................................................... 188

10.5.2. Multimodal medical image registration ........................ 189

10.6. ICARE .................................................................................. 190

10.6.1. Introduction: The CARE properties ............................. 190

10.6.2. ICARE: What is it?....................................................... 192

10.6.3. Elementary Components ............................................... 194

10.6.4. Composition Components ............................................. 195

10.6.5. ICARE Platform ............................................................ 197

10.7. CAMELEON............................................................................ 199

10.8.MODALITY THEORY.............................................................. 202

10.8.1. MULTIMODALITY ....................................................... 206

10.9. USIXML................................................................................ 208

10.10. AMODEUS MODEL FOR DIALOGUE CONTROLLER............. 211

10.11. REFERENCES ....................................................................... 213

Reliability ordered cascade....................................................... 213

Multimodal emotion detection (prosody + facial) .................... 214

Mutual information in multimodal SP....................................... 214

Multimodal biometrics .............................................................. 214

Multimodal medical image registration.................................... 214

ICARE ....................................................................................... 214

CAMELEON.............................................................................. 215

Modality theory ......................................................................... 216

UsiXML ..................................................................................... 216

AMODEUS................................................................................ 216

CHAPTER 11: 10 MAJOR PRACTICAL OUTCOMES............ 217

11.1. IMMERSIVE ENVIRONMENT................................................... 217

11.1.1. Introduction................................................................... 217

11.1.2. The CAVE...................................................................... 218

11.1.3. Other immersive platforms............................................ 218

11.2. AIRPLANE COCKPIT............................................................... 219

11.3. CAR APPLICATION................................................................. 220

11.4. VTK-ITK MULTIMODAL MEDICAL IMAGING PLATFORMS.... 221

11.4.1. The Visualization ToolKit (VTK) .................................. 221

11.4.2. The Segmentation & Registration ToolKit (ITK) .......... 222

11.4.3. Multimodal platforms.................................................... 224

11.5. AUGMENTED REALITY IN SURGERY...................................... 226

11.5.1. Augmented reality ......................................................... 226

11.5.2. AR and surgery................. ............................................ 226

11.6.MULTIMODAL MOBILE AUGMENTED REALITY...................... 227

11.6.1. Definition....................................................................... 227

11.6.2. Applications................................................................... 228

11.7. NICE DEMO........................................................................... 229

11.7.1. The NICE Project .......................................................... 230

11.7.2. The Multimodal Scenario .............................................. 230

11.8. FAME: CONTEXT-AWARE DISTRIBUTED USER INTERFACES 232

11.8.1. What is it?...................................................................... 232

11.8.2. How does it work?......................................................... 232

11.8.3. What is it used for?........................................................ 233

11.9. CONCURTASKTREES............................................................. 234

11.9.1. What is it?...................................................................... 234

11.9.2. Applications................................................................... 236

11.10. GRAFIXML......................................................................... 237

11.11. REFERENCES ....................................................................... 238

Immersive environment ............................................................. 238

Airplane cockpit ........................................................................ 238

Car applications........................................................................ 239

VTK-ITK platforms for 3D multimodal medical imaging ......... 239

Augmented reality in surgical operating theatres ..................... 239

Multimodal mobile augmented reality ...................................... 239

NICE demo ................................................................................ 240

FAME........................................................................................ 240

ConcurTaskTree ........................................................................ 240

GrafiXML .................................................................................. 240

CHAPTER 12: 10 MAJOR CHALLENGES ................................ 241

12.1. SOCIAL INTERACTIONS.......................................................... 241

12.2. SOFTWARE ARCHITECTURE REFERENCE MODEL .................. 242

12.3.MIX OF ARCHITECTURAL STYLES.......................................... 243

12.4. SOFTWARE COMPONENT DESCRIPTION ................................. 243

12.5. POLYMORPHIC USER INTERFACES......................................... 243

12.6. GENERICNESS OF MODEL, METHODS, AND TOOLS................. 243

12.7. SCALABILITY......................................................................... 244

12.8. REFERENCE GLOSSARY......................................................... 244

12.9. GENERIC CONTACTLESS MULTIMODAL INTERFACES ............ 246

12.10. SECURITY/PRIVACY IN CONTEXT-SENSITIVE MULTIMODAL APPLICATIONS.......... 246

12.11. REFERENCES ....................................................................... 247

CHAPTER 13: INTERVIEWING ................................................. 249

13.1. QUESTIONNAIRE ................................................................... 249

13.2. INDUSTRY ............................................................................. 250

13.2.1. Xavier Marichal (Alterface, Belgium)........................... 250

13.2.2. Frederic Kaplan (Sony, France) ................................... 252

13.2.3. Stéphane Chatty and Stéphane Sire (Intuilab, France). 253

13.2.4. Robin Springer (Computer Talk, USA) ......................... 261

13.3. ACADEMICS .......................................................................... 269

13.3.1. Human-Computer Interaction....................................... 269

13.3.2. Context-aware adaptation............................................. 273

13.3.3. Usability ........................................................................ 275

13.3.4. Information fusion & fission ......................................... 285

13.3.5. Edutainment .................................................................. 298

13.3.6. Medical.......................................................................... 304

GLOSSARY ..................................................................................... 313

FLAGS. ........................................................................................... 313

TERMS AND DEFINITIONS............................................................... 313

REFERENCES.................................................................................. 346


Extrait


Texte intégral en PDF à télécharger gratuitement