History of HCI: Recap
- Input/Output devices
- The lesson
- Keyboards & terminals are just artifacts of today's technologies
- New input/output devices will change the way we interact with computers
Up-and-Coming Areas
- Gesture Recognition
- Multi-Media
- Mixed Reality
- Computer Supported Cooperative Work
- Natrual language and speech
The development
Multi-modal Interaction
Physiology any of the various types of sensaiton, such as vision or hearing.
多种感官
Pen-centric computing
- handwriting recognition
MSRA, Digital Ink
试图解决电子签名验证身份的问题
- HCI Lab, CAS
- Easy Editor
tilt menu: CHI2008
重要突破：引入了笔的倾斜角来做菜单选择
Music Fountain
帮助设计师设计音乐喷泉，通过笔的压感设置水流的强度，笔的角度设置水流的角度，并达到所见即所得
Voice Recognition
- MS SpeechSDK
- IBM ViaVoice
- Nuance
Hardware
出发点：云端的识别已经做的很好，但有两个问题，一个是网络限制，5G可能有所改变；另一个是安全问题
Gesture Language Recognition
难点：即使计算机可以知道做出了什么手势，但如何去解读是受人群影响->可能是没有完全解的问题
中科院计算所，CAS：做手语识别
数据手套->与微软合作
- CV-based
openCV
Gaze tracking
- 技术基本成熟
- 期望做：眼动控制；用眼选择物体
- Infants predict other people's action goals, Nature Neuroscience, 2006 目前很成功的成果，研究儿童对成人的眼动反应，探究人类从多大开始对外界有反应
Attentive UI
感知情境，帮助选择->难点：情境感知+AI->概念死亡
Biometrics
- iris palm lines, handwriting, gait, voice, face, DNA, etc.
BCI
- 直接用脑信号来解读->难点：难以获取脑信号，可能衍生伦理问题
- Brainball: Winning by relaxing
Haptic UI
- "For every action there is an equal and opposite reaction" 作用力与反作用力
- 非常重要的交互模式：目前为止唯一的双向通道，具有不同于视觉和听觉的重要特点
1995 NSFC Key program “多通道用户界面研究”
中国的起步
- Beijing Univ., Hangzhou Univ., Institute of Software, CAS
VR & 3D interaction
VR略过
Introduction to 3D UI
3D interaction: Human-computer interaction in which the user's tasks are performed directly in a 3D spatial context.
3D情境下即可归入3D交互
3D UI: A UI that involves 3D interaction.
Why 3D User Interfaces?
- 3D interaction is relevant to real world tasks
- The technology behind 3D Uis is becoming mature
- 3D interaction is difficult
- Current 3D Uis either are simple or lack usability
3D UI design is an area ripe for further work
目前还缺乏可用性
Ubiquitous computing
Smart space & Intelligent UI
- Smart City
- Facilities for aged
- Industry App
- Daily Life