Course Name:Multi-modal Human-computer Interaction

Course Code: S2293225

Semester: 5

Credit: 2

Program: Computer science

Course Module: Optional

Responsible: Jianrong Wang

E-mail: wjr@tju.edu.cn

Department: Tianjin International Engineering Institute

Time Allocation(1 credit hour = 45 minutes)

Course Description

The course is optional designed for Engineering Master of Computer Science in TIEI. Human–computer interaction (HCI) focuses on the design and use of computer technology, focusing particularly on the interfaces between users and computers. A basic precept of HCI is that users should be able to focus on solving problems, rather than dealing with the intricacies of complex software. This course includes the following topics: the basic theory of HCI, user-centred design research and usability evaluation methods. In addition, the course reviews emerging areas of HCI research, including augmented-reality and tangible user interfaces. Students will have a preliminary and extensive understanding about multimodal human-computer interaction, which enables students to improve the design of interactive systems.

Prerequisite

• Statistics: mathematical foundation

• Programming fundamental: programming skills

Course Objectives

The purpose of this course is to enable students to understand the basic theory of multimodal human-computer interaction and improve the design of interactive systems. After this course, students should be able to:

• Understand the history of contemporary user interfaces,

• Propose design approaches that are suitable to different classes of user and application

• Identify appropriate techniques for analysis and critique of user interfaces, and to

• Be able to design and undertake quantitative and qualitative studies in order to improve the design of interactive systems.

CourseSyllabus

• The scope and challenges of HCI and Interaction Design

• Visual representation: modes of correspondence

• Text and gesture interaction: evolution of interaction hardware, measurement and assessment of novel methods

• Inference-based approaches: Bayesian strategies

• Augmented reality and tangible user interfaces: machine vision, fiducial markers, mixed reality

• Usability of programming languages: end-user programming, cognitive dimensions of notations

• User-centred design research: contextual observation, prototyping

• Usability evaluation methods: formative methods, empirical measures

Textbooks & References

• Jacko J A, Sears A.The Human-Computer Interaction Handbook. 2003.

• Dix A.Human-computer interaction. Springer US, 2009.

• Grifoni J P.Multimodal Human Computer Interaction and Pervasive Services. IGI Global, 2009.

• Thiran J P, Marques F and Bourlard H.Multimodal Signal Processing: Theory and Applications for Human Computer Interactio.Elsevier, 2010.

Capability Tasks

CT1: To able to analyze and synthesize relevant knowledge by learning multimodal human-computer interaction.

CT2: To understand the basic concepts and relations of multimodal human-computer interaction; To grasp the concept and application of different methods.

CT11: The ability to evaluate themselves, master their abilities, and choice career.

CS1: To master the basic theoretical knowledge of multimodal human-computer interaction; Understand the current situation and development trend of multimodal human-computer interaction.

CS2: To grasp core knowledge of multimodal human-computer interaction and related knowledge of engineering technology, and to be able to apply core knowledge and knowledge of engineering technology to system development.

Achievements

• To understand the significance of historical case studies. - Level: A

• To develop practical user interface design skills. - Level: M

• To master the basic theory of HCI and user-centred design research. - Level: M

• To grasp augmented-reality and tangible user interfaces. - Level: M

• To know about future directions in HCI. - Level: A

Students: Computer science,Year 3