Tutorials
The role of the tutorials is to provide a platform for a more intensive scientific exchange amongst researchers interested in a particular topic and as a meeting point for the community. Tutorials complement the depth-oriented technical sessions by providing participants with broad overviews of emerging fields. A tutorial can be scheduled for 1.5 or 3 hours.
Tutorial on
High-level Interaction Design with Discourse Models for Automated GUI Generation
Instructor
|
Hermann Kaindl
TU Wien, Univ. for Continuing Education Krems, Vienna Univ. of Economics and Business
Austria
|
|
|
|
Brief Bio
Hermann Kaindl joined the Institute of Computer Technology at TU Wien in early 2003 as a full professor, where he served in this position until September 2022, for several years as the department head and the head of the organizational unit entitled “Software-intensive Systems”. He served for several years as a member of the Senate at TU Wien, from October 2019 until September 2022 as a Vice Chairman. After his retirement, Hermann Kaindl is still working on (funded) research projects at three different universities. Prior to moving to academia, he was a senior consultant with the division of program and systems engineering at Siemens AG Austria. There he has gained more than 24 years of industrial experience in requirements and software engineering, human-computer interaction and artificial intelligence. He is a Senior Member of the IEEE and a Distinguished Scientist member of the ACM.
|
Abstract
Since manual creation of user interfaces is hard and expensive, automated generation may become more and more important in the future. Instead of generating UIs from simple abstractions, transforming them from high-level models should be more attractive. In particular, we let an interaction designer model discourses in the sense of dialogues (supported by a tool), inspired by human-human communication. This tutorial informs about our approach, both about its advantages and its challenges (e.g., in terms of usability of generated UIs). In particular, our unique approach to optimization for a given device (e.g., a Smartphone) that applies Artificial Intelligence (AI) techniques will be high-lighted, as well as the techniques based on ontologies for automated GUI generation and customiza¬tion. We also address low-vision accessibility of Web-pages, by combining automated design-time generation of Web-pages with responsive design for improving accessibility.
Keywords
Interaction design; discourse models; task models; automat¬ed GUI generation, customization, low-vision accessibility of Web-pages.
Aims and Learning Objectives
In this tutorial, participants will learn about an open and fully implemented approach to GUI generation from mod¬els at the highest level of the Cameleon Reference Frame¬work, i.e., the Tasks & Concepts Level. These models focus on the specifi¬cation of (classes of) dialogues in contrast to tasks for modeling activities that can be performed by the user or the application (system). Participants will understand a duality of these ap¬proaches. In particular, they will also get an overview of both automatically generating and customiz¬ing GUIs. Finally, participants will see potential use of such an approach for improving accessibility.
Target Audience
This tutorial is of particular interest for user-interface designers, interaction designers, Web designers, or software engineers who need to provide GUIs but are not experts in GUI design themselves. Also educators can benefit from this tutorial.
Prerequisite Knowledge of Audience
The assumed attendee background is some familiarity with usage scenarios as well as interest in interaction design. There are no pre-requisites such as knowledge about Human-Computer Interaction in general.
Detailed Outline
Background
- Interaction design
- Task-based modeling
- Speech acts
- Conversation Analysis
- Model-driven transformation
Interaction design based on discourse modeling
- Discourse example
- Communicative Acts
- Adjacency Pair
- RST relations
- Exercise: Understand given model
- Duality of Task- and Discourse-based Design
GUI Generation
- Process of user-interface generation
- Generation of Structural UI Model
- Generation of Behavioral UI Model
- Weaving of structural and behavioral models
- Optimization for tailoring to device
- Examples of generated user interfaces
- Unified Communication Platform
Customization
- Custom rules
- Custom widgets
Improving Low-vision Accessibility
- Combination with Responsive Design
- Accessibility evaluation
Conclusion