Home      Log In      Contacts      FAQs      INSTICC Portal


The role of the tutorials is to provide a platform for a more intensive scientific exchange amongst researchers interested in a particular topic and as a meeting point for the community. Tutorials complement the depth-oriented technical sessions by providing participants with broad overviews of emerging fields. A tutorial can be scheduled for 1.5 or 3 hours.

Tutorial on
High-level Interaction Design with Discourse Models for Automated GUI Generation


Hermann Kaindl
TU Wien
Brief Bio
Hermann Kaindl is the head of the organizational unit entitled “Software-intensive Systems” of the Institute of Computer Technology and a Vice Chairman of the Senate at TU Wien. He joined this institute in early 2003 as a full professor. Prior to moving to academia, he was a senior consultant with the division of program and systems engineering at Siemens AG Austria. There he has gained more than 24 years of industrial experience in requirements and software engineering, human-computer interaction and artificial intelligence. He is a Senior Member of the IEEE and a Distinguished Scientist member of the ACM.

Since manual creation of user interfaces is hard and expensive, automated generation may become more and more important in the future. Instead of generating UIs from simple abstractions, transforming them from high-level models should be more attractive. In particular, we let an interaction designer model discourses in the sense of dialogues (supported by a tool), inspired by human-human communication. This tutorial informs about our approach, both about its advantages and its challenges (e.g., in terms of usability of generated UIs). In particular, our unique approach to optimization for a given device (e.g., a Smartphone) that applies Artificial Intelligence (AI) techniques will be high-lighted, as well as the techniques based on ontologies for automated GUI generation and customiza¬tion. We also address low-vision accessibility of Web-pages, by combining automated design-time generation of Web-pages with responsive design for improving accessibility.


Interaction design; discourse models; task models; automat¬ed GUI generation, customization, low-vision accessibility of Web-pages.

Aims and Learning Objectives

In this tutorial, participants will learn about an open and fully implemented approach to GUI generation from mod¬els at the highest level of the Cameleon Reference Frame¬work, i.e., the Tasks & Concepts Level. These models focus on the specifi¬cation of (classes of) dialogues in contrast to tasks for modeling activities that can be performed by the user or the application (system). Participants will understand a duality of these ap¬proaches. In particular, they will also get an overview of both automatically generating and customiz¬ing GUIs. Finally, participants will see potential use of such an approach for improving accessibility.

Target Audience

This tutorial is of particular interest for user-interface designers, interaction designers, Web designers, or software engineers who need to provide GUIs but are not experts in GUI design themselves. Also educators can benefit from this tutorial.

Prerequisite Knowledge of Audience

The assumed attendee background is some familiarity with usage scenarios as well as interest in interaction design. There are no pre-requisites such as knowledge about Human-Computer Interaction in general.

Detailed Outline

- Interaction design
- Task-based modeling
- Speech acts
- Conversation Analysis
- Model-driven transformation
Interaction design based on discourse modeling
- Discourse example
- Communicative Acts
- Adjacency Pair
- RST relations
- Exercise: Understand given model
- Duality of Task- and Discourse-based Design
GUI Generation
- Process of user-interface generation
- Generation of Structural UI Model
- Generation of Behavioral UI Model
- Weaving of structural and behavioral models
- Optimization for tailoring to device
- Examples of generated user interfaces
- Unified Communication Platform
- Custom rules
- Custom widgets
Improving Low-vision Accessibility
- Combination with Responsive Design
- Accessibility evaluation

Secretariat Contacts