Multimodal Collaborative Painting Application Design for Children with Autism

Zhang Aijia
Huang Guanghui
Ph.D in Design
Theory and Practice of Art Design
2024-03-01
Color
Application Design
Painting Wonderland application is a multimodal, collaborative painting therapy tool designed for children with autism. It is based on a theoretical framework that synthesizes Applied Behavior Analysis, the Fogg Behavior Model, and Collaborative Learning Theory. The app leverages artificial intelligence and multimodal data to support therapists in dynamically modifying behaviors through a "screening—intervention—feedback—rescreening" process. During the painting process, AI image generation technology enhances engagement through positive feedback mechanisms, while facial recognition technology and professional scales precisely assess children's conditions. The app also features modes for parents and doctors collaboratively facilitate the child's development.
  • Multimodal Collaborative Painting Application Design Theory for Children with Autism This design is mainly based on a multi-dimensional theoretical framework jointly constructed by applied behavior analysis, Fogg behavioral model and synergy theory. Through the integration of interdisciplinary theories, effective applications can be more comprehensively designed to promote special training and improve behavior of children with autism.
  • Multimodal Collaborative Painting Application Design Practice for Children with Autism The "Painting Healing Land" app is the first painting-based rehabilitation intervention tool for children with autism. Specifically, it contains three main functional structures. The first is the special training function targeted at the characteristics of autism. The second is real-time accurate feedback and screening functions. The third is to realize digital dynamic treatment that connects families.