Can generative AI become the spark that ignites a new wave of creativity in UX design, or does true innovation still lie within the realm of human intuition?
The user experience (UX) design industry stands at the cusp of a revolutionary shift, driven by the increasing integration of generative AI technologies. Once confined to the realm of possibility, AI is now geared to make its mark as a transformative force in design.
Popular tools like Figma’s “First Draft” are enabling designers to generate initial concepts rapidly, expediting the ideation process and opening up new possibilities. Meanwhile, platforms such as Coframe are using AI to optimize websites in real time, delivering personalized user experiences that drive engagement.
But what if AI could do more than just optimize workflows? What if it could become a source of inspiration for UX designers, triggering new creative ideas and pushing the boundaries of traditional design?
This question lies at the heart of a recent study by researchers at University of Cologne, Vorarlberg University of Applied Sciences, and the University of Liechtenstein, who explore how AI can serve as a muse in the UX design process.
Exploring AI as a ‘Muse’ in UX Design
(Image: Ideogram AI.)
The research investigates three major approaches through which AI can enhance the creative process for UX designers. These approaches offer designers not only tools to streamline their work, but also to spark new ideas and expand their creative horizons.
One approach involves Large Language Models (LLMs), like GPT, which help designers rapidly generate and refine ideas for user interface (UI) designs. These tools speed up ideation by suggesting text-based concepts that can be developed further, making them particularly useful in the early stages of design when quick brainstorming is crucial.
Unlike traditional search methods that rely on keywords, Vision-Language Models (VLMs) understand both images and text, allowing designers to communicate with AI in a more intuitive way. This capability transforms how designers seek inspiration, moving beyond rigid search terms to more fluid, natural interactions. The second approach explored in the study leverages VLMs to help designers search vast collections of UI screenshots by simply describing what they need. This opens a world of creative possibilities, allowing them to uncover patterns, draw from existing designs, and refine their ideas with greater ease.
The third approach uses Diffusion Models (DMs), which generate UI visuals directly from text descriptions. These models offer diverse design options, making them ideal for conceptual exploration and early-stage ideation. Designers can use DMs to quickly visualize different layouts, styles, and themes without manually sketching or prototyping from scratch. This approach is particularly valuable when brainstorming novel UI elements, experimenting with unconventional design languages, or seeking inspiration outside familiar patterns.
The research, titled “On AI-Inspired UI Design,” is published in the journal IEEE Xplore.
AI is revolutionising industries and ways of working – and UX is no exception. With UI design patterns being mature now, UI frameworks allow for generative AI to do the heavy lifting for cookie-cutter sites and applications. But core skills like creative problem solving and bespoke app design are less likely to be covered by AI – leaving a clear space for UX consulting as a discipline – with AI efficiencies built in.
How Far Can AI Take UX Design?
(Image: Ideogram AI.)
As generative AI continues to evolve, its role in UX design is becoming impossible to ignore. What was once a manual, iterative process is now being augmented by AI-powered tools that not only accelerate workflows but also expand the creative potential of designers. The research highlights how LLMs, VLMs, and DMs can serve as more than just efficiency boosters—they can act as catalysts for inspiration, helping designers push past conventional boundaries and explore new design frontiers.
The future of UX design will not be dictated by AI alone, but by how designers choose to wield it. Whether used to streamline ideation, uncover new visual possibilities, or generate entirely novel interfaces, AI is expanding the boundaries of what’s possible in design. The question is no longer whether AI can inspire UX design—but how far designers are willing to let it take them.
