In human-centered AI, UX and software roles are evolving

Software development has long demanded the skills of two types of experts. There are those interested in how a user interacts with an application. And those who write the code that makes it work. The boundary between the user experience (UX) designer and the software engineer are well established. But the advent of “human-centered artificial intelligence” is challenging traditional design paradigms. “UX designers use their understanding of human behavior and usability principles to design graphical user interfaces. But AI is changing what interfaces look like and how they operate, a research professor at the Stanford Graduate School of Education and a faculty fellow of the Stanford Institute for Human-Centered Artificial Intelligence (HAI). In a new preprint paper and three colleagues from the University of Michigan show how this boundary is shifting and have developed recommendations for ways the two can communicate in the age of AI.  They call their recommendations “desirable leaky abstractions.” Leaky abstractions are practical steps and documentation that the two disciplines can use to convey the nitty-gritty “low-level” details of their vision in language the other can understand. “Using these tools, the disciplines leak key information back and forth across what was once an impermeable boundary,”
Less is not always more
As an example of the challenges presented by AI, facial recognition used to unlock phones. Once, the unlock interface was easy to describe. User swipes. Keypad appears. User enters the passcode. Application authenticates. User gains access to the phone. With AI-inspired facial recognition, however, UX design begins to go deeper than the interface into the AI itself. Designers must think about things they’ve never had to before, like the training data or the way the algorithm is trained. Designers are finding it hard to understand AI capabilities, to describe how things should work in an ideal world, and to build prototype interfaces. Engineers, in turn, are finding they can no longer build software to exact specifications. For instance, engineers often consider training data as a non-technical specification. That is, training data is someone else’s responsibility. “Engineers and designers have different priorities and incentives, which creates a lot of friction between the two fields, Leaky abstractions are helping to ease that friction.”
Radical reinvention
In their research and colleagues interviewed 21 application design professionals UX researchers, AI engineers, data scientists, and product managers across 14 organizations to conceptualize how professional collaborations are evolving to meet the challenges of the age of artificial intelligence.  The researchers lay out several leaky abstractions for UX professionals and software engineers to share information. For the UX designers, suggestions include things like the sharing of qualitative codebooks to communicating user needs in the annotation of training data. Designers can also storyboard ideal user interactions and desired AI model behavior. Alternatively, they could record user testing to provide examples of faulty AI behavior to aid iterative interface design. They also suggest that engineers be invited to participate in user testing, a practice not common in traditional software development. For engineers, the co-authors recommended leaky abstractions, including compiling of computational notebooks of data characteristics, providing visual dashboards that establish AI and end-user performance expectations, creating spreadsheets of AI outputs to aid prototyping and “exposing” the various “knobs” available to designers that they can use to fine-tune algorithm parameters, among others. The authors’ main recommendation, however, is for these collaborating parties to postpone committing to design specifications if possible. The two disciplines must fit together like pieces of a jigsaw puzzle. Fewer complexities mean an easier fit. It takes time to polish those rough edges.
In software development, there is sometimes a misalignment of needs, Instead, if I, the engineer, create an initial version of my puzzle piece and you, the UX designer, create yours, we can work together to address misalignment over multiple iterations, before establishing the specifics of the design. Then, only when the pieces finally fit, do we solidify the application specifications at the last moment.”
In all cases, the historic boundary between engineer and designer is the enemy of good human-centered design and leaky abstractions can penetrate that boundary without rewriting the rules altogether.

See More

IT Modernization

10 Steps for Legacy IT Modernization Success

IT Modernization Success Although the thought of mainframe migration can be intimidating, it is a crucial step that businesses must

AI

Accelerating AI for Growth – Infrastructure Plays a Key Role

Businesses all over the world have realised how important artificial intelligence (AI) is to driving change and company expansion. Many

Edge Computing

Here’s Why Edge Computing Will Perfectly Size Its Role in 2023

With edge computing, it has always been possible to leverage “big data” (a term we now hardly ever hear) more

security

The 7 key trends for the security industry in 2023

In recent years, the physical security sector has seen significant change. In this constantly changing business, cutting-edge technology advancements and

See More Blogs

HIX.AI Announces Major Product Pivot to AI Search Engine, Rivaling Perplexity

SINGAPORE, July 15, 2024 /PRNewswire/ — HIX.AI, a leading innovative solution provider in the artificial intelligence field, today announced a fundamental shift

theinfotech.info

Machine Learning Helps Differentiate Compostable from Conventional Plastic Trash with “Very Good” Accuracy

Compostable plastics are becoming more popular, and while they have many advantages, some of these items, such as wrappers and

Big Data in B2B Business

Key takeaways Big data analytics gathers masses of data from numerous sources and uses it to enhance customer service and

theinfotech

Programming Languages

Definition of programming A computer program is made up of code that is run by the computer to carry out

theinfotech

Overview of Software System

WHAT IS SOFTWARE? Software is a collection of instructions, data, or computer programs used to run computers and carry out