Presentations on AI and XR at CHI 2025 in Yokohama

Lars Erik Holmquist and Sam Nemeth will be presenting the Late Breaking Work “Don’t believe anything I tell you, it’s all lies!”: A Synthetic Ethnography on Untruth in Large Language Models at CHI 2025,  the ACM SIGCHI conference on Human Factors in Computing Systems. CHI is the premier international conference of Human-Computer Interaction.

The short paper applies the new method synthetic ethnography to present three case studies of how Large Language Models (LLMs) present untruth. We observed the behaviour of different LLMs talking about verifiable facts, and found that when they reached the edge of their knowledge base, they just went on talking (what Hicks et al. called “bullshitting”). We believe that although it is problematic, this capacity to “fill in” is also part of what makes LLMs and other forms of generative AI so useful. However, currently the interfaces fail to give the user an understanding of the model’s limitations, and therefore we argue that LLMs should be designed so that they can “lie gracefully” – continuing to do what they do best, while making it possible for the user to work with them to avoid dangerous untruths.

Also at CHI, Lars Erik Holmquist will present the paper Liberated Pixels and Virtual Production: A Framework and a Test Case for XR Beyond Glasses at the workshop Beyond Glasses: Future Directions for XR Interactions within the Physical World. The paper argues that virtual production (such the VP studio as at NTU's new DaDA building) presents a perfect environment for developing novel extended reality (XR) applications, and proposes a new framework for XR beyond glasses, called Liberated Pixels. 

CHI 2025 takes place in Yokohama, Japan, at the PACIFICO Yokohama from 26 April to 1 May 2025, while also supporting remote attendance. Hope to see you there!

Seminar with Ollie Hanton: 3D Printing Interactive Devices

Time: April 10, 14.00-16.00
Place: Waverley 129

What shape is a screen and why do flat, rectangular interfaces limit the way we interact with digital information? Free-form interactive devices such as custom-fitted wearables, bespoke controllers and integrated interactive surfaces hold the potential to revolutionise environments including education, vehicular travel, workplaces and homes. However, manufacturing is limited to high quantity runs of identical devices and component-based fabrication is limited in form and quality. By harnessing 1) state-of-the-art active materials that can enable input and output and 2) additive manufacturing methods to enable automated deposition, the next step in manifesting interfaces is through decentralised production where makers can design and produce physical devices on-demand. 

Ollie Hanton is a lecturer (assistant professor) at the University of Bath. Before joining the University of Bath, he attained his Ph.D. from the University of Bristol, supervised by Professor Anne Roudaut and Professor Mike Faser. There he focused his research on the Personal Fabrication of Interactive Devices through spraying and 3D printing. Ollie publishes work at top HCI conferences (CHI, TEI) where he has received multiple awards for his research.

Seminar with Max Wilson: Brain Data as Cognitive Personal Informatics

Time: March 27, 14.00-16.00
Place: Waverley 129

Classifying the cognitive states of people, using physiological data is basically a machine learning problem now, whether its brain data, heart/breathing data, or off-body camera data. So what is the HCI question? For us, the question is how will this become mixed up in wearable tech and personal informatics. Especially since you can already buy consumer home neurotech for £200-1000 (!), but also because our watches and apps like Welltory are similarly trying to help manage our cognitive effort. Further, because we still don’t really know what goals people should have for e.g. their mental workload levels throughout the day, nor what is healthy. In this talk I will describe several of our research projects that are building our understanding of a Future Living with Consumer Neurotechnology.

Max L. Wilson is an Associate Professor of Human-Computer Interaction, in the Mixed Reality Lab, and Director of Student Experience in the School of Computer Science. His EPSRC, European, and Google funded research is focused on the use of fNIRS brain data, about mental workload and other cognitive activity, as a form of personal data, that can be used to evaluate technology and work tasks. This work has emerged from his earlier research on the evaluation of user interfaces for interacting with information. Max is on the steering committees of both ACM CHI and ACM CHIIR conferences, as well as a member of the SIGCHI Conferences Working Group, and a Deputy Editor at the International Journal of Human-Computer Studies.

Conversational Prototyping project

We are working on a new project on using Large Language Models (LLMs) to prototype physical products. The project is called Conversational Prototyping: Leveraging generative AI to support iterative device production and testing and is funded by the UKRI pro² network+. The project is a collaboration with Poppe and Partners in Amsterdam, and we are working with two external partners: Datalink Electronics in Loughborough and Electric Circus in Amsterdam.

In the projects, we are trying to harness the power of LLMs in a new way, by letting them perform different functions in a physical product, that are developed in a conversation with the designer. This is inspired by the idea of Intelligence on Tap, which considers artificial intelligence as a new design material. By working with two different partners - an electronics device manufacturer, and a robotic performance group - we will create entirely new ways to dynamically prototype new and exciting functionality in these products.

You can read more about Conversational Prototyping as well as the other projects that have been funded by the pro² network+ here!

Two new Professor positions at NTU School of Art and Design

We are excited to announce two new positions at Nottingham Trent University, School of Art and Design! We are growing our research rapidly and there are fantastic opportunities for cross-disciplinary projects, including our Digital, Technology and Creative strategic research theme.

We are looking for a Professor in Creative Industries to work across disciplines spanning fine art, graphic design, illustration, animation, photography, filmmaking, gaming, visual effects and design for stage and screen, exploring the application and impact of digital technologies in areas such as the metaverse, virtual/augmented/ mixed reality and immersive experiences.

We are also looking for a Professor in Advanced Textiles, who will be joining a strong and dedicated team of academics, researchers and technicians with excellent technical facilities to facilitate interdisciplinary and collaborative research.

Feel free to contact me at lars.holmquist@ntu.ac.uk for more information and please share in your network!

Job title: Professor - Creative Industries

Job reference: 551326

https://vacancies.ntu.ac.uk/Job/JobDetail?JobId=1356

Job title: Professor - Advanced Textiles

Job reference: 551327

https://vacancies.ntu.ac.uk/Job/JobDetail?JobId=1357

Welcome new PhD student Seher Singh!

Seher Singh is a new PhD student at the Nottingham School of Art and Design. She has an interdisciplinary background that consists of a MSc in Human Computer Interaction from the University of Nottingham and a BSc in Psychology from the University of Bath. She enjoys designing and conducting research studies; and her current areas of interest include Mixed Reality and User Experience. Her current work is all about Blending Real and Physical Interaction in Immersive Experiences. 

This PhD will investigate the combination of immersive displays (virtual reality) and rapid manufacturing (such as 3D printing) to create blended virtual-physical environments. Usually, everything in VR is completely virtual, but she will investigate using 3D printing, laser cutting and other low-cost, rapid fabrication processes to physically manufacture parts of the environment; then track and seamlessly integrate the physical components into the virtual environment. While this approach has been tried in several domains already, such as training and games, in this project she will take a fundamental principles approach, aiming to create a toolkit for creating and integrating physical and virtual environments. The research methods will involve human-computer interaction design, co-creation with users, iterative design and prototyping, qualitative and quantitative experiential testing in labs.

Study Creative Technologies at NTU

The new Creative Technologies MSc is open for applications at the School of Art and Design, Nottingham Trent University! You will have access to cutting-edge facilities at the Design & Digital Arts building, and a strong network of academic and industry experts. Members of the Connected Experiences Lab are involved in the program both as instructors and collaborators. We hope to meet the next generation of creative technologists!

Full information on how to apply can be found here:

https://www.ntu.ac.uk/course/art-and-design/pg/msc-creative-technologies