Research /
Human–machine interaction

em.

Human input.
Digital response.

An interactive study using neural networks and Unity to translate human behaviour into a responsive digital environment.

IAAC / Robotics & Advanced Construction / 2019

Animated particles in the em. interactive digital environment

01 / Network training

Learning from
behaviour.

A neural network provides the link between human input and the digital environment.

Network training comparison showing ResNet and SimpleCNN curves across successive epochs
Network training / Comparative study

02 / Character & interaction

A body within
the system.

Character attributes and player interaction shape the relationship between movement and digital space.

Animated conceptual reconstruction showing a particle character and connected interaction workflow
Character interaction / Illustrative reconstruction of the workflow

03 / Responsive environment

Movement
becomes
atmosphere.

Ambient particles vary in movement and colour in response to human input.

Animated blue, pink and orange particle behaviour
Particle behaviour / Digital study
Animated ambient particles in the Unity environment
Ambient response / Unity environment

Research focus

Exploring the relationship between human behaviour and digital space.

Alexandros Varvantakis · Gjergjia Lilo / Faculty: Alexandre Dubor · Raimund Krenmueller

Previous
Previous

Constructing Cognition

Next
Next

Queenstown