Industry news

Application and principle of large screen touch interactive Lidar

Multimedia interactive solution refers to the application of advanced computer sensing technology and projection display technology to create a fantasy and dynamic interactive experience, the audience through body movements to interact with the system to produce special effects images, an advertising and entertainment system solution.


At present, the mainstream projection interactive games are generally using "Lidar +TUIO+Unity" to achieve. The hardware mainly adopts two-dimensional single-line rotating scanning interactive radar, and the radar touch control adopts advanced infrared capture technology, which is shown as an invisible multi-touch wall in the actual interactive experience, generally parallel to the effect display screen. Completely different from the traditional touch device's dependence on the touch surface, making the user's interaction experience more natural and comfortable. The radar scan data is then transferred to unity for interactive effects.


TUIO (protocol interface), which allows the transmission of abstract descriptions on interactive surfaces, such as transmitting touch and touching the state of objects. Simply understood as a universal language of diplomacy, TUIO is used between Radar and unity. In short, in a large-screen interaction, Lidar scans the data, TUIO translates it into a language unity understands, and unity implements the interaction.


This scheme takes Lidar as the core position detection sensor, Lidar can connect with Unity3d, TUIO, C#SDK, which has the functions of network transmission, hot swap, heartbeat, automatic reconnection, etc. It can help the integrated system convert the monitoring point into coordinate data through the detection area of the radar, and realize various mouse events. Then, interactive entertainment activities such as wall projection interaction, ground projection interaction, glass walkway, scenic area, children's entertainment interaction, ball smashing and so on can be realized.


The characteristics of the scheme are:

1: novel form, strong sense of science and technology;

2. Integrated participation, good experience effect;

3: Multi-touch, meet the interaction of multiple people;

4: up to 18000 times per second detection frequency;

5: high refresh frequency, instant feedback;

6: Network cable connection, up to 50m away


Scan the qr codeclose
the qr code