CN108269310B - Interactive display system, method and device - Google Patents

Abstract

An interactive display system, the system comprising: the display surface is used for displaying the image; the induction coil is attached to one interaction point on the display surface and used for indicating the coordinates of the interaction point on the display surface; the server is used for generating interactive images for display; and the interaction control box is connected with the induction coil, judges and receives coordinate signals of the induction coil, sends interaction point information to the server, and generates images according to the interaction point information by the server. The display surface is formed by two-dimensional simple color lines, is provided with at least one interaction point area, is a preset interaction scene, and serves as a normal static picture to prompt and trigger interaction of an interactor.

Description

Interactive display system, method and device

Technical Field

The invention relates to an augmented reality interactive display system, method and device for the field of science popularization propaganda and education.

Background

In recent years, in exhibition items, there has been often seen an deductive way in which the basic exhibition method is to interact with a visitor or user using a horizontal or vertical projection surface. The interactive display mode based on the augmented virtual reality is very suitable for popular science propaganda education. In order to realize the interactive display mode, the following more mature realization methods are available in the technology.

One implementation technique is based on camera infrared imaging analysis technology. The infrared imaging mode is a common technology, and the principle is as follows: and (3) irradiating the interaction area by using an invisible infrared lamp to form an infrared reflection surface, and analyzing and processing the image shielded by the interactors by using a camera subjected to infrared filtering treatment. The latest analysis technology is a high-speed image analysis method based on the OpenCV technology. The shadow position in the blocked infrared reflection surface image is taken as an interaction triggering position, two-dimensional coordinates are transmitted to an interaction software system, a background interaction management system feeds back the two-dimensional coordinates of interaction, and a rendering system renders corresponding images for interaction display.

The infrared imaging analysis technology has the advantages that the implementation cost is low, and the interaction device can be implemented only by matching an infrared lamp with an ordinary CCTV camera modified by infrared filtering with an image capturing interface and related software installed on a PC. The interactive device cost per square meter of the interactive range is on the order of thousand vowels. The disadvantage is that the resolution of the device is low due to the problems of the shooting angle of the camera and the irradiation angle of the infrared lamp, and the feedback can only be carried out on a larger shielding body. Meanwhile, because of the need of image recognition analysis with large calculation amount, the interaction delay is serious.

Another implementation is based on infrared correlation interaction technology. Infrared correlation interaction technology is also a mature technology, which originates from infrared correlation sensors and is originally applied to industrial detection. In the development of multimedia interaction demand, the infrared correlation type interaction device occupies more than 90% of the touch screen interaction market at one time by virtue of the characteristics of simple technology, low price (relative to a capacitive interaction mode, a plasma interaction mode and a sound wave interaction mode) and the like. The technology is named as active infrared blocking detection, and the basic structure comprises a transmitting end, a receiving end, a light beam intensity control, an optical lens and the like. The principle is that the infrared rays emitted by the infrared light emitting diode are focused by an optical lens, so that the rays are transmitted to a long distance, and finally the rays are received by a photosensitive transistor at a receiving end. When an object blocks the infrared rays emitted by the emitting end, the receiving end can not receive the infrared rays, so that a trigger signal can be emitted. The infrared light is invisible light, and is diffused, and after being projected, a cone beam is formed in the initial path stage, and the ideal intensity and the emission distance of the cone beam are attenuated inversely square as the emission distance increases. When an object passes through the detection area, the infrared beam is blocked to trigger a trigger signal. The infrared touch screen is an infrared matrix densely distributed along the direction X, Y before being clung to the screen, and whether infrared rays are blocked by an object or not is detected and the touch of a user is positioned through continuous scanning. And outputting corresponding two-dimensional coordinates according to the position in X, Y directions, which is shielded by infrared rays, transmitting the two-dimensional coordinates to an interactive software system, feeding back the interactive two-dimensional coordinates by a background interactive management system, and rendering corresponding images by a rendering system for interactive display. Similar techniques include an acoustic-wave correlation blocking detection interaction mode and a plasma-radiation blocking detection interaction technology, and the analysis of advantages and disadvantages is performed together, so that the description is not repeated.

The advantage of infrared correlation interaction technology is that its resolution is relatively high compared to the smaller presentation surface, which can reach an interaction resolution of 4096 x 4096 dpi. The stability is relatively high, and the main components of the infrared diode and the photoresistor are the infrared diode and the photoresistor, so that the industrialization degree is high, and the stability reaches a high level. In addition, since the main equipment life of the scheme depends on the life of the infrared light-emitting diode, the interactive device has the characteristics of long service life, high durability and no electric interference. The main weakness of the mode is that as the scheme uses the blocking test of various media to realize the interactive coordinate judgment, the scheme correspondingly has misjudgment on similar substances, namely infrared equipment has weak resistance to strong light, sound wave equipment has weak resistance to strong noise and the like, so that the application range of the equipment is limited. Secondly, as the sensing range of the two-dimensional coordinate positioning equipment is the size of the detection matrix, when the sensing interaction range needs to be expanded, the size of the detection matrix can only be simply increased, in a large-scale interaction project, the cost per square meter of the interaction device can reach more than ten thousand yuan notes under the condition of square calculation, and as the installation of the device is superficial, the device needs to be installed on the upper layer of the interaction content and is symmetrical and linear, and the modeling design difficulty of the interaction content is caused.

The third mode is a laser radar positioning interaction mode. The laser radar works in the infrared and visible light bands, and takes laser as a working beam. The laser changes the electric pulse into the light pulse and emits it, the optical receiver restores the light pulse reflected from the target into the electric pulse and sends it to the computing device. The laser radar has the function of accurately measuring the position (distance and angle), the motion state (speed, vibration and gesture) and the shape of a target, and detecting, identifying, distinguishing and tracking the target. The laser radar adopts 2 working modes of pulse or continuous wave, and the detection method can be divided into Mie scattering, rayleigh scattering, raman scattering, brillouin scattering, fluorescence, doppler and other laser radars according to different detection principles. The lidar is a radar system that detects a characteristic quantity such as a position, a speed, etc. of a target by emitting a laser beam. In terms of working principle, there is no fundamental difference from microwave radar: the detection signal (laser beam) is emitted to the target, then the received signal (target echo) reflected from the target is compared with the emission signal, and after proper processing, the relevant information of the target, such as parameters of the distance, azimuth, altitude, speed, gesture, even shape and the like of the target, can be obtained. In the interaction scheme, the laser radar has the function of forming a laser scanning light curtain which is about 2mm-10mm away from the interaction surface on the interaction surface, and the two-dimensional coordinates relative to the laser emission point are formed by ascertaining the position and the motion state of an interaction body moving in the light curtain so as to achieve the interaction. The radar has the advantages of small volume, light weight, large sensing area and low price.

However, the drawbacks of lidar are also very evident, and first of all, the operation is greatly affected by the environment and the atmosphere. The laser generally has smaller attenuation and longer propagation distance in sunny weather. In bad weather such as humidity, dense smoke, dense fog, etc., attenuation is increased sharply, and propagation distance is affected greatly. For example, co2 laser with the working wavelength of 10.6 μm has better atmospheric transmission performance in all lasers, and attenuation in bad weather is 6 times of that in sunny days. In addition, the air circulation can also distort and shake the laser beam, and directly influence the measurement accuracy of the laser radar. And its accuracy is low, and its resolution can only reach the centimeter level under normal conditions, so that such devices cannot be used in fine interaction requirements.

The fourth mode is a nano conductive ink interaction mode. The nanometer conductive ink interaction mode is a new media interaction mode with artistic sense which has just emerged in 2017, and the principle is that the conductive characteristics of nanometer silver and graphite materials are utilized, and short-circuit current is generated through human body contact so as to excite corresponding interaction actions. The original development application of the nano material is applied to a fine-scale circuit printing process, and the printing of the circuit can be performed on various materials through a printer, so that the cost of the preparation process of the circuit can be greatly reduced, and even the preparation grade of the circuit can be easily improved to the nano grade by improving the printing resolution of a professional printer. 2017. A new media company in Europe in the year has introduced a display item printed by conductive ink, and forms short-circuit current by human body touch so as to excite corresponding projection images, form an augmented reality display effect, and enter the interactive display industry from the nano conductive ink interactive mode.

The nanometer conductive ink mode has the advantages that implementation is simple, computer drawing is only needed for the display pattern, and interval circuit setting is carried out according to the condition of the touch pattern needed by display interaction, then the implementation can be printed on a large scale directly through a printer, and confirmation of the interaction position can be implemented through the adhesion of the conductive adhesive to the node to the signal collecting device, so that an interaction effect is generated. And because the printing material of the conductive ink can be flexible material, the conductive ink interaction mode has the realization of curved surface interaction which cannot be realized in the previous 3 modes, and a larger design space and a larger display mode are provided for the project design in the display.

The biggest drawback of conductive inks is that they must be pre-fabricated. If the printing is performed in blocks, more precise line bonding work is required on site. So, at present, such display items are usually cut into smaller interactive block planes, and interacted according to the interactive block planes. Meanwhile, due to the problem of cost, the interactive mode has the problem of high implementation cost on a large-scale exhibition item with sparse interactive blocks.

Disclosure of Invention

The embodiment of the invention discloses an interactive display system, method and device, which aim at a virtual image interactive control solution used in science popularization propaganda education and aim at solving the problems of technical defects or over-high cost in the prior art.

In one embodiment of the present invention, an interactive display system, the system comprising:

the display surface is used for displaying the image;

The induction coil is attached to one interaction point on the display surface and used for indicating the coordinates of the interaction point on the display surface;

The server is used for generating interactive images for display;

And the interaction control box is connected with the induction coil, judges and receives coordinate signals of the induction coil, sends interaction point information to the server, and generates images according to the interaction point information by the server.

The display surface is formed by two-dimensional simple color lines, is provided with at least one interaction point area, is a preset interaction scene, and serves as a normal static picture to prompt and trigger interaction of an interactor.

The server comprises the following modules,

The control module is used for receiving the interaction coordinate information sent by the interaction control box, calling the model animation in the virtual scene according to the interaction design, and then feeding back to the projection fusion equipment to output an interaction image;

the virtual scene module is a virtual three-dimensional scene corresponding to the two-dimensional scene of the display surface, controls the virtual camera through interaction, extracts and codes the virtual three-dimensional animation in the space corresponding to the scene interaction, and sends the virtual three-dimensional animation to the projection fusion module for unified rendering display;

The projection fusion module is used for integrating a rendering system and matrix video fusion based on a rendering server and a matrix server, performing distributed rendering according to a matrix arrangement mode of a projector required by picture output in the early stage of scene output rendering, and performing fusion light path attenuation calculation on fusion edges while scene rendering, wherein the scene and matrix requirements can be simultaneously solved only by one-time rendering.

The invention relates to an interactive display system method and device for science popularization propaganda education based on augmented virtual reality, wherein the method comprises the following steps of: the system comprises a display surface, an interaction control device, a control module, a virtual scene module, a projection fusion module and a projector. Based on three characteristics of virtual reality, namely immersion, imagination and interactivity, wherein interactivity is the most important link in exhibition, aiming at the link, the invention adopts an induction coil mode at an interaction control point of a display surface to transmit an interaction signal to a server through an interaction control box, and triggers and mobilizes image data in the server to be projected to the display surface through a projector, so as to form an augmented reality display effect. The beneficial effects obtained thereby include:

1. And the cost performance is extremely high. If the interactive points of the display surface are taken as implementation units for accounting, the implementation cost of the large interactive display item is greatly reduced.

2. Easy to implement. Implementation can be accomplished quickly with minimal labor in the field by prefabricated components using simple tools.

3. High reliability. The industrial components which can be produced in mass can be adopted, so that the stability of the components can be ensured under the condition of ensuring the price advantage of the components.

4. Has wide applicability. Aiming at the current popular science display characteristics and the popularization of Mopping polygonal projection technology, the display interaction surface can develop to multiple deformation, asymmetry and concave-convex cambered surface. In response to these needs, the invention makes the interaction point a modular, variable member, with the possibility of unlimited expansion (at rated power) through series stages. And the bending deformation can be carried out according to the field condition so as to meet the requirement of exhibition items. The installation adopts a glue connection mode, and the good interactive triggering performance can be obtained by directly pasting double faced adhesive tapes smaller than or equal to 2 mm.

Drawings

The above, as well as additional purposes, features, and advantages of exemplary embodiments of the present invention will become readily apparent from the following detailed description when read in conjunction with the accompanying drawings. Several embodiments of the present invention are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which:

fig. 1 is a schematic diagram of an interactive control principle of an interactive display device according to an embodiment of the present invention.

FIG. 2 is a schematic diagram of the interactive display system according to one embodiment of the present invention.

Fig. 3 is a schematic diagram of an induction coil in one embodiment of the present invention.

FIG. 4 is a schematic diagram of a touch chip connection circuit in one embodiment of the invention.

FIG. 5 is a schematic diagram of a microprocessor connection circuit according to one embodiment of the invention.

Fig. 6 is a schematic diagram of a communication interface chip connection circuit in an embodiment of the invention.

FIG. 7 is a schematic diagram of an interactive image processing flow according to an embodiment of the invention.

Wherein, 1-induction coil, 2-touch chip, 3-communication interface chip, 4-microprocessor, 5-power chip, 6-control box, 7-display surface, 8-server, 9-projector.

Detailed Description

In accordance with one or more embodiments, as shown in FIG. 2, an interactive display system, the system comprising:

And the display surface is used for displaying the image. The display surface is formed by two-dimensional simple color lines, is provided with a plurality of interaction point areas, is a preset interaction scene, and serves as a normal static picture to prompt and trigger interaction of an interactor.

And the induction coils are attached to one interaction point on the display surface and used for indicating the coordinates of the interaction point on the display surface.

The server is used for generating interactive images for display;

And the interaction control box is connected with the induction coil, judges and receives coordinate signals of the induction coil, sends interaction point information to the server, and generates images according to the interaction point information by the server. The interactive control is the most important link in the interactive activity, and is used for sending coded electric signals according to the interactive touch positions when an interactor touches the corresponding positions on the display surface, and marking the two-dimensional absolute coordinates (relative coordinates are generated by touch screens such as infrared touch screens, capacitance touch screens and the like) of the touch interaction points relative to the display surface to the upper computer of the control equipment so as to control the box to process the interactive effect. The communication between the interactive control box and the upper computer adopts a universal serial port communication mode, and supports a PnP mode.

In accordance with one or more embodiments, as shown in fig. 7, the server includes the following modules,

The control module is a software module running in the computer and is used for receiving the interaction coordinate signals sent by the interaction device, calling the model animation in the virtual scene according to the interaction design, and then feeding back to the fusion rendering equipment to output the interaction image.

The virtual scene module is used for generating a virtual three-dimensional scene corresponding to the two-dimensional scene of the display surface, controlling the virtual camera through interaction, extracting and encoding the virtual three-dimensional animation in the space corresponding to the scene interaction, and sending the virtual three-dimensional animation to the projection fusion module for unified rendering display.

The projection fusion module is a set of software system based on a rendering server and a matrix server, is different from an independent rendering system and a matrix video fusion system which are common in the market, and combines two systems into a whole. The method has the advantages that the distributed rendering is carried out according to the matrix arrangement mode of the projector required by the picture output in the early stage of the scene rendering, the fusion light path attenuation amount calculation is carried out on the fusion edge while the scene rendering is carried out, so that the requirements of the scene and the matrix can be simultaneously met by only one rendering, and the rendering resources are greatly saved. Meanwhile, through the application of the NVIDIA GPU operation plug-in, the operation capability of a CPU is better liberated, so that the control in a large-area interactive display item is better and smoother, the picture can reach more than 16K by the current common N-card configuration, and a large amount of rendering cost is saved for the science popularization display item.

According to one or more embodiments, the interactive display system further comprises a projector through which the interactive image generated by the server is projected onto the display surface. The projector adopts an integrated laser high-definition projector with a reflecting lens, and the rendered scene animation is projected on the interactive position on the display surface. The projector can be well suitable for application in various science popularization venues under the conditions of high contrast and high color resolution. The projector projects the rendered scene animation on the relevant interactive position, so as to achieve the effects of interactive action and science popularization learning.

According to one or more embodiments, the interactive display system further includes a control computer, the control module is loaded in the control computer, the control computer is connected with the interactive control box, receives the interactive coordinate information sent by the interactive control box, calls the model animation in the virtual scene according to the interactive design, and then feeds back to the server to output the interactive image. The interactive control box sends out coded electric signals according to the positions of the interactive points, and controls the computer to mark the two-dimensional absolute coordinates of the touch interactive points relative to the display surface, so that the control module can process the interactive effect, and a plurality of interactive control boxes can be supported to be used in parallel through the USB Hub.

According to one or more embodiments, as shown in fig. 2 and 7, an interactive presentation method includes the steps of:

setting a display surface for displaying the image;

attaching at least one induction coil to an interaction point on the display surface, wherein the interaction point is used for indicating the coordinates of the interaction point on the display surface;

the setting server is used for generating interactive images for display;

and setting an interaction control box, wherein the interaction control box is connected with the induction coil, judges and receives coordinate signals of the induction coil, sends interaction point information to a server, and generates images according to the interaction point information by the server.

The server comprises the following modules,

The control module is used for receiving the interaction coordinate information sent by the interaction control box, calling the model animation in the virtual scene according to the interaction design, and then feeding back to the projection fusion equipment to output an interaction image;

the virtual scene module is a virtual three-dimensional scene corresponding to the two-dimensional scene of the display surface, controls the virtual camera through interaction, extracts and codes the virtual three-dimensional animation in the space corresponding to the scene interaction, and sends the virtual three-dimensional animation to the projection fusion module for unified rendering display;

The projection fusion module is used for integrating a rendering system and matrix video fusion based on a rendering server and a matrix server, performing distributed rendering according to a matrix arrangement mode of a projector required by picture output in the early stage of scene output rendering, and performing fusion light path attenuation calculation on fusion edges while scene rendering, wherein the scene and matrix requirements can be simultaneously solved only by one-time rendering.

According to one or more embodiments, as shown in fig. 1, an interactive presentation device for augmented reality includes:

The display surface is used for displaying images or pictures;

The induction coils are attached to one interaction point of the display surface;

The touch chips are connected with the corresponding induction coils;

the microprocessor is connected with the touch chip and a communication interface chip;

And the power supply chip supplies power to the microprocessor, the touch chip and the communication interface chip.

The touch chip, microprocessor, communication interface chip and power chip are integrated on a circuit board within an interactive control box.

According to one or more embodiments, as shown in FIG. 2, an interactive display device includes a display surface, an interactive control box, a server, and a projector. The server is connected with the communication interface chip in the interactive control box, and the server is connected with the projector. The display surface is a preset interaction scene and is formed by two-dimensional simple color lines, and the display surface serves as a normal static picture to prompt and trigger interaction of an interactor.

When the interactors touch the area of the interaction point induction coil on the display surface, the interaction control box receives and judges interaction coordinate information on the display surface corresponding to the interaction point induction coil due to the change of the capacitive reactance of the induction coil, and then feeds back the interaction coordinate information to the server, and the interaction image is output through the projector. The server is provided with a plurality of GPU cards, and can adapt to the rendering and fusion calculation requirements of projection images. The projector is a laser high-definition projector with a reflecting lens, and can be well suitable for application in various science popularization venues under the conditions of high contrast and high color resolution.

According to one or more embodiments, as shown in fig. 3, the spiral pattern of the induction coil, the wire diameter of the induction coil is 0.3 mm, and the induction coil is directly adhered to the interaction point of the display surface by double-sided adhesive tape.

In accordance with one or more embodiments, as shown in FIG. 4, the touch chip employs SGL8022, the T1 pin of the chip is connected to the induction coil, and the SO pin is connected to the IO port of the microprocessor through an NPN triode 8050. The chip also uses a 7805 chip to provide power to the connection.

According to one or more embodiments, as shown in FIG. 5, the microprocessor employs ATmega328P, with 2 LEDs connected to the ports of the microprocessor for indicating the operational status of the interactive control box.

According to one or more embodiments, as shown in fig. 6, the communication interface chip employs a serial port CH341T for communication connection with a server.

It is to be understood that while the spirit and principles of the invention have been described in connection with several embodiments, it is to be understood that this invention is not limited to the specific embodiments disclosed nor does it imply that the features of these aspects are not combinable and that such is for convenience of description only. The invention is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.

Claims (3)

1. An interactive display system, the system comprising:

The projection display surface is used for displaying images;

At least one induction coil attached to one interaction point on the display surface for indicating the coordinates of the interaction point on the display surface,

When a plurality of interaction points are arranged on the display surface, the induction coil is in a spiral pattern and is adhered to the interaction points;

The server is used for generating interactive images for display;

the interaction control box is connected with the induction coil, judges and receives coordinate signals of the induction coil, sends interaction point information to the server, and generates images according to the interaction point information by the server;

The display surface is formed by two-dimensional simple color lines, is provided with at least one interaction point area, is a preset interaction scene, and serves as a normal static picture to prompt and trigger interaction for an interactor;

The server comprises the following modules,

The control module is used for receiving the interaction coordinate information sent by the interaction control box, calling the model animation in the virtual scene according to the interaction design, and then feeding back to the projection fusion equipment to output an interaction image;

the virtual scene module is a virtual three-dimensional scene corresponding to the two-dimensional scene of the display surface, controls the virtual camera through interaction, extracts and codes the virtual three-dimensional animation in the space corresponding to the scene interaction, and sends the virtual three-dimensional animation to the projection fusion module for unified rendering display;

The projection fusion module is used for integrating a rendering system and matrix video fusion based on a rendering server and a matrix server, performing distributed rendering according to a matrix arrangement mode of a projector required by picture output in the early stage of scene output rendering, and performing fusion light path attenuation calculation on fusion edges while scene rendering, wherein the requirements of scenes and matrixes can be simultaneously solved only by one-time rendering;

The server releases the operation capability of the CPU through the GPU operation plug-in unit,

The interactive display system also comprises a projector, wherein an interactive image generated by the server is projected to a display surface through the projector, and the projector adopts an integrated laser high-definition projector with a reflecting lens to project the rendered scene animation on an interactive position on the display surface;

The interactive display system also comprises a control computer, a control module is loaded in the control computer, the control computer is connected with the interactive control box, receives the interactive coordinate information sent by the interactive control box, calls the model animation in the virtual scene according to the interactive design, feeds back to the server, outputs the interactive image,

The interactive control box sends out coded electric signals according to the positions of the interactive points, controls the computer to mark the two-dimensional absolute coordinates of the touch interactive points relative to the display surface so as to facilitate the interactive effect processing of the control module, supports the parallel use of a plurality of interactive control boxes through the USB Hub,

The circuit of the interactive control box comprises:

At least one touch chip connected with the corresponding induction coil;

the microprocessor is connected with the touch chip and a communication interface chip;

And the power supply chip supplies power to the microprocessor, the touch chip and the communication interface chip.

2. An interactive display method is characterized by comprising the following steps:

Setting a projection display surface for displaying images;

attaching at least one induction coil to an interaction point on the display surface, wherein the interaction point is used for indicating the coordinates of the interaction point on the display surface;

the setting server is used for generating interactive images for display;

Setting an interaction control box, wherein the interaction control box is connected with the induction coil, judges and receives coordinate signals of the induction coil, sends interaction point information to a server, and generates images according to the interaction point information by the server;

The display surface is formed by two-dimensional simple color lines, is provided with at least one interaction point area which is a preset interaction scene and serves as a normal static picture to prompt and trigger interaction of an interactor, the server comprises the following modules,

The control module is used for receiving the interaction coordinate information sent by the interaction control box, calling the model animation in the virtual scene according to the interaction design, and then feeding back to the projection fusion equipment to output an interaction image;

the virtual scene module is a virtual three-dimensional scene corresponding to the two-dimensional scene of the display surface, controls the virtual camera through interaction, extracts and codes the virtual three-dimensional animation in the space corresponding to the scene interaction, and sends the virtual three-dimensional animation to the projection fusion module for unified rendering display;

The projection fusion module is used for integrating a rendering system and matrix video fusion based on a rendering server and a matrix server, performing distributed rendering according to a matrix arrangement mode of a projector required for picture output in the early stage of scene output rendering, and performing fusion light path attenuation calculation on fusion edges while scene rendering, wherein the scene and matrix requirements are simultaneously solved only by one-time rendering.

3. An interactive display device for interactive display of augmented reality, the interactive display device comprising:

The projection display surface is used for displaying images;

at least one induction coil attached to an interaction point of the display surface;

At least one touch chip connected with the corresponding induction coil;

the microprocessor is connected with the touch chip and a communication interface chip;

The power chip supplies power for the microprocessor, the touch chip and the communication interface chip;

the touch chip, the microprocessor, the communication interface chip and the power supply chip are integrated in an interactive control box;

The interactive display device further comprises a server and a projector,

The server is connected with the communication in the interactive control box, the server is connected with the projector,

The interactive display device also comprises a control computer which is in communication connection with the interactive control box, receives the interactive coordinate information sent by the interactive control box, calls the model animation in the virtual scene according to the interactive design, feeds back to the server, outputs the interactive image,

The server comprises the following modules,

The control module is used for receiving the interaction coordinate information sent by the interaction control box, calling the model animation in the virtual scene according to the interaction design, and then feeding back to the projection fusion equipment to output an interaction image;

the virtual scene module is a virtual three-dimensional scene corresponding to the two-dimensional scene of the display surface, controls the virtual camera through interaction, extracts and codes the virtual three-dimensional animation in the space corresponding to the scene interaction, and sends the virtual three-dimensional animation to the projection fusion module for unified rendering display;

The projection fusion module is used for integrating a rendering system and matrix video fusion based on a rendering server and a matrix server, performing distributed rendering according to a matrix arrangement mode of a projector required for picture output in the early stage of scene output rendering, and performing fusion light path attenuation calculation on fusion edges while scene rendering, wherein the scene and matrix requirements are simultaneously solved only by one-time rendering.