CN111311986A - Immersive interactive panoramic teaching system - Google Patents

Abstract

The invention discloses an immersive interactive panoramic teaching system, wherein the front part of a transparent projection screen is a platform area, the rear part of the transparent projection screen is an equipment room area, an optical negative refraction plate, a reflector and a first projector are arranged at the rear part of the transparent projection screen, the reflector is positioned below the optical negative refraction plate, light rays emitted by the reflector pass through the optical negative refraction plate and are refocused in the air in front of the optical negative refraction plate to form a real image of a first image, and the real image and the image of the reflector are symmetrical about the plane of the optical negative refraction plate; the scene and characters described by the author are made into a second image, the author and the interactive communication in the Chinese teaching content are made into a three-dimensional holographic first image and audio data, the controller inputs the first image into the first projector for projection, and the second image is input into the second projector for projection. The invention can realize that authors and historical figures walk out of the transparent projection screen and interact with teachers in the same lecture, gives the students brand-new real experience feeling and three-dimensional effect, and can not see the optical negative refraction plate, thereby realizing real science fiction visual effect.

Description

An immersive interactive panoramic teaching system

technical field

The invention relates to the field of teaching, in particular to an immersive interactive panoramic teaching system.

Background technique

Today, the advent of 3D printing, unmanned driving and the 4G era has made us deeply feel the changes that science and technology have brought to life. In teaching, from tape recorders, slide projectors to whiteboards, multimedia teaching, micro-lectures, etc., our classrooms are also experiencing changes due to technology. In the future, our teaching will certainly not be static. One day, 3D holographic projection technology will replace today's ordinary projectors into the classroom and into the classroom, giving students a strong visual shock and wonderful classroom effects. "3D holographic projection technology" is a 3D technology that uses the principles of interference and diffraction to record and reproduce the real three-dimensional image of an object. How to apply 3D holographic projection technology to the teaching of Chinese, geography, history, etc., how to realize the interaction between teachers, authors and historical figures, and bring a new visual experience to students are the problems we must study and solve.

SUMMARY OF THE INVENTION

In view of this, the present invention proposes an immersive interactive panoramic teaching system, comprising a first projection device for projecting a first image, a second projection device for projecting a second image, an optical negative refraction plate (10), an audio A playback device and a controller; the first projection device includes a reflector and a first projector, the first projector projects to the reflector, the second projection device includes a transparent projection screen and a second projector, and the second projector projects toward the transparent projection screen Projection; the controller is connected with the first projector, the second projector, the transparent projection screen and the audio playback device;

The front of the transparent projection screen is the podium area, and the rear of the transparent projection screen is the equipment room area. The optical negative refraction plate, the reflector and the first projector are all arranged behind the transparent projection screen. The reflector is located below the optical negative refraction plate. After the light passes through the optical negative refraction plate, it is refocused in the air in front of the optical negative refraction plate to form a real image of the first image. The real image and the image of the reflector are symmetrical about the optical negative refraction plate plane, and the real image plane is located in front of the transparent projection screen image plane or back or overlap fusion;

The controller includes a Chinese teaching module, and the Chinese teaching module includes the first video, the second video and audio data of Chinese teaching, the scene and text described by the author are made into the second video, and the author and interactive communication in the Chinese teaching content are made into The first image and audio data of the 3D holography, or the interactive communication between the teacher and the author makes the first image and audio data of the 3D holography; the controller inputs the first image to the first projector for projection, and inputs the second image to the The second projector projects, and the audio data is input to the audio playback device for playback; the controller controls the first projector and the second projector to project alternately in a time-sharing manner, or the first projector and the second projector project with different brightness .

Further, the controller includes a geography teaching module, the geography teaching module includes a first image, a second image and audio data for geography teaching, the sun is made into a second image, and the earth is made into a three-dimensional holographic first image, the controller controls The first projection device moves up, down, left, and right to present a three-dimensional image of the earth revolving around the sun; or the earth is made into a second image, and the meteorite is made into a three-dimensional holographic first image, and the controller controls the first projection device to move up, down, left, and right to present the meteorite 3D image of the crashing Earth.

Further, the controller includes a history teaching module, and the history teaching module includes a first image, a second image and audio data for history teaching, making historical scenery and text into a second image, and making historical figures and antiques and interactive communication into three-dimensional. Holographic first image and audio data, or interactive communication between teachers and historical figures to produce three-dimensional holographic first image and audio data.

Further, it includes a driving device, the driving device is connected with the controller, the driving device drives the first projection device to move up and down, left and right, and records the spatial coordinate position information of the first projection device, and drives the first projection device to move by the driving device so that the real image plane is relative to the real image plane. The image plane of the transparent projection screen moves back and forth, left and right; the optical negative refraction plate is inclined backward by 45 degrees, the reflector (9) and the optical negative refraction plate are at 90 degrees, and the transparent projection screen is vertically arranged in front of the optical negative refraction plate.

Further, the driving device includes a chassis and a scissor lift device, the scissor lift device is installed on the chassis, the first projection device is installed on the scissor lift device, and the scissor lift device drives the first projection device to move up and down, A traveling wheel and a driving motor are installed on the chassis, and the driving motor drives the traveling wheel to rotate to make the chassis move left and right.

Further, it includes a human limb sensor, the controller is connected with the human limb sensor, and the human limb sensor collects human limb movements to generate a first control command signal to control the projection of the second projection device and the movement and projection of the first projection device; or include A voice sensor, the controller is connected with the voice sensor, and the voice sensor collects human voice information to generate a second control command signal to control the movement and projection of the second projection device and the first projection device.

Further, it includes an audio playback device, the controller is connected with the audio playback device, and the controller stores audio information; it includes a human limb sensor, the controller is connected with the human limb sensor, and the human limb sensor collects human limb movements to generate the first The third control instruction signal controls the audio playback device to play corresponding audio information; or includes a voice sensor, the controller is connected to the voice sensor, and the voice sensor collects human voice information to generate a fourth control instruction signal to control the audio playback device to play the corresponding audio information.

Further, the controller inputs the first image to the first projector for projection, inputs the second image to the second projector for projection, switches to input the second image to the first projector for projection, and inputs the first image to the second projection The projector is used to project the front and rear positions of the first image and the second image.

Further, it includes a blackboard frame, a blackboard that can move left and right is installed in the blackboard frame, and the transparent projection screen is installed in the blackboard frame.

The immersive interactive panoramic teaching system of the present invention can realize that the author and historical figures can walk out of the transparent projection screen, interact with teachers on the same stage to give lectures, give students a new real experience and three-dimensional projection effect, and can not see the optical negative refraction plate. Authentic sci-fi visuals.

Description of drawings

The accompanying drawings constituting a part of the present invention are used to provide further understanding of the present invention, and the exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the attached image:

1 is a schematic diagram of classroom layout in an immersive interactive panoramic teaching system of the present invention;

2 is a schematic diagram of an immersive interactive panoramic teaching system of the present invention;

FIG. 3 is a schematic diagram of the blackboard of the present invention.

Detailed ways

It should be noted that the embodiments of the present invention and the features of the embodiments may be combined with each other under the condition of no conflict. The present invention will be described in detail below with reference to the accompanying drawings and in conjunction with the embodiments.

As shown in FIG. 1 and FIG. 2, the present invention provides an immersive interactive panoramic teaching system, including a first projection device for projecting a first image, a second projection device for projecting a second image, an optical negative refraction Board 10, audio playback device (not shown in the figure), controller 6; the first projection device includes a reflector 9 and a first projector 12, the first projector 12 projects to the reflector 9, and the second projection device includes a transparent The projection screen 1 and the second projector 11, the second projector 11 projects to the transparent projection screen 1; the controller 6 is connected with the first projector 12 and the second projector 11, the transparent projection screen 1 and the audio playback device;

In front of the transparent projection screen 1 is the podium area 100 , in front of the podium area 100 is the student listening area 300 , behind the transparent projection screen 1 is the equipment room area 200 , the optical negative refraction plate 10 , the reflector 9 and the first projector 12 are all arranged in the transparent Behind the projection screen 1 , the optical negative refraction plate 10 is inclined backward by 45 degrees, the reflector 9 and the optical negative refraction plate 10 are at 90 degrees, and the transparent projection screen 1 is vertically arranged in front of the optical negative refraction plate 10 . The reflector 9 is located below the optical negative refraction plate 10. After the light from the reflector 9 passes through the optical negative refraction plate 10, it is refocused in the air in front of the optical negative refraction plate 10 to form the real image 2 of the first image, the real image 2 and the reflector 9. The image is symmetrical about the optical negative refraction plate 10, and the real image 2 is located in front of or behind the image plane of the transparent projection screen 1 or overlapped and merged; the controller 6 controls the first projector 12 and the second projector 11 alternately time-sharing projection, or The first projector 12 and the second projector 11 project with different brightness.

As shown in FIG. 3 , it includes a blackboard frame, a blackboard 13 that can move left and right is installed in the blackboard frame, and the transparent projection screen 1 is installed in the blackboard frame. The blackboard 13 can be moved to the area of the transparent projection screen 1 , and the teaching 3 can write on the blackboard 13 .

The optical negative refraction plate 10 refers to an optical lens that can refocus in the air to present a real image, and the real image is plane-symmetrical about the optical negative refraction plate 10 . For example: CN201720919002.X patent discloses an optical flat plate structure for realizing air imaging, and other types of optical negative refraction plate structures can also be used. The transparent projection screen 1 adopts a PDLC transparent projection screen. When the second projector 11 is not projecting, and when the transparent projection screen 1 is in the closed state, the transparent projection screen 1 is transparent and light-transmitting. After reflection, a real image 2 is presented in front of the transparent projection screen 1 through the transparent projection screen 1 . Students can also see through the transparent projection screen 1 the real image 2 behind it.

Alternate time-sharing projection means that the first projector 12 and the second projector 11 project alternately, and the two projection time points are different, that is, when the first projector 12 projects, the second projector 11 is turned off, and the transparent projection screen 1 When it is turned off and is in a transparent and light-transmitting state, the first projector 12 and the second projector 11 are quickly switched to switch images, so that the first image and the second image have a sense of depth and achieve a deep fusion 3D projection effect. Projection with different brightness means that the projection brightness of the first projector 12 and the second projector 11 are different, so that the first image and the second image can achieve a deep fusion 3D projection effect. The vertical depth of the first image and the second image can be achieved by adjusting the upper and lower positions of the first projection device.

In order to realize Chinese teaching, the controller 6 includes a Chinese teaching module, and the Chinese teaching module includes the first video, the second video and audio data of Chinese teaching, the scene and text described by the author are made into the second video, and the Chinese teaching content The author and the interactive communication are made into the first image and audio data of the 3D hologram, or the interactive communication between the teacher 3 and the author is made into the first image and audio data of the 3D hologram; the controller 6 inputs the first image to the first projector 12 Projecting is performed, the second image is input to the second projector 11 for projection, and the audio data is input to the audio playback device for playback.

For example: when teaching "Looking at Lushan Waterfall", the scenes and verses of "Lushan Waterfall" were made into the second video, the author Li Bai was made into the first video, and Li Bai's voice and teacher 3 and Li Bai's reciting "Looking at Lushan Waterfall" were made with Li Bai. The speech of the conversation is made into audio material. When Teacher 3 is teaching, Li Bai is presented in front of the students, and Teacher 3 can have a dialogue with Li Bai, giving students a new real experience and three-dimensional projection effect.

In order to realize geography teaching, the controller 6 includes a geography teaching module, the geography teaching module includes a first image, a second image and audio data for geography teaching, the sun is made into a second image, and the earth is made into a three-dimensional holographic first image, The controller 6 controls the first projection device to move up and down, left and right, and presents a three-dimensional image of the earth rotating around the sun; or the earth is made into a second image, and the meteorite is made into a three-dimensional holographic first image, and the controller 6 controls the first projection device up and down. Move left and right to present a three-dimensional image of the meteorite falling and hitting the earth.

In order to realize the history teaching, the controller 6 includes a history teaching module, the history teaching module includes the first video, the second video and the audio data of the history teaching, the historical scene and text are made into the second video, and the historical figures and antiques are interactively communicated with each other. The first image and audio data of the three-dimensional holography are produced, or the first video and audio data of the three-dimensional holography are produced by interactive communication between the teacher (3) and historical figures.

In order to realize the movement of the real image 2 relative to the transparent projection screen 1, left and right, to give students an intuitive feeling that three-dimensional holographic images such as authors and historical figures emerge from the image of the transparent projection screen, to create an immersive and real experience for students to interact on the same stage. In a further technical solution, a driving device is included, the driving device is connected with the controller 6, the driving device drives the first projection device to move up, down, left and right, and records the spatial coordinate position information of the first projection device, and drives the first projection device to move through the driving device. The real image 2 plane moves back and forth, left and right, relative to the transparent projection screen 1 image plane. The driving device includes a chassis and a scissor lift device 8. The scissor lift device 8 is installed on the chassis, the first projection device is installed on the scissor lift device 8, and the scissor lift device 8 drives the first projection device to move up and down , On the chassis (not shown in the figure), a traveling wheel 7 and a driving motor (not shown in the figure) are installed, and the driving motor drives the traveling wheel 7 to rotate to make the chassis move left and right. When the first projection device goes up and down, the real image 2 moves back and forth, giving students an intuitive experience of the sci-fi visual effect of the three-dimensional holographic image entering and exiting from the image screen of the transparent projection screen 1 . When the first projection device moves left and right, the real image 2 moves left and right, giving students an intuitive feeling that the three-dimensional holographic image moves left and right in front of the transparent projection screen 1 . For example: the real image 2 is presented behind the transparent projection screen 1, and when the 3D holographic image is controlled to move downward, the real image 2 passes from the back of the transparent projection screen 1 through the transparent projection screen 1 and is presented in front of the transparent projection screen 1, so as to avoid the sudden change of the first image. Presenting, avoid giving students a sense of abruptness, and give students a visual sense that the real image 2 is walking out of the transparent projection screen 1, not volleying out.

In order to realize the movement of the real image 2 relative to the transparent projection screen 1, front and rear, left and right, the students can intuitively feel that the 3D holographic image emerges from the image of the transparent projection screen 1, and create an immersive and same-stage lecture for the students. The present invention also provides in the second scheme:

The controller inputs the first image to the first projector 12 for projection, inputs the second image to the second projector 11 for projection, switches to input the second image to the first projector 12 for projection, and inputs the first image to the second projection The projector 11 projects to realize the visual effect that the first image enters the rear of the second image.

In order to realize the interaction between the author and the historical staff and the teacher 3 performing on the same stage, in terms of video, the following two schemes are included:

The first solution includes a human limb sensor 5, the controller 6 is connected to the human limb sensor 5, and the human limb sensor 5 collects the movements of the human limb to generate a first control command signal to control the projection of the second projection device and the first projection device movement and projection;

For example: when teacher 3 shakes his feet, the author Li Bai jumps out of the transparent projection screen 1, when teacher 3 makes a gesture of moving forward, backward, left and right, the author Li Bai moves forward, backward, left and right, and when teacher 3 walks forward, backward, left and right, the author Li Bai moves forward and backward Move left and right.

The second solution includes a voice sensor 4, the controller 6 is connected to the voice sensor 4, and the voice sensor 4 collects human voice information to generate a second control command signal to control the movement and projection of the second projection device and the first projection device.

For example: when teacher 3 said: "please author Li Bai", the author Li Bai jumped out of the transparent projection screen 1, when teacher 3 said: "please move forward, back, left and right", the author Li Bai moved forward, back, left and right.

Similarly, in terms of audio, the following two solutions are included:

The first solution includes a human limb sensor 5, the controller 6 is connected with the human limb sensor 5, and the human limb sensor 5 collects the movements of the human limb to generate a third control command signal to control the audio playback device to play the corresponding audio information;

For example, when the teacher 3 claps, the audio playback device plays the corresponding audio information.

The second solution includes a voice sensor 4, the controller 6 is connected to the voice sensor 4, and the voice sensor 4 collects human voice information to generate a fourth control command signal to control the audio playback device to play the corresponding audio information.

For example, when the teacher 3 has a dialogue with the author Li Bai, the audio playback device plays the corresponding dialogue audio information.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the scope of the present invention. within the scope of protection.

Claims (9)

1. An immersive interactive panoramic teaching system is characterized by comprising a first projection device for projecting a first image, a second projection device for projecting a second image, an optical negative refraction plate (10), an audio playing device and a controller (6); the first projection device comprises a reflecting mirror (9) and a first projector (12), the first projector (12) projects to the reflecting mirror (9), the second projection device comprises a transparent projection screen (1) and a second projector (11), and the second projector (11) projects to the transparent projection screen (1); the controller (6) is connected with the first projector (12), the second projector (11), the transparent projection screen (1) and the audio playing device;

the front of the transparent projection screen (1) is a platform area (100), the rear of the transparent projection screen (1) is an equipment room area (200), an optical negative refraction plate (10), a reflective mirror (9) and a first projector (12) are arranged at the rear of the transparent projection screen (1), the reflective mirror (9) is positioned below the optical negative refraction plate (10), light rays emitted by the reflective mirror (9) pass through the optical negative refraction plate (10) and are refocused in the air in front of the optical negative refraction plate (10) to form a real image (2) of a first image, the images of the real image (2) and the reflective mirror (9) are plane-symmetric about the optical negative refraction plate (10), and the plane of the real image (2) is positioned in front of or behind the image plane of the transparent projection screen (1) or overlapped and fused;

the controller (6) comprises a Chinese teaching module, the Chinese teaching module comprises a first image, a second image and audio data of Chinese teaching, scenery and characters described by an author are made into the second image, the author and interactive communication in Chinese teaching contents are made into a three-dimensional holographic first image and audio data, or a teacher (3) and the author are made into the three-dimensional holographic first image and audio data through interactive communication; the controller (6) inputs the first image to the first projector (12) for projection, inputs the second image to the second projector (11) for projection, and inputs the audio data to the audio playing device for playing; the controller (6) controls the first projector (12) and the second projector (11) to project in an alternate time-sharing manner, or the first projector (12) and the second projector (11) to project in different brightness manners.

2. The immersive interactive panoramic teaching system of claim 1, wherein the controller (6) comprises a geography teaching module, the geography teaching module comprises a first image and a second image of geography teaching and audio data, the sun is made into the second image, the earth is made into a three-dimensional holographic first image, the controller (6) controls the first projection device to move up and down and left and right, and a three-dimensional image of the earth rotating around the sun is presented; or the earth is made into a second image, meteorites are made into a three-dimensional holographic first image, the controller (6) controls the first projection device to move up and down and left and right, and the three-dimensional image that the meteorites fall to collide with the earth is presented.

3. The immersive interactive panoramic teaching system of claim 1, wherein the controller (6) comprises a history teaching module, the history teaching module comprises a first image and a second image of the history teaching and audio data, the history scene and characters are made into the second image, the history character and antique and interactive communication are made into the three-dimensional holographic first image and audio data, or the teacher (3) and the history character are made into the three-dimensional holographic first image and audio data.

4. The immersive interactive panoramic teaching system of any one of claims 1 to 3, comprising a driving device, wherein the driving device is connected with the controller (6), the driving device drives the first projection device to move up, down, left and right and records the spatial coordinate position information of the first projection device, and the driving device drives the first projection device to move so that the real image (2) plane moves back, forth, left and right relative to the image plane of the transparent projection screen (1); the optical negative refraction plate (10) is inclined backward by 45 degrees, the reflector (9) and the optical negative refraction plate (10) form 90 degrees, and the transparent projection screen (1) is vertically arranged in front of the optical negative refraction plate (10).

5. The immersive interactive panoramic teaching system of claim 4, wherein the driving device comprises a chassis and a scissor type lifting device (8), the scissor type lifting device (8) is installed on the chassis, the first projection device is installed on the scissor type lifting device (8), the scissor type lifting device (8) drives the first projection device to move up and down, a walking wheel (7) and a driving motor are installed on the chassis, and the driving motor drives the walking wheel (7) to rotate so as to enable the chassis to move left and right.

6. The immersive interactive panoramic teaching system according to claim 4, comprising a human limb sensor (5), wherein the controller (6) is connected with the human limb sensor (5), and the human limb sensor (5) collects human limb movements to generate a first control instruction signal to control the projection of the second projection device and the movement and projection of the first projection device; or the voice projection device comprises a voice sensor (4), the controller (6) is connected with the voice sensor (4), and the voice sensor (4) collects human voice information to generate a second control instruction signal to control the second projection device and the first projection device to move and project.

7. The immersive interactive panoramic teaching system of claim 4, comprising an audio playing device, wherein the controller (6) is connected to the audio playing device, and the controller (6) stores audio information; the human limb sensor (5) collects human limb actions to generate a third control instruction signal to control the audio playing device to play corresponding audio information; or the voice playing device comprises a voice sensor (4), the controller (6) is connected with the voice sensor (4), and the voice sensor (4) collects human voice information and generates a fourth control instruction signal to control the audio playing device to play corresponding audio information.

8. The immersive interactive panoramic teaching system of claim 1, wherein the controller (6) inputs the first image into the first projector (12) for projection, inputs the second image into the second projector (11) for projection, switches to input the second image into the first projector (12) for projection, and inputs the first image into the second projector (11) for projection, thereby implementing front-back position conversion of the first image and the second image.

9. The immersive interactive panoramic teaching system of claim 1, comprising a blackboard frame, wherein a left-right movable blackboard (13) is mounted in the blackboard frame, and wherein the transparent projection screen (1) is mounted in the blackboard frame.

Images