CN113516761B - Method and device for manufacturing naked eye 3D content with optical illusion - Google Patents

Abstract

The embodiment of the application provides a method and a device for manufacturing optical illusion naked eye 3D content, wherein the method comprises the following steps: basic image perspective information and elevation angle information of a screen display scene are obtained, and reverse summation of camera parameters of a viewing site and scene simulation are carried out; performing content design and creative association with modeling of a live-action LED based on a real scene structure; performing CG scene making and primary detection in the scene, performing real shooting camera simulation, shooting and synthesizing with CG content; performing resolution matching and rendering output on a scene under a CG (graphic control) camera according to the resolution size required by an LED (light emitting diode) screen, unfolding an output video sequence to an LED screen model in a three-dimensional scene in a baking mode in CG software, and obtaining a video format result of a final 3D optical illusion screen according to the file format requirement required by the screen; the method and the device can effectively ensure the uniform and correct perspective relation of the impression effect during multi-screen simulcast.

Description

Optical illusion naked-eye 3D content production method and device

Technical field

This application relates to the field of visual technology, and specifically to a method and device for producing optical illusion naked-eye 3D content.

Background technique

The visual system is the most important sensory pathway for humans. About 80% of external information enters the human brain through the visual system. But sometimes our visual system can trick our brains, causing some interesting phenomena called "visual illusions." Optical illusion art refers to the art in which artists draw pictures using the principles of optical illusion. 3D street art paintings have been around since the 16th century. Static 3D paintings are created from 2D paintings, and the corresponding effects can only be observed from specific angles.

In recent years, thanks to the development of LED screen displays and ultra-high-definition content production technology, a number of highly realistic naked-eye 3D contents have been displayed on outdoor ultra-high-definition large screens. These contents belong to the category of optical illusion art. They transform the previous static optical illusion 3D paintings into dynamic naked-eye 3D videos, which have shocking visual impact and form the concept of a popular check-in spot in the city. In the future, with the leadership and promotion of the "Hundred Cities, Thousand Screens" project of China Central Radio and Television Station, as well as the demand of advertisers and audiences for exquisite content on offline outdoor large screens, optical illusion naked-eye 3D content is suitable for displaying hot content and advertising products. will gradually increase.

These optical illusion naked-eye 3D contents are either completely produced by computer CG, or are synthesized by computer CG production and real-shot content. Currently, there are three problems in the production of these contents. First, there is no unified standardized production process. Second, due to the different shapes of different outdoor LEDs and different on-site viewing angles, multi-screen broadcast cannot guarantee a unified look and feel. Third, for naked-eye 3D images composed of real-shot content, the correct perspective relationship cannot be guaranteed when viewed with outdoor LEDs.

Contents of the invention

In view of the problems in the prior art, this application provides a method and device for producing optical illusion-like naked-eye 3D content, which can effectively ensure the unified look and feel and correct perspective relationship during multi-screen broadcast.

In order to solve at least one of the above problems, this application provides the following technical solutions:

In the first aspect, this application provides a method for producing optical illusion naked-eye 3D content, including:

Obtain the basic image perspective information and elevation information of the scene displayed on the screen, and simulate the reverse summation of camera parameters at the viewing site;

Carry out content design based on realistic scene construction and creative correlation with the modeling of real-life LEDs, and conduct CG scene production and preliminary inspection within the scene, and perform real-shot camera simulation, shooting and synthesis with CG content;

According to the resolution size required by the LED screen, the scene under the CG camera will be resolution matched and rendered. The output video sequence will be expanded to the LED screen model in the three-dimensional scene through baking in the CG software. , and obtain the final video format result of the 3D optical illusion screen according to the file format requirements required by the screen.

Further, the scene simulation of camera reverse summation for viewing the scene includes:

Through the data information, image information and screen parameters collected from the real scene, the camera angle is reversely calculated and simulated, and the camera parameters are calculated using the perspective formula algorithm;

Build a simple model based on the real scene, locate the average test points on the model screen and place the basic geometry for calibration respectively. Through a matrix arrangement, the perspective deformation effect of the screen content is obtained based on the camera's fan-shaped angle of field survey.

Further, the CG scene production and preliminary detection within the scene include:

According to the design plan and production requirements, complete model production, scene construction, material mapping, animation production, lighting arrangement and rendering output in CG production software to obtain CG scenes that meet production requirements;

Conduct preliminary inspections on the production of CG scenes within the observation area, and adjust structures that are stretched and deformed within the observation range.

Further, the simulation, shooting and synthesis of real-shot camera with CG content include:

Simulate real-life character model performances and create low-poly 3D character models. Add calibrated basic geometry to the scene as the background. Divide areas and mark digital numbers for each 3D model of the character and background. Position the main element model in the design according to the best viewing point. The three-dimensional spatial relationship with the virtual scene, combined with the actual shooting location conditions and shooting equipment parameters, by scaling the CG scene, moving the position of the camera in the CG scene, or changing the shooting angle, to obtain preliminary real-shot camera position parameter information;

Set up a real-shot stage based on camera parameters and real-life scene shooting conditions, and arrange lights that match the three-dimensional scene light source;

Separate the keying of the character performance content, synthesize it into a three-dimensional scene, and perform color correction.

In the second aspect, this application provides an optical illusion naked-eye 3D content production device, including:

The restoration simulation module is used to obtain the basic image perspective information and elevation information of the screen display scene, and perform inverse summation scene simulation of camera parameters at the viewing site;

The content detection module is used for content design based on realistic scene construction and creative correlation with the modeling of real-life LEDs, and for CG scene production and preliminary detection within the scene, and for real-shot camera simulation, shooting, and synthesis with CG content;

The content synthesis module is used to match the resolution and render the output of the scene under the CG camera according to the required resolution size of the LED screen. The output video sequence will be expanded into a three-dimensional scene through baking in the CG software. On the LED screen model within, and obtain the final 3D optical illusion screen video format result according to the file format requirements required by the screen.

Further, the restoration simulation module includes:

The camera parameter determination unit is used to perform reverse calculation and simulation calculation of the camera angle through the data information, image information and screen parameters collected from the real scene, and use the perspective formula algorithm to calculate the camera parameters;

The perspective deformation effect determination unit is used to build a simple model based on the real scene. It locates the average test points on the model screen and places the basic geometry for calibration respectively. Through matrix arrangement, based on the camera simulating the fan-shaped angle of field survey, it is obtained Perspective deformation effect of screen content.

Further, the content detection module includes:

The CG scene production unit is used to complete model production, scene construction, material mapping, animation production, lighting arrangement and rendering output in CG production software in accordance with the design plan and production requirements, and obtain CG scenes that meet the production requirements;

The structure adjustment unit is used to conduct preliminary inspection of the production of CG scenes within the observation area, and adjust structures that have stretched and deformed within the observation area.

Further, the content synthesis module includes:

The camera position parameter determination unit is used to simulate realistic character model performances and produce low-polygon 3D character models. It adds calibrated basic geometry as the background to the scene, divides areas and marks digital numbers for each 3D model of the character and background, and marks them with numbers according to the latest The three-dimensional spatial relationship between the main element model and the virtual scene in the best viewing point positioning design, combined with the actual shooting location conditions and shooting equipment parameters, is obtained by scaling the CG scene, moving the position of the camera in the CG scene, or changing the shooting angle. Actual camera position parameter information;

The scene building unit is used to build a real-shot stage based on camera parameters and real-life scene shooting conditions, and arrange lighting that matches the three-dimensional scene light source;

The synthesis unit is used to separate the keying of character performance content, synthesize it into a three-dimensional scene, and perform color correction.

In a third aspect, the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, the naked-eye optical illusion is realized. Steps of 3D content production method.

In a fourth aspect, the present application provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of the optical illusion-like naked-eye 3D content production method are implemented.

It can be seen from the above technical solution that this application provides a method and device for producing optical illusion-like naked-eye 3D content. By establishing a unified standardized production process, it can effectively ensure the unified look and feel and correct perspective relationship during multi-screen broadcast.

Description of drawings

In order to more clearly explain the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description are: For some embodiments of the present application, those of ordinary skill in the art can also obtain other drawings based on these drawings without exerting creative efforts.

Figure 1 is one of the flow diagrams of the optical illusion naked-eye 3D content production method in the embodiment of the present application;

Figure 2 is the second schematic flow chart of the optical illusion naked-eye 3D content production method in the embodiment of the present application;

Figure 3 is the third schematic flowchart of the optical illusion naked-eye 3D content production method in the embodiment of the present application;

Figure 4 is the fourth schematic flowchart of the optical illusion naked-eye 3D content production method in the embodiment of the present application;

Figure 5 is one of the structural diagrams of the optical illusion naked-eye 3D content production device in the embodiment of the present application;

Figure 6 is the second structural diagram of the optical illusion naked-eye 3D content production device in the embodiment of the present application;

Figure 7 is the third structural diagram of the optical illusion naked-eye 3D content production device in the embodiment of the present application;

Figure 8 is the fourth structural diagram of the optical illusion naked-eye 3D content production device in the embodiment of the present application;

Figure 9 is a schematic structural diagram of an electronic device in an embodiment of the present application.

Detailed ways

In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments These are part of the embodiments of this application, but not all of them. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of this application.

Considering that these optical illusion naked-eye 3D contents are either completely produced by computer CG, or synthesized by computer CG production and real-shot content, there are currently three problems in the production of these contents. First, there is no unified standardized production process. Second, due to the different shapes of different outdoor LEDs and different on-site viewing angles, multi-screen broadcast cannot guarantee a unified look and feel. Third, for the problem that naked-eye 3D images synthesized from real-shot content cannot guarantee the correct perspective relationship when viewed with outdoor LEDs, this application provides a method and device for producing optical illusion-like naked-eye 3D content, by establishing a unified standardization The production process can effectively ensure the unified look and feel and correct perspective relationship during multi-screen broadcast.

In order to effectively ensure the unified look and feel and correct perspective relationship during multi-screen simulcast, this application provides an embodiment of an optical illusion naked-eye 3D content production method. Refer to Figure 1. The optical illusion naked-eye 3D content production method is specific. Contains the following content:

Step S101: Obtain the basic image perspective information and elevation information of the screen display scene, and perform inverse summation scene simulation of camera parameters at the viewing site;

Specifically, the corresponding effect of optical illusion naked-eye 3D content can only be observed at a specific angle. First, it is necessary to analyze the situation of the scene displayed on the screen, and obtain a fan-shaped viewing interval with good visual effects and uniformity through on-site survey and live shooting. Factors that need to be considered during the actual survey include the main screen structure of the real location and the structure of the surrounding environment, viewing time, the height of the viewing equipment and people, the direction of the street, and the direction of the flow of people or vehicles. Determine the best viewing point based on these factors, and obtain basic image perspective information, elevation information, etc. in the process. For multi-screen playback, it is necessary to consider the unified viewing angles of multiple screens and plan the screens to be released. There should be no large deviations in the viewing angles of multiple screens.

Step S102: Carry out content design based on the realistic scene structure and creatively associate it with the shape of the real-scene LED, and conduct CG scene production and preliminary inspection within the scene, and conduct real-shot camera simulation, shooting, and synthesis with CG content;

Specifically, according to the conclusions drawn from the above steps, creative content is created based on realistic scene construction. The creative connection between the design content and the shape of the real-life LED not only allows the screen display content to be connected or even integrated with the real environment, but also ensures the correct visual perspective relationship and enhances the realism and presence of the optical illusion 3D effect. In order to achieve the "off-screen" optical illusion 3D effect, the screen is appropriately "blank" based on the real scene. "Blank space" can be part of the real scene during the day, or it can be the "empty black" of the night scene. Its specific position and size are determined according to the movement trajectory and perspective change requirements of the creative subject, so as to achieve the effect of interaction between the creative subject and the real environment.

Step S103: According to the required resolution size of the LED screen, the scene under the CG camera will be resolution matched and rendered. The output video sequence will be expanded to the LED in the three-dimensional scene through baking in the CG software. On the screen model, and obtain the final 3D optical illusion screen video format result according to the file format requirements required by the screen.

Specifically, after all post-production is completed, the resolution of the scene under the CG camera will be matched according to the resolution size required by the LED screen to ensure that the content displayed on the screen in the CG scene has sufficient resolution required by the LED screen. , and then render and output. The output video sequence will be expanded to the LED screen model in the three-dimensional scene through baking in CG software, and the final video format result of the 3D optical illusion screen will be obtained according to the file format requirements required by the screen.

Specifically, the finished content will be played on-site for real-life inspection to confirm whether the final viewing effect meets expectations, including whether the perspective ratio relationship is correct within the optimal viewing range of each screen, and whether there are obvious deformed and stretched elements, etc. If there are any problems, modify and adjust them to achieve a satisfactory display effect.

It can be seen from the above description that the optical illusion naked-eye 3D content production method provided by the embodiments of the present application can effectively ensure the unified look and feel and correct perspective relationship during multi-screen broadcast by establishing a unified standardized production process.

In an embodiment of the optical illusion naked-eye 3D content production method of the present application, referring to Figure 2, the following content may be specifically included:

Step S201: Perform reverse calculation and simulation calculation of the camera angle through the data information, image information and screen parameters collected from the real scene, and use the perspective formula algorithm to calculate the camera parameters;

Step S202: Build a simple model based on the real scene, locate the average test points on the model screen and place the basic geometry for calibration respectively. Through a matrix arrangement, based on the camera simulating the fan-shaped angle of field survey, the perspective deformation of the screen content is obtained. Effect to get how the main content within the screen is deployed.

(1) View the camera feedback at the scene

By performing camera inversion on the shooting equipment used to take photos on site, the three-dimensional space of the LED viewing site can be restored. Restore the on-site LED shape, camera lens parameters, shooting angle and other scenes in CG to solve the alignment problem between the on-site and CG perspective space.

The specific steps are to use the data information, image information and screen parameters collected from the real scene to perform inverse calculation and simulation calculation of the camera angle in the three-dimensional design software, and use the perspective formula algorithm to calculate the camera parameters that are close to the reality, and apply them to obtain the same The visual effect output results match the best viewing point in reality to ensure that the perspective relationship of the video content is consistent with the real scene.

(2) Scene simulation

After completing the camera simulation matching, preliminary testing is required. Build a simple model based on the real scene, locate the average test points on the model screen and place the basic geometry (cube, sphere) for calibration respectively. Through matrix arrangement, the camera simulates the fan-shaped angle of field survey, which can be quickly and intuitively Get the approximate perspective deformation effect of the screen content. Multi-screen joint investment will repeat this step. The purpose of this step is to avoid problems in advance in the subsequent design stage, and to eliminate obvious deformation areas of image information caused by large perspective stretching.

Specifically, it is used to build a simple model based on the real scene, locate the average test points on the model screen and place the basic geometry (cube, sphere) for calibration respectively, divide the area of each model and mark it digitally, and arrange it in a matrix. Based on the fan-shaped angle of view of the camera simulating field survey, a single frame is rendered and baked back to the three-dimensional screen of the CG scene, and then based on the actual field of view range obtained from the field survey, the approximate perspective deformation effect of the screen content can be quickly and intuitively obtained . Multi-screen joint investment will repeat this step. The purpose of this step is to avoid problems in advance in the subsequent design stage, and to determine the deployment range of important content of the picture during design, which can eliminate obvious deformation areas of image information caused by large perspective stretching.

In one embodiment of the optical illusion naked-eye 3D content production method of the present application, referring to Figure 3, the following content may be specifically included:

Step S301: Complete model production, scene construction, material mapping, animation production, lighting arrangement and rendering output in the CG production software according to the design plan and production requirements, and obtain a CG scene that meets the production requirements;

Step S302: Preliminarily inspect the production of the CG scene within the observation area, and adjust the structures that are stretched and deformed within the observation area.

(1)CG scene production

This step is the same as the general CG production step.

According to the design plan and production requirements, complete the steps of model production, scene construction, material mapping, animation production, lighting arrangement and rendering output in the CG production software, and finally obtain a CG scene that meets the production requirements.

(2) Preliminary detection within the scene

Conduct a preliminary inspection of the production of CG scenes within the observation area obtained in step 1, and adjust structures that have obvious stretching and deformation within the observation range.

In one embodiment of the optical illusion naked-eye 3D content production method of the present application, referring to Figure 4, the following content may be specifically included:

Step S401: Simulate the performance of the real character model and create a low-polygon three-dimensional character model. Add the calibrated basic geometry to the scene as the background. Divide areas and mark digital numbers for each three-dimensional model of the character and background. Position the design according to the best viewing point. The three-dimensional spatial relationship between the main element model and the virtual scene, combined with the actual shooting location conditions and shooting equipment parameters, by scaling the CG scene, moving the position of the camera in the CG scene, or changing the shooting angle, the preliminary real-shot camera position parameters are obtained information;

Step S402: Build a real shooting stage based on camera parameters and real scene shooting conditions, and arrange lighting that matches the three-dimensional scene light source;

Step S403: Separate the keying of the character performance content, synthesize it into a three-dimensional scene, and perform color correction.

1) Real camera simulation

Simulate real-life character model performances and create low-poly 3D character models. Add calibrated basic geometry to the scene as the background. Divide areas and mark digital numbers for each 3D model of the character and background. Position the main element model in the design according to the best viewing point. The three-dimensional spatial relationship with the virtual scene, combined with the actual shooting location conditions and shooting equipment parameters, by scaling the CG scene, moving the position of the camera in the CG scene, or changing the shooting angle, etc., to obtain preliminary real-shot camera position parameter information . Since the change of the camera position may cause the perspective relationship to change, the calibration basic geometry can be used again in this process to continuously confirm whether there is any picture deformation effect due to the perspective effect in the three-dimensional scene within the observation range obtained in step 1. Scene optimization and visual effects tuning are also carried out to obtain a more uniform and high-quality viewing experience within the optimal viewing range. Finally, accurate real-shot camera position parameter information is obtained.

(2) Real-life content shooting

Based on the camera parameters and realistic scene shooting conditions obtained in the above steps, the real-shot stage will be built, and lights that match the three-dimensional scene light source will be arranged to ensure the light and shadow changes, color expression, and perspective proportions of the real characters and the digital scene. etc. to achieve a more realistic and natural shooting effect.

(3) Synthesis of CG and real-shot content.

This step is the same as common CG real-shot synthesis.

After the filming is completed, the character performance content is separated into keyings through post-production, synthesized into a three-dimensional scene, and color corrected to ensure color tonality matching.

In order to effectively ensure the uniformity of visual effects and the correct perspective relationship during multi-screen simulcast, this application provides an optical illusion naked-eye 3D content production device for realizing all or part of the optical illusion naked-eye 3D content production method Referring to Figure 4, the optical illusion naked-eye 3D content production device specifically includes the following content:

The restoration simulation module 10 is used to obtain the basic image perspective information and elevation information of the screen display scene, and perform reverse summation scene simulation of camera parameters at the viewing site;

The content detection module 20 is used to perform content design based on realistic scene construction and creative correlation with the modeling of real-life LEDs, and perform CG scene production and preliminary detection within the scene, and perform real-shot camera simulation, shooting, and synthesis with CG content;

The content synthesis module 30 is used to perform resolution matching and rendering output of the scene under the CG camera according to the resolution size required by the LED screen. The output video sequence will be expanded to three-dimensional through baking in the CG software. On the LED screen model in the scene, the video format result of the final 3D optical illusion screen is obtained according to the file format requirements required by the screen.

It can be seen from the above description that the optical illusion naked-eye 3D content production device provided by the embodiment of the present application can effectively ensure the unified look and feel and correct perspective relationship during multi-screen broadcast by establishing a unified standardized production process.

In one embodiment of the optical illusion naked-eye 3D content production device of the present application, referring to Figure 6, the restoration simulation module 10 includes:

The camera parameter determination unit 11 is used to perform reverse calculation and simulation calculation of the camera angle through the data information, image information and screen parameters collected from the real scene, and calculate the camera parameters using the perspective formula algorithm;

The perspective deformation effect determination unit 12 is used to build a simple model based on the real scene, locate the average test points on the model screen and place the basic geometry for calibration respectively. Through a matrix arrangement, based on the camera simulating the fan-shaped angle of field survey, we obtain The perspective deformation effect of the screen content.

Specifically, it is used to build a simple model based on the real scene, locate the average test points on the model screen and place the basic geometry (cube, sphere) for calibration respectively, divide the area of each model and mark it digitally, and arrange it in a matrix. Based on the fan-shaped angle of view of the camera simulating field survey, a single frame is rendered and baked back to the three-dimensional screen of the CG scene, and then based on the actual field of view range obtained from the field survey, the approximate perspective deformation effect of the screen content can be quickly and intuitively obtained . Multi-screen joint investment will repeat this step. The purpose of this step is to avoid problems in advance in the subsequent design stage, and to determine the deployment range of important content of the picture during design, which can eliminate obvious deformation areas of image information caused by large perspective stretching.

In one embodiment of the optical illusion naked-eye 3D content production device of the present application, referring to Figure 7, the content detection module 20 includes:

The CG scene production unit 21 is used to complete model production, scene construction, material mapping, animation production, lighting arrangement and rendering output in CG production software in accordance with the design plan and production requirements, and obtain a CG scene that meets the production requirements;

The structure adjustment unit 22 is used for preliminary inspection of the production of CG scenes within the observation area, and for adjusting structures that are stretched and deformed within the observation area.

In one embodiment of the optical illusion naked-eye 3D content production device of the present application, referring to Figure 8, the content synthesis module 30 includes:

The camera position parameter determination unit 31 is used to simulate realistic character model performances and produce low-polygon three-dimensional character models, add calibrated basic geometry as the background to the scene, divide areas and mark digital numbers for each three-dimensional model of the character and background, according to The three-dimensional spatial relationship between the main element model and the virtual scene in the best viewing point positioning design, combined with the actual shooting location conditions and shooting equipment parameters, is initially obtained by scaling the CG scene, moving the position of the camera in the CG scene, or changing the shooting angle. The real-shot camera position parameter information;

The scene building unit 32 is used to build a real-shot stage based on camera parameters and real-life scene shooting conditions, and arrange lighting that matches the three-dimensional scene light source;

The synthesis unit 33 is used to separate the keying of character performance content, synthesize it into a three-dimensional scene, and perform color correction.

From a hardware level, in order to effectively ensure the unified look and feel and correct perspective relationship during multi-screen broadcast, this application provides an electronic device for realizing all or part of the optical illusion naked-eye 3D content production method. In an embodiment of the device, the electronic device specifically includes the following content:

A processor (processor), a memory (memory), a communication interface (Communications Interface) and a bus; wherein the processor, memory and communication interface complete communication with each other through the bus; the communication interface is used to realize optical illusions Information transmission between the naked-eye 3D content production device and related equipment such as core business systems, user terminals, and related databases; the logic controller can be a desktop computer, a tablet computer, a mobile terminal, etc., and this embodiment is not limited thereto. In this embodiment, the logic controller can be implemented with reference to the embodiment of the optical illusion naked-eye 3D content production method and the embodiment of the optical illusion naked-eye 3D content production device, the contents of which are incorporated here. The repetitive parts will not be repeated.

It can be understood that the user terminal may include a smart phone, a tablet electronic device, a network set-top box, a portable computer, a desktop computer, a personal digital assistant (PDA), a vehicle-mounted device, a smart wearable device, etc. The smart wearable devices may include smart glasses, smart watches, smart bracelets, etc.

In practical applications, part of the optical illusion naked-eye 3D content production method can be executed on the electronic device side as described above, or all operations can be completed in the client device. Specifically, the selection may be made based on the processing capabilities of the client device and restrictions on user usage scenarios. This application does not limit this. If all operations are completed in the client device, the client device may also include a processor.

The above-mentioned client device may have a communication module (ie, communication unit), which may communicate with a remote server to realize data transmission with the server. The server may include a server on the task dispatching center side. In other implementation scenarios, it may also include a server of an intermediate platform, such as a server of a third-party server platform that has a communication link with the task dispatching center server. The server may include a single computer device, a server cluster composed of multiple servers, or a server structure of distributed devices.

FIG. 9 is a schematic block diagram of the system structure of the electronic device 9600 according to the embodiment of the present application. As shown in Figure 9, the electronic device 9600 may include a central processing unit 9100 and a memory 9140; the memory 9140 is coupled to the central processing unit 9100. It is worth noting that Figure 9 is exemplary; other types of structures can also be used to supplement or replace this structure to implement telecommunications functions or other functions.

In one embodiment, the optical illusion-like naked-eye 3D content production method function can be integrated into the central processor 9100. Among them, the central processing unit 9100 can be configured to perform the following control:

Step S101: Obtain the basic image perspective information and elevation information of the screen display scene, and perform inverse summation scene simulation of camera parameters at the viewing site;

Step S102: Carry out content design based on the realistic scene structure and creatively associate it with the shape of the real-scene LED, and conduct CG scene production and preliminary inspection within the scene, and conduct real-shot camera simulation, shooting, and synthesis with CG content;

Step S103: According to the required resolution size of the LED screen, the scene under the CG camera will be resolution matched and rendered. The output video sequence will be expanded to the LED in the three-dimensional scene through baking in the CG software. On the screen model, and obtain the final 3D optical illusion screen video format result according to the file format requirements required by the screen.

As can be seen from the above description, the electronic device provided by the embodiments of the present application can effectively ensure a unified look and feel and a correct perspective relationship during multi-screen simulcast by establishing a unified standardized production process.

In another embodiment, the optical illusion naked-eye 3D content production device can be configured separately from the central processor 9100. For example, the optical illusion naked-eye 3D content production device can be configured as a chip connected to the central processor 9100, through the central processor 9100. Control to achieve optical illusion-like naked-eye 3D content production method functions.

As shown in Figure 9, the electronic device 9600 may also include: a communication module 9110, an input unit 9120, an audio processor 9130, a display 9160, and a power supply 9170. It is worth noting that the electronic device 9600 does not necessarily include all components shown in FIG. 9; in addition, the electronic device 9600 may also include components not shown in FIG. 9, and reference may be made to the existing technology.

As shown in Figure 9, the central processor 9100, sometimes also called a controller or operating control, may include a microprocessor or other processor device and/or a logic device. The central processor 9100 receives input and controls various aspects of the electronic device 9600. Operation of parts.

The memory 9140 may be, for example, one or more of a cache, flash memory, hard drive, removable media, volatile memory, non-volatile memory or other suitable devices. The above-mentioned information related to the failure can be stored, and the program that executes the related information can also be stored. And the central processing unit 9100 can execute the program stored in the memory 9140 to implement information storage or processing, etc.

The input unit 9120 provides input to the central processor 9100. The input unit 9120 is, for example, a key or a touch input device. Power supply 9170 is used to provide power to electronic device 9600. The display 9160 is used to display display objects such as images and text. The display may be, for example, an LCD display, but is not limited thereto.

The memory 9140 may be a solid-state memory, such as a read-only memory (ROM), a random access memory (RAM), a SIM card, etc. It can also be a memory that retains information even when the power is turned off, can be selectively erased and provided with more data, examples of this memory are sometimes called EPROM, etc. Memory 9140 may also be some other type of device. Memory 9140 includes buffer memory 9141 (sometimes referred to as a buffer). The memory 9140 may include an application/function storage part 9142 for storing application programs and function programs or a flow for executing operations of the electronic device 9600 through the central processor 9100 .

The memory 9140 may also include a data storage 9143 for storing data such as contacts, digital data, pictures, sounds, and/or any other data used by the electronic device. The driver storage portion 9144 of the memory 9140 may include various drivers of the electronic device for communication functions and/or for performing other functions of the electronic device (such as messaging applications, address book applications, etc.).

The communication module 9110 is the transmitter/receiver 9110 that sends and receives signals via the antenna 9111. A communication module (transmitter/receiver) 9110 is coupled to the central processor 9100 to provide input signals and receive output signals, which may be the same as in a conventional mobile communication terminal.

Based on different communication technologies, multiple communication modules 9110 can be provided in the same electronic device, such as a cellular network module, a Bluetooth module, and/or a wireless LAN module, etc. The communication module (transmitter/receiver) 9110 is also coupled to a speaker 9131 and a microphone 9132 via an audio processor 9130 to provide audio output via the speaker 9131 and receive audio input from the microphone 9132 to implement general telecommunications functions. Audio processor 9130 may include any suitable buffers, decoders, amplifiers, etc. In addition, the audio processor 9130 is also coupled to the central processor 9100, thereby enabling recording on the local machine through the microphone 9132, and enabling sound stored on the local machine to be played through the speaker 9131.

Embodiments of the present application also provide a computer-readable storage medium that can implement all steps in the optical illusion naked-eye 3D content production method in the above embodiments, in which the execution subject is a server or a client. The computer-readable storage medium stores There is a computer program. When the computer program is executed by the processor, all the steps of the optical illusion naked-eye 3D content production method in the above embodiment are implemented in which the execution subject is the server or the client. For example, when the processor executes the computer program, it is implemented. Following steps:

Step S101: Obtain the basic image perspective information and elevation information of the screen display scene, and perform inverse summation scene simulation of camera parameters at the viewing site;

Step S102: Carry out content design based on the realistic scene structure and creatively associate it with the shape of the real-scene LED, and conduct CG scene production and preliminary inspection within the scene, and conduct real-shot camera simulation, shooting, and synthesis with CG content;

Step S103: According to the required resolution size of the LED screen, the scene under the CG camera will be resolution matched and rendered. The output video sequence will be expanded to the LED in the three-dimensional scene through baking in the CG software. On the screen model, and obtain the final 3D optical illusion screen video format result according to the file format requirements required by the screen.

As can be seen from the above description, the computer-readable storage medium provided by the embodiments of the present application can effectively ensure a unified look and feel and a correct perspective relationship during multi-screen simulcast by establishing a unified standardized production process.

Those skilled in the art will understand that embodiments of the present invention may be provided as methods, devices, or computer program products. Thus, the invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (apparatus), and computer program products according to embodiments of the invention. It will be understood that each process and/or block in the flowchart illustrations and/or block diagrams, and combinations of processes and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine, such that the instructions executed by the processor of the computer or other programmable data processing device produce a use A device for implementing the functions specified in one process or processes of the flowchart and/or one block or blocks of the block diagram.

These computer program instructions may also be stored in a computer-readable memory that causes a computer or other programmable data processing apparatus to operate in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction means, the instructions The device implements the functions specified in a process or processes of the flowchart and/or a block or blocks of the block diagram.

These computer program instructions may also be loaded onto a computer or other programmable data processing device, causing a series of operating steps to be performed on the computer or other programmable device to produce computer-implemented processing, thereby executing on the computer or other programmable device. Instructions provide steps for implementing the functions specified in a process or processes of a flowchart diagram and/or a block or blocks of a block diagram.

The present invention uses specific embodiments to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for those of ordinary skill in the art, based on this The idea of the invention will be subject to change in the specific implementation and scope of application. In summary, the contents of this description should not be understood as limiting the invention.

Claims (10)

1. A method for producing naked eye 3D content with optical illusion, the method comprising:

basic image perspective information and elevation angle information of a screen display scene are obtained, and reverse summation of camera parameters of a viewing site and scene simulation are carried out;

content design is carried out based on a real scene structure, creative association is carried out based on the modeling of a real scene LED, CG scene making and primary detection in the scene are carried out, and simulation, shooting and synthesis with CG content of a real shooting camera are carried out;

and performing resolution matching and rendering output on the scene under the CG video camera according to the resolution size required by the LED screen, unfolding the output video sequence to an LED screen model in the three-dimensional scene in a baking mode in CG software, and obtaining a video format result of the final 3D visual illusion screen according to the file format requirement required by the screen.

2. The method for producing naked eye 3D content according to claim 1, wherein the performing camera inverse sum scene simulation of the viewing scene comprises:

the back-solving and simulation calculation of the camera angle are carried out through the data information, the image information and the screen parameters acquired by the live-action, and the camera parameters are calculated by using a perspective formula algorithm;

And constructing a simple model according to the live-action, positioning average test points on a model screen, respectively placing basic geometric bodies for calibration, and obtaining the perspective deformation effect of screen content based on the visual angle of the fan-shaped angle of the camera simulation field survey in a matrix arrangement mode.

3. The method for creating the naked eye 3D content according to claim 1, wherein the steps of CG scene creation and in-scene preliminary detection include:

completing model making, scene building, material mapping, animation making, lamplight arrangement and rendering output in CG making software according to a design scheme and making requirements to obtain CG scenes meeting making requirements;

and (3) carrying out preliminary detection on the manufacture of the CG scene in the observation area, and adjusting the structure with stretching deformation in the observation area.

4. The method for creating the naked eye 3D content according to claim 1, wherein the steps of performing real camera simulation, photographing and synthesizing with CG content include:

simulating real character model performance and manufacturing a low-surface number three-dimensional character model, adding a calibration basic geometric body to a scene as a background, dividing areas for each three-dimensional model of the character and the background, marking a digital number, and obtaining preliminary real shooting camera position parameter information by combining the condition of an actual shooting place and shooting equipment parameters and scaling the position of a camera in a CG scene and moving the camera in the CG scene or changing the shooting angle according to the three-dimensional space relation between a main element model and a virtual scene in the optimal view point positioning design;

Setting up a real shooting curtain table according to camera parameters and real scene shooting conditions, and arranging light matched with a three-dimensional scene light source;

and separating the character performance content, synthesizing the character performance content into a three-dimensional scene, and correcting colors.

5. An optical illusion-like naked eye 3D content creation apparatus, comprising:

the restoration simulation module is used for acquiring basic image perspective information and elevation angle information of the screen display scene and performing camera parameter inverse summation scene simulation of the watching site;

the content detection module is used for carrying out content design based on a real scene structure, carrying out creative association based on the modeling of a real scene LED, carrying out CG scene making and primary detection in the scene, and carrying out real shooting camera simulation, shooting and synthesizing with CG content;

the content synthesis module is used for carrying out resolution matching and rendering output on the scene under the CG camera according to the resolution size required by the LED screen, expanding the output video sequence onto an LED screen model in the three-dimensional scene in a baking mode in CG software, and obtaining a video format result of the final 3D visual illusion screen according to the file format requirement required by the screen.

6. The optical illusion-type naked eye 3D content producing device according to claim 5, wherein the reduction simulation module includes:

the camera parameter determining unit is used for carrying out inverse calculation and simulation calculation of the camera angle through data information, image information and screen parameters acquired by live-action, and calculating to obtain camera parameters by using a perspective formula algorithm;

and the perspective deformation effect determining unit is used for constructing a simple model according to the live-action, positioning average test points on a model screen, respectively placing basic geometric bodies for calibration, and simulating the view angle of the fan-shaped angle of the field survey based on the camera in a matrix arrangement mode to obtain the perspective deformation effect of the screen content.

7. The optical illusion-type naked eye 3D content producing device according to claim 5, wherein the content detecting module includes:

the CG scene making unit is used for completing model making, scene building, material mapping, animation making, light arrangement and rendering output in CG making software according to the design scheme and making requirements to obtain a CG scene meeting the making requirements;

and the structure adjusting unit is used for carrying out preliminary detection on the manufacture of the CG scene in the observation area and adjusting the structure with stretching deformation in the observation area.

8. The optical illusion-type naked eye 3D content producing device according to claim 5, wherein the content synthesizing module includes:

the camera position parameter determining unit is used for simulating the performance of a real role model and manufacturing a low-surface number three-dimensional role model, adding a calibration basic geometric body into a scene to serve as a background, dividing areas for each three-dimensional model of the role and the background, marking a digital number, and obtaining preliminary real camera position parameter information by combining the condition of an actual shooting place and shooting equipment parameters and scaling the position of a camera in a CG scene and moving the position of the camera in the CG scene or changing the shooting angle according to the three-dimensional space relation between a main element model and a virtual scene in the optimal view point positioning design;

the scene building unit is used for building a real shooting curtain table according to camera parameters and real scene shooting conditions, and arranging lamplight matched with the three-dimensional scene light source;

and the synthesizing unit is used for separating the character performance content, synthesizing the character performance content into a three-dimensional scene and correcting colors.

9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the optical illusion-like naked eye 3D content producing method according to any one of claims 1 to 4 when executing the program.

10. A computer-readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the optical illusion-like naked eye 3D content producing method according to any one of claims 1 to 4.