CN114399425B - Image processing method, video processing method, device, equipment and medium - Google Patents

Abstract

The embodiment of the disclosure discloses an image processing method, a video processing method, a device, equipment and a medium. The image processing method comprises the following steps: acquiring an initial image, and extracting at least one group of color data in the initial image; forming corresponding light beams based on any one of the at least one set of color data; superposing the light beams to form a light beam effect diagram corresponding to the initial image; and superposing the beam effect image into the initial image to form a beam effect image. And (3) taking the light beam in the light beam effect graph as the light beam emitted by the virtual light source simulating holographic projection, and adding the light beam effect graph into the initial image to form a light beam effect image. By adding the simulated light beam in the image, a simulated effect of adding the holographic projection in the image is achieved.

Description

Image processing method, video processing method, device, equipment and medium

Technical Field

The embodiments of the present disclosure relate to the field of image processing technology, and in particular to an image processing method, a video processing method, an apparatus, a device, and a medium.

Background technique

With the demand for image and video display, adding special effects to image or video frames has become a common processing method. However, the current special effect processing methods are still limited in variety and insufficient to meet user needs.

Summary of the invention

The embodiments of the present disclosure provide an image processing method, a video processing method, an apparatus, a device and a medium to achieve adding a projection beam effect on an image.

In a first aspect, an embodiment of the present disclosure provides an image processing method, including:

Acquire an initial image, and extract at least one set of color data from the initial image;

Form corresponding light beams respectively based on any set of color data in the at least one set of color data;

superimposing the light beams to form a light beam effect diagram corresponding to the initial image;

The light beam effect diagram is superimposed on the initial image to form a light beam effect image.

In a second aspect, the present disclosure also provides a video processing method, including:

Acquire video data to be projected, and adjust the tone of the video data to the projection tone;

For the image frame in the hue-adjusted video data, at least one group of color data in the image frame is extracted, corresponding light beams are formed based on any one group of color data in the at least one group of color data, the light beams are superimposed to form a light beam effect diagram corresponding to the image frame, and the light beam effect diagram is superimposed on the image frame to obtain special effect video data.

In a third aspect, the present disclosure also provides an image processing device, including:

A color data extraction module, used to obtain an initial image and extract at least one set of color data from the initial image;

A light beam generating module, which forms corresponding light beams based on any one of the at least one set of color data;

A beam effect generating module, used for superimposing the beams to form a beam effect diagram corresponding to the initial image;

The beam effect image generating module is used for superimposing the beam effect diagram onto the initial image to form a beam effect image.

In a fourth aspect, the present disclosure also provides a video processing device, including:

A video data acquisition module, used to acquire video data to be projected;

A tone adjustment module, used for adjusting the tone of the video data to a projection tone;

A video processing module is used to extract at least one set of color data from an image frame in the hue-adjusted video data, form corresponding light beams based on any one set of color data in the at least one set of color data, superimpose the light beams to form a light beam effect diagram corresponding to the image frame, and superimpose the light beam effect diagram onto the image frame to obtain special effect video data.

In a fifth aspect, an embodiment of the present disclosure further provides an electronic device, the electronic device comprising:

one or more processors;

a storage device for storing one or more programs,

When the one or more programs are executed by the one or more processors, the one or more processors implement the image processing method or video processing method as described in any one of the embodiments of the present disclosure.

In a sixth aspect, the embodiments of the present disclosure further provide a storage medium comprising computer executable instructions, which, when executed by a computer processor, are used to execute the image processing method or video processing method as described in any one of the embodiments of the present disclosure.

The technical solution of the disclosed embodiment is to extract at least one set of color data from the initial image, form a corresponding light beam based on each set of color data, superimpose the light beams generated for each set of color data to form a light beam effect diagram corresponding to the initial image, and superimpose the light beam effect diagram onto the initial image to form a light beam effect image. By adding a simulated light beam to the image, a projection simulation special effect is added to the image.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.

FIG1 is a schematic diagram of a flow chart of an image processing method provided by an embodiment of the present disclosure;

FIG2 is a schematic diagram of an initial light beam provided by an embodiment of the present disclosure;

FIG3 is a schematic diagram of a focused light beam provided by an embodiment of the present disclosure;

FIG4 is a schematic diagram of a target light beam provided by an embodiment of the present disclosure;

FIG5 is a schematic diagram of a light beam effect of an initial image provided by an embodiment of the present disclosure;

FIG6 is a schematic flow chart of a video processing method provided by an embodiment of the present disclosure;

FIG7 is a schematic diagram of a transparent template provided by an embodiment of the present disclosure;

FIG8 is a schematic diagram of the structure of an image processing device provided by an embodiment of the present disclosure;

FIG9 is a schematic diagram of the structure of a video processing device provided by an embodiment of the present disclosure;

FIG. 10 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure.

Detailed ways

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and/or in parallel. In addition, the method embodiments may include additional steps and/or omit the steps shown. The scope of the present disclosure is not limited in this respect.

The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

FIG1 is a flow chart of an image processing method provided by an embodiment of the present disclosure. The embodiment of the present disclosure is suitable for setting a beam effect of simulated holographic projection in an image or video. The method can be executed by an image processing device provided by an embodiment of the present disclosure. The image processing device can be implemented in the form of software and/or hardware. Optionally, it can be implemented by an electronic device, which can be a mobile terminal or a PC. As shown in FIG1, the method of this embodiment includes:

S110: Acquire an initial image, and extract at least one set of color data from the initial image.

S120, forming corresponding light beams based on any one set of color data in at least one set of color data.

S130, superimposing the light beams to form a light beam effect diagram corresponding to the initial image.

S140, superimposing the light beam effect diagram onto the initial image to form a light beam effect image.

In this embodiment, the initial image is the image to be processed, and the simulated beam effect of holographic projection is added to the initial image to obtain the effect image of simulated holographic projection. The image can be an image collected in real time or an imported image. In some embodiments, the initial image is a partial image frame or all image frames in the video. For example, the simulated beam effect of holographic projection can be added to each frame of the video to obtain the effect video of simulated holographic projection. In some embodiments, the initial image is an image frame collected in real time by the camera device. Taking live broadcast as an example, during the live broadcast process, the image frame is collected in real time, and the beam effect is added to the collected partial image frame or all image frames respectively. For example, the simulated beam effect of holographic projection can be added to each frame of the live broadcast to obtain the effect live data stream of simulated holographic projection. For example, in the display interface of the live broadcast device, a special effect processing control can be configured. When the special effect processing control is detected to be selected, the beam effect is set for each collected image.

The light beam effect in this embodiment is generated based on the color data in the initial image. Accordingly, different initial images correspond to different light beam effects, so that the light beam effect changes with the image, thereby improving the randomness and flexibility of the light beam effect and avoiding the poor simulation effect caused by a fixed light beam effect.

At least one set of color data is extracted from the initial image, and any set of color data in the at least one set of color data can be used to generate a simulated light beam. In some embodiments, color data in a pixel row in the initial image can be extracted as a set of color data, and the pixel row can be a pixel row at any position in the initial image, which can be randomly determined, and multiple pixel rows do not overlap.

In some embodiments, color data in any pixel column in the initial image may be extracted as a set of color data. The pixel column may be any pixel column in the initial image and may be randomly determined. Multiple pixel columns do not overlap.

In some embodiments, the color data of the pixel points on any extraction line in the initial image can be extracted as a set of color data, wherein the extraction line can be a straight line at any angle in the initial image, and the extraction line can be a horizontal extraction line, a vertical extraction line, or a slanted line at any inclination angle.

In some embodiments, multiple groups of color data may be used to generate multiple light beams, and the number of groups of color data is not limited and can be set according to user needs. Exemplarily, the number of groups of color data may be pre-set, or may be a parameter input by a user according to an input control of an interactive interface, and the parameter may include the number of groups of color data, wherein the input control may be an input box, a data selection slider, or a data increase/decrease control, etc., and is not limited thereto, as long as it has a data input function.

The color data may be extracted based on one or more forms of randomly determined pixel rows, pixel columns, and extraction lines in the initial image, wherein the extraction method of any set of color data may be randomly determined. Optionally, multiple sets of color data in the same initial image may be determined based on one extraction method or different extraction methods. In some embodiments, the extraction method of user input may be collected based on the virtual controls of the interactive interface, wherein the extraction methods include pixel row extraction, pixel column extraction, random line extraction, mixed extraction, and the like.

In some embodiments, extracting at least one set of color data in the initial image may be detecting a color extraction operation input by a user on an interactive interface, and obtaining corresponding color data based on the color extraction operation. The color extraction operation may be a sliding touch operation, extracting color data on a sliding track corresponding to the sliding touch operation, and taking the color data on a continuous sliding track as a set of color data, or collecting color data on a sliding track, grouping the collected color data based on a preset number, and dividing to obtain multiple sets of color data. The color extraction operation may also be a row/column selection touch operation, that is, the color extraction operation is a click operation, determining a position point corresponding to the color extraction operation, and determining the color data corresponding to the pixel row or pixel column where the position point is located as a set of color data.

It should be noted that if the initial image belongs to an image frame in a video or an image frame in a live video stream, the same settings can be performed on all images in the video/video stream or on images after the timestamp of the initial image based on the above settings.

In this embodiment, an interactive control is provided on the interactive interface to enable interaction between the user and the electronic device, thereby generating a corresponding light beam effect according to the user's settings, thereby improving the interactivity of the light beam effect during the generation process.

In some embodiments, after acquiring the initial image, the method further includes: segmenting the initial image to obtain a beam reference object, and forming a beam reference image based on the segmented beam reference object and a preset background. The beam reference object may be a simulated object for holographic projection in the initial image. For example, the beam reference object may include but is not limited to a person, an animal, etc. The beam reference object may be specified by the user or automatically identified. For example, taking the beam reference object as a person, for each initial image, the portrait in the initial image is identified, and the portrait is automatically identified and segmented to obtain the segmented beam reference object. For example, the beam reference object may also be a specific person, which may be identified in the initial image according to preset person information. When the initial image includes a specific person, the beam reference object is segmented. The segmented beam reference object is added with a preset background to form a beam reference image, wherein the preset background may be a monochrome background, such as a white background or a black background, etc. The background in the initial image is replaced by the monochrome background to reduce the color interference of the original background.

Correspondingly, extracting at least one set of color data from the initial image includes: extracting at least one set of color data from the light beam reference image. The method of extracting each set of color data from the light beam reference image is the same as the method of extracting color data from the initial image in the above embodiment, and will not be repeated here.

In some embodiments, the at least one set of color data is color data of an extraction line in the initial image or the light beam reference image, and the extraction line is a pixel row or pixel column in the initial image or the light beam reference image. The color data is extracted by extracting the extraction line, and the color variation in the same set of color data is improved to avoid the situation of a single color, so as to improve the color effect of the light beam.

Each set of color data is processed to obtain a corresponding light beam. Optionally, corresponding light beams are formed based on any set of color data in at least one set of color data, including: for any set of color data in at least one set of color data, a color line is formed based on each color value in the color data to form an initial light beam corresponding to the color data; the initial light beam is gathered based on a virtual light source, and the gathered light beam is split and extracted to obtain a target light beam corresponding to the color data.

The direction of the color line is determined according to the simulated projection direction of the holographic projection. For example, if the simulated projection direction is from bottom to top or from top to bottom, the direction of the color line is vertical. If the simulated projection direction is from left to right or from right to left, the direction of the color line is horizontal. In this embodiment, each group of color data is extracted based on an extraction line such as a pixel row/pixel column, and the corresponding color data is sorted according to the position of each pixel point on the extraction line. Based on the positional relationship of each color data, multiple color lines with the same positional relationship are formed, and the color lines corresponding to each color data form an initial light beam. For example, taking the extraction of color data based on a pixel row as an example, the color data of the first pixel point on the pixel row (for example, data a) forms a first color line, which can be a numerical color line, that is, a first pixel column, and the color data of each pixel point on the pixel column is the same (that is, data a), and the color data of the second pixel point on the pixel row (for example, data b) forms a second color line, that is, a second pixel column, and so on, to obtain an initial light beam. For example, see Figure 2, which is a schematic diagram of an initial light beam provided in an embodiment of the present disclosure.

In order to simulate the beam effect of holographic projection, the initial beam is focused to simulate the effect of the virtual light source on the emitted beam. Optionally, the focusing is performed based on the setting position of the virtual light source, where the setting position of the virtual light source can be pre-set or determined according to the simulated projection direction of the holographic projection. Taking the simulated projection direction from bottom to top as an example, the setting position of the virtual light source can be the bottom center position of the initial beam, and taking the simulated projection direction from top to bottom as an example, the setting position of the virtual light source can be the top center position of the initial beam.

Optionally, focusing the initial light beam based on the virtual light source includes: determining a beam range of the focused light beam based on the virtual light source, extracting color data within the beam range from the initial light beam, and obtaining the focused light beam. Referring to FIG2 , FIG2 includes the initial light beam and the background. In the focusing process in this embodiment, for the initial light beam, the background is eliminated during the focusing process to avoid background interference.

The beam range of the focused light beam is a triangular range with the position of the focused light beam as the vertex and the width of the initial light beam as the base width. For example, see FIG3 , which is a schematic diagram of a focused light beam provided in an embodiment of the present disclosure, wherein the position of the beam vertex in FIG3 is the setting position of the virtual light source. Among them, each pixel point outside the beam range of the focused light beam is set as a background color, and the color data of each pixel point within the beam range of the focused light beam is determined based on the color data of the corresponding pixel point in the initial light beam. Specifically, for any pixel point within the beam range of the focused light beam, based on the pixel coordinates of the pixel point, the color data corresponding to the pixel coordinates is extracted in the initial light beam, and the pixel point within the beam range of the focused light beam is set accordingly based on the extracted color data to form a focused light beam.

The converged light beam is a triangular light beam, which does not meet the projection effect. In order to improve the simulation authenticity of the holographic projection, the converged light beam is split into multiple sub-beams, and recognizable sub-beams are extracted from the multiple sub-beams to form a target beam.

Optionally, the focused light beam is split and extracted to obtain a target light beam corresponding to the color data, including: determining the color difference between adjacent light beams in the focused light beam based on a preset step size in the width direction of the light beam; extracting a target split beam in the focused light beam based on the color difference to form a target light beam. Taking the clustered light beam in FIG3 as an example, the image of the focused light beam can be set under the UV coordinate, and its simulated projection direction is from bottom to top, that is, projected in the y direction, and correspondingly, the width direction of the light beam is the x direction. The focused light beam is divided into a plurality of sub-beams based on a preset step size, wherein the sub-beams are divided on the widest side of the focused light beam based on the preset step size to provide the accuracy of the light beam division. The preset step size can be pre-set or adjusted according to user needs. For example, a step size adjustment control can be provided in the interactive interface to obtain the step size parameter input by the user. Exemplarily, under the UV coordinate, the preset step size can be 0.05.

Obtain color data of each sub-beam after division, wherein the color data of the sub-beam may be the color data of the central color line of the sub-beam, or may be the color average of each color line in the sub-beam, without limitation. Determine the color difference of adjacent sub-beams, which may be to compare the color difference with a judgment threshold to determine the recognition of the sub-beam, and further determine whether to retain the sub-beam. By discarding sub-beams with small color changes and poor recognition, a recognizable target beam is obtained.

In some embodiments, extracting a target beam in the converged beam based on the color difference may be: for any sub-beam in the converged beam, determining the first color difference between the current sub-beam and the first adjacent sub-beam, and the second color difference between the current sub-beam and the second adjacent sub-beam, and comparing the sum of the difference between the first color difference and the second color difference with a preset threshold. When the sum of the difference is greater than or equal to the preset threshold, it indicates that the color change is large, and the current sub-beam is retained. When the sum of the difference is less than the preset threshold, it indicates that the color change is small, and the current sub-beam is discarded. The preset threshold may be set according to user needs. In some embodiments, the preset threshold may be in the range of 0.5-0.9, for example, 0.6.

Exemplarily, see FIG. 4, which is a schematic diagram of a target beam provided by an embodiment of the present disclosure. The target beam is generated based on a set of extracted color data. For each set of color data, a target beam such as FIG. 4 can be formed, and multiple target beams are superimposed to obtain a beam effect diagram of the initial image, wherein beam superposition is performed based on the virtual light source of each target beam, that is, the virtual light source position of each beam is superimposed at the same position to form a beam effect diagram. The beam effect diagram is added to the initial image, for example, the background of the beam effect diagram can be removed, and the extracted beam is superimposed in the initial image. Optionally, the extracted beam is superimposed based on the holographic projection simulation object in the initial image. Specifically, according to the projection simulation position in the initial image, the position of the virtual light source corresponding to the beam is determined, and the extracted beam is superimposed based on the position of the virtual light source. For example, the position of the virtual light source corresponding to the beam can be determined based on the simulated projection direction and the simulated projection position. Taking the simulated projection direction from bottom to top as an example, the position of the virtual light source corresponding to the beam is the bottom of the position of the holographic projection simulation object. Taking the simulated projection direction from top to bottom as an example, the position of the virtual light source corresponding to the beam is the top of the position of the holographic projection simulation object.

In some embodiments, superimposing the beam effect diagram onto the initial image to form the beam effect image may also be: adding the beam effect diagram to the beam reference image to form a simulated image of a holographic projection simulation of the beam reference object.

On the basis of the above embodiment, after corresponding light beams are formed based on any set of color data, before being superimposed on the initial image, the method further includes: setting the transparency of the light beam, for example, the transparency of each generated light beam can be set, or the transparency of a local light beam can be set. Wherein, the transparency increases successively along the projection direction of the light beam. Since light dissipates during the propagation of light in space, the color change of light gradually fades in the projection direction. In order to improve the simulation effect of holographic projection, the transparency of the obtained light beam is set to simulate the change of the light beam in space. The transparency of the light beam can be in the range of 0-100%, and the larger the transparency value, the higher the transparency.

In this embodiment, the transparency of the light beam is set to increase successively along the projection direction of the light beam, that is, the transparency of the light beam at the virtual light source position is 0, the transparency at the end of the light beam can be 100%, and the transparency changes uniformly in the projection direction. For example, see Figure 5, which is a schematic diagram of the light beam effect of the initial image provided by the embodiment of the present disclosure. Figure 5 includes multiple superimposed light beams and the transparency set for the superimposed light beams. The light beam in Figure 5 is added to the initial image to achieve the effect of simulating the holographic projection technology in the image.

For a video including multiple initial images, or a video stream collected in real time during a live broadcast, based on the above method, the light beam effect corresponding to each image is determined in turn, and the light beam effect is added to the corresponding image to obtain a simulated video or simulated video stream of the projection effect.

The technical solution provided in this embodiment is to extract at least one set of color data from the initial image, form a corresponding light beam based on each set of color data, superimpose the light beams generated for one or more sets of color data to form a light beam effect diagram corresponding to the initial image, and superimpose the light beam effect diagram onto the initial image to form a light beam effect image. By adding a simulated light beam to the image, a projection effect is simulated in the image.

On the basis of the above embodiments, the present disclosure further provides a video processing method, see Figure 6, which is a flow chart of a video processing method provided by an embodiment of the present disclosure. The embodiment of the present disclosure is suitable for simulating the situation of holographic projection by adding a beam effect of holographic projection to the video. The method can be executed by the video processing device provided by the embodiment of the present disclosure. The video processing device can be implemented in the form of software and/or hardware, and optionally, it can be implemented by an electronic device, which can be a mobile terminal or a PC, etc.

S210, obtaining video data to be projected, and adjusting the tone of the video data to the projection tone.

S220. For an image frame in the hue-adjusted video data, extract at least one group of color data in the image frame, form corresponding light beams based on any one group of color data in the at least one group of color data, superimpose the light beams to form a light beam effect diagram corresponding to the image frame, and superimpose the light beam effect diagram onto the image frame to obtain special effect video data.

The hue of the virtual image formed by holographic projection technology is different from the standard hue of the image. In order to improve the simulation authenticity of the holographic projection, the hue of the video data is adjusted to the projection hue.

In this embodiment, a conversion relationship between the projection tone and the standard tone is preset, and the color data of the pixel points in each frame image in the video data is converted based on the above conversion relationship to obtain video data that meets the projection tone, so as to improve the simulation authenticity of the holographic projection.

It should be noted that the projection color tone can be a fixed one, or multiple projection colors can be set according to different projection scenes. Correspondingly, the conversion relationship between the projection color tone and the standard color tone can change with the change of the projection color tone, so as to achieve data conversion that satisfies any projection color tone. For example, the conversion relationship between multiple projection colors and standard colors can be pre-stored for easy calling.

In some embodiments, the projection hue includes a blue hue. Optionally, adjusting the hue of the video data to the projection hue includes: converting the color data of the image frame in the video data into color data corresponding to the blue hue according to a conversion relationship between the channel color data in the current hue and the channel color data in the blue hue.

The image frame in the video data may be an RGB image, and the color data of the pixel in the image frame may be (R, G, B, A), where R, G, B are the data of the three channels of red, green and blue, respectively, and A is the transparency of the pixel. The hue of the image is a standard hue, and the image is converted to an image in a blue hue. Exemplarily, the color data conversion relationship between the current hue and the blue hue may be:

T.r＝E.r/2.5

T.g＝E.g/2.5

T.b＝(E.r+E.g+E.b)/3.0

T.a＝E.a

Among them, E.r, E.g, E.b and E.a are the data of the red, green and blue channels and the transparency data under the current hue respectively, and T.r, T.g, T.b and T.a are the data of the red, green and blue channels and the transparency data under the blue hue respectively.

Since there is a certain amount of jitter during simulated projection, in order to improve the authenticity of the simulation, based on the above embodiment, before adjusting the tone of the video data to the projection tone, the method further includes: performing random jitter processing on the video data. Exemplarily, a jitter parameter is generated for any frame image, and the color data of the image is updated based on the jitter parameter. Exemplarily, the jitter parameter is accumulated to the original color data. Among them, the random jitter parameter is generated based on the timestamps of different images to increase the randomness of the jitter parameter.

In some embodiments, the coordinate system where the video data is located may be randomly jittered to generate jitter parameters at each moment, the coordinate system may be updated based on the jitter parameters, and color data may be extracted from the updated coordinate system to achieve jitter setting for the video data.

A projection beam effect is added to each frame image in the video after the tone conversion, and the projection beam effect can be generated based on the image processing method provided in the above embodiment. For example, each frame image in the video data is used as the initial image, at least one set of color data in the initial image is extracted, and corresponding light beams are respectively formed based on any set of color data in at least one set of color data, and the generated partial or all light beams are superimposed to form a light beam effect diagram corresponding to the initial image, and the light beam effect diagram is superimposed on the corresponding initial image to form a light beam effect image, and each frame is added with a light beam effect image to form simulated projection video data, that is, processed special effect video data.

In some embodiments, the special effects video data is displayed in an augmented reality manner to form a virtual image in the display space. The virtual image has a projection color tone and a projection simulation light beam, thereby realizing the effect simulation of the holographic projection technology based on the augmented reality technology.

In some embodiments, after acquiring the video data, the portraits in each frame of the video data may be extracted, that is, the background in each frame is removed and replaced with a monochrome background, such as a black, white background, or a transparent background. The above-mentioned projection effect simulation processing is performed on the video data after the background is replaced. In the process of displaying the special effect video data, the holographic projection of the characters in the video data can be simulated, avoiding the interference of the background data in the video data.

The technical solution provided in this embodiment realizes the simulation of holographic projection based on video data by adjusting the video data to the projection tone of holographic projection and adding the light beam effect of simulated holographic projection to each image.

On the basis of the above embodiments, the present disclosure also provides a preferred example of a video processing method. The video data to be processed is obtained. Since there is a certain jitter during the simulation projection, the random jitter data N is obtained using the time parameter T, where N is very small. The random jitter data N is superimposed on the UV coordinate, that is, fuv = (uv.x + N.x, uv.y + N.y). The color data of the image is collected on the UV coordinate, resulting in a certain jitter, thereby improving the authenticity of the simulation.

The hue of the video data is converted into a blue tone, that is, the proportion of the blue channel is increased through the conversion formulas of T.r=E.r/2.5, T.g=E.g/2.5, T.b=(E.r+E.g+E.b)/3.0 and T.a=E.a, thereby converting the image into a blue tone.

Add a beam effect to each frame. For each frame in the video data, extract the projection object in the image by cutting out the image, such as the portrait in the image, and set the background of the portrait to black. In the shader of material rendering, use UV coordinates to sample the color information in the image, that is, the coordinates of each pixel in the image are (x, y), for example: uv = (0.5, 0.5), then use this uv to sample the color data, the color value type is (R, G, B, A), representing the red, green, blue, and transparency channels respectively, and the value range of each channel is 0 to 1.

Select the pixel color on y=y0 (i.e. a set of color data), replace all the colors in the y direction, and form a bunch of strips in the vertical direction (i.e. the initial beam), see Figure 2. Set the light source point of the beam to P (0.5, 0), transform the initial beam, and gather it to point p to obtain a concentrated beam, see Figure 3. Separate the beams in Figure 3 into sub-beams, and compare the pixels in the x direction. The sub-beams with larger pixel value differences are retained, and the sub-beams with smaller pixel value differences are discarded. Specifically, for the current uv＝(p,q) position, the sampled pixel is Q0, the sampled pixel of uv＝(p+0.05,q) is Q1, the sampled pixel of uv＝(p-0.05,q) is Q2, and the difference L10＝Q1-Q0, L21＝Q2-Q1 are obtained, and the difference sum D＝L10+L21 is obtained. If D<0.6, it means that the color change here is relatively small and it is discarded. Otherwise, it is retained to obtain the target light beam, see Figure 4.

After the light beam is emitted, it will gradually weaken with the distance, and the intensity of the light beam is controlled by the preset transparency. Set a transparent template M, see Figure 7 for an example, Figure 7 is a schematic diagram of a transparent template provided by an embodiment of the present disclosure. The transparency value A1 in Figure 7, the whiter the higher the transparency, the darker the lower the transparency. The projection direction in Figure 7 is from bottom to top, and the transparency gradually increases along the projection line. The transparency in the transparent template M and the obtained target light beam are superimposed to complete a set of light beam effects. Based on the color data corresponding to multiple y0, corresponding light beam effects are respectively formed, and multiple light beam effects are superimposed to form a light beam effect image, see Figure 5.

The beam effect in the beam effect image corresponding to each frame of the image is added to the corresponding image to form special effect video data. The special effect video data is placed in the AR scene for display, and interactions such as conversations with people in the video data can be achieved in the AR scene.

FIG8 is a schematic diagram of the structure of an image processing device provided by an embodiment of the present disclosure. As shown in FIG8 , the device includes:

A color data extraction module 310 is used to obtain an initial image and extract at least one set of color data from the initial image;

A light beam generating module 320, which forms corresponding light beams based on any one of the at least one set of color data;

A beam effect generating module 330, configured to superimpose the beams to form a beam effect diagram corresponding to the initial image;

The beam effect image generating module 340 is used to superimpose the beam effect diagram onto the initial image to form a beam effect image.

Based on the above embodiment, the device further includes:

A beam reference image generation module, configured to segment a beam reference object from the initial image after acquiring the initial image, and form a beam reference image based on the segmented beam reference object and a preset background;

The color data extraction module 310 is used to extract at least one set of color data from the light beam reference image.

Based on the above embodiment, the at least one set of color data is color data of an extracted line in the initial image or the light beam reference image, and the extracted line is a pixel row or pixel column in the initial image or the light beam reference image.

Based on the above embodiment, the light beam generating module 320 includes:

An initial light beam forming unit, configured to form a color line based on each color value in the color data for any one of the at least one set of color data, so as to form an initial light beam corresponding to the color data;

A beam focusing unit, used for focusing the initial light beam based on a virtual light source;

The target light beam generating unit is used to perform splitting extraction on the focused light beam to obtain a target light beam corresponding to the color data.

Optionally, a beam focusing unit is used to:

The beam range of the converged light beam is determined based on the virtual light source, and color data within the beam range is extracted from the initial light beam to obtain the converged light beam.

Optionally, the target beam generating unit is used to:

In the width direction of the light beam, determining the color difference between adjacent light beams in the converged light beam based on a preset step size;

A target beamlet is extracted from the converged beam based on the color difference to form a target beam.

Based on the above embodiment, the device further includes:

The transparency setting module is used to set the transparency of the light beam after forming a corresponding light beam based on any one of the at least one set of color data, wherein the transparency increases sequentially along the projection direction of the light beam.

Based on the above embodiment, the initial image is an image frame in a video, or the initial image is an image frame captured in real time by a camera device;

Correspondingly, the image frames in the video are respectively added with beam effects to form a beam effect video, or the image frames collected in real time are respectively added with beam effects to form a real-time beam effect video stream.

The device provided by the embodiments of the present disclosure can execute the method provided by any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method.

It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the embodiments of the present disclosure.

FIG9 is a schematic diagram of the structure of a video processing device provided by an embodiment of the present disclosure. As shown in FIG9 , the device includes:

The video data acquisition module 410 is used to acquire the video data to be projected;

A tone adjustment module 420, configured to adjust the tone of the video data to a projection tone;

The video processing module 430 is used to extract at least one group of color data from the image frame in the video data after the tone adjustment, form corresponding light beams based on any one group of color data in the at least one group of color data, superimpose the light beams to form a light beam effect diagram corresponding to the image frame, and superimpose the light beam effect diagram into the image frame to obtain special effect video data.

Based on the above embodiment, the device further includes:

The dithering processing module is used to perform random dithering processing on the video data before adjusting the tone of the video data to the projection tone.

Based on the above embodiment, the projection color tone includes a blue tone;

The hue adjustment module 420 is used to convert the color data of the image frame in the video data into color data corresponding to the blue hue according to the conversion relationship between the channel color data in the current hue and the channel color data in the blue hue.

Based on the above embodiment, the device further includes:

The special effect video data display module is used to display the special effect video data based on augmented reality.

The device provided by the embodiments of the present disclosure can execute the method provided by any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method.

It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the embodiments of the present disclosure.

Reference is made to FIG10, which shows a schematic diagram of the structure of an electronic device (e.g., a terminal device or server in FIG10) 400 suitable for implementing an embodiment of the present disclosure. The terminal device in the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (e.g., vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. The electronic device shown in FIG10 is only an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.

As shown in FIG10 , the electronic device 400 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 401, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 402 or a program loaded from a storage device 408 into a random access memory (RAM) 403. In the RAM 403, various programs and data required for the operation of the electronic device 400 are also stored. The processing device 401, the ROM 402, and the RAM 403 are connected to each other via a bus 404. An input/output (I/O) interface 405 is also connected to the bus 404.

Typically, the following devices may be connected to the I/O interface 405: input devices 406 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 407 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 408 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 409. The communication device 409 may allow the electronic device 400 to communicate wirelessly or wired with other devices to exchange data. Although FIG. 10 shows an electronic device 400 with various devices, it should be understood that it is not required to implement or have all the devices shown. More or fewer devices may be implemented or have alternatively.

In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 409, or installed from the storage device 408, or installed from the ROM402. When the computer program is executed by the processing device 401, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

The electronic device provided in the embodiment of the present disclosure and the image processing method or video processing method provided in the above-mentioned embodiment belong to the same inventive concept. The technical details not fully described in this embodiment can be referred to the above-mentioned embodiment, and this embodiment has the same beneficial effects as the above-mentioned embodiment.

An embodiment of the present disclosure provides a computer storage medium on which a computer program is stored. When the program is executed by a processor, the image processing method or video processing method provided in the above embodiment is implemented.

It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

The computer-readable medium may be included in the electronic device, or may exist independently without being installed in the electronic device.

The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device:

Acquire an initial image, and extract at least one set of color data from the initial image;

Based on any set of color data, corresponding light beams are formed respectively;

Superimposing the light beams to form a light beam effect diagram corresponding to the initial image;

The light beam effect diagram is superimposed on the initial image to form a light beam effect image.

or,

Acquire video data to be projected, and adjust the tone of the video data to the projection tone;

A projection beam effect is set for each frame image in the tone-adjusted video data to form special effect video data.

Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and/or flow chart, and the combination of the square boxes in the block diagram and/or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

The units involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the name of a unit/module does not, in some cases, constitute a limitation on the unit itself.

The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

According to one or more embodiments of the present disclosure, [Example 1] provides an image processing method, the method comprising:

Acquire an initial image, and extract at least one set of color data from the initial image;

Form corresponding light beams respectively based on any set of color data in the at least one set of color data;

superimposing the light beams to form a light beam effect diagram corresponding to the initial image;

The light beam effect diagram is superimposed on the initial image to form a light beam effect image.

According to one or more embodiments of the present disclosure, [Example 2] provides an image processing method, further comprising:

After acquiring the initial image, the method further includes: segmenting the initial image to obtain a beam reference object, and forming a beam reference image based on the segmented beam reference object and a preset background;

The extracting at least one set of color data from the initial image includes: extracting at least one set of color data from the light beam reference image.

According to one or more embodiments of the present disclosure, [Example 3] provides an image processing method, further comprising:

The at least one set of color data is color data of an extracted line in the initial image or the light beam reference image, and the extracted line is a pixel row or a pixel column in the initial image or the light beam reference image.

According to one or more embodiments of the present disclosure, [Example 4] provides an image processing method, further comprising:

Any one of the at least one set of color data forms a corresponding light beam, including: for any one of the at least one set of color data, a color line is formed based on the color value in the color data to form an initial light beam corresponding to the color data; based on a virtual light source, the initial light beam is gathered, and the gathered light beam is split and extracted to obtain a target light beam corresponding to the color data.

According to one or more embodiments of the present disclosure, [Example 5] provides an image processing method, further comprising:

The focusing of the initial light beam based on the virtual light source includes: determining a beam range of the focused light beam based on the virtual light source, extracting color data within the beam range from the initial light beam, and obtaining the focused light beam.

According to one or more embodiments of the present disclosure, [Example 6] provides an image processing method, further comprising:

The focused light beam is split and extracted to obtain a target light beam corresponding to the color data, including: determining the color difference between adjacent light beams in the focused light beam based on a preset step size in the width direction of the light beam; and extracting a target split beam in the focused light beam based on the color difference to form a target light beam.

According to one or more embodiments of the present disclosure, [Example 7] provides an image processing method, further comprising:

After forming corresponding light beams based on any one of the at least one set of color data, the method further includes: setting the transparency of the light beam, wherein the transparency increases sequentially along the projection direction of the light beam.

According to one or more embodiments of the present disclosure, [Example 8] provides an image processing method, further comprising:

The initial image is an image frame in a video, or the initial image is a frame image captured in real time by a camera device;

The image frames in the video are respectively added with beam effects to form a beam effect video, or the image frames collected in real time are respectively added with beam effects to form a real-time beam effect video stream.

According to one or more embodiments of the present disclosure, [Example 9] provides a video processing method, including:

Acquire video data to be projected, and adjust the tone of the video data to the projection tone;

For the image frame in the hue-adjusted video data, at least one group of color data in the image frame is extracted, corresponding light beams are formed based on any one group of color data in the at least one group of color data, the light beams are superimposed to form a light beam effect diagram corresponding to the image frame, and the light beam effect diagram is superimposed on the image frame to obtain special effect video data.

According to one or more embodiments of the present disclosure, [Example 10] provides a video processing method, further comprising:

Before adjusting the tone of the video data to the projection tone, the method further includes: performing random dithering processing on the video data.

According to one or more embodiments of the present disclosure, [Example 11] provides a video processing method, further comprising:

The projection hue includes a blue hue;

The adjusting the hue of the video data to the projection hue includes: converting the color data of the image frame in the video data into color data corresponding to the blue hue according to the conversion relationship between the channel color data in the current hue and the channel color data in the blue hue.

According to one or more embodiments of the present disclosure, [Example 12] provides a video processing method, further comprising:

The method also includes: displaying the special effect video data in an augmented reality manner.

According to one or more embodiments of the present disclosure, [Example 13] provides an image processing device, the device comprising:

A color data extraction module, used to obtain an initial image and extract at least one set of color data from the initial image;

A light beam generating module, which forms corresponding light beams based on any one of the at least one set of color data;

A beam effect generating module, used for superimposing the beams to form a beam effect diagram corresponding to the initial image;

The beam effect image generating module is used for superimposing the beam effect diagram onto the initial image to form a beam effect image.

According to one or more embodiments of the present disclosure, [Example 14] provides a video processing device, the device comprising:

A video data acquisition module, used to acquire video data to be projected;

A tone adjustment module, used for adjusting the tone of the video data to a projection tone;

A video processing module is used to extract at least one set of color data from an image frame in the hue-adjusted video data, form corresponding light beams based on any one set of color data in the at least one set of color data, superimpose the light beams to form a light beam effect diagram corresponding to the image frame, and superimpose the light beam effect diagram onto the image frame to obtain special effect video data.

The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other.

In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

Although the subject matter has been described in language specific to structural features and/or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims (15)

1. An image processing method, comprising:

acquiring an initial image, and extracting at least one group of color data in the initial image;

forming corresponding target light beams respectively based on any one of the at least one set of color data, wherein any one set of color data comprises a plurality of color data, and each set of color data corresponds to one target light beam;

Superposing the target light beams to form a light beam effect diagram corresponding to the initial image;

the beam effect image is overlapped to the initial image to form a beam effect image;

Wherein the forming of the corresponding target light beam based on any one of the at least one set of color data includes:

For any one of the at least one set of color data, forming a color line based on each of the color data in the any one set of color data, and forming an initial light beam corresponding to the any one set of color data based on the color lines respectively corresponding to the plurality of color data; the plurality of color lines in the initial beam are ordered based on the positional relationship of the color data in any one set of color data;

Gathering the initial light beams based on a virtual light source, and splitting and extracting the gathered light beams to obtain target light beams corresponding to the color data; the target beam is a beam having a color difference from an adjacent beam.

2. The method of claim 1, further comprising, after acquiring the initial image:

dividing the initial image to obtain a beam reference object, and forming a beam reference image based on the divided beam reference object and a preset background;

the extracting at least one set of color data in the initial image comprises:

At least one set of color data in the beam reference image is extracted.

3. The method according to claim 1 or 2, wherein the at least one set of color data is color data on extraction lines in the initial image or the beam reference image, the extraction lines being rows or columns of pixels in the initial image or the beam reference image.

4. The method of claim 1, wherein the gathering the initial light beam based on the virtual light source comprises:

and determining a beam range of the converging light beam based on the virtual light source, and extracting color data in the beam range from the initial light beam to obtain the converging light beam.

5. The method according to claim 1, wherein the beam splitting extraction is performed on the collected light beams to obtain the target light beams corresponding to the color data, including:

in the width direction of the light beam, determining the color difference value of adjacent light beams in the converging light beam based on a preset step length;

And extracting a target beam splitting from the converging light beam based on the color difference value and a preset threshold value to form a target light beam.

6. The method of claim 1, wherein after forming the corresponding light beams based on any one of the at least one set of color data, respectively, the method further comprises:

and setting the transparency of the light beam, wherein the transparency sequentially increases along the projection direction of the light beam.

7. The method of claim 1, wherein the initial image is an image frame in a video or the initial image is a frame image acquired in real time by a camera device;

and respectively adding beam effects to the image frames in the video to form a beam effect video, or respectively adding beam effects to the image frames acquired in real time to form a real-time beam effect video stream.

8. A video processing method, comprising:

acquiring video data to be projected, and adjusting the tone of the video data to be projected tone;

Extracting at least one group of color data in the image frame for the image frame in the video data with the adjusted color tone, and respectively forming corresponding target light beams based on any group of color data in the at least one group of color data, wherein any group of color data comprises a plurality of color data, each group of color data corresponds to one target light beam, superposing the target light beams to form a light beam effect graph corresponding to the image frame, and superposing the light beam effect graph into the image frame to obtain special effect video data;

Wherein the forming of the corresponding target light beam based on any one of the at least one set of color data includes:

For any one of the at least one set of color data, forming a color line based on each of the color data in the any one set of color data, and forming an initial light beam corresponding to the any one set of color data based on the color lines respectively corresponding to the plurality of color data; the plurality of color lines in the initial beam are ordered based on the positional relationship of the color data in any one set of color data;

Gathering the initial light beams based on a virtual light source, and splitting and extracting the gathered light beams to obtain target light beams corresponding to the color data; the target beam is a beam having a color difference from an adjacent beam.

9. The method of claim 8, wherein prior to adjusting the hue of the video data to the projected hue, the method further comprises:

And carrying out random dithering processing on the video data.

10. The method of claim 8, wherein the projected hue comprises a blue hue;

the adjusting the tone of the video data to a projected tone includes:

And converting the color data of the image frames in the video data into color data corresponding to the blue tone according to the conversion relation between the channel color data in the current tone and the channel color data in the blue tone.

11. The method of claim 8, wherein the method further comprises:

and displaying the special effect video data in an augmented reality-based mode.

12. An image processing apparatus, comprising:

the color data extraction module is used for acquiring an initial image and extracting at least one group of color data in the initial image;

A beam generation module for forming corresponding target beams based on any one of the at least one set of color data; wherein, any group of color data comprises a plurality of color data, and each group of color data corresponds to one target light beam;

The beam effect generation module is used for superposing the target beams to form a beam effect diagram corresponding to the initial image;

the beam effect image generation module is used for superposing the beam effect image into the initial image to form a beam effect image;

Wherein the beam generation module comprises:

An initial beam forming unit, configured to, for any one of the at least one set of color data, form a color line based on each of the color data in the any one set of color data, and form an initial beam corresponding to the any one set of color data based on color lines corresponding to the plurality of color data, respectively; the plurality of color lines in the initial beam are ordered based on the positional relationship of the color data in any one set of color data;

The light beam gathering unit is used for gathering the initial light beam based on the virtual light source;

The target beam generating unit is used for carrying out beam splitting extraction on the gathered light beams to obtain target light beams corresponding to the color data; the target beam is a beam having a color difference from an adjacent beam.

13. A video processing apparatus, comprising:

The video data acquisition module is used for acquiring video data to be projected;

a tone adjustment module for adjusting the tone of the video data to a projected tone;

The video processing module is used for extracting at least one group of color data in the image frame for the image frame in the video data with the adjusted tone, forming corresponding target light beams respectively based on any group of color data in the at least one group of color data, wherein any group of color data comprises a plurality of color data, each group of color data corresponds to one target light beam, superposing the target light beams to form a light beam effect graph corresponding to the image frame, and superposing the light beam effect graph into the image frame to obtain special effect video data;

Wherein, the video processing module includes:

A light beam forming unit, configured to, for any one of the at least one set of color data, form a color line based on each of the color data in the any one set of color data, and form an initial light beam corresponding to the any one set of color data based on the color lines respectively corresponding to the plurality of color data; the plurality of color lines in the initial beam are ordered based on the positional relationship of the color data in any one set of color data; gathering the initial light beams based on a virtual light source, and carrying out beam splitting extraction on the gathered light beams to obtain target light beams corresponding to the color data; the target beam is a beam having a color difference from an adjacent beam.

14. An electronic device, the electronic device comprising:

one or more processors;

storage means for storing one or more programs,

When executed by the one or more processors, causes the one or more processors to implement the image processing method of any of claims 1-7, or the video processing method of any of claims 8-11.

15. A storage medium containing computer executable instructions which, when executed by a computer processor, are for performing the image processing method of any of claims 1-7, or the video processing method of any of claims 8-11.