CN108805951B

CN108805951B - Projection image processing method, device, terminal and storage medium

Info

Publication number: CN108805951B
Application number: CN201810540267.8A
Authority: CN
Inventors: 王文斌
Original assignee: Chongqing Huiye Iot Technology Co ltd
Current assignee: Chongqing Huiye Communication Technology Co ltd
Priority date: 2018-05-30
Filing date: 2018-05-30
Publication date: 2022-07-19
Anticipated expiration: 2038-05-30
Also published as: CN108805951A

Abstract

The embodiment of the invention discloses a method, a device, a terminal and a storage medium for processing a projected image. The method comprises the following steps: identifying an action of a first object; when the first object drawing is determined, acquiring a first image drawn by the first object; and replacing the current projection image with the target projection image according to the first image. The embodiment of the invention collects the drawing of the viewer by identifying the action of the viewer, and replaces the content in the projection image with the drawing of the viewer, thereby solving the problem that the projection viewer can not output own ideas and interacts with the projection contents, realizing the combination of the drawing of the projection viewer and the content of the projection image, and exciting the viewing and learning interests of the projection viewer to make the projection viewer actively express own ideas.

Description

Projection image processing method, device, terminal and storage medium

Technical Field

The embodiment of the invention relates to computer technology, in particular to a projection image processing method, a projection image processing device, a projection image processing terminal and a storage medium.

Background

At present, a large number of story projectors are arranged in the market, and stories in a picture book or a story book are projected in a film or video projection mode, so that story plots are more vivid and have picture feeling, and the interest of children in reading is increased. However, children can only passively receive the projected story content, but cannot directly output their own ideas and combine them with the projected picture, and cannot interact with the projected story content, which is not favorable for the exertion of imagination of children.

Disclosure of Invention

The embodiment of the invention provides a projection image processing method, a projection image processing device, a projection terminal and a storage medium, which are used for combining a picture drawn by a viewer with a projection picture, so that the viewer can interact with projection contents to arouse learning interest.

In a first aspect, an embodiment of the present invention provides a projection image processing method, where the method includes:

identifying an action of a first object;

when the first object drawing is determined, acquiring a first image drawn by the first object;

and replacing the current projection image with the target projection image according to the first image.

In a second aspect, an embodiment of the present invention further provides a projection image processing apparatus, including:

the action recognition module is used for recognizing the action of the first object;

the first image extraction module is used for acquiring a first image drawn by the first object when the first object drawing is determined;

and the image replacing module is used for replacing the current projection image with the target projection image according to the first image.

In a third aspect, an embodiment of the present invention further provides a terminal, where the terminal includes:

one or more processors;

storage means for storing one or more programs;

When executed by the one or more processors, cause the one or more processors to implement a projection image processing method as in any of the embodiments of the present invention.

In a fourth aspect, the embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor, implements the projection image processing method according to any one of the embodiments of the present invention.

The embodiment of the invention collects the drawing of the viewer when the viewer draws by identifying the action of the viewer, and replaces the content in the projection image with the drawing of the viewer, thereby solving the problems that the viewer cannot output own ideas and interacts with the projection content, realizing the combination of the drawing drawn by the viewer and the content of the projection image, and exciting the viewing and learning interests of the viewer so as to actively express the own ideas.

Drawings

FIG. 1 is a flowchart of a method for processing a projected image according to a first embodiment of the present invention;

FIG. 2 is a schematic structural diagram of a projection image processing apparatus according to a second embodiment of the present invention;

fig. 3 is a schematic structural diagram of a terminal in a third embodiment of the present invention.

Detailed Description

The present invention will be described in further detail with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not to be construed as limiting the invention. It should be further noted that, for the convenience of description, only some structures related to the present invention are shown in the drawings, not all of them.

Example one

The projector is a device that can project images or videos onto a curtain, and can be connected with a computer, a VCD, a DVD, a BD, a game machine, a DV, etc. through different interfaces to play corresponding video signals. Projectors are now widely used in homes, offices, schools and entertainment venues.

In the early education stage in the growth process of the children, in order to arouse the learning interest of the children and enable the children to remember more deeply, the story of the children is directly displayed in a projection mode, and the sound of the people's attraction, namely the frequency of the opposing of the. The camera device and the artificial intelligence module are added, so that interaction between a person who watches the projection story and the story line can be realized, and the idea can be expressed.

Fig. 1 is a flowchart of a method for processing a projected image according to an embodiment of the present invention, where the embodiment is applicable to a case of processing a projected image, and the method may be performed by a projected image processing apparatus, and the apparatus may be configured in a terminal, for example. As shown in fig. 1, the method specifically includes:

and S110, identifying the action of the first object.

The first object is a person who views the projection image or video, and may be a child or an adult. Specifically, an image and/or a video of the first object can be captured by the camera and uploaded to the processor. Then, the processor carries out pattern recognition on the acquired image and/or video of the first object, and whether the first object carries out drawing or not is judged.

S120, when the first object drawing is determined, a first image drawn by the first object is obtained.

When it is determined that the first object is drawing, the first image may be extracted in the captured image and/or video. Specifically, the first image can be separated from the original picture or image into an individual image layer by using a matting method, the main function is to prepare for image synthesis in the subsequent steps, and the method can be specifically realized by extracting a filter, extracting an external filter, a channel, calculating, applying an image method and other algorithms.

And S130, replacing the current projection image with the target projection image according to the first image.

Acquiring a current projection image and determining a second image to be replaced in the current projection image; and replacing a second image in the current projection image with the first image to obtain the target projection image.

Wherein the current projection image is an image projected by the projector when the first object is identified to be drawn. The determination of the second image is determined based on the properties of the first image. Specifically, when the first image is acquired, the category and the specific content of the first image are further analyzed, and the category of the first image may be contents such as cartoon characters, buildings, animals and plants, fruits, natural landscapes and the like. For example, after the first image is identified as a big tree, whether a tree or a plant exists in the current projection image is matched, if so, the tree or the plant in the current projection image is determined as a second image and is extracted from the current projection image, namely, the same type of substitution of the first image as the second image is carried out, the appearance presented by the original projection image is replaced by the appearance presented by the projection image in the eyes of a child or a big person who watches the projection, and therefore the output of the idea of a projector and the interaction with the projection content are realized.

Further, before the target projection image is finally obtained, the projection image processing method further includes the steps of: comparing the first image with the second image to determine whether the contours of the first image and the second image match; if not, smoothing the difference between the first image and the second image according to the pixel information of the current projection image; and coloring the first image according to the pixel information of the current projection image.

Specifically, the purpose of the above steps is to make the fusion of the first image and the current projection image more natural, so that the finally obtained target projection image has no sense of incongruity. When the color difference exists between the first image and the current projected image or the first image and the second image are not matched completely, interpolation can be adopted to correct the target projected image. The interpolation method can be a nearest neighbor interpolation method, a bilinear interpolation method, a bicubic interpolation method of a 4 x 4 pixel neighborhood, a Lanczos interpolation method of an 8 x 8 pixel neighborhood and the like according to the characteristics of the image data.

Preferably, the projection image processing method further comprises saving the target projection image, and generating a new story set. The idea of the viewer can be recorded, memory points are formed, and the rich imagination and learning interest of the viewer are stimulated.

According to the technical scheme, the action of the projection viewer is identified, the drawing of the projection viewer is collected during drawing, the drawing of the projection viewer replaces the content in the projection image, the problems that the projection viewer cannot output own ideas and interacts with the projection content are solved, the combination of the drawing drawn by the projection viewer and the content of the projection image is realized, the viewing and learning interests of the projection viewer can be stimulated, and the projection viewer can actively express own ideas.

Example two

Fig. 2 is a schematic structural diagram of a projection image processing apparatus according to a second embodiment of the present invention. As shown in fig. 2, the projection image processing apparatus includes: a motion recognition module 210, a first image extraction module 220, and an image replacement module 230.

The action recognition module 210 is configured to recognize an action of the first object; a first image extracting module 220, configured to obtain a first image drawn by the first object when determining that the first object is drawn; an image replacing module 230, configured to replace the current projection image with the target projection image according to the first image.

Further, the image replacement module 230 includes:

the second image extraction unit is used for acquiring a current projection image and determining a second image to be replaced in the current projection image; and the image replacing unit is used for replacing a second image in the current projection image with the first image to obtain the target projection image.

Further, the projection image processing apparatus further includes an image matching module, and the image matching module specifically includes:

the contour matching unit is used for comparing the first image with the second image to determine whether the contours of the first image and the second image are matched before the target projection image is obtained; the image smoothing unit is used for smoothing the difference between the first image and the second image according to the pixel information of the current projection image when the first image and the second image are determined to have unmatched contours; and the image color matching unit is used for coloring the first image according to the pixel information of the current projected image.

Preferably, the projection image processing device further comprises a story generation module for saving the target projection image and generating a new story set.

The projected image processing device provided by the embodiment of the invention can execute the projected image processing method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.

EXAMPLE III

Fig. 3 is a schematic structural diagram of a terminal in a third embodiment of the present invention. Fig. 3 illustrates a block diagram of an exemplary terminal 312 suitable for use in implementing embodiments of the present invention. The terminal 312 shown in fig. 3 is only an example, and should not bring any limitation to the functions and the application range of the embodiment of the present invention.

As shown in fig. 3, the terminal 312 is in the form of a general purpose computing device. The components of the terminal 312 may include, but are not limited to: one or more processors or processing units 316, a system memory 328, and a bus 318 that couples the various system components including the system memory 328 and the processing unit 316.

Bus 318 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, micro-channel architecture (MAC) bus, enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.

Terminal 312 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by terminal 312 and includes both volatile and nonvolatile media, removable and non-removable media.

The system memory 328 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM)330 and/or cache memory 332. The terminal 312 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 334 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 3, and commonly referred to as a "hard drive"). Although not shown in FIG. 3, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 318 by one or more data media interfaces. Memory 328 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.

A program/utility 340 having a set (at least one) of program modules 342 may be stored, for example, in memory 328, such program modules 342 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 342 generally perform the functions and/or methodologies of embodiments of the present invention as described herein.

The terminal 312 may also communicate with one or more external devices 314 (e.g., keyboard, pointing device, display 324, etc.), one or more devices that enable a user to interact with the terminal 312, and/or any devices (e.g., network card, modem, etc.) that enable the terminal 312 to communicate with one or more other computing devices. Such communication may occur through input/output (I/O) interfaces 322. Also, the terminal 312 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network such as the Internet) via the network adapter 320. As shown, the network adapter 320 communicates with the other modules of the terminal 312 over the bus 318. It should be appreciated that although not shown in FIG. 3, other hardware and/or software modules may be used in conjunction with the terminal 312, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.

The processing unit 316 executes various functional applications and data processing by running the program stored in the system memory 328, for example, implementing the method for processing a projected image according to the embodiment of the present invention, the method mainly includes:

Identifying an action of a first object;

Example four

The fourth embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the method for processing a projected image provided in the fourth embodiment of the present invention, where the method mainly includes:

identifying an action of a first object;

Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "for example" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A method of processing a projected image, comprising:

identifying an action of a first object; wherein the first object is a person viewing the projected image or video;

replacing the current projection image with a target projection image according to the first image;

wherein replacing the current projection image with the target projection image according to the first image comprises:

acquiring a current projection image and determining a second image to be replaced in the current projection image;

Replacing a second image in the current projection image with the first image to obtain the target projection image;

wherein the current projection image is an image projected by the projector when the first object is identified in drawing; the determination of the second image is judged according to the properties of the first image.

2. The method of claim 1, wherein prior to obtaining the target projection image, the method further comprises:

comparing the first image with the second image to determine whether the contours of the first image and the second image match;

if not, smoothing the difference between the first image and the second image according to the pixel information of the current projection image;

and coloring the first image according to the pixel information of the current projection image.

3. The method of claim 1, further comprising:

and saving the target projection image to generate a new story set.

4. A projection image processing apparatus characterized by comprising:

the action recognition module is used for recognizing the action of the first object; wherein the first object is a person viewing the projected image or video;

The image replacing module is used for replacing the current projection image with the target projection image according to the first image;

wherein the image replacement module comprises:

the second image extraction unit is used for acquiring a current projection image and determining a second image to be replaced in the current projection image;

the image replacing unit is used for replacing a second image in the current projection image with the first image to obtain the target projection image;

5. The apparatus according to claim 4, further comprising an image matching module, the image matching module comprising in particular:

the contour matching unit is used for comparing the first image with the second image to determine whether the contours of the first image and the second image are matched before the target projection image is obtained;

the image smoothing unit is used for smoothing the difference between the first image and the second image according to the pixel information of the current projection image when the first image and the second image are determined to have unmatched contours;

And the image color matching unit is used for coloring the first image according to the pixel information of the current projection image.

6. The apparatus of claim 4, further comprising a story generation module to: and saving the target projection image to generate a new story set.

7. A terminal, characterized in that the terminal comprises:

one or more processors;

storage means for storing one or more programs;

when executed by the one or more processors, cause the one or more processors to implement the projection image processing method of any of claims 1-3.

8. A computer-readable storage medium on which a computer program is stored, which program, when being executed by a processor, is characterized by carrying out the projection image processing method of any one of claims 1 to 3.