CN107509021A - Shooting method, shooting device and storage medium - Google Patents

Abstract

The invention discloses a shooting method, which comprises the steps of acquiring state information of a target object in a state of acquiring an audio signal input by the target object; judging whether the state information meets shooting conditions or not; and if the state information accords with shooting conditions, controlling the camera device to shoot the multimedia aiming at the target object. The invention also discloses a shooting device and a storage medium.

Description

A shooting method, device and storage medium

technical field

The present invention relates to the technical field of photographing, in particular to a photographing method, device and storage medium.

Background technique

With the continuous improvement of people's living standards, there are more and more entertainment methods for people to choose from. Among them, going to the karaoke room to sing is a very common entertainment method.

Recently, a kind of miniaturized, exquisite and convenient entertainment equipment has appeared in shopping malls, cinemas, restaurants and other places with a large flow of people. This type of entertainment equipment is a glass house that integrates singing, listening to songs, and recording songs. Its appearance is similar to a closed telephone booth. Therefore, it is called "mobile KTV" and "mini karaoke room". Or "mini karaoke room" (hereinafter collectively referred to as "mini karaoke room"). People can sing in the mini karaoke room without the interference of others, and in the process of singing, they can't help showing various rich expressions.

However, in the existing mini karaoke room, to capture the user's expression, the user often needs to take out his own mobile phone or camera and other terminal devices to perform manual shooting, which is inefficient and cumbersome, resulting in poor user experience.

Contents of the invention

In view of this, the embodiments of the present invention hope to provide a shooting method, device and storage medium, which can realize automatic shooting.

In order to achieve the above object, the technical solution of the embodiment of the present invention is achieved in this way:

An embodiment of the present invention provides a shooting method, the method is applied to equipment provided with a camera device, and the method includes:

In the state of collecting the audio signal input by the target object, obtain the state information of the target object;

judging whether the state information meets the shooting conditions;

If the state information meets the shooting condition, the camera is controlled to shoot the multimedia for the target object.

In the above solution, before acquiring the status information of the target object, it also includes:

adjusting the shooting angle of at least one camera so that the target object is within the shooting range of the at least one camera; or, if the target object is located outside the specified area of the preview image captured by the camera, prompting the The target object changes position.

In the above solution, the adjustment of the shooting angle of at least one camera device includes:

automatically adjust the shooting angle of the camera; or,

In response to the received shooting angle adjustment instruction, the shooting angle of the camera device is adjusted.

In the above solution, the acquisition of the status information of the target object includes acquisition of at least one of the following information:

the tone of voice of the target audience;

the volume of the target object;

The facial expression characteristics of the target object.

In the above solution, when the state information of the target object includes the tone of the target object, the judging whether the state information meets the shooting conditions includes: when the tone of the target object in the audio signal output process is greater than the tone When the threshold is reached, it is determined that the shooting conditions are met;

When the state information of the target object includes the volume of the target object, the judging whether the state information meets the shooting conditions includes: when the volume of the target object in the audio signal output process is greater than a volume threshold, judging Meet the shooting conditions;

When the state information of the target object includes the facial expression features of the target object, the judging whether the state information meets the shooting conditions includes: judging whether there is similarity with the facial expression features of the target object in the expression database Degree is greater than the preset facial expression feature of the similarity threshold; if it exists, it is determined that it meets the shooting conditions; wherein, the expression library is a database for storing preset facial expression features; the preset facial expression feature is a preset facial expression feature The state information set to characterize the target object conforms to the facial expression feature of the shooting condition.

In the above solution, the method further includes: playing preset multimedia;

If the state information does not meet the shooting condition, when the preset playing progress of the multimedia reaches a preset time point, the camera is controlled to shoot the multimedia targeted at the target object.

In the above solution, the device provided with the camera device is applied to a mini karaoke room.

In the above scheme, the multimedia for the target object includes one of the following:

picture; video;

The method also includes:

Preprocessing the multimedia for the target object, and storing the preprocessed multimedia;

Wherein, the preprocessing includes at least one of the following methods: generating an emoticon package according to the acquired multimedia; making the acquired multimedia into a personalized video.

In the above scheme, the method also includes:

If the state information meets the shooting conditions, then controlling the device to record the audio signal currently input by the target object;

Combining the recorded audio signal and the multimedia for the target object into one video.

In the above scheme, the method also includes:

The synthesized video is used to replace the preset multimedia.

In the above scheme, the method also includes:

Send the multimedia and/or the video for the target object to a designated terminal device.

The embodiment of the present invention also provides a photographing device, which includes: an acquisition module, a discrimination module, and a photographing module; wherein,

The acquisition module is used to acquire the state information of the target object in the state of collecting the audio signal input by the target object;

The judging module is used to judge whether the state information meets the shooting conditions;

The photographing module is configured to control the photographing device to photograph the multimedia for the target object if the state information meets the photographing conditions.

In the above solution, the device further includes an adjustment module, configured to adjust the shooting angle of at least one camera device, so that the target object is within the shooting range of the at least one camera device; or, if the target object is located in the If the preview image captured by the camera device is outside the specified area, the target object is prompted to change its position.

In the above solution, the adjustment module is specifically used for:

automatically adjust the shooting angle of the camera; or,

In response to the received shooting angle adjustment instruction, the shooting angle of the camera device is adjusted.

In the above solution, the acquisition module is specifically used to: acquire at least one of the following information:

the tone of voice of the target audience;

the volume of the target object;

The facial expression characteristics of the target object.

In the above solution, the judging module is specifically configured to: when the state information of the target object acquired by the acquisition module includes the tone of the target object, and the tone of the target object in the audio signal output process is greater than the tone When the threshold is reached, it is determined that the shooting conditions are met;

It is also specifically used for: when the state information of the target object acquired by the acquisition module includes the volume of the target object, and the volume of the target object during the audio signal output process is greater than a volume threshold, determine that the shooting condition is met;

It is also specifically used for: when the state information of the target object acquired by the acquisition module includes the facial expression characteristics of the target object, and it is judged whether there is a similarity degree to the facial expression characteristics of the target object in the expression database The preset facial expression feature of the degree threshold; if it exists, it is determined that it meets the shooting conditions; wherein, the expression storehouse is a database for storing preset facial expression features; the preset facial expression feature is a preset, The state information used to characterize the target object meets the facial expression features of the shooting conditions.

In the above solution, the device also includes a preset module, specifically for:

Play preset multimedia;

If the state information does not meet the shooting condition, when the preset playing progress of the multimedia reaches a preset time point, the camera is controlled to shoot the multimedia for the target object.

In the above solution, the device further includes a preprocessing module, configured to preprocess the multimedia for the target object, and store the preprocessed multimedia; wherein, the preprocessing includes at least one of the following methods : Generate an emoticon package according to the acquired multimedia; make the acquired multimedia into a personalized video.

In the above solution, the preprocessing module is specifically used to: if the state information meets the shooting conditions, control the device to record the audio signal currently input by the target object; combine the recorded audio signal with the The multimedia of the target object is synthesized into one video.

In the above solution, the device further includes a replacement module, configured to use the synthesized video to replace the preset multimedia.

In the solution above, the apparatus further includes a sending module, configured to send the multimedia and/or the video for the target object to a designated terminal device.

An embodiment of the present invention also provides a storage medium on which an executable program is stored, and when the executable program is executed by a processor, the steps in the above technical solution are implemented.

An embodiment of the present invention also provides a photographing device, including a memory, a processor, and an executable program stored on the memory and capable of being run by the processor. When the processor runs the executable program, it executes the above-mentioned technical solutions. A step of.

In any one of the above solutions provided by the embodiments of the present invention, the state information of the target object is acquired in the state of collecting the audio signal input by the target object, and then the state information of the target object is determined. When the state information of the target object meets the shooting conditions, the camera device is used to shoot the multimedia for the target object. It can be seen that the entire shooting process does not require the user to take out the mobile phone or camera and other terminal equipment that comes with it for manual shooting, but realizes the automatic shooting of the target object (user). Compared with the prior art, this solution has high efficiency, and for the user, since there is no need to take out the equipment and shoot manually, the shooting process becomes convenient.

Description of drawings

FIG. 1 is a schematic diagram of the implementation flow of the shooting method provided by the embodiment of the present invention;

Fig. 2 is a detailed flow chart of the photographing method provided by the embodiment of the present invention;

FIG. 3 is a schematic diagram of the composition and structure of the photographing device provided by the embodiment of the present invention;

FIG. 4 is a schematic diagram of a hardware structure of a photographing device provided by an embodiment of the present invention.

detailed description

Embodiment one,

In the embodiment of the present invention, a schematic diagram of the implementation flow of the shooting method is shown in Figure 1, including the following steps:

Step 101: Obtain the state information of the target object in the state of collecting the audio signal input by the target object;

Step 102: judging whether the state information meets the shooting conditions;

Step 103: If the state information meets the shooting condition, control the camera device to shoot multimedia for the target object.

Here, the photographing method is applied to equipment provided with a photographing device. Wherein, the device provided with the camera device, for example, can be applied to a mini karaoke room.

Here, the target object is a user who is in an audio output state and the multimedia processing system controls the camera device to perform multimedia shooting. For example, in the process of singing in the mini karaoke room, the karaoke system controls the camera to take pictures or videos of users. Further, when the target object outputs an audio signal, the multimedia processing system will automatically acquire the audio signal, and at this time the multimedia processing system is in the state of collecting the audio signal input by the target object. For example, the target object starts to sing in the mini karaoke room, and the karaoke system automatically collects the sound signal of the target object. Before the acquisition of the state information of the target object, it also includes: adjusting the shooting angle of at least one camera, so that the target object is within the shooting range of the at least one camera; or, if the target object is located in the camera If the device is outside the designated area of the preview image captured by the device, the target object is prompted to change its position. Specifically, when the target object is within the shooting range of the camera device, and the shooting angle needs to be adjusted when the shooting angle is not good, the shooting angle of the camera device is adjusted so that the target object is within the shooting range of at least one camera device; When the target object is outside the specified area of the preview image captured by the camera, a prompt message appears, prompting the target object to change its position so that the target object is within the shooting range of at least one camera device. Wherein, the adjusting the shooting angle of at least one camera includes: automatically adjusting the shooting angle of the camera; or adjusting the shooting angle of the camera in response to a received shooting angle adjustment instruction.

Here, the acquiring the status information of the target object includes acquiring at least one of the following information: the tone of the target object; the volume of the target object; and the facial expression features of the target object. Wherein, the tone of the target object is the tone of the target object obtained by the multimedia processing system through voice tone recognition after acquiring the audio signal of the target object; the volume of the target object is the tone of the target object obtained by the multimedia processing system After the audio signal of the target object is obtained, the volume of the target object is obtained through voice volume recognition; the facial expression characteristics of the target object are monitored and obtained by the multimedia processing system through the camera equipment in working condition of.

Further, when the state information of the target object includes the tone of the target object, the judging whether the state information meets the shooting conditions includes: when the tone of the target object in the audio signal output process is greater than a tone threshold , it is determined that the shooting conditions are met;

When the state information of the target object includes the volume of the target object, the judging whether the state information meets the shooting conditions includes: when the volume of the target object in the audio signal output process is greater than a volume threshold, judging Meet the shooting conditions;

When the state information of the target object includes the facial expression features of the target object, the judging whether the state information meets the shooting conditions includes: judging whether there is similarity with the facial expression features of the target object in the expression database Degree is greater than the preset facial expression feature of the similarity threshold; if it exists, it is determined that it meets the shooting conditions; wherein, the expression library is a database for storing preset facial expression features; the preset facial expression feature is a preset facial expression feature The state information set to characterize the target object conforms to the facial expression feature of the shooting condition.

In addition, the method further includes: playing preset multimedia; if the status information does not meet the shooting conditions, when the playing progress of the preset multimedia reaches a preset time point, controlling the camera to shoot the target Objects of multimedia. Wherein, the preset multimedia is existing multimedia. Optionally, at least one preset time point may be preset in the preset multimedia. The reason for setting the preset time point in the multimedia will be introduced later, and will not be repeated here.

Further, the multimedia for the target object includes one of the following: pictures; videos; specifically, the target object can be photographed in the state of collecting the audio signal input by the target object; or, it can be In the state of collecting the audio signal input by the target object, video recording is performed on the target object through the camera device.

Further, the method further includes: preprocessing the multimedia for the target object, and storing the preprocessed multimedia; wherein, the preprocessing includes at least one of the following methods: generating Emoticon package; make the acquired multimedia into a personalized video. Wherein, the emoticon package is a set of pictures for expressing specific emotions, which is made by taking pictures of the target object as the material, adding a series of words, symbols, etc. matching the pictures. The personalized video is based on the picture of the target object taken as the material, and the audio, text and the picture are synthesized through the synthesis software, and then produced into a video that meets the producer's wishes. Further, the method further includes: if the state information meets the shooting conditions, controlling the device to record the audio signal currently input by the target object; synthesizing the recorded audio signal with the multimedia for the target object for a video. Further, the method further includes: using the synthesized video to replace the preset multimedia. Further, the method further includes: sending the multimedia for the target object and/or the video to a designated terminal device.

In the solution provided by this embodiment, the state information of the target object is obtained under the state of collecting the audio signal input by the target object, and then it is judged whether the state information of the target object meets the shooting conditions. When it is determined that the state information of the target object meets the When the shooting conditions are met, the camera is controlled to shoot the multimedia for the target object; or, when it is determined that the state information of the target object does not meet the shooting conditions, when the preset multimedia playback progress reaches the preset time point , then control the camera device to shoot multimedia for the target object. In this way, the automatic shooting of the target object is realized.

Embodiment two,

In the embodiment of the present invention, the implementation process of the shooting method is shown in Figure 1, including the following steps:

Step 101: Obtain the state information of the target object in the state of collecting the audio signal input by the target object;

Step 102: judging whether the state information meets the shooting conditions;

Step 103: If the state information meets the shooting condition, control the camera device to shoot multimedia for the target object.

In step 101 in the embodiment of the present invention, at least one camera device is arranged in the space where the target object is located, and communicates with the multimedia processing system in a wired or wireless manner. Specifically, the camera device can be connected to the multimedia processing system in a wireless manner such as Wireless Local Area Networks (WLAN), Bluetooth, or Near Field Communication (NFC); or, it can be connected to the multimedia processing system through a wired network. In addition, the terminal device logs into the multimedia processing system by scanning a code, inputting verification information, etc., so as to realize the communication connection between the terminal device and the multimedia processing system. Wherein, the terminal device includes, but is not limited to, a mobile phone, a tablet computer, a smart wearable device, and the like. Further, the camera starts up after receiving the startup instruction; or, it can start up automatically after being connected to the multimedia processing system. Specifically, the camera device is started after receiving the startup command directly; or, the multimedia processing system receives the startup command to start the camera device, and starts the camera device; or, the camera device is connected to the multimedia It starts automatically after processing the system. In addition, after the camera is turned on, a shooting mode is set, which can be changed when needed.

Here, the photographing method is applied to equipment provided with a photographing device. Wherein, the device provided with the camera device is applied to a mini karaoke room.

Here, the acquiring the status information of the target object includes acquiring at least one of the following information: the tone of the target object; the volume of the target object; and the facial expression features of the target object. Wherein, the multimedia includes image, video and other forms. In addition, before the acquisition of the state information of the target object, it also includes: adjusting the shooting angle of at least one camera so that the target object is within the shooting range of the at least one camera device; or, if the target object is located in the If the target object is outside the designated area of the preview image captured by the camera device, the target object is prompted to change its position. Specifically, when the target object is within the shooting range of the camera device, and the shooting angle needs to be adjusted when the shooting angle is not good, the shooting angle of the camera device is adjusted so that the target object is within the shooting range of at least one camera device; When the target object is outside the specified area of the preview image captured by the camera, a prompt message appears in the multimedia processing system, prompting the target object to change its position so that the target object is within the shooting range of at least one camera device .

Wherein, the adjusting the shooting angle of at least one camera includes: the multimedia processing system automatically adjusts the shooting angle of the camera; or, in response to the received shooting angle adjustment instruction, adjusts the shooting angle of the camera . Further, at least one of the following methods can be adopted to adjust the shooting angle of the camera device: the multimedia processing system automatically adjusts the angle of the camera device; or, after receiving the adjustment instruction, directly adjust the shooting angle on the camera device. Specifically, the multimedia processing system sends the multimedia captured by the camera to the terminal device, and the target object can obtain the captured preview information on the screen of the terminal device, and the multimedia processing system can The above preview information automatically adjusts the shooting angle; or, after receiving the adjustment instruction, the camera device directly adjusts the shooting angle according to the preview information displayed on the screen of the terminal device; or, according to the terminal device The preview information displayed on the screen of the multimedia processing system adjusts the shooting angle of the camera device according to the received adjustment instruction.

In addition, after the shooting angle of the camera device is adjusted, the terminal device may turn off the preview state; or, may keep the preview state on.

In step 102, the multimedia processing system judges whether the status information meets the shooting conditions. Specifically, determining that the state information meets the shooting conditions may be done in at least one of the following ways:

When the state information of the target object includes the tone of the target object, the multimedia processing system determines whether the state information meets the shooting conditions, including: when the tone of the target object in the audio signal output process is greater than a tone threshold when the shooting condition is met; when the state information of the target object includes the volume of the target object, the multimedia processing system judges whether the state information meets the shooting condition, including: when the target object is in the audio signal output When the volume in the process is greater than the volume threshold, it is determined that the shooting condition is met;

When the state information of the target object includes the facial expression feature of the target object, the multimedia processing system judges whether the state information meets the shooting conditions, including: judging whether there is a facial expression similar to the target object in the expression database The similarity of the feature is greater than the preset facial expression feature of the similarity threshold; if it exists, it is determined that it meets the shooting conditions; wherein, the expression storehouse is a database for storing preset facial expression features; the preset facial expression feature , is a preset facial expression feature used to represent that the state information of the target object meets the shooting conditions.

Of course, it is also possible to use two or more of the above methods to determine whether the state information meets the shooting conditions. For example, when the state information of the target object includes the tone and volume of the target object, the multimedia processing system judging whether the state information meets the shooting conditions includes: when the target object is in the audio signal output process When the volume is greater than the volume threshold and the tone of the target object during the audio signal output process is greater than the tone threshold, it is determined that the shooting condition is met.

Specifically, the pitch and volume of the voice signal output by the target object during the audio signal output process will constantly change, and in the case of a high pitch, there will often be clear state information, such as rich facial expressions and various body movements. , so when the pitch of the target object during the audio signal output process is greater than the pitch threshold, it is determined that the shooting condition is met. Wherein, the tone threshold is an empirical value, and a certain value in the tone can be set as the tone threshold, for example, 2000 US is set as the tone threshold; or, when the target object is in the audio signal output process, the volume When there is a significant change and is greater than the volume threshold, it is determined that the shooting condition is met. Wherein, the volume threshold is an empirical value, and a certain value in the volume can be set as the volume threshold, for example, 40 decibels is set as the volume threshold; The similarity of facial expression feature is greater than the preset facial expression feature of similarity threshold; If it exists, it is judged to meet the shooting conditions; Wherein, the similarity threshold is an empirical value, and the facial expression with similarity greater than 80% can be set as similarity threshold. The preset expression may be a sad expression, a happy expression, a ferocious expression, and the like.

In addition, the method further includes: playing preset multimedia; if the status information does not meet the shooting conditions, when the playing progress of the preset multimedia reaches a preset time point, controlling the camera to shoot the target Objects of multimedia. Wherein, the preset multimedia is already existing multimedia, and through the statistics of the historical information of the preset multimedia, all the preset multimedia are set, so that the preset multimedia includes At least one preset time point. Wherein, the preset time point may be a time point when a smiling expression, a sad expression, etc. appear.

In step 103, if the state information meets the shooting condition, the camera is controlled to shoot multimedia for the target object. Wherein, the multimedia for the target object includes one of the following: pictures; video; specifically, the target object can be photographed in the state of collecting the audio signal input by the target object; or, it can be collected In the state of the audio signal input by the target object, video recording is performed on the target object through the camera device.

Here, after the multimedia processing system controls the camera device to capture the multimedia of the target object, it preprocesses the multimedia of the target object and stores the preprocessed multimedia; wherein, the preprocessing The processing includes at least one of the following methods: generating an emoticon package according to the acquired multimedia; or, performing image processing and sound effect processing on the acquired photo or video of the target object; or making the acquired multimedia into a personalized video. Specifically, the multimedia processing system controls the device to record the audio signal currently input by the target object; and synthesizes the recorded audio signal and the multimedia for the target object into one video. Further, the multimedia processing system replaces the preset multimedia with the synthesized video. Further, the multimedia processing system sends the multimedia for the target object and/or the video to a designated terminal device.

Embodiment three,

The shooting method of the embodiment of the present invention will be further described in detail below in conjunction with an example, taking target object A's singing process in a mini karaoke room as an example to capture or record a video of the target object A.

In the embodiment of the present invention, the detailed flowchart of the shooting method is shown in Figure 2, including the following steps:

Step 201: Adjust the shooting angle of the camera or prompt the target object A to change its location;

Here, at least one camera is installed in the mini karaoke room, so that the target object A can be photographed from different directions. For example, the target object A may be photographed from the front, left and right sides. Further, the camera communicates with the karaoke system in a wired or wireless manner. Specifically, the camera can be connected to the karaoke system in a wireless manner such as WLAN, Bluetooth, or NFC; or, it can be connected to the karaoke system through a wired network.

In addition, the terminal device of the target object A, such as a mobile phone, can log in to the karaoke system by scanning the QR code of WeChat, QQ or Weibo; System communication connections.

Further, the camera starts up after receiving the startup command; or, it can start up automatically after being connected to the karaoke system. Specifically, the camera starts up after receiving the startup command directly; or, the karaoke system receives the startup command and starts up the camera; or, the camera starts up automatically after being connected to the karaoke system. Wherein, each camera needs to be turned on independently, and different cameras can be turned on as required. In addition, the camera is set to a shooting mode when it is turned on, which can be changed when needed.

Next, before the official singing, if the position of the target object A is not within the shooting range of any camera, adjust the shooting angle of at least one camera so that the target object A is within the shooting range of the at least one camera; or, If the target object A is located outside the specified area of the preview image captured by the camera, the target object A is prompted to change its position. Specifically, when the target object A is within the shooting range of the camera, and the shooting angle needs to be adjusted when the shooting angle is not good, adjust the shooting angle of the camera so that the target object A is within the shooting range of at least one camera; When the preview image taken is outside the specified area, a prompt message appears on the display screen of the karaoke system, prompting the target object A to change its position so that the target object A is within the shooting range of at least one camera.

Wherein, said adjusting the shooting angle of at least one camera includes: the karaoke system automatically adjusts the shooting angle of the camera; or, adjusts the shooting angle of the camera in response to the received shooting angle adjustment instruction.

Further, at least one of the following methods may be used to adjust the shooting angle of the camera:

The karaoke system sends the photos taken by the camera to the mobile phone of the target object A, and the target object A can get the preview information of the shooting on the screen of the mobile phone, and the karaoke system can obtain the position of the preview frame of the target object A on the mobile phone display , and then automatically adjust the shooting angle; or, after receiving the adjustment command, the camera directly adjusts the shooting angle according to the position of the target object A in the preview frame on the mobile phone display; or, according to the target object A in the mobile phone display The position of the preview frame, the karaoke system adjusts the shooting angle of the camera according to the received adjustment instructions. In addition, after the shooting angle of the camera is adjusted, the camera will maintain the current preview shooting state, and the mobile phone of the target object A can turn off the preview state; or, can keep the preview state on.

Step 202: Obtain the status information of the target object A during the process of collecting the target object A's singing;

Here, after turning on at least one camera and adjusting the shooting angle, the target object A starts to sing, and the karaoke system monitors the target object A in real time, and obtains the status information of the target object A during the singing process of the target object A .

Wherein, said obtaining the status information of the target object A includes obtaining at least one of the following information: the tone of the target object A; the volume of the target object A; the facial expression features of the target object A.

Step 203: judging whether the state information meets the shooting conditions;

Here, the karaoke system judges whether the acquired state information of the target object A meets the shooting conditions. Specifically, determining that the state information meets the shooting conditions may be done in at least one of the following ways:

When the state information of the target object A includes the tone of the target object A, the karaoke system judges whether the state information meets the shooting conditions, including: when the tone of the target object A in the singing process is greater than the tone threshold, it is determined that the shooting conditions are met;

When the state information of the target object A includes the volume of the target object A, the karaoke system judges whether the state information meets the shooting conditions, including: when the volume of the target object A in the singing process is greater than the volume threshold, it is determined that the shooting conditions are met;

When the state information of the target object A includes the facial expression feature of the target object A, the karaoke system judges whether the state information meets the shooting conditions, including: judging whether there is a similarity with the facial expression feature of the target object A greater than The preset facial expression feature of the similarity threshold; if it exists, it is judged to meet the shooting conditions; wherein, the expression storehouse is a database for storing preset facial expression features; the preset facial expression feature is preset , the facial expression feature used to characterize the state information of the target object conforming to the shooting condition.

Of course, it is also possible to use two or more of the above methods to determine whether the state information meets the shooting conditions. For example, when the state information of the target object A includes the tone and volume of the target object, the karaoke system judges whether the state information meets the shooting conditions, including: when the volume of the target object A during singing is greater than the volume threshold and the tone When it is greater than the tone threshold, it is determined that the shooting condition is met.

Specifically, the pitch and volume of the target object A will change continuously during the singing process. In the case of high pitch, there will often be clear state information, such as rich facial expressions and various body movements. Therefore, when the target object A is in the When the pitch during the singing is greater than the pitch threshold, it is determined that the shooting condition is met. Wherein, the tone threshold is an empirical value, and a certain value in the tone can be set as the tone threshold, for example, 2000 US is set as the tone threshold; When the change is greater than the volume threshold, it is determined that the shooting condition is met. Wherein, the volume threshold is an empirical value, and a certain value in the volume can be set as the volume threshold, for example, 40 decibels is set as the volume threshold; The similarity of the expression feature is greater than the preset facial expression feature of the similarity threshold; if it exists, it is determined to meet the shooting conditions; wherein, the similarity threshold is an empirical value, and the facial expression with a similarity greater than 80% can be set as similar degree threshold. The preset expression may be a sad expression, a happy expression, a ferocious expression, and the like.

In addition, the karaoke system plays preset multimedia; if the state information does not meet the shooting conditions, when the playback progress of the preset multimedia reaches a preset time point, the camera is controlled to shoot the multimedia for the target object A. Wherein, the preset multimedia is the multimedia existing in the karaoke system, and through the statistics of the historical information of the preset multimedia, all the preset multimedia are set, so that the preset The multimedia contains at least one preset time point. Wherein, the preset time point may be a time point when a smiling expression, a sad expression, etc. appear.

Step 204: If the state information meets the shooting condition, control the camera to shoot the multimedia for the target object A.

If the state information meets the shooting conditions, the camera is controlled to shoot multimedia for the target object A. Wherein, the multimedia for the target object A includes one of the following: pictures; videos;

Specifically, when the current mode of the camera is the shooting format, the target object A can be photographed during the singing process of the target object A; or, when the current mode of the camera is the recording format, the target object A can be taken during the singing process Video recording of the target object A is performed through the camera.

In addition, after the karaoke system controls the camera to shoot the multimedia for the target object A, preprocess the multimedia for the target object A, and store the preprocessed multimedia; wherein, the preprocessing includes at least one of the following methods : generating an emoticon package according to the acquired multimedia; or, performing image processing and sound effect processing on the acquired photo or video of the target object; or, making the acquired multimedia into a personalized video. Specifically, the karaoke system controls the device to record the song currently sung by the target object A; synthesizes the recorded song and the multimedia for the target object A into a video, and uses the synthesized video to replace the karaoke system Multimedia preset in . In addition, the karaoke system can send the multimedia and/or the video for the target object A to the mobile phone, and realize the webcast of the target object A's singing process through the mobile phone.

In order to realize the above-mentioned photographing method, an embodiment of the present invention also provides a photographing device. The schematic diagram of the composition and structure of the device is shown in FIG.

The acquisition module 31 is used to acquire the state information of the target object under the state of collecting the audio signal input by the target object;

The judging module 32 is configured to judge whether the status information meets the shooting conditions;

The photographing module 33 is configured to control the photographing device to photograph the multimedia for the target object if the state information meets the photographing conditions. Wherein, the multimedia for the target object includes one of the following: pictures; videos;

Here, the acquiring module is specifically configured to: acquire at least one of the following information:

the tone of voice of the target audience;

the volume of the target object;

The facial expression characteristics of the target object.

Here, the device further includes an adjustment module, configured to adjust the shooting angle of at least one camera device, so that the target object is within the shooting range of the at least one camera device; or, if the target object is located in the camera device If the captured preview image is outside the specified area, the target object is prompted to change its position. Specifically, when the target object is within the shooting range of the camera device, and the shooting angle needs to be adjusted when the shooting angle is not good, the shooting angle of the camera device is adjusted so that the target object is within the shooting range of at least one camera device; When the target object is outside the specified area of the preview image taken by the camera, a prompt message appears, prompting the target object to change its position so that the target object enters the shooting range of at least one camera device, and then adjusted so that The target object is within the shooting range of at least one camera device. Further, the adjustment module is specifically configured to: automatically adjust the shooting angle of the camera; or adjust the shooting angle of the camera in response to a received shooting angle adjustment instruction.

Further, the judging module is specifically configured to: when the state information of the target object acquired by the acquiring module includes the tone of the target object, and the tone of the target object during the audio signal output process is greater than a tone threshold , it is determined that the shooting conditions are met;

It is also specifically used for: when the state information of the target object acquired by the acquisition module includes the volume of the target object, and the volume of the target object during the audio signal output process is greater than a volume threshold, determine that the shooting condition is met;

It is also specifically used for: when the state information of the target object acquired by the acquisition module includes the facial expression characteristics of the target object, and it is judged whether there is a similarity degree to the facial expression characteristics of the target object in the expression database The preset facial expression feature of the degree threshold; if it exists, it is determined that it meets the shooting conditions; wherein, the expression storehouse is a database for storing preset facial expression features; the preset facial expression feature is a preset, The state information used to characterize the target object meets the facial expression features of the shooting conditions.

Further, the device further includes a preset module, specifically configured to: play preset multimedia; if the state information does not meet the shooting conditions, when the playback progress of the preset multimedia reaches a preset time point, The camera is controlled to capture multimedia for the target object. Wherein, the preset multimedia is existing multimedia with at least one preset time point preset.

Specifically, the pitch and volume of the voice signal output by the target object during the audio signal output process will constantly change, and in the case of a high pitch, there will often be clear state information, such as rich facial expressions and various body movements. , so when the state information of the target object acquired by the acquisition module includes the tone of the target object, and the tone of the target object during the audio signal output process is greater than the tone threshold, it is determined that the shooting condition is met. Wherein, the tone threshold is an empirical value, and a certain value in the tone can be set as the tone threshold, for example, 2000 US is set as the tone threshold; or, when the target object acquired by the acquisition module The status information includes the volume of the target object, and when the volume of the target object during the audio signal output process is greater than a volume threshold, it is determined that the shooting condition is met. Wherein, the volume threshold is an empirical value, and a certain value in the volume can be set as the volume threshold, for example, 40 decibels is set as the volume threshold; or, when the target object acquired by the acquisition module The state information includes the facial expression feature of the target object, and it is judged whether there is a preset facial expression feature whose similarity with the facial expression feature of the target object is greater than a similarity threshold in the expression storehouse; wherein, the similarity threshold is Empirical values, facial expressions with a similarity greater than 80% can be set as the similarity threshold. The preset expression may be a sad expression, a happy expression, a ferocious expression, and the like.

Further, the device further includes a preprocessing module, configured to preprocess the multimedia for the target object, and store the preprocessed multimedia; wherein, the preprocessing includes at least one of the following methods: Generate emoticons according to the acquired multimedia; make the acquired multimedia into a personalized video.

Further, the preprocessing module is specifically configured to: if the state information meets the shooting conditions, control the device to record the audio signal currently input by the target object; The object's multimedia is composited into one video.

Further, the device further includes a replacement module, configured to use the synthesized video to replace the preset multimedia.

Further, the apparatus further includes a sending module, configured to send the multimedia and/or the video for the target object to a designated terminal device.

In practical applications, the acquisition module 31, the discrimination module 32, the photographing module 33, the adjustment module, the preset module, the preprocessing module, the replacement module and the sending module can be controlled by a central processing unit (CPU, Central) located in the multimedia processing system. Processing Unit), microprocessor (MPU, Micro Processor Unit), digital signal processor (DSP, Digital Signal Processor), or Field Programmable Gate Array (FPGA, Field Programmable Gate Array).

It should be noted that: when the photographing device provided in the above-mentioned embodiment performs photographing, the division of the above-mentioned program modules is used as an example for illustration. The internal structure of the program is divided into different program modules to complete all or part of the processing described above. In addition, the photographing device provided in the above embodiments and the photographing method embodiments belong to the same idea, and the specific implementation process thereof is detailed in the method embodiments, and will not be repeated here.

In order to realize the above method, an embodiment of the present invention also provides another shooting device, which includes a memory, a processor, and an executable program stored on the memory and capable of being run by the processor, and the processor runs the When the program is executable, do the following:

In the state of collecting the audio signal input by the target object, obtain the state information of the target object;

judging whether the state information meets the shooting conditions;

If the state information meets the shooting condition, the camera is controlled to shoot the multimedia for the target object.

The processor is also configured to perform the following operations when running the executable program:

adjusting the shooting angle of at least one camera so that the target object is within the shooting range of the at least one camera; or, if the target object is located outside the specified area of the preview image captured by the camera, prompting the The target object changes position.

The processor is also configured to perform the following operations when running the executable program:

automatically adjust the shooting angle of the camera; or,

In response to the received shooting angle adjustment instruction, the shooting angle of the camera device is adjusted.

The processor is also configured to perform the following operations when running the executable program:

The acquiring state information of the target object includes acquiring at least one of the following information:

the tone of voice of the target audience;

the volume of the target object;

The facial expression characteristics of the target object.

The processor is also configured to perform the following operations when running the executable program:

When the state information of the target object includes the tone of the target object, the judging whether the state information meets the shooting conditions includes: when the tone of the target object in the audio signal output process is greater than a tone threshold, judging Meet the shooting conditions;

When the state information of the target object includes the volume of the target object, the judging whether the state information meets the shooting conditions includes: when the volume of the target object in the audio signal output process is greater than a volume threshold, judging Meet the shooting conditions;

When the state information of the target object includes the facial expression features of the target object, the judging whether the state information meets the shooting conditions includes: judging whether there is similarity with the facial expression features of the target object in the expression database Degree is greater than the preset facial expression feature of the similarity threshold; if it exists, it is determined that it meets the shooting conditions; wherein, the expression library is a database for storing preset facial expression features; the preset facial expression feature is a preset facial expression feature The state information set to characterize the target object conforms to the facial expression feature of the shooting condition.

The processor is also configured to perform the following operations when running the executable program:

Play preset multimedia;

If the state information does not meet the shooting condition, when the preset playing progress of the multimedia reaches a preset time point, the camera is controlled to shoot the multimedia targeted at the target object.

The processor is also configured to perform the following operations when running the executable program:

The device provided with the camera device is applied to a mini karaoke room.

The processor is also configured to perform the following operations when running the executable program:

The multimedia for the target object includes one of the following: pictures; videos;

The method also includes:

Preprocessing the multimedia for the target object, and storing the preprocessed multimedia;

Wherein, the preprocessing includes at least one of the following methods: generating an emoticon package according to the acquired multimedia; making the acquired multimedia into a personalized video.

The processor is also configured to perform the following operations when running the executable program:

If the state information meets the shooting conditions, then controlling the device to record the audio signal currently input by the target object;

Combining the recorded audio signal and the multimedia for the target object into one video.

The processor is also configured to perform the following operations when running the executable program:

The synthesized video is used to replace the preset multimedia.

The processor is also configured to perform the following operations when running the executable program:

Send the multimedia and/or the video for the target object to a designated terminal device.

The hardware structure of the photographing device will be further described below by taking the photographing device implemented as a server or terminal for photographing as an example.

FIG. 4 shows a schematic diagram of a hardware structure of a camera according to an embodiment of the present invention. The camera 400 shown in FIG. 4 includes: at least one processor 401 , a memory 402 , a user interface 403 and at least one network interface 404 . Various components in the camera 400 are coupled together through a bus system 405 . It can be understood that the bus system 405 is used to realize connection and communication between these components. In addition to the data bus, the bus system 405 also includes a power bus, a control bus and a status signal bus. However, for clarity of illustration, the various buses are labeled as bus system 405 in FIG. 4 .

Wherein, the user interface 403 may include a display, a keyboard, a mouse, a trackball, a click wheel, keys, buttons, a touch panel or a touch screen, and the like.

It can be understood that the memory 402 may be a volatile memory or a non-volatile memory, and may also include both volatile and non-volatile memories.

The memory 402 in the embodiment of the present invention is used to store various types of data to support the operation of the camera 400 . Examples of these data include: any computer program for operating on the photographing device 400 , such as an executable program 4021 , and the program for implementing the method of the embodiment of the present invention may be included in the executable program 4021 .

The methods disclosed in the foregoing embodiments of the present invention may be applied to the processor 401 or implemented by the processor 401 . The processor 401 may be an integrated circuit chip and has signal processing capabilities. In the implementation process, each step of the above method may be completed by an integrated logic circuit of hardware in the processor 401 or instructions in the form of software. The aforementioned processor 401 may be a general-purpose processor, DSP, or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and the like. The processor 401 may implement or execute various methods, steps, and logic block diagrams disclosed in the embodiments of the present invention. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the methods disclosed in the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in a storage medium, and the storage medium is located in the memory 402. The processor 401 reads the information in the memory 402, and completes the steps of the foregoing method in combination with its hardware.

In an exemplary embodiment, the embodiment of the present invention also provides a storage medium on which an executable program is stored, and when the executable program is run by the processor 401 of the photographing device 400, the following operations are performed:

In the state of collecting the audio signal input by the target object, obtain the state information of the target object;

judging whether the state information meets the shooting conditions;

If the state information meets the shooting condition, the camera is controlled to shoot the multimedia for the target object.

When the executable program is run by the processor 401 of the photographing device 400, the following operations are also performed:

adjusting the shooting angle of at least one camera so that the target object is within the shooting range of the at least one camera; or, if the target object is located outside the specified area of the preview image captured by the camera, prompting the The target object changes position.

When the executable program is run by the processor 401 of the photographing device 400, the following operations are also performed:

automatically adjust the shooting angle of the camera; or,

In response to the received shooting angle adjustment instruction, the shooting angle of the camera device is adjusted.

When the executable program is run by the processor 401 of the photographing device 400, the following operations are also performed:

The acquiring state information of the target object includes acquiring at least one of the following information:

the tone of voice of the target audience;

the volume of the target object;

The facial expression characteristics of the target object.

When the executable program is run by the processor 401 of the photographing device 400, the following operations are also performed:

When the state information of the target object includes the tone of the target object, the judging whether the state information meets the shooting conditions includes: when the tone of the target object in the audio signal output process is greater than a tone threshold, judging Meet the shooting conditions;

When the state information of the target object includes the volume of the target object, the judging whether the state information meets the shooting conditions includes: when the volume of the target object in the audio signal output process is greater than a volume threshold, judging Meet the shooting conditions;

When the state information of the target object includes the facial expression features of the target object, the judging whether the state information meets the shooting conditions includes: judging whether there is similarity with the facial expression features of the target object in the expression database Degree is greater than the preset facial expression feature of the similarity threshold; if it exists, it is determined that it meets the shooting conditions; wherein, the expression library is a database for storing preset facial expression features; the preset facial expression feature is a preset facial expression feature The state information set to characterize the target object conforms to the facial expression feature of the shooting condition.

When the executable program is run by the processor 401 of the photographing device 400, the following operations are also performed:

Play preset multimedia;

If the state information does not meet the shooting condition, when the preset playing progress of the multimedia reaches a preset time point, the camera is controlled to shoot the multimedia targeted at the target object.

When the executable program is run by the processor 401 of the photographing device 400, the following operations are also performed:

The device provided with the camera device is applied to a mini karaoke room.

When the executable program is run by the processor 401 of the photographing device 400, the following operations are also performed:

The multimedia for the target object includes one of the following: pictures; videos;

The method also includes:

Preprocessing the multimedia for the target object, and storing the preprocessed multimedia;

Wherein, the preprocessing includes at least one of the following methods: generating an emoticon package according to the acquired multimedia; making the acquired multimedia into a personalized video.

When the executable program is run by the processor 401 of the photographing device 400, the following operations are also performed:

If the state information meets the shooting conditions, then controlling the device to record the audio signal currently input by the target object;

Combining the recorded audio signal and the multimedia for the target object into one video.

When the executable program is run by the processor 401 of the photographing device 400, the following operations are also performed:

The synthesized video is used to replace the preset multimedia.

When the executable program is run by the processor 401 of the photographing device 400, the following operations are also performed:

Send the multimedia and/or the video for the target object to a designated terminal device.

Those skilled in the art should understand that the embodiments of the present invention may be provided as methods, systems, or executable program products. Accordingly, the present invention can take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of an executable program product embodied on one or more computer-usable storage media (including but not limited to magnetic disk storage, optical storage, etc.) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and executable program products according to embodiments of the invention. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and a combination of procedures and/or blocks in the flowchart and/or block diagram can be realized by executable program instructions. These executable program instructions can be provided to a general purpose computer, special purpose computer, embedded processor or processor of a reference programmable data processing device to produce a machine such that the instructions executed by the computer or a processor of a reference programmable data processing device produce Means for realizing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

These executable program instructions may also be stored in a computer-readable memory capable of directing a computer or reference programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the The instruction means implements the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

These executable program instructions can also be loaded onto a computer or reference programmable data processing device, causing a series of operational steps to be performed on the computer or reference programmable device to produce a computer-implemented process for execution on the computer or reference programmable device The instructions provide steps for implementing the functions specified in the procedure or procedures of the flowchart and/or the block or blocks of the block diagram.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the protection scope of the present invention.

Claims (23)

1. A shooting method, characterized in that, the method is applied to equipment provided with a camera, and the method comprises: In the state of collecting the audio signal input by the target object, obtain the state information of the target object; judging whether the state information meets the shooting conditions; If the state information meets the shooting condition, the camera is controlled to shoot the multimedia for the target object. 2. The method according to claim 1, further comprising: adjusting the shooting angle of at least one camera so that the target object is within the shooting range of the at least one camera; or, if the target object is located outside the specified area of the preview image captured by the camera, prompting the The target object changes position. 3. The method according to claim 2, wherein said adjusting the shooting angle of at least one camera device comprises: automatically adjust the shooting angle of the camera; or, In response to the received shooting angle adjustment instruction, the shooting angle of the camera device is adjusted. 4. The method according to claim 1, wherein said obtaining the status information of the target object comprises obtaining at least one of the following information: the tone of voice of the target audience; the volume of the target object; The facial expression characteristics of the target object. 5. The method of claim 4, wherein, When the state information of the target object includes the tone of the target object, the judging whether the state information meets the shooting conditions includes: when the tone of the target object in the audio signal output process is greater than a tone threshold, judging Meet the shooting conditions; When the state information of the target object includes the volume of the target object, the judging whether the state information meets the shooting conditions includes: when the volume of the target object in the audio signal output process is greater than a volume threshold, judging Meet the shooting conditions; When the state information of the target object includes the facial expression features of the target object, the judging whether the state information meets the shooting conditions includes: judging whether there is similarity with the facial expression features of the target object in the expression database Degree is greater than the preset facial expression feature of the similarity threshold; if it exists, it is determined that it meets the shooting conditions; wherein, the expression library is a database for storing preset facial expression features; the preset facial expression feature is a preset facial expression feature The state information set to characterize the target object conforms to the facial expression feature of the shooting condition. 6. according to the described method of claim 5, it is characterized in that, described method also comprises: Play preset multimedia; If the state information does not meet the shooting condition, when the preset playing progress of the multimedia reaches a preset time point, the camera is controlled to shoot the multimedia targeted at the target object. 7. The method according to claim 6, wherein the multimedia for the target object comprises one of the following: picture; video; The method also includes: Preprocessing the multimedia for the target object, and storing the preprocessed multimedia; Wherein, the preprocessing includes at least one of the following methods: generating an emoticon package according to the acquired multimedia; making the acquired multimedia into a personalized video. 8. The method according to claim 7, wherein the method further comprises: If the state information meets the shooting conditions, then controlling the device to record the audio signal currently input by the target object; Combining the recorded audio signal and the multimedia for the target object into one video. 9. The method according to claim 8, wherein the method further comprises: The synthesized video is used to replace the preset multimedia. 10. The method according to claim 9, further comprising: Send the multimedia and/or the video for the target object to a designated terminal device. 11. The method according to any one of claims 1-10, characterized in that, the device provided with the camera device is applied to a mini karaoke room. 12. A photographing device, characterized in that the device comprises: an acquisition module, a discrimination module, and a photographing module; wherein, The acquisition module is used to acquire the state information of the target object in the state of collecting the audio signal input by the target object; The judging module is used to judge whether the state information meets the shooting conditions; The photographing module is configured to control the photographing device to photograph the multimedia for the target object if the state information meets the photographing conditions. 13. The device according to claim 12, further comprising an adjustment module, configured to adjust the shooting angle of at least one camera device, so that the target object is within the shooting range of the at least one camera device or, if the target object is located outside the specified area of the preview image captured by the camera device, prompting the target object to change its location. 14. The device according to claim 13, wherein the adjustment module is specifically used for: automatically adjust the shooting angle of the camera; or, In response to the received shooting angle adjustment instruction, the shooting angle of the camera device is adjusted. 15. The device according to claim 12, wherein the acquiring module is specifically configured to: acquire at least one of the following information: the tone of voice of the target audience; the volume of the target object; The facial expression characteristics of the target object. 16. The apparatus of claim 15, wherein: The judging module is specifically configured to: when the state information of the target object acquired by the acquisition module includes the tone of the target object, and the tone of the target object during the audio signal output process is greater than a tone threshold, determine Meet the shooting conditions; It is also specifically used for: when the state information of the target object acquired by the acquisition module includes the volume of the target object, and the volume of the target object during the audio signal output process is greater than a volume threshold, determine that the shooting condition is met; It is also specifically used for: when the state information of the target object acquired by the acquisition module includes the facial expression characteristics of the target object, and it is judged whether there is a similarity degree to the facial expression characteristics of the target object in the expression database The preset facial expression feature of the degree threshold; if it exists, it is determined that it meets the shooting conditions; wherein, the expression storehouse is a database for storing preset facial expression features; the preset facial expression feature is a preset, The state information used to characterize the target object meets the facial expression features of the shooting conditions. 17. The device according to claim 16, characterized in that the device further comprises a preset module, specifically for: Play preset multimedia; If the state information does not meet the shooting condition, when the preset playing progress of the multimedia reaches a preset time point, the camera is controlled to shoot the multimedia for the target object. 18. The device according to claim 12, further comprising a preprocessing module configured to preprocess the multimedia for the target object and store the preprocessed multimedia; wherein, The preprocessing includes at least one of the following methods: generating an emoticon package according to the acquired multimedia; making the acquired multimedia into a personalized video. 19. The device according to claim 19, wherein the preprocessing module is specifically configured to: if the state information meets the shooting conditions, control the device to record the audio signal currently input by the target object ; Synthesizing the recorded audio signal and the multimedia for the target object into one video. 20. The device according to claim 19, further comprising a replacement module, configured to use the synthesized video to replace the preset multimedia. 21. The device according to claim 20, further comprising a sending module, configured to send the multimedia and/or the video for the target object to a designated terminal device. 22. A storage medium, on which an executable program is stored, wherein when the executable program is executed by a processor, the steps of the method according to any one of claims 1 to 11 are implemented. 23. A photographing device, comprising a memory, a processor, and an executable program stored on the memory and capable of being run by the processor, characterized in that, when the processor runs the executable program, it executes claims 1 to 10. 11. The steps of any one of the methods.