JP2001042880A - Karaoke device and karaoke video software - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make expandable a method of utilizing a KARAOKE device, and to make more familiar videos enjoyable. SOLUTION: This device comprises an input means 1 for inputting selected music data and voice, a selected music telecast means 2 for selecting, processing, and telecasting the best KARAOKE video from this selected music data, a video display means 3 for displaying a KARAOKE video, a voice output means 4 for outputting KARAOKE performance and singing voice, a video storage means 5 for storing KARAOKE videos selected by the telecast means 2 and a KARAOKE video changed into singer's face, a photographing means 6 for photographing the singer, a video synthesis means 7 for changing the face image of the singer in the KARAOKE video into that of this photographed singer by pasting the latter on the former, and a recording means 8 for recording KARAOKE video in which the face of the singer is changed into that of the selected music telecast means 2.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a karaoke apparatus,
In particular, it relates to a digital karaoke apparatus and karaoke video software.

[0002]

2. Description of the Related Art As shown in FIG. 21, a conventional karaoke apparatus generally has a remote controller for selecting karaoke and input means 1 for inputting a singing voice from a microphone, and a selected song for a laser disk, a CD, a DVD and a communication line. And the like, and the selected song is broadcast as a karaoke video, the video display 3 displays the selected video and the lyrics, the singer's singing voice input to the input device 1 from the microphone, and the karaoke performance Is output by the audio output means 4.

[0003]

However, in the conventional karaoke apparatus as described above, the singer sings along with the karaoke performance while watching the lyrics of the selected karaoke video, so that a person who is good at singing is not good at singing. It was advantageous because it was possible to hear a singing voice. For this reason, there was a problem that people who were not good at singing did not sing even if they went to karaoke. In addition, since the conventional karaoke video is determined by the title, the same video is always displayed for the same tune, so that there is a disadvantage that it is difficult for other people to select the same tune. In addition, the singer did not pay much attention because the singer was searching for the song selection number of the next song to sing during karaoke. Further, in the conventional karaoke apparatus, it was not possible for a singer to make the singer feel like singing on an actual stage like a professional singer who appeared in a song program on a television or the like. In the past, there were not many karaoke videos that children could enjoy. On the other hand, there has been a problem that it is impossible to make a singer's desired karaoke video with a conventional karaoke apparatus. Furthermore, there is no conventional karaoke apparatus that automatically broadcasts an advertisement video or the like while a singer is not broadcasting a karaoke video.

[0004] The present invention has been made in view of the above-mentioned circumstances. Conventionally, a singer simply sang to a karaoke performance while looking at the lyrics of a karaoke video, but the singer selected a video of a desired style. It changes the face of the person in the karaoke video to the singer's face and broadcasts it, and also changes and processes the background picture of the karaoke video of the selected song to the video desired by the singer and broadcasts it, singing voice It is another object of the present invention to provide a karaoke apparatus that can enjoy not only a video but also a karaoke apparatus, and a karaoke apparatus that automatically broadcasts an image such as an advertisement when a singer is not selecting a song or performing karaoke.

[0005]

According to a first aspect of the present invention, there is provided a karaoke apparatus comprising: an input unit for inputting music selection data and voice; A music selection and broadcasting means for selecting and processing a selected karaoke video, and a video storage means for recording the selected video, a photographing means for digitally photographing the singer's face continuously at the start of karaoke, and the video storage Digitally analyzing the face image of the person in the image of the means, collecting face image data, synchronizing the face image of the person in the karaoke image with the karaoke image, and changing the face image to the singer's face photographed by the photographing means. Image synthesizing means, an image displaying means for displaying an image of the image synthesizing means, a singing voice of the singer input by the input means, and a karaoke performance selected by the music selecting and broadcasting means. A karaoke apparatus characterized by comprising an audio output means for outputting.

According to a second aspect of the present invention, in the karaoke apparatus according to the first aspect, instead of the photographing means for continuously photographing the singer's face simultaneously with the start of the karaoke, the singer's face is preliminarily determined before the start of the karaoke. It is equipped with a photographing means for digital photographing and a video analyzing means for digitally analyzing the image of the face of the photographed singer and collecting image data of various facial expressions and face orientations. A karaoke apparatus characterized in that a face image of a person in a karaoke video is changed in advance to the photographed singer's face image and edited, and the singer's face image is broadcast as a karaoke video at the start of karaoke.

According to a third aspect of the present invention, in the karaoke apparatus according to the first and second aspects, a recording means is connected to and added to the music selection and broadcasting means, and the video displayed by the video display means is recorded. A karaoke apparatus characterized by being capable of recording a karaoke performance song and a singer's singing voice output by the voice output means, or printing a karaoke video.

According to a fourth aspect of the present invention, there is provided a karaoke video software employing the karaoke apparatus according to the first and second aspects, wherein a face of a person in the karaoke video can be changed to a face of a singer or the like. The karaoke machine is equipped with image data such as outline, face size, face direction, etc., eyes, nose, mouth, ears, eyebrows, hairstyles, etc., and the entire face area including shading and shading. Karaoke video software for the device.

According to a fifth aspect of the present invention, there is provided a karaoke video software employing the karaoke apparatus according to the first and second aspects, wherein only the persons and lyrics in the video are left in the selected karaoke video, and the background of the video is obtained. This is karaoke video software for a background picture of a karaoke apparatus, wherein a picture or the like can be changed or processed into a seasonal feeling, a desired scenery, an object or the like by designating.

According to a sixth aspect of the present invention, there is provided a karaoke apparatus according to the first and second aspects, wherein even if there is a singer, a video such as an advertisement is automatically displayed while the karaoke video is not being displayed. A karaoke apparatus characterized by the following.

[0011]

An embodiment of the present invention will be described below with reference to the drawings. 1 and 2 are diagrams showing a basic configuration of a karaoke apparatus according to the present invention.

This karaoke apparatus is constructed by digitizing a conventional karaoke apparatus and adding functions of a personal computer, a digital video camera, and the like, and changing a person's face in a karaoke picture to a singer's face. In addition to being broadcast, the karaoke video of the selected song is changed and processed by the singer to the video desired by the singer, so that not only the singing voice but also the video can be enjoyed.

First, in FIG. 1, input means 1 includes a remote control for specifying the name of a karaoke song and the content of a karaoke video, a voice input device for selecting a song by voice, a microphone for inputting a singing voice, and the like. You can do it. The input result of the data input to the input means 1 is transmitted to the music selection and broadcasting means 2. The transmission between the input means 1 and the music selection / broadcasting means 2 may be wireless or wired.

Next, the music selection / broadcasting means 2 digitizes the same one as the conventional karaoke apparatus, and further converts it into a personal computer,
A karaoke video of a selected tune is searched and extracted from karaoke video software of various fields stored in the video storage means 5 to select a tune. However, the difference from the conventional karaoke video is that the selected karaoke video software is equipped with face image data of the person in the karaoke video,
That is, the face image of the person can be changed. In addition, various fields are prepared for the same song and the content of the video. For example, the singer can select a video desired by the singer, such as a stage style, historical drama style, animation style, or a standard original video. In addition, seasonal feeling and the like can be processed by designating the karaoke video. For example, in the spring, cherry blossom petals can be scattered on the selected karaoke video. Further, it is possible to specify that a landscape such as a flower, a mountain, or the sea is displayed in a background picture of a video. In the case of the music selection / broadcasting means 2 via the communication line, the image storage means 5 is provided at the communication line destination, and the selected karaoke image and the image data of the background picture in various fields are equipped. Can be implemented.

The music selection and broadcasting means 2 comprises a video display means 3
Are connected to the audio output means 4, the image storage means 5, and the recording means 8 for transmitting and receiving signals.

Next, the image display means 3 displays the selected karaoke image and lyrics, and displays a CRT (cathode ray tube), a liquid crystal, a plasma display, a projector, and a PDP (plasma display panel) of a wall-mounted television. , FED (Field Emission
Display), PALC (plasma addressed liquid crystal),
This is a display device such as an SED (Surface Conduction Electron Emission Display) and is displayed on a screen.

The sound output means 4 is an amplifier and a speaker, as in the conventional karaoke apparatus, and outputs karaoke performance music and the singing voice of the singer.

Further, the recording means 8 is for recording and recording karaoke video, printing and the like.
Printing is performed on a recording medium such as RW, DVD, video tape, and cache memory by a color copying machine or the like. That is, it is possible to record and record a karaoke image and a singing voice of the singer's face by designating it. If there is a video desired by the singer among the karaoke videos, the karaoke video can be paused and color-printed like a photograph. Incidentally, the recording means 8 does not have to be particularly equipped.

On the other hand, the video storage means 5 is composed of functions such as a personal computer, a workstation and a server, and a recording medium such as a hard disk. The extracted karaoke video that has been selected is stored again, and face image data of the person in the karaoke video is collected. As the face image data of the karaoke video, there are image data of only the face such as face outline and size, face direction and shadow, eyes, nose, mouth, ears, eyebrows, etc., and the whole head from the neck up to and including the hair. Outline and size, face orientation and shading and eyes, nose,
There are two types of image data of the whole head, such as mouth, ears, eyebrows, and hairstyle. Since these two types of image data are designated as the outline of the face to be changed by the input unit 1, the image data is transmitted to the video synthesizing unit 7 based on the designation result.

In the image storage means 5, karaoke image software for a background picture is input and stored in advance.
Equipped with images of various background pictures of seasonal feeling and image style displayed on the background of the karaoke video, and if specified, instead of the background picture of the original video of the selected karaoke, the specified background The picture is transmitted to the video synthesizing means 7. In the case of communication karaoke, the function of the image storage means 5, such as a background picture of the karaoke image, is provided at the communication line destination.

Next, the photographing means 6 is a digital video camera, a television camera, a CMOS camera, a CCD, an infrared photographing device, etc. The karaoke device shown in FIG.
The singer's face image photographed by the photographing means 6 is continuously photographed at the same time as the start of the karaoke song, and stopped at the end of one song. Note that the photographing device of the photographing means 6 is configured so as to follow and photograph the singer's face while automatically focusing on a sensor or the like attached to the microphone of the input means 1.

The photographing means 6 is preferably a method of processing an image photographed by an infrared photographing apparatus since a general karaoke box is dim. However, in the case of a photographing apparatus such as a video camera or a CCD, the photographer is a photographer. A function is provided for correcting the face image so that the face image can be automatically and brightly displayed. Further, when the image of the singer to be photographed is particularly dark, the lighting device is automatically turned on to illuminate the singer's face following the photographing of the photographing means 6. The singer's face image photographed by the photographing means 6 is transmitted to the video synthesizing means 7.

Next, the video synthesizing means 7 is constituted by a personal computer, a workstation, a server, etc., and calls out face image data of a person in the selected karaoke video stored in the video storing means 5. Then, based on the face image data, the image is changed to the singer's face image photographed by the photographing means 6 and synthesized, and the karaoke video is edited again to the singer's face. That is, face image data of the size of the face of the person in the karaoke image and the size of the entire head hair are extracted, and the singer's face photographed by the photographing means 6 in accordance with the size is directly used as the progress of the karaoke image. Synchronously and continuously, automatically paste and broadcast.

The karaoke video image changed to the singer's face image and synthesized is transmitted to the video image storage means 5 and stored again. Then, it is transmitted to the music selection and broadcasting means 2.

Next, the music selection / broadcasting means 2 displays the karaoke image synthesized by changing to the singer's face image on the video display means 3 for the video, and the audio output for the karaoke performance and singing voice. Output by means 4.

On the other hand, the recording means 8 converts the karaoke image synthesized by changing to the singer's face image into an MO, a CD if necessary.
-Record and record on recording media such as RW, DVD, videotape, etc., and if there is a karaoke video desired by the singer, pause the karaoke and print it with a color copier like a photograph. Can be done.

Next, FIG. 2 is obtained by adding a video analyzing means 9 to FIG. The first difference between the functions of FIG. 1 is that the face of the singing singer photographed by the photographing means 6 in FIG. 1 is directly synchronized with the face image of the person in the karaoke video, and is continuously pasted. Was changed to the face of the singer, whereas the photographing means 6 of FIG. 2 uses various types of faces of the singer in advance, such as a normal face, a smiling face, and a left-right oblique face, before selecting a song. This means that a photograph is taken by a digital video or a digital camera or the like, and is stored in the photographing means 6 in advance.

The second difference from FIG. 1 is that various face images of the singer photographed in advance by the photographing means 6 are input to the image analyzing means 9, and the image analyzing means 9 selects a song before the singer sings. Sometimes, we collect face image data of the person in the selected karaoke video, extract the face image of the singer that was captured in advance, similar to the face image data of the collected person, before starting the karaoke broadcast, The face of the person in the selected karaoke video is changed to the face of the singer, and the synthesizing process is performed in advance.

In FIG. 2, input means 1, music selection and broadcasting means 2, video display means 3, audio output means 4, video storage means 5
The recording means 8 and the recording means 8 have the same configuration as in FIG. 1 and will not be described again. However, the photographing means 6 in FIG. 2 is connected to the video analyzing means 9, and the video analyzing means 9 is connected to the ing.

On the other hand, the photographing means 6 shown in FIG. 2 is for photographing the singer's face with a digital video or digital camera or the like in advance before selecting a karaoke, and is connected to the video analyzing means 9. That is, various faces such as the face direction and expression of the singer are photographed, and the photographed singer's face image data is transmitted to the video analyzing means 9.

As a photographing method of the photographing means 6, in the case of photographing with digital video, for example, it is possible to continuously photograph the singer from the left sideways face to the frontal face, the right sideways face, and facial expressions. In the case of, the singer is photographed for each face direction. Further, if the singer is dissatisfied with the photographed face, the photographer can take the photograph again and correct it. Furthermore, the eyes of the face taken,
The nose, mouth, ears, eyebrows, hairstyle, and the like can also be modified by extracting them from various patterns provided in advance and pasting them to the photographed face.

Next, the video analyzing means 9 of FIG. 2 is constituted by a personal computer, a workstation, a server, or the like, and analyzes the face of the singer photographed by the photographing means 6 by linking it to a song selection number into various faces. The face image data is collected. Then, based on the face image data of the person in the karaoke video, an approximate singer's face is selected, and the face image data is transmitted / received to / from the video synthesizing means 7. You can change the face of the person in the karaoke video to the singer's face and broadcast it. Then, various kinds of face image data of the singer extracted based on the face image data of the person in the karaoke video are transmitted to the video synthesizing means 7.

Next, the video synthesizing means 7 shown in FIG. 2 is composed of the same personal computer, workstation, server or the like as the video analyzing means 9, and the selected karaoke music stored in the video storing means 5 is selected. The face image data of the person in the video is called, and the approximate singer's face extracted by the video analysis means 9 based on the face image data is pasted to the face of the person in the karaoke video, changed, and synthesized. , To edit the karaoke video back to the singer's face. In other words, the photographed singer's face image data is combined with the face image data of the person in the karaoke video by combining the contour and shadow of the face, and the like.
Create a karaoke video of the singer's face image. If there is a background picture of the designated karaoke video, the picture is extracted and processed or synthesized as a background picture of the singer's face image. Then, the karaoke video changed to the singer's face image is transmitted to the video storage unit 5.

The video storing means 5 stores the karaoke video changed to the singer's face image again, transmits the karaoke video to the music selection and broadcasting means 2 and displays it on the video displaying means 3 as in FIG. The karaoke performance and the singing voice of the singer are output by the voice output means 4.

As described above, in FIG. 1, the singer's face is photographed in synchronization with the karaoke video, and the face of the person in the karaoke video is changed to the singer's face. On the other hand, FIG. 2 shows the face of the singer before shooting of the karaoke video based on the face image data of the person in the karaoke video based on the face image data of the person in the karaoke video. There is a difference that it is changed beforehand to a face that is similar to the face before it is broadcast.

FIG. 3 shows an example of an appearance image of the karaoke apparatus according to the first aspect of the present invention.
A video camera that automatically tracks and shoots the singer's face,
The lighting device illuminates when the singer's face is dark, a microphone for inputting the singing voice, a video camera tracking sensor for tracking and shooting the singer, a karaoke device and a personal computer, and the like.

The karaoke apparatus and karaoke video software configured as described above will be described with reference to FIGS. Here, it is assumed that various karaoke video software has been input and stored in the video storage means 5 in advance. First, FIG. 4 shows an embodiment of an input screen at the time of karaoke song selection, which is displayed on the video display means 3 of FIG. 1 according to claim 1 of the present invention. In FIG.
The music selection order is automatically added for each music selection. A
The song name or song selection number in the column is automatically entered by inputting the song name into the input means 1 using a microphone or the like, or by inputting the karaoke song selection number using a remote controller or the like, so that the song name and the name of the singer who sang the song are automatically entered. Display. The input method of the screen may be a method of directly touching and selecting the screen, other than voice and remote control input.

Next, the singer in column B inputs whether the singer is male or female and inputs his name. In the photographing of the singer in column C, the photographer selects whether to photograph the singer's face or not.
If you do not shoot, the karaoke video will be broadcast with the original video provided as standard.

Next, the singer selects a desired karaoke video in the D column. For example, when the stage is selected, a child screen as shown in FIG. 6 is displayed. When a kimono is selected on this child screen, a karaoke video of a singer in a kimono is selected on the stage stage corresponding to the song name. When a historical drama is selected in the D column, a child screen as shown in FIG. 7 is displayed. When a lord is selected on this child screen, the appearance of the lord is displayed in the image of the historical drama corresponding to the song title. The singer's karaoke video is selected and aired.

Next, in the column E, when the singer selects the spring according to the seasonal feeling of the desired video background, a picture representing the spring is selected and displayed as the background picture of the karaoke video selected in the column D. Is done.

Further, when a flower is selected in the style of the picture background picture in column F, a child screen as shown in FIG. 8 is displayed, and the type of flower can be selected.

When a mountain is selected in the style of the picture background picture in the F column, a child screen as shown in FIG. 9 is displayed, and the type of the mountain can be selected.

For example, in the karaoke image when the stage and the kimono are selected in the column D, the spring is selected in the column E, and the flower and the cherry tree are selected in the column F, the cherry tree in full bloom and the petals of the cherry tree are scattered as shown in FIG. A picture of a Japanese singer singing is displayed on the stage stage with the background picture.

In column D, historical drama and lord, in column E summer, F
Karaoke image when mountain and Mt. Fuji are selected in the column
As shown in the above, a historical drama-like image of a singer in the form of a lord is displayed on a background picture of Mt. Fuji in the summer.

Next, the outline of the face to be changed in the G column specifies whether to change only the face of the face image of the person in the karaoke video or the entire head above the neck including the hair and face. ,
In the display example of the image of the lord, if you specify only the face,
As in 1, only the face is changed to the singer's face, leaving the chonmage as it is. If the entire head is specified, the lord's chonmage is deleted, and the entire head above the neck including the hair and face is changed to the singer's face and displayed.

When the selection from the columns A to G in FIG. 4 is completed, the completion of the setting in the column H is designated, so that the singer selects the karaoke image of the desired music selection. In the H column, the conditions selected from the A column to the G column can be changed or canceled.

Further, the pause in the column H of FIG. 4 is to pause when there is an image that the singer likes in the karaoke image, and designate the printing of the karaoke image, thereby recording means such as a color copying machine. In step 8, color printing can be performed like a photograph. In addition, when one karaoke is completed and the user can sing well, or when he / she likes the karaoke video selected by himself, the recording means 8 designates recording in the H column, and the recording means 8 records the recording medium such as a CD-RW. You can also record.

FIG. 5 shows a second embodiment according to the present invention.
FIG. 3 shows an embodiment of an input screen for karaoke music selection displayed on the video display means 3 of FIG. In FIG. 5, columns A to H are the same as those in FIG. 4 and the description of the music selection method is omitted, but FIG. 5 is different from FIG. 4 in that columns J to L are added.

First, the face photographed in advance in column J in FIG. 5 is the same as the face of the singer photographed in advance by the photographing means 6 before selecting a song, such as a normal frontal face, a frontal smile, a diagonal right-facing, a diagonal left-facing, etc. Then, a predetermined face type is automatically displayed to check whether the face is corrected. This pre-photographed face is basic face image data for enabling the singer's face to be changed to an approximate face with respect to the face image data of the person in the selected karaoke video. If the user does not like the face photographed in the pre-shooting, the user can designate a correction in the J column and correct the face in the K column.

Next, in the correction of the face in the K column, various kinds of eyes, nose, mouth,
From the ears, eyebrows, hairstyles, etc.
The user can select a scrolling screen of the column and paste it on the face of the pre-shooting in the column J to correct it. When the desired singer's face is determined, the completion of correction is designated. Then, the position where the singer's face in the J column was instructed to be corrected is corrected.

Then, the name of the singer whose face was photographed in advance is input by the face image number in the L column of FIG. That is, in the example of FIG. 5, since the singer of the face image number of L1 is Mr. Miyagawa, when Mr. Miyakawa inputs L1 at the time of selecting the next song, the face of the person in the selected karaoke video is changed to Mr. Miyakawa. Since the face is changed, the pre-shooting of the singer only needs to be performed once.

One embodiment of a specific karaoke video screen selected by the singer in this way is shown in FIGS. First, FIG. 10 assumes that the singer in the column B of FIGS. 4 and 5 is a man, the karaoke image in the column D is a stage, kimono is selected on the child screen, and the seasonal feeling of the image background in the column E is spring, This is an image when the style of the image background picture in the F column is selected as a flower and the type of flower is selected as cherry on the child screen. In other words, the singer can feel the atmosphere of singing on the stage of the cherry blossoms.

In FIGS. 4 and 5, when the singer in column C is selected to be photographed, the outline of the face to be changed in column G is selected, and the entire head including the face and hair is selected. 1
The face image of the person in the karaoke video of No. 0 is changed to the face of the singer with the hair and face. If only the face is selected in the G column, the hair is changed to the singer's face only with the karaoke image of the head hair.

On the other hand, in changing the face image of the person in the karaoke video shown in FIG. 4, the face of the singer photographed by the photographing means 1 is displayed as it is in the size of the face of the karaoke video in synchronization with the karaoke video. As a result, the singer can shoot the karaoke video with a unique facial expression.
That is, since the head of the person in the karaoke video is replaced with the neck of the singer, the singer can broadcast the program with various expressions.

In the change of the face image of the person in the karaoke video shown in FIG. 5, the face of the singer photographed in advance by the photographing means 6 is determined based on the face image data of the person in the karaoke video at the time of music selection. It is automatically changed to the singer's face before being broadcast.

Next, FIG. 11 shows a case where the singer in column B of FIGS. 4 and 5 is a man, the karaoke video in column D is a historical drama, and a lord is selected on the child screen. This is an image in the case where the feeling is summer and the style of the image background picture in the F column is mountain, and Mt. Fuji is selected on the child screen. In other words, a singer is an example of a karaoke video in which a singer can sing in the form of a lord in front of Mt. Fuji in summer.

Similarly, FIG. 12 shows an example in which historical drama, princess, autumn, and garden are selected. FIG. 13 shows an example of a karaoke image in the case where animation, summer and sky are selected for children and the song selection is made for three siblings.

Next, FIGS. 14 and 15 show a first embodiment of the present invention.
5 is a flowchart showing an example of an operation which operates in conjunction with an instruction on the music selection screen of FIG. 4 according to claim 3.

In FIG. 14, the karaoke apparatus is first turned on to call up the music selection screen shown in FIG. 4 (ST1). Then, the music selection order is automatically displayed on the screen (ST2). Next, the user inputs a tune name by voice or a tune selection number by remote control to the input means 1 (ST3). Then, the name of the selected song and the name of the singer of the song are automatically displayed (ST4). Then, the singer's gender and name are input (ST5).

Next, the singer is photographed, and it is determined whether the face image of the person in the karaoke video is changed to the singer's face (ST)
6). If the face is to be changed to a photographed face, the singer inputs a desired karaoke video field (ST7). Then, a sub-screen corresponding to the field is displayed (ST8), and a desired item is selected from the sub-screen (ST8).
9).

Further, a desired seasonal feeling of the video background is selected and input (ST10). Then, the style of the picture background picture is selected, and the desired type is selected and input from the child screen (ST11). Next, the face of the person in the karaoke video is changed only by the outline of the face, the entire head including the hair is changed from the neck, or the outline of the face to be changed is selected (ST).
12). If the designation result is OK, the setting completion is selected (ST13).

As described above, when the setting of the music selection screen of FIG. 4 is completed, the music selection broadcasting means 2 searches the video storage means 5 for karaoke video software corresponding to the selected input condition ( ST14). Then, the searched and extracted karaoke video is stored again in another place in the video storage means 5 where it can be changed (ST15). then,
Proceed to FIG.

On the other hand, in FIG. 14, if the singer is not photographed in step ST6, the process proceeds to step ST41, and the selected karaoke video is broadcast as it is in the same manner as in the conventional karaoke apparatus (ST41). The performance of the karaoke video is output by the audio output means 4 (ST4).
2) When the singer's singing voice is input to the prelude and read by the microphone (ST43), the singer's singing voice is output by the speaker (S43).
T44). Next, it is confirmed whether the karaoke video is completed for one song (ST45). If it has not ended, the process returns to step ST41 and repeats until one karaoke video ends. If the karaoke video has ended in step ST45, the broadcasting of the karaoke video ends.

Next, in FIG. 15, the video synthesizing means 7 collects the face image data of the person to be changed in the karaoke video image stored by the video storing means 5 based on the designation of the contour of the face to be changed. (ST16). When all the face image data of the person in the selected karaoke video has been collected, the karaoke broadcasting preparation is completed (ST1).
7). If face image data collection has not been completed, the process is continued until the collection is completed.

When the preparation for karaoke broadcasting is completed,
The video synthesizing unit 7 issues a command to start shooting to the shooting unit 6, and the shooting unit 6 starts shooting (ST1).
8). Next, broadcasting of the karaoke video is started by the video display means 3 (ST19).

Further, the image synthesizing means 7 performs the synthesizing and editing process by changing the face of the person in the karaoke image to the face of the photographed singer (ST20). Then, the karaoke video changed to the singer's face is broadcast on the video display means 3 via the video storage means 5 and the music selection and broadcast means 2 (ST21).

On the other hand, when the broadcasting of the karaoke video is started in step ST19, the process proceeds to step ST22, where the music played by the karaoke video is output at the same time (ST22). Then, the singer's singing voice is input by the microphone following the prelude (ST
23). The singing voice of the singer is output from the speaker (ST24). Then, the process proceeds to step ST25.

Further, the image storage means 5 determines in step S
The karaoke video changed to the singer's face and broadcasted in T21 and the singing voice of the singer in step ST24 are simultaneously assigned a number in the song selection order and stored (ST25). Then, it is confirmed whether one karaoke video has been completed (ST2).
6). If one song is not completed, the process returns to step ST20 and repeats until one song is completed. Also,
If the end of one music has been completed in step ST26, the photographing of the photographing means 6 is also stopped (ST27). Then, the broadcasting of the selected karaoke video ends (ST28).

On the other hand, the karaoke video saved in step ST25 and having the singer's face changed in the song selection order is designated by recording in column H of FIG.
Recording can be performed (ST29).

Further, the karaoke video with the song selection order changed to the singer's face saved in step ST25 is designated by pausing and printing in column H of FIG. Stop at the location of the video,
Images can be printed in the same way as photographs (ST3).
0).

FIGS. 16, 17 and 18 are flowcharts showing an example of the operation according to the second and third aspects of the present invention, which operates in conjunction with the instruction on the music selection screen of FIG. It is a thing.

In FIG. 16, the karaoke apparatus is first turned on to call up the music selection screen shown in FIG. 5 (ST1). Then, the music selection order is automatically displayed on the screen (ST2). Next, the user inputs a tune name by voice or a tune selection number by remote control to the input means 1 (ST3). Then, the name of the selected song and the name of the singer of the song are automatically displayed (ST4). Then, the singer's gender and name are input (ST5).

Next, it is determined whether the singer is photographed in advance and the face image of the person in the karaoke video is changed to the singer's face (S)
T6). If the face is changed to the photographed face, the face of the singer is photographed (ST31). Then, various faces of the photographed singer are displayed in the J column of the music selection screen in FIG. 5 (S
T32). Next, it is determined whether to correct the various faces of the displayed singer (ST33). If the singer's face is to be corrected, scroll through the screen in the K column of FIG. 5 for the desired one among various eyes, nose, mouth, eyebrows, hairstyles, etc. provided in advance in the image synthesizing means 7. The user selects and corrects (ST34). Then, the corrected face is displayed and confirmed (ST35). Then, the process proceeds to step ST36.

On the other hand, if the singer's face photographed in advance is not to be corrected in step ST33 of FIG. 16, the process directly proceeds to step ST36.

Next, a name is input to the face image number so that the singer's face photographed in advance can be identified (ST)
36). Then, the video analysis means 9 digitally analyzes the singer's face image taken in advance, and the front normal face,
The face image data of various faces such as a frontal smile, a diagonally right-facing face and the like are collected and assigned with a singer's face image number (ST3).
7). Then, the process proceeds to FIG.

On the other hand, in FIG. 16, if the singer is not photographed in step ST6, the process proceeds to step ST41, and the selected karaoke video is broadcast as it is in the same manner as in the conventional karaoke apparatus (ST41). The performance of the karaoke video is output by the audio output means 4 (ST4).
2) When the singer's singing voice is input to the prelude and read by the microphone (ST43), the singer's singing voice is output by the speaker (S43).
T44). Next, it is confirmed whether the karaoke video is completed for one song (ST45). If it has not ended, the process returns to step ST41 and repeats until one karaoke video ends. If the karaoke video has ended in step ST45, the broadcasting of the karaoke video ends.

Next, the field of the karaoke video desired by the singer is selected in column D of FIG. Then, in FIG. 17, since the field of the karaoke video desired by the singer is input (ST7), a sub-screen corresponding to the field is displayed (ST8), and a desired item is selected from the sub-screen (ST9).

Further, a desired seasonal feeling of the video background is selected and input (ST10). Then, the style of the picture background picture is selected, and the desired type is selected and input from the child screen (ST11). Next, the face of the person in the karaoke video is changed only by the outline of the face, the entire head including the hair is changed from the neck, or the outline of the face to be changed is selected (ST).
12). If the designation result is OK, the setting completion is selected (ST13).

As described above, when the setting of the music selection screen in FIG. 5 is completed, the music selection broadcasting means 2 searches the video storage means 5 for karaoke video software corresponding to the selected input condition ( ST14). Then, the searched and extracted karaoke video is stored again in another place in the video storage means 5 where it can be changed (ST15). then,
Proceed to FIG.

Next, in FIG. 18, the image synthesizing means 7 collects the face image data of the person to be changed in the karaoke image stored by the image storing means 5 based on the designation of the contour of the face to be changed. (ST16). Then, according to the face image data of the person in the selected karaoke video, a synthesis editing process is performed (ST17). Then, the karaoke video changed to the singer's face is stored in the video storage means 5 (ST18).

Next, it is confirmed whether or not all the face images of the persons in the karaoke video have been changed for the selected karaoke video of one tune, and if all the changes have been completed, the process proceeds to the next step ST20. ST19). If all the changes have not been completed, the process returns to step ST16 and repeats until the change for one selected music piece is completed. Then, when the change of the entire face image to the singer's face is completed, the broadcasting of the karaoke video is started (ST20). Then, the karaoke video changed to the singer's face is broadcast by the video display means 3 via the music selection broadcasting means 2 (ST2).
1).

On the other hand, when the broadcasting of the karaoke video is started in step ST20, the process also proceeds to step ST22, where the performance music of the karaoke video is output simultaneously (ST2).
2). Then, following the prelude, the singing voice of the singer is input by the microphone (ST23). The singing voice of the singer is output from the speaker (ST24). Then, the process proceeds to step ST25.

Further, the image storage means 5 determines in step S
The karaoke video changed to the singer's face and broadcasted in T21 and the singing voice of the singer in step ST24 are simultaneously assigned and numbered in a song selection order and stored (ST25). Then, it is checked whether one karaoke video has been completed (ST2).
6). If one song has not been completed, step S
It returns to T21 and repeats until one music is completed. If it is determined in step ST26 that one tune has been completed, the broadcasting of the selected karaoke video ends (ST27).

On the other hand, the karaoke video saved in the step ST25 and having the song selection order changed to the singer's face is designated by recording in the column H in FIG.
Recording can be performed (ST29).

Further, the karaoke video with the song selection order changed to the singer's face saved in step ST25 is designated by pausing and printing in column H of FIG. Stop at the location of the video,
Images can be printed in the same way as photographs (ST3).
0).

On the other hand, FIG. 19 is a flow chart showing an example of the operation and operation of the video software of the karaoke apparatus from when a singer selects a song to when one karaoke video ends, according to claims 4 and 5 of the present invention. It is shown by.

In FIG. 19, the karaoke video software is
Even in the same song, the karaoke video for each field, the karaoke performance song and its lyrics, the outline of the face image of the person in the karaoke video, face size, face orientation, etc., eyes, nose, mouth, ears,
Equipped with face image data such as eyebrows and hairstyles, and contrast image data such as shadows and other areas of the entire face above the neck, including the head hair. (S) is a video software that can be changed by designating the background picture etc.
T51). This karaoke video software is MO, C
Although recorded on recording media such as D and DVD, the input to the karaoke apparatus may be performed by communication means such as the Internet.

First, the music selection / broadcasting means 2 searches the karaoke video of the condition specified on the music selection screen of FIGS. 4 and 5 and stores the karaoke video software of the step ST51 which matches the condition with the video storage. Extract from means 5. Then, the extracted video software is copied and stored again in another area of the video storage means 5, and the stored video software is changed to a singer's face or a background picture is changed. Karaoke video software is not changed.

In FIG. 19, when the music selection data from the input means 1 is received, the music selection broadcasting means 2
Retrieves and extracts karaoke video software based on the music selection data (ST52). Then, the extracted video software is stored in the video storage unit 5. Next, in order to confirm whether or not to change the face image of the person in the stored video software, it is determined whether to photograph the singer (ST53). If an image is to be taken, it is checked whether the face to be changed by the video software is only the face (ST54). In the case of YES, only the face of the person in the video software is changed (ST5).
5). In the case of NO, changing the face of the person in the video software changes the entire head above the neck (ST6).
4). Then, the process proceeds to step ST56.

Next, in step ST56, the face image of the person in the karaoke video is changed to the face image of the photographed singer based on the designation of changing only the face or the entire head above the neck. Implement processing for changing (ST5)
6).

Then, it is confirmed whether or not a video background picture is designated (ST57). If YES, the original background picture that is provided as standard with the karaoke video software is deleted (ST58). Then, in place of the deleted background picture, the designated background picture is searched and called from another karaoke video software specially equipped with the background picture (ST59). Then, the designated background picture is changed (ST60). As a result, the face image and the background picture of the person in the karaoke video are changed, and the changed karaoke video is transmitted to the video display means 3 and displayed.
The change of the background picture may be overwritten without being deleted.

On the other hand, if the designation of the picture background picture is NO in step ST57, only the face image of the person in the karaoke picture is changed to the singer's face, the background picture is not changed, and the original karaoke picture is changed. It is broadcast as a background picture (ST65).

Further, when the singer is not photographed in the step ST53, the selected karaoke video is broadcast as it is, similarly to the conventional karaoke apparatus, without changing the face image or the background picture of the person in the karaoke video. Yes (ST
63).

Next, it is confirmed whether the karaoke video is finished. If not, the process returns to step ST53 and repeats until the process is completed. Then, when it is finished, the broadcasting of the selected karaoke video is finished (ST62).

On the other hand, FIG. 20 is a flow chart showing an example of the operation of the karaoke apparatus according to claim 6 of the present invention for operating an advertisement video.

In FIG. 20, first, it is checked whether the power of the karaoke apparatus is on (ST71). If NO, the karaoke apparatus is not used, and the process does not proceed to the next operation. In the case of YES, the karaoke apparatus judges that the karaoke apparatus is being used by the singer and proceeds to the next step. And
A karaoke song selection screen is displayed, and it is confirmed whether a song is being selected (ST7).
2). If YES, the video of the advertisement is not displayed because karaoke is used, so that the next operation is not advanced. In the case of NO, it is determined that no music is being selected, and the process proceeds to the next step. Then, it is confirmed whether the karaoke video is being broadcast (ST73). If YES, karaoke is being used, so the next operation is not performed. In the case of NO, it is determined that karaoke is not used, and a process of searching for and extracting an advertisement video prepared in the music selection and broadcasting means 2 in advance is performed (ST7).
4).

Next, the extracted advertisement video is broadcast on the video display means 3 (ST75), and at the same time, the sound of the advertisement video is also output on the audio output means 4 (ST7).
6). If at least one of the conditions in steps ST71 to ST73 is satisfied, the broadcasting of the advertisement video is stopped.

When the singer does not use the karaoke apparatus, the advertisement video is prepared in order of the vacant time, and the advertisement videos prepared in the music selection and broadcasting means 2 are sequentially arranged. It is broadcast automatically.

Therefore, according to the configuration of the above embodiment, the face image of the person in the video of the karaoke apparatus can be changed to the singer's face. It can make you feel like singing. In addition, a person who is not good at singing can create a karaoke video that enhances the effect of the video by selecting a video that suits the user, and can attract the attention of the people around him. Furthermore, by equipping a lot of videos in each field,
Since it is possible to change and edit the video a lot, it is possible to provide a karaoke video that can be enjoyed by children and families in the case of an animation video or the like. In addition, when the singer does not use the karaoke device, the advertisement video is broadcasted, so that the karaoke fee can be reduced.

On the other hand, you can create your own unique karaoke video that has never existed before, and by recording the video,
At home, you can reproduce the karaoke video changed to your face again, so you can study the effects of the next karaoke and reflect on it, and consider your own karaoke video to show you And you can enjoy the production mood.

In the above embodiment, claims 1 and 2
Although the description has been made separately, a configuration in which both are combined may be adopted. In addition, various karaoke video softwares are not input and stored in the video storage means 5 in advance,
Similar to the conventional karaoke apparatus, a method of extracting the corresponding karaoke video software from a laser disk, a CD, a DVD or the like at the time of music selection and inputting it to the video storage means 5 may be used.

In the above embodiment, the karaoke video was simply described. However, the present invention is not limited to a video captured by a video camera or the like, but may be a karaoke video or a karaoke video software for a two-dimensional video or a three-dimensional video by computer graphics. May be.

Further, by mounting the image display means of the present invention on a car using a large screen or the like, the karaoke apparatus can be moved. Therefore, the karaoke apparatus may be used for a karaoke tournament event outdoors or the like.

The karaoke apparatus of the present invention comprises input means, music selection and broadcasting means, video display means, audio output means, video storage means, photographing means, video synthesis means, recording means, and video analysis means. However, the present invention is not particularly limited to these components. In addition, the present invention can be variously modified and implemented without departing from the gist.

[0105]

As described above, according to the present invention, the following effects can be obtained. According to the invention of claim 1, since the face of the person in the karaoke video is changed to the face of the singer who is shooting and broadcasted, the singer himself appears on the television,
It makes you feel like you're singing like a real singer on the screen. In addition, since the singer can select a desired background picture, the singer can create his own karaoke video, which has the effect of producing a karaoke video to be shown to others. Furthermore, since the video of each field can be selected even if the same song is selected, the karaoke video of the same song has a different atmosphere, so that it is not necessary to withhold the need to select another song since the song was sung first.

Next, according to the second aspect of the present invention, since the singer can be photographed in advance and the photographed face can be corrected,
You can direct yourself better and cover your singing voice with video. Furthermore, since it is easy to use it for children's singers in animation videos and the like, there is an effect that karaoke by the family can be more enjoyed.

According to the third aspect of the present invention, the singer can record or record the desired karaoke video, so that the recorded recording can be reproduced at home, and the karaoke can be obtained by printing his or her own karaoke video. Can be so commemorated.

Further, according to the invention of claim 4, since karaoke video in various fields can be changed to a singer's face from a person's face image in karaoke video, karaoke video software for enjoying unprecedented video can be provided.

Next, in the invention of claim 5, since the background picture in the karaoke picture can be changed to a picture in various fields even if the same music piece is selected, the background picture of the singer's own karaoke picture is displayed. Can direct.

On the other hand, according to the invention of claim 6, since the advertisement is automatically broadcast when the karaoke is interrupted, there is an effect that the karaoke fee can be reduced for the advertisement fee.

[Brief description of the drawings]

FIG. 1 is a diagram showing a basic configuration of claim 1 to which the present invention is applied.

FIG. 2 is a diagram showing a basic configuration of claim 2 to which the present invention is applied.

FIG. 3 is an external view showing the image of the device of the present invention according to claim 1;

FIG. 4 is a diagram showing a display example of a music selection screen according to claim 1 of the apparatus of the present invention.

FIG. 5 is a diagram showing a display example of a music selection screen according to claim 2 of the apparatus of the present invention.

FIG. 6 is a diagram showing a display example of a child screen of a music selection screen of the device of the present invention.

FIG. 7 is a diagram showing a display example of a child screen of a music selection screen of the apparatus of the present invention.

FIG. 8 is a diagram showing a display example of a child screen of a music selection screen of the apparatus of the present invention.

FIG. 9 is a diagram showing a display example of a child screen of a music selection screen of the apparatus of the present invention.

FIG. 10 is a diagram showing a display example of a karaoke image of the apparatus of the present invention.

FIG. 11 is a diagram showing a display example of a karaoke video of the apparatus of the present invention.

FIG. 12 is a diagram showing a display example of a karaoke video of the device of the present invention.

FIG. 13 is a diagram showing a display example of a karaoke video of the apparatus of the present invention.

FIG. 14 is a flowchart for explaining the operation of the device of the present invention corresponding to claim 1;

FIG. 15 is a flowchart for explaining the operation of the device of the present invention corresponding to claims 1 and 3;

FIG. 16 is a flowchart for explaining the operation of the device of the present invention according to claim 2;

FIG. 17 is a flowchart for explaining the operation of the device of the present invention according to claim 2;

FIG. 18 is a flowchart for explaining the operation of the device according to the second and third aspects of the present invention.

FIG. 19 is a flowchart for explaining the operation of the device of the present invention corresponding to claims 4 and 5;

FIG. 20 is a flowchart for explaining the operation of the device of the present invention according to claim 6;

FIG. 21 is a diagram showing an example of the configuration of a conventional karaoke apparatus. 1 ... input means, 2 ... music selection broadcasting means, 3 ... video display means,
4 audio output means, 5 video storage means, 6 photography means,
7 ... Video combining means, 8 ... Recording means, 9 ... Video analyzing means.

Claims (6)

[Claims] In a karaoke apparatus, input means for inputting music selection data and audio, music selection and broadcasting means for selecting, processing and displaying an optimum karaoke video from the input music selection data, Image storage means to record, shooting means to digitally shoot the singer's face continuously at the same time as the start of karaoke, and digitally analyze the face image of a person in the image of the image storage means to collect face image data, Synchronizing the face image of the person in the karaoke video with the karaoke video, changing to the singer's face shot by the shooting means, and synthesizing the video, and video display means for displaying the video of the video synthesis means, A karaoke apparatus comprising: a singer's singing voice input by the input means; and voice output means for outputting a karaoke performance selected by the music selection broadcasting means. 2. The karaoke apparatus according to claim 1, wherein
Instead of shooting means that shoots the singer's face continuously at the same time as the start of karaoke, instead of shooting means that digitally shoots the singer's face in advance before starting karaoke, and digitally analyzes the image of this shot singer's face It is provided with video analysis means for collecting image data of various facial expressions and face orientations, and converts a face image of a person in a karaoke video selected at the time of music selection into a face image of the photographed singer in advance. A karaoke apparatus characterized in that the singer's face image is changed and edited, and the singer's face image is broadcasted at the start of the karaoke. 3. The karaoke apparatus according to claim 1, wherein a recording means is connected to and added to said music selection / broadcasting means, and a video displayed on said video display means is recorded.
A karaoke apparatus characterized by being capable of recording a karaoke performance song and a singer's singing voice output by the voice output means, or printing a karaoke video. 4. In a karaoke video software employing the karaoke apparatus according to claim 1 or 2, a face of a person in the karaoke video can be changed to a face of a singer or the like.
It is equipped with image data such as face outline, face size, face orientation, etc., eyes, nose, mouth, ears, eyebrows, hairstyle, etc., and the entire face area including shading and shading. Karaoke video software for karaoke equipment. 5. A karaoke video software employing the karaoke apparatus according to claim 1 or 2, wherein only a person and lyrics in the video are left for the selected karaoke video, and a seasonal feeling is specified by designating a background picture or the like of the video. Karaoke video software for a karaoke device, which can be changed or processed into desired scenery or objects. 6. The karaoke apparatus according to claim 1, wherein a video such as an advertisement is automatically broadcast while a singer is present and a karaoke video is not being broadcast.