JP2013200370A - Karaoke system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a karaoke system which is capable of suitably adjusting imaging in an imaging apparatus.SOLUTION: The karaoke system includes: a digital camera 82 which is provided in a fixed position of a karaoke device 16 and is capable of adjusting imaging in accordance with a command; and imaging adjustment means 104 which outputs a command to the digital camera 82 to adjust imaging in the digital camera 82. Since the imaging adjustment means 104 controls timing of adjustment of imaging in accordance with progress of music relating to karaoke performance of the karaoke device 16, it is possible to suitably adjust imaging in the digital camera 82 while considering coordination with karaoke performance of the karaoke device 16.

Description

  The present invention relates to a karaoke apparatus used in a karaoke box or the like, and more particularly, to an improvement for improving the convenience.

  2. Description of the Related Art A karaoke apparatus is known that outputs a performance song selected from a large number of performance songs and displays a lyric text image of the performance song on a video display device. According to such a karaoke device, the music information of the karaoke performance song selected (selected) by the remote control device or the like from a large number of karaoke performance songs stored in the storage device in advance is output, and the lyrics information of the karaoke performance song is output. By displaying the included video on the screen in synchronization with the output, it is possible to enjoy the karaoke performance of the desired song.

  As one aspect of the karaoke device, an image pickup device such as a CCD (Charge Coupled Device) camera is provided, and a moving image or a still image shot by the image pickup device is output as a background image or the like in a karaoke performance by the karaoke device. Are known. Further, as such an imaging device, a device that is fixed in position with respect to the karaoke device and that can perform imaging adjustment such as so-called pan / tilt or zoom change in accordance with a command from the karaoke device is preferable. Used for. As an imaging adjustment technique in such an imaging apparatus, an imaging apparatus control system described in Patent Document 1 has been proposed.

JP 2007-67963 A

  However, in the adjustment of imaging in the imaging device provided at a fixed position with respect to the karaoke device, there is a problem of balance with karaoke performance by the karaoke device. That is, for example, in a mode in which a moving image shot by the imaging device is used as a background image of a karaoke performance by the karaoke device, pan / tilt and zoom changes are continuously performed after the karaoke player starts singing. If this is the case, there may be a problem that the performer cannot concentrate on the performance or the atmosphere of the place is broken. Such a problem has been newly found in the process in which the present inventor continues eager research in order to improve the convenience of the karaoke apparatus provided with the imaging device.

  The present invention has been made against the background of the above circumstances, and an object of the present invention is to provide a karaoke apparatus capable of suitably adjusting imaging in an imaging apparatus.

  In order to achieve such an object, the gist of the present invention is to output a performance song selected from a large number of performance songs and display a lyric character image of the performance song on a video display device. An imaging device that is fixed in position relative to the karaoke device and that can adjust imaging in response to a command, and that the command is output to the imaging device, whereby the imaging device An imaging adjustment unit that adjusts the imaging, and the imaging adjustment unit controls the timing of adjusting the imaging according to the progress of the musical piece.

  If it does in this way, the image pick-up device provided in position fixing with respect to the karaoke device which can adjust image pick-up according to a command, and outputting the command to the image pick-up device, the image pick-up device Imaging adjustment means for adjusting the imaging of the karaoke performance by the karaoke apparatus, since the imaging adjustment means controls the timing of the imaging adjustment according to the progress of the performance song It is possible to suitably adjust the imaging in the imaging apparatus while considering the trade-off. That is, it is possible to provide a karaoke apparatus that can suitably adjust the imaging in the imaging apparatus.

  Here, preferably, the imaging adjustment means ends the adjustment of imaging in accordance with a timing at which singing in the performance music is to be started. In this way, it is possible to suitably suppress the occurrence of problems such that the performer cannot concentrate on the performance or the atmosphere of the place is broken.

  Preferably, the imaging adjustment means ends the imaging adjustment in accordance with a timing at which the output of the guide melody related to the performance tune is started. In this way, the adjustment of the imaging can be finished in accordance with the timing at which the singing in the performance song should be started, and the performer cannot concentrate on the performance or the atmosphere of the place is broken. The occurrence of such problems can be suitably suppressed.

  Preferably, the imaging adjustment means ends the imaging adjustment in accordance with a timing at which color change display control of the lyric text image related to the performance tune is started. In this way, the adjustment of the imaging can be finished in accordance with the timing at which the singing in the performance song should be started, and the performer cannot concentrate on the performance or the atmosphere of the place is broken. The occurrence of such problems can be suitably suppressed.

  Preferably, the imaging adjustment unit ends the adjustment of the imaging in accordance with a timing at which voice input from a predetermined voice input device is started with the output of the musical piece. In this way, the adjustment of the imaging can be finished in accordance with the timing at which the singing in the performance song should be started, and the performer cannot concentrate on the performance or the atmosphere of the place is broken. The occurrence of such problems can be suitably suppressed.

  Preferably, the number of users calculating means for calculating the number of users performing a karaoke performance using the karaoke apparatus, and imaging for determining the number of persons included in the imaging captured by the imaging apparatus. An inside number determination unit, and the imaging adjustment unit terminates the adjustment of the imaging when the number of people determined by the inside number of images determination unit coincides with the number of people calculated by the number of users calculation unit. To do. If it does in this way, all the users who are performing the karaoke performance using the said karaoke apparatus will adjust the imaging in the imaging device in a suitable and practical aspect so that it may be included in the imaging in the said imaging device. be able to.

  Preferably, the imaging adjustment unit adjusts imaging in the imaging apparatus by controlling an imaging direction of the imaging apparatus. In this way, it is possible to adjust the imaging in the imaging apparatus in a suitable and practical manner by so-called pan / tilt.

  Preferably, the imaging adjustment unit adjusts imaging in the imaging apparatus by controlling zoom of the imaging apparatus. If it does in this way, imaging in the above-mentioned imaging device can be adjusted in a suitable and practical mode by zooming in or zooming out.

It is a figure explaining the structure of the communication karaoke system to which the karaoke apparatus of this invention is applied suitably. It is a block diagram which illustrates the composition of the karaoke device which is one example of the present invention. It is a figure explaining the touchscreen display provided in the commander main body in the karaoke apparatus of FIG. It is a front view explaining in detail the structure of the digital camera with which the karaoke apparatus of FIG. 2 was equipped. It is a functional block diagram explaining the principal part of the control function with which CPU of the karaoke apparatus of FIG. 2 was equipped. FIG. 4 illustrates an example of an image captured by the digital camera in FIG. 4, and illustrates an example in which the imaging range is too close to the left side. FIG. 4 illustrates an example of an image captured by the digital camera in FIG. 4 and illustrates an example in which the zoom magnification is too large. FIG. 5 illustrates an example of an image captured by the digital camera in FIG. 4, and illustrates an example in which images of all users performing a karaoke performance are included in the image capture. It is a flowchart explaining the principal part of login / logout control by CPU of the karaoke apparatus of FIG. It is a flowchart explaining the principal part of the imaging adjustment control by CPU of the karaoke apparatus of FIG.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram illustrating a configuration of a communication karaoke system 10 to which the karaoke apparatus of the present invention is preferably applied. As shown in FIG. 1, in the communication karaoke system 10 of this embodiment, a plurality of private rooms 14a, 14b, 14c,... In a store 12 such as a karaoke box, a snack, an inn, etc. Is simply referred to as a private room 14), one or a plurality of each (1 in FIG. 1) karaoke devices 16a, 16b, 16c, which are one embodiment of the present invention (hereinafter not particularly distinguished). Is simply referred to as a karaoke device 16). The plurality of karaoke apparatuses 16 are connected to the communication line 18 via the router 28. Similarly, information is exchanged between the server apparatus 20 and the like connected to the communication line 18 via the communication line 18. Communication is possible.

  The online karaoke system 10 includes a plurality of electronic quick sample devices 22a, 22b, 22c,... (Hereinafter simply referred to as the electronic quick sample device 22 unless otherwise distinguished). When using 16, one or several electronic quick sample devices 22 are lent for each user (group), and as will be described later in each private room 14, an association process is performed with the karaoke device 16. By being performed, the karaoke device 16 is used as a remote control device. Further, as shown in FIG. 1, a LAN 24 for connecting the plurality of karaoke devices 16 to each other is laid in the store 12, and an input to the karaoke device 16 from the electronic quick sample device 22 is predetermined. The access point 26 and the LAN 24 are used for LAN communication.

  The communication line 18 is a wide area information communication network connected to the Internet such as a WWW (World Wide Web) constituted by, for example, a public telephone line, an ADSL line, or an optical fiber line. The server device 20 is a server operated by, for example, an information distribution service provider that manages the communication karaoke system 10, and karaoke information (music data), background video information, and music between the communication karaoke system 10. It functions as a center device that performs basic control of storage and input / output management of digital contents such as information. Moreover, the database which manages the database which matches and memorize | stores the information regarding the karaoke performance using the said karaoke apparatus 16 for each user who uses the said communication karaoke system 10 with the identification information (user ID) of the user. Functions as a server. That is, the server device 20 preferably correlates at least the identification information of the user and a password used for login authentication described later in correspondence with each user in the communication karaoke system 10. And remember. In the present embodiment, the configuration including the single server device 20 having both the function as the center device of the online karaoke system 10 and the function as the database server will be described. May be configured as an individual server device.

  As shown in FIG. 1, the communication karaoke system 10 according to the present embodiment can transmit and receive information to and from a plurality of systems or communication terminal devices via the communication line 18. That is, a personal computer 30 that is a communication terminal device is connected to the communication line 18, and a mobile phone 32 that is also a communication terminal device is connected to the communication line 18 via a relay base station 34. In addition, information can be transmitted and received between the mobile phone 32 and the karaoke device 16 or the server device 20. Further, a home karaoke device 36 which is a karaoke device having a different form from the karaoke device 16 is connected to the communication line 18, and the home karaoke device 36 and the karaoke device 16, the server device 20, etc. It is possible to send and receive information. That is, the communication karaoke system 10 of the present embodiment includes a second communication karaoke system including the server device 20 and the plurality of home karaoke devices 36. Preferably, the mobile phone 32 functions as a karaoke device having a different form from the karaoke device 16.

  FIG. 2 is a block diagram illustrating the configuration of the karaoke apparatus 16. As shown in FIG. 2, the karaoke device 16 includes a video display device 40 such as a TFT (Thin Film Transistor Liquid Crystal) or a PDP (Plasma Display Panel), and a video output control unit such as a video board (graphics board). 42, a video information decoder 44, a video mixer 46, a synthesizer 48 as a sound source, a microphone 50 as an audio input device, an amplifier mixer 52, a speaker 54, an operation panel 56, an operation panel 56, and the like. An input / output interface 58 for processing an input signal, a CPU 60 as a central processing unit, a ROM 62 as a read-only memory, a RAM 64 as a write / read memory as needed, a hard disk 66 as a storage device, a modem 68, From the LAN port 70 and input devices such as the electronic sample device 22 and the remote control device 76 A remote control receiving unit 72 for receiving the remote control signal, an A / D converter 74 for converting the sound input from the microphone 50 into a digital signal, and a digital camera 82 as an imaging device (see FIG. 4) And is configured.

  The video output control unit 42 functions as a character video output device that outputs a character video (telop) such as a lyric character video generated by the CPU 60, and displays various video displays by the video display device 40. It is a control device. The video information decoder 44 is a background video playback device that plays back (decodes) a predetermined background video based on background video information stored in the hard disk 66 when a user sings while referring to lyrics. . The background video information is, for example, MPEG (Moving Picture Experts Group) format data, and the background video reproduced by the video information decoder 44 based on the MPEG data is sent to the video mixer 46. The video mixer 46 combines the character video generated by the CPU 60 and output from the video output control unit 42 with the background video reproduced by the video information decoder 44 to the video display device 40. This is a video composition device to be displayed.

  The synthesizer 48 is a sound source that generates a music signal such as a musical instrument performance signal based on performance information of a karaoke performance song read from the hard disk 66 and sent. The performance information is, for example, data in MIDI (Musical Instrument Digital Interface) format, and the music signal generated by the synthesizer 48 based on the MIDI data is converted into an analog signal and sent to the amplifier mixer 52. The amplifier mixer 52 mixes the transmitted music signal and the singing voice of the user (player) input via the microphone 50, and those signals are electrically amplified and output from the speaker 54. The

  The operation panel 56 allows the user of the karaoke apparatus 16 to select a karaoke performance piece that the user wants to sing, adjust the pitch of the performance piece, adjust the volume balance between the performance and the song, and perform echo and volume. , An input device provided with operation buttons (switches) or knobs for performing various adjustments such as tone. Further, the karaoke apparatus 16 may include a touch panel display 78 in a commander main body 38 that stores the CPU 60, the synthesizer 48, and the like, for example, as shown in FIG. The touch panel display 78 displays an image (video) and inputs to the karaoke device 16 in response to a user's contact. Preferably, the front side flat portion (karaoke box) of the commander main body 38 is used. Etc., the surface on the user side). In such an embodiment, the touch panel display 78 functions as a second video display device separately from the video display device 40, and the user of the karaoke device 16 selects a karaoke performance song to be sung, It functions as an operation panel for adjusting the tone pitch, adjusting the volume balance between performance and song, and making various adjustments such as echo, volume, and tone. For example, the example shown in FIG. 3 shows a state in which a plurality of character buttons 80 each indicating an individual character (for example, a Japanese character or alphabet) are displayed on the touch panel display 78. When a touch operation is performed on a character button 80 (relative position corresponding to the character button 80 on the touch panel) displayed on the touch panel display 78 with a user's finger, a pen, or the like, the character or character indicated by the character button 80 is displayed. A string is entered. A karaoke performance song that the user of the karaoke apparatus 16 wants to sing, such as searching for a singer name or song name that matches the character or character string in the forward direction based on the character or character string input by such an operation. Search or music selection input is performed via the touch panel display 78.

  Further, the karaoke device 16 is provided with a remote control device 76 that functions as an input device for remotely executing a part of the function of the operation panel 56, and the remote control receiving unit 72 is connected to the remote control device 76. A remote control signal to be transmitted is received and supplied to the CPU 60. In addition, the association (sticking) processing between the karaoke device 16 and the electronic quick sample device 22 is also performed via the remote control receiving unit 72, and the electronic quick sample device associated with the karaoke device 16 in this way. 22 also functions as an input device. In the present embodiment, an input device such as the remote control device 76 provided in the karaoke device 16 or the electronic quick sample device 22 subjected to the association processing also constitutes a part of the karaoke device 16. The following will be described.

  The CPU 60 is a so-called microcomputer that processes and controls electronic information based on a predetermined program stored in advance in the ROM 62 using the temporary storage function of the RAM 64, and executes various controls related to the karaoke device 16. To do. That is, when a predetermined karaoke performance song is selected by the electronic quick sample device 22, the touch panel display 78, etc., the song selection reservation control for registering the selected karaoke performance song in the reserved song table provided in the RAM 64, Music data read control for reading performance information and lyrics information (music data) of the karaoke performance music selected from the hard disk 66 in the RAM 64 in accordance with the performance order of the reserved music table, as the performance of the karaoke performance music progresses. A performance output control for transmitting performance information from the RAM 64 to the synthesizer 48, and a lyric character image generated based on the lyric information developed in the RAM 64 and transmitted to the video output control unit 42 during the performance output control. The video information decoding is performed during output control and performance output control. Background video output control for playing back a predetermined background video by controlling 44, inter-song information output for outputting inter-song information such as new music information, music selection ranking, store advertisement, etc. while karaoke performance is not performed, that is, between songs In addition to control and basic control such as information communication control with the server device 20 and the like via the communication line 18, imaging adjustment control of this embodiment described later is executed.

  The modem 68 is a device for connecting the karaoke device 16 to the communication line 18, converts a digital signal output from the CPU 60 into an analog signal and sends the analog signal to the communication line 18. An analog signal transmitted via the digital signal is converted into a digital signal and supplied to the CPU 60. In addition, the aspect by which any karaoke apparatus 16 is equipped with the function of the said router 28 among the several karaoke apparatuses 16 with which the said store 12 was equipped, and is connected to the said communication line 18 as a master commander is also considered, In that case, The modem 68 is required for the karaoke device 16 that functions as the master commander, but is not necessarily provided for other karaoke devices 16 that communicate information with the server device 20 and the like via the master commander. It doesn't have to be done.

  The LAN port 70 is a connector for connecting the karaoke device 16 to another device such as the other karaoke device 16 or the electronic quick sample device 22 via the LAN 24, and the karaoke device 16 is connected as such. By being connected via the LAN 24, information can be transmitted / received to / from other devices such as the other karaoke apparatus 16 and the electronic quick sample apparatus 22. For example, the music selection input from the electronic quick sample device 22 received through the access point 26 is received and stored in a reserved music table provided in the RAM 64, or the karaoke device 16 through the access point 26. Thus, mutual exchange of information between the karaoke device 16 and the electronic quick sample device 22 is performed via radio waves, such as transmitting predetermined information to the electronic quick sample device 22. Communication between the electronic sample device 22 and the server device 20 via the communication line 18 is also performed via the karaoke device 16 provided with the LAN 24 or the router 28.

  The hard disk 66 is provided with various databases including a karaoke database for storing a large number of karaoke information (music data) for outputting karaoke performance music. Of a plurality of karaoke devices 16 provided in a store such as a karaoke box, a predetermined karaoke device 16 such as the karaoke device 16a is connected to the communication line 18 via the modem 68, and the plurality of karaoke devices. New karaoke information or the like is distributed from the server device 20 via the communication line 18 and stored in the karaoke database or the like of the hard disk 66 so that new songs can always be played by the server 16. In addition, communication is performed via the LAN 24 between the karaoke device 16 a that has acquired the information from the server device 20 and the other karaoke devices 16, and is stored in the hard disk 66 of each karaoke device 16. Information is shared, and the contents of the karaoke database and the like are equivalent.

  The karaoke database stores a large number (for example, tens of thousands of songs) of music data (karaoke data) corresponding to performance songs that can be output by the karaoke device 16. The music data includes performance information for generating a performance sound of a predetermined instrument by the synthesizer 48, lyrics information for generating a lyrics character image (lyric telop), and lyrics generated based on the lyrics information. It includes lyrics color change information for sequentially changing the color of the character image in accordance with the progress of the performance, and is identified by a music selection number unique to each performance song as the content ID. In addition, information such as the song name, artist name (singer name), date of publication, genre, and tone of the performance song is stored in association with the song data. Here, the performance information includes parts and drum parts corresponding to various musical instruments, but includes at least performance information corresponding to a guide melody corresponding to the main melody of a performance song (a series of pitches to be uttered in singing). It is out. The music data stored in the music database is preferably one in which a plurality of divisions are determined in advance in MIDI data as performance information. This category is, for example, a performance category defined in the meta information of the MIDI data. For each predetermined performance time, for example, an Intro, Amelo, B melody ( Bmelo), Cmelo, Fill, chorus, interlude, later performance, and variable beat are defined.

  FIG. 4 is a front view for explaining in detail the configuration of a digital camera 82 which is an example of an imaging device provided in the karaoke apparatus 16. The digital camera 82 is preferably a so-called digital video camera that can shoot a moving image, and is, for example, a stationary device that is fixed to the karaoke device 16 at a predetermined position in each individual room 14 or the like. . As shown in FIG. 4, the digital camera 82 has a pedestal 84 provided in a fixed position with respect to the karaoke apparatus 16 and a main body 88 including a lens 90 with respect to the pedestal 84 as a central axis (the main body is viewed from the vertical direction). When viewed, the lens 90 is driven in the vertical direction (vertical direction) with respect to the pan mechanism 86 that is driven to rotate around the central axis C (swing drive in the left-right direction) and the main body 88 (base 84). And a zoom mechanism for zooming in (ie, changing the focal length for enlarging the subject) and zooming out (changing the focal length for reducing the subject) of the digital camera 82. zoom) mechanism 94. That is, the digital camera 82 is a so-called pan / tilt / zoom camera capable of pan / tilt control and zoom control in accordance with a command (control signal) from the CPU 60 or the like. Video information corresponding to the image captured by the digital camera 82 is supplied to the CPU 60 and the like via an interface or the like.

  FIG. 5 is a functional block diagram illustrating a main part of the control function provided in the CPU 60 of the karaoke apparatus 16. The various control means shown in FIG. 5 are preferably all functionally provided in the CPU 60 of the karaoke apparatus 16, but some of these control functions are included in the electronic quick reference apparatus 22 and server. It may be functionally provided in a control unit in another device such as the device 20. For example, some or all of the login authentication control unit 102, the imaging adjustment unit 104, the number of users calculation unit 110, and the imaging analysis control unit 112 illustrated in FIG. 5 are included in the CPU of the electronic sample device 22 or the server device 20. The CPU may be functionally provided. Further, the imaging adjustment unit 104 may be functionally provided in a control unit built in the digital camera 82.

  The karaoke performance control means 100 shown in FIG. 5 controls the output of the performance music at the time of the karaoke performance by the karaoke apparatus 16. Specifically, the music data corresponding to the music selection number of the reserved music stored in the reserved music table in order from the upper reserved music in the reserved music table such as the RAM 64 is stored in the karaoke database of the hard disk 66. The output of the performance music is controlled based on the performance information included in the music data. That is, based on MIDI data as performance information, the synthesizer 48 outputs musical instrument performance sounds (music information) corresponding to tracks or channels as musical score information in the MIDI data, and the speaker via the amplifier mixer 52. 54 to output. Moreover, the output of the lyric character video concerning the performance music is controlled based on the lyric information included in the music data. That is, a lyric character image is generated based on the lyric information, and the lyric character image is displayed on the image display device 40 via the image output control unit 42. Further, as the karaoke performance progresses, the lyric character video is switched and displayed, and the lyric character video is sequentially color-changed and displayed based on the lyric color change information. Preferably, an image (video) taken by the digital camera 82 is displayed on the video display device 40 as a background video of the lyrics character video.

  The login authentication control means 102 authenticates the user in the communication karaoke system 10 in accordance with the identification information (user ID) input from the electronic quick sample device 22, the touch panel display 78, etc., and the authentication is normally performed. If this happens, the user is allowed to log in with the identification information. Specifically, when a user ID and password as identification information are input by the electronic quick sample device 22 or the like, a password stored in the server device 20 in association with the user ID is input. The server device 20 is inquired of whether or not they match, and if they match, normal authentication is performed, whereas if they do not match, an error is assumed. The login authentication control means 102 may transmit a user ID and password input by the electronic sample device 22 or the like to the server device 20, and the substantial authentication is performed on the server device 20 side. It does not matter if it is done in

  The imaging adjustment unit 104 adjusts imaging in the digital camera 82 by outputting a command (control signal) to the digital camera 82 that is an imaging apparatus. For example, a pan control command that determines the horizontal direction (left-right direction) of imaging controlled by the pan mechanism 86 in the digital camera 82, and a tilt control command that determines the vertical direction (vertical direction) of imaging controlled by the tilt mechanism 92. , And a zoom control command for determining an enlargement ratio and the like related to the zoom of the image pickup controlled by the zoom mechanism 94 is output to the digital camera 82. That is, the imaging adjustment unit 104 adjusts the imaging by controlling the imaging range (horizontal range and vertical range) and the focal length related to imaging in the digital camera 82. In order to perform such control, the imaging adjustment unit 104 includes a pan / tilt control unit 106 and a zoom control unit 108 as shown in FIG. Hereinafter, these control functions will be described.

  The pan / tilt control means 106 adjusts the imaging in the digital camera 82 by controlling the direction of the imaging range related to imaging in the digital camera 82. That is, the imaging in the digital camera 82 is adjusted by so-called pan / tilt. Specifically, by outputting to the pan mechanism 86 a pan control command that determines an angle (angular position) in the horizontal direction (left-right direction) of imaging in the digital camera 82, the pan mechanism 86 passes through the pan mechanism 86. The imaging range in the horizontal direction of the imaging (lens 90) in the digital camera 82 is controlled. Further, by outputting to the tilt mechanism 92 a tilt control command for determining an angle (angular position) in the vertical direction (vertical direction) of imaging in the digital camera 82, the digital camera 82 is passed through the tilt mechanism 92. The imaging range in the vertical direction of the imaging (lens 90) is controlled. In other words, the imaging range related to the biaxial direction (horizontal direction and vertical direction) of imaging in the digital camera 82 is controlled via the pan mechanism 86 and the tilt mechanism 92.

  The zoom control means 108 adjusts the imaging in the digital camera 82 by controlling the focal length of the digital camera 82. That is, the image pickup in the digital camera 82 is adjusted by so-called zoom. Specifically, the focal length of the digital camera 82 is continuously changed via the zoom mechanism 94, and the size of the captured image (video) is continuously changed. In other words, imaging zoom-in (zoom in) or zoom-out (zoom out) of the digital camera 82 is performed. Such control is preferably executed by changing the focal length without changing the focal plane position by driving a part of the lens 90. That is, the zoom mechanism 94 preferably performs zoom control related to imaging of the digital camera 82 by driving a partial configuration related to the lens 90.

  The user number calculating means 110 calculates the number of users who are performing karaoke performances using the karaoke apparatus 16. For example, when a karaoke performance using the karaoke device 16 is performed in the private room 14 of the store 12 such as a karaoke box, the number of users who are performing karaoke performances in the private room 14 together. calculate. The number-of-users calculation means 110 preferably uses the number of users who are normally authenticated by the login authentication control means 102 at the present time using the karaoke device 16 for various karaoke performances. It is calculated as the number of persons. In other words, the number of users who have logged in to the communication karaoke system 10 via the karaoke device 16 is calculated as the number of users who are performing karaoke performances using the karaoke device 16. Further, the user number calculating means 110 preferably has the karaoke device via the electronic quick sample device 22 or the like at the start of karaoke performance by the karaoke device 16 (for example, when entering the private room 14). 16 may be used to input (directly input) the number of users who perform karaoke performances, and calculate (acquire) the number of users input in this way.

  The imaging analysis control means 112 analyzes the imaging (video) taken by the digital camera 82, and includes an in-imaging number determination means 114. The imaging analysis control unit 112 preferably performs face recognition of a person during imaging that is captured by the digital camera 82 using a well-known face recognition technique. That is, from a predetermined relationship (for example, a relationship that defines a typical pattern of the arrangement of eyebrows, eyes, nose, mouth, and the like on a person's face), the brightness and color in imaging taken by the digital camera 82 are determined. Based on the degree, hue, and the like, a portion (partial video) corresponding to the face of the person during the imaging is recognized. The in-imaging number determination unit 114 determines the number of persons included in the image captured by the digital camera 82 based on the analysis result by the imaging analysis control unit 112. Preferably, the number of portions corresponding to the face of a person in the image captured by the digital camera 82 analyzed by the image capture analysis control means 112 is determined as the number of persons included in the image capture. For example, if it is analyzed that three parts corresponding to a person's face are included during imaging taken by the digital camera 82, it is determined that three persons are included in the imaging. To do.

  The performance song progress determination means 116 is for determining the progress of the performance music in the karaoke performance by the karaoke apparatus 16 and includes a singing start timing determination means 118. The performance progress determination means 116 preferably determines how far the performance (output) of the target performance music has progressed at the present time in the karaoke performance by the karaoke performance control means 100. Preferably, such a determination is made based on the elapsed time from the start of the karaoke performance by the karaoke performance control means 100. Further, preferably, the progress of the performance music is determined based on a performance category predetermined for each performance music. For example, the performance currently being performed by the karaoke performance control means 100 is any of the intro, A melody, B melody, C melody, phil, chorus, interlude, later performance, and variable beat of the target performance piece. It is determined whether it corresponds to the category.

  The singing start timing determining means 118 determines the timing at which singing in the performance tune to be performed is started in the karaoke performance by the karaoke performance control means 100. The timing at which this singing should start is the timing at which the singing part (vocal part) of the target performance song starts. For example, after the start of the output of the target performance song, the prelude ends and corresponds to the singing part. This is the point in time when the output of the guide melody is started. Or, for songs without a prelude, a cappella song, etc., the guide corresponding to the singing part is displayed after the countdown display until the beginning of the singing part is performed according to the setting after the output of the target performance song This is the time when melody output starts.

  The singing start timing determining means 118 preferably determines the timing at which the output of the guide melody related to the target performance song is started as the timing at which the song should be started. Specifically, after the karaoke performance control means 100 starts to output the target performance tune, the singing is started in the performance tune at the time when the first sound in the guide melody is output or immediately before the first beat. Judge as the timing to be.

  In addition, the singing start timing determination unit 118 preferably uses the timing at which the color change display control of the lyric text image related to the target performance song is started as the timing at which the song should be started. judge. Specifically, after the karaoke performance control means 100 starts outputting the target performance song, a lyric character image is generated based on the lyric information of the performance song, and the lyrics character image is transmitted via the image output control unit 42. After the video is displayed on the video display device 40, the time when the actual color change display of the lyric character video is started or one beat immediately before it is determined as the timing at which singing should be started in the performance song. To do. In addition, the singing start timing determination unit 118 preferably determines the timing at which the lyric text image related to the target performance tune is displayed, that is, the time when the lyric text video is displayed on the video display device 40. It may be determined as a timing at which singing should be started in a performance song.

  The singing start timing determining means 118 preferably sings the timing at which voice input from the microphone 50, which is a predetermined voice input device, is started in response to the output of the target performance tune. Is determined as the timing to be started. Specifically, when it is determined that the audio information input from the microphone 50 via the A / D converter 74 corresponds to a signal intensity equal to or higher than a predetermined value, the determination is performed. It is determined that the timing at which the singing should be started in the performance piece.

  The imaging adjustment unit 104 preferably includes a number comparison unit 109 that compares the number of people determined by the number-of-imaging number determination unit 114 and the number of people calculated by the user number calculation unit 110. Based on the comparison result by the number comparison means 109, the end of the imaging adjustment is determined. That is, the imaging adjustment unit 104 preferably ends the adjustment of the imaging when the number of persons determined by the in-imaging number determination unit 114 matches the number of persons calculated by the user number calculation unit 110. To do. In particular, in the karaoke performance control by the karaoke performance control means 100, such control is performed in a mode in which an image (video) photographed by the digital camera 82 is displayed on the video display device 40 as a background video of the lyrics character video. Do. That is, the number of persons included in the image captured by the digital camera 82 determined based on the analysis result by the imaging analysis control unit 112 is the number of persons calculated by the user number calculation unit 110, for example, at that time Then, when the number of users who have logged in to the communication karaoke system 10 via the karaoke device 16 coincides with the number of users, the adjustment of imaging in the digital camera 82 by the imaging adjustment unit 104 is ended.

  FIGS. 6 to 8 exemplify an image picked up by the digital camera 82, and the adjustment of the image pickup when there are three users performing a karaoke performance using the karaoke device 16 will be described. It is a figure to do. In the imaging 120 shown in FIG. 6, the image 126a corresponding to the face of a person is included, but the images 126b and 126c (refer to FIG. 8) corresponding to the faces of other people are not included. This is because an imaging range related to imaging by the digital camera 82 is shifted to the left side in the left-right direction, and in such imaging 120, the number of people determined by the in-imaging number determination means 114 (= 1) and the number of people calculated by the user number calculating means 110 (= 3 people) do not match. In this case, the pan / tilt control means 106 moves the imaging range related to the imaging by the digital camera 82 to the right side via the pan mechanism 86, so that the human face is shown in FIG. The imaging 124 includes all the corresponding videos 126a, 126b, and 126c. In the imaging 122 shown in FIG. 7, the video 126b corresponding to the face of a person is included, but the images 126a and 126c (see FIG. 8) corresponding to the faces of other people are not included. This is because the zoom enlargement ratio related to the image pickup by the digital camera 82 is too large (zoom in too much). In such an image pickup 122, the number of persons determined by the number-of-images determination means 114 (= 1) and the number of people calculated by the user number calculating means 110 (= 3 people) do not match. In this case, by zooming out the image picked up by the digital camera 82 via the zoom mechanism 94 by the zoom control means 108, images 126a, 126b, 126c corresponding to a human face are obtained as shown in FIG. All of the captured images 124 are included. As described above, even when the image of all the users performing the karaoke performance using the karaoke apparatus 16 is not included in the image picked up by the digital camera 82 at the beginning, the pan mechanism 86, the tilt By controlling the imaging range, zooming, and the like related to the imaging of the digital camera 82 via the mechanism 92 and the zoom mechanism 94, it is possible to adjust so that the images of all the users fit within the imaging. Note that, depending on the arrangement of the digital camera 82 and the number of users, it is not always possible to make adjustments so that the images of all the members fit within the imaging of the digital camera 82.

  The imaging adjustment unit 104 preferably ends the adjustment of the imaging in accordance with the timing at which singing should be started in the target performance piece. In particular, in the karaoke performance control by the karaoke performance control means 100, such control is performed in a mode in which an image (video) photographed by the digital camera 82 is displayed on the video display device 40 as a background video of the lyrics character video. Do. That is, even if the number of persons determined by the number-of-imaging number determination unit 114 does not match the number of persons calculated by the number-of-users calculation unit 110, the singing start timing determination unit 118 performs the singing in the performance song. If it is determined that the timing is to start, the adjustment of the imaging is terminated in response to the determination. Preferably, the adjustment of the imaging is finished at a timing when singing should be started in the performance music. In other words, the adjustment of the imaging is finished when the singing start timing determining unit 118 determines the timing at which the singing of the target performance piece is to be started. Preferably, the adjustment of the imaging may be ended a predetermined time (for example, 5 seconds) before the timing at which the singing of the target performance music is to be started.

  Further, the imaging adjustment unit 104 preferably restarts the adjustment of the imaging in a performance portion where singing is not performed in the target performance tune. For example, if it is determined by the performance song progress determination means 116 that the performance currently performed by the karaoke performance control means 100 is an interlude or the like of the target performance music, the imaging adjustment means 104 The imaging may be adjusted according to the above. In such a case, preferably, the adjustment of the imaging is finished in accordance with the timing when the performance corresponding to the interlude is finished and the singing part is started again. In other words, the imaging adjustment unit 104 preferably does not execute the adjustment of the imaging by the imaging adjustment unit 104 while the guide melody is being output in the target performance piece.

  FIG. 9 is a flowchart for explaining a main part of the login / logout control by the CPU 60 of the karaoke apparatus 16 and is repeatedly executed at a predetermined cycle. Note that the control shown in FIG. 9 may be executed by the CPU of the electronic quick sample apparatus 22 or the like.

  First, in step (hereinafter, step is omitted) SA1, it is determined whether or not login information, that is, identification information and a login password are input via the electronic quick sample device 22, the touch panel display 78, or the like. If the determination at SA1 is negative, the processing below SA7 is executed. If the determination at SA1 is affirmative, at SA2, the identification information and login password entered at SA1 are stored in the server. Transmitted to the device 20. Next, in SA3, it is determined whether or not a response indicating that the server apparatus 20 has successfully logged in is returned. When the determination of SA3 is negative, after SA6 displays the fact that there is an error on the electronic quick sample device 22, the touch panel display 78, etc., the processing after SA7 is executed. When SA is affirmed, after the login process is normally performed in SA4, in SA5, various information relating to the logged-in user is downloaded from the database or the like in the server device 20. Next, in SA7, it is determined whether or not there is an input for performing a logout process of a predetermined user by the electronic quick sample device 22, the touch panel display 78, or the like. If the determination at SA7 is negative, the routine is terminated. If the determination at SA7 is affirmative, after the logout process of the target user is performed at SA8, This routine is terminated.

  FIG. 10 is a flowchart for explaining a main part of an example of the imaging adjustment control by the CPU 60 of the karaoke apparatus 16 and is repeatedly executed at a predetermined cycle.

  First, in S0, the number of users who are logged in to the communication karaoke system 10 via the karaoke device 16 at that time (the number of users who have been successfully authenticated for login in SA4) is determined. . Next, in S1, whether or not the karaoke device 16 starts to output a predetermined performance song, for example, in the order of performance of the highest-order reserved song in the reserved song table stored in the RAM 64 or the like. To be judged. If the determination in S1 is negative, the routine is terminated accordingly. If the determination in S1 is affirmative, the karaoke data (music data) of the performance music to be output is started in S2. Is read from the karaoke database in the hard disk 66, and the output of the performance music is started based on the karaoke data. Next, in S <b> 3, adjustment of an imaging range (imaging direction) related to imaging by the digital camera 82 is performed via the pan mechanism 86 and tilt mechanism 92 in the digital camera 82. Next, in S4, zoom-in or zoom-out of the imaging by the digital camera 82, that is, adjustment of the focal length is performed via the zoom mechanism 94 in the digital camera 82. Next, in S5, an image captured by the digital camera 82 is analyzed, and an image corresponding to a human face is analyzed in the image capturing using, for example, a well-known face recognition technique. Next, in S6, the number of persons included in the image taken by the digital camera 82 is determined based on the analysis result in S5. Next, in S7, it is determined whether or not the number of people determined in S6 matches the number of users logged in to the communication karaoke system 10 determined in S0. If the determination in S7 is affirmative, the processing from S9 is executed. If the determination in S7 is negative, in S8, the vocal part, that is, the guide melody is played in the karaoke performance by the karaoke device 16. It is determined whether or not it is time to start the corresponding part. If the determination in S8 is negative, the processing from S3 onward is executed again. If the determination in S8 is positive, in S9, the pan mechanism 86, tilt mechanism 92, Then, the adjustment of the imaging by the digital camera 82 via the zoom mechanism 94 or the like is terminated, and after the karaoke performance output by the karaoke device 16 is continued in S10, this routine is terminated.

  In the above control, S1, S2, and S10 are operations of the karaoke performance control means 100, SA1 to SA6 are operations of the login authentication control means 102, and S3, S4, and S9 are operations of the imaging adjustment means 104. In addition, S3 is an operation of the pan / tilt control means 106, S4 is an operation of the zoom control means 108, S7 is an operation of the number comparison means 109, and S0 is an operation of the number of users calculation means 110. S5 and S6 correspond to the operation of the imaging analysis control unit 112, S6 corresponds to the operation of the in-imaging number determination unit 114, and S8 corresponds to the operation of the performance piece progress determination unit 116 and the singing start timing determination unit 118, respectively. .

  As described above, according to the present embodiment, the digital camera 82 as an imaging device that is provided in a fixed position with respect to the karaoke device 16 and that can perform imaging adjustment according to a command, and the digital camera 82 Imaging instruction means 104 (S3, S4, and S9) for adjusting the imaging in the digital camera 82 by outputting the command, and the imaging adjustment means 104 according to the progress of the performance tune. Since the timing for adjusting the imaging is controlled, it is possible to suitably adjust the imaging in the digital camera 82 in consideration of the balance with the karaoke performance by the karaoke apparatus 16. That is, it is possible to provide the karaoke apparatus 16 that can suitably adjust the imaging in the imaging apparatus.

  In addition, since the imaging adjustment unit 104 ends the adjustment of the imaging in accordance with the timing at which singing in the performance music is to be started, the player cannot concentrate on the performance, Generation | occurrence | production of malfunctions, such as a broken atmosphere, can be suppressed suitably.

  Further, since the imaging adjustment means 104 ends the adjustment of the imaging in accordance with the timing when the output of the guide melody related to the performance tune is started, the timing at which the singing in the performance tune should be started. At the same time, the adjustment of the imaging can be ended, and it is possible to suitably suppress the occurrence of problems such that the performer cannot concentrate on the performance or the atmosphere of the place is broken.

  In addition, since the imaging adjustment unit 104 ends the adjustment of the imaging in accordance with the timing when the color change display control of the lyrics character video relating to the performance song is started, the singing in the performance song starts. The adjustment of the imaging can be completed in accordance with the timing to be performed, and it is possible to suitably suppress the occurrence of problems such as the inability of the performer to concentrate on the performance or the atmosphere of the place being broken.

  In addition, the imaging adjustment unit 104 ends the adjustment of the imaging in accordance with the timing at which voice input from the microphone 50, which is a predetermined voice input device, is started with the output of the performance music. It is possible to finish the adjustment of the imaging in accordance with the timing at which singing in the performance music is to be started, and it is preferable that the player cannot concentrate on the performance or the atmosphere of the place is broken. Can be suppressed.

  Further, the number of users calculating means 110 (S0) for calculating the number of users performing karaoke performance using the karaoke device 16 and the number of persons included in the image captured by the digital camera 82 are determined. And the number of people determined by the number-of-imaging number determination unit 114 matches the number of people calculated by the number-of-users calculation unit 110. At this point, the adjustment of the imaging is completed, so that all users who are performing a karaoke performance using the karaoke device 16 are included in the imaging of the digital camera 82. Can be adjusted in a suitable and practical manner.

  In addition, since the imaging adjustment unit 104 adjusts the imaging in the digital camera 82 by controlling the imaging direction of the digital camera 82, the imaging adjustment unit 104 preferably performs imaging in the digital camera 82 by so-called pan / tilt. Adjustments can be made in a practical manner.

  In addition, since the imaging adjustment unit 104 adjusts the imaging of the digital camera 82 by controlling the zoom of the digital camera 82, the imaging of the digital camera 82 is suitably and practically performed by zooming in or out. Can be adjusted in a specific manner.

  The preferred embodiments of the present invention have been described in detail with reference to the drawings. However, the present invention is not limited to these embodiments, and may be implemented in other modes.

  For example, in the above-described embodiment, the imaging adjustment unit 104 performs pan / tilt control and zoom control of imaging by the digital camera 82 via the pan mechanism 86, tilt mechanism 92, and zoom mechanism 94 in the digital camera 82. However, the present invention is not limited to this, for example, regarding an imaging apparatus in which one of the normal shooting mode and the panoramic shooting mode is selectively established. The imaging adjustment unit 104 may adjust imaging by switching shooting modes in the imaging apparatus. In addition, regarding an imaging apparatus having a configuration capable of switching between a normal lens and a fisheye lens, the imaging adjustment unit 104 adjusts imaging by the imaging apparatus by performing control to switch between a normal lens and a fisheye lens in the imaging apparatus. It may be what performs.

  In the above-described embodiment, the imaging adjustment unit 104 determines that all the users who are performing karaoke performances using the karaoke apparatus 16 are within the imaging by the digital camera 82, so Although the adjustment was completed, this is only a preferred embodiment of the present invention, and all users who perform karaoke performance using the karaoke apparatus 16 are always within the image pickup by the digital camera 82. This need not be the condition for the end of adjustment. For example, based on the analysis result by the imaging analysis control means 112, the imaging range centered on the image corresponding to the face of each person in the image captured by the digital camera 82 (the image corresponding to the face of each person is substantially at the center. Adjustments such as storing each angle) may be performed. Further, as the karaoke performance control means 100 advances the karaoke performance, the imaging range of the digital camera 82 may be switched so that each stored imaging range is taken. For example, the imaging of the digital camera 82 is controlled such that different imaging ranges are obtained for A melody, B melody, rust, and the like of the target performance piece. In this way, in particular, in the karaoke performance control by the karaoke performance control means 100, an image (video) taken by the digital camera 82 is displayed on the video display device 40 as a background video of the lyrics character video. In the aspect, the video centering on each user's face is sequentially displayed as the background video as the karaoke performance progresses, and it is produced as if it were shot with a plurality of imaging devices, so that the atmosphere of the place is suitably It can be excited. Also in such an aspect, the timing for adjusting the imaging is controlled according to the progress of the performance music, for example, the adjustment of the imaging is terminated in accordance with the timing at which the singing in the target performance music is to be started. Thus, problems such as deterioration of the atmosphere of the place can be suppressed, and the present invention has a temporary effect.

  In addition, although not illustrated one by one, the present invention is implemented with various modifications within a range not departing from the gist thereof.

  16: Karaoke device, 50: Microphone (speech input device), 82: Digital camera (imaging device), 104: Imaging adjustment means, 110: Number of users calculation means, 114: In-imaging number determination means

Claims (8)

A karaoke device that outputs a performance song selected from a large number of performance songs and displays a lyric text image of the performance song on a video display device,
An image pickup apparatus provided at a fixed position with respect to the karaoke apparatus and capable of adjusting image pickup in accordance with a command;
Imaging adjustment means for adjusting imaging in the imaging device by outputting the command to the imaging device, and
The karaoke apparatus characterized in that the imaging adjustment means controls the timing of adjusting the imaging according to the progress of the performance music.   2. The karaoke apparatus according to claim 1, wherein the imaging adjustment unit is configured to end the imaging adjustment in accordance with a timing at which singing in the performance music is to be started.   3. The karaoke apparatus according to claim 2, wherein the imaging adjustment unit ends the adjustment of the imaging in accordance with a timing at which an output of a guide melody related to the performance tune is started.   3. The karaoke apparatus according to claim 2, wherein the imaging adjustment unit is configured to end the imaging adjustment in accordance with a timing at which color change display control of the lyrics character video relating to the performance tune is started.   3. The karaoke apparatus according to claim 2, wherein the imaging adjustment unit ends the adjustment of the imaging in accordance with a timing at which voice input from a predetermined voice input device is started in accordance with output of the performance music. User number calculating means for calculating the number of users performing karaoke performance using the karaoke device;
An in-imaging number determination means for determining the number of persons included in the image captured by the imaging device,
6. The imaging adjustment unit terminates the imaging adjustment when the number of persons determined by the in-imaging number determination unit coincides with the number of persons calculated by the user number calculation unit. The karaoke apparatus according to any one of the above.   The karaoke apparatus according to any one of claims 1 to 6, wherein the imaging adjustment unit adjusts imaging in the imaging apparatus by controlling an imaging direction of the imaging apparatus.   The karaoke apparatus according to any one of claims 1 to 6, wherein the imaging adjustment unit adjusts imaging in the imaging apparatus by controlling zoom of the imaging apparatus.

Images