JP2006014148A - Network camera and network system - Google Patents

Abstract

An object of the present invention is to provide a network camera, a program, and a network system that can be easily performed when it is desired to output audio simultaneously.
When accessed from a computer device, portal screen display information is transmitted, images captured by a host camera and other voice-compatible network cameras are displayed in a list on the computer device, and voice communication is performed with the computer device. Display of a network camera 1 capable of displaying a voice broadcast transmission button for associating network information with each image in portal screen display information and performing voice transmission simultaneously from a computer device based on the network information An information generating unit 19c is provided.
[Selection] Figure 1

Description

  The present invention relates to a network system that performs image and sound communication using a network camera capable of performing sound communication and a computer device that operates the camera.

  Recently, a network system that captures an image with a network camera and transmits image information of the network camera to a computer device via a network such as the Internet has become widespread. However, in this network system, image information can be obtained by operating a computer device, but not even surrounding audio information. Therefore, a network camera (hereinafter referred to as an audio-compatible network camera) has been developed that is equipped with a speaker and a microphone and can perform audio communication in addition to images.

  FIG. 6 is an explanatory diagram of a conventional network system for performing voice communication. In this network system, with respect to image transmission, an image captured by the camera 10 of the audio network camera 1 is compressed by the image processing unit 12, and the compressed image data is protocol-processed by the communication control unit 13. Are sent to the network 3 and sent to one or a plurality of computer devices 2. The computer device 2 decompresses the received image data and displays it on the screen. In FIG. 7, a plurality of audio-compatible network cameras 1 are connected to the network 3, and each computer apparatus 2 switches the audio-compatible network camera 1 and obtains image information captured by each camera 10.

  Further, regarding voice communication, voice input from the microphone 17 is subjected to AD conversion and compression processing by the voice transmission processing unit 15, and voice transmission data is sent to the computer apparatus 2 via the communication control unit 13 and the network 3. . The computer apparatus 2 processes the received voice transmission data and outputs the voice from the speaker 28. Similarly, audio input from the microphone 27 of the computer apparatus 2 is processed by the computer apparatus 2 and transmitted as audio reception data, and is transmitted to the audio-compatible network camera 1 via the network 3. In the voice-compatible network camera 1, the received voice reception data is transferred to the voice reception processing unit 14 via the communication control unit 13, where it is decompressed and DA-converted and output to the speaker 18.

  In this network system, when a user of the voice-compatible network camera 1 sends a voice and listens to the collected sound, the voice is input from the microphone 27 of the computer apparatus 2 and the voice data is transmitted. Audio is output from one speaker 18. At the same time, the sound is collected by the microphone 17, transmitted to the computer device 2, and output from the speaker 28. The control unit 19 controls the entire system of the voice-compatible network camera 1. The audio processing in the computer device 2 is processed by a JAVA (registered trademark) applet program downloaded from the audio network camera 1 or the like.

  By the way, a network system that simultaneously displays images of a plurality of video / audio communication terminals when acquiring image information from the plurality of video / audio communication terminals is disclosed (for example, see Patent Document 1). The network system of Patent Document 1 is a video conference room system or the like, in which a plurality of video / audio communication terminals each equipped with a video camera, a microphone, and a speaker are connected to a network. On the screen displayed on the display of the video / audio communication terminal, a list of multi-point video display windows of the video camera is displayed as shown in FIG. The video of the designated point is displayed in each area of the multi-point video display window, and “Speak” and “Listen” buttons are displayed respectively. FIG. 7 is an explanatory diagram of a conventional image list display for voice communication.

  In the network system of the plurality of audio-compatible network cameras 1 shown in FIG. 6 described above, a technique for displaying a list of images and sounds as in Patent Document 1 has not been proposed. List display is performed by such processing (see, for example, Patent Document 2).

  That is, when a predetermined network camera is accessed from a computer device to view a list of images of each network camera, the network camera acquires the images captured by the host camera and the cameras of the other network cameras, for example, HTML. <Img src = http: // 1.1.1.1:8001/ image / image.jpg>, <img src = http: // 1.1.1.2:8002/ image / image.jpg>, etc. The displayed screen display information is transmitted. In order to acquire image data from each URL (Uniform Resource Locator) of the network camera in accordance with the above description, the communication means such as a browser of the computer device makes an image transmission request to the network camera. In response to this request, each network camera transmits an image “image.jpg”, and each image is displayed in a list on the displayed screen.

Therefore, in order to display a list of network camera images, an IP address such as “1.1.1.1”, a port number such as “8001”, or a DNS (Dynamic name system) function can be used as a URL. In the past, the host name and port number must be entered. Conventionally, the user sends a screen setting request for displaying a list from the computer device to the predetermined network camera, and the received setting screen The user inputs the IP address, port number, and host name of each network camera and sends it. Upon receiving this, the network camera sends a registration request to each network camera using the input IP address and port number of each network camera. When there is a response, the network camera registers in the network camera registration table to be displayed in a list. is doing. A hyperlink is described in each network camera image displayed in a list, and the image can be received by directly accessing the network camera of the link destination.
Japanese Patent Laid-Open No. 9-247637 JP 2002-208730 A

  As described above, in a network system of a conventional network camera with only image transmission, it is possible to display a list of images and access a linked network camera. When this technology is to be applied to the voice communication of the voice-compatible network camera 1 of FIG. 6, it is considered that video is displayed in each area of the multipoint video display window and buttons are respectively displayed as shown in FIG. It is done.

  However, if there is a button for voice communication in each of the displayed images, if it is desired to output audio from the all-audio compatible network camera 1 at the same time, the audio must be transmitted by pressing the button for each image. It is very troublesome and time consuming. For example, when using a voice-enabled network camera as a surveillance camera in the area, “Mr. A, please return to the office” to a person who is not in the camera but is somewhere in the area. For example, when “students should enter the classroom”.

  In view of the above-described conventional problems, an object of the present invention is to provide a network camera, a program, and a network system that can be easily performed when it is desired to simultaneously output audio.

In order to solve the above-described conventional problems, the present invention is directed to a host camera capable of transmitting voice information and communicating with another host camera connected to the network when the communication means transmits portal screen display information when accessed from a terminal via a network. A network camera capable of displaying a list of images captured by a network camera capable of voice communication as a portal screen on a terminal based on portal screen display information, and performing voice communication with the terminal, including a host camera and other network cameras A network information storage unit for storing the network information of the image, and an audio broadcast for associating the image list display with the network information, and simultaneously transmitting audio from the terminal to the host camera and other network cameras based on the network information Information display for screen display that displays a send button on the portal screen And main features provided and means.

  According to the network camera, the program, and the network system of the present invention, when a voice broadcast transmission button is displayed on portal screen display information for displaying a list of images and it is desired to output the voice at the same time, it can be easily performed with one touch.

  In order to solve the above-described problem, according to a first aspect of the present invention, when accessed from a terminal via a network, the communication means transmits portal screen display information, and another audio connected to the host camera and the network. A network camera capable of displaying a list of images taken by a communicable network camera on the terminal using portal screen display information and enabling voice communication with the terminal. The network information of the host camera and other network cameras is displayed. Portal for a network information storage unit to store, a voice broadcast transmission button for associating a list of images with network information, and performing simultaneous voice transmission from the terminal to the host camera and other network cameras based on the network information Screen display information generating means for displaying on the screen display information is provided. The network broadcast camera displays a voice broadcast send button in the portal screen display information that displays a list of images, and the network broadcast information and the broadcast broadcast send button of the host camera and other network cameras are related. When you want to output audio at the same time, you can easily do it with one touch.

  A second invention of the present invention is an invention subordinate to the first invention, a transmission file storage unit for storing a program for operating on a terminal, and a file transfer unit for transmitting terminal side communication processing means to the terminal Since the terminal side communication processing means is downloaded to the terminal, it can be easily operated without using a special terminal.

  According to a third aspect of the present invention, when a voice broadcast transmission button displayed by portal screen display information is pressed by a graphical user interface, the computer displays images displayed in a list by the portal screen display information. Functions as network information extraction means for extracting associated network information, and terminal side communication processing means for transmitting a voice reception mode setting request to a network camera that has captured a list of images displayed based on the network information When the voice broadcast button is pressed, all the network information associated with the image is extracted, the voice reception mode setting request is sent, and it is very easy for the network camera that picked up the image. Audio can be output simultaneously.

  A fourth invention of the present invention is an invention subordinate to the third invention, wherein the terminal side communication processing means generates and transmits a voice reception mode setting request when the network camera is not in voice communication with another terminal. In the case of voice communication, the program does not generate a voice reception mode setting request, and the voice is transmitted all at once to the network cameras other than the voice communication, so that the call during voice communication is not hindered.

A fifth invention of the present invention is an invention dependent on the fourth invention, wherein the terminal side communication processing means periodically inquires of the network camera about the voice communication mode, and the voice is based on the voice communication mode. This is a program that makes a judgment during communication, and since the voice communication mode is periodically inquired, it is possible to immediately judge the transmission destinations to which voices are transmitted all at once.

  According to a sixth aspect of the present invention, a terminal capable of voice communication transmits a portal screen display information when accessed from a terminal via a network, and is connected to a host camera capable of voice communication and another network connected to the network. A network system including a network camera capable of displaying a list of images captured by a network camera capable of voice communication on a terminal using portal screen display information and capable of performing voice communication with the terminal. In addition, the network system displays an audio broadcast button for sending audio from the terminal to the network cameras that list the images at the same time. Displays the broadcast button, and the network information of the network camera and the audio broadcast button are related. Because they attached, easily performed in the one-touch when you want to output the audio at the same time.

  The seventh invention of the present invention is an invention subordinate to the sixth invention, and is a network system that generates a packet for voice transmission all at once based on network information associated with an image, and picks up the image Since the packet is transmitted to the network camera based on the network information, the packet can be transmitted very easily.

  The eighth invention of the present invention is an invention dependent on the sixth or seventh invention, wherein voice is transmitted simultaneously to network cameras in communication modes other than during voice communication, and voice is transmitted to network cameras during voice communication. This is a network system that does not, and since voices are transmitted all at once to other than the network camera that is performing voice communication, it does not hinder calls during voice communication.

  A ninth invention of the present invention is an invention subordinate to the sixth or seventh invention, wherein the voices are transmitted to the network cameras all at once, and whether each of the network cameras is in voice communication is determined individually. Decide whether or not to output audio, and if audio output is not possible, send notification that the network camera cannot output audio to the terminal, and send audio data to the audio-compatible network camera notified by the terminal This is a network system that cancels the transmission of voice and can easily perform voice broadcast processing.

Example 1
Hereinafter, the network camera, the program, and the network system according to the first embodiment of the present invention will be described. FIG. 1 is a configuration diagram of a network system in Embodiment 1 of the present invention, FIG. 2 is a configuration diagram of a network camera in Embodiment 1 of the present invention, and FIG. 3A is a block configuration of a computer apparatus in Embodiment 1 of the present invention. FIG. 3B is a block diagram of another program downloaded to the computer apparatus of FIG. 3A, and FIG. 4 is an explanatory diagram of the portal screen of the computer apparatus in the first embodiment of the present invention.

  1 and 2, reference numerals 1A, 1B, 1C, and 1D (hereinafter collectively referred to as 1) denote an audio-compatible network camera equipped with an audio communication device capable of capturing and transmitting an image and performing audio communication (the network camera of the present invention). 2E, 2F (hereinafter collectively referred to as 2) is a computer device such as a personal computer (terminal of the present invention) capable of voice communication, and 3 is a network such as the Internet or Ethernet (registered trademark).

In FIG. 2, 10 is a camera of the audio-compatible network camera 1, 11 is a codec unit for compressing and decompressing data to be transmitted and received, and 12 is an image for compressing an image signal captured by the camera 11 into JPEG format, MPEG format, or the like. A processing unit 13 is a communication control unit that protocol-processes and transmits image data compressed by the image processing unit 12 and audio data described later. This protocol processing refers to processing such as the IEEE 802.03 protocol such as TCP / IP protocol or Ethernet (registered trademark).

  Reference numeral 14 denotes a voice reception processing unit that decodes voice reception data (PCM digital signal) received by the voice-compatible network camera 1, and reference numeral 14a denotes a digital signal output from the voice reception processing unit 14, which is converted to a digital signal by analog conversion. DA conversion unit 15 for converting to a voice transmission processing unit 15 for encoding the voice input to the voice-compatible network camera 1, and 15 a because the output from the voice output adjustment circuit 17 a (described later) is an analog signal. An AD conversion unit that performs AD conversion, 16 is a camera control unit for controlling pan, tilt, and zoom of the camera 10, 17 is a microphone for inputting audio around the audio-compatible network camera 1, and 17 a is audio input adjustment. A circuit, 18 is a speaker for outputting sound, and 18a is a sound output adjusting circuit.

  Reference numeral 19 denotes a control unit of the voice-compatible network camera 1. The control unit 19 includes a central processing unit (hereinafter referred to as “CPU”), and each control function is executed by software as a function realization means by a program loaded from the storage unit 20 described later. 19a is a communication execution means (communication means of the present invention) for performing voice communication and image transmission, 19b is a program such as an active x, JAVA (registered trademark) applet stored in the transmission file storage section 20b, for example, terminal side communication described later This is a file transfer means for downloading the processing means 26. The screen display information is described in a markup language such as HTML and a Java (registered trademark) applet. Not only HTML but also other markup languages such as XML and XML may be used.

  Reference numeral 19c denotes screen display information generating means for generating screen display information such as a portal screen (see FIG. 5) for displaying a list of images. Reference numeral 19d denotes a voice-compatible network camera registered in a network information storage unit 20d described later. This is network information extraction means for extracting one network information. The network information extracting means 19d extracts the network information of each voice-corresponding network camera 1 registered from the network information storage section 20d, and the screen display information generating means 19c displays the information on the displayed positions of the displayed images. Have a hyperlink written.

  Next, 20 is a storage unit storing a program for controlling the system, 20a is a screen display information storage unit storing a portal screen display information template and other screen display information, and 20b is a computer device 2. The transmission file storage unit stores programs such as active x, JAVA (registered trademark) applets (hereinafter referred to as terminal side communication processing means) that are transmitted to and executed by the CPU of the computer apparatus 2. 20c is an image storage unit for storing the image data compressed by the image processing unit 12, and 20d is a network information storage unit for storing a display camera table in which network information for displaying a list of images is displayed in the portal screen display information. is there. Note that the screen display information described in the above-described HTML or the like is stored in the screen display information storage unit 20a, and the image data displayed at this time is stored in the image storage unit 20c of each image server.

Next, the configuration of the computer apparatus 2 will be described with reference to FIG. In FIG. 3 (a), 21 is a communication control unit that is an interface with the network 3, 22 is provided with a CPU as hardware, reads a program from the storage unit 23, and is realized as a function realizing unit, Reference numeral 23 denotes a storage unit for storing programs and data, reference numeral 23a denotes a voice storage unit for storing voice data, and reference numeral 23b stores URLs of voice-compatible network cameras 1A, 1B, 1C, and 1D described in portal screen display information. A network information storage unit. Also, 24 is a browser means for acquiring and browsing screen display information (web page) from a website on the network 3, and 25 is for voice communication mounted with a JAVA (registered trademark) applet, plug-in or the like. This is a voice processing means realized as a function realizing means by the program.

  Similarly, reference numeral 26 denotes terminal side communication processing means realized by a program such as active x, JAVA (registered trademark) applet downloaded by the file transfer means of the voice-compatible network camera 1. Here, referring to FIG. 3B, 26a is a flag indicating the voice communication mode of the voice-compatible network cameras 1A, 1B, 1C, and 1D, and 26b is a voice-compatible network camera 1A when portal screen display information is received. , 1B, 1C, 1D is network information extraction means for extracting network information and storing it in the network information storage unit 23b. In FIG. 3A again, 27 is a microphone, 27a is an audio input adjustment circuit, 28 is a speaker, 28a is an audio output adjustment circuit, and 29 is a display unit.

  When the portal screen display information is received, the network information extraction unit 26b extracts the network information, IP address, port number, or host name of the voice-compatible network cameras 1A, 1B, 1C, and 1D, and stores the network information storage unit. 23b. When a voice broadcast transmission button 55 (described later) is pressed, the terminal-side communication processing means 26 generates and transmits an IP packet using the IP address and port number as the transmission destination. When the network information extraction unit 26b extracts the host name, it inquires of the DNS server (not shown) about the IP address and port number and stores them in the network information storage unit 23b. Further, the terminal-side communication processing means 26 periodically inquires each voice communication mode (voice reception mode, voice transmission mode) to the voice-compatible network cameras 1A, 1B, 1C, 1D and confirms whether there is a mode change. Then, the flag 26a is updated.

  In the first embodiment, the network information extracting unit 26b extracts the network information of the voice-compatible network cameras 1A, 1B, 1C, and 1D from the portal screen display information. Network information requesting means for requesting is provided, and the network information is acquired from the network information storage unit 20d of the voice-compatible network camera 1 by the terminal side communication processing unit 26 and the communication execution unit 19a, and stored in the network information storage unit 23b. You can also.

  The browser means 24 is composed of a general-purpose browser program, and the terminal-side communication processing means 26 extends the functions of the browser means 24 and the voice processing means 25 for the communication of the image and voice of the voice-compatible network camera 1. Note that voice communication is half-duplex communication because transmission processing and reception processing by the voice processing means 25 are alternately performed. Note that a dedicated program can be installed as the terminal-side communication processing means 26.

  In the computer apparatus 2, when voice is input from the microphone 27, the voice of the analog signal is encoded by the voice processing unit 25 to be voice transmission data (PCM digital signal), and the communication control unit 21 is set by the terminal side communication processing unit 26. To the network camera 1 corresponding to the voice. Conversely, when voice reception data (PCM digital signal) is received from the voice-compatible network camera 1, the voice processing means 25 decodes it and outputs it from the speaker 28 after DA conversion to an analog signal. When portal screen display information is received from the voice-compatible network camera 1, the browser means 24 displays an image on the portal screen display information list display template, and the terminal-side communication processing means 26 displays buttons and the like. Then, processing is performed based on the input by the graphical user interface, and the IP packet is transmitted to the voice-compatible network camera 1.

Therefore, the operation of the voice display type network camera 1 and the computer apparatus 2 according to the first embodiment during image transmission for list display and voice communication will be described. The browser means 24 of the computer apparatus 2 accesses the communication execution means 19a of the voice-compatible network camera 1, and requests portal screen display information. FIG. 4 shows this portal screen, 51 is an image area such as a still image or a moving image of two or more designated voice-compatible network cameras 1, and 52 is a control bar for controlling the camera 10 of the voice-compatible network camera 1. is there. Reference numeral 53 denotes a voice transmission button for transmitting voice to each voice-compatible network camera 1, and reference numeral 54 denotes a voice reception button for receiving voice from each voice-compatible network camera 1. Reference numeral 55 denotes a voice broadcast transmission button for simultaneously outputting voices to all displayed voice-compatible network cameras 1, and 56 denotes a volume adjustment for adjusting the volume output from the speaker 18 of the voice-compatible network camera 1. It is a bar. The voice transmission button 53, the voice reception button 54, and the voice broadcast transmission button 55 are described by active x, JAVA (registered trademark) applet, etc. in the received screen display information.

  Therefore, first, the list display of images will be described with reference to FIG. 4. For the four images of the audio-compatible network camera 1 in the image area 51 of the portal screen, the audio-compatible network camera 1A in FIG. IP address “192.168.0.151”, port number “8001”, host name “camera001”, IP address “192.168.0.152”, port number “8002”, host name “camera002”, voice for network camera 1B supporting voice IP address “192.168.0.153”, port number “8003”, host name “camera003” for compatible network camera 1C, IP address “192.168.0.154”, port number “8004” for voice compatible network camera 1D The host name “camera004” is supported.

  The network information is stored in the network information storage unit 20d together with the MAC address. However, when creating the portal screen, the network information extracting unit 19d of the voice-compatible network camera 1A refers to the display camera table to display an image. The network information that needs to be displayed is taken out and described in the portal screen display information by the screen display information generating means 19c using these. Thus, when the computer apparatus 2 receives the portal screen display information, the image data can be received from the image storage unit 20c of each voice-compatible network camera 1 and a list display can be performed.

For example, for the audio-compatible network camera 1A, the screen display information generating unit 19c uses the IP address and port number to convert the portal screen display information to <img src = http://192.168.0.152:8001/image/image. You can request an image "image.jpg" by writing jpg> etc., and if a DNS server (not shown) is available, use the host name to specify <img src =
You can request an image at http://xxx.net/camera001/image/image.jpg>. Similarly, <img
src = http: // 192.168.0.152:8002 / image / image.jpg> or <img src = http: // xxx.net/camera002 / image / image.jpg> and <img src = http: // 192.168 0.153: 8003 / image / image.jpg> or <img src = http: // xxx.net/camera003 / image / image.jpg>, <img src = http: // 192.168.0.154:8004 / image / image .jpg> or <img src = http: // xxx.net/camera004 / image / image.jpg>, and the audio network camera 1A, 1B is displayed in the image area 51 at the predetermined position of the portal screen display information. , 1C, 1D images can be displayed. Furthermore, by using the /***/image.jpg portion as a CGI command or the like, it is possible to perform more advanced image display by performing various processes in each of the audio-compatible network cameras 1A, 1B, 1C, and 1D. Become.

On the other hand, when the voice is individually transmitted from the computer device 2E to the voice compatible network camera 1A of FIG. 1, the following operation is performed. At this time, it is assumed that the terminal-side communication processing means 26 refers to the flag 26a, and neither the audio-compatible network camera 1A is in the audio communication mode. In the first embodiment, the voice-compatible network camera 1 is in a voice reception mode in a voice communication mode (voice reception mode, voice transmission mode) because voice reception processing and voice transmission processing are processed in different systems. Judgment is made. When the voice transmission button 53 associated with each image is pressed, the voice processing means 25 converts the voice input from the microphone 27 of the computer apparatus 2E (IP address is set to “192.168.0.155:8005”, for example) into data. And stored in the voice storage unit 23a of the storage unit 23. When the terminal-side communication processing means 26 refers to the flag 26a and knows that the voice-compatible network camera 1A is not in the voice reception mode, the destination IP address “192.168.0.151:801” and the source IP address “192.168.0.155: The voiced data stored in the voice storage unit 23a is stored in the data area of the IP packet "8005" and transmitted to the voice-compatible network camera 1A. Upon receiving this, the voice-compatible network camera 1A sets the voice reception mode, thereby receiving voice data from the computer device 2E, converting the received voice data into an analog signal, and outputting from the speaker 18.

  However, since the flag 26a is periodically updated, when the audio data is transmitted to the audio-compatible network camera 1A, the audio-compatible network camera 1A may be receiving audio from another computer device 2. For this reason, the control unit 19 of the network camera 1A corresponding to the voice performs exclusive control that gives priority to the data transmission first, outputs the voice of the computer apparatus 2 during voice communication as it is, and the computer apparatus 2E that has transmitted later. Control is performed so that no sound is output. At the same time, a notification to the effect that voice output cannot be performed is sent to the computer apparatus 2E, and the terminal side communication processing means 26 stops the transmission of the voice data in the computer apparatus 2E.

  Further, this process may be further thoroughly performed so that the voice data is transmitted to the voice-compatible network camera 1A immediately after the voice transmission button 53 is pressed, and exclusive control is performed on the voice-compatible network camera 1A side. At this time, if audio is not output because it was transmitted later, a notification that the audio cannot be output from the audio-compatible network camera 1A is transmitted to the computer device 2E, and the computer device 2E transmits audio data based on this notification. It will be canceled.

  Next, when sending a voice broadcast from the computer apparatus 2E, it is as follows. At this time, the terminal-side communication processing means 26 refers to the flag 26a, and it is assumed that the voice-compatible network cameras 1A, 1B, 1C, and 1D in FIG. 1 are not in the voice communication mode of any of the computer devices 2E and 2F. When the voice broadcast transmission button 55 of the computer device 2E is pressed, the voice processing means 25 converts the voice from the microphone 27E into data and stores it in the voice storage unit 23a of the storage unit 23. Up to this point, it is the same as the voice transmission described above, but the terminal side communication processing means 26 refers to the flag 26a, and if it knows that the voice compatible network cameras 1A, 1B, 1C, 1D are not in the voice reception mode, the voice storage is performed. IP packet containing the data voice stored in the unit 23a, that is, the IP packet of the destination IP address “192.168.0.151:8001”, the source IP address “192.168.0.155:8005”, the destination IP address "192.168.0.152:8002", source IP address "192.168.0.155:8005" IP packet, destination IP address "192.168.0.153:8003", source IP address "192.168.0.155:8005" IP packet, IP packets having a transmission destination IP address “192.168.0.154:8004” and a transmission source IP address “192.168.0.155:8005” are respectively generated and transmitted to the voice-compatible network cameras 1A, 1B, 1C, and 1D. Each is transmitted as a voice reception mode setting request. When the voice-compatible network cameras 1A, 1B, 1C, and 1D receive this, they are set to the voice reception mode, thereby receiving voice data from the computer device 2E and outputting from the speaker 18.

Next, a description will be given of a case where the audio-compatible network cameras 1A, 1B, 1C, and 1D shown in FIG. 1 are in the audio reception mode with either of the computer devices 2E and 2F. Here, for example, it is assumed that the speaker 18A of the audio-compatible network camera 1A outputs the sound from the microphone 27F of the computer device 2F. At this time, when the voice broadcast transmission button 55 of the computer device 2E is pressed, the voice processing means 25 converts the voice from the microphone 27E into data and stores it in the voice storage unit 23a of the storage unit 23. The terminal side communication processing means 26 has a flag 26a.
, When it is found that the voice-compatible network camera 1A is in the voice communication mode, the transmission destination IP address “192.168 .0.152: 8002” containing the voiced data stored in the voice storage unit 23a is transmitted. IP packet with source IP address “192.168.0.155:8005”, destination IP address “192.168.0.153:8003”, IP packet with source IP address “192.168.0.155:8005”, destination IP address “192.168.0.154: 8004 "and source IP address" 192.168.0.155:8005 "are respectively generated and transmitted to the voice-compatible network cameras 1B, 1C, and 1D. When the voice-compatible network cameras 1B, 1C, and 1D receive this, they set the voice reception mode, thereby receiving voice data from the computer apparatus 2E and outputting it from the speaker 18.

  Even when this voice broadcast transmission is performed, the voice data is transmitted to the voice-compatible network cameras 1A, 1B, 1C, and 1D as soon as the voice broadcast transmission button 55 is pressed as described above. It is also possible to perform exclusive control individually by determining whether or not the voice communication type network cameras 1A, 1B, 1C, and 1D are performing voice communication. If the voice-capable network camera 1A cannot transmit voice because it was transmitted later during voice communication, the voice-capable network camera 1A sends a notification to the computer apparatus 2E that voice cannot be output. Based on this, it is preferable that the computer apparatus 2E stop the transmission of audio data to the audio network camera 1A.

  Next, a series of operation procedures in the case of the first embodiment when performing audio communication by displaying a list of images of each audio-compatible network camera 1 from the computer apparatus 2 will be described. FIG. 6 is a flowchart when voice communication is performed from the image list display according to the first embodiment of the present invention. In FIG. 6, when portal screen display information is requested from a predetermined voice-compatible network camera 1A (step 1), portal screen display information is transmitted from the voice-compatible network camera 1A, and a portal screen that is a list display of images is displayed. It is displayed (step 2).

  Wait until the button is pressed (step 3). When the voice transmission button 53 is pressed (step 4), the voice-compatible network camera 1 with the voice transmission button 53 pressed is in a voice communication mode with another computer device 2. Is checked (step 5), and when not in the voice communication mode with another computer apparatus 2, the voice is transmitted (step 6). If in step 4 the voice communication mode with another computer apparatus 2, a non-transmission display indicating that “sound is being received” or “sound is being transmitted” is performed (step 7), and the process is terminated.

  If the button pressed in step 4 is not the voice transmission button 53, it is determined whether the voice broadcast transmission button 55 has been pressed (step 8). If not, the process returns to step 3. In the case of the voice broadcast transmission button 55 at step 8, the voice communication mode is checked for all voice-compatible network cameras 1, and it is determined whether there is a voice-compatible network camera 1 that is performing voice communication (step 9). . If all of the voice-compatible network cameras 1 are not in the voice communication mode, the voice reception mode is transferred to the voice reception mode as it is (step 10). If there is a voice compatible network camera 1 in the voice communication mode with another computer apparatus 2 in step 9, the voice compatible network camera 1 in the voice communication mode is “receiving voice” or “sending voice”. Is sent to the remaining voice-compatible network camera 1 that is not in the voice communication mode (step 11), and the process ends.

As described above, when the voice transmission button 53 is pressed at step 4, step 5 is not checked and voice data is immediately transmitted to the voice-compatible network camera 1, and whether voice communication is being performed on the voice-compatible network camera 1 side. It may be determined whether or not exclusive control is performed individually. Even when voice broadcast transmission is performed at step 8, as described above, when the voice broadcast transmission button 55 is pressed, step 9 is not checked, and voice data is immediately sent to the voice-compatible network cameras 1A, 1B, 1C, and 1D. There is also a method in which exclusive control is individually performed by determining whether or not voice communication is being performed by each of the voice-compatible network cameras 1A, 1B, 1C, and 1D. At this time, when voice output cannot be performed due to voice communication, a notification that voice output is not possible is transmitted to the computer apparatus 2E, and the computer apparatus 2E transmits voice data to the voice-compatible network camera 1A based on this notification. Cancel transmission of.

  As described above, when the computer device 2 according to the first embodiment presses the voice broadcast transmission button 55, the terminal-side communication processing unit 26 refers to the flag 26a, so that the voice-compatible network camera 1 is in the voice reception mode. A voice reception mode setting request containing voice data is notified to the voice-compatible network camera 1 not in the voice reception mode, and voice is output from all voice-compatible network cameras 1 not in the voice reception mode. Can do. When there is a voice-compatible network camera 1 in the voice reception mode, a non-transmission display is performed and the user is notified, so that only the voice-compatible network camera 1 can transmit voice again. When the voice broadcast transmission button 55 is pressed, the voice data is immediately transmitted to the voice-compatible network camera 1, and whether the voice-compatible network camera 1 is performing voice communication or not is controlled individually. It can also be done. Also in this case, for the voice-compatible network camera 1 that has been notified that the voice output cannot be performed due to the exclusive control, a voice is transmitted again only to the voice-compatible network camera 1 by performing a non-transmission display. be able to.

  The present invention provides a network system including a network camera capable of displaying a list of images and outputting sound, and a terminal capable of image communication and sound communication via the network, and for operating the network camera. Applicable to the program.

1 is a configuration diagram of a network system according to a first embodiment of the present invention. 1 is a configuration diagram of a network camera in Embodiment 1 of the present invention. (A) The block block diagram of the computer apparatus in Example 1 of this invention, (b) The block block diagram which downloaded another program to the computer apparatus of (a) Explanatory drawing of the portal screen of the computer apparatus in Example 1 of this invention Flowchart for voice communication from image list display in Embodiment 1 of the present invention Illustration of a conventional network system for voice communication Explanatory drawing of image list display for conventional voice communication

Explanation of symbols

1, 1A, 1B, 1C, 1D Audio network camera 2, 2E, 2F Computer device 3 Network 10 Camera 11 Codec unit 12 Image processing unit 13, 21 Communication control unit 14 Audio reception processing unit 14a DA conversion unit 15 Audio transmission Processing unit 15a AD conversion unit 16 Camera control unit 17, 27 Microphone 17a, 27a Audio input adjustment circuit 18, 28 Speaker 18a, 28a Audio output adjustment circuit 19 Control unit 19a Communication execution unit 19b File transfer unit 19c Screen display information generation unit 19d, 26b Network information extraction means 20, 23 Storage unit 20a Screen display information storage unit 20b Transmission file storage unit 20c Image storage unit 20d, 23b Network information storage unit 22 Control operation unit 23a Audio storage unit 24 Browser means 25 Audio Management means 26 terminal side communication processing unit 26a flag 29 display unit 51 the image area 52 the control bar 53 voice transmission button 54 audio receiving button 55 voice multicast transmission button 56 volume adjusting bar

Claims (9)

When accessed from a terminal via a network, the communication means transmits portal screen display information, and the portal captures images captured by a host camera capable of voice communication and another voice communication network camera connected to the network. A network camera capable of displaying a list as a portal screen on the terminal by screen display information and performing voice communication with the terminal, the network information storing the network information of the host camera and the other network camera An audio broadcast button for associating the storage unit with the list display of the image and the network information, and simultaneously transmitting audio from the terminal to the host camera and the other network camera according to the network information; Screen display information displayed on the portal screen Network camera, characterized in that the generating means are provided. 2. The network camera according to claim 1, further comprising: a transmission file storage unit that stores a program for operating the terminal; and a file transfer unit that transmits the terminal-side communication processing unit to the terminal. A network that retrieves network information associated with images listed by the portal screen display information when the voice broadcast transmission button displayed by the portal screen display information is pressed by the graphical user interface. A program for functioning as an information extraction unit and a terminal-side communication processing unit that transmits a voice reception mode setting request to a network camera that has captured the list-displayed image based on the network information. The terminal-side communication processing means generates and transmits the voice reception mode setting request when the network camera is not in voice communication with another terminal, and does not generate the voice reception mode setting request when voice communication is in progress. The program according to claim 3. 5. The program according to claim 4, wherein the terminal-side communication processing means periodically inquires of the network camera about a voice communication mode, and determines whether voice communication is being performed based on the voice communication mode. When it is accessed from a terminal capable of voice communication via the network, the portal screen display information is transmitted and imaged by a host camera capable of voice communication and another voice communication network camera connected to the network. The network system includes a network camera that can display a list of the images on the terminal according to the portal screen display information and perform voice communication with the terminal, and the images are displayed on the portal screen as a list. A network system for displaying a voice broadcast button for performing voice transmission from the terminal simultaneously to a network camera that is connected. 7. The network system according to claim 6, wherein a packet for voice transmission all at once is generated based on network information associated with the image. The network system according to claim 6 or 7, wherein voice is simultaneously transmitted to network cameras in communication modes other than during voice communication, and voice is not transmitted to network cameras during voice communication. Sends audio to the network camera all at once, determines whether each network camera is in voice communication, determines whether to output audio individually, and if audio output is not possible, The network system according to claim 6 or 7, wherein a notification indicating that the terminal cannot be transmitted is transmitted to the terminal, and transmission of voice data to the voice-compatible network camera notified by the terminal is stopped.

Images