JP2015176220A - Bulletin board apparatus and bulletin board system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To perform search more surely when an elderly person loiters around and the like.SOLUTION: A bulletin board device 1 including a screen 2 and a camera 11 and a server device 3 connected to it are provided. The server device includes; a photographic image processing unit 3e for recognizing a face from an image photographed by a camera; a person to be searched registration information unit 3d for registering registration information including a face image of a specific person who becomes a search object; an image storage unit 3b for storing the image to be displayed on the bulletin board device; and a face recognition engine for collating the photographed face image with the face image in the registration information, and calculating a recognition rate. When there is a possibility that the detected person is the specific person by the recognition rate, by displaying an image corresponding to likes and tastes from the registration information, the specific person can be detained in front of the bulletin board device, and his/her family members and the like can go to pick him/her up during that time.

Description

  The present invention relates to a bulletin board apparatus and a bulletin board system for detecting a specific person such as an infant who is likely to get lost or an elderly person who may be hesitant.

  Conventionally, as a system for searching for lost children, elderly people, etc., for example, a GPS (Global Positioning System) device or a wireless communication device such as a mobile phone equipped with GPS is carried in advance by a specific person who has a risk of getting lost or trapped, There is one that detects the position of a wireless communication device (searched person) via a wireless base station or the like when a search is required. However, since the distance between the radio base stations is long, not only the position accuracy is low, but also there is a problem that a radio communication device having a GPS function is expensive.

  Therefore, since the power consumption is small compared to the GPS device, an inexpensive wireless communication device such as Bluetooth (registered trademark) can be carried by a child or an elderly person and communicated with a mobile phone of the family or a gas meter with a communication device. Some have made it possible to determine that they are in a lost or trapped state when it is detected that they are out of the radio wave reachable range (see, for example, Patent Document 1).

  Although the above-mentioned Patent Document 1 enables a carrier of a wireless communication device to determine whether it is within or outside the jurisdiction (for example, whereabouts) of a family (guardian), he / she has moved far without being aware of it. In such a case, there is a problem that the position cannot be specified.

  On the other hand, there is one in which a transmitter is carried to narrow a specific range of positions (for example, Patent Document 2). However, if the searcher does not know the face of the searcher and there are multiple searchers, it takes time to identify the searcher, and in the meantime, the searcher gets mixed into the crowd. There is a risk of it.

JP 2002-271835 A JP 2000-76559 A

  As described in the above Patent Documents 1 and 2, by carrying any communication device, it is possible to track the carrier to some extent, but as described above, the user goes away from the place of residence to a crowded place such as the city. If this happens, there is a problem that detection is difficult.

  The present invention has been devised to solve such problems of the prior art, and the main purpose of the present invention is to make the search even more reliable when a child is lost or an elderly person is deceived. It is an object of the present invention to provide a bulletin board apparatus and a bulletin board system that can be used in the future.

  The bulletin board apparatus according to the present invention includes an image display unit that displays electronic data as an image, a person detection unit that detects a person, a transmission / reception unit that transmits and receives to / from a server device, and a detection result of the detected person to the server device. And the server device collates recognition information for recognizing a specific person registered in the server device and the detection result, and the detected person is determined to be the specific person, And a control unit that causes the image display unit to display an image for the specific person transmitted from the server device.

  According to the present invention, for example, a camera or a human sensor is provided as a person detection unit on a bulletin board installed outdoors or in a public facility, and a person passing through the front of the bulletin board is detected by face authentication in the case of an image. In some cases, if detected by a portable IC tag or the like, it is checked against the registered number of the person's face image or IC tag, which is recognition information registered in the server device, and the detected person is a specific person. If it has been done, for example, a family photo or the like is displayed on the image display section of the bulletin board as an image for the specific person based on the registered information. As a result, if the detected person is a registered specific person, the person can be kept in front of the bulletin board, and the position of the bulletin board can be easily grasped beforehand by a map or the like. A searcher who is looking for an elderly person can quickly find a search target (specific person) by going to the place where the bulletin board is installed.

Schematic explanatory diagram showing an application example of the present invention Configuration diagram based on the present invention The flowchart which shows an example of the control point of this invention FIG. 3 is a main part flow diagram showing a modification of the flow of FIG. (A) is an image display state diagram showing the interest of a specific person, (b) is a state diagram showing a voice call, and (c) is a state diagram showing a conversation. The figure which shows the example of a display of the screen of a terminal device The figure corresponding to FIG. 2 which shows 2nd Embodiment

  A first invention made to solve the above problems is an image display unit that displays electronic data as an image, a person image acquisition unit that acquires a person image, a transmission / reception unit that transmits and receives a server device, and the acquired The person image is transmitted to the server device, and the server device compares the person detected from the person image with recognition information for recognizing a specific person registered in the server device. And a control unit that causes the image display unit to display an image for the specific person transmitted from the server device when the person is determined to be the specific person.

  According to this, for example, a camera is provided on a bulletin board installed outdoors or in a public facility, and a photographed image obtained by photographing a person passing in front of the bulletin board is transmitted to the server device. Person image acquisition means for acquiring a person can be provided. When the face image of the person is registered as the recognition information of the specific person in the server device, the face is verified by face authentication, and when the detected person is determined to be the specific person, the image display unit of the bulletin board For example, a family photo or the like is displayed as an image for a specific person based on the registered information. As a result, if the detected person is a registered specific person, the person can be kept in front of the bulletin board, and the position of the bulletin board can be easily grasped beforehand by a map or the like. A searcher who is looking for an elderly person can quickly find a search target (specific person) by going to the place where the bulletin board is installed.

  According to a second aspect of the present invention, there is provided an image display unit that displays electronic data as an image, a person detection unit that detects a person, a transmission / reception unit that transmits / receives data to / from a server device, and a detection result of the detected person as the server device. And the server device collates recognition information for recognizing a specific person registered in the server device and the detection result, and the detected person is determined to be the specific person, And a control unit that causes the image display unit to display an image for the specific person transmitted from the server device.

  According to this, for example, a camera or a human sensor is provided as a person detection means on a bulletin board installed outdoors or in a public facility, and a person passing in front of the bulletin board is detected by face authentication in the case of an image. If it is detected by a portable IC tag or the like, it is checked against the registration number of the person's face image or IC tag, which is recognition information registered in the server device, and whether or not the detected person is a specific person Can be identified. By performing the person detection process on the bulletin board apparatus side in this way, the subsequent verification process and the like can be performed quickly.

  The third invention is an image display unit that displays electronic data as an image, a person detection unit that detects a person, a registration information storage unit that stores registration information including at least recognition information for recognizing a specific person, A collation unit that collates a detection result of the person detection unit with the recognition information; a transmission / reception unit that transmits / receives data to / from a server device; and when the detected person is determined to be the specific person by the collation unit, A control unit that transmits a result of the collation to the server device, and causes the image display unit to display an image for the specific person transmitted from the server device.

  According to this, for example, a camera or a human sensor is provided as a person detection means on a bulletin board installed outdoors or in a public facility, and a person passing in front of the bulletin board is detected by face authentication in the case of an image. Is detected by the registered information storage means provided on the bulletin board, and it is detected by checking the registered identification information such as the face image of the person and the registration number of the IC tag, etc. When it is determined that the person is a specific person, for example, a family photo or the like is displayed on the image display unit of the bulletin board as an image for the specific person based on the registered information. Thus, by performing the person detection process and the collation process on the bulletin board apparatus side, the process can be distributed among the server apparatuses, and the collation process in the bulletin board apparatus can be quickly performed.

  According to a fourth aspect of the present invention, there is provided registration information including at least an image display unit for displaying electronic data as an image, person detection means for detecting a person, recognition information for recognizing a specific person, and an image for the specific person. Registered information storage means for storing the information, verification means for verifying the detection result of the person detection means and the recognition information, and when the detected person is determined to be the specific person by the verification means, A control unit that displays an image for a specific person on the image display unit.

  According to this, for example, a camera or a human sensor is provided as a person detection means on a bulletin board installed outdoors or in a public facility, and a person passing in front of the bulletin board is detected by face authentication in the case of an image. Is detected by the registered information storage means provided on the bulletin board, and it is detected by checking the registered identification information such as the face image of the person and the registration number of the IC tag, etc. When it is determined that the person is a specific person, for example, a family photo or the like is displayed on the image display unit of the bulletin board as an image for the specific person based on the registered information. Thereby, when the detected person is a registered specific person, the person can be kept in front of the bulletin board, and the position of the bulletin board can be easily grasped in advance by a map or the like. A searcher searching for an old man can quickly find the search target (specific person) by heading to the place where the bulletin board is installed. Furthermore, since there is no need to transmit / receive data to / from the server device, verification can be performed without being affected by a line failure or the like.

  According to a fifth aspect of the invention, in the invention according to any one of the first to fourth aspects, the image display unit includes a recognition rate indicating the possibility that the detected person is the specific person by the collation. When it is determined that is less than a predetermined threshold, normal bulletin information is displayed.

  According to this, since notices from local governments and neighborhood associations are displayed as normal bulletin information until the possibility that the detected person is a specific person becomes high, a normal bulletin board for people other than the specific person Can function as.

  In a sixth aspect based on any one of the first to fifth aspects, the image display unit has a recognition rate indicating the possibility that the detected person is the specific person by the collation. The first image is displayed when it is determined to be equal to or higher than the first threshold, and the second image is displayed when the recognition rate is equal to or higher than a second threshold lower than the first threshold and lower than the first threshold. Is displayed.

  According to this, when there is a high possibility that the detected person is a specific person, the first image to be displayed on the image display unit is related to a specific individual such as a family photo, for example. If there is a possibility, but the recognition rate does not reach a high level, the second image will be displayed when an interest is shown by preparing an image relating to the person's hobbies and preferences that the specific person is interested in. Can keep the detected person in front of the bulletin board. Furthermore, when it is determined that the person is a specific person, the first image can be displayed to keep the person more.

  Further, according to a seventh invention, in any one of the first to fifth inventions, the previous image display unit includes a plurality of the detected persons, and one of the plurality of persons is the When it is determined that the specific person is obtained by the collation, the third image is displayed.

  According to this, even when there is a high possibility that the detected person is a specific person, when there are a plurality of detected persons, for example, an image that becomes a family photo or the like is not displayed immediately, such as By displaying an image in which only the person is interested as a third image different from the image based on the registered information, the possibility of a specific person can be displayed without displaying an image corresponding to personal information to an unspecified number of others. You can keep a high person. The image that only the person is interested in may be an image that is considered to have fewer lovers than a general hobby, and includes, for example, personal ornaments and stuffed animals.

  According to an eighth invention, in any one of the first to seventh inventions, the image is a unique image that is different for each specific person.

  According to this, by registering a unique image (for example, an image that the person is most interested in) for each specific person, when the possibility of being a specific person is high, the image is displayed in front of the bulletin board. This can increase the effect of keeping it.

  According to a ninth invention, in any one of the first to eighth inventions, an image of the face of the specific person is included.

  According to this, even if a child who is likely to get lost or an elderly person who may be jealous does not have a wireless communication device such as an IC tag in advance, a face photo of the child to be searched or a specific person who is an elderly person Can be recognized by authentication using a known face authentication system. Thereby, even if it is disliked or forgotten to carry the wireless communication device, it can be searched without any problem.

  Further, a tenth aspect of the present invention is the information processing apparatus according to any one of the first to ninth aspects, further comprising voice transmission / reception means for talking with the detected person, wherein the recognition information recognizes the specific person. The content of the conversation is included, and the collation includes the content of the conversation.

  According to this, by registering the content of conversation that can recognize a specific person as recognition information (for example, content that interests the person such as hobbies and preferences), by performing conversation based on that content, It can be recognized as a specific person.

  An eleventh aspect of the invention includes a bulletin board device including an image display unit that displays electronic data as an image and a person detection unit that detects a person, and a server device connected to the bulletin board device via a network, One of the bulletin board device and the server device, registration information storage means for storing registration information including at least recognition information for identifying a specific person and an image for the specific person, a detection result by the person detection means, A collation unit that collates recognition information, and a control unit that displays an image for the specific person on the image display unit when the detected person is determined to be the specific person by the collation unit. It is assumed that at least a part is provided and the other is provided on the other side.

  According to this, in the configuration in which the bulletin board device and the server device are connected via a network, a registration information storage unit that stores registration information of a specific person, a verification unit that collates a detected person with a registered specific person, Providing a control unit that performs control for displaying an image for a specific person on the image display unit separately for the bulletin board device or the server device, thereby performing appropriate distribution according to the size of each load in the computer processing And the efficiency of the entire system can be promoted. For example, processing that requires an expensive circuit is performed by a server device, so that a large number of bulletin boards can be arranged by reducing the burden on the bulletin board side. It can be carried out.

  According to a twelfth aspect, in the eleventh aspect, the server apparatus includes a terminal device connected to the server apparatus via a network, and the server apparatus has a high possibility that the detected person is the specific person. When it is determined by the verification means, the terminal device is notified that the specific person has been detected.

  According to this, when there is a high possibility that the person detected by the bulletin board device is a specific person to be searched, the searcher is notified from the server device to the searcher's terminal device such as a family or a security company. Can pick you up with peace of mind.

  In a thirteenth aspect based on the twelfth aspect, the bulletin board apparatus includes voice transmission / reception means for talking with the detected person, and the terminal apparatus includes voice transmission / reception means, A configuration is adopted in which voice is transmitted to and received from the bulletin board via a server device.

  According to this, when a specific person is detected, the terminal device operated by the family or the security company and the bulletin board device can be connected, and the specific person can talk with the family or the security company. Since it can be kept in front of the bulletin board device for a longer time, a family member or a security company person can go to a specific person during that time.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a schematic explanatory view showing an application example of the present invention. As shown in FIG. 1, bulletin board devices 1 serving as bulletin boards for residents by local governments and neighborhood associations are installed at a plurality of locations in the outdoors and public facilities. The bulletin board apparatus 1 may be provided with the screen 2 as an image display part on a part of a plate surface to which paper or the like is attached even if the entire surface is an image display part of the screen 2 made of, for example, a liquid crystal screen. . On the screen 2, an image similar to that displayed on a monitor of a television or personal computer is displayed.

  Each bulletin board device 1 is connected to a server device 3 installed in a center (facility) such as a local government or a security company via a network such as the Internet. Similarly, terminal devices 4 such as mobile phones owned by registered residents and security companies are connected to the server device 3 via a network.

  As shown in FIG. 2, the bulletin board apparatus 1 includes a camera 11 that captures the front (front) of the bulletin board apparatus 1 at, for example, a wide angle, a speaker 12a and a microphone 12b that constitute voice transmitting / receiving means, and a control that controls them. Part 13 is provided. The camera 11 constitutes a person image acquisition unit.

  The server device 3 may be a host computer having a known server function, and includes a server control unit 3a that performs main control, an image storage unit 3b that stores image data to be displayed on the screen 2 of the bulletin board device 1, A bulletin board information section 3c for storing various image data to be stored in the image storage section 3b, position information of the bulletin board apparatus 1, etc., and a search request and searchee registration information input individually or transmitted from the terminal apparatus 4 Searched person registration information section 3d for storing (photos of face and hobbies / preference data), photographed image processing section 3e for inputting photographed image data from the camera 11, various applications executed by the bulletin board apparatus 1, etc. Is stored. This configuration is merely an example, and each element does not necessarily have to be provided independently, and may be a combination of processing by a program and data stored in a storage device.

  In addition, the direction of the arrow in FIG. 2 shows the main signal flow, and does not show all the input / output signals between the blocks. The image data is composed of electronic data constituting an image to be displayed on the screen 2 and may be simply expressed as an image.

  The server control unit 3a is known as a collation unit that collates the face image data processed by the photographed image processing unit 3e and the face image data of a specific person included in the registration information data of the searchee registration information unit 3d. A face recognition engine used in the face authentication system, a voice conversation engine for talking with a person in front of the bulletin board apparatus 1 via the speaker 12a and the microphone 12b, and a control for displaying a moving image and a photograph on the screen 2 are performed. And an image display engine.

  In the image storage unit 3b, for example, in addition to images including normal bulletin information (characters) such as announcements of local governments and neighborhood associations, registered images are included in a call image of an agent, etc., which will be described later, and the searchee registration information unit 3d. An image corresponding to the hobby preference included in the registration information of the specific person 5 to be searched is stored. Furthermore, when a specific person 5 is detected among a plurality of persons, which will be described later, a unique image (for example, a scene of a place of birth or a neighborhood) where only the person (specific person 5) is interested is stored.

  In the bulletin board information section 3c, the number and address of the bulletin board device 1, the position on the map, the IP address for network connection, and the like are registered.

  In the searched person registration information section 3d, for example, registrant information data sent from the terminal device 4 is stored. As registrant information data, for example, searcher attributes such as the address and contact information of the person or family who will be the searchee (specific person 5), information on the gender and body shape of the specific person 5, and a face photo of the specific person 5 Data and information that enables identification (how to walk), image information for family voices and calls, contact information for family, security company, and facility managers, system when a specific person 5 is found It may be an operation setting or the like. In addition, when there are a plurality of contact information, it is good to set the order when not connected. The face photo data, gender, body shape, movement, etc. of the specific person 5 included in the registrant information data are recognition information for recognizing the specific person 5. The recognition information is not limited to these, and any information that enables the specific person 5 to be identified is included. For example, the recognition information includes a dialect including a dialect.

  The captured image processing unit 3e extracts a face based on the captured image data input from the camera 11, and outputs the extracted face to the server control unit 3a. As a result, a person detection unit can be configured by the camera 11 that captures the front of the bulletin board apparatus 1 and the captured image processing unit 3e that extracts a face image from the captured image. In addition to 11, a detection device such as an IC tag reader may be provided to constitute a person detection means.

  Instead of storing normal content including normal bulletin information such as the above-mentioned notice of local governments or neighborhood associations in the image storage unit 3b, the normal content may be stored in the storage device 3f. The storage device 3f stores a plurality of applications for displaying normal bulletin information such as notifications at normal times and for displaying and calling hobbies and the like when a search target is found. An image may be generated by executing an application, and the image is appropriately transmitted to the bulletin board apparatus 1.

  The face recognition engine of the server control unit 3a may perform collation on a face image by a known face authentication system. The photographed face image sent from the photographed image processing unit 3e and the search target registration information The face image of the specific person 5 registered in the unit 3d is collated, and the degree of possibility of being the specific person 5 is calculated as a recognition rate. For example, an upper limit (second threshold) that can be regarded as another person is set as a recognition rate of 30%, and a lower limit (first threshold value) that is approximately the person is set as a recognition rate of 70%, and recognition that the person may be possible. The rate is set to 30 to 70%, and the process is divided into three stages: a low recognition rate (˜30%), a medium recognition rate (30 to 70%), and a high recognition rate (70% to). In this case, the upper limit (30%) of the low recognition rate can be set as a predetermined threshold value for displaying normal posting information. These three stages are also examples, and may be two stages or four or more stages. The method for calculating the recognition rate is arbitrary, and for example, the recognition rate may be calculated from the number of points where each characteristic part (contour, eyes, nose, mouth, etc.) matches. Further, the above-described numerical values of the recognition rate are guides and may be arbitrary numerical values. Here, the person verification is described using face recognition as an example. However, the present invention is not limited to this, and the height, the way of walking, or the like may be verified, or may be combined with a recognition result such as an IC tag. Good.

  The voice conversation engine of the server control unit 3a is for carrying out a conversation with a person in front of the bulletin board apparatus 1 via the speaker 12a and the microphone 12b of the bulletin board apparatus 1, and using a known voice recognition technology, It may be one using an artificial intelligence application for conversation. In addition, a pre-recorded voice may be transmitted to the bulletin board apparatus 1.

  The image display engine of the server control unit 3a performs control to display image data or the like stored in the storage device 3f on the screen 2 of the bulletin board device 1. The storage device 3f may store an image of a person photographed in advance in the form of a call or a character (hereinafter referred to as an agent) drawn with image software, for example. The agent may be operated by an application.

  If the detected person using the image display engine and the voice conversation engine is highly likely to be the specific person 5 by collation with the specific person 5 registered in the searched person information registration unit, it is registered. If there is a response from a name that is called, a conversation with the pattern of daily conversation registered by the voice conversation engine is performed, or content that shows interest from the registered information (old photos, photos of hometowns and their localities) Or other dialects). Thereby, when the possibility that the detected person is the specific person 5 is high, it is possible to continue the video and the conversation that keeps being in the place. Further, the image display engine and the voice conversation engine have a known video conference function capable of video transmission so that conversation can be performed between the bulletin board apparatus 1 and the terminal apparatus 4.

  The configuration of the bulletin board device 1 and the server device 3 has been described above. However, the bulletin board device and the server device according to the present invention are not limited to the above-described configuration contents, and each component (the image storage unit 3b, The bulletin board information unit 3c, the searched person registration information unit 3d, the captured image processing unit 3e, and the storage device 3f) may be individually provided in either the bulletin board device 1 or the server device 3. For example, processing that requires expensive circuits and programs is performed by the server device 3, so that the burden on the bulletin board device 1 can be reduced, and the cost when a large number of bulletin board devices 1 are arranged can be reduced. And can promote dissemination.

  The terminal device 4 is a mobile phone as an example. However, the terminal device 4 is not limited to a mobile phone, and may be any device as long as it is connected to a network, can be transmitted to and received from the server device 3, and can display an image. A personal computer or the like is applied. In particular, it may be provided with a camera in addition to a speaker and a microphone. In this case, a conversation similar to a videophone can be performed with the bulletin board apparatus 1.

  Next, the operation procedure of the bulletin board apparatus and bulletin board system configured as described above will be described below with reference to the flowchart of FIG. Note that, depending on the registration information of the search target person (specific person 5), the search may be always performed, or the search may be started upon contact from a family member or the like.

  In step ST1 of FIG. 3, the screen 2 of the bulletin board apparatus 1 is normally displayed. The normal display may be normal bulletin information stored in the storage device 3f as described above (notices from local governments and neighborhood associations). If no person is detected for a certain period of time, the display itself may be turned off to save power.

7
In the next step ST2, a person is detected by performing image processing on the photographed image of the camera 11. This person detection process may be a known image process, and the description thereof is omitted. In the illustrated example, the person is detected by image processing. However, the present invention is not limited to image processing using the camera 11, and may be a human sensor, for example. In addition, when a specific person 5 can carry a wireless communication device such as an IC tag in advance, the person detection may be performed when communication with the wireless communication device is established. If it is determined in step ST2 that a person has been detected, the process proceeds to step ST3. If no person is detected, the process returns to step ST1.

  In step ST3, a photographed image photographed by the camera 11 is recorded. The recording may be, for example, storing a predetermined length of time in the storage device 3f. By recording a photographed image for a long time or continuously recording regardless of person detection, the function of the surveillance camera can be provided.

  In the next step ST4, the photographed image processing unit 3e extracts a face from the recorded photographed image. In the illustrated example, the server apparatus 3 has the processing function. However, the bulletin board apparatus 1 may have the function to perform image processing. In the next step ST5, the face recognition engine of the server control unit 3a collates the extracted face image with the face image of the specific person 5 registered in the searchee registration information unit 3d, and the recognition described above. Calculate the rate.

  Next, in this illustrated example, the cases are divided into three steps ST7a to 7c. If the recognition rate in step ST7a is at a low level (for example, 30% or less), it is determined that there is no possibility that the detected person is the specific person 5 for whom a search request is made, and in step ST8a, the same as step ST1. The normal display is performed and the process returns to step ST2, and the person detection is continued. In addition, as an image to be displayed on the screen 2, an image for the specific person 5 based on the registration information is used, but it is also preferable to use the first image and the second image that are changed according to the difference in recognition rate.

  If the recognition rate in step ST7b is a medium level (30 to 70%), the detected person may be the specific person 5, and the specific person 5 is registered in step ST8b to attract interest. based on the information, as the second image, for example, display the tastes to the combined interests image (see FIG. 5 (a)) and, to display the agent on the screen 2, by the agent, "Hello!" and "going out is? And so on (see FIG. 5B). In this case, if it is not the specific person 5, it may be only interested in normal notification information, so the normal notification information display may be left in a part of the display unit. Interesting images include fishing, go, shogi, bonsai, and scenery. The recognition accuracy can be further improved if the bulletin board apparatus 1 is faced forward by such an interest image display or the like. Moreover, it is thought that it is interested in the display of the bulletin board apparatus 1 that it faces the front. In the next step ST9b, it is determined whether or not the extracted face is facing the front. If it is a landscape orientation or the like, the process returns to step ST2, and if it is the front, the process proceeds to step ST10b. In this case, a case where a plurality of persons including persons with a medium recognition rate are facing the front is also included.

  In step ST10b, the agent is displayed again on the screen 2, and there is a response to the call, a response is given by calling "Mr. A!", And the conversation according to, for example, a hobby preference is continued. It is also good to have a conversation using your native dialect. In the next step ST11b, the recognition rate is calculated again, and it is determined that the possibility of being the person is large from the content of the conversation (such as a positive reply to the content specific to the person) and that the recognition rate has exceeded the large recognition rate (70% or more). If the recognition rate is medium (30 to 70%), the process returns to step ST10b. If the recognition rate is low (less than 30%), the process returns to step ST2. In this way, collation can be performed from the content of the conversation.

  In step ST12b, the family or facility manager who has submitted the search request or the requested security company is notified that the specific person 5 has been found, and the process proceeds to step ST13b. In step ST13b, it is determined whether or not the terminal device 4 operated by the family or the like who has received the notification is connected to the bulletin board device 1 via the server device 3, and if not connected, the process returns to step ST10b and is connected. In that case, the process proceeds to step ST14b.

  In step ST14b, a line is connected so that conversation can be performed with the terminal device 4 using the speaker 12a and the microphone 12b of the bulletin board device 1. Thereby, a family etc. can talk with the specific person 5 in front of the bulletin board apparatus 1 via the terminal device 4, for example, and can keep the specific person 5 still there. The location information (address, etc.) of each bulletin board device 1 is stored in the bulletin board information section 3c of the server device 3, and the location information of the bulletin board device 1 where the specific person 5 is found is transmitted from the server device 3 to the terminal device 4. As a result, the family or the like can accurately know the position of the specific person 5. For example, when a mobile phone or the like is used as the terminal device 4, the specific person 5 can be picked up to the discovered bulletin board apparatus 1 while continuing the conversation with the specific person 5.

  Furthermore, in the conversation in step ST14b, when the terminal device 4 has a TV phone function of talking while photographing the operator, the bulletin board device 1 uses the photographed image of the operator as a first image, as will be described later. The specific person 5 photographed by the camera 11 of the bulletin board device 1 can be displayed on the terminal device 4. Thereby, the family and the like can visually confirm the specific person 5 and the specific person 5 feels to actually talk with the family and the like so that the conversation can be continued easily. It becomes easy to keep the specific person 5 in front of the bulletin board apparatus 1 until it arrives.

  Note that steps ST13b to ST14b may be repeated until the terminal device 4 is disconnected. If it is determined in step ST13b that the terminal device 4 is not connected, the process returns to step ST10b. In that case, by repeating steps ST10b to ST13b (continuing the conversation), it is possible to keep the specific person 5 who is likely to be the person who has requested the search in front of the bulletin board apparatus 1.

  When a family image is provided by the searcher, the family image may be displayed instead of the agent in step ST10b. Thereby, the specific person 5 can be further retained. In addition, although notification is given here when the possibility that the person is the person has increased, the degree of urgency varies depending on the level of dementia, etc. of the specific person 5, so the registration information determines that the recognition rate is in progress. Notification may be performed at the stage where the notification is made.

  When the recognition rate in step ST7c is a high level (70% or more), the detected person is regarded as the specific person 5, and the family or facility that has issued the search request in step ST8c as in step ST12b. The administrator or the requested security company is notified that the specific person 5 has been found. As a result, prompt response is possible. In the next step ST9c, as described above, the display of the interest image and the call by the agent are performed. Thereby, even when passing in front of the bulletin board apparatus 1, for example, the bulletin board apparatus 1 can be interested. In the next step ST10c, for example, an agent is displayed and a conversation is performed in order to keep the specific person 5 having a high recognition rate level. In this case, if a family image is provided by the searcher, the family image may be displayed as the first image. Thereby, it can hold more reliably.

  In the next step ST11c, it is determined whether or not the terminal device 4 operated by the family member who has received the notification is connected to the bulletin board device 1 via the server device 3, and if not connected, the process returns to step ST10c to be connected. If YES in step ST12c, the flow advances to step ST12c to enable conversation and display of the image of the terminal operator as in step ST14b. Further, the repetition of steps ST11c to ST12c is the same as steps ST13b to ST14b.

  In the above flow, the case where there is one specific person 5 has been described, but the same processing can be performed even when a plurality of persons are detected. Further, depending on whether there is only one specific person 5 or a plurality of persons including the specific person 5 in front of the bulletin board apparatus 1, the display image and the content of the voice call may be varied depending on the registration information. This is because there is no need to inform others easily when the display image is related to privacy. For example, until it can be determined that the person is a specific person 5, it is preferable not to display a photograph of a family or the like as an example of the first image to suppress the leakage of personal information. In this case, the image displayed on the screen 2 may be a third image different from the first image and the second image. The third image is not surely conscious of the person like a family photo, but is an image that matches a specific person 5 rather than a general one that is targeted by a large number of people such as hobbies and preferences. Good. As an example of the third image, there are, for example, a personally cherished figurine or a favorite article. Even if there are multiple persons, if it is certain that the detected person is the specific person 5, priority is given to retaining, and after showing interest in the bulletin board device 1, a photograph of a family member or the like is displayed. It is good to call the name of the person 5, talk according to hobbies and preferences, or talk using the dialect of the hometown.

  In step ST9c, if it is detected by image processing of the photographed image of the camera 11 that the specific person 5 has left the front of the bulletin board apparatus 1 after speaking, it is specified if the process proceeds to step ST8c. Since it is a case where it can be regarded as the person 5, the call is made again to keep it. In this case, for example, not only the volume is increased when starting to go away, but also the volume is increased according to the distance, and the call may be continued until disappearing from the photographed image, or the call for calling back. You may do. By continuing to call, the possibility that the specific person 5 will return increases (see FIG. 5C). Note that the same processing may be performed after step ST10b.

  Further, as shown in the flow of FIG. 4, steps ST6a and ST6b may be provided between the above-described steps ST5 and ST7a (ST7b, ST7c). In this step ST6a, attention is paid to the bulletin board apparatus 1. For example, the interest image (the image matched with the age at which the search request has been made, etc.) and sound are circulated by, for example, melody because the certainty of the specific person 5 is unknown at this stage, and the interest is shown in the bulletin board apparatus 1. Let An image adapted to this age is an example of the second image.

  In the next step ST6b, it is determined whether the detected person has faced the front or approached the bulletin board apparatus 1, and if it passes the front of the bulletin board apparatus 1, the process returns to step ST2 to face the front. Alternatively, if it is determined that the vehicle is approaching, the process of dividing the case in steps ST7a to 7c is performed.

  FIG. 6 is a diagram illustrating an example of a screen display when a smartphone is applied as the terminal device 4. On the screen of the terminal device 4 that is a smartphone, the main screen portion 4a that displays the image of the other party at the top, the bulletin board address display portion 4b that displays the address of the bulletin board device 1 below, and the position of the bulletin board device 1 are displayed below. A map display button unit 4c for displaying a map to be displayed on the main screen unit 4a, a bulletin screen display unit 4d for displaying an image displayed on the screen 2 of the bulletin board device 1, and a user photographed by the terminal device 4 A self-image display unit 4e for displaying the self-image, a self-image display button unit 4f for displaying the self-image on the screen 2 of the bulletin board device 1, a disconnect button unit 4g for disconnecting communication, and the bulletin board device 1 Is provided with a recording / playback button unit 4h for redisplaying the image recorded by the above operation on the main screen unit 4a.

  When it is notified from the server device 3 that the specific person 5 who has issued the search request has been detected, it is possible to confirm whether or not the specific person 5 is the search target on the main screen unit 4a. You may be able to talk like a telephone. At first, as shown in the figure, the screen 2 of the bulletin board apparatus 1 does not display the own image taken by the terminal apparatus 4, and confirms that the person is the specific person 5 to be searched on the main screen section 4a. Or whether only one of the specific persons 5 is in front of the bulletin board apparatus 1 is confirmed. Thus, after confirming the situation in front of the bulletin board apparatus 1, the user's own image can be displayed on the screen 2 by operating the self-image display button unit 4f. In addition, even though the bulletin board apparatus 1 is connected by the notification from the server apparatus 3, the other party (specific person 5) is not displayed on the main screen unit 4 a at that time. In this case, the image of the specific person 5 recorded and recognized on the bulletin board device 1 can be displayed on the main screen portion 4a by operating the recording / playback button portion 4h. Thereby, the specific person 5 can be confirmed.

  When the security company performs the above operation of the terminal device 4, it is not necessary to provide the self-image display unit 4e and the self-image display button unit 4f for displaying the person who operates the terminal device 4 (person of the security company). Good.

  By arranging a plurality of bulletin board apparatuses 1 configured in this way, the probability of detecting a specific person 5 such as an elderly person or a child who is likely to get lost increases. Furthermore, since the screen 2 capable of displaying an image of electronic data is provided on the bulletin board apparatus 1, a wide variety of images can be displayed as appropriate. Usually, notifications from local governments and neighborhood associations are displayed, and when the specific person 5 is detected according to the registration information, an image showing interest according to the specific person 5 can be selected and displayed. Can be kept in front of the bulletin board apparatus 1.

  In the illustrated example, as described above, the server apparatus 3 is provided with various engines and has a function of storing face recognition and registration information. However, the bulletin board apparatus 1 may have these functions. As an example, FIG. 7 shows a second embodiment. In addition, the same code | symbol is attached | subjected about the part similar to the above, and the detailed description is abbreviate | omitted.

  In FIG. 7, the bulletin board apparatus 1 includes a face extraction unit 14 to which captured image data from the camera 11 is input, a searchee registration information unit 15 as registration information storage means for storing registration information of the specific person 5, a face The person collation unit 16 to which the face image data from the extraction unit 14 and the registration information data from the searchee registration information unit 15 are input, the control unit 13 that performs overall control of the bulletin board device 1, and the screen of the bulletin board device 1 An image storage unit 18 that stores image data to be displayed on the screen 2 and an image display control unit 19 that performs control to display the stored image data from the image storage unit 18 on the screen 2 are provided. In this example, the camera 11, the face extraction unit 14, and the person verification unit 16 constitute a person detection unit.

  The server device 3 includes a server control unit 3a serving as a host computer having a known server function, and a bulletin board information unit 3c that stores various image data stored in the image storage unit 18, position information of the bulletin board device 1, and the like. And a storage device 3 f that stores search requests transmitted from the terminal device 4, searchee registration information (face photos, hobbies / preference data), various applications executed by the bulletin board device 1, and the like.

  Even in such a configuration, the above-described control can be performed. In this case, for example, even when the network line is temporarily disconnected, the detention processing described above can be performed individually because the registration information is registered in each bulletin board device 1. The specific person 5 can be kept in front, and when the line is restored, the family and the like can be notified to receive the notice.

  As for the procedure for detecting the specific person 5, in the above-described embodiments, examples of detection using an IC tag and face recognition using a face authentication system have been described. You can also register and check how to walk in the video you shot. This makes it possible to detect the specific person 5 even when face recognition is difficult, for example, when the user passes a distant place.

  Although the present invention has been described with reference to the preferred embodiments, the present invention is not limited to such embodiments and can be easily understood by those skilled in the art. As long as it does not deviate from the above, it can be appropriately changed. For example, although a storage device is not shown in the bulletin board device 1, a search request is issued by providing a storage device and storing registration information of persons who can be targeted by the specific person 5 in advance for the number of registered persons. The server device 3 can promptly enter the detection state by only transmitting the registration number of the specific person 5 to each bulletin board device 1. Further, when the specific person 5 leaves after entering the state of notifying the family or the like, the direction of leaving from the captured image can be estimated and added to the item for notifying the direction of the specific person 5 leaving. Thereby, even when the specific person 5 goes away from the bulletin board apparatus 1, it becomes easy to search for the specific person 5. In addition, all the components shown in the above embodiment are not necessarily essential, and can be appropriately selected without departing from the gist of the present invention. Further, in this embodiment, bulletin boards of neighborhood associations and residents' associations are assumed, but they may be used for lost child searches in large-scale commercial facilities and theme parks. In this case, at the same time as using the facility information display board and the notification display part, using the image taken with the surveillance camera etc. at the time of entrance, the attribute information etc. as registration information by the declaration from the family who offered the search You only need to enter it.

  The bulletin board device and the bulletin board system according to the present invention have the effect of detecting old people, lost children, etc. by bulletin boards placed in the city and keeping them on the spot. In addition, when a camera is used, it can be applied to the use of a surveillance camera.

DESCRIPTION OF SYMBOLS 1 Bulletin board 2 Screen 3 Server apparatus 3a Server 3b Bulletin board information part 3c Searching person information registration part 3d Storage apparatus 4 Terminal apparatus 5 Specific person 11 Camera 12a Speaker 12b Microphone 14 Face extraction part 15 Registration information storage part 16 Person collation part 18 Image Preservation part

Claims (13)

An image display unit for displaying electronic data as an image;
Human image acquisition means for acquiring human images;
Transmitting / receiving means for transmitting / receiving to / from the server device;
The acquired person image is transmitted to the server device, and the server device compares the person detected from the person image with recognition information for recognizing a specific person registered in the server device. A bulletin board comprising: a control unit that causes the image display unit to display an image for the specific person transmitted from the server device when the detected person is determined to be the specific person apparatus. An image display unit for displaying electronic data as an image;
A person detecting means for detecting a person;
Transmitting / receiving means for transmitting / receiving to / from the server device;
The detection result of the detected person is transmitted to the server device, and the server device detects the person detected by collating recognition information for recognizing a specific person registered in the server device with the detection result. A bulletin board device comprising: a control unit that causes the image display unit to display an image for the specific person transmitted from the server device when the user is determined to be the specific person. An image display unit for displaying electronic data as an image;
A person detecting means for detecting a person;
Registration information storage means for storing registration information including at least recognition information for recognizing a specific person;
Collation means for collating the detection result by the person detection means with the recognition information;
Transmitting / receiving means for transmitting / receiving to / from the server device;
When the detected person is determined to be the specific person by the verification unit, the result of the verification is transmitted to the server device, and the image for the specific person transmitted from the server device is A bulletin board device comprising: a control unit for displaying on an image display unit. An image display unit for displaying electronic data as an image;
A person detecting means for detecting a person;
Registration information storage means for storing registration information including at least recognition information for recognizing a specific person and an image for the specific person;
Collation means for collating the detection result by the person detection means with the recognition information;
A bulletin board apparatus, comprising: a control unit that causes the image display unit to display an image for the specific person when the detected person is determined to be the specific person by the collating unit.   In the image display unit, when the recognition rate indicating the possibility that the detected person is the specific person is less than a predetermined threshold by the collation, normal posting information is displayed. The bulletin board apparatus according to any one of claims 1 to 4, wherein   The image display unit displays a first image when the recognition rate indicating that the detected person is likely to be the specific person is greater than or equal to a first threshold by the collation, and the recognition The second image is displayed when the rate is less than the first threshold and greater than or equal to a second threshold lower than the first threshold. Bulletin board equipment.   The image display unit displays a third image when there are a plurality of detected persons and one of the persons is determined to be the specific person by the verification. 6. The bulletin board apparatus according to claim 1, wherein the bulletin board apparatus is characterized.   The bulletin board apparatus according to claim 1, wherein the image is a unique image that is different for each specific person.   9. The bulletin board apparatus according to claim 1, wherein the recognition information includes an image of the face of the specific person. Having voice transmitting and receiving means for talking with the detected person;
The recognition information includes the content of a conversation for recognizing the specific person,
The bulletin board apparatus according to claim 1, wherein the collation includes contents of the conversation. A bulletin board device comprising an image display unit for displaying electronic data as an image and a person detection means for detecting a person;
A server device connected to the bulletin board device via a network;
On one of the bulletin board device and the server device,
Registration information storing means for storing registration information including at least recognition information for recognizing a specific person and an image for the specific person, collation means for comparing a detection result of the person detection means with the recognition information, When the detected person is determined to be the specific person by the collating means, at least a part of the control unit that displays an image for the specific person on the image display unit is provided, and the remaining is A bulletin board system characterized by being provided. A terminal device connected to the server device via a network;
The server device notifies the terminal device that the specific person has been detected when the collation unit determines that the detected person is likely to be the specific person. The bulletin board system according to claim 11. The bulletin board apparatus has a voice transmission / reception means for having a conversation with the detected person,
The bulletin board system according to claim 12, wherein the terminal device includes voice transmission / reception means, and transmits and receives voice to and from the bulletin board via the server device.

Images