JP6376207B2 - Terminal device, operation state display method, and program - Google Patents

Description

The present invention relates to a terminal device, an operation state display method , and a program.

In recent years, there are an increasing number of pet owners such as dogs and cats, and elderly people who are living alone (the elderly). In addition, in the case of relatives living away from the elderly, the state (mode) of the elderly is concerned. In such a case, the state of a pet or an elderly person is also received at a remote portable terminal device or PC by receiving an image from a surveillance camera installed indoors by a portable terminal device or a personal computer (PC) via a remote communication network. It was possible to check the camera, but it was necessary to watch the camera image carefully.
By the way, conventionally, an acceleration sensor is provided on a cane of an elderly person or the like, and the detection result by the acceleration sensor is transmitted to the monitoring device as a state of the user (watching target person) (walking, stationary), thereby displaying an animation. Such a technique is known (see Patent Document 1).

JP 2009-199319 A

  However, in the technique of Patent Document 1 described above, the state of the person to be watched is animated and displayed in an easy-to-understand manner. However, the technique is limited to those who use a cane as the object to be watched, and Only walking and still can be displayed as states, and it was not a general-purpose technology.

An object of the present invention is to accurately determine a constant current state of the detection target.

The terminal device according to the present invention classifies a plurality of operations in the detection target, a first acquisition unit that acquires the operation content of the detection target, a second acquisition unit that acquires the current location and the current time of the detection target. and operation type that, the detecting operation and the time zone of the location and the detection target there a target, by referring to the storage means for storing a plurality of state information determined by the operation contents acquired by the first acquisition means corresponds and operation type for the the current location and time zone of current time acquired by the second acquisition means, said determining means for determining the current status information of the detection target determined by said detection object discriminated by said discrimination means Display setting means capable of setting the display of the current state information with different character images for each type of detection target .
Moreover, the operation state display method according to the present invention includes a first acquisition step of acquiring the operation content of the detection target, a second acquisition step of acquiring the current location and the current time of the detection target, and a plurality of detection targets. Acquired in the first acquisition step by referring to storage means for storing a plurality of state information determined by the operation type that classifies the operation of the operation, the location where the detection target is located, and the operation time zone of the detection target A determination step for determining current state information of the detection target determined by the operation type to which the operation content corresponds, and the current location and time zone acquired in the second acquisition step; and the determination step. And displaying the current state information of the detection target as a character image selected from a plurality of character images corresponding to the type of the detection target. , Characterized by having a.
In addition, the program according to the present invention includes a first acquisition unit that acquires the operation content of the detection target, a second acquisition unit that acquires the current location and the current time of the detection target, and a plurality of operations in the detection target. The operation content acquired by the first acquisition unit by referring to a storage unit that stores a plurality of state information determined by the operation type classified as follows, the location where the detection target is located, and the operation time zone of the detection target The determination means for determining the current state information of the detection target determined by the operation type corresponding to the current location and the time zone of the current time acquired by the second acquisition means, and the detection determined by the determination means Function as display control means for displaying the current state information of the target in a character image selected from among a plurality of character images corresponding to the type of detection target It is characterized in.

According to the present invention, it is possible to accurately determine a constant current state of the detection target.

The block diagram which showed the outline | summary of the watching system which watches over a monitoring object via a communication network. 1 is a block diagram showing basic components of a home server device (watch management device) 1. FIG. The block diagram which showed the basic component of the sensor apparatus 2. FIG. The block diagram which showed the basic component of the portable terminal device 8. FIG. The figure for demonstrating the watching database WT by the home server apparatus 1 side. (1), (2) is the figure which showed the example of a display when displaying the character which shows the state of a monitoring object (pet) on the terminal screen of a terminal device (PC6 or the portable terminal device 8). The flowchart which showed the outline | summary of the whole operation | movement started by the sensor apparatus 2 according to power-on operation. The flowchart which showed the characteristic operation | movement outline | summary (registration process) of this embodiment among the whole operation | movement of the portable terminal device 8. FIG. The flowchart which showed the characteristic operation | movement outline | summary (registration process) of this embodiment started execution by interruption for every fixed time among the whole operation | movement of the home server apparatus 1. FIG. The flowchart which showed the characteristic operation | movement outline | summary (state determination process) of this embodiment started execution by interruption for every fixed time among the whole operation | movement of the home server apparatus 1. FIG. The screen in the case of registering the operation of the watching target (pet) in the mobile terminal device 8 is shown, (1) is a new registration screen, and (2) is a diagram showing an already registered screen. In 2nd Embodiment, the flowchart which showed the characteristic operation | movement outline | summary (registration process) of 2nd Embodiment among the whole operation | movement of the portable terminal device 8. FIG. In 2nd Embodiment, the flowchart which showed the characteristic operation | movement outline | summary (state determination process) of 2nd Embodiment among the whole operation | movement of the portable terminal device 8. FIG.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
(First embodiment)
First, a first embodiment of the present invention will be described with reference to FIGS.
FIG. 1 is a block diagram showing an overview of a watching system for watching over a monitoring target via a communication network.
The watching system has a home server device (watching management device) 1 as a core, and this home server device 1 is connected to the sensor device 2 attached to a watching target (for example, a pet (dog)) at home. A personal computer (PC) connected for communication via an access pointer 4 constituting an internal LAN (Local Area Network) 3.

  The home server device 1 can be connected to another personal computer (PC) 6 via the Internet 5 and can be connected to the mobile terminal device 8 via the Internet 5 and the wireless communication network 7. It has become. The sensor device 2 is, for example, a collar-mounted small electronic device when the watching target is a pet. The sensor device 2 may be integrally molded with the collar or may be detachably attached. As will be described in detail later, the sensor device 2 detects a movement to be watched over, and transmits the detection result to the home server device 1 via the home LAN 3.

  The home server device 1 accesses the sensor device 2 via the home LAN 3 and receives and receives from the sensor device 2 when receiving a request for confirmation of the state of the monitoring target from the terminal device (PC 6 or portable terminal device 8). Based on the detected result, the watching database WT is searched to determine the state to be watched (for example, during meals, sleeping, etc.), and a picture (character) indicating the state is represented by a character string indicating the state. At the same time, it is transmitted to the requesting terminal (PC 6 or portable terminal device 8) and displayed on the terminal screen. As described above, the monitoring system according to the present embodiment performs data transmission / reception between the home server device 1 and the sensor device 2 via the communication network, and between the home server device 1 and the PC 6 or the mobile terminal device 8. This is a wide area communication system capable of transmitting and receiving data via a communication network.

FIG. 2 is a block diagram showing basic components of the home server device 1.
In addition to basic functions such as a text creation function, an e-mail function, an Internet connection function, a clock function, etc., the home server device 1 has a watching function that can check the state of the watching target in real time as described above. The CPU 11 is a central processing unit that operates by supplying power from the power supply unit 12 and controls the overall operation of the home server device 1 according to various programs in the storage unit 13. The storage unit 13 includes, for example, a ROM, a flash memory, and the like, and stores programs and various applications for realizing the present embodiment in accordance with the operation procedure illustrated in FIGS. 9 and 10.

  That is, the storage unit 13 includes a program memory SP, a watch database WT, and the like, and a work for temporarily storing various information (for example, a flag, a timer, etc.) necessary for the home server device 1 to operate. It has a configuration having a region (not shown). The current time measured by the clock function is also stored in the storage unit 13 and updated sequentially. The storage unit 13 may be configured to include a removable portable memory (recording medium) such as an SD card or an IC card, and is connected to a network via a communication function (not shown). May include a storage area on a predetermined external server side.

  The wide area communication unit 14 is used at the time of an electronic mail function and an Internet connection function, and transmits / receives data to / from a terminal device (PC 6 or portable terminal device 8) via the Internet 5 and the wireless communication network 7. The LAN communication unit 15 is a LAN communication module for transmitting and receiving data to and from the monitoring sensor device 2 via the home LAN 3. The display unit 16 uses, for example, a high-definition liquid crystal display, an organic EL display, an electrophoretic display (electronic paper), and the like, and displays display information such as character information and a standby image. On the surface of the display unit 16, a touch screen (touch screen) is configured by laminating and arranging a contact operation unit (transparent contact sensor) that detects contact of a finger. Although not shown, the operation unit 17 includes a power on / off key, a character key, a function key, and the like, and the CPU 11 performs processing according to the operation key.

FIG. 3 is a block diagram showing basic components of the sensor device 2.
The sensor device 2 has a CPU 21 as a core, and operates by supplying power from a power supply unit 22 including a secondary battery. The CPU 21 controls the overall operation of the sensor device 2 according to various programs in the storage unit 23. The storage unit 23 includes a ROM, a flash memory, and the like. In addition to the program memory CP that stores a program for realizing the present embodiment in accordance with the operation procedure illustrated in FIG. Etc.) are temporarily stored in the work area (not shown). A LAN communication unit 24, a power button 25, and a motion sensor 26 are connected to the CPU 21 as peripheral devices. The LAN communication unit 24 is a LAN communication module for transmitting / receiving data to / from the home server device 1 via the home LAN 3. The power button 25 is a mechanical push button for turning on / off the power supply unit 22.

  The motion sensor 26 is, for example, a 6-axis motion sensor and includes a 3-axis acceleration sensor 26A and a 3-axis geomagnetic sensor 26B. The acceleration sensor 26 </ b> A is a sensor that detects, for example, an intense large movement, a slow and slow movement, a fine movement, a fast movement, an irregular movement, and the like, as the movement of the watching target (for example, a pet). That is, the acceleration sensor 26A detects a state of vibration (swing) applied to the sensor device 2 and outputs a voltage value of a vibration waveform corresponding to the magnitude of the vibration (acceleration). This is a three-axis acceleration sensor configured to output a voltage value proportional to the acceleration according to the three-axis directions (X, Y, and Z-axis directions), that is, the magnitude of acceleration applied to the front, rear, left, right, and upper three axes. Of course, the number of axes is not limited to three.

  The geomagnetic sensor 26 </ b> B detects the geomagnetism in the front-rear direction and the left-right direction as the orientation of the sensor device 2 as the orientation (direction and tilt) of the sensor device 2, and detects the geomagnetism in the vertical direction as the tilt of the sensor device 2 3 Although it is an axial geomagnetic sensor, of course, it is not restricted to 3 axes. The direction of the watching target is detected by the geomagnetic sensor 26B. In this embodiment, the moving distance and the moving direction of the watching target are obtained based on the detection result of the geomagnetic sensor 26B and the detection result of the acceleration sensor 26A. Based on the distance and the moving direction, the current location (rough position) to be watched over is specified.

  That is, the CPU 21 calculates the walking cycle, walking speed, and number of steps to be watched based on the detection result of the acceleration sensor 26A, and calculates the moving distance from the walking cycle, walking speed, and number of steps. Then, the movement path to be watched over is calculated from the calculated movement distance and the movement direction specified based on the detection result of the geomagnetic sensor 26B. Depending on whether the current position specified by the movement route calculated in this way corresponds to each of the set positions from the registered starting point, for example, the positions set for each room in the home The current whereabouts are detected. The motion sensor 26 may be configured by adding a triaxial angular velocity sensor in addition to the triaxial acceleration sensor 26A and the triaxial geomagnetic sensor 26B. As described above, the motion sensor 26 may be a nine-axis motion sensor, but in this embodiment, a six-axis motion sensor including a three-axis acceleration sensor 26A and a three-axis geomagnetic sensor 26B is used.

  The motion sensor 26 configured as described above is operated periodically (for example, 100 ms), but the operation cycle may be arbitrarily set according to the type and state of the watching target. The motion sensor 26 is not limited to the configuration in which the acceleration sensor 26A and the geomagnetic sensor 26B are combined, and the acceleration sensor 26A and the geomagnetic sensor 26B may be separated. The CPU 21 takes in detection results (accelerations and directions corresponding to X, Y, and Z axes) detected by periodically operating the acceleration sensor 26A and the geomagnetic sensor 26B, and temporarily stores them in the storage unit 23 sequentially. For example, detection results every 100 ms are sequentially stored for “one minute”.

FIG. 4 is a block diagram showing basic components of the mobile terminal device 8.
The mobile terminal device 8 has a watch function that can check a state to be watched in real time, in addition to basic functions such as a call function, an e-mail function, an Internet connection function, and a clock function. The CPU 81 is a central processing unit that operates by supplying power from the power supply unit 82 and controls the overall operation of the mobile terminal device 8 according to various programs in the storage unit 83.
The storage unit 83 has a configuration including, for example, a ROM, a flash memory, and the like, and stores a program and various applications for realizing the present embodiment.

  The storage unit 83 includes a program memory TP for realizing the present embodiment in accordance with the operation procedure illustrated in FIG. 8 and the like, and various types of information (for example, flags, A work area (not shown) for temporarily storing a timer or the like). The current time measured by the clock function is also stored in the storage unit 83 and updated sequentially. Note that the storage unit 83 may include a removable portable memory (recording medium) such as an SD card or an IC card, and is connected to a network via a communication function (not shown). May include a storage area on a predetermined external server side. The wireless communication unit 84 is used for a call function, an e-mail function, and an Internet connection function. The display unit 85 displays display information such as character information and a standby image such as a high-definition liquid crystal display or an organic EL display. Although not shown, the operation unit 86 includes a power on / off button, character keys, function keys, and the like, and the CPU 81 performs processing according to the operation button. The LAN communication unit 87 is a LAN communication module for transmitting / receiving data to / from the home server device 1 via the home LAN 3.

FIG. 5 is a diagram for explaining the watching database WT on the home server device 1 side.
The watching database WT is a database that is referred to when specifying the state of the watching target based on the detection result received and acquired from the sensor device 2 and the time zone including the current time. Each item includes “type”, “time zone”, “place”, “motion”, “state”, and “character”. The “type of watching target” is an item for storing what the watching target is, and in the example shown in the figure, “pet (dog)” is stored, but it is of course not limited thereto. “Time zone” is an item for storing, for example, morning, noon, and night time zones. In the figure, “anytime” indicates that the time zone is not specified. “Location” indicates the position of each room in the home, and position information indicating in which direction and how far away from the preset home position (direction and distance from the start point) Is stored for each room. For example, when the watching target is a pet (dog), position information (direction and distance) such as a meal place and a bed is stored.

  “Operation” indicates a specific operation during meals, during sleep, and the like, and is an item for storing a vibration state corresponding to the X, Y, and Z axes as an operation pattern. These include "big and big movements up and down, left and right, and back and forth", "slow and irregular movements", "relative movements up and down, left and right, and back and forth", and "regular movements up and down, left and right". This “operation” item has a configuration capable of storing a plurality of (for example, three) operation patterns. That is, each detection result detected a plurality of times by the sensor device 2 can be stored as a plurality of operation patterns. “Status” indicates the status of the monitoring target specified based on “type of watching target”, “time zone”, “location”, and “motion”, for example, “meal”, “barking threatening (abnormal) ) ”,“ Sleeping ”,“ playing ”, and the like. “Character” is a picture that shows a corresponding “state”, and is an item that stores a character called an avatar that expresses a watching target.

  The contents of the watching database WT are arbitrarily registered according to user operations, and the home server device 1 receives a registration instruction (a registration instruction for registering an operation to be watched) from the mobile terminal device 8. The registration process to the watching database WT is executed. That is, the home server device 1 receives and acquires the detection result (motion to be watched over) of the acceleration sensor 26A from the sensor device 2, registers it as the motion pattern in the “motion” item of the watch database WT, and The input result (type, state, location, time zone, character) input from the device 8 is received and acquired, and the corresponding “type of watch target”, “time zone”, “location” in the watch database WT ”,“ State ”, and“ character ”items are registered. As described above, a plurality of detection results (operation patterns) detected by the sensor device 2 can be registered in the “operation”.

  FIG. 6 is a display example when a character indicating the state of the watching target is displayed on the terminal screen when a request for checking the state of the watching target is received from the terminal device (PC 6 or portable terminal device 8). 6 (1) is a case where the “type of watching target” is “pet (dog)” and the “state” is “meal”. The character string displayed in the upper right part of the terminal screen indicates the “state”. FIG. 7 (2) shows an example of character display when the “type of watching target” is “pet (dog)” and the “state” is “barking threatening (abnormal)”. The displayed character string indicates the “state”.

  Next, the operation concept of the watching system in the first embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. Further, it is possible to sequentially execute the operation according to the above-described program code transmitted via a transmission medium such as a network. The same applies to other embodiments described later. In addition to the recording medium, an operation peculiar to the present embodiment can be executed using a program / data supplied externally via a transmission medium.

FIG. 7 is a flowchart showing an outline of the entire operation that is started in response to a power-on operation by the power button 25 in the sensor device 2.
First, the CPU 21 of the sensor device 2 checks whether a registration instruction for registering an operation to be watched is received from the home server device 1 (step A1), or confirms the state of the watch target from the home server device 1 It is checked whether a request has been received (step A4), or whether a power-off operation has been performed with the power button 25 is checked (step A5).

  Now, when a power-off operation is performed (YES in step A5), the flow of FIG. 7 ends. However, when a registration instruction for registering an operation to be watched is received from the home server device 1 (YES in step A1). ), A predetermined amount of detection results (acceleration corresponding to X, Y, and Z axes) detected by the acceleration sensor 26A constituting the motion sensor 26, for example, detection results every 100 ms for one minute are received and acquired. Is temporarily stored in the storage unit 23 (step A2). And after performing the process (step A3) which transmits the detection result for this predetermined amount to the home server apparatus 1, it returns to above-mentioned step A1.

  When a confirmation request for confirming the state of the object to be watched is received from the home server device 1 (YES in step A4), detection for a predetermined amount detected by the acceleration sensor 26A and the geomagnetic sensor 26B constituting the motion sensor 26 As a result (acceleration and direction corresponding to X, Y, and Z axes), for example, a detection result (acceleration and direction) every 100 ms for one minute is acquired and temporarily stored in the storage unit 23 (step A6). And after performing the process (step A7) which transmits the detection result for this predetermined amount to the home server apparatus 1, it returns to above-mentioned step A1.

FIG. 8 is a flowchart showing a characteristic operation outline (registration process) of the present embodiment among the entire operations of the mobile terminal device 8, and a registration instruction for registering an operation to be watched is performed by a user operation. When it starts running.
First, when the CPU 81 of the mobile terminal device 8 receives a registration instruction by a user operation, the CPU 81 checks whether the registration instruction is an operation for instructing new registration (step B1), and may be an operation for instructing new registration. If so (YES in step B1), a new registration screen is displayed on the display unit 85 (step B2). FIG. 11A is a diagram illustrating a new registration screen. This new registration screen has input items IN1 to IN5 of “type of watching target”, “time zone”, “location”, “state”, and “character”, as well as input items IN1 to IN5. Corresponding to the selection button (triangle mark in the figure) and a transmission button BT for instructing to transmit the contents of the input items IN1 to IN5 to the home server device 1.

  When an input operation for inputting the type, place, time zone, state, and character to be watched is performed on the input items IN1 to IN5 in the new registration screen, an input process (step B3) corresponding to the input operation is performed. Thereafter, it is checked whether or not the transmission button BT has been operated (step B4), and the process returns to the above-described input processing (step B3) until the transmission button BT is operated. Now, when the send button BT is operated (YES in step B4), it is instructed that the watch target is newly registered, and the input result of each of the input items IN1 to IN4 is transmitted to the home server device 1 ( After performing step B5), the flow of FIG. 8 ends.

  On the other hand, when instructing the user to supplementally register the operation to be watched over, the user performs an operation to instruct the update of the registered contents. If this replenishment registration is instructed by a user operation as a registration instruction (NO in step B1), an already registered screen is displayed on the display unit 85 (step B6). FIG. 11B is a diagram illustrating an already registered screen, and a send button BT is provided on the already registered screen. Here, the user performs an operation of inputting data in the items of “type of watching target” and “state” in the registered screen in order to specify desired registered contents, and then the send button BT. To operate. In this case, the portable terminal device 8 performs input processing when “type of watching target” and “state” are input to the input items IN1 and IN4 in the registered screen (step B7), and then transmits When the button BT is operated (YES in step B8), the input data of the input items IN1 and IN4 in the already registered screen is transmitted to the home server device 1 together with an instruction to supplementarily register the watching target operation. (Step B9).

FIG. 9 is a flowchart showing a characteristic operation outline (registration process) of the present embodiment in the entire operation of the home server apparatus 1, and the execution is started by interruption every predetermined time. When the flow of FIG. 9 is exited, the flow returns to the main flow (not shown) of the overall operation.
First, the CPU 11 of the home server device 1 checks whether or not a registration instruction for registering an operation to be watched over is received from the mobile terminal device 8 via the home LAN 3 (step C1), and if the registration instruction is not received (step C1). If the registration instruction is received (YES in step C1), after performing the process of transmitting the registration instruction to the sensor device 2 (step C2), the registration instruction is It is checked whether it is a new registration instruction (step C3).

  When new registration is instructed (YES in step C3), a process (step C4) of receiving an input result (type of watch target, time zone, place, state, character) from the mobile terminal device 8 is performed. Thereafter, a new record including the input result is generated, and this generated record is watched and additionally registered (new registration) in the database WT (step C5). When a predetermined amount of acceleration is received from the sensor device 2 (step C6), the received predetermined amount of acceleration is averaged (step C7), and this averaged acceleration is used as an operation pattern in a corresponding record (generated record). Is newly registered in the “operation” item (step C8).

  On the other hand, if the registration instruction is an instruction for replenishment registration (NO in step C3), this input is performed after a process (step C9) for receiving the input result (the type and state of the watching target) from the mobile terminal device 8 is performed. The watching database WT is searched based on the result (step C10), and the corresponding record is designated as the record to be updated (step C11). When a predetermined amount of acceleration is received from the sensor device 2 (step C6), the received predetermined amount of acceleration is averaged (step C7), and this averaged acceleration is used as an operation pattern in a corresponding record (designated record). Are additionally registered in the item “operation” (step C8).

FIG. 10 is a flowchart showing a characteristic operation outline (state determination process) of the present embodiment in the entire operation of the home server apparatus 1, and the execution is started by interruption every predetermined time. When the flow of FIG. 10 is exited, the flow returns to the main flow (not shown) of the overall operation.
First, the CPU 11 of the home server device 1 checks whether or not a confirmation request for confirming the state to be watched over has been received from the terminal device (PC 6 or portable terminal device 8) via the Internet 5 (step D1), and a request for state confirmation. If NO is received (NO in step D1), the flow exits from the flow of FIG. 10, but when a request for status confirmation is received (YES in step D1), a command for requesting status confirmation is transmitted to the sensor device 2 (step S1). Step D2).

  When the home server device 1 receives and acquires a predetermined amount of detection results (acceleration and direction corresponding to the X, Y, and Z axes) from the sensor device 2 (step D3), the acceleration sensor 26A is included in the detection results. Based on each detection result, information obtained by averaging them is specified as the current operation (step D4). That is, information obtained by averaging the movements of the watching target for one minute is specified as the current action. Further, based on the detection results of the acceleration sensor 26A and the geomagnetic sensor 26B, the current place where the watching target is located is specified (steps D5 and D6).

  In other words, the location in the home is specified by determining in which direction and how far it has moved from the home starting point that has been set in advance. For each detection result of the detected acceleration sensor 26A and geomagnetic sensor 26B, a process of calculating the position of the watching target is performed (step D5), and information obtained by averaging the calculated positions is specified as the current location (step D6). In this case, the location is specified based on the direction and distance that the object to be watched for 1 minute has moved, but the location may be specified, for example, dining, bedroom, toilet, etc. It suffices if the location can be specified in units of rooms.

  When the operation and location to be watched are specified in this way, after performing processing (step D7) for obtaining the current time measured by the clock function, the watch database WT is based on the motion, location, and current time (time zone). Is searched (step D8), and the presence or absence is determined (step D9). If there is a corresponding record, that is, if it is determined normally (YES in step D9), “state” and “character” are read from the corresponding record (step D10). In this case, the CPU 11 first searches the watch database WT based on the location, selects each record having the corresponding “location”, and then selects an “operation” similar to the operation from the selected records. Select the record you have. In this case, a plurality of detection results (operation patterns) are stored in the “operation” of the watching database WT, and a record similar to any one of the operations is selected. Finally, a record having a “time zone” to which the current time belongs is selected from the selected records, and “state” and “character” are read from the record.

  After performing the process (step D11) for transmitting the read “state” and “character” to the requesting terminal device (PC 6 or mobile terminal device 8), the flow of FIG. 10 is exited. Hereinafter, the home server device 1 repeats the above-described operation every time it receives a request to check the state of the object to be watched over from the PC 6 or the mobile terminal device 8 via the Internet 5. The PC 6 and the mobile terminal device 8 display the received “state” and “character” on the terminal screen. In this case, if the watching target is a pet, for example, FIG. 5 (1), (2) The screen content is as shown in. On the other hand, if it is determined as “not applicable” as a result of searching the watching database WT (NO in step D9), an error message indicating that determination cannot be made, for example, “determination is impossible. After performing the process (step D12) of generating “Please” and transmitting it to the requesting terminal device (PC 6 or portable terminal device 8), the flow of FIG. 10 is exited.

  As described above, the home server device 1 configuring the watching system according to the first embodiment uses the detection result indicating the movement of the watching target detected by the sensor device 2 as the watching target operation pattern, and the mobile terminal device 8 Corresponding to the corresponding operation pattern by referring to the monitoring database WT based on the detection result detected by the sensor device 2 in the state of storing and registering in the monitoring database WT as the state of the input operation contents of the monitoring target Since the action to be watched is determined and notified, the movement of the watch target can be learned and the various states can be accurately notified regardless of the watch target. It becomes possible and rich in versatility and accuracy.

  The home server device 1 determines the state of the watch target in consideration of the time zone because the home server device 1 determines the watch target state based on the time zone corresponding to the current time in addition to the watch target operation. It is possible to determine the state more accurately.

  The home server device 1 keeps track of the pictures that are input from the portable terminal device 8 and stores them in the watch database WT and registers them. Since the notification is made at, it is possible to visually notify the state of the watching target in an easy-to-understand manner. In this case, since the watching target is expressed and the character expressing the state is displayed as a pictorial diagram showing the watching target, the state of the watching target can be notified more visually and easily.

  A plurality of detection results (motion patterns) detected by the sensor device 2 can be registered in the “motion” of the watch database WT, and when determining the state of the watch target, any one of the plurality of motion patterns can be registered. Since the determination is made according to whether it is applicable, the determination can be made more accurately.

  The home server device 1 determines the location to be watched based on the positional relationship from the starting point registered in advance for each location and the detection result of the motion sensor 26 (acceleration sensor 26A and geomagnetic sensor) acquired from the sensor device 2. Since the motion sensor 26 can be used to detect the location of the object to be watched roughly, the sensor device 2 can be effectively reduced in size, thickness, weight, and cost. It will be something.

  In the above-described first embodiment, the home server device 1 specifies the location of the watch target based on the detection results of the acceleration sensor 26A and the geomagnetic sensor 6B. It may be performed on the side. Further, in the home server device 1, the detection results for a predetermined amount are averaged to specify the operation and the location, but this averaging may also be performed on the sensor device 2 side. Furthermore, the averaging of detection results for a predetermined amount may be an arithmetic average, a maximum frequency, a median value, or the like.

  Further, in the first embodiment described above, the home server device 1 transmits the character expressing the state of the watch target in response to a request from the PC 6 or the mobile terminal device 8 side. You may make it transmit the character expressing the state of watching over with respect to the portable terminal device 8. FIG.

(Second Embodiment)
A second embodiment of the present invention will be described below with reference to FIGS.
In the first embodiment described above, data transmission / reception is performed between the home server device 1 and the sensor device 2 via the communication network, and the home server device 1 and the other PCs 6 and portable terminal devices 8 In this second embodiment, the present invention is applied to the mobile terminal device 8 as a monitoring device. Here, in both the embodiments, the same or the same names are denoted by the same reference numerals, the description thereof will be omitted, and the following description will focus on the features of the second embodiment. .

FIG. 12 is a flowchart illustrating a registration process that is started when a registration instruction for registering an operation to be watched is performed by a user operation, out of the entire operation of the mobile terminal device 8.
First, when the CPU 81 of the portable terminal device 8 receives a registration instruction by a user operation, the CPU 81 checks whether the registration instruction is an operation for instructing new registration (step E1), and may be an operation for instructing new registration. If this is the case (YES in step E1), a new registration screen is displayed on the display unit 85 (step E2). In this case, when an input operation for inputting the type, place, time zone, state, and character to be watched is performed, an input process corresponding to the input operation is performed (step E3), and a new record including the input result is generated. Then, this generated record is watched and additionally registered (newly registered) in the database WT (step E4). When a predetermined amount of acceleration is received from the sensor device 2 (step E5), the received predetermined amount of acceleration is averaged (step E6), and this averaged acceleration is used as an operation pattern in a corresponding record (generated record). Is newly registered in the “operation” item (step E7).

  On the other hand, when it is instructed to supplementally register the operation to be watched over (NO in step E1), the already registered screen is displayed on the display unit 85 (step E8). In this case, when an input operation for inputting the type and state of the watching target is performed, an input process corresponding to the input operation is performed (step E9), and the watching database WT is searched based on the input result (the type and state of the watching target). (Step E10), the corresponding record is designated as the record to be updated (Step E11). When a predetermined amount of acceleration is received from the sensor device 2 (step E5), the received predetermined amount of acceleration is averaged (step E6), and the averaged acceleration is used as an operation pattern in a corresponding record (designated record). Are additionally registered in the “operation” item (step E7).

FIG. 13 is a flowchart illustrating a state determination process that is started when a confirmation instruction for confirming a state to be watched is performed by a user operation, out of the overall operation of the mobile terminal device 8. Since it is the same as the flow of No. 10, the description thereof will be simply given.
First, when the CPU 81 of the portable terminal device 8 receives a state confirmation instruction from the portable terminal device 8, the CPU 81 transmits a state confirmation request command to the sensor device 2 (step F <b> 1). When a detection result (acceleration and direction corresponding to X, Y, and Z axes) is received and acquired (step F2), information obtained by averaging the detection results based on the detection results of the acceleration sensor 26A among the detection results. Is identified as the current operation (step F3).

  Based on the detection results of the acceleration sensor 26A and the geomagnetic sensor 26B, the current location where the watching target is located is specified (steps F4 and F5). At this time, the acceleration sensor 26A and the geomagnetic sensor 26B received from the sensor device 2 are specified. For each detection result, a process for calculating the position of the watching target is performed (step F4), and information obtained by averaging the calculated positions is specified as the current location (step F5). When the operation and location to be watched are specified in this manner, the processing (step F6) for obtaining the current time measured by the clock function is performed, and then the watch database WT is based on the motion, location, and current time (time zone). Is searched (step F7), and the presence or absence is determined (step F8).

  If there is a corresponding record (YES in step F8), “state” and “character” are read from the corresponding record (step F9). After performing the process (step F10) for displaying the read “state” and “character” on the display unit (terminal screen) 85, the flow of FIG. 13 is exited. On the other hand, as a result of searching the watching database WT, if it is determined that “not applicable” (NO in step F8), an error message indicating that determination cannot be made, for example, “determination is impossible. After performing the process (Step F12) for generating “Please” and displaying it on the display unit (terminal screen) 85, the flow of FIG.

  As described above, in the second embodiment, the mobile terminal device (monitoring device) 8 monitors the detection result indicating the motion of the monitoring target detected by the sensor device 2 as an operation pattern of the monitoring target, and the input operation of the monitoring target In the state where the contents are stored and registered in the watch database WT as the state, the watch database WT is referred to based on the detection result detected by the sensor device 2 and the state corresponding to the corresponding operation pattern is watched. Since it is judged and displayed as content, it is possible to learn the movement of the watching target, and it is possible to accurately notify the various states of any watching target. It will be rich in nature.

  Since the mobile terminal device 8 determines the state of the monitoring target based on the time zone corresponding to the current time in addition to the operation of the monitoring target, the state of the monitoring target is determined in consideration of the time zone. This makes it possible to determine the state more accurately.

  When the mobile terminal device 8 stores and registers the watch figure that represents the state of the watch target input from the mobile terminal device 8 in the watch database WT and determines the watch target state, the mobile terminal device 8 displays the state as a pictorial diagram. Since the notification is made, the state of the watching target can be notified visually and easily. In this case, since the watching target is expressed and the character expressing the state is displayed as a pictorial diagram showing the watching target, the state of the watching target can be notified more visually and easily.

  A plurality of detection results (motion patterns) detected by the sensor device 2 can be registered in the “motion” of the watch database WT, and when determining the state of the watch target, any one of the plurality of motion patterns can be registered. Since the determination is made according to whether it is applicable, the determination can be made more accurately.

  In the second embodiment described above, the mobile terminal device 8 specifies the location to be watched based on the detection result of the motion sensor 26 (acceleration sensor 26A and geomagnetic sensor). You may make it carry out by the sensor apparatus 2 side.

  In each of the above-described embodiments, a pet (dog) has been exemplified as an object to be watched at home. However, the present invention is not limited thereto, and may be a person such as an elderly person, or in a company such as a factory. If the worker is watched over, the safety of the worker can be easily confirmed without using a large-scale and expensive system.

  In each of the above-described embodiments, the location and operation of the monitoring target are specified based on the detection result of the motion sensor 26 (the acceleration sensor 26A and the geomagnetic sensor), but the image taken by the surveillance camera installed indoors By analyzing the above, the location and operation of the object to be watched may be specified. Further, the location to be watched over may be specified based on the current position (longitude / latitude information) from a GPS (Global Positioning System) unit (not shown).

  In each of the above-described embodiments, the “time zone” is input on the registration screen. However, based on the current time at the time of new registration, for example, a time zone such as morning, noon, night, or one hour unit is automatically set. It may be determined automatically.

  Further, in each of the above-described embodiments, the home LAN 3 is exemplified as a communication means between the home server device 1 and the sensor device 2, but the communication device is used in a communication range (several meters to several tens of meters) narrower than the wireless LAN. It may be a wireless network called WPAN (Wireless Personal Area Network).

  Further, the “apparatus” and “unit” shown in each of the above-described embodiments may be separated into a plurality of cases by function, and are not limited to a single case. In addition, each step described in the above-described flowchart is not limited to time-series processing, and a plurality of steps may be processed in parallel or separately.

The embodiment of the present invention has been described above. However, the present invention is not limited to this, and includes the invention described in the claims and the equivalent scope thereof.
Hereinafter, the invention described in the claims of the present application will be appended.
(Appendix)
(Claim 1)
The invention described in claim 1
A monitoring system for watching over a communication target via a communication network,
Sensor means for detecting the movement of the object to be watched;
An input means for inputting the operation content to be watched over;
An operation storage means for watching the detection result by the sensor means as an operation pattern to be watched; and an operation result for watching the input result by the input means, and storing the operation pattern and the state in association with each other;
A determination unit that refers to the operation storage unit based on a detection result by the sensor unit and determines a content corresponding to the corresponding operation pattern as a target operation content;
Notification means for notifying the content of the operation to be watched determined by the determination means;
It is the watching system characterized by having equipped.
(Claim 2)
The invention according to claim 2 is the monitoring system according to claim 1,
The operation storage means further stores a time zone when the watching target performs the operation,
The determination means determines the operation content to be watched by referring to the operation storage means based on the time zone in addition to the detection result by the sensor means,
This is a monitoring system characterized by the above.
(Claim 3)
The invention according to claim 3 is the monitoring system according to claim 1 or 2,
The input means further inputs a picture representing the operation content to be watched over,
The operation storage means further stores the picture inputted by the input means,
The notifying means notifies the picture stored in the action storing means in correspondence with the state indicating the action content of the watching target determined by the determining means;
This is a monitoring system characterized by the above.
(Claim 4)
The invention according to claim 4 is the monitoring system according to any one of claims 1 to 3,
The operation storage means stores each detection result detected multiple times by the sensor means for each state as a plurality of operation patterns,
If the result of detection by the sensor means corresponds to one of a plurality of action patterns stored for each of the states in the action storage means, the determination means monitors the state corresponding to the action pattern. Judge as operation content,
This is a monitoring system characterized by the above.
(Claim 5)
The invention according to claim 5 is the monitoring system according to any one of claims 1 to 4,
The monitoring system includes a sensor device attached to a monitoring target, a monitoring management device connected to the sensor device via the communication network, and a portable device connected to the monitoring management device via a communication network. A terminal device,
The sensor device includes:
Equipped with sensor means to detect the movement of the object to be watched over,
The portable terminal device
It has an input means to input the operation content to be watched over,
The monitoring management device is:
An operation storage means for storing the operation pattern and the state in association with each other as an operation target pattern to watch over the detection result by the sensor means,
A determination unit that refers to the operation storage unit based on a detection result by the sensor unit and determines a content corresponding to the corresponding operation pattern as a target operation content;
Notification means for notifying the content of the operation to be watched determined by the determination means;
Comprising
This is a monitoring system characterized by the above.
(Claim 6)
The invention described in claim 6
A device for watching over the object
An acquisition means for acquiring the detection result from the sensor means for detecting the operation to be watched over;
An input means for inputting the operation content to be watched over;
An operation storage unit that monitors the detection result of the sensor unit acquired by the acquisition unit and sets the operation pattern as a target operation pattern; ,
A determination unit that refers to the operation storage unit based on a detection result by the sensor unit and determines a content corresponding to the corresponding operation pattern as a target operation content;
Output means for outputting the operation content of the watching target determined by the determination means;
It is the monitoring device characterized by comprising.
(Claim 7)
The invention according to claim 7 is the monitoring device according to claim 6,
The operation storage means further stores a time zone when the watching target performs the operation,
The determination means determines the operation content to be watched by referring to the operation storage means based on the time zone in addition to the detection result by the sensor means,
This is a monitoring device characterized by the above.
(Claim 8)
The invention according to claim 8 is the monitoring device according to any one of claims 6 to 8,
The operation storage means stores each detection result detected multiple times by the sensor means for each state as a plurality of operation patterns,
If the result of detection by the sensor means corresponds to one of a plurality of action patterns stored for each of the states in the action storage means, the determination means monitors the state corresponding to the action pattern. Judge as operation content,
This is a monitoring device characterized by the above.
(Claim 9)
The invention according to claim 9 is the monitoring device according to any one of claims 6 to 8,
The operation storage unit stores each detection result detected by the sensor unit a plurality of times for each state as a plurality of operation patterns, and the determination unit stores the detection result by the sensor unit in the operation storage unit. If it corresponds to one of a plurality of operation patterns stored for each state, the state corresponding to the operation pattern is observed and determined as the operation content to be targeted.
This is a monitoring device characterized by the above.
(Claim 10)
The invention according to claim 10 is:
Against the computer,
A function of acquiring the detection result from the sensor means for detecting the operation to be watched over,
A function to input the operation details to be watched over,
Detection by the sensor means is an action storage means for monitoring the acquired detection result of the sensor means as an action pattern to be watched and storing the action pattern and the state in association with each other as the state to be watched by the input result. A function to refer to based on the result, to watch the state corresponding to the corresponding operation pattern and determine the operation content of the target,
A function of outputting the operation content of the determined watching target;
It is a program for realizing.

1 Home server device 2 Sensor device 3 Home LAN
4 Access pointer 5 Internet 6 Other PC
7 Wireless communication network 8 Mobile terminal device 11, 21, 81 CPU
13, 23, 83 Storage unit 14 Wide area communication unit 14
15 LAN Communication Unit 17 Operation Unit 26 Motion Sensor 26A Acceleration Sensor 26B Geomagnetic Sensor WT Watch Database

Claims (5)

First acquisition means for acquiring the operation content of the detection target ;
Second acquisition means for acquiring the current location and the current time of the detection target;
Wherein the operation type classifying the plurality of operations in the detection target, by referring to the storage means for storing operation and the time zone of the location and the detection target there of the detection target, a plurality of state information determined by the first A discriminating unit for discriminating current state information of the detection target determined by an operation type to which the operation content acquired by the acquiring unit corresponds, and a current location and a time zone of the current time acquired by the second acquiring unit;
Display setting means capable of displaying and setting the current state information of the detection target determined by the determination means with a different character image for each type of detection target;
Terminal apparatus characterized by comprising a. The determination means determines pet status information as the detection target status information.
The terminal device according to claim 1. The determination means determines current state information corresponding to the type of the detection target;
The terminal device according to claim 1, wherein the terminal device is a terminal device. A first acquisition step of acquiring the operation content of the detection target;
A second acquisition step of acquiring the current location and the current time of the detection target;
By referring to a storage unit that stores a plurality of state information determined by an operation type that classifies a plurality of operations in the detection target, a location where the detection target exists, and an operation time zone of the detection target, the first A determination step of determining current state information of the detection target determined by the operation type to which the operation content acquired in the acquisition step corresponds, and the current location and time zone of the current time acquired in the second acquisition step;
A display step of displaying the current state information of the detection target determined in the determination step with a character image selected from a plurality of character images corresponding to the type of the detection target;
An operation state display method characterized by comprising: Computer
First acquisition means for acquiring the operation content of the detection target;
Second acquisition means for acquiring the current location and the current time of the detection target;
By referring to a storage unit that stores a plurality of state information determined by an operation type that classifies a plurality of operations in the detection target, a location where the detection target exists, and an operation time zone of the detection target, the first A discriminating unit for discriminating current state information of the detection target determined by an operation type to which the operation content acquired by the acquiring unit corresponds, and a current location and a time zone of the current time acquired by the second acquiring unit;
Display control means for displaying the current state information of the detection target determined by the determination means in a character image selected in correspondence with the type of the detection target from among a plurality of character images;
A program characterized by functioning as

Images