JP2010191697A - System and method of recollection through search of previous record - Google Patents

Abstract

A recollection system through search of past records according to the present invention includes a database device storing automatic or passive records related to past events and things of an individual, and a search requesting a search in response to a user request. A computing device, a server computing device that searches a database device through a search request from the search computing device, and extracts result data corresponding to the search request, and a multisensory element that extracts the result data extracted from the server computing device And an expression computing device for expressing in an integrated manner.
As described above, the present invention retrieves past individual records in various ways and reproduces the corresponding records in a similar manner through a multisensory expression device, thereby further improving the effect for past recollections. The effect of enhancing an individual's past memory by being able to serve as a mediator is obtained.
[Selection] Figure 1

Description

  The present invention searches for automatic or passive records concerning past incidents and things based on keywords or categories, and expresses the results in various media such as visual, auditory, tactile, and olfactory to reflect the past of the individual. The present invention relates to a recollection system and method through retrieval of past records used as a mediator.

  People usually recollect the past more easily through media related to past events and things such as photographs, music, and smells. For example, things used in the past, music, materials in various albums, and the like serve as mediators for recollections of specific memories in the past.

  A database of the past changes in the mind of the individual, and the mental health / dementia prevention by the individual himself / herself can be performed, and this database can be used by the doctor / caregiver to treat the patient (see, for example, Patent Document 1) ).

  In recent years, with the development of technology, it is easy to collect personal record data, so this can be used more effectively by applying it as a reminiscence method to remind the early dementia patients and elderly people with weak memory ability Research is ongoing.

  In recent years, the present digital record in the past can be easily secured by recording the present through various digital devices such as cameras and camcorders or life logging devices, and managing it as personal data.

JP 2002-007560 A

  Accordingly, the present invention has been made in view of the above circumstances, and its purpose is to extract information necessary for various searches from automatic or passive records regarding past cases and things, and to use the appropriate medium. It is to provide a personalized mediator that can make an individual reminisce about the past.

  According to the first aspect of the present invention for achieving the above object, a recollection system through retrieval of past records includes a database device in which automatic or passive records relating to individual past events and things are stored. A search computing device that requests a search in response to a user request, a server computing device that searches the database device through a search request of the search computing device, and extracts result data corresponding to the search request; An expression computing device for expressing the result data extracted from the server computing device in a multisensory element.

  According to a second aspect of the present invention, a construction step of collecting data of past records of a treatment subject and constructing a personal database device of the treatment subject, and a medium for the past recollection of the treatment subject A search requesting step for requesting a clue that can be used as a body to a server computing device through a search computing device, and the server computing device searches the database device of the treatment subject in response to the search request, A search step for searching result data used as an intermediary for recollection, a result list providing step for providing the searched result data in a list format through a search computing device, and the server computing device for the result Express past record data corresponding to one past record selected from the list. And a service step of the service provided to the computing device.

  According to the present invention, a past record of only an individual is retrieved in various ways, and the corresponding record is reproduced in a similar manner through a multisensory expression device, thereby providing a more effective medium for past recollections. It is possible to increase the memory of the individual in the past so that the role of the person can be fulfilled.

  By applying the present invention to the reminiscence therapy, it can be effectively used to improve symptoms of patients with dementia.

FIG. 2 is a block diagram illustrating a recollection system through retrieval of past records according to a preferred embodiment of the present invention. It is a flowchart which shows the procedure of the application of the reminiscence therapy to which this invention was applied.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In a preferred embodiment of the present invention, automatic or passive records relating to past incidents and things are searched based on keywords or categories, and the results are expressed by various media such as visual, auditory, tactile, and olfactory treatments. A recollection system and method that enables it to become a mediator that reminds the past of the subject will be described.

  FIG. 1 is a block diagram illustrating a recollection system through retrieval of past records according to a preferred embodiment of the present invention, which includes a database device 100, a server computing device 200, a retrieval computing device 300, and an expression computing device 400. Including.

  The database device 100 includes a media database 101 storing media data representing past cases and things by individual using visual, auditory, tactile, and olfactory senses, individual data, and information on unit cases and individual objects. For example, name, meaning, representative word, etc., and each data stored in each database 101, 102 is time, place, person, activity for convenience of search , Including values for variables corresponding to the bodily sensation information, each variable is categorized so as to be classified and managed by the DB control unit 103.

  The server computing device 200 includes a DB linkage / query unit 201 and a streaming server unit 202. The DB linkage / query unit 201 receives a request for a question from the search computing device 300, searches for necessary information from each of the databases 101 and 102 of the database device 100, and provides the search result to the search computing device 300. To do. In some cases, a streaming service can be requested like a video, but in such a case, the streaming client is responsible for the role of the streaming server in the streaming server unit 202, and the streaming client is the search computing device 300 or the expression computing device 400. It becomes.

  The search computing device 300 provides a user interface that allows a user to search past records and supports various search methods, and includes a user interface unit 301, a search unit 302, and an expression control unit 303. The user interface unit 301 allows not only simple keyword-based search but also category-based search. Here, categories are classified into time, place, person, activity, and bodily sensation information. By providing the user with the number of data to be generated, the distribution of data can be grasped. In addition, keywords can be searched within a category, and a search for a large number of keywords, a search for a large number of categories, and a cross search between a category search and a keyword search are supported. The search unit 302 transmits a combination of search formulas in conjunction with the server computing device 200, and provides the results in a manner that can be easily expressed by the user interface unit 301.

  Further, the search computing device 300 provides a search result list as a representative word and a representative image through the user interface unit 301 and the search unit 302, and the incident is performed for a specific search result selected from the search result list by the user 500. Alternatively, the data related to the thing is retrieved again, and the result is transmitted to the expression computing device 400. The expression control unit 303 of the search computing device 300 provides control data for controlling the data expressed through the expression computing device 400 with command words such as start and stop. That is, the control data includes data start, temporary stop, stop command signals, individual reproduction selection for visual, auditory, tactile, and olfactory data, and individual intensity selection command signals for visual, auditory, tactile, and olfactory data. Etc.

  The expression computing device 400 includes a device management unit 401, a fusion / synchronization control unit 402, and a streaming client unit 403. The streaming client unit 403 receives expression data from the server computing device 200, and the fusion / synchronization control unit 402 receives control data from the search computing device 300. Here, the expression data is data related to a corresponding case or thing with respect to a specific search result selected by the user 500 from the search result list, and data indicating visual, auditory, tactile, and olfactory senses and their fusion expressions. And metadata about synchronization. In addition, the expression computing device 400 functions as a streaming client. In the device management unit 401, individual devices for multisensory expression, such as a visual device 600, a hearing device 700, an olfactory device 800, a tactile device 900, and the like. It also performs functions to control and manage operations.

  The database device 100, the server computing device 200, the search computing device 300, and the expression computing device 400 are arranged to transmit and receive data in conjunction with each other via a wired / wireless network.

  The system of the present invention having the above-described configuration will be described as follows based on an application scenario applied to a reminiscence therapy for an early dementia patient.

  First, a database is constructed in which basic information about the treatment subject and the past of the treatment subject are recorded. For the past records, a separate logging device is worn to continuously collect records related to incidents or things that occur in daily life, or when a specific event occurs, the user desires to record, a camera, a camcorder Data is collected using a logging device such as Records about the past that have passed in the case of elderly people can be obtained from albums, photos, etc., and converted into digital data for collection. Since the collected data is in a state where the lower level is not refined, the collected data is divided into past record units using automatic or passive editing tools, and only meaningful past record data is extracted. To do. Then, metadata including words, images, category information based on the search, and the like are generated from the past record data for subsequent search and use of data.

  Through such a process, the media database 101 and the meta database 102 relating to the treatment subject are prepared, and the basic information relating to the treatment subject is stored together to construct the database device 100.

  When such a past record data collection process is completed, a reminiscence treatment is performed on the treatment subject, and the process will be described with reference to FIG.

  FIG. 2 is a flowchart showing a procedure of application of reminiscence therapy to which the present invention is applied. As shown in FIG. 2, when a treatment subject, for example, a patient with dementia appears, the user 500, that is, a user in charge of the role of the therapist, searches for information on the treatment subject through the search computing device 300 (for example, A search for a profile of the treatment subject is requested (S200). That is, a definition about data to be requested is made through the user interface unit 301 and the search unit 302 of the search computing device 300, and the database device 100 is linked through the DB link / query unit 201 and the DB control unit 103 to ask an appropriate question. After collecting necessary data by the combination, the result is provided to the user 500.

  Here, in the case of application of reminiscence therapy, the user interface unit 301 provides an interface and information for a person who plays an auxiliary role such as a family who is not a patient with dementia, a healer, or the like, and can proceed with the stage according to reminiscence therapy. .

  Thereafter, the user 500 searches the search computing device 300 for clues that can be used as a mediator for the past recollection of the treatment subject. In this process, a search method related to past records by category and keyword classification is provided through the user interface unit 301 of FIG. 1, through which a search keyword is input and a category is selected (S202). The category is composed of time, place, person, activity, and experience information. For example, the user 500 can search using the keyword “wedding” in the activity category and the keyword “snow, cold” in the experience category.

  After that, the search unit 302 combines the search keyword of the user 500 into a query formula suitable for the query, and then transmits the query to the DB link / query unit 201, so that the DB link / query unit 201 receives information from the database device 100 through the DB control unit 103. The past record data for the treatment subject is searched (S204). The search result, that is, the search result list is provided to the search unit (302) (S206). At this time, the DB linkage / query unit 201 can perform an inference and integration process for data by adding a cognitive and artificial intelligence algorithm as necessary. Further, the database apparatus 100 may exist as a separate database apparatus when there are a large number of treatment subjects.

  At this time, the search result list is configured as a list including representative images and representative words, and is provided to the user 500 through the search computing device 300.

  Thereafter, when the user 500 selects a desired past record from the result list (S208), the search unit 302 requests the server computing device 200 to search for the entire data related to the selected past record. The DB link / query unit 201 receives the entire data from the database device 100 based on the request for the entire data search related to the selected past record (S210).

  The server computing device 200 prepares to provide the entire data provided from the database device 100 to the client through the streaming server unit 202. When the user 500 requests the representation of the data of the corresponding past record, the representation control unit 303 transmits the type of media to be controlled and the control command to the fusion / synchronization control unit 402 of the representation computing device 400 in response to the request. Then, the past recording data is received by the streaming method in conjunction with the streaming server unit 202 through the streaming client unit 403 (S212).

  The fusion / synchronization control unit 402 responds to the operations of the visual, auditory, tactile, and olfactory devices 600, 700, 800, and 900, which are multi-sensory devices, in response to a control command received from the expression control unit 303 for past record data. Then, control is performed to synchronize with the fused expression, and the device management unit 401 is instructed to perform individual operations of the multisensory device. Therefore, the device management unit 401 individually controls and operates the visual device 600, the hearing device 700, the tactile device 800, and the olfactory device 900 (S214).

  Through this process, clues that serve as mediators of recollection are expressed to the subject of treatment, and the therapist performs such a process partly and repeatedly in accordance with the flow of treatment.

  According to a preferred embodiment of the present invention, automatic or passive records relating to past incidents and things are searched based on keywords or categories, and the results are expressed in various media such as visual, auditory, tactile, and taste. Thus, the treatment subject can become a mediator that recalls the past.

  Although the present invention has been described so far as limited to the embodiments of the present invention, it is obvious that the technology of the present invention can be easily modified by those skilled in the art. It can be said that such modified embodiments are included in the technical idea described in the claims of the present invention.

100 database device 200 server computing device 300 search computing device 400 expression computing device 500 user 600 visual device 700 hearing device 800 olfactory device 900 tactile device

Claims (11)

A database device that stores automatic or passive records of individual past incidents and things;
A search computing device that requests a search in response to a user request;
A server computing device that searches the database device through a search request of the search computing device and extracts result data corresponding to the search request;
A recollection system through retrieval of past records, comprising: an expression computing device for expressing the result data extracted from the server computing device in a multisensory element.   The database device includes media data and its metadata representing records of past cases and things of the individual expressed by visual, auditory, tactile, and olfactory senses, and each data includes time, place, person, activity, and bodily sensation information. The recollection system through retrieval of past records according to claim 1, comprising values for corresponding variables. The server computing device provides the search result data converted according to a format required by the search computing device, provides a DB linkage / query unit that performs a function of inferring and combining the result data;
The search server according to claim 1, further comprising a streaming server unit that provides the result data streaming service to the expression computing device when the result data streaming service is requested. Recollection system. The search computing device includes:
A user interface unit that provides an interface for searching past records of the individual based on keywords or categories;
The retrieval control unit according to claim 1, further comprising: a representation control unit that provides the representation computing device with a control command for controlling the result data provided to the representation computing device. Recollection system. The expression computing device comprises:
A device management unit connected to an individual sensory device and controlling and operating the individual sensory device;
A streaming client unit that receives the result data from the server computing device;
5. The past synchronization control unit according to claim 4, further comprising: a fusion synchronization control unit configured to control the individual sensory device to be synchronized with the fusion expression based on a control command of the search computer control device. Reminiscence system through search of records. A construction step of collecting data of past records of the treatment subject to construct a personal database device of the treatment subject;
A search requesting step of requesting the server computing device through the search computing device for a clue that can be used as a mediator for the past recollection of the treatment subject;
In the server computing device, a search step of searching the database device of the treatment subject in response to the search request and searching result data of past records used as a medium for past recollection;
A result list providing step of providing the searched result data in a list form through a search computing device;
A recollection method through retrieval of past records, including: a service stage in which the server computing device provides and services data of past records corresponding to one past record selected from the result list to the expression computing device.   The recollection method according to claim 6, wherein the search is requested based on a keyword base and a category of time, place, person, activity, and bodily sensation information. The recollection method is:
Providing the search computing device with a control command for controlling a representation scheme for the selected past record data to the representation computing device;
An expression step of expressing data of past records provided from the server computing device by controlling the operation of an individual sensory device linked with the expression computing device based on the control command in the expression computing device. The method of recollecting through retrieval of past records according to claim 6, further comprising:   The control command is a control signal for starting, temporarily stopping, and stopping the data representation of the past record, and a control signal for expressing the past record data in sensory data and adjusting the expression strength of the sensory data. 9. A recollection method through retrieval of past records according to claim 8.   The past record data may be expressed by multi-sensory fusion by synchronizing visual, auditory, tactile and olfactory expression devices expressing the sensory data. Recollection method.   The recollection method according to claim 6, wherein the retrieved result data includes a representative image and a representative word.

Images