JP2017012339A - Cognitive function observation system and cognitive function observation method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a system and a method for cognitive function observation which allow a subject to easily observe a cognitive function while enjoying listening music.SOLUTION: A cognitive function observation system 10 is formed of a panel device 20 and a device body 30. The panel device 20 comprises sensors SA-SI for detecting the fact that buttons 24A-24I are pressed by a user. A routine setting program 44 of the device body 30 sets a routine so that a tone row of specific music is reproduced by repeatedly touching selected one or more buttons in a prescribed order. Then, when the routine is presented to the user by a routine presentation program 46, and the user stores and executes the presented routine, a sound output program 50 refers to a routine table, and outputs a sound corresponding to the pressed button. By repeating the steps, the tone row of the specific music is reproduced and information related to an execution state of the routine is stored as log data 68.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a system and method for examining and observing cognitive functions, and more specifically to a cognitive function observing system and a cognitive function observing method for observing cognitive functions while enjoying music.

  Since early detection and treatment are important for cognitive dysfunction such as dementia, various testing methods for early detection have been developed. Among them, for example, MMSE (Mini-Mental State Test) is a comprehensive cognitive function test mainly used to measure memory, computation, language, and orientation, and is widely used worldwide. It is. However, the MMSE evaluation test, for example, repeats the question “What is the date of the month?”, And there are many subjects who are not only enjoyable but feel painful and tend not to take the test. . For this reason, it is difficult to repeat it on a daily basis, and it is not suitable for continuous examination and observation of cognitive function. In addition, since the test-type cognitive function test requires an examiner, human cost is also required.

  On the other hand, there are a great many people who like music, and the following Patent Document 1 proposes an inspection device that uses music to check for dementia and forgotten items and determine their level. The apparatus of Patent Document 1 includes a storage unit that stores examination questions related to music, a voice output unit that outputs music, a display unit that displays an examination question, and a subject that answers the examination question. And an examination processing means for judging the symptom level of the subject's dementia or forgetfulness from the inputted answer.

JP 2010-178920 A

  However, in the background art described in Patent Document 1, it is necessary for the examinee to see and confirm characters and pictures displayed on the inspection apparatus, and to further perform an operation such as inputting an answer using the input device. Therefore, there is a problem that it is difficult for a person who is weak in visual acuity or a person who is not good at performing an operation using the input means. Therefore, if a simpler system using music can be introduced for the examination and observation of cognitive function, the mental burden on the subject can be reduced and repeated on a daily basis, which is convenient for data collection.

  The present invention focuses on the above points, and a cognitive function observation system and cognition that allows a subject to easily and repeatedly conduct examination and observation of cognitive functions on a daily basis while enjoying music. The purpose is to provide a function observation method.

  The cognitive function observation system of the present invention is a cognitive function observation system that reproduces a sound sequence that is the pitch and order of sounds constituting a music piece by executing a predetermined routine by a user, and is used for inspection and observation of the cognitive function. A plurality of objects touched by the user, detection means for detecting that the user has touched the plurality of objects, and one or more objects selected from the plurality of objects, in a predetermined order The routine is set so that the sound sequence of a specific musical piece is reproduced by repeatedly touching in step, and the routine setting means for generating a routine table and the routine set by the routine setting means are presented to the user. A routine presenting means, and the user sets a predetermined object according to the routine presented by the routine presenting means. An output instructing unit for instructing the output unit to output the corresponding sound when touched, and a log acquisition unit for acquiring data on the execution status of the routine by the user. Characteristic cognitive function observation system.

  One of the main forms includes control means for controlling each of the means and determining whether or not a predetermined routine has been achieved by the user, and the control means includes the routine setting means, When a routine of a plurality of stages with different difficulty levels is set, the routine presentation means is instructed to present to the user from a routine with a lower difficulty level, and it is determined that the user has achieved the presented routine. When instructing the routine presenting means to present a routine that is one step higher in difficulty than the most recently executed routine, and when the user determines that the presented routine has been achieved, After the data is acquired by the log acquisition means, the execution of each means is stopped, and the examination / observation of the cognitive function is terminated.

  In another form, the routine setting means divides the melody of the music into one sound that constitutes the music, and each contact operation of the divided sound to a predetermined object by a user constituting the routine It is characterized by assigning to. In still another embodiment, the output means outputs a sound with a length corresponding to a timing when the detection means detects a contact by the user and a time when the contact is detected. Still another embodiment is characterized in that guide means for outputting a guide sound according to the tempo of the music is provided. Yet another embodiment is characterized by comprising a communication means for exchanging data with other terminals via a network.

  The cognitive function confirmation method of the present invention is a cognitive function inspection / observation method using a plurality of objects that can be contacted by a user. One or more objects selected from the plurality of objects are arranged in a predetermined order. Step 1 for generating a routine table by setting a routine so that a sequence of sounds that are the pitch and order of sound constituting a specific musical piece is reproduced by repeated contact, and presenting the set routine to the user Step 2 to perform, Step 3 to refer to the routine table when the user touches a predetermined object according to the routine presented in Step 2, and output a corresponding sound, and the execution status of the routine by the user And obtaining data related to step 4.

  One of the main forms is that in Step 1, a routine of a plurality of stages having different levels of difficulty is set. In Step 2, a routine having a low level of difficulty is presented to the user, and in Step 3, the routine is presented. Step 5 for determining whether or not the user has achieved the routine, and if it is determined in Step 5 that the routine has been achieved, the routine returns to Step 2 and is one step more difficult than the routine presented most recently. The routine is presented to the user, the steps 3 and 4 are repeated, and the cognitive function is obtained after acquiring the data on the execution status of the routine except when it is determined that the routine is achieved in the step 5. This is characterized in that the inspection / observation is terminated. Another aspect is characterized in that it includes Steps 6 and 6 for transmitting and receiving the data acquired in Step 4 between terminals connectable via a network. The above and other objects, features and advantages of the present invention will become apparent from the following detailed description and the accompanying drawings.

  According to the present invention, a plurality of objects that can be contacted by a user are used, and one or more objects selected from the plurality of objects are repeatedly contacted in a predetermined order to reproduce a sound string of a specific music piece. The routine is set to generate a routine table, and the set routine is presented to the user. Then, when the user touches a predetermined object according to the presented routine, the corresponding sound is output by referring to the routine table, and log data relating to the execution status of the routine by the user is acquired. This becomes a “play” of the melody by performing a specific routine. For this reason, a user's mental burden is few and it can test | inspect and observe a cognitive function repeatedly on a daily basis. In addition, by observing the acquired log data over time, it is possible to grasp changes in cognitive function over time. Moreover, since it can be carried out by a user (subject) alone, the human cost can be reduced.

It is a block diagram which shows the whole structure of the cognitive function observation system of Example 1 of this invention. It is a figure which shows the said Example 1, (A) is a figure which shows an example of the sound string data of a music, (B) is a figure which shows an example of the mode of presentation of the routine to a user. It is a flowchart which shows the outline | summary of the cognitive function observation by the said Example 1. FIG. It is a figure which shows the routine table of the several levels of the said Example 1. FIG. It is a figure which shows Example 2 of this invention. It is a figure which shows Example 3 of this invention. It is a figure which shows the other Example of this invention.

  Hereinafter, the best mode for carrying out the present invention will be described in detail based on examples.

  First, Embodiment 1 of the present invention will be described with reference to FIGS. FIG. 1 is a block diagram showing the overall configuration of the cognitive function observation system of the present embodiment. FIG. 2A is a diagram illustrating an example of the sound string data of a music piece, and FIG. 2B is a diagram illustrating an example of a routine presented to the user. FIG. 3 is a flowchart showing an overview of cognitive function observation using the system of the present embodiment. FIG. 4 is a diagram illustrating an example of a routine table having a plurality of levels according to this embodiment.

  <Summary> ... The present invention reproduces a musical tone string (pitch and order of sounds constituting a musical piece) by executing a predetermined routine by the user (subject), thereby checking the user's cognitive function. In addition to performing observation (hereinafter referred to as “observation” including examination), log data relating to routine execution status is acquired, and the log data is acquired periodically (for example, daily, weekly, etc.). Thus, it is possible to grasp a change with time of the cognitive function of the user. In the present invention, a plurality of objects that can be contacted by the user are used, and a sound string of a specific musical piece is reproduced by repeatedly contacting one or more objects selected from the plurality of objects in a predetermined order. The routine is set as described above, and a routine table is generated. The “routine” in this case is a procedure of an operation of touching which object in which order, and the “routine table” stores a specific music piece for each of a plurality of contact operations included in the routine. It shows which sound of each of the constituent sounds is assigned. Such a routine may be set automatically by the system or may be set by the user. The routine may be determined in advance or may be randomly generated.

  Then, the set routine is presented to the user, the routine presented by the user is stored, and the routine is executed accordingly. Presenting the routine to the user includes a method of changing or lighting the display of the object according to the routine. In addition, guidance may be given by voice. As long as the object can be touched by the user, the object may be a three-dimensional object such as a button or a flat button displayed on the touch panel. When the user memorizes the presented routine and touches a predetermined object according to the routine, the routine table is referred to, and a corresponding sound is output according to the order of the touching operation. By repeating this, the sound sequence of a specific music piece is reproduced. Note that only the pitch of each sound constituting the melody of the music is assigned to the routine table, and no sound value is set. Therefore, the user can “play” the melody by adjusting the timing and length of touching the object.

  The routine as described above is periodically executed, and data relating to the execution status of the routine is acquired as log data. The execution result of the routine has a correlation with the result of the existing cognitive function test, and the corresponding cognitive function can be roughly grasped from the level and the achievement level of the routine. The routine is prepared with a plurality of levels having different levels of difficulty, presents the simplest routine, and presents and executes a routine with a high level of difficulty if the user can execute it without making a mistake. Repeat this step to present and execute a routine that is gradually more difficult. If the user makes a mistake during the execution of a routine of a certain level, the test ends at that point, and the level of the routine is recorded as log data together with the date of execution. By observing such log data over time, changes in cognitive function over time can be grasped.

  <Whole structure> ... Next, the whole structure of the cognitive function observation system of a present Example is demonstrated. As shown in FIG. 1, the cognitive function monitoring system 10 according to the present embodiment includes a plurality (9 in the illustrated example) of planar buttons 24 </ b> A to 24 </ b> I displayed on a monitor 22 of a panel device 20 such as a tablet. Used as an object that the user contacts. Various functions of this system are provided in a device main body 30 different from the panel device 20. Note that, as in the embodiments described later, the panel device 22 and the device main body 30 may be configured as a single device using a tablet terminal.

  On the monitor 22 of the panel device 20, as shown in FIG. 1, a total of nine objects, that is, buttons 24A to 24I are displayed in three vertical and horizontal directions. An operation detection unit 26 having sensors SA to SI for detecting that the user has touched the buttons 24 </ b> A to 24 </ b> I is provided inside the panel device 20. In addition, the panel device 20 is provided with an audio output unit 28 that outputs sound in response to an output instruction from the device main body 30 described later. The sound output may be performed on the apparatus main body 30 side, or may be performed on both the panel device 20 and the apparatus main body 30.

  The apparatus main body 30 includes a CPU 32, a communication control unit 34, an output unit 36, a program memory 40, a data memory 60, a USB port 70, and the like. The communication control unit 34 is connected to a network such as the Internet 80 and transmits / receives data to / from other terminals 82, the server 84, and the like. The output unit 36 is a speaker, and a sound is reproduced in accordance with the execution of the routine. The output unit 36 is provided with a metronome 36A. The metronome 36 </ b> A makes a sound at regular intervals so that the user can touch the buttons 24 </ b> A to 24 </ b> I in accordance with the tempo of the song. For example, a click sound without a pitch is output. . The USB port 70 is used for inserting a USB memory 72 for acquiring sound string data of music, comparison data related to a recognition function, and the like from the outside. A card slot or the like may be provided instead of the port 70. The data memory 60 stores sound string data 62, a table database 64, a music database 66, log data 68, and the like. The data in the data memory 60 will be described together with the functions of the following programs. Note that the sound value data 63 in the data memory 60 will be described in Example 3 described later.

  The program memory 40 is provided with a control program 42, a routine setting program 44, a routine presentation program 46, a sound string data acquisition program 48, a sound output program 50, and a log acquisition program 52. The control program 42 controls the execution of each program. The routine setting program 44 sets a routine so that a sound string of a specific music piece is reproduced when a user repeatedly touches one or more objects selected from a plurality of objects in a predetermined order. A table is generated. Hereinafter, an example of routine setting will be described with a specific example.

  FIG. 2A shows a part of the score of “Hometown” selected as a specific music piece and the sound string data 62 corresponding to the score. The sound string data 62 is obtained by extracting only the part related to the sound string from the music database 66 of the data memory 60. The “order” shown in FIG. 4A means the arrangement order of the sounds constituting the music, and the “sound string” indicates the change in pitch. For example, order 1 is pitch C, order 2 is pitch C,... Order 9 is pitch F, order 10 is pitch G, and so on.

  The routine setting program 44 sets a routine so that the sound string of the song “Hometown” is reproduced when the user touches a predetermined button in a predetermined order. FIG. 4 (A) shows an example in which the user sets as a routine that the user only presses one of the plurality of buttons 24A to 24I (for example, button 24 at position PE). 4A to 4C, the positions of the plurality of buttons 24 on the monitor 22 are indicated by PA to PI, and the button 24 at the position PA corresponds to the button 24A shown in FIG. To do. The same applies to the other buttons 24B to 24I.

  As described above, in the case where “the button 24 at position PE is repeatedly pressed” is the content of the routine, the routine table T1 is as shown in FIG. A routine and a position are added to the sound string data 62 shown in FIG. 2A, and a button assigned with “1” by “1 → 1 → 1 →... → 1” of “routine”. It has been shown that it repeatedly touches. Since the position of the button to be pressed may change depending on the setting of the routine, the position of the button 24 on which “1” is displayed is specified by “PE” of “Position”. In this case, it is a routine to repeatedly press one button.

  Since the routine shown in FIG. 4A is a single operation, it is easy to execute the routine (for example, “level 1”) unless the buttons are misplaced. Therefore, in this embodiment, a plurality of routines having different levels of difficulty are set, and a routine table is generated for each level of routine. FIG. 4B shows a routine table T2 of a routine that repeats two operations (for example, a “level 2” routine). In the example of FIG. 4B, the “routine” is “1 → 2 → 1 → 2 →... → 1 → 2”, and the button assigned with “1” and “2” It is a content that repeats pressing the assigned button alternately. Further, the button 24 to which “1” is assigned has a position “PD” which is different from the position shown in FIG. 4A, and a button “PI” is assigned to “2”. Of course, the example of FIG. 4B is merely an example, and the button 24 at another position may be designated as “2” without changing the position of “1”.

  In the routine shown in FIG. 4C, for example, “level 9” is set to repeat the operation of pressing nine buttons in a predetermined order. In the routine table T9 shown in FIG. 4C, the “routine” is “1 → 2 → 3 → 4 → 5 → 6 → 7 → 8 → 9 → 1 →. It is a content that repeatedly presses buttons assigned with “9” in order of numbers. In the illustrated example, the button to which “1” is assigned has a position “PG”. Similarly, “2” is the position “PB”, “3” is the position “PF”, “4” is the position “PD”, “5” is the position “PI”, “6” is the positions “PC”, “7”. "Is a position" PE "," 8 "is a position" PH ", and" 9 "is a position" PA ". The assignment of numbers and positions of these buttons 24 may be changed every time a routine is generated.

  The routine tables T1, T2,... T9 shown in FIGS. 4A to 4C may be prepared in advance in the table database 64 in the data memory 60 of the apparatus body 30, You may make it produce | generate randomly every time a music is designated by a user (examinee) or an examiner.

  The routine presentation program 46 is for presenting the routine set by the routine setting program 44 to the user. Various ways of presentation are possible. For example, among the buttons 24A to 24I, the buttons included in the routine may be lit in the order of pressing, flashed, or displayed with numbers. It is done. Moreover, you may present with an audio | voice. FIG. 2B shows an example of a routine presentation mode in the case of “level 2”. As shown in the upper part of the figure, initially, nothing is displayed on the buttons 24 of the positions PA to PI of the monitor 22 of the panel device 20, but in the middle part of the figure by executing the routine presentation program 46. As shown, “1” is displayed on the button 24 at the position PD, and “2” is displayed on the button 24 at the position PI. At the same time, a guidance voice “Please touch the buttons“ 1 ”and“ 2 ”alternately” flows from the output unit 36 of the apparatus main body 30. Or you may output the same audio | voice from the audio | voice output part 28 of the panel apparatus 20. FIG. Further, the level being presented may be displayed on the display unit 38 of the apparatus main body 30.

  Further, in the illustrated example, as shown in FIG. 2B, the corresponding buttons are sequentially lit or blinked in accordance with the pressing order. For example, the “1” button 24D is turned on in the middle of FIG. 2B, the “2” button 24I is turned on in the lower part of FIG. 2B, and the “1” button 24D is turned on. It is a condition to do. At this time, if the lighting intervals of “1” and “2” are set in accordance with the performance rhythm of the music, the user can easily grasp the approximate execution speed (performance speed) of the routine. At the same time, the tempo may be indicated by the metronome 36A.

  The sound string data acquisition program 48 is for acquiring the sound string data 62 of the music to be reproduced (or played) by execution of the routine (the time series data for the pitches of the sounds constituting the music). The music used in the routine can be selected by the user, but may be determined by something other than the user. The sound string data can be acquired by inserting the USB memory 72 storing the music data into the USB port 70 of the apparatus main body 30 and loading the data, or storing a large number of music data in the data memory 60 in advance. If there is a music database 66 in which sound string data is accumulated, a favorite music may be selected from the music database 66. Alternatively, sound string data of a favorite song may be acquired from the Internet 80 via the communication control unit 34. The method of selecting or acquiring the sound string data of the music is arbitrary, and the examiner may select as appropriate according to the degree of the user's cognitive function.

  Next, the sound output program 50 of the program memory 40 stores a routine presented by the user, and when the predetermined buttons 24A to 24I of the monitor 22 are touched in a predetermined order according to the routine, the routine database 64 is referred to. Then, a table corresponding to the level being executed is referred to, a sound corresponding to the order of operations in the routine when contact is detected is specified, and a sound output instruction is issued. At this time, the sound output program 50 instructs the output unit 36 to output a sound with a length corresponding to the time during which the user's contact is detected by the sensors SA to SI, so that the user touches the button. You can “play” a song by adjusting the timing and length. When the user presses a button different from the routine, the sound output program 50 may output an error sound having no pitch to indicate a mistake to the user.

  The log acquisition program 52 acquires data relating to the execution status of the routine by the user, accumulates it for each user, and stores it in the data memory 60 as log data 68. The level (difficulty level) of the routine set in the present invention has a correlation with the result of the existing cognitive function test, and the corresponding cognitive function can be roughly grasped from the level and achievement level of the routine. The routine is prepared with a plurality of levels having different levels of difficulty, presents the simplest routine, and presents and executes a routine with a high level of difficulty if the user can execute it without making a mistake. Repeat this step to present and execute a routine that is gradually more difficult. If the user makes a mistake during the execution of a routine of a certain level, the test ends at that point, and the level of the routine is recorded as log data together with the date of execution. Then, by observing the log data over time, changes in cognitive function over time can be grasped.

  <Inspection / Confirmation Procedure> Next, an example of a cognitive function inspection / confirmation procedure according to this embodiment will be described with reference to FIG. Here, among the nine buttons displayed on the monitor 22, “Level 1”, which uses the lowest level of difficulty using only one button, to “Level 9”, which uses the highest level of difficulty using all nine buttons. It is assumed that the routines up to are set. In addition, the music for which the sound string is reproduced by performing these routines is the same music throughout levels 1 to 9, but different music may be used for each level. The routine tables T1 to T9 corresponding to these levels are set and stored in the data memory 60.

  As shown in FIG. 3, when the test is started, the control program 42 makes a routine presentation program 44 so as to present to the user the “level 1” routine having the lowest difficulty among the set routines. To instruct. The routine presentation program 44 presents the routine to the user, for example, by displaying the number “1” on the corresponding button or blinking the button 24 at a predetermined interval (step S10). In addition to visual presentation, as shown in FIG. 2B, a routine may be presented by voice (such as “Please play the task song with one finger”). The user who is presented with the “level 1” routine stores the contents of the routine, and when the presentation ends, executes the routine according to the contents (step S12). At the time of performance, the metronome 36A is made to sound at a tempo suitable for the subject song. Further, this tempo may be increased or decreased depending on the age of the user (subject).

  The control program 42 determines whether or not the user has reached the end of the “level 1” song without making a mistake (step S14), and determines that the user has reached the end of the song (Yes in step S14). The routine presentation program 46 is instructed to present a routine having a level that is one step higher than the most recently presented level (ie, “level 2”). On the other hand, when the user makes a mistake and determines that the end of the song has not been reached (No in step S14), log data is acquired by the log acquisition program 52 (step S40), the log is saved, and the Internet is used if necessary. It transmits to the other terminal 82 via 80 (step S42), and ends.

  If the “level 1” song has been played to the end in step S14, then the “level 2” routine is presented by the routine presentation program 46 (step S16). The presentation of the routine may be as shown in FIG. 2 (B), and the two buttons and the routine are presented visually, and the voice “Please play the task piece with one finger” is displayed. You may make it flow. The user stores the presented routine and executes the “level 2” routine (step S18). Thereafter, it is determined whether or not the end of the music of level 2 has been reached by the same procedure (step S20). If it has been reached (Yes in step S20), the routine of “level 3” is presented (step S22). If not reached (No in step S20), the log is acquired, saved and terminated (steps S40 and S42). The above procedure is repeated until all level routines are executed (No in step S30). When all level routines are completed (Yes in step S30), logs are acquired, stored, and transmitted (steps). S40, S42) End.

  The log data acquired by the above means can roughly determine the cognitive function from the level reached, and can also be used to check the change of the user's cognitive function over time. For example, when the cognitive function is divided into levels 1 to 9, it is assumed that the routine of level 5 is achieved at a certain time. One month later, the test is performed under the same conditions. When the test is completed at “level 3”, the cognitive function is lowered. When the test is completed at “level 6”, the function is improved (improved). In this way, it is possible to detect changes in cognitive function at an early stage by periodically testing and observing the results over time.

Thus, according to the first embodiment, there are the following effects.
(1) Using a plurality of buttons 24A to 24I that can be contacted by a user and repeatedly touching one or more buttons selected from these buttons in a predetermined order, a sound string of a specific music piece is reproduced. A routine table is generated by setting the routine as described above. The set routine is presented to the user, and when the user stores the routine and touches a predetermined button according to the presented routine, the corresponding sound is output by referring to the routine table, It was decided to obtain log data related to performance status. Based on the correlation between the level of the routine and the result of the existing cognitive function test, the approximate cognitive function level of the user is grasped. Therefore, the cognitive function can be confirmed while enjoying music.
(2) Since the music can be enjoyed and the mental burden on the user is small, it can be repeatedly executed on a daily basis, so that periodic log data can be acquired.
(3) Since the cognitive functions such as short-term memory, working memory, and approximate memory are deeply involved in the execution of the routine of this embodiment, by observing the log data, changes in these cognitive functions over time are observed. I can grasp it.

(4) According to the present embodiment, since the examination and observation can be performed while enjoying music, it is much more enjoyable than the conventional cognitive function examination, and the active participation of the subject can be expected.
(5) According to this embodiment, starting from a simple task of playing a melody with one finger and gradually becoming difficult, no practice is required. Since it can be carried out by one person, human costs can be reduced.
(6) There are almost countless assignments, so you won't get bored.

(7) Short-term memory, working memory, and approximate memory are susceptible to impairment initially in the early stages of mild cognitive impairment and Alzheimer-type dementia, and can therefore be used as screening means for early discrimination.
(8) Repeating the performance with your fingers while changing the theme song activates brain activity and helps prevent or improve dementia.
(9) By acquiring log data via the Internet 80, it can also be used for a home monitoring system.

  Next, Embodiment 2 of the present invention will be described with reference to FIG. In addition, the same code | symbol shall be used for the component which is the same as that of Example 1 mentioned above, or respond | corresponds. In the first embodiment described above, the planar buttons 24A to 24I of the panel device 20 are used as objects as objects to be contacted by the user, but this is also an example, and as shown in FIG. As an alternative, an existing general-purpose keyboard 130 may be used.

  A general-purpose sound source / audio device 150 such as a synthesizer is connected to such a motion detection unit 110 via a converter 140 in which a cognitive function observation application 142 is introduced. The cognitive function observation application 142 is provided with the same functions as the program memory 40, the data memory 60, and the communication control unit 34 of the apparatus main body 30 of the first embodiment. The general-purpose sound source 150 corresponds to the output unit 36 of the first embodiment. With such a configuration, the system of the present embodiment can be easily constructed using an existing keyboard and sound source. The converter 140 may be a dedicated product for the cognitive function observation system, or may be used by installing the cognitive function observation application 142 in an existing computer. In this case, the cognitive function observation application 142 itself may be acquired via the Internet 80. Further, as in the example illustrated in FIG. 5B, the tablet terminal 160 may have an integrated configuration having all functions. In this case, the buttons 24A to 24I are displayed as objects on the monitor 162 of the tablet terminal 160, the cognitive function observation application 170 is provided therein, and the communication control unit 172 and the output unit 174 may be used.

  Next, Embodiment 3 of the present invention will be described with reference to FIG. In the first embodiment described above, each sound in the music is applied to one operation (contact operation) by the user, and the length of sound output is adjusted according to the timing when the user contacts the object and the time when the user contacts the object. It was. In contrast, in this embodiment, the melody can be accurately played by the user repeating a predetermined routine at a constant tempo. For example, when setting a routine, the unit of the minimum note value (the time length on the musical score related to musical sound) is applied to one action, and if it is longer than that, it is idle. By setting (non-playing action), the melody can be played accurately by operating at a constant tempo (contacting the object).

  In this embodiment, tone value data 63 provided in the data memory 60 of the apparatus main body 30 shown in FIG. 1 is used. The sound value data 63 indicates the length of the sound on the musical score of the sound string data. Such tone value data 63 may be prepared in advance, or may be acquired when the sound string data acquisition program 48 acquires sound string data. Further, a program (not shown) for obtaining sound value data may be provided separately. The routine setting program 44 generates a routine table TA using the sound string data 62 and the sound value data 63 and stores it in the data memory 60. Specifically, each sound constituting the music is divided by the minimum sound value, with a minimum sound value among a large number of sounds constituting the melody of the music as a predetermined unit. Then, for each sound, as shown in FIG. 6, the sound is output for the first part of each divided sound, and the sound is not output for the part after the first part. A table in which presence / absence of output of each part of the divided sound and the operation by the user is assigned is generated.

  FIG. 6 shows an example of the table TA generated in the present embodiment. As shown in the figure, in the case of “Hometown”, the minimum note value in the melody is an eighth note. Then, when the eighth note (minimum note value) is set to “1”, the relative note value of the other sounds is “C → C → C → D → E → D → E → E → F”. Corresponding to “→ G → rest”, the sound value is “2 → 2 → 2 → 3 → 1 → 2 → 2 → 2 → 2 → 4 → 2”. For example, in FIG. 6, in the first bar, the melody is “C → C → C”, and the note value is “2 → 2 → 2”. That is, when each sound is divided into unit representations with the minimum sound value as a unit of division, the first “C” is divided into two unit representations (in the example shown, the second “C”, 3 The same applies to the second “C”).

  Here, when the user's action is assigned to each divided expression, it is designated as “sounding action” only in the first action (“◯” in FIG. 6), and in the second action, “ “No sound (empty shot) operation” is designated (“×” in FIG. 6). Similarly, for the third and subsequent operations, the melody can be played accurately by performing the operation at a constant tempo by designating the operation to generate sound and the operation not to generate sound. Although the contents are omitted in FIG. 6, the routine table TA is provided with columns of “routine” and “position” in the same manner as in FIG. 4, and an operation to be performed by the user is set. .

  Thus, according to the present embodiment, in addition to the effects of the first embodiment described above, there is an effect that the melody can be correctly played when the user repeats the routine at a constant tempo. When this embodiment is applied and a specific routine is repeated as quickly as possible using a plurality of fingers, there is a correlation between the time required for one routine and the cognitive function. That is, the cognitive function can be inferred by acquiring and analyzing the time required for execution of the routine as the log data 68. For this reason, it can be used as a method for examining and observing cognitive function.

In addition, this invention is not limited to the Example mentioned above, A various change can be added in the range which does not deviate from the summary of this invention. For example, the following are also included.
(1) The system configuration shown in the first embodiment is also an example, and as shown in the second embodiment, the design can be changed as appropriate within the range where the same effects can be obtained. Of course, Example 2 is also an example and does not prevent other forms.
(2) The sensors SA to SI shown in the first embodiment are only examples, and as means for detecting contact of the user with the object in the present invention, various known means such as strain gauges, pressure sensors, and pressure sensitive sensors are used. Conductive rubber or the like may be used.
(3) In the first embodiment, data is transmitted / received and information is acquired / provided by connecting to the Internet 80 as necessary. However, this is also an example, and the network is used as necessary. You may do it. Moreover, what is acquired from the network may include music string data, performance applications 142 and 170, and the like.

  (4) In the above-described embodiment, the buttons 24A to 24I (Example 1) displayed on the flat panel and the keys (Example 2) of the general-purpose keyboard 130 are exemplified as the objects to be contacted by the user. This is also an example, and other known various contact media can be applied as long as the user's contact operation can be detected. For example, the board device 200 shown in FIG. 7A is an example in which buttons BT1 to BT5 are provided on the three-dimensional blocks 202A to 202E arranged in a horizontal manner on the base 201, respectively. The sound string of music is reproduced by touching the buttons BT1 to BT5. In the illustrated example, a groove is provided between the buttons BT1 and BT2 and between the buttons BT2 and BT3. However, this is an example, and the groove may not be provided. The number of buttons may be increased or decreased as appropriate. Like the board device 210 shown in FIG. 7B, elongated keys K1 to K5 may be arranged radially on a planar base 212.

  A board device 220 shown in FIG. 7C is an example in which a part to be pressed with a finger is a detachable peg. The pegs PA1 to PA5 shown in the figure have a large upper area and a low height, so that they are easy to contact. Further, the pegs PB1 to PB5 have a smaller upper area and a higher height than the pegs PA1 to PA5. Further, the pegs PC1 to PC5 are set so that the area of the uppermost portion is narrow and the height is high. The narrower the contact area with the finger and the higher the height, the higher the difficulty of pressing accurately, and the sophistication of the board device 220 changes. These pegs PA1 to PA5, PB1 to PB5, and PC1 to PC5 are detachably attached to holes 224A to 224E provided in the base 222 of the board device 220. The holes 224A to 224E shown in FIG. 7 (C) are arranged so that the fingertips of the fingers of the right hand can easily touch. However, this is also an example, and can be appropriately changed to a horizontal row, a vertical row, a cross shape, or the like. The number can be increased or decreased.

  The example shown in FIG. 7D is an example in which the present invention is applied to clothes. A plurality of sensors 232A to 232F are built in the wear 230 shown in FIG. As the sensors 232A to 232F, for example, fiber sensors using a conductive material are used. The wearer (user) of the wear 230 touches the sensors 232A to 232F with a palm or the like according to the presented routine, thereby detecting contact from the wireless transmitter 234 attached to the wear 230. Is transmitted to the portable terminals 236, 238, etc., and a sound is output. In this example, the wear 230 itself in which the sensors 232A to 232F are embedded is an object.

  (5) The above-described first to third embodiments have been described with reference to an example in which a user touches an object with a hand. However, this is also an example. For example, a sensor is provided on a shoe and a user walks (motions). May be detected, or a sensor may be provided on the mat to detect a user step (operation). For example, in the example shown in the third embodiment, if the routine is set to a simple action of walking, that is, alternately landing with left and right feet, a specific melody can be played by walking at a constant tempo. it can.

(6) A mode that allows the user to determine the routine is provided, and if a favorite pattern is selected from the number and arrangement of objects, it can be enjoyed as a musical instrument or a toy. When used as a musical instrument, a plurality of fingers may be used in addition to pressing with one finger. Moreover, when using it as a musical instrument or a toy, even if it makes a mistake, it does not end, but it is possible to continue and continue playing.
(7) In the first embodiment, the routine is terminated if the button is pressed incorrectly even once. However, for example, if the failure is up to three times, the number of times is counted and it is determined that the routine is completed. The design can be changed as appropriate.
(8) In the above embodiment, one sound is generated for one operation included in the routine, but this is also an example, and the music is divided into short phrases, and when the user presses a predetermined button, A phrase having a predetermined length is reproduced, and the music may be played by repeating it.

  According to the present invention, a plurality of objects that can be contacted by a user are used, and one or more objects selected from the plurality of objects are repeatedly contacted in a predetermined order to reproduce a sound string of a specific music piece. The routine is set to generate a routine table, and the set routine is presented to the user. Then, when the user touches a predetermined object according to the presented routine, the corresponding sound is output with reference to the routine table, and log data regarding the execution of the routine by the user is acquired. For this reason, music can be enjoyed and the mental burden on the user is small, so that it can be repeatedly performed on a daily basis. Therefore, the present invention can be applied to the purpose of grasping a change in cognitive function over time by observing log data. In particular, log data can be transmitted and received through a network, which is suitable for a home monitoring system.

DESCRIPTION OF SYMBOLS 10: Cognitive function observation system 20: Panel apparatus 22: Monitor 24, 24A-24I: Button 26: Motion detection part 28: Audio | voice output part 30: Apparatus main body 32: CPU
34: Communication control unit 36: Output unit 36A: Metronome 38: Display unit 40: Program memory 42: Control program 44: Routine setting program 46: Routine presentation program 48: Sound string data acquisition program 50: Sound output program 52: Log acquisition Program 60: Data memory 62: Sound string data 63: Sound value data 64: Table database 66: Music database 68: Log data 70: USB port 72: USB memory 80: Internet 82: Terminal 84: Server 100: Cognitive function observation system 110: Motion detection unit 130: Keyboard 140: Converter 142: Cognitive function observation application 150: General-purpose sound source / audio device 160: Tablet device 162: Monitor 170: Cognitive function observation application 172: Communication control unit 174 Output unit 200: Board device 201: Base 202A to 202E: Block 210: Board device 212: Base 220: Board device 222: Base 224A to 224E: Hole 230: Wear 232A to 232F: Sensor 234: Wireless transmitters 236, 238: Mobile terminals BA to BD: Blocks BT1 to BT5: Buttons K1 to K5: Keys PA to PI: Button positions PA1 to PA5, PB1 to PB5, PC1 to PC5: Pegs SA to SI: Sensors T1 to T9, TA: Routine table

Claims (9)

A cognitive function observation system that reproduces a sound sequence that is the pitch and order of sounds constituting a music piece by executing a predetermined routine by a user, and is used for examination and observation of cognitive function,
A plurality of objects contacted by the user;
Detecting means for detecting that the user has contacted the plurality of objects;
Routine setting means for generating a routine table by setting a routine to reproduce a sound string of a specific music piece by repeatedly contacting one or more objects selected from the plurality of objects in a predetermined order. When,
Routine presenting means for presenting the routine set by the routine setting means to the user;
An output instruction means for referring to the routine table and instructing the output means to output an appropriate sound when the user contacts a predetermined object according to the routine presented by the routine presenting means;
Log acquisition means for acquiring data relating to the execution status of the routine by the user;
Cognitive function observation system characterized by having The control means for controlling each means, and determining whether or not a predetermined routine has been achieved by the user,
The control means includes
When the routine setting means sets a routine of a plurality of stages having different difficulty levels,
Instructing the routine presenting means to present to the user from a routine with low difficulty,
When it is determined that the user has achieved the presented routine, the routine presenting means is instructed to present a routine that is one step higher than the most recently executed routine,
Except when it is determined that the user has achieved the presented routine, after the data is acquired by the log acquisition means, the execution of each means is stopped, and the examination / observation of the cognitive function is terminated. The cognitive function observation system according to claim 1. The routine setting means includes
The melody of the music is divided for each sound constituting the music, and each divided sound is assigned to each contact action to a predetermined object by a user constituting the routine. 2. Cognitive function observation system according to 2.   The cognitive function observation system according to claim 3, wherein the output means outputs a sound with a length corresponding to a timing when the detection means detects a contact by the user and a time during which the contact is detected. . Guide means for outputting a guide sound according to the tempo of the music;
The cognitive function observation system according to claim 3 or 4, wherein the cognitive function observation system is provided. A communication means for exchanging data with other terminals via a network;
The cognitive function observation system according to any one of claims 1 to 5, wherein the cognitive function observation system is provided. A method for examining and observing cognitive function using a plurality of objects that can be contacted by a user,
A routine is set so that a sequence of sounds that are in the pitch and order of a specific piece of music is reproduced by repeatedly touching one or more objects selected from the plurality of objects in a predetermined order. Step 1 for generating a routine table;
Presenting the set routine to the user, step 2;
When the user touches a predetermined object according to the routine presented in step 2, referring to the routine table and outputting a corresponding sound;
Obtaining data relating to the execution status of the routine by the user; and
A method for observing cognitive function, comprising In step 1, a plurality of stages of different levels of difficulty are set,
In step 2, a low difficulty routine is presented to the user,
In step 3, including determining whether the user has achieved the presented routine;
If it is determined in step 5 that the routine has been achieved, the process returns to step 2 to present the user with a routine that is one step more difficult than the most recently presented routine, and repeats steps 3 and 4;
8. The cognitive function observation according to claim 7, wherein the test / observation of the cognitive function is terminated after obtaining data relating to the execution status of the routine except when it is determined in step 5 that the routine has been achieved. Method. Steps 6 and 6 for transmitting / receiving the data acquired in Step 4 or Step 5 between terminals connectable via a network
The cognitive function observation system according to claim 8, comprising: