JP6873846B2 - Information processing device - Google Patents

Description

The present invention relates to a technique for making a determination based on a user's operation.

In Patent Document 1, the touch panel of the sub-terminal device calculates the shape of the foot to authenticate the user, and the main terminal device calculates biometric information (breathing, pulse, body movement) from the output waveform of the Doppler sensor and is a fatigue index. Etc. are disclosed.

Re-table 2015/107710

In the technique of Patent Document 1, the determination is made by sleeping after getting on the sub-terminal device, but if the user does not know that the determination is made by such an operation, the appropriate determination is not made.
Therefore, an object of the present invention is to enable a determination based on a user's operation result so that the determination can be performed without the user knowing the operation to be performed for the determination.

In order to achieve the above object, the present invention provides an operation instruction unit that instructs a target user to perform an operation by using the function of the first terminal having a function of assisting communication between people, and an operation information indicating the operation of the person. An operation acquisition unit that acquires the operation information about the target user who has performed an operation in response to the instruction from a second terminal having a detection function is compared with the content of the instruction and the acquired operation information. A determination unit that makes a determination regarding the target user, a sound acquisition unit that acquires the ambient sound recorded by the third terminal having a function of recording the ambient sound, and a user's voice included in the acquired ambient sound. The operation instruction unit is provided with an identification unit that identifies, a living sound included in the acquired ambient sound, and a storage unit that stores the user identified from the ambient sound in association with each other. The operation instruction unit is the target user. Provided is an information processing apparatus that gives an instruction when a living sound similar to the living sound stored in association with is acquired.

The third terminal has a function of outputting a sound, and includes an output instruction unit for instructing the third terminal to output a sound prompting the user to speak, and the identification unit outputs a sound prompting the user to speak. The identification may be performed from the human voice included in the ambient sound recorded later.

Further, the present invention has a function of assisting communication between people, which is installed at a specific position, and operates the target user by using the function of a first terminal that sounds a ringing tone when the communication is started. An operation instruction unit for instructing, an operation acquisition unit for acquiring the operation information about the target user who has performed an operation in response to the instruction from a second terminal having a function of detecting operation information indicating a person's operation, and an operation acquisition unit. The information acquired from the determination unit that compares the content of the instruction with the acquired operation information to determine the target user and the fourth terminal installed at a predetermined distance from the first terminal. Based on this, a detection unit that detects the approach of the target user to the fourth terminal, a call instruction unit that gives an instruction to sound the ringing tone of the first terminal when the approach is detected, and the first terminal. The determination unit is provided with a period specifying unit that specifies a period during which the ringing tone is ringing, and the determination unit provides an information processing device that makes a determination based on the predetermined distance and the movement speed of the target user represented by the specified period. To do.

The fourth terminal has a function of recording an ambient sound, includes a sound acquisition unit for acquiring the ambient sound recorded by the fourth terminal, and the period specifying unit is included in the acquired ambient sound. The period may be specified based on the ringing tone.

According to the present invention, when a determination is made based on a user's operation result, the determination can be made without the user knowing the operation to be performed for the determination.

Diagram showing the overall configuration of the dementia prevention system according to the examples Diagram showing the hardware configuration of server devices, etc. Diagram showing the functional configuration realized by the dementia prevention system The figure which shows an example of the 1st judgment table The figure which shows an example of the 2nd judgment table Diagram showing an example of the integrated UI where the judgment result is displayed Diagram showing an example of stored unique information The figure which shows an example of the operation procedure of each apparatus in judgment processing The figure which shows an example of the operation procedure of each device in the 1st home judgment processing The figure which shows an example of the operation procedure of each device in the 2nd home judgment processing

[1] Example FIG. 1 shows the overall configuration of the dementia prevention system 1 according to the embodiment. The dementia prevention system 1 is a system that supports the prevention of dementia. The dementia prevention system 1 is, for example, a user who is targeted to prevent dementia (elderly people, etc., hereinafter referred to as “target user”) and a user who supports activities related to prevention while watching over the target user (family of target user). Etc. (hereinafter referred to as "support users").

The target users include both those who have developed dementia and those who have developed dementia. This is because prevention of dementia includes not only preventing the onset of dementia, but also stopping the progression of the developed dementia and improving the symptoms. The dementia prevention system 1 includes a network 2, a fixed telephone 3, a server device 10, a home router 20, a first user terminal 30, and a second user terminal 40.

The network 2 is a communication system including a mobile communication network, the Internet, and the like, and relays data exchange between devices accessing the own system. The server device 10 and the home router 20 access the network 2 by wire communication, and the first user terminal 30 and the second user terminal 40 access by wireless communication. The access to the network 2 may be either wired communication or wireless communication.

The server device 10 is an information processing device that performs processing related to dementia prevention. The home router 20 has a communication function with the network 2, a communication function compliant with the wireless LAN (Local Area Network) standard, and a function of relaying a call by a fixed telephone line, and the fixed telephone 3 is connected to the home router 20. There is. The fixed telephone 3 is a communication terminal having a telephone function (a function of assisting communication by voice), which is an auxiliary function for assisting communication between people, and is an example of the "first terminal" of the present invention. It is assumed that both the home router 20 and the fixed telephone 3 are installed in the house where the target user resides.

The first user terminal 30 is a terminal used by the target user, and is, for example, an information processing device such as a smartphone, a mobile phone other than a smartphone, or a tablet terminal. The first user terminal 30 may be any as long as it has a communication function, a display function, and the like, but in this embodiment, it will be described as being a smartphone. The first user terminal 30 communicates with the server device 10 via the network 2 or via the network 2 and the home router 20. The second user terminal 40 is an information processing device similar to the first user terminal 30 used by the support user, and is, for example, a smartphone.

FIG. 2 shows the hardware configuration of the server device 10 and the like. The server device 10 and the like (server device 10, home router 20, first user terminal 30, second user terminal 40) all include a processor 11, a memory 12, a storage 13, a communication device 14, and an input device 15. A computer including an output device 16 and a bus 17. The word "device" here can be read as a circuit, a device, a unit, or the like. Further, each device may be included one or more, or some devices may not be included.

The processor 11 operates, for example, an operating system to control the entire computer. The processor 11 may be composed of a central processing unit (CPU) including an interface with a peripheral device, a control device, an arithmetic unit, a register, and the like. Further, the processor 11 reads a program (program code), a software module, data, and the like from the storage 13 and / or the communication device 14 into the memory 12, and executes various processes according to these.

The number of processors 11 that execute various processes may be one, two or more, and two or more processors 11 may execute various processes simultaneously or sequentially. Further, the processor 11 may be mounted on one or more chips. The program may be transmitted from the network via a telecommunication line.

The memory 12 is a computer-readable recording medium, and is composed of at least one such as a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), an EEPROM (Electrically Erasable Programmable ROM), and a RAM (Random Access Memory). May be done. The memory 12 may be referred to as a register, a cache, a main memory (main storage device), or the like. The memory 12 can store the above-mentioned program (program code), software module, data, and the like.

The storage 13 is a computer-readable recording medium, and is, for example, an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, an optical magnetic disk (for example, a compact disk, a digital versatile disk, Blu-). It may consist of at least one such as a ray® disc), a smart card, a flash memory (eg, a card, stick, key drive), a floppy® disc, a magnetic strip, and the like. The storage 13 may be referred to as an auxiliary storage device. The storage medium described above may be, for example, a database, server or other suitable medium including the memory 12 and / or the storage 13.

The communication device 14 is hardware (transmission / reception device) for performing communication between computers via a wired and / or wireless network, and is also referred to as, for example, a network device, a network controller, a network card, a communication module, or the like. The input device 15 is an input device (for example, a keyboard, a mouse, a microphone, a switch, a button, a sensor, etc.) that receives an input from the outside. For example, the home router 20 and the first user terminal 30 include a microphone that collects sounds (ambient sounds) generated in the surroundings as an input device. Further, the first user terminal 30 includes a sensor for measuring the acceleration or the angular velocity of the own device as an input device.

The output device 16 is an output device (for example, a display, a speaker, an LED lamp, etc.) that outputs to the outside. For example, the home router 20 includes a speaker that outputs sound as an output device. The input device 15 and the output device 16 may have an integrated configuration (for example, a touch screen). Further, the devices such as the processor 11 and the memory 12 are accessible to each other via the bus 17 for communicating information. The bus 17 may be composed of a single bus or may be composed of different buses between the devices.

Further, the server device 10 and the like are hardware such as a microprocessor, a digital signal processor (DSP: Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array). It may be configured to include, and a part or all of each functional block may be realized by the hardware. For example, the processor 11 may be implemented on at least one of these hardware.

A program provided by this system is stored in the server device 10, the home router 20, the first user terminal 30, and the second user terminal 40 included in the dementia prevention system 1, and the processor of each device executes the program. By controlling each part, the function group described below is realized.

FIG. 3 shows the functional configuration realized by the dementia prevention system 1. The server device 10 includes an operation instruction unit 101, an operation information acquisition unit 102, a dementia-related determination unit 103, an ambient sound acquisition unit 104, a user identification unit 105, a unique information storage unit 106, and a sound output instruction unit. It is equipped with 107. The home router 20 includes a sound output unit 201, an ambient sound recording unit 202, and an ambient sound transmission unit 203. The first user terminal 30 includes an operation information detection unit 301 and an operation information transmission unit 302. The second user terminal 40 includes a determination result requesting unit 401 and a determination result display unit 402.

The operation instruction unit 101 of the server device 10 instructs the target user to operate by using the auxiliary function of the terminal having the above-mentioned auxiliary function (function of assisting communication between people). The operation instruction unit 101 is an example of the "operation instruction unit" of the present invention.

The operation instruction unit 101 stores in advance instruction information in a format capable of outputting, for example, an instruction voice indicating an operation instruction by a telephone function (an example of an auxiliary function), and stores the instruction information in a fixed telephone having a telephone function. Output to 3. There are several output timings, which will be explained in detail later. The fixed telephone 3 outputs (sounds) an operation instruction voice indicated by the output instruction information. The operation instruction unit 101 gives an operation instruction by outputting the instruction information in this way.

The server device 10 has a user ID assigned to the target user registered in the dementia prevention system 1 (hereinafter referred to as “registration ID”) and output destination information registered in association with the target user (this embodiment). Then, the telephone number of the fixed telephone 3) is stored in association with the telephone number. The operation instruction unit 101 outputs instruction information to those registered output destinations. Registration of the target user and the output destination is performed by, for example, a support user or a target user.

In this embodiment, the operation instruction unit 101 includes a first operation of clapping hands at predetermined intervals, a second operation of singing a predetermined song, and a third operation of shaking the first user terminal 30 a predetermined number of times. Instruct one of the actions of. When the first operation is instructed, for example, an instruction voice "Please clap 10 times at 1-second intervals" is output. When the target user performs the first action according to this instruction, a clapping sound is emitted.

When the second operation is instructed, for example, an instruction voice saying "Please sing" Spring has come "" is output. When the target user performs the second action according to this instruction, the singing voice of "Spring has come" is emitted. When the third operation is instructed, for example, an instruction voice "Please shake the smartphone 10 times at 1-second intervals" is output. When the target user performs the third operation according to this instruction, the first user terminal 30 which is a smartphone is shaken.

The operation information detection unit 301 of the first user terminal 30 is a function of detecting operation information indicating a person's operation. The first user terminal 30 is a detection terminal that detects operation information in this way, and is an example of the "second terminal" of the present invention. For example, when the target user performs the first operation, the operation information detection unit 301 collects the sound of the clapping sound emitted at a predetermined interval with a microphone, and detects the information indicating the sound as the operation information. When the target user performs the second operation, the operation information detection unit 301 collects the singing voice of the target user with a microphone and detects the information indicating the singing voice as the operation information.

Further, when the target user performs the third operation, the operation information detection unit 301 detects the acceleration or the angular velocity of the own device with the sensor, and detects the information indicating the detection result as the operation information. For example, when the target user swings the smartphone 10 times as the third operation, the information indicating the detection result in which the acceleration direction or the angular velocity direction is switched to the opposite direction 19 times is detected as the operation information.

In this embodiment, it is assumed that the first user terminal 30 is always executing the above program, and the operation information detection unit 301 is always realized. Therefore, the operation information detection unit 301 detects the operation information at any time when the above operation is performed. Not limited to this, for example, the operation information detection unit 301 may be realized to detect the operation information when the target user performs a predetermined operation.

Further, the operation instruction unit 101 of the server device 10 may instruct the start of detection of the operation information. In that case, the operation instruction unit 101 outputs the instruction information to the fixed telephone 3 and outputs the instruction information instructing the start of detection of the operation information to the first user terminal 30. If the first user terminal 30 has not executed the above program when receiving this instruction, the first user terminal 30 executes the program to realize the operation information detection unit 301 and starts the detection of the operation information.

The operation information detection unit 301 supplies the detected operation information to the operation information transmission unit 302. The operation information transmission unit 302 transmits the supplied operation information to the server device 10. The operation information transmission unit 302 stores the registration ID of the target user who uses the own device, and transmits the registration ID together with the operation information.

The operation information acquisition unit 102 of the server device 10 transmits the operation information and the registration ID transmitted from the first user terminal 30 including the operation information detection unit 301 from the target user indicated by the registration ID, that is, the operation instruction unit 101. Acquired as operation information about the target user who performed the operation in response to the instruction. The operation information acquisition unit 102 is an example of the “operation acquisition unit” of the present invention.

The motion information acquisition unit 102 supplies the acquired motion information and the registration ID to the dementia-related determination unit 103. The dementia-related determination unit 103 is also supplied with the operation instruction content to the target user and the registration ID of the target user from the operation instruction unit 101. The dementia-related determination unit 103 compares the content of the operation instruction by the operation instruction unit 101 with the operation information acquired by the operation information acquisition unit 102, and makes a dementia-related determination for the target user.

In this embodiment, the dementia-related determination unit 103 determines the status of dementia-related symptoms of the target user. The term "dementia-related symptom" includes not only the symptom seen in the person who develops dementia but also the symptom which seems to be a sign of dementia appearing in the person who does not develop dementia. This determination related to dementia is an example of the "determination regarding the user" of the present invention, and the dementia-related determination unit 103 is an example of the "determination unit" of the present invention.

Specifically, the dementia-related determination unit 103 makes the above determination based on the difference between the instructed motion and the result of the motion indicated by the motion information. If the first action (clapping at a predetermined interval) is performed, the dementia-related determination unit 103 responds to the total time of the difference between the interval of the hand clapping performed by the target user and the predetermined interval. To make a judgment. The dementia-related determination unit 103 stores, for example, a first determination table in which the total time of the difference and the symptom status are associated with each other as follows, and makes a determination using the first determination table.

FIG. 4 shows an example of the first determination table. In the first judgment table of FIG. 4A, the total time of the difference of "less than T1", "T1 or more and less than T2" and "T2 or more" (T1 <T2) is "none", "minor" and "necessary". The degree of the symptomatism "attention" (an example of the symptomatological situation) is associated. The dementia-related determination unit 103 calculates the total time of the difference by comparing the content of the instruction with the motion information, and determines the degree of the symptomatology associated with the calculated total time in the first determination table of the target user. Judge as the degree of symptomatism.

If the second action (singing a predetermined song) is performed, the dementia-related determination unit 103 uses, for example, a karaoke scoring technique to determine the pitch and singing timing of the singing voice of the target user. Judgment is made according to the total value (referred to as "singing deviation value") indicating the magnitude of the deviation from the pitch of the song and the timing to be sung. The dementia-related determination unit 103 stores, for example, a second determination table in which the singing deviation value and the symptom status are associated with each other as follows, and makes a determination using the second determination table.

FIG. 5 shows an example of the second determination table. In the second judgment table of FIG. 5 (a), the singing deviation values of "less than C1", "more than C1 and less than C2" and "more than C2" (C1 <C2) are "none", "minor" and "need attention". The degree of the symptom is associated with it. The dementia-related determination unit 103 calculates the singing deviation value by comparing the content of the instruction with the motion information, and determines the degree of the symptomatology associated with the calculated singing deviation value in the second determination table of the target user. Judge as the degree of symptomatism.

If the third action (the action of shaking the smartphone at a predetermined interval) is performed, the dementia-related determination unit 103 sets the time at which the difference between the interval at which the target user shakes the smartphone and the predetermined interval is totaled. Judgment is made accordingly. The dementia-related determination unit 103 determines the degree of the symptom of the target user in the same manner as the first operation by using, for example, the first determination table shown in FIG. 4A.

The dementia-related determination unit 103 may store the contents of the supplied operation instruction and the operation information together with the supplied date and time information, and make a determination based on the past comparison result. For example, in the case where the first action is performed, the dementia-related determination unit 103 is the total time of the difference between the clapping interval and the predetermined interval performed in the past predetermined period (for example, one year). The average value is calculated, and the judgment is made using a judgment table that associates the relationship between the calculated average value and the total time of the difference due to the newly performed first operation with the progress of the symptomatology (an example of the symptomatology situation). I do.

For example, in the first determination table of FIG. 4B, "average value x less than 0.95", "average value x 0.95 or more and average value x less than 1.05", and "average value x 1.05 or more". The relationship between the total time of the new difference and the average value is associated with the progress of symptoms such as "improvement tendency", "no change", and "deterioration tendency". When the first action is performed, the dementia-related determination unit 103 determines the progress of the symptom of the target user using this first determination table (for example, the total time of the new difference is 10% less than the average value. For example, it is determined that there is an "improvement tendency" associated with "average value x less than 0.95"). Further, the dementia-related determination unit 103 determines the progress of the symptom of the target user by using the first determination table even when the third operation is performed.

In the second judgment table of FIG. 5B, the new values are "average value x less than 0.95", "average value x 0.95 or more and average value x less than 1.05", and "average value x 1.05 or more". The relationship between the singing deviation value and the average value is associated with the progress of symptoms such as "improvement tendency", "no change", and "deterioration tendency". When the second action is performed, the dementia-related determination unit 103 determines the progress of the symptom of the target user using the second determination table. In the examples of FIGS. 4 and 5, the value obtained by multiplying the average value (0.95 and 1.05) is an example, and this value can be changed or a predetermined value can be added or subtracted from the average value. The ease with which each symptomatology progresses may be changed.

Similarly, the dementia-related determination unit 103 makes a determination based on the past comparison results of the second operation and the third operation. The dementia-related determination unit 103 stores the result of the determination performed as described above in association with the registration ID of the target user, and transmits it to the second user terminal 40, for example, when requested by the second user terminal 40. To do.

The determination result requesting unit 401 of the second user terminal 40 requests the server device 10 to determine the dementia of the target user. The determination result requesting unit 401 sends request data indicating, for example, the registration ID of the target user and requesting the determination when the supporting user performs a predetermined operation for requesting the determination from the own device. This request is made by transmitting to the device 10.

When the dementia-related determination unit 103 of the server device 10 receives the request data, the determination result stored in association with the registration ID indicated by the request data is stored in the request source terminal (second user terminal 40 in this example). Send. The determination result display unit 402 of the second user terminal 40 displays the result of determination by the dementia-related determination unit 103 for the target user. The determination result display unit 402 displays the determination result on, for example, an integrated UI (User Interface) that provides information on the dementia prevention system 1.

FIG. 6 shows an example of the integrated UI in which the determination result is displayed. The determination result display unit 402 anthropomorphizes the person image G1 of the support user “Mr. B” and the server device 10 that has determined the target user “Mr. A” on the dementia prevention system screen. G2 is displayed. Further, the determination result display unit 402 displays a balloon image F1 including a line "Tell me the degree of the symptom of Mr. A" spoken by the person image G1.

The determination result display unit 402 displays the balloon image F1 when the support user performs the above-mentioned request operation. In addition, the judgment result display unit 402 determines that there is no symptom from the balloon image F2 representing the line "I will inform you of the degree of Mr. A's symptom" spoken by the person image G2 and "From today's movement of Mr. A." The balloon image F3, which represents the line "I did.", Is displayed.

When the determination is made based on the past comparison result, the determination result display unit 402 sets the comparison result based on the latest operation information as a score (for example, in the case of the first operation, the clapping interval and the predetermined interval). The score becomes higher as the total time of the difference is smaller), and the determination result may be displayed in addition to the score). The judgment result display unit 402 displays a balloon image representing a line such as "Today's movement of Mr. A was 80 points. It was judged that there is an improvement tendency from the movement of the past year."

By communicating the determination result of the target user to the support user in this way, it is possible to support the determination of dementia prevention by the support user. For example, if the "need attention" or "deterioration tendency" continues many times, the supporting user can instruct the target user to undergo an examination at the hospital. Further, for example, if the target user is engaged in dementia prevention activity and "none" or "improvement tendency" continues, it is possible to instruct to continue as it is because the activity is effective.

For example, when a person other than the target user lives in the house where the fixed telephone 3 is installed, the target user does not always answer the telephone when the ringing tone of the fixed telephone 3 rings. In the following, a function for storing unique information of the target user, such as a feature amount of the voice of the target user and a living sound peculiar to the target user, will be described so that the target user can answer the phone. Living sounds are sounds generated based on human movements in daily life, such as footsteps, door opening / closing sounds, and switch operation sounds.

The sound output unit 201 of the home router 20 is a function of outputting sound from the speaker of its own device, and outputs, for example, the sound instructed by the server device 10. Further, the peripheral sound recording unit 202 of the home router 20 is a function of recording the peripheral sound (ambient sound) collected by the microphone of the own device. The home router 20 is a sound processing terminal having a function of outputting sound and a function of recording ambient sound in this way, and is an example of the "third terminal" of the present invention.

When the peripheral sound recording unit 202 records the peripheral sound, the peripheral sound recording unit 202 supplies the peripheral sound data indicating the recorded peripheral sound to the peripheral sound transmission unit 203. The ambient sound transmission unit 203 transmits the supplied ambient sound data to the server device 10. The ambient sound acquisition unit 104 of the server device 10 acquires the ambient sound recorded by the home router 20 by receiving the transmitted ambient sound data. The ambient sound acquisition unit 104 is an example of the "sound acquisition unit" of the present invention. The ambient sound acquisition unit 104 supplies the received ambient sound data to the user identification unit 105.

If the peripheral sound acquired by the peripheral sound acquisition unit 104 includes a human voice (voice), the user identification unit 105 identifies the user from the voice. The user identification unit 105 is an example of the "identification unit" of the present invention. For example, the user identification unit 105 extracts sounds in the frequency band of human voice from ambient sounds as human voice, and extracts sounds in other frequency bands as daily life sounds (footsteps, etc.).

The user identification unit 105 stores, for example, a pattern sound of a living sound, extracts a sound similar to the pattern sound included in the sound of the frequency band of a human voice as a living sound, and extracts the living sound. The removed sound may be extracted as human voice. The user identification unit 105 further extracts, for example, a feature amount used in well-known voice recognition from the sound in the frequency band of the extracted voice, and the extracted feature amount is common (the similarity of the feature amount becomes equal to or higher than the threshold value). Identify users as the same user.

When a new user is identified from the extracted voice, the user identification unit 105 issues an identification ID which is a user ID different from the registration ID described above in order to identify the user who has emitted the voice. Further, when the user identification unit 105 identifies that the extracted voice is the same as the voice of the user who has already issued the identification ID, the user identification unit 105 also assigns the issued identification ID to the user who has issued the voice.

When the user identification unit 105 identifies the user from the voice included in the ambient sound as described above, the identification ID issued for the user, the feature amount extracted from the voice, and the living sound extracted together with the voice (details). (Sound data indicating daily life sounds) is supplied to the unique information storage unit 106.

The unique information storage unit 106 stores the supplied information in association with each other, so that the specific living sound included in the ambient sound acquired by the ambient sound acquisition unit 104 and the user identification unit from the ambient sound are used. The user identified by 105 is associated and stored. The unique information storage unit 106 is an example of the "storage unit" of the present invention.

FIG. 7 shows an example of stored unique information. In the example of FIG. 7A, the unique information storage unit 106 stores the identification ID, the feature amount, the living sound, and the registration ID in association with each other. For example, the identification ID "ID001" is associated with "feature amount 1-1" and "feature amount 1-2" and the like, and "life sound 1-1" and "life sound 1-2" and the like. , "Feature amount 2-1" and the like are associated with the identification ID "ID002" and the like, "life sound 2-1" and the like.

The feature amount associated with the same identification ID, such as "feature amount 1-1" and "feature amount 1-2", is a feature amount determined by the user identification unit 105 to be a common feature amount. It represents that. “Life sound 1-1”, “life sound 1-2”, “life sound 2-1” and the like are examples of specific life sounds, respectively. At this point, all registration IDs are "not applicable".

The sound output instruction unit 107 of the server device 10 gives an instruction to output the sound prompting the user to speak to the home router 20. The sound output indicator 107 is an example of the "output indicator" of the present invention. The sound that prompts the user to speak is a home confirmation voice that inquires whether the target user is near the home router 20, for example, "Is Mr. A nearby?" As described above, since the home router 20 is installed in the house where the target user resides, the sound output by the home router 20 can be heard if the target user is at home.

The sound output instruction unit 107 instructs the output destination registered as described above for each target user to output sound at a set timing (for example, a fixed time every day). The output timing is set by, for example, a support user or a target user. The sound output instruction unit 107 homes the sound data (for example, stored in advance in the server device 10) indicating the sound in a format capable of being output (sounded) by the home router 20 and the instruction data instructing the output of the sound. This instruction is given by transmitting to the router 20.

When the sound output unit 201 of the home router 20 receives the transmitted sound data and instruction data, it outputs (sounds) the sound indicated by the sound data in accordance with the instruction indicated by the instruction data. When the sound output unit 201 outputs a sound prompting the user to speak, the sound output unit 201 notifies the peripheral sound recording unit 202 to that effect. Upon receiving this notification, the ambient sound recording unit 202 records the ambient sound for a certain period of time.

The peripheral sound acquisition unit 104 acquires the peripheral sound recorded during this fixed period, that is, the peripheral sound recorded after the output of the sound prompting the utterance, and the user identification unit 105 includes the peripheral sound thus acquired. The user is identified from the voice of the person. This makes it possible to identify a user near the home router 20 even if the home router 20 is not constantly recording.

Further, as compared with the case where the home router 20 constantly records, the load of communication between the home router 20 and the server device 10 can be reduced, and the load of user identification processing by the server device 10 can also be reduced. .. In addition, the user cannot be identified unless the user's voice is included in the ambient sound, but by outputting a sound that prompts utterance, the user's voice is included in the ambient sound as compared with the case where this sound is not output. It becomes easy to identify the user.

When the sound output instruction unit 107 instructs the output of the home confirmation voice, the user identification unit 105 indicates that the registration ID of the target user and the output destination associated with the target user are instructed to output the home confirmation voice. Notify to. When the target user hears the home confirmation voice output from the sound output unit 201, an answer affirming the inquiry such as "yes" is recorded by the peripheral sound recording unit 202, and the voice is heard by a person other than the target user. In that case, an answer denying the inquiry such as "No" is recorded by the ambient sound recording unit 202.

When the ambient sound is supplied after receiving the above notification from the sound output instruction unit 107, the user identification unit 105 recognizes the human voice included in the supplied peripheral sound by using, for example, a well-known voice recognition technique. To do. When the user identification unit 105 recognizes an answer that affirms the inquiry, the user identification unit 105 supplies the notified registration ID together with the identification ID, the feature amount, and the living sound to the unique information storage unit 106, and the operation instruction unit 101 receives a home confirmation voice. Notifies that the target user has answered.

Upon receiving the notification from the user identification unit 105, the operation instruction unit 101 gives an operation instruction to the notified target user as described above. When the registration ID is supplied from the user identification unit 105, the unique information storage unit 106 stores the registration ID in association with the identification ID supplied together (in the example of FIG. 7B, it is called "ID001". A registration ID of "UserA" is associated with the identification ID and stored).

When the user identification unit 105 recognizes the answer that the human voice is not recognized or the inquiry is denied, the user identification unit 105 supplies only the identification ID, the feature amount, and the living sound to the unique information storage unit 106. Therefore, in this case, the identification ID and the registration ID are not associated with each other. Further, in this case, the user identification unit 105 does not notify the operation instruction unit 101. Therefore, the operation instruction unit 101 does not instruct the operation.

Even if the human voice is not recognized from the ambient sound, the peripheral sound includes the living sound, and the unique information storage unit 106 has the identification ID, the living sound, and the living sound as in the example of FIG. 7B. When the registration ID is stored, the operation instruction unit 101 may determine the timing of instructing the operation based on the living sound.

Specifically, the operation instruction unit 101 gives an operation instruction to the target user when a life sound similar to a specific life sound stored in the unique information storage unit 106 is acquired in association with the target user. In that case, the user identification unit 105 supplies the living sound extracted from the ambient sound as described above to the operation instruction unit 101 together with the user ID (registration ID) of the target user associated with the home router 20.

The operation instruction unit 101 corresponds to a specific life sound stored in the unique information storage unit 106 in association with the registration ID supplied from the user identification unit 105 (in the example of FIG. 7B, “UserA””. Read the attached "life sounds 1-1" and "life sounds 1-2", etc.). The operation instruction unit 101 calculates the degree of similarity between the read specific life sound and the life sound supplied from the user identification unit 105, for example, by using a well-known voice matching technique.

For example, when the similarity calculated for any of the specific living sounds is equal to or higher than the threshold value, the operation instruction unit 101 determines that the target user has generated the living sound, that is, the target user is at home. Then, an operation instruction (output of instruction information to the fixed telephone 3 and the like) is given to the target user.

As a result, even if the target user does not speak, the operation instruction can be given when the target user is expected to be in a place where the contact terminal can be used (for example, in a house). In addition, since the operation instruction is given only when the life sound is similar to the life sound generated by the target user, the operation instruction is given to other persons unless it is judged that the life sound is similar by chance. Can be avoided.

It should be noted that the method of judging similar life sounds is not limited to this. The operation instruction unit 101 may determine that the supplied living sounds are similar, for example, when the similarity with the living sounds of a predetermined ratio among the plurality of stored living sounds is equal to or more than the threshold value. Further, for example, the operation instruction unit 101 divides the stored living sounds into groups according to the type of living sounds (footsteps, door opening / closing sounds, switch operation sounds, etc.) in advance, and determines predetermined among the living sounds of the same group. When there is a group in which the degree of similarity with the living sound of the ratio is equal to or more than the threshold value, it may be determined that the supplied living sounds are similar.

Based on the above configuration, each device included in the dementia prevention system 1 includes a determination process related to dementia of the target user, a first home determination process for determining whether or not the target user is at home by voice, and a determination process thereof. The second home-based judgment process, in which the judgment is made based on the sound of daily life, is performed.
FIG. 8 shows an example of the operation procedure of each device in the determination process. This operation procedure is started when the timing of the operation instruction to the target user comes.

First, the server device 10 (operation instruction unit 101) reads out instruction information indicating an operation instruction by voice (step S11), and outputs the instruction information to the fixed telephone 3 in this example (step S12). The fixed telephone 3 outputs an instruction voice indicated by the output instruction information (step S13). When the target user who hears the instruction voice performs the instructed operation, the first user terminal 30 (operation information detection unit 301) detects the operation information indicating the operation of a person (step S21).

Next, the first user terminal 30 (operation information transmission unit 302) transmits the detected operation information to the server device 10 (step S22). The server device 10 (operation information acquisition unit 102) acquires the transmitted operation information about the target user (step S23). Then, the server device 10 (dementia-related determination unit 103) compares the content of the operation instruction with the acquired operation information, and makes a determination related to dementia for the target user (step S24).

FIG. 9 shows an example of the operation procedure of each device in the first home determination process. This operation procedure is started when the time set as the output timing of the sound prompting the utterance is reached. First, the server device 10 (sound output instruction unit 107) reads sound data indicating a sound prompting the user to speak (step S31), and instructs the home router 20 to output the sound indicated by the read sound data. Data is transmitted to the home router 20 (step S32).

The home router 20 (sound output unit 201) outputs a sound prompting utterance according to the instruction of the transmitted instruction data (step S33). Next, the home router 20 (peripheral sound recording unit 202) records the peripheral sound for a certain period of time (step S34). Subsequently, the home router 20 (ambient sound transmission unit 203) transmits the ambient sound data indicating the recorded ambient sound to the server device 10 (step S35).

The server device 10 (ambient sound acquisition unit 104) acquires the ambient sound indicated by the transmitted ambient sound data (step S36). Next, the server device 10 (user identification unit 105) extracts voice and living sound from the acquired ambient sound (step S41), and identifies the user from the extracted voice (step S42). Subsequently, the server device 10 (unique information storage unit 106) associates the extracted living sound with the identified user and stores the extracted user as unique information (step S43).

Next, the server device 10 (user identification unit 105) recognizes the extracted voice (step S44) and determines whether or not the target user is at home (step S45). When the server device 10 determines in step S45 that the target user is at home, the operation procedure in the determination process shown in FIG. 8 is subsequently performed.

FIG. 10 shows an example of the operation procedure of each device in the second home determination process. In this operation procedure, the same operation procedure as the second home determination process shown in FIG. 9 is performed from step S31 (reading sound data) to S36 (acquisition of ambient sound). Next, the server device 10 (user identification unit 105) extracts the living sound from the acquired ambient sound (step S51). Subsequently, the server device 10 (operation instruction unit 101) calculates the degree of similarity between the living sound stored in step S43 of FIG. 9 and the extracted living sound (step S52).

Then, the server device 10 (operation instruction unit 101) determines whether or not these living sounds are similar based on the calculated similarity (step S53). If it is determined that the server device 10 is similar in step S53, it is considered that the target user is at home, and thereafter, the operation procedure in the determination process shown in FIG. 8 is performed.

In this embodiment, the target user performs the operation instructed by the server device 10, and the determination by comparing the operation performed by the target user with the instructed operation, that is, the determination based on the operation result of the target user is performed. At the time of this determination, an operation instruction is always given, so that the determination can be performed without the target user knowing the operation to be performed for the determination.

In addition, since instructions for this operation are given using a function called the telephone function that assists communication between people, those who normally use these functions can operate without having to remember any special operations. Can receive instructions. Further, in this embodiment, the contact terminal (fixed telephone 3 in this embodiment) used for instructing the operation and the detection terminal (first user terminal 30 in this embodiment) for detecting the operation information are separate terminals. is there.

If the operation instruction and the operation information detection are performed on the same terminal, for example, when the operation of shaking the terminal is instructed as in the third operation described above, the operation instruction is given during the detection of the operation information. There will be restrictions such as not being able to hear. In this embodiment, by using different terminals, for example, the operation of shaking the detection terminal while listening to the instruction from the contact terminal is performed, and the operation instruction and the operation information are detected without being subject to such restrictions. And can be done.

[2] Modifications The above-mentioned examples are merely examples of the implementation of the present invention, and may be modified as follows.

[2-1] Contact terminal (first terminal)
In the embodiment, the fixed telephone 3 is an example of a communication terminal (first terminal of the present invention) having an auxiliary function (a function of assisting communication between people), but the present invention is not limited to this. For example, since the first user terminal 30 also has a telephone function, it may be used as a communication terminal instead of or together with the fixed telephone 3. Further, when the first user terminal 30 has an e-mail function or an SNS (Social Networking Service) function, these can also be used as auxiliary functions, so that these functions may be used for operation instructions.

In that case, the operation instruction unit 101 stores the instruction information indicating the operation instruction in text in advance, and outputs the instruction information to the e-mail address of the target user or the SNS account. The target user performs an operation by looking at the instruction displayed on the first user terminal 30. As described above, any terminal may be used as a communication terminal as long as it has a function of assisting communication between people.

[2-2] Detection terminal (second terminal)
In the embodiment, the first user terminal 30 is an example of a detection terminal (second terminal of the present invention) having a function of detecting operation information, but the present invention is not limited to this. For example, the home router 20 may also be used as a detection terminal because the ambient sound recording unit 202 can acquire the clapping sound or singing of the target user as operation information.

[2-3] Operation information The operation information is not limited to that described in the examples (information indicating the sound of clapping, information indicating singing voice, information indicating acceleration or angular velocity). For example, when an operation instruction is given to go to a predetermined place and return, the operation information detection unit 301 detects the position information of the own device as the operation information.

Further, when the operation instruction to answer a predetermined question is given, the operation information detection unit 301 detects the information indicating the answer voice of the target user as the operation information. As for this question, in addition to questions asking the date, day of the week, time, etc., questions asking knowledge of kanji, history, geography, math, etc., attribute information of registered target users (date of birth, birthplace, school of origin, etc.) ) Is used.

Further, when an operation instruction to prepare a predetermined dish is given, the operation information detection unit 301 detects information indicating the sound of the dish or an image obtained by photographing the dish as the operation information. In addition, if an operation instruction to move to a predetermined place is given using transportation such as a train, the operation information detection unit 301 records the history when the transportation fee is paid by electronic money. Detect as operation information. As described above, any information may be detected as operation information as long as the information can be detected by the detection terminal.

[2-4] Sound processing terminal (third terminal)
In the embodiment, the home router 20 is an example of a terminal for sound processing (the third terminal of the present invention), but the present invention is not limited to this. For example, since the first user terminal 30 can also record ambient sounds and output sounds, it may be used as a terminal for sound processing instead of or together with the home router 20. Further, a television, a game machine, an IoT home appliance, or the like may be used as a terminal for sound processing. In short, any terminal may be used as a sound processing terminal as long as it has a recording function, a sound output function, and a communication function.

[2-5] Calling Period When the fixed telephone 3 is used for the operation instruction, the period until the target user answers the telephone may be used for the determination. The fixed telephone 3 has a function of ringing a ringing tone when starting communication between people. When the operation instruction unit 101 of the server device 10 gives an operation instruction, it first calls the telephone number of the fixed telephone 3 to make a ringing tone. The period from when the ringing tone sounds until the target user picks up the handset is set as the calling period, and the shorter the calling period, the faster the target user's action.

In this modification, it is assumed that the home router 20 is installed at a predetermined distance from the fixed telephone 3 and the distance between the terminals is registered in the dementia prevention system 1 by the support user or the target user. .. The home router 20 of this modification is an example of the "fourth terminal" of the present invention. The home router 20 was also an example of the "third terminal" of the present invention in the embodiment. In the present invention, the same terminal as the home router 20 may be used as the "third terminal" and the "fourth terminal", or different terminals may be used as the "third terminal" and the "fourth terminal". It may be used (for example, a dedicated terminal that functions as a "fourth terminal" may be provided in addition to the home router 20). For example, the dementia-related determination unit 103 of the server device 10 stores the distance between the registered terminals.

In this modification, the peripheral sound recording unit 202 of the home router 20 constantly records the peripheral sound, and the peripheral sound acquisition unit 104 continuously acquires the peripheral sound. The ambient sound acquisition unit 104 is an example of the "sound acquisition unit" of the present invention. From the ambient sound thus acquired, the user identification unit 105 extracts the feature amount of the voice when the voice is included, and extracts and extracts the living sound when the voice is not included. The information is supplied to the operation instruction unit 101.

The operation instruction unit 101 detects the approach of the target user to the home router 20 based on the information (voice feature amount or living sound) supplied from the user identification unit 105. The operation instruction unit 101 of this modification is an example of the "detection unit" of the present invention. When the voice feature amount is supplied, the operation instruction unit 101 compares it with the feature amount stored in the unique information storage unit 106 in association with the registration ID of the target user, and if the similarity is equal to or higher than the threshold value. Detects that the target user has approached the home router 20.

Further, the operation instruction unit 101 detects that the target user has approached the home router 20 when it is determined that the target user has generated the living sound when the living sound is supplied, as in the embodiment. .. When the operation instruction unit 101 detects this approach, it makes a call to the telephone number of the fixed telephone 3 to give a call instruction to ring the ringing tone of the fixed telephone 3. The operation instruction unit 101 in this case is an example of the "call instruction unit" of the present invention.

The fixed telephone 3 rings when it receives a call instruction. When the target user who has come near the home router 20 hears this ringing tone, he / she further moves to the fixed telephone 3 and picks up the handset. After that, the operation instruction unit 101 gives an operation instruction as in the embodiment. From the time when the ringing tone is heard until the handset is picked up, the peripheral sound recording unit 202 of the home router 20 records the peripheral sound including the ringing tone, so that the peripheral sound acquisition unit 104 records the peripheral sound including the ringing tone. get.

In this modification, when the operation instruction unit 101 gives a call instruction, the operation instruction unit 101 notifies the ambient sound acquisition unit 104 to that effect. Upon receiving the notification, the ambient sound acquisition unit 104 supplies the acquired ambient sound to the dementia-related determination unit 103. The dementia-related determination unit 103 identifies the period during which the ringing tone of the fixed telephone 3 is ringing based on the ringing tone included in the supplied ambient sound. The dementia-related determination unit 103 of this modified example is also an example of the “period specifying unit” of the present invention.

The dementia-related determination unit 103 stores, for example, a ringing tone pattern sound, and sets a period during which the supplied ambient sound includes a sound matching the pattern sound during the ringing tone period (ringing tone sounds). (Period of stay). In the above example, the ringing period is specified by the home router 20 recording the ringing tone of the fixed telephone 3. As a result, the ringing period can be specified even if the fixed telephone 3 which is a contact terminal does not have a special function (for example, a function of notifying an external device that a ringing tone is ringing).

The method of specifying the period is not limited to this. For example, when the fixed telephone 3 is an IP (Internet Protocol) telephone and signals are exchanged via the home router 20, the signal relayed by the home router 20 is monitored and the fixed telephone 3 rings. A signal indicating that the user may be present may be extracted and transmitted to the server device 10. When the first user terminal 30 is used as a contact terminal, the server device 10 stores the period during which the first user terminal 30 itself is ringing, and when the ringing tone is completed, the period information indicating the period is stored. The call period may be specified by sending to.

The dementia-related determination unit 103 makes a determination based on the movement speed of the target user represented by the calling period thus specified and the distance between the terminals stored as described above. The dementia-related determination unit 103 calculates and stores the movement speed of the target user from the call period and the distance between the terminals each time a call instruction is given, and stores the stored movement speed for each predetermined period (for example, 1). Calculate the average value for each month).

For example, when the average value rises above a certain rate from the previous month, the dementia-related judgment unit 103 determines that the progress of symptoms related to dementia is "improving", and when it falls below a certain rate. Determines that the progress is "deteriorating", and if the upper and lower sides are within a certain ratio, it is determined that the progress is "no change".

The determination method based on the moving speed is not limited to this. The dementia-related determination unit 103 integrates, for example, a determination result obtained by comparing the content of the instruction with the motion information and corrected based on the movement speed (for example, the slower the movement speed, the worse the determination result is corrected). It may be a good judgment result. In addition, the dementia-related determination unit 103 stores the date of the call in addition to the movement speed, calculates a linear approximation formula showing a change tendency of a predetermined number of movement speeds in the past, and the slope is positive. If it is, it may be determined as “improvement tendency”, and if it is negative, it may be determined as “deterioration tendency”.

It should be noted that the detection of the approach of the target user to the home router 20, the call instruction, the specification of the call period, and the determination based on the movement speed of the target user may be performed by a function different from the above. For example, the approach may be detected by the ambient sound acquisition unit 104 or the user identification unit 105 instead of the operation instruction unit 101. Further, a new function other than each part shown in FIG. 3 may be provided, and the function may perform those operations.

When an operation instruction is given as in the embodiment, the target user will be conscious of performing the instructed operation faithfully. On the other hand, in the case of a daily operation of picking up the handset after the ringing tone is heard, such an consciousness is less likely to occur as compared with the instructed operation, so to speak, a natural operation is performed. In this modification, the determination can be made based on the natural movement of the target user.

[2-6] Confirmation of operation information The detection terminal detects the operation information indicating the operation of the target user, but a person other than the target user hears the operation instruction, and the operation indicating the operation performed by that person. Information can also be detected. Assuming that case, it may be confirmed whether or not the detected operation information indicates the operation performed by the target user.

In this modification, when the operation information acquisition unit 102 acquires the operation information and the registration ID, they are supplied to the operation instruction unit 101. The operation instruction unit 101 gives an instruction indicated by the instruction information previously output to the output destination (for example, the fixed telephone 3) associated with the supplied registration ID as an operation instruction indicated by the supplied operation information. Judge that there is.

The operation instruction unit 101 indicates a voice (for example, "Mr. A, did you clapping your hands 10 times earlier?") Inquiring the target user indicated by the registration ID whether or not the operation was performed based on the instruction. Generates and outputs query information. In this way, the operation instruction unit 101 inquires the target user whether or not the operation indicated by the operation information acquired by the operation information acquisition unit 102 has been performed. The operation instruction unit 101 is an example of the "inquiry unit" of the present invention.

The fixed telephone 3 outputs the voice indicated by the output inquiry information. If the target user heard this voice, a positive answer such as "Yes, I did" was given, and if it was another person, a denial such as "No, I am not Mr. A". Answer will be made. The peripheral sound including these answers is recorded by the peripheral sound recording unit 202 of the home router 20 and acquired by the peripheral sound acquisition unit 104.

When the operation instruction unit 101 outputs the inquiry information, the operation instruction unit 101 notifies the ambient sound acquisition unit 104 to that effect. Upon receiving the notification, the ambient sound acquisition unit 104 supplies the acquired ambient sound to the dementia-related determination unit 103. The dementia-related determination unit 103 makes a determination regarding dementia without using motion information indicating an action indicating a motion that is answered as negative in response to an inquiry from the motion instruction unit 101 (that is, an action that is answered that the target user has not performed). ..

The dementia-related determination unit 103 has, for example, a pattern voice of a positive answer such as "yes", "yes", "yes", and a negative answer such as "no", "no", "not". It is determined whether the target user's answer is positive or negative depending on which pattern voice is included in the supplied ambient sound by memorizing the pattern voice of the answer. .. It should be noted that this determination may be made using another well-known speech recognition technique.

When the dementia-related determination unit 103 determines that the answer is positive, it makes a determination regarding dementia using the acquired motion information, and when it determines that the answer is negative, it is acquired. Dementia is judged by using the motion information obtained with other positive answers without using the motion information. As a result, it is possible to prevent the determination of the target user from being made based on the operation performed by another person.

[2-7] Information for urging utterance In the embodiment, voice data indicating a home confirmation voice was used as information for urging utterance, but the present invention is not limited to this. For example, voice data indicating a greeting, a question (quiz), a pet's bark, or the like may be used. Further, text data, image data, moving image data, or the like may be used instead of voice data. Regardless of which data is used, in short, it is sufficient that the information is transmitted to the target user and the utterance of the target user is promoted.

[2-8] User Terminal The first user terminal 30 and the second user terminal 40 are both smartphones in the examples, but the present invention is not limited to this, and for example, a mobile phone other than a smartphone may be used, or a tablet. It may be a terminal, a laptop computer, or the like. In short, any terminal can be used as long as it can realize the functions shown in FIG.

[2-9] Device for Realizing Each Part The device for realizing each function shown in FIG. 3 is not limited to the device shown in FIG. For example, a device such as a home router 20 installed in the target user's house may realize the function provided by the server device 10. Further, two or more devices may realize each function included in the server device 10. In short, as long as these functions are realized in the dementia prevention system as a whole, the dementia prevention system may be equipped with any number of devices.

[2-10] System In each of the above examples, a system that supports the prevention of dementia (dementia prevention system) has been described, but the present invention is also applicable to other systems. For example, it may be applied to a system for investigating the degree of health or physical condition, etc., depending on whether or not the instructed movement can be performed accurately, instead of preventing dementia.

[2-11] Category of Invention The present invention provides information processing devices such as a home router, a first user terminal, a second user terminal, and a server device, as well as an information processing system such as a dementia prevention system including these devices. Can also be captured. Further, the present invention can be regarded as an information processing method for realizing the processing performed by each device, and also as a program for operating a computer that controls each device. This program may be provided in the form of a recording medium such as an optical disk that stores it, or may be provided in the form of being downloaded to a computer via a network such as the Internet and installed and made available. May be done.

[2-12] Processing Procedures, etc. The order of the processing procedures, sequences, flowcharts, etc. of each embodiment described in the present specification may be changed as long as there is no contradiction. For example, the methods described herein present elements of various steps in an exemplary order, and are not limited to the particular order presented.

[2-13] Handling of input / output information and the like The input and output information and the like may be stored in a specific location (for example, a memory) or may be managed by a management table. Input / output information and the like can be overwritten, updated, or added. The output information and the like may be deleted. The input information or the like may be transmitted to another device.

[2-14] Software Software, whether referred to as software, firmware, middleware, microcode, hardware description language, or by any other name, is an instruction, instruction set, code, code segment, program code, program. , Subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, etc. should be broadly interpreted.

Further, software, instructions, and the like may be transmitted and received via a transmission medium. For example, the software uses wired technology such as coaxial cable, fiber optic cable, twisted pair and digital subscriber line (DSL) and / or wireless technology such as infrared, wireless and microwave to websites, servers, or other When transmitted from a remote source, these wired and / or wireless technologies are included within the definition of transmission medium.

[2-15] Information, Signals The information, signals and the like described herein may be represented using any of a variety of different techniques. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description are voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, light fields or photons, or any of these. It may be represented by a combination of.

[2-16] Systems, Networks The terms "system" and "network" as used herein are used interchangeably.

[2-17] Meaning of "based on" The term "based on" as used herein does not mean "based on" unless otherwise stated. In other words, the statement "based on" means both "based only" and "at least based on".

[2-18] "and", "or"
In the present specification, for configurations that can be implemented by either "A and B" or "A or B", the configuration described in one expression may be used as the configuration described in the other expression. For example, when "A and B" are described, they may be used as "A or B" as long as they are not inconsistent with other descriptions and can be implemented.

[2-19] Variations of Aspects, etc. Each of the examples described in the present specification may be used alone, in combination, or switched with execution. Further, the notification of predetermined information (for example, the notification of "being X") is not limited to the explicit one, but is performed implicitly (for example, the notification of the predetermined information is not performed). May be good.

Although the present invention has been described in detail above, it is clear to those skilled in the art that the present invention is not limited to the examples described herein. The present invention can be implemented as modifications and modifications without departing from the spirit and scope of the invention as defined by the claims. Therefore, the description of the present specification is for the purpose of exemplification and does not have any limiting meaning to the present invention.

1 ... Dementia prevention system, 3 ... Fixed telephone, 10 ... Server device, 20 ... Home router, 30 ... First user terminal, 40 ... Second user terminal, 101 ... Operation instruction unit, 102 ... Operation information acquisition unit, 103 ... Dementia-related determination unit, 104 ... Peripheral sound acquisition unit, 105 ... User identification unit, 106 ... Unique information storage unit, 107 ... Sound output indicator unit, 201 ... Sound output unit, 202 ... Peripheral sound recording unit, 203 ... Peripheral Sound transmission unit, 301 ... Operation information detection unit, 302 ... Operation information transmission unit, 401 ... Judgment result request unit, 402 ... Judgment result display unit.

Claims (4)

An operation instruction unit that instructs the target user to perform an operation using the function of the first terminal having a function of assisting communication between people.
An operation acquisition unit that acquires the operation information about the target user who has performed an operation in response to the instruction from a second terminal having a function of detecting operation information indicating a person's operation.
A determination unit that compares the content of the instruction with the acquired operation information to make a determination regarding the target user, and a determination unit .
A sound acquisition unit that acquires ambient sound recorded by a third terminal that has a function to record ambient sound,
An identification unit that identifies the user from the human voice included in the acquired ambient sound,
It is provided with a storage unit that stores the life sound included in the acquired peripheral sound and the user identified from the peripheral sound in association with each other.
The operation instruction unit is an information processing device that gives an instruction when a life sound similar to the life sound stored in association with the target user is acquired. Before Symbol third terminal has a function of outputting a sound,
It is provided with an output instruction unit that gives an instruction to output a sound prompting the user's utterance to the third terminal.
The information processing device according to claim 1 , wherein the identification unit performs the identification from a human voice included in the peripheral sound recorded after the output of the sound prompting the utterance. An operation instruction unit that is installed at a specific position, has a function of assisting communication between people, and instructs a target user to perform an operation by using the function of the first terminal that sounds a ringing tone when the communication is started. ,
An operation acquisition unit that acquires the operation information about the target user who has performed an operation in response to the instruction from a second terminal having a function of detecting operation information indicating a person's operation.
A determination unit that compares the content of the instruction with the acquired operation information to make a determination regarding the target user, and a determination unit.
A detection unit that detects the approach of the target user to the fourth terminal based on information acquired from the fourth terminal installed at a predetermined distance from the first terminal.
A ringing instruction unit that gives an instruction to sound the ringing tone of the first terminal when the approach is detected, and
It is provided with a period specifying unit for specifying the period during which the ringing tone of the first terminal is ringing.
The determination unit is an information processing device that makes a determination based on the movement speed of the target user represented by the predetermined distance and the specified period. Before Symbol fourth terminal has a function to record the ambient sound,
A sound acquisition unit for acquiring ambient sounds recorded by the fourth terminal is provided.
The information processing device according to claim 3 , wherein the period specifying unit specifies the period based on the ringing tone included in the acquired ambient sound.

Images