JP6997035B2 - Information provision system, information processing equipment and programs - Google Patents

Description

The present invention relates to an information providing system, an information processing device and a program.

The following biometric information management systems are known. That is, the biometric information management system records the biometric information measured by a plurality of biometric information measuring means provided inside and outside the home in association with the subject. The biometric information management system proposes a subject's meal menu, exercise menu, and bathing menu based on the recorded biometric information (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2000-126138

For example, when a family lives together in the same living space, the members of the family are different in gender, generation, etc., such as father, mother, children, and grandfather and grandmother. For this reason, the information required for the members in daily life differs for each member. Considering this, under a service that provides information to a group of multiple members, such as a family member, the necessary information is individually provided for each member. Is preferable.
However, in the configuration of Patent Document 1, common items such as a meal menu, an exercise menu, a bathing menu, and the like are only proposed for each member.

The present invention has been made in view of such circumstances, and is supported for each member under the service of providing information based on the information detected regarding the members to a group of a plurality of members. The purpose is to provide the necessary information individually.

One aspect of the present invention for solving the above-mentioned problems is provided in a certain space, and corresponds to one or more sensors for detecting a predetermined object, an information processing apparatus, and a user corresponding to the certain space. The information processing device includes a user terminal device, and the information processing device includes a detection information acquisition unit that acquires detection information output from the sensor, and a plurality of users based on the detection information acquired by the detection information acquisition unit. It is provided with an analysis unit that executes analysis corresponding to the analysis item individually set in the above, and an information output unit that outputs information provided based on the analysis result of the analysis item for each user to a predetermined user terminal device. The user terminal device is an information providing system including an information presenting unit that outputs the provided information output from the information output unit to the user.

One aspect of the present invention includes a detection information acquisition unit that is provided in a certain space and acquires detection information output from one or more sensors that detect a predetermined target, and detection information acquired by the detection information acquisition unit. The analysis unit that executes the analysis corresponding to the analysis item individually set for each of a plurality of users and the information provided based on the analysis result for the analysis item for each user correspond to the certain space. It is an information processing device including an information output unit that outputs to a predetermined user terminal device among the user terminal devices corresponding to the user.

One aspect of the present invention is a detection information acquisition unit, which is equipped with a computer in a certain space and acquires detection information output from one or more sensors that detect a predetermined target, and is acquired by the detection information acquisition unit. An analysis unit that executes analysis corresponding to analysis items individually set for each of a plurality of users based on the detection information, and information provided based on the analysis results for the analysis items for each user corresponds to the certain space. It is a program for functioning as an information output unit to be output to a predetermined user terminal device among the user terminal devices corresponding to the user.

As described above, according to the present invention, under the service of providing information based on the information detected regarding the member members to a group of a plurality of member members, each member member can be individually dealt with individually. The effect of being able to provide the necessary information can be obtained.

It is a figure which shows the configuration example of the information provision system in this embodiment. It is a figure which shows the structural example of the sensor in this embodiment. It is a figure which shows the structural example of the information processing apparatus in this embodiment. It is a figure which shows an example of the user information in this embodiment. It is a figure which shows the configuration example of the user terminal apparatus in this embodiment. It is a flowchart which shows the example of the processing procedure executed by the information processing apparatus in this embodiment. It is a flowchart which shows the example of the processing procedure executed by the information processing apparatus in this embodiment.

[Overall configuration example of information provision system]
FIG. 1 shows an overall configuration example of the information providing system 1 in the present embodiment. The information providing system 1 in the figure includes n sensors 100 (100-1 to 100-n), an information processing device 200, and an input / output device 300 provided in a living space 10 (an example of a constant space). Further, the information providing system 1 includes user terminal devices 400 (400-1 to 400-4) possessed by users U (U-1 to U-4) residing in the living space 10.

Specifically, the living space 10 in the present embodiment may be a house. In this case, the house as the living space 10 may include not only the inside of the house but also a garden outside the house, an entrance, and the like, for example, in the case of the site as a house.

The figure shows an example in which four users U-1 to U-4 live in the living space 10. Specifically, in the following description, the four users U are family members, user U-1 is a father, user U-2 is a mother, user U-3 is a child, and user U-4 is a grandfather (even a grandmother). Good) is taken as an example.
In the figure, the case where the user U-2 and the user U-4 exist in the living space 10 and the user U-1 and the user U-3 exist outside the living space 10 is shown. ing. This means that if the user U goes in and out of the living space 10 in daily life and possesses the user terminal device 400, he / she will be provided with the information provided later even outside the living space 10. It shows that it is possible.

Each of the sensors 100 is installed at a predetermined place in the living space and detects a predetermined detection item. Specifically, the sensors 100-1 to 100-n include cameras, microphones, and various biometric information sensors.

The sensor 100 as a camera takes an image of the surrounding environment in a certain imaging range. That is, the sensor 100 as a camera detects the field of view range corresponding to the installed position and direction as a detection target, and obtains a captured image as detection information. As the sensor 100 as a camera, in order to obtain a high-quality captured image, a sensor 100 that outputs a captured image using images captured by a plurality of cameras, such as a dual camera, may be used. .. Further, as the sensor 100 as a camera, for example, a line sensor that can obtain a high-definition captured image may be used.

The sensor 100 as a microphone collects ambient sound. That is, the sensor 100 as a camera detects the ambient sound according to the installed position and the set directivity as the detection target, and obtains an audio signal as the detection information.

Each of the sensors 100 as a biometric information sensor detects predetermined biometric information. The sensor 100 as a biological information sensor includes a body composition sensor for measuring body weight, body fat percentage, and the like, an odor sensor for detecting odor, and the like.
Further, the sensor 100 as a biological information sensor includes a body temperature sensor that measures body temperature using, for example, thermography, a heart rate sensor that detects heart rate per unit time using a millimeter-wave radar, and blood oxygen using infrared rays. A blood oxygen concentration sensor for detecting the concentration and a respiratory rate sensor for detecting the respiratory rate per unit time using a millimeter-wave radar may be included. Further, the sensor 100 as a biological information sensor may include a urine / stool sensor that detects a predetermined test item from urine or stool.

Each of the sensors 100 transmits (outputs) the detection information obtained by the sensor 100 to the information processing apparatus 200. The communication between the sensor 100 and the information processing device 200 may be wired or short-range wireless communication.

The information processing apparatus 200 performs an analysis corresponding to a predetermined item for each user U based on the detection information transmitted from the sensor 100. The information processing apparatus 200 generates information provided to a predetermined user U based on the analysis result.
The provided information is information to be provided to at least one predetermined user U. Specific examples of the provided information will be described later.

The information processing device 200 transmits (outputs) the generated provided information to a predetermined user terminal device 400.
The information provided from the information processing device 200 to the user terminal device 400 is transmitted via the gateway GW. The gateway GW in the figure has a repeater for communicating between the wireless LAN router and the external network NW.
For example, when the user terminal device 400 exists in the living space 10, the provided information transmitted from the information processing device 200 is transmitted to the user in the living space 10 via the wireless LAN router of the gateway GW. It is transmitted to the terminal device 400. Further, when the user terminal device 400 exists outside the living space 10, the provided information transmitted from the information processing device 200 is transmitted from the repeater of the gateway GW to the living space 10 via the network NW. It is transmitted to the outside user terminal device 400.

Further, the information processing device 200 is connected to the input / output device 300. The input / output device 300 functions as an input device capable of performing an input operation on the information processing device 200 by the user. Further, the input / output device 300 may output the provided information transmitted from the information processing device 200 so as to be presented to the user U in the living space 10. The information provided by the input / output device 300 may be presented by display or voice.
The input / output device 300 may be, for example, an input device such as a mouse, a keyboard, a touch panel, a microphone, a display device, a sound output device (including a voice signal amplifier circuit, a speaker, etc.) and the like. Further, the input / output device 300 may be a smart speaker or the like.

The user terminal device 400 receives the provided information transmitted from the information processing device 200, displays the received provided information, and outputs the received provided information by voice or the like. As a result, information is provided to the user U. Further, the user U can perform operations related to various settings required in the information providing system by operating the user terminal device 400. Functions such as output of information provided by the user terminal device 400 and operations related to various settings are realized by the information providing application installed in the user terminal device 400.

[Sensor configuration example]
FIG. 2 shows a configuration example of the sensor 100. The sensor 100 in the figure includes a detection unit 101 and a communication unit 102.

The detection unit 101 detects the detection target and outputs the detection information indicating the detection result. When the sensor 100 is a camera, the detection unit 101 includes a lens, an image pickup element, and the like, and performs image pickup to obtain detection information as an image pickup image. In this case, the detection unit 101 may include a dual camera, a line sensor, or the like, as described above.
Further, when the sensor 100 is a microphone, the detection unit 101 collects sound and obtains detection information as an audio signal.

The communication unit 102 communicates with the information processing device 200 to transmit the detection signal output from the detection unit 101 to the information processing device 200. The communication unit 102 may be configured to support wired communication or may be configured to support wireless communication. As the wireless communication, for example, a predetermined short-range wireless communication such as Bluetooth (registered trademark) may be adopted.

[Configuration example of information processing device]
FIG. 3 shows a configuration example of the information processing apparatus 200. The information processing device 200 in the figure includes a sensor-compatible communication unit 201, a network-compatible communication unit 202, an input / output interface unit 203, a control unit 204, and a storage unit 205.

The sensor-compatible communication unit 201 communicates with the sensor 100.
The network-compatible communication unit 202 performs communication corresponding to the network NW via the gateway GW.

The sensor-compatible communication unit 201 and the network-compatible communication unit 202 include circuits corresponding to their respective communications.
The input / output interface unit 203 inputs / outputs information between the information processing device 200 and the external device corresponding to the user interface. In correspondence with FIG. 1, the input / output interface unit 203 is connected to the input / output device 300.

The control unit 204 executes various controls in the information processing apparatus 200. The function as the control unit 204 is realized by executing a program by a CPU (Central Processing Unit) provided in the information processing apparatus 200.
The control unit 204 in the figure includes a detection information acquisition unit 241, a detection information processing unit 242, an individual recognition unit 243, an analysis unit 244, and an information output unit 245.

The detection information acquisition unit 241 acquires the detection information output from the sensor 100. The detection information transmitted from the sensor 100 is received by the sensor-compatible communication unit 201. The detection information acquisition unit 241 acquires the detection information received by the sensor-compatible communication unit 201.

The detection information processing unit 242 processes the predetermined detection information among the detection information acquired by the detection information acquisition unit 241.
As a specific example of processing, the detection information processing unit 242 may extract the subject (person, food, etc.) to be analyzed by the analysis unit 244 for the detection information as the captured image. Further, when extracting the subject, the detection information processing unit 242 extracts a high-quality image from, for example, a plurality of captured images obtained by different cameras (sensor 100) and a plurality of captured images obtained by capturing images at different times. The subject may be extracted.
Further, the detection information processing unit 242 may, for example, remove noise and extract an audio signal component to be analyzed by the analysis unit 244 for the detection information as an audio signal.
Further, the detection information processing unit 242 may also remove noise from the detection information from the sensor 100 as the biological information sensor.

The personal recognition unit 243 executes personal recognition using the detection information acquired by the detection information acquisition unit 241 and the predetermined detection information (including the detection information after processing by the detection information processing unit 242). The individual recognition here is a process of recognizing an individual for each user U residing in the living space 10. The personal recognition unit 243 can perform personal recognition based on an image of a person extracted from the detection information as a captured image. The individual recognition based on the image of a person may be the individual recognition based on the face image or the individual recognition based on the whole body image.
Further, the personal recognition unit 243 can perform personal recognition based on the component of the human voice extracted from the detection information as the voice signal. Further, the personal recognition unit 243 can perform personal recognition based on the detection information about the odor detected by the sensor 100 as the odor sensor. In the example of FIG. 1, the individual recognition unit 243 recognizes an individual corresponding to each of the four users U-1 to U-4.

In individual recognition, the individual recognition unit 243 may also recognize, for example, the gender, height, age group, etc. of each individual. In this case, the individual recognition unit 243 constitutes a family for each recognized individual, such as a father, mother, child (son, daughter), grandfather, etc., based on the gender, age group, etc. of each recognized individual. You may also be aware of which of the personnel you are in.

The analysis unit 244 corresponds to analysis items individually set for each of a plurality of users U based on the detection information acquired by the detection information acquisition unit 241 (including the detection information after processing by the detection information processing unit 242). Perform the analysis.
The information output unit 245 outputs the provided information based on the analysis result of the analysis item for each user U to the predetermined user terminal device 400.
Examples of the analysis items individually associated with each user and the provided information output by the information output unit 245 based on the analysis result may be related to health or the like, and specific examples will be described later.

The storage unit 205 is configured to include a storage device, and stores various types of information corresponding to the information processing device 200. The storage unit 205 in the figure includes a detection information storage unit 251, an analysis information storage unit 252, a user information storage unit 253, and a detection analysis history storage unit 254.

The detection information storage unit 251 stores the detection information (including the detection information obtained by processing by the detection information processing unit 242) acquired by the detection information acquisition unit 241. By accumulating the detection information according to the time series by the detection information storage unit 251, the analysis unit 244 not only performs the analysis having real-time property based on the detection information acquired at any time by the detection information acquisition unit 241 but also the past. It is also possible to perform analysis using the detection information from to the present.
The analysis information storage unit 252 stores the information of the analysis result by the analysis unit 244.

The user information storage unit 253 stores user information for each user U.
FIG. 4 shows an example of user information stored in the user information storage unit 253. The figure shows an example of user information corresponding to each user U-1 to U-4. One record (one line) in the figure is user information corresponding to one user U. The user information corresponding to one user U includes each area of a user identifier, a user feature amount, a user profile, and feedback setting information.
The area of the user identifier stores the user identifier indicating the corresponding user.
The area of the user feature amount stores the feature amount corresponding to the personal recognition of the corresponding user.

The personal recognition unit 243 recognizes an individual as a user U as a result of executing personal recognition processing based on feature quantities extracted from, for example, captured images, sounds, odors, etc. detected by the sensor 100. A user identifier is given for. The user identifier given when the corresponding user U is recognized is stored in the user identifier area in the user information, and the feature amount area is extracted when the corresponding user U is recognized. Features are stored. The feature amount information stored in the feature amount area may be appropriately updated according to changes according to the aging of the user U and the like.

Further, in the figure, the user profile area stores the user profile information. The user profile information stored in the user profile area is, for example, a personnel classification indicating which member in the family structure (that is, father, mother, child (son, daughter), grandfather, etc.). Information indicating), gender, age (or age group), and other basic information about the user U may be stored.
Information such as personnel classification, gender, and age in such user profile information may be acquired by inputting by an operation on the input / output device 300 by the user U or an operation on the user terminal device 400. In this case, for example, the input / output device 300 or the user terminal device 400 displays the face image of the user U recognized by the personal recognition unit 243, and displays the user profile of the user U corresponding to the displayed face image. Display the input screen for input. The user U performs an operation of inputting information such as personnel classification, gender, and age on the input screen. Further, in this case, the name (may be a nickname) of the user U can be input as one of the user profile information.

The area of the feedback setting information stores information (feedback setting information) regarding the setting of the presentation of the provided information corresponding to the corresponding user U. As for the feedback setting information, for example, what kind of analysis items are set for the corresponding user U, and which user terminal device 400 should be notified (provided) of the provided information corresponding to each analysis item. This is information indicating.

In the figure, an example of feedback setting information corresponding to one user U is shown. The figure shows an example in which three feedback setting information corresponding to each of the analysis item 1, the analysis item 2, and the analysis item 3 is stored. In one feedback setting information, the notification destination information is associated with the analysis item. The notification destination information in one feedback setting information may be indicated by a plurality of user terminal devices 400 as notification destinations.

The explanation is returned to FIG. The detection analysis history storage unit 254 stores the detection analysis history. In the detection analysis history, the detection information obtained in the past and the information related to the analysis result (analysis result-related information) are stored. The analysis result-related information may be information indicating the analysis result by the analysis unit 244, or may be information provided based on the analysis result.
The detection / analysis history storage unit 254 may accumulate, for example, all the detection information and the analysis result-related information obtained so far. However, it may be difficult to store all of the detection information and analysis result-related information obtained so far due to the limitation of the storage capacity of the storage device corresponding to the storage unit 205.
Therefore, the control unit 204 (an example of the storage control unit) may store, for example, representative value information (representative detection analysis history) of the detection information and the analysis result-related information in the detection analysis history storage unit 254. Such a representative detection analysis history may be an average value at regular intervals, a moving average value, a value at a time when a remarkable change is shown at regular intervals, and the like. If the information corresponding to such a representative value is stored as the detection / analysis history, the storage capacity of the storage device corresponding to the detection / analysis history storage unit 254 can be saved.
The control unit 204 may transmit the representative detection analysis history stored in the detection analysis history storage unit 254 to the user terminal device 400, for example, in response to a request from the user terminal device 400. The user terminal device 400 may output the received representative detection analysis history so that, for example, a change according to a time series is presented. As an example, the user U performs an operation for requesting a detection analysis history indicating a state related to the past health state of himself / herself or another user to the user terminal device 400, and the user terminal device 400 relates to the past health state. The status can be displayed. As a result, the user can easily grasp the past health condition of himself / herself or other users.

In FIG. 5, the user terminal device 400 includes a communication unit 401, a control unit 402, a storage unit 403, an input interface unit 404, and an output interface unit 405.

The communication unit 401 executes communication via the network NW.

The control unit 402 executes various controls in the user terminal device 400. The function as the control unit 402 is realized by the CPU included in the user terminal device 400 executing a program.
The control unit 402 in the figure includes an application-corresponding processing unit 421 (an example of an information presentation unit). The application correspondence processing unit 421 executes various functions corresponding to the information providing application installed in the user terminal device 400. That is, the function as the application-corresponding processing unit 421 is realized by the CPU included in the user terminal device 400 executing the program of the installed information providing application.

The application correspondence processing unit 421 outputs the provided information received from the information processing apparatus 200 to the user U by display, voice, or the like. Further, the application correspondence processing unit 421 accepts operations performed regarding various settings required in the information providing system. The application correspondence processing unit 421 transmits information indicating the setting contents corresponding to the received operation to the information processing apparatus 200. The information processing apparatus 200 stores the setting contents indicated by the received information in the storage unit 205. The information set in this way includes, for example, information of a predetermined item in the user profile stored in the user information storage unit 253. Further, the application-corresponding processing unit 421 may store the application-corresponding processing unit 421 in its own storage unit 403 depending on the setting contents according to the received operation.

The storage unit 403 stores various information corresponding to the user terminal device 400, including a program of an information providing application.

The input interface unit 404 is a part of the input / output in the user interface corresponding to the input. The input interface unit 404 includes, for example, various physical keys and input devices included in the user terminal device 400. The input device may include a touch panel, a microphone, a camera and the like.

The output interface unit 405 is a part of the input / output in the user interface corresponding to the input. The output interface unit 405 may include, for example, a display device included in the user terminal device 400 and an audio output unit (audio signal amplification circuit, speaker, earphone terminal, etc.).

[Processing procedure example]
With reference to the flowchart of FIG. 6, it is a flowchart showing an example of a processing procedure executed by the information processing apparatus 200 in response to the reception of the detection information transmitted from the sensor 100. The process shown in the figure is performed under the condition that the user information corresponding to each member of the family corresponding to the living space 10 is stored in the user information storage unit 253. Further, the process of the figure is executed, for example, at predetermined fixed time intervals.

Step S101: In the information processing apparatus 200, the detection information acquisition unit 241 acquires the detection information transmitted from each sensor 100.

Step S102: When the detection information acquired in step S102 is recognizable by an individual, the individual recognition unit 243 executes personal recognition based on the acquired detection information. As a specific example, when the acquired detection information is a captured image, personal recognition is possible if the captured image includes an image of a person. In addition, personal recognition is possible if the voice signal includes a voice uttered by a person. In addition, personal recognition is possible based on the odor of a person detected by the odor sensor.
The personal recognition in step S102 is a process of recognizing which of the family members indicated in the user information stored in the user information storage unit 253 is the user U corresponding to the acquired detection information. For this purpose, the personal recognition unit 243 obtains the similarity between the feature amount extracted from the acquired detection information and the user feature amount for each user U stored in the user information, and obtains a certain degree of similarity or more. It is recognized that the person corresponding to the user feature amount is the user U corresponding to the detection information acquired this time. In step S102, a plurality of users U may be recognized at the same time.

Step S103: The detection information acquisition unit 241 discriminates whether or not the detection information acquired in step S101 is the information necessary for the analysis according to the individual recognized in step S102.
For example, the detection information acquisition unit 241 specifies the type of detection information required for analysis corresponding to each user U by referring to the feedback setting information for each user U stored in the user information storage unit 253. .. The detection information acquisition unit 241 discriminates that among the detection information detected in step S102, the same detection information necessary for the analysis to be performed corresponding to the individual recognized in step S102 is necessary, and is different. Discriminate that things are unnecessary.
Then, the detection information acquisition unit 241 may discard the detection information determined to be unnecessary.

Step S104: The detection information processing unit 242 processes the detection information discriminated as necessary in step S103 that needs to be processed. As for the processing of the detection information, for example, as described above, extraction of the subject necessary for analysis from the captured image, extraction of a high-quality image, extraction of the voice signal component to be tail-analyzed, noise removal, and as a biometric information sensor. Noise removal and the like for the detection information from the sensor 100 can be mentioned.

Step S105: The detection information acquisition unit 241 stores the detection information discriminated as necessary in step S103 in the detection information storage unit 251 in correspondence with the individual recognized in step S102. The detection information acquisition unit 241 may store the detection information discriminated as unnecessary in step S105 in the detection information storage unit 251 without discarding it.

The processing of the detection information by the detection information processing unit 242 may be executed in advance in step S102 before step S104, targeting the detection information used for personal recognition in step S102.

An example of a processing procedure executed by the information processing apparatus 200 in connection with the output of the provided information will be described with reference to the flowchart of FIG. 7. The process shown in the figure is a process executed in connection with the output of the provided information corresponding to a predetermined analysis item (FIG. 4) among the provided information corresponding to one user U.
Step S201: First, the analysis unit 244 refers to the feedback setting information of the target user from the feedback setting information stored in the user information storage unit 253.
Step S202: The analysis unit 244 corresponds to the target user U in this time based on the feedback setting information referred to in step S201, and the analysis unit 244 is required to analyze the analysis item to be the target this time. Judge the type of. The analysis unit 244 acquires the detection information of the type determined to be necessary for the analysis from the detection information associated with the target user stored in the detection information storage unit 251.
Step S203: The analysis unit 244 executes the analysis using the detection information acquired in step S202.
Step S204: The analysis unit 244 stores the information indicating the analysis result in step S203 in the analysis information storage unit 252.
Step S205: The information output unit 245 outputs the provided information. That is, the information output unit 245 generates the provided information about the target user based on the analysis result stored in step S204. The information output unit 245 transmits the generated provided information to a predetermined user terminal device 400. Here, the information output unit 245 transmits the provided information to the user terminal device 400 indicated by the notification destination information associated with the analysis item targeted for analysis this time in the feedback setting information referred to in step S201. do.

[Specific example of providing information output]
(1st example)
Depending on the process shown in FIGS. 6 and 7, the analysis unit 244 in the information processing apparatus 200 can analyze, for example, a health state, a dietary state, a stress state, a growth state, a beauty state, and the like for each user U. .. Then, the information output unit 245 can output information indicating analysis results such as a health state, a dietary state, a stress state, a growth state, and a beauty state as provided information. Further, the information output unit 245 can output information regarding a proposal for improving the state as provided information based on the analysis results of the various states described above.

As one specific example, regarding the user U-1 who is a father, the case where the analysis items according to the diagnosis of the health condition, especially the lifestyle-related disease, are set for the feedback setting information will be given as an example. Further, the notification destination indicated by the notification destination information in the same feedback setting information is set as, for example, the user terminal device 400-1 of the user U-1 who is the father.

Such feedback setting information, for example, because the user U-1 who is the father was conscious of the prevention of his / her own lifestyle-related disease, the self-confidence of the user U-1 with respect to the user terminal device 400-1 and the input / output device 300. It can be set by performing an operation. Alternatively, the information processing apparatus 200 may set such feedback setting information based on the information such as the age group shown in the user profile information in the user information stored corresponding to the user U-1. .. Alternatively, it corresponds to the case where the information processing apparatus 200 determines that the lifestyle determined based on the detection information obtained corresponding to the user U-1 so far is not of good quality based on the learning process or the like. Then, such feedback setting information may be set.

In this case, the detection information acquisition unit 241 of the information processing apparatus 200 corresponds to the individual recognized as the user U-1 who is the father, and has a body composition (weight, body fat ratio, etc.), heart rate, and blood pressure monitor. The detection information storage unit 251 stores the detection information such as the blood pressure measured by the above as the detection information necessary for the analysis.
Further, the detection information acquisition unit 241 in this case may also acquire an image captured by capturing the meal of the user U-1 in response to the improvement of eating habits for preventing lifestyle-related diseases.

Then, the analysis unit 244 analyzes the detection information stored as described above, and determines, for example, the degree of symptoms as a lifestyle-related disease.
In addition, the analysis unit 244 may analyze the menu contents, calories, nutrient balance, water content, salt content, etc. of the meal by using the captured image of the meal. In the present embodiment, as the captured image, for example, an image captured by a dual camera or a line sensor as described above is used, or a high-quality image is obtained by processing, so that the meal prepared by the analysis unit 244 is prepared. It is possible to improve the accuracy of specifying the content. From the analysis result regarding such a diet, for example, the influence on lifestyle-related diseases from the aspect of eating habits can be determined.
The information output unit 245 provides information that presents the degree of the determined symptom based on the analysis result of the analysis unit 244 and the content of the improvement proposal (including the meal content) according to the degree of the symptom. To generate. The information output unit 245 transmits the generated provided information to the user terminal device 400-1 of the user U-1 (father), which is the notification destination indicated by the notification destination information in the corresponding feedback setting information.
The user U-1 (father) can easily know his / her symptoms and improvement measures by displaying the received provided information on the user terminal device 400-1 and checking the displayed contents. ..

(2nd example)
Further, for example, user U-1 (father) is in an environment where stress is likely to be given at work or the like.
Therefore, as one of the specific examples, the analysis item related to the diagnosis of the stress state of the user U-1 (father) can be set as the feedback setting information corresponding to the user U-1 (father). Further, as the notification destination information in the feedback setting information in this case, the case of the user U-2 (mother) is taken as an example. That is, the feedback setting information in this case is set in response to the situation where the stress state of the user U-1 (father) is observed by the wife user U-2 (mother).

In this case, the detection information acquisition unit 241 of the information processing apparatus 200 corresponds to the individual recognized as the user U-1 (father), and the captured image including the user U-1 and the voice of the user U-1. The detection information storage unit 251 stores detection information used as a material for determining a stress state, such as a signal, a heart rate detected for the user U-1, a respiratory rate, and the like.
In this case, for the captured image, the stress state can be determined from the facial expression extracted from the face image of the user U-1. Further, for the voice signal, the stress state can be determined from the tone of the voice of the user U-1. In addition, the stress state can be determined based on the state of disorder regarding the heart rate, the respiratory rate, and the like.

Then, the analysis unit 244 analyzes the detection information stored as described above and determines the stress state.
The information output unit 245 generates provided information indicating, for example, a determined stress state (which may further include information indicating measures for stress relief) based on the analysis result of the analysis unit 244. The information output unit 245 transmits the generated provided information to the user terminal device 400-2 of the user U-2 (mother), which is the notification destination indicated by the notification destination information in the corresponding feedback setting information.
The user U-1 (mother) displays the received provided information on the user terminal device 400-2, and confirms the displayed contents to stress the user U-2 (father) who is her husband. You can easily grasp the state.

(3rd example)
Also, in the family, parents are concerned about whether their children are growing physically. Therefore, as one of the specific examples, the analysis item related to the diagnosis of the growth state of the user U-3 (child) can be set as the feedback setting information corresponding to the user U-3 (child). Further, as the notification destination information in the feedback setting information in this case, the case where the parent user U-1 (father) and the user U-2 (mother) are taken as an example.

In this case, the detection information acquisition unit 241 of the information processing apparatus 200 corresponds to the individual recognized as the user U-3 (child), the captured image including the user U-3, and the weight of the user U-1. The detection information storage unit 251 stores the detection information used as a material for determining physical growth. In this case, the analysis unit 244 can estimate the height based on the image of the whole body of the user U-3 in the captured image.

The analysis unit 244 is based on information such as the height and weight estimated based on the detection information stored as described above, the height and weight estimated in the past, and the age indicated by the user profile information in the user information. , Perform an analysis on the growth of user U-3 (children). For example, the analysis unit 244 can determine whether or not the growth state according to the passage of days is favorable. In addition, the analysis unit 244, together with the analysis on growth, provides information on the diet of the user U-3 (child) based on the captured image (menu content, calories, nutrient balance, water content, salt content, meal intake time). Etc. may be determined and associated with the state of growth.

The information output unit 245 generates provided information indicating information on the growth of the child based on the analysis result of the analysis unit 244. The information output unit 245 sends the generated provided information to the user terminal device 400-1 of the user U-1 (father) and the user U-2 (mother), which are the notification destinations indicated by the notification destination information in the corresponding feedback setting information. ) Is transmitted to the user terminal device 400-2.
The parents, user U-1 (father) and user U-1 (mother), display the received provided information on the user terminal device 400-1, and confirm the displayed contents to grow the child. You can easily check the state of. In addition, when the contents related to meals are associated and presented in the provided information, the user U-1 (father) and the user U-1 (mother) are related to the growth of the child, and the eating habits of the child. You can also check if it is appropriate and improve your eating habits.

(4th example)
In addition, the user U-2 (mother) is interested in beauty such as skin and body shape related to herself. Therefore, as an example, feedback setting information of analysis items related to beauty may be set corresponding to the user U-2 (mother). The notification destination indicated by the notification destination information in the feedback setting information in this case is, for example, the case where the user terminal device 400-2 of the user U-2 (mother) is taken as an example.

In this case, the detection information acquisition unit 241 acquires the detection information such as the captured image, the body weight, and the body fat percentage corresponding to the user U-2 (mother), and stores the detection information in the detection information storage unit 251.
The analysis unit 244 determines the skin condition of the user U-2 (mother) by using the captured image in the stored detection information. Further, the analysis unit 244 determines the state related to the body shape of the user U-2 (mother) by using the information such as the captured image, the body weight, and the body fat percentage in the stored detection information. Among the determinations of the state related to such a body shape, for example, the degree of deviation of the body shape of the user U-2 (mother) from the standard body shape (or the target body shape set manually or automatically) according to the age, etc., and the user U -2 (Mother) may include changes according to the passage of days. Further, the analysis unit 244 recognizes and recognizes, for example, the contents of the user's meal (menu contents, calories, nutrient balance, water content, salt content), etc. from the captured image of the meal of the user U-2 (mother). You may evaluate the content of the meal.
Then, the information output unit 245 generates information on the body shape determined by the analysis unit 244, provision information reflecting the evaluation result of the meal content, an improvement plan, and the like, and notifies the generated provision information to the notification destination information. Is transmitted to the user terminal device 400-2 of the user U-2 (mother) indicated by. As a result, the user U-2 (mother) can easily obtain information on his / her beauty in daily life and use it to enhance his / her beauty.

(5th example)
In addition, the user U-4 (grandfather) is worried that he may not be able to move due to sudden illness or injury such as a fall and a broken bone. Therefore, as one specific example, feedback setting information may be set with the analysis item of determining whether or not the user U-4 (grandfather) is in a state of being stuck in the living space 10. Further, in the notification destination information in this feedback setting information, for example, user terminal devices 400-1, 400 such as user U-4 (grandfather) son, user U-1 (father) and user U-2 (mother) who are daughters. -2 etc. is set as the notification destination.

In this case, the detection information acquisition unit 241 acquires and detects detection information as biological information such as an image captured by the user U-4 (grandfather), a heart rate of the user U-4 (grandfather), and the like. It is stored in the information storage unit 251.
Then, the analysis unit 244 determines, for example, the presence or absence of an abnormality in the user U-4 by using the detected information as the stored captured image. For example, the user U-4 (grandfather) has changed from being in a state of moving in the living space 10 to being lying on the floor, and it is determined that the biological information such as the pulse at this time is abnormal. In such a case, the analysis unit 244 determines that an abnormality has occurred in the user U-4 (grandfather). At this time, the analysis unit 244 determines from the captured image whether or not the facial expression of the user U-4 (grandfather) is, for example, a painful facial expression or a painful facial expression. May also be used to determine whether or not an abnormality has occurred in the user U-4 (grandfather).

When the analysis unit 244 determines that an abnormality has occurred in the user U-4 (grandfather), the information output unit 245 immediately determines that the user U-1 (father) and the user U-2 (mother) who are the notification destinations have an abnormality. The provided information notifying the user U-4 (grandfather) that an abnormality has occurred is transmitted to the user terminal devices 400-1 and 400-2. User U-1 (father) and user U-2 (mother) can respond promptly by receiving the notification as the transmitted provided information.

(6th example)
Further, for example, when the user U-3 (child) is still a newborn baby, an infant, etc. (in this case, the user U-3 does not have to possess the user terminal device 400-3), the user U-3 (child). Can be said to convey one's desires to the outside by crying, babbling, laughing, etc. For example, such a case where the user U-3 (child) cries may be, for example, a case where the user is hungry, the diaper is wet, or the user wants to be held.

Therefore, when the user U-3 (child) is a newborn baby or an infant, feedback setting information is set corresponding to the user U-3 (child) with the estimation of the desire of the user U-3 (child) as an analysis item. May be done. The notification destination information in such feedback setting information may be set to indicate the user terminal device 400-2 of the user U-2 who is the mother as the notification destination. Furthermore, the user terminal device 400 of another person in the family may also be indicated as a notification destination. Alternatively, the notification destination indicated by the notification destination information in this case may be the user terminal device 400 of the user U whose existence is confirmed to currently exist in the living space 10.

In this case, the detection information acquisition unit 241 acquires the audio signal of the user U-3 (child) as detection information and stores it in the detection information storage unit 251. Further, the detection information acquisition unit 241 may also acquire the captured image of the user U-3 (child) as detection information and store it in the detection information storage unit 251. The detected information of the captured image can be used for estimating the desire by analyzing the movement and facial expression of the user U-3 (child), for example.
The analysis unit 244 estimates the desire of the user U-3 (child) by using the detection information obtained as described above. In addition, the pattern of how to make a voice, facial expression, how to move, etc. according to the desire of the user U-3 (child) differs for each individual. Therefore, it is preferable that the analysis unit 244 in this case determines the desire according to the target user U-3 (child) by learning.
The information output unit 245 generates the provision information of the content notifying the desire of the user U-3 (child) determined by the analysis unit 244, and transmits it to the user terminal device 400 of the notification destination. As a result, the user U who has been notified of the provided information can grasp the desire of the user U-3 (child) in addition to the state of the user U-3 (child) that he / she is currently confirming, as well as the information providing system. It can be judged by referring to the estimation result about the desire provided by.

The contents of the provided information in the information providing system of the present embodiment can be considered in various ways in addition to the above examples. It can be said that the provided information given in each of the above examples is broadly related to the health of the user. However, the information provided may be, for example, information other than health. For example, the information may be provided according to a hobby, a preference, or the like, which is determined according to the behavior pattern or the like analyzed for the user U.

Further, for example, a sensor 100 for measuring the spatial environment such as temperature, humidity, and air cleanliness in the living space 10 is provided, and the measurement result of the spatial environment detected by these sensors 100 is also reflected in the analysis for the user U. You may let me.

Further, in each of the above examples, the detection information is acquired, analyzed, and the provided information is output for the user U who is a human being. However, for example, an animal such as a pet other than a human may be targeted for acquisition of detection information, analysis corresponding to a predetermined analysis item, and output of provided information. Further, the notification destination indicated by the notification destination information of the feedback setting information corresponding to the pet in this case may be the user terminal device 400 of one or more users U of any one of the family members.
For example, when the analysis unit 244 targets an animal such as a dog or a cat as a pet, the analysis unit 244 determines the emotion of the pet (contents that the owner wants to appeal to) and the health condition of the pet based on the detection information such as the captured image and the voice signal. Etc. are judged. The information output unit 245 generates information provided to inform the user of the pet's emotions (contents to be appealed to the owner) or the pet's health condition determined by the analysis unit 244, and notifies the feedback setting information corresponding to the pet. The provided information may be transmitted to the user terminal device 400 designated by the destination information.

In the above example, a case where a certain space is a living space 10 and corresponds to a house such as a detached house or a condominium in which a family lives is described. However, the certain space in the present embodiment may be, for example, an employee dormitory, a share house, or the like. Further, the certain space may be an office or the like.

A program for realizing the functions of the information processing device 200, the user terminal device 400, and the like described above is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into the computer system. By executing the process, the above-mentioned information processing device 200, user terminal device 400, or the like may be processed. Here, "loading and executing a program recorded on a recording medium into a computer system" includes installing the program in the computer system. The term "computer system" as used herein includes hardware such as an OS and peripheral devices. Further, the "computer system" may include a plurality of computer devices connected via a network including a communication line such as the Internet, WAN, LAN, and a dedicated line. Further, the "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, or a CD-ROM, and a storage device such as a hard disk built in a computer system. As described above, the recording medium in which the program is stored may be a non-transient recording medium such as a CD-ROM. The recording medium also includes an internal or external recording medium accessible from the distribution server for distributing the program. The code of the program stored in the recording medium of the distribution server may be different from the code of the program in a format that can be executed by the terminal device. That is, the format stored in the distribution server does not matter as long as it can be downloaded from the distribution server and installed in a form that can be executed by the terminal device. It should be noted that the configuration in which the program is divided into a plurality of parts and downloaded at different timings and then combined by the terminal device, or the distribution server for distributing each of the divided programs may be different. Furthermore, a "computer-readable recording medium" is a volatile memory (RAM) inside a computer system that serves as a server or client when a program is transmitted via a network, and holds the program for a certain period of time. It shall include things. Further, the above program may be for realizing a part of the above-mentioned functions. Further, it may be a so-called difference file (difference program) that can realize the above-mentioned function in combination with a program already recorded in the computer system.

1 Information provision system, 10 Living space, 100 (100-1 to 100-n) sensor, 101 detection unit, 102 communication unit, 200 information processing device, 201 sensor compatible communication unit, 202 network compatible communication unit, 203 input / output interface Unit, 204 control unit, 205 storage unit, 241 detection information acquisition unit, 242 detection information processing unit, 243 personal recognition unit, 244 analysis unit, 245 information output unit, 251 detection information storage unit, 252 analysis information storage unit, 253 user Information storage unit, 254 detection and analysis history storage unit, 300 input / output device, 400 (400-1 to 400-n) user terminal device, 401 communication unit, 402 control unit, 403 storage unit, 404 input interface unit, 405 output interface Department, 421 Application support processing department

Claims (8)

It is provided in a certain space and includes one or more sensors for detecting a predetermined object, an information processing device, and a user terminal device corresponding to a user corresponding to the certain space.
The information processing device is
A detection information acquisition unit that acquires detection information output from the sensor,
Based on the detection information acquired by the detection information acquisition unit, the analysis unit that executes the analysis corresponding to the analysis items individually set for each of the plurality of users, and the analysis unit.
It is provided with an information output unit that outputs information provided based on the analysis result of the analysis item for each user to a predetermined user terminal device.
The user terminal device is
An information providing system including an information presenting unit that outputs the provided information output from the information output unit so as to present it to the user. The information output unit is
The information according to claim 1, wherein the information provided based on the analysis result of the analysis item analyzed by the analysis unit is output to a user terminal device of a user different from the user to which the analysis item analyzed by the analysis unit corresponds. Offering system. The information provision according to claim 1 or 2, wherein the detection information acquisition unit acquires an image captured by the sensor including a camera that detects an ambient environment in a certain imaging range by imaging as the detection information. system. The information providing system according to any one of claims 1 to 3, wherein the detection information acquisition unit acquires an audio signal output from the sensor including a microphone that detects by collecting sound as the detection information. The information providing system according to any one of claims 1 to 4, wherein the detection information acquisition unit acquires detection information output from the sensor that detects predetermined biological information. Claims 1 to 5 include a storage control unit that stores representative value information for at least one of the detection information acquired by the detection information acquisition unit and the information indicating the analysis result by the analysis unit in the storage unit. The information provision system described in any one of the above. A detection information acquisition unit that is provided in a certain space and acquires detection information output from one or more sensors that detect a predetermined target.
An analysis unit that executes analysis corresponding to analysis items individually set for each of a plurality of users based on the detection information acquired by the detection information acquisition unit.
An information processing device including an information output unit that outputs information provided based on the analysis result of the analysis item for each user to a predetermined user terminal device among the user terminal devices corresponding to the user corresponding to the certain space. .. Computer,
A detection information acquisition unit, which is provided in a certain space and acquires detection information output from one or more sensors that detect a predetermined target.
An analysis unit that executes analysis corresponding to analysis items individually set for each of a plurality of users based on the detection information acquired by the detection information acquisition unit.
A program for functioning as an information output unit that outputs information provided based on the analysis result of the analysis item for each user to a predetermined user terminal device among the user terminal devices corresponding to the user corresponding to the certain space. ..

Images