WO2019220899A1

WO2019220899A1 - Biological information acquisition system, electronic apparatus, biological information acquisition method, and biological information acquisition program

Info

Publication number: WO2019220899A1
Application number: PCT/JP2019/017443
Authority: WO
Inventors: 田中　伸也; 素寺横; 慎一郎園田; 宏俊吉澤
Original assignee: 富士フイルム株式会社
Priority date: 2018-05-16
Filing date: 2019-04-24
Publication date: 2019-11-21
Also published as: JP6986147B2; JPWO2019220899A1

Abstract

A biological information acquisition system provided with: a favorite meal feeding device including a favorite meal feeding unit that transmits information representing a virtual favorite meal to be fed to a virtual life form, to an electronic apparatus representing the virtual life form, in accordance with an instruction from a user; and the electronic apparatus, which includes a recognition unit for recognizing the user, a biological information acquisition unit for acquiring biological information of the user, and a reception unit which, if a condition concerning the user when the biological information acquisition unit has acquired the biological information satisfies a biological information acquisition condition that is at least one of a predetermined condition for acquiring biological information and the same condition as when biological information was acquired previously, receives the information representing the favorite meal transmitted from the favorite meal feeding device.

Description

Biological information acquisition system, electronic device, biological information acquisition method, and biological information acquisition program

The present disclosure relates to a biological information acquisition system, an electronic device, a biological information acquisition method, and a biological information acquisition program.

Conventionally, as a technique for managing the health of a user, for example, Patent Document 1 describes a technique using a virtual pet. According to the technology described in Japanese Patent Application Laid-Open No. 2010-214009, virtual pets are trained according to the user's behavior to improve the health of the user.

In addition, conventionally, for the purpose of managing the health of the user, obtaining biological information such as the user's body temperature has been performed.

The technology described in Japanese Patent Laid-Open No. 2010-214009 promotes user behavior by growing virtual pets, and does not acquire user biometric information and perform health management.

On the other hand, when performing user health management or the like using biometric information, it is desired to acquire biometric information with high accuracy rather than simply acquiring biometric information. However, when the user himself / herself measures biometric information or records measurement results, it is difficult to measure biometric information in an appropriate state that satisfies appropriate measurement conditions, and the accuracy of the measured biometric information is low was there. In addition, when the user himself / herself measures biometric information and records measurement results, it is difficult to continuously measure biometric information, and appropriate information for managing health may not be obtained.

Therefore, a technique for appropriately and continuously acquiring the user's biometric information is desired.

This disclosure provides a biological information acquisition system, an electronic device, a biological information acquisition method, and a biological information acquisition program that can appropriately and continuously acquire a user's biological information.

1st aspect of this indication is a biometric information acquisition system, Comprising: The information showing the virtual favorite food provided to a virtual life form is transmitted with respect to the electronic device showing a virtual life form according to a user's instruction | indication The condition related to the user when the biometric information acquisition unit acquires biometric information in advance, the favorite supply device having the favorite supply unit, the recognition unit that recognizes the user, the biometric information acquisition unit that acquires the biometric information of the user, When the biometric information acquisition condition that satisfies at least one of the conditions for obtaining biometric information and the biometric information acquisition condition that is at least one of the same conditions as the previous biometric information acquisition, the information representing the favorite food transmitted from the favorite supply device is displayed. And an electronic device having a receiving unit.

In a second aspect of the present disclosure, in the first aspect, the receiving unit may include a guiding unit that guides the user to a state that satisfies the biometric information acquisition condition.

According to a third aspect of the present disclosure, in the first aspect or the second aspect, the electronic device includes a request unit that requests the user to supply a favorite food when it is time to acquire the user's biological information. Furthermore, you may have.

According to a fourth aspect of the present disclosure, in the third aspect, the request unit is based on at least one information of information indicating a change in the state of the electronic device, information indicating time, and information indicating the current position of the own device. The timing may be determined.

In the fifth aspect of the present disclosure, in the first aspect to the fourth aspect, the receiving unit may respond to the user when a favorite food is received.

The sixth aspect of the present disclosure may further include an analysis device that analyzes the biological information acquired by the biological information acquisition unit in the first to fifth aspects.

According to a seventh aspect of the present disclosure, in the sixth aspect, the analysis device may include at least one of a favorite food supply device and an electronic device.

According to an eighth aspect of the present disclosure, in the sixth aspect or the seventh aspect, the favorite food supply device includes a purchase unit for purchasing information representing a favorite by the user, and the analysis device receives the favorite food received by the receiving unit. You may have the provision part which provides a user with the analysis result which analyzed biometric information according to the purchase price corresponding to the information to represent.

In the ninth aspect of the present disclosure, in the first to eighth aspects, the favorite food may be virtual food.

In the tenth aspect of the present disclosure, from the first aspect to the eighth aspect, the favorite food may be a virtual money item.

An eleventh aspect of the present disclosure is a biological information acquisition system that transmits information representing a virtual favorite to be supplied to a virtual life form to an electronic device representing the virtual life form in response to a user instruction. When a favorite supply device having a favorite supply unit, a recognition unit that recognizes a user, a biological information acquisition unit that acquires biological information of the user, and a biological information acquisition unit acquire biological information, An electronic device having a predetermined biometric information acquisition condition and a guiding unit that guides the user to a condition that satisfies biometric information acquisition conditions that are at least one of the same conditions as when biometric information was acquired last time And comprising.

A twelfth aspect of the present disclosure is an electronic device that transmits information representing a virtual favorite to be provided to the virtual life form to the electronic device representing the virtual life form in accordance with a user instruction. A recognition unit for recognizing a user, a biometric information acquisition unit that acquires biometric information of the user, and a condition regarding the user when the biometric information acquisition unit acquires the biometric information are predetermined biometric information acquisition And a receiving unit that receives information representing a favorite food transmitted from the favorite food supply device when the biometric information acquisition condition that is at least one of the same conditions as the previous biometric information acquisition condition is satisfied. Have.

A thirteenth aspect of the present disclosure is an electronic device that transmits information representing a virtual favorite to be provided to the virtual life form to the electronic device representing the virtual life form according to a user instruction. When the biometric information is acquired by the recognizing unit for recognizing the user, the biometric information acquiring unit for acquiring the biometric information of the user, and the biometric information acquiring unit of the supply apparatus, the biometric information acquisition in which conditions regarding the user are determined in advance And a guiding unit that guides the user to a state that satisfies the biometric information acquisition condition that is at least one of the same conditions as when biometric information was previously acquired.

A fourteenth aspect of the present disclosure is a biological information acquisition method, in which information representing a virtual favorite to be supplied to a virtual life form is transmitted to a computer in an electronic device representing the virtual life form according to a user instruction When the user of the food supply device that transmits to the user recognizes the user, acquires the user's biometric information, and acquires the biometric information, the condition regarding the user is the biometric information acquisition condition and the previous biometric information is acquired When at least one of the same conditions is satisfied, a process for receiving the information representing the favorite food transmitted from the favorite food supply device is executed.

A fifteenth aspect of the present disclosure is a biological information acquisition method, in which information representing a virtual favorite to be supplied to a virtual life form is sent to a computer in an electronic device representing the virtual life form according to a user instruction In the case of recognizing the user, acquiring the biometric information of the user, and acquiring the biometric information, the conditions related to the user are predetermined conditions for biometric information acquisition and A process of guiding the user to a state satisfying the biometric information acquisition condition that is at least one of the same conditions as when the information is acquired is executed.

A sixteenth aspect of the present disclosure is a biometric information acquisition program, in which information representing a virtual favorite to be supplied to a virtual life form is sent to an electronic device representing a virtual life form according to a user instruction. The user-recognizing device for transmitting to the user recognizes the user, acquires the user's biometric information, and obtains the biometric information. The user-related conditions are predetermined biometric information acquisition conditions and the previous biometric information. When the biometric information acquisition condition, which is at least one of the same conditions as when acquiring the condition, is satisfied, the process of receiving the information representing the favorite food transmitted from the favorite food supply apparatus is executed.

A seventeenth aspect of the present disclosure is a biometric information acquisition program, in which information representing a virtual favorite to be supplied to a virtual life form is sent to an electronic device representing a virtual life form according to a user instruction. In the case of recognizing the user, acquiring the biometric information of the user, and acquiring the biometric information, the conditions related to the user are predetermined conditions for biometric information acquisition and A process of guiding the user to a state satisfying the biometric information acquisition condition that is at least one of the same conditions as when the information is acquired is executed.

According to the above aspect, the biological information acquisition system, the electronic device, the biological information acquisition method, and the biological information acquisition program of the present disclosure can acquire the user's biological information appropriately and continuously.

It is a block diagram which shows an example of a structure of the biometric information acquisition system of illustrative embodiment. It is a block diagram which shows an example of the hardware constitutions of the favorite food supply apparatus of exemplary embodiment. It is a block diagram which shows an example of the hardware constitutions of the pet robot of exemplary embodiment. It is a block diagram which shows an example of the hardware constitutions of the server of example embodiment. It is a block diagram which shows an example of a functional structure of the biometric information acquisition system of illustrative embodiment. It is a flowchart which shows an example of the favorite supply process performed with the favorite supply apparatus of exemplary embodiment. It is a flowchart which shows an example of the biometric information acquisition process performed with the pet robot of exemplary embodiment. It is a flowchart which shows an example of the analysis result provision process performed with the server of example embodiment.

Hereinafter, exemplary embodiments for carrying out the technology of the present disclosure will be described in detail with reference to the drawings.

First, the configuration of the biological information acquisition system 1 according to this exemplary embodiment will be described with reference to FIG. As shown in FIG. 1, the biological information acquisition system 1 of the present exemplary embodiment includes a favorite food supply device 10, a pet robot 12, and a server 14. The favorite food supply device 10, the pet robot 12, and the server 14 are connected to the network N so as to be able to communicate with each other. Further, the favorite food supply device 10 and the pet robot 12 are connected so as to be able to communicate without going through the network N. The communication between the favorite food supply device 10 and the pet robot 12 is preferably wireless communication but may be priority communication.

The favorite food supply device 10 is a device used by a user who owns the favorite food supply device 10 and the pet robot 12 to supply a virtual favorite food to the pet robot 12. In the present exemplary embodiment, as an example, the favorite food supply device 10 is a so-called smart device such as a smartphone or a tablet terminal, but the specific form of the favorite food supply device 10 is not particularly limited. It may be a device such as a dedicated device or a remote controller, or a combination of these devices.

In the exemplary embodiment, the “favorite” refers to food of the pet robot 12 as an example in the exemplary embodiment, but is not limited to food, and corresponds to other money items such as money and money. A point, a decoration, etc. may be sufficient and the form which combined these may be sufficient. Moreover, in this exemplary embodiment, types of food such as “favorites” such as grade, item, dish name, and taste are provided.

Further, what is handled in the biological information acquisition system 1 of the present exemplary embodiment is not “actual favorite” itself but “virtual favorite”, and specifically, electronic data representing the favorite. Hereinafter, in the biological information acquisition system 1 of the present exemplary embodiment, the term “favorite” may refer to a “virtual favorite”.

The pet robot 12 is an example of the electronic device of the present disclosure, and is an example of the “virtual life form” of the exemplary embodiment, and receives the favorite food supplied from the favorite food supply device 10. In the present exemplary embodiment, since the favorite food is food as described above, the pet robot 12 indicates that the favorite food has been received by pretending that the favorite food has been eaten. The pet robot 12 may have a form in which the appearance of the robot itself represents a pet, or may have a form representing a pet by an image or the like displayed on the display unit 43 described later, and is not particularly limited. . In addition, the “life form” in the present exemplary embodiment is not limited to an actually existing life form, and may be a fictitious life form. In the exemplary embodiment, the “virtual life form” indicates “robot” and “pet”. However, the present embodiment is not limited to these forms, and electronic devices other than the “robot” may be used. Needless to say, it may be a life form other than a “pet”.

In addition, when the pet robot 12 of the exemplary embodiment receives a favorite food supplied from the favorite food supply device 10, if the user's biological information satisfies a biological information acquisition condition described in detail later, the user's biological information is displayed. If it is acquired and not satisfied, the user is guided to a state of being satisfied.

The server 14 is an example of the analysis device according to the present disclosure, analyzes the user's biological information acquired by the pet robot 12, and provides the analysis result to a predetermined providing destination.

Next, with reference to FIG. 2, the hardware configuration of the favorite food supply apparatus 10 of the present exemplary embodiment will be described. As shown in FIG. 2, the favorite food supply device 10 includes a CPU (Central Processing Unit) 20, a memory 21 as a temporary storage area, and a nonvolatile storage unit 22. The favorite food supply device 10 includes a display unit 23 such as a liquid crystal display, an input unit 24 such as a keyboard, an output unit 25 such as a speaker that outputs sound, a network I / F (InterFace) 26 connected to the network N, and A communication I / F 27 for communicating with the pet robot 12 is included. The display unit 23 and the input unit 24 may be an integrated touch panel display. The CPU 20, memory 21, storage unit 22, display unit 23, input unit 24, output unit 25, network I / F 26, and communication I / F 27 are connected to the bus 28.

The storage unit 22 is realized by an HDD (Hard Disk Drive), an SSD (Solid State Drive), a flash memory, or the like. A favorite part supply program 30 is stored in the storage unit 22 as a storage medium. The CPU 20 reads the favorite food supply program 30 from the storage unit 22, expands it in the memory 21, and executes the expanded favorite food supply program 30. The storage unit 22 stores favorite management information 32 used for managing favorite foods that can be supplied to the pet robot 12.

Referring also to FIG. 3, the hardware configuration of the pet robot 12 of the present exemplary embodiment will be described. As shown in FIG. 3, the pet robot 12 includes a CPU 40, a memory 41 as a temporary storage area, and a nonvolatile storage unit 42. The pet robot 12 communicates with the display unit 43 such as a liquid crystal display, the output unit 45 such as a speaker that outputs sound, the drive unit 44, the network I / F 46 connected to the network N, and the favorite food supply device 10. Communication I / F47. The pet robot 12 includes a biological information acquisition sensor 49 used to acquire the biological information of the user. The CPU 40, the memory 41, the storage unit 42, the display unit 43, the drive unit 44, the output unit 45, the network I / F 46, the communication I / F 47, and the biological information acquisition sensor 49 are connected to the bus 48.

The storage unit 42 is realized by an HDD, an SSD, a flash memory, or the like. A biometric information acquisition program 50 is stored in the storage unit 42 as a storage medium. The CPU 40 reads the biometric information acquisition program 50 from the storage unit 42 and expands it in the memory 41, and executes the expanded biometric information acquisition program 50. The storage unit 42 stores biometric information data 52 representing the acquired user biometric information.

The drive unit 44 has a function of moving the limbs (not shown) of the pet robot 12 and the like.

The biological information acquisition sensor 49 is a sensor for acquiring information (biological information derivation data) necessary for deriving the user's biological information. The biological information acquisition sensor 49 is not particularly limited as long as it corresponds to the type of biological information to be acquired. Examples of biological information include face color, pulse, heart rate, blood flow, blood pressure, voice quality, and vital capacity, but are not particularly limited. Examples of the biological information acquisition sensor 49 include an RGB (Red Green Blue) camera capable of acquiring a moving image or a still image of the user's face, a far-infrared camera capable of acquiring the user's body temperature, a user's face, and the like. Depth camera capable of obtaining the shape (depth) of the user, sound sensor capable of obtaining the user's voice, and Doppler sensor using microwaves or millimeter waves capable of obtaining the movement of the user's body surface, etc. Or a combination of these. Further, for example, as the biological information acquisition sensor 49, an optical measurement system for measuring blood flow described in Japanese Patent Laid-Open No. 2009-200433 may be used. The optical measurement system described in Japanese Patent Application Laid-Open No. 2009-200433 includes means for measuring blood flow by receiving and analyzing laser light applied to a living tissue.

Also, with reference to FIG. 4, the hardware configuration of the server 14 of the present exemplary embodiment will be described. As shown in FIG. 4, the server 14 includes a CPU 60, a memory 61 as a temporary storage area, and a nonvolatile storage unit 62. The server 14 includes a display unit 63 such as a liquid crystal display, an input unit 64 such as a keyboard and a mouse, and a network I / F 66 connected to the network N. The display unit 63 and the input unit 64 may be an integrated touch panel display. The CPU 60, the memory 61, the storage unit 62, the display unit 63, the input unit 64, and the network I / F 66 are connected to the bus 68.

The storage unit 62 is realized by an HDD, an SSD, a flash memory, or the like. An analysis result providing program 70 is stored in the storage unit 62 as a storage medium. The CPU 60 reads each analysis result providing program 70 from the storage unit 62 and expands it in the memory 61, and executes the expanded analysis result providing program 70. The storage unit 62 stores user management information 72 for managing users of the favorite food supply device 10 and the pet robot 12.

Next, a functional configuration of the biological information acquisition system 1 according to the exemplary embodiment will be described with reference to FIG. As shown in FIG. 5, the favorite food supply device 10 includes a purchase unit 90 and a favorite food supply unit 92. When the CPU 20 executes the favorite food supply program 30, the CPU 20 functions as the purchase unit 90 and the favorite food supply unit 92.

The purchase unit 90 has a function for the user to purchase electronic data representing a virtual favorite food to be supplied to the pet robot 12. The favorite food supply unit 92 transmits electronic data representing a virtual favorite food to the pet robot 12 in accordance with a user instruction.

On the other hand, as shown in FIG. 5, the pet robot 12 includes a request unit 80, a recognition unit 82, a biological information acquisition unit 84, and a reception unit 86.

The request unit 80 requests the user to supply a favorite food when it is time to acquire the user's biological information. The recognition unit 82 recognizes the user. The biological information acquisition unit 84 acquires the user's biological information. The biometric information acquisition unit 84 transmits the acquired data representing the biometric information of the user to the server 14 via the network N.

The receiving unit 86 includes a guiding unit 87. The receiving unit 86 has at least one of the conditions for the user when the biometric information acquiring unit 84 acquires the biometric information, a predetermined condition for acquiring biometric information and the same condition as when biometric information was acquired last time. When the biometric information acquisition condition which is a condition is satisfied, electronic data representing the favorite food supplied from the favorite food supply device 10 is received. When the biometric information acquisition condition is not satisfied, the guide unit 87 guides the user to a state that satisfies the biometric information acquisition condition.

On the other hand, as shown in FIG. 5, the server 14 includes an analysis unit 96 and a providing unit 98. The analysis unit 96 analyzes the biological information acquired by the pet robot 12 and derives information as an analysis result for the health management of the user. The providing unit 98 provides the analysis result of the biological information by the analyzing unit 96 to a predetermined providing destination such as a user.

Next, the operation of the biological information acquisition system 1 of this exemplary embodiment will be described. First, with reference to FIG. 6, the supply of favorite food to the pet robot 12 by the favorite food supply device 10 will be described. When the CPU 20 executes the favorite food supply program 30, the favorite food supply process shown in FIG. 6 is executed. The favorite food supply process shown in FIG. 6 is executed, for example, at a timing when a predetermined instruction regarding the execution of supply of a favorite food by the user of the favorite food supply device 10 is input by the input unit 24.

In step S100 in FIG. 6, the favorite food supply unit 92 determines whether or not to execute the supply of the favorite food. In the favorite food supply device 10 of the present exemplary embodiment, a user supplies a favorite food to the pet robot 12 and purchases a favorite food for supply. In this step, it is determined whether or not the user has instructed the execution of the supply of the favorite food among the supply of the favorite food and the purchase of the favorite food. If the execution of the supply of the favorite food is not instructed, in other words, if the execution of the purchase of the favorite food is instructed, the determination in step S100 is negative, and the process proceeds to step S102. In step S102, the purchase unit 90 causes the display unit 23 to display purchase favorite designation information for the user to designate the favorite food to be purchased. In this exemplary embodiment, when a favorite product is purchased, the number (type) and type of the favorite product to be purchased can be specified, and the purchase price varies depending on the number and type of the favorite product. Therefore, the purchase unit 90 causes the display unit 23 to display information for the user to specify the number and type of favorite foods to be purchased, and to pay an amount corresponding to the specified number and type of favorite foods as purchase favorite specification information. Note that the method of payment by the user at the time of purchase is not particularly limited, such as cash, virtual currency, some points, and combinations thereof.

In the next step S104, the purchasing unit 90 determines whether the user has specified the favorite food to be purchased by the input unit 24. The determination in step S104 is negative until a favorite food to be purchased is specified. If a favorite food to be purchased is specified, the determination in step S104 is affirmative and the process proceeds to step S106. Note that in the biometric information acquisition system 1 of the present exemplary embodiment, regarding the purchase management of the favorite food, the information related to the purchase of the favorite food is managed externally from the favorite food supply device 10 and the server 14 via the network I / F 26. The data is transmitted / received to / from the device and managed by an external management device.

In step S106, the purchase unit 90 updates the favorite management information 32 stored in the storage unit 22, and then proceeds to step S118. The favorite food management information 32 includes information indicating the number and types of favorite foods that can be supplied to the pet robot 12. Specifically, the purchase unit 90 updates the number of favorite foods that can be supplied in the favorite management information 32 according to the number of purchases, or updates the types that can be supplied according to the types purchased. .

On the other hand, when execution of supply of favorite food is instructed, the determination in step S100 is affirmative, and the process proceeds to step S108. In step S108, the favorite food supply unit 92 causes the display unit 23 to display supply favorite specifying information for the user to specify the favorite food to be supplied. In this exemplary embodiment, when a favorite food is supplied to the pet robot 12, it is possible to specify the number (amount) and type of the favorite food to be supplied. For this reason, the favorite food supply unit 92 causes the display unit 23 to display information for the user to specify the number and type of favorite foods to be supplied as supplied food specification information.

In the next step S110, the favorite food supply unit 92 determines whether the user has specified the favorite food to be supplied by the input unit 24. The determination in step S110 is a negative determination until designation of a favorite food to be supplied is made, and if the favorite food to be supplied is specified, the determination in step S110 is affirmative and the process proceeds to step S112.

In step S112, the favorite food supply unit 92 supplies the favorite food according to the designated number and type, and transmits data representing the favorite food to the pet robot 12 via the communication I / F 27 as the favorite data. In the exemplary embodiment, when a favorite is supplied, the favorite supply unit 92 transmits the favorite data to the pet robot 12 and also provides the user with information indicating that the favorite is supplied to the pet robot 12. Present. By presenting information indicating that a favorite food is being provided to the user, it is possible to give the user a sense of supplying the pet robot 12 with the favorite food. There is no particular limitation on the method of providing the favorite food and the method of presenting the information indicating that the favorite food is being provided to the user. For example, an image representing a favorite displayed on the display unit 23 may be changed as if the pet robot 12 is eating a favorite. Further, for example, the sound and state as if the favorite food is going out from the favorite food supply device 10 may be displayed visually or audibly by the display unit 23 and the output unit 25. May be output in conjunction with the user moving the favorite food supply device 10. Further, for example, when the favorite food supply device 10 has a function for realizing augmented reality (AR), the augmented reality function may be used to display the favorite food supplied to the virtual space. Further, for example, the favorite food supply device 10 may be arranged at a predetermined position such as in front of the face of the pet robot 12 to start the supply of the favorite food.

As will be described later, when the pet robot 12 receives a favorite food, the pet robot 12 transmits reception data indicating that it has been received to the favorite food supply device 10 via the communication I / F 27. Therefore, in step S114, the favorite food supply unit 92 determines whether or not the received data is received via the communication I / F 27. The determination in step S114 is negative until reception data is received. When reception data is received, the determination in step S114 is affirmative and the process proceeds to step S116.

In step S116, the favorite food supply unit 92 updates the favorite management information 32 stored in the storage unit 22, and then proceeds to step S118. Specifically, the favorite food supply unit 92 updates the number of favorite foods that can be supplied in the favorite management information 32 according to the number of payments, or updates the types that can be supplied according to the types supplied. Do.

In step S118, the favorite food supply unit 92 determines whether or not to end the favorite food supply process. For example, if an instruction to supply a favorite food is input after the purchase of the favorite food is entered, the determination in step S118 is negative, the process returns to step S100, and the processing from steps S102 to S116 is repeated. On the other hand, when the user inputs an instruction to end the operation via the input unit 24, the determination in step S118 is affirmative, and the favorite food supply process ends.

Next, acquisition of a user's biological information by the pet robot 12 will be described with reference to FIG. When the CPU 40 executes the biological information acquisition program 50, the biological information acquisition process shown in FIG. 7 is executed. The biometric information acquisition process illustrated in FIG. 7 is executed, for example, when the pet robot 12 is first turned on, when reset is performed, or the like.

In step S200 of FIG. 7, the request unit 80 determines whether it is time to acquire the user's biological information. In the biometric information acquisition system 1 of the present exemplary embodiment, the timing for acquiring biometric information is determined in advance according to the type of biometric information to be acquired, for example, at a predetermined time or at predetermined intervals. It has been established. The request unit 80 determines whether or not it is time to acquire biometric information for each type of biometric information to be acquired. In addition, the determination method of whether it is the timing which acquires biometric information is not specifically limited, For example, it is good also as a form determined with reference to the timer which abbreviate | omitted illustration and it came to the predetermined time. Alternatively, the determination may be made based on the elapsed time since receiving the favorite food last time, which corresponds to the virtual hunger degree of the pet robot 12. Further, for example, the determination may be made based on the position where the pet robot 12 is placed, or for example, the determination may be made based on history information such as the battery consumption of the pet robot 12 or the movable time. These forms may be combined. Thus, in the pet robot 12 of this exemplary embodiment, the timing for acquiring the user's biological information is determined based on the information indicating the state of the pet robot 12.

The determination in step S200 is negative until the timing for acquiring biometric information is reached, and the determination in step S200 is positive when the timing for acquiring biometric information is reached, and the process proceeds to step S202.

In step S202, the request unit 80 executes a request for a favorite food. The method by which the request unit 80 executes a request for a favorite is not particularly limited. For example, a specific voice indicating that a favorite food is requested may be output by the output unit 45, a facial expression of the pet robot 12 may be changed, or the limbs of the pet robot 12 may be generated by the drive unit 44. The display unit 43 may display a specific message requesting a favorite food, or a combination of these forms.

In the present exemplary embodiment, in response to the pet robot 12 requesting a favorite food, the user supplies the favorite food to the pet robot 12 using the favorite food supply device 10 as described above. Accordingly, in the next step S204, the recognition unit 82 determines whether or not the favorite data has been received from the favorite supply device 10 via the communication I / F 47. The determination in step S204 is negative until the favorite data is received, and when favorite data is received, the determination in step S204 is affirmative, and the process proceeds to step S206. In addition, when favorite data is not received even if predetermined time passes, in other words, when it becomes negative determination for predetermined time, it is preferable to set it as the form which returns to step S200.

In step S206, the recognition unit 82 acquires user information for identifying a user. In the exemplary embodiment, user information is acquired using the biological information acquisition sensor 49. In the next step S208, the recognition unit 82 executes a user inquiry to determine whether or not the user is a target of biometric information acquisition (hereinafter referred to as “target user”) based on the acquired user information. To do. In the biological information acquisition system 1 of the present exemplary embodiment, it is possible for a person other than the target user to supply a favorite food to the pet robot 12 using the favorite food supply device 10. In addition, when the pet robot 12 acquires biometric information for a plurality of users, for example, the biometric information to be acquired may be different for each target user, and the target user of the biometric information determined to be acquired this time There is a case where a different target user tries to provide a favorite food to the pet robot 12. Therefore, in the present exemplary embodiment, in this step, it is inquired whether or not the user is the current target user. The user inquiry method is not particularly limited. For example, when the biometric information acquisition sensor 49 is an RGB camera, a still image of the user's face is acquired, the image analysis is performed on the still image, and the target user registered in advance It is good also as a form which corresponds to the feature of the face of, or performs what is called face recognition. In the case where the biometric information acquisition sensor 49 is an RGB camera, for example, a user model such as a pre-registered target user's face image is used as teacher data, and a machine learning learning model is used, and the user's still image is used as a learning model. It is good also as a form which inputs and outputs whether it is an object user.

If it is not the target user, the determination in step S210 is negative, and the process proceeds to step S212. In step S212, the receiving unit 86 makes a response for the non-target user, and then returns to step S200. In the exemplary embodiment, as an example, the receiving unit 86 uses the display unit 43, the driving unit 44, the output unit 45, and the like as a predetermined action for stopping the supply of favorite food as a response for the non-target user. Do it. As a specific example, the output unit 45 outputs “I am not hungry after all”. Note that the response for the non-target user is not limited to this form. For example, the user may receive (eat) a favorite food but may not obtain the biological information. Moreover, it is good also as a form which shows to a user that it is a non-target user.

On the other hand, if the user is the target user, the determination in step S210 is affirmative, and the process proceeds to step S214. In step S <b> 214, the biological information acquisition unit 84 acquires biological information derivation data by the biological information acquisition sensor 49. For example, when the biological information to be acquired is a user's pulse, a moving image or a still image of the user's face is acquired from the biological information acquisition sensor 49 that is an RGB camera.

In the next step S216, the receiving unit 86 determines whether or not the biometric information derivation data acquired in step S214 satisfies the biometric information acquisition condition. The biometric information acquisition condition is a condition for appropriately deriving the biometric information of the user with high accuracy, and is the same condition as the predetermined condition for acquiring biometric information and the previous biometric information acquisition. Is at least one of the conditions. The predetermined condition for acquiring biological information is specifically a position appropriate for acquiring biological information. In the present exemplary embodiment, as an example of conditions for acquiring biometric information, in this step, it is determined based on the biometric information derivation data acquired from the biometric information acquisition sensor 49 whether or not the user is located at an appropriate position. To do. For example, when the biometric information acquisition sensor 49 is an RGB camera, whether or not the target user is photographed in a posture facing the front in the image in which the target user's face is acquired, in other words, the direction of the target user's face is the front It is determined whether or not it is facing. Further, for example, when the biological information acquisition sensor 49 is an optical measurement system, it is determined whether or not the biological information acquisition sensor 49 is in contact with the skin of the target user. If the biometric information acquisition condition is not satisfied, the determination in step S216 is negative and the process proceeds to step S218.

In step S218, the receiving unit 86 makes a response rejecting the favorite food. In the next step S220, the guiding unit 87 guides the user's position to a position that satisfies the biometric information acquisition condition, and then returns to step S214. The processes of S216 to S220 are repeated. The response for rejecting the favorite food performed by the receiving unit 86 in step S218 is not particularly limited. For example, the display unit 43, the drive unit 44, the output unit 45, and the like are used for the rejection or the favorite food is received ( (Eating) causes an action indicating that no favorite food is placed at an appropriate position.

Also, the user position guidance method executed by the guidance unit 87 in step S220 is not particularly limited, and the position satisfying the biometric information acquisition condition matches the current position of the user derived from the biometric information derivation data. Any method can be used as long as the user's position can be guided to a state where the user can be regarded as being. For example, the position of the user and the pet robot that stores the face image of the user in a specified size within a specified range, and that the angle between the user's face and the pet robot 12 (biological information acquisition sensor 49) falls within a specified range. 12 (biological information acquisition sensor 49) within a certain range, and the position of the user's face, etc. (front and back), for example, to perform shooting according to shooting conditions such as predetermined resolution, light quantity, and focus. , Left and right) may be guided by voice or the like output from the output unit 45. In addition, for example, the driving unit 44 may guide the pet robot 12 by moving the limbs or the like, or the display unit 43 may display information indicating the position of the guidance destination. In addition, for example, even if a specific position is not guided, when the user's position is a position that satisfies the biometric information acquisition condition, the pet robot 12 performs a motion that satisfies the biometric information acquisition condition. It is good also as a form which guides a user's position by expressing. Further, for example, when the biological information acquisition sensor 49 is an optical measurement system, the biological information acquisition sensor 49 is a part corresponding to the mouth of the pet robot 12. Then, in order to guide the target user's skin to a position in contact with the biological information acquisition sensor 49, the part of the biological information acquisition sensor 49 corresponding to the mouth of the robot 12 may be swung left and right or up and down. The part of the biological information acquisition sensor 49 corresponding to the mouth may be opened and closed. Further, the present invention is not limited to this exemplary embodiment, and information for guiding the position of the user is transmitted to the favorite food supply device 10 and is guided using the display unit 23 and the output unit 25 of the favorite food supply device 10. It is good also as a form and it is good also as a form which combined these forms.

On the other hand, when the biometric information acquisition condition is satisfied, the determination in step S216 is affirmative, and the process proceeds to step S222. In step S222, the receiving unit 86 makes a response to receive the favorite food. The response of receiving the favorite food performed by the receiving unit 86 is not particularly limited, and may be a response indicating that the pet robot 12 is eating a food favorite food in the present exemplary embodiment. For example, it is good also as a form which performs the operation | movement which eats favorite food by the drive part 44, It is good also as a form which outputs the audio | voice which eats favorite food by the output part 45, and the display part 43, the drive part 44, etc. The form of changing the expression of the pet robot 12 may be used, or a combination of these forms may be used.

In addition, when representing that the pet robot 12 is eating a favorite food, as described above, in the exemplary embodiment, since the amount and type of the favorite food to be supplied are specified, the pet robot 12 is adapted to the specified amount or favorite food. It is preferable to make a response. As a response in this case, it is good also as a form which changes the speed of eating, for example according to quantity and kind, and it is good also as a form which changes operation | movement itself.

In the next step S224, the receiving unit 86 transmits reception data indicating that the favorite food has been received to the favorite food supply apparatus 10 via the communication I / F 47.

In the next step S226, the biometric information acquisition unit 84 derives biometric information from the biometric information derivation data acquired in step S214. The pet robot 12 may be configured to perform a predetermined operation (response) according to the derived biological information. For example, when the body temperature is derived as the biological information, generally or personally, when the body temperature is higher than a so-called normal temperature, an operation indicating that the user is unwell may be performed.

In the next step S228, the biological information acquisition unit 84 determines whether it is time to transmit the data representing the derived biological information (hereinafter referred to as “biological information data”) to the server 14. The timing of transmitting the biological information data to the server 14 is, for example, every time the biological information data is derived, when a predetermined number of the derived biological information data is accumulated, or when a predetermined period has elapsed. The case may be mentioned, but is not particularly limited.

If it is not time to transmit the biological information data to the server 14, the determination in step S228 is negative, and the process proceeds to step S230. In step S230, the biometric information acquisition unit 84 stores the derived biometric information data in the storage unit 42 as the biometric information data 52, and then returns to step S200 to repeat the processes of steps S202 to S228.

On the other hand, in the case of timing for transmitting the biological information data to the server 14, the determination in step S228 is affirmative, and the process proceeds to step S232. In step S232, the biological information acquisition unit 84 transmits the biological information data to the server 14 via the network I / F 46, returns to step S200, and repeats the processes of steps S202 to S230. When transmitting the biometric information data to the server 14, if the biometric information data 52 is stored in the storage unit 42, the biometric information data 52 is transmitted to the server 14 together with the stored biometric information data 52. In the exemplary embodiment, the biometric information data is associated with data representing the date and time when the corresponding biometric information is acquired, and is transmitted to the server 14 in a state in which the data representing the date and time is associated. The

Next, provision of analysis results of biological information by the server 14 will be described with reference to FIG. When the CPU 60 executes the analysis result providing program 70, the analysis result providing process shown in FIG. 8 is executed. The analysis result providing process illustrated in FIG. 8 is executed, for example, at a timing when the biological information data is received from the pet robot 12 via the network I / F 66.

In step S300 of FIG. 8, the analysis unit 96 analyzes the user's biological information data. The method by which the analysis unit 96 analyzes the biological information data is not particularly limited as long as the analysis unit 96 can obtain at least one of information representing the user's health status and information useful for user health management. For example, it is good also as a form which analyzes the time-sequential change of biometric information, and analyzes whether a user's physical condition is not destroyed or there exists a date and time etc. which are easy to collapse. In addition, it is good also as a form which changes the analysis method of the biometric information data by the server 14, or the content to analyze according to the quantity and kind of favorite food which the user supplied with respect to the pet robot 12. FIG. In other words, what is provided as an analysis result may be different depending on the amount paid (purchased) by the user.

In the next step S302, the providing unit 98 provides the analysis result to a predetermined providing destination, and then ends the analysis result providing process. The predetermined provision destination is not limited to the user himself, and is not particularly limited. For example, the predetermined provision destination may be a user's child or parents. Also, the method of providing the analysis result is not particularly limited, and the analysis result may be sent to a designated transmission destination by mail, courier, or the like, and the data representing the analysis result may be designated by the favorite feeding device 10 or the like. It may be configured to transmit electronically by e-mail or the like, or may be provided by the pet robot 12. Alternatively, the predetermined provision destination may be a doctor or the like, and the analysis result may be provided to the user verbally through the doctor or the like after the analysis result is provided to the doctor or the like.

As described above, the biological information acquisition system 1 of the present exemplary embodiment transmits information representing a virtual favorite to be supplied to a virtual life form to the pet robot 12 representing a virtual life form according to a user instruction. The favorite food supply device 10 having the favorite food supply unit 92 to be transmitted, the recognition unit 82 for recognizing the user, the biological information acquisition unit 84 for acquiring the biological information of the user, and the biological information acquisition unit 84 have acquired the biological information. If the condition regarding the user in this case satisfies a predetermined condition for acquiring biological information and a biological information acquisition condition that is at least one of the same conditions as when biometric information was acquired last time, the favorite food supply device 10 And a pet robot 12 having a receiving unit 86 for receiving information representing a favorite food transmitted from.

According to the biological information acquisition system 1 of the present exemplary embodiment, the pet robot 12 receives a favorite food and eats the favorite food when the biological information acquisition condition that is a condition appropriate for acquisition of the user's biological information is satisfied. Thereby, according to the biometric information acquisition system 1 of the exemplary embodiment, a user who wants the pet robot 12 to eat a favorite food naturally satisfies the biometric information acquisition condition. The biometric information of the user can be acquired. In addition, according to the biometric information acquisition system 1 of the exemplary embodiment, since the user continuously supplies favorite foods from the pleasure of feeding (eating) the pet robot 12 with favorite foods, Continuous acquisition is possible.

In addition, the biological information acquisition system 1 of the present exemplary embodiment in another aspect provides information representing a virtual favorite to be supplied to a virtual life form to a pet robot 12 representing a virtual life form according to a user instruction. The favorite food supply device 10 having the favorite food supply unit 92 to be transmitted, the recognition unit 82 that recognizes the user, the biological information acquisition unit 84 that acquires the biological information of the user, and the biological information acquisition unit 84 acquire the biological information. In such a case, the user is guided to a state in which the condition related to the user satisfies the biometric information acquisition condition that is a predetermined condition for acquiring biometric information and at least one of the same conditions as the case where the biometric information is acquired last time. And a pet robot 12 having a guiding portion 87.

According to the biometric information acquisition system 1 of the present exemplary embodiment, a state in which the biometric information acquisition condition is satisfied in order to guide a user who supplies (feeds) a favorite food to the pet robot 12 to a state in which the biometric information acquisition condition is satisfied. Thus, the biological information of the user can be acquired. In addition, according to the biometric information acquisition system 1 of the exemplary embodiment, since the user continuously supplies favorite foods from the pleasure of feeding (eating) the favorite food to the pet robot 12, Continuous acquisition is possible.

Therefore, according to the biological information acquisition system 1 of the exemplary embodiment, the biological information of the user can be acquired appropriately and continuously. Moreover, according to the pet robot 12 of this exemplary embodiment, the user's biological information can be acquired in a non-contact manner, and the user's load due to the acquisition of the biological information can be reduced. In addition, although it is not limited to acquisition of the biometric information by non-contact, it cannot be overemphasized that it is preferable to set it as the form which reduces a user's load.

The pet robot 12 is not limited to this exemplary embodiment, and the pet robot 12 changes the timing at which the biological information is acquired and the frequency at which it is acquired according to the derived biological information and the analysis result obtained by analyzing the biological information data by the server 14. For example, when the user's health condition is not good, the frequency of acquiring biological information may be increased. In addition, for example, when the request unit 80 of the pet robot 12 requests a favorite, but the state in which the favorite user is not supplied with the favorite continues, the timing for acquiring the biological information and the frequency of acquisition according to the duration For example, the timing for acquiring biological information may be increased as the duration time increases.

In this exemplary embodiment, the biometric information derivation data acquired by the biometric information acquisition sensor 49 is used for both user recognition (inquiry) and biometric information income. For example, an image pickup unit and a sensor for acquiring data for this purpose may be separately provided.

In the present exemplary embodiment, the pet robot 12 has been described as directly acquiring data used for user recognition, but may be acquired indirectly. As a form to acquire indirectly, it is good also as a form which acquires the user's identification information registered into favorite food supply apparatus 10 from favorite supply apparatus 10, and recognizes a user based on the acquired identification information, for example. . Further, for example, the user may be recognized based on the user data acquired via another device (another pet robot 12) or the like that has recognized the user in the vicinity of the pet robot 12.

In the exemplary embodiment, the server 14 analyzes the biological information data and provides the analysis result, and is configured as an example of the analysis device of the present disclosure. However, the pet robot 12 or the favorite food supply device is used. 10 may have a function of an analysis device.

In addition, various processors other than the CPU may execute various processes executed by the CPU executing software (programs) in the above exemplary embodiment. As a processor in this case, in order to execute specific processing such as PLD (Programmable Logic Device) and ASIC (Application Specific Integrated Circuit) whose circuit configuration can be changed after manufacturing FPGA (Field-Programmable Gate Array) or the like A dedicated electric circuit, which is a processor having a circuit configuration designed exclusively, is exemplified. The various processes may be executed by one of these various processors, or a combination of two or more processors of the same type or different types (for example, a combination of a plurality of FPGAs and CPUs and FPGAs). Etc.). Further, the hardware structure of these various processors is more specifically an electric circuit in which circuit elements such as semiconductor elements are combined.

In the exemplary embodiment, the food supply program 30 is stored (installed) in the storage unit 22 in advance, the biological information acquisition program 50 is stored in the storage unit 42 in advance, and the analysis result providing program 70 is stored. However, the present invention is not limited to this. Each of the favorite food supply program 30, the biometric information acquisition program 50, and the analysis result providing program 70 includes a CD-ROM (Compact Disk Read Only Memory), DVD-ROM (Digital Versatile Disk Read Only Memory), and USB (Universal Serial Bus). ) It may be provided in a form recorded in a recording medium such as a memory. Each of the favorite food supply program 30, the biological information acquisition program 50, and the analysis result providing program 70 may be downloaded from an external device via a network.

All documents, patent applications and technical standards mentioned in this specification are to the same extent as if each individual document, patent application and technical standard were specifically and individually stated to be incorporated by reference. Incorporated by reference in the book.

The entire disclosure of Japanese Patent Application No. 2018-094627 is incorporated herein by reference.

Claims

A food supply device having a food supply unit that transmits information representing a virtual food to be supplied to a virtual life form to an electronic device representing the virtual life form according to a user's instruction;
The biometric information acquisition in which the recognition part which recognizes the said user, the biometric information acquisition part which acquires the biometric information of the said user, and the conditions regarding the said user when the said biometric information acquisition part acquires the said biometric information And receiving the information representing the favorite food transmitted from the favorite food supply device when the biological information acquisition condition that is at least one of the same conditions as the previous acquired biological information is satisfied. A portion of the electronic device,
A biological information acquisition system comprising:
2. The biological information acquisition system according to claim 1, wherein the receiving unit includes a guiding unit that guides the user to a state where the biological information acquisition condition is satisfied if the condition is not satisfied.
The biological information acquisition according to claim 1, wherein the electronic device further includes a request unit that requests the user to supply the favorite food when it is time to acquire the biological information of the user. system.
The said request | requirement part determines the said timing based on at least 1 information of the information showing the change of the state of the said electronic device, the information showing time, and the information showing the present position of an own apparatus. Biological information acquisition system.
The biological information acquisition system according to any one of claims 1 to 4, wherein the receiving unit responds to the user when the favorite is received.
The biological information acquisition system according to any one of claims 1 to 5, further comprising an analysis device that analyzes the biological information acquired by the biological information acquisition unit.
The biological information acquisition system according to claim 6, wherein the analysis device is provided in at least one of the favorite food supply device and the electronic device.
The favorite food supply device includes a purchase unit for purchasing information representing the favorite food by the user,
The analysis apparatus includes a providing unit that provides an analysis result obtained by analyzing the biological information to the user according to a purchase amount corresponding to information representing the favorite food received by the receiving unit.
The biological information acquisition system according to claim 6 or 7.
The biological information acquisition system according to any one of claims 1 to 8, wherein the favorite food is virtual food.
The biological information acquisition system according to any one of claims 1 to 8, wherein the favorite food is a virtual money item.
A food supply device having a food supply unit that transmits information representing a virtual food to be supplied to a virtual life form to an electronic device representing the virtual life form according to a user's instruction;
A recognition unit that recognizes the user, a biometric information acquisition unit that acquires the biometric information of the user, and a biometric information in which conditions regarding the user are predetermined when the biometric information acquisition unit acquires the biometric information. The electronic device having a condition for acquisition, and a guiding unit that guides the user to a state satisfying a biological information acquisition condition that is at least one of the same conditions as when the biological information was acquired last time;
A biological information acquisition system comprising:
A recognition unit for recognizing the user of a food supply device that transmits information representing a virtual favorite to be supplied to a virtual life form to an electronic device representing the virtual life form according to a user instruction;
A biometric information acquisition unit for acquiring biometric information of the user;
The condition regarding the user when the biological information acquisition unit acquires the biological information is a predetermined condition for acquiring biological information and at least one of the same conditions as when the biological information was acquired last time. When a certain biometric information acquisition condition is satisfied, a receiving unit that receives information representing the favorite food transmitted from the favorite food supply device;
Having an electronic device.
A recognition unit for recognizing the user of a food supply device that transmits information representing a virtual favorite to be supplied to a virtual life form to an electronic device representing the virtual life form according to a user instruction;
A biometric information acquisition unit for acquiring biometric information of the user;
When the biometric information acquisition unit acquires the biometric information, the condition related to the user is a predetermined condition for acquiring biometric information, and at least one of the same conditions as when the biometric information was acquired last time A guiding unit for guiding the user to a state satisfying the biometric information acquisition condition,
Having an electronic device.
On the computer,
Recognizing the user of a food supply device that transmits information representing a virtual favorite to be supplied to a virtual life form to an electronic device representing the virtual life form according to a user's instruction;
Obtaining biometric information of the user;
When the condition related to the user when acquiring the biometric information satisfies the condition for acquiring biometric information and at least one of the same conditions as when the biometric information was acquired last time, transmitted from the favorite food supply device Receiving information representing said favorite food,
A biological information acquisition method for executing processing.
On the computer,
Recognizing the user of a food supply device that transmits information representing a virtual favorite to be supplied to a virtual life form to an electronic device representing the virtual life form according to a user's instruction;
Obtaining biometric information of the user;
When acquiring the biometric information, the condition regarding the user is a biometric information acquisition condition that is a predetermined condition for acquiring biometric information and a condition that is at least one of the same conditions as when the biometric information was acquired last time. Directing the user to a state of satisfaction;
A biological information acquisition method for executing processing.
On the computer,
Recognizing the user of a food supply device that transmits information representing a virtual favorite to be supplied to a virtual life form to an electronic device representing the virtual life form according to a user's instruction;
Obtaining biometric information of the user;
The condition regarding the user when acquiring the biometric information is a biometric information acquisition condition that is a predetermined condition for acquiring biometric information and a condition that is at least one of the same conditions as when the biometric information was acquired last time If so, receive information representing the favorite transmitted from the favorite device,
A biological information acquisition program for executing processing.
On the computer,
Recognizing the user of a food supply device that transmits information representing a virtual favorite to be supplied to a virtual life form to an electronic device representing the virtual life form according to a user's instruction;
Obtaining biometric information of the user;
When acquiring the biological information, the condition related to the user is a biological information acquisition condition that is a predetermined condition for acquiring biological information and at least one of the same conditions as when the biological information was acquired last time Directing the user to a state that satisfies
A biological information acquisition program for executing processing.