JP7033307B2 - Information processing device and its operation method - Google Patents

Description

The present disclosure relates to an information processing device for determining a user's physical condition and an operation method thereof.

Patent Document 1 discloses that a massage device asks a user a question and determines a physical condition based on the user's answer.

Japanese Unexamined Patent Publication No. 2000-70318

There is a limit to the determination of the physical condition of the user by the machine (information processing) as in Patent Document 1. In addition, a person may desire to communicate with a person, and there is a possibility that the satisfaction level of the user may be lowered only by the judgment by the machine.

Therefore, a technique for supplementing the determination of the user's physical condition by a machine (information processing) is desired.

The information processing apparatus of the present disclosure executes a determination process relating to the physical condition of the user, determines the necessity of communication between the user and a human counterpart based on the result of the determination process, and determines the necessity of communication, and the communication. Is configured to execute information processing for the communication when it is determined that is necessary.

In the operation method of the information processing apparatus of the present disclosure, a determination process relating to the physical condition of the user is executed, and based on the result of the determination process, the necessity of communication between the user and a human correspondent is determined. , When it is determined that the communication is necessary, it includes executing information processing for the communication.

Further details will be described in the embodiments described below.

FIG. 1 is a flowchart of the determination process. FIG. 2 is a flowchart of processing in the server. FIG. 3 is a block diagram of a network system including a massage device. FIG. 4 is a diagram showing a shooting guidance screen of a camera image. FIG. 5 is a diagram showing a secondary determination necessity table. FIG. 6 is a diagram showing a communication necessity table. FIG. 7 is a diagram showing a doctor database, an esthetician database, and an advisor database. FIG. 8 is a diagram showing the establishment of a communication session. FIG. 9 is a diagram showing a determination result and a massage course correspondence table. FIG. 10 is an explanatory diagram of massage course generation.

<1. Overview of information processing equipment and its operation method>

(1) The information processing apparatus according to the embodiment is configured to execute a determination process relating to the physical condition of the user. The physical condition may be a condition related to the user's body, and may be, for example, a health condition such as a physical condition or a medical condition, or a cosmetic condition such as a skin condition.

The information processing apparatus according to the embodiment is configured to determine the necessity of communication between the user and a human correspondent based on the result of the determination process. Correspondents are, for example, doctors, estheticians, and other advisors on physical conditions. When communication with the responder is required, for example, when it is determined that the user's health condition is poor, it is necessary to consult with an appropriate advisor such as a doctor. When communication with the corresponding person is unnecessary, for example, there is almost no problem in the physical condition such as the health condition and the beauty condition of the user.

The information processing apparatus according to the embodiment is configured to execute the information processing for the communication when it is determined that the communication is necessary. By executing the information processing for communication, the user can easily communicate with the corresponding person.

(2) The information processing for the communication preferably includes at least one of a communication session establishment process for the communication and a preparation process for the communication. A communication session for communication is a communication session established between a user's communication device and a corresponding person's communication device. Communication preparation processing is information processing for advance preparation necessary for communication after the fact, instead of communicating with the responder immediately. The preparatory process may include, for example, a reservation process for setting a reservation for ex post facto communication, or may include a timer setting for establishing a communication session for ex post facto communication.

(3) The preparatory process preferably includes a reservation process for the communication. In this case, the user can make a reservation in order to communicate with the correspondent at a convenient time.

(4) The information processing for the communication preferably includes a process of enabling the information of the user used in the determination process to be displayed on the terminal of the corresponding person. In this case, the responder can take action based on the determination process. The determination result may be displayed on the terminal of the corresponding person in place of or in addition to the user information used for the determination process.

(5) The information processing for the communication is preferably selected based on the result of the determination process. In this case, appropriate information processing is selected according to the result of the determination process. The process selected is preferably one of, for example, information processing for communication with a doctor, information processing for communication with an esthetician, and information processing for communication with an advisor.

(6) The information processing for the communication is preferably selected on the basis of day or time. In this case, appropriate information processing is selected according to the day or time. Information processing can include, for example, a communication session establishment process for communication and a communication preparation process. For example, during the day on weekdays, the process of establishing a communication session for communication may be selected, and during the night or on holidays, the process of preparing for communication may be selected.

(7) The corresponding person is preferably selected based on the result of the determination process. In this case, an appropriate responder is selected according to the result of the determination process.

(8) It is preferable that the information processing apparatus according to the embodiment further executes an operation determination process for determining an operation to be performed by the massage device used by the user, using the result of the determination process. In this case, it is possible to determine an appropriate massage operation according to the determination processing result as the operation to be performed by the massage device. The information processing device may be built in the massage device or may be connected to the massage device via a communication network. The determination of the massage action may be the selection of the massage course based on the judgment result, the selection of the massage site (for example, the meridian) based on the judgment result, or the automatic generation of the massage course based on the judgment result. May be.

The determination of the motion does not have to be the determination of a single motion or the determination of the motion actually performed by the massage motion, and may be the determination of a plurality of motion candidates to be recommended to the user.

(9) When it is determined that the communication is necessary, the information processing apparatus according to the embodiment can execute the information processing for the communication without executing the operation determination process. The massage may be performed even when it is determined that communication is necessary, but when it is determined that communication is necessary, it may not be appropriate to perform the massage. By not performing, you can avoid performing the massage.

(10) The operation method of the information processing apparatus according to the embodiment is a key point of communication between the user and a human correspondent based on the result of the determination process for executing the determination process regarding the physical condition of the user. When it is determined whether or not the communication is necessary, the information processing for the communication is executed.

The computer program according to the embodiment has a determination process relating to the physical condition of the user, a process of determining the necessity of communication between the user and a human correspondent based on the result of the determination process, and the communication. Is a computer program that causes a computer to execute information processing for communication when it is determined that is necessary.

<2. Information processing device example>

1 and 2 show a process executed by the server (information processing apparatus) 40 shown in FIG. The server 40 is for providing a service to the user 20. The services provided to the user 20 include, for example, support for the user 20 to use the massage device 10, management of physical conditions such as the health condition and beauty condition of the user 20, and related services. The server 40 is operated by a service provider for the user 20. The service provider is, for example, a sales company of the massage device 10.

As shown in FIG. 3, the server 40 can communicate with the massage device 10 via the network 30. The network 30 is, for example, the Internet. The massage device 10 is installed in many homes. The server 40 can communicate with the plurality of massage devices 10.

The server 40 is a computer equipped with a processor 50 and a storage device 60. The processor 50 executes various information processing 51, 52, 53, 54, 55, 56, 57, 58 for providing services. These information processing 51, 52, 53, 54, 55, 56, 57, 58 are performed by the processor 50 executing the computer program 70 stored in the storage device 60. These information processes 51, 52, 53, 54, 55, 56, 57, 58 will be described later. The storage device 60 stores various data 61, 62, 63, 64, 65, 66, 67, 68 used for information processing. These data 61, 62, 63, 64, 65, 66, 67, 68 will also be described later.

The massage device 10 includes a massage device main body 10a. The massage device main body 10a includes a massage unit (not shown) that massages the user 20. The massage device main body 10a is, for example, a chair type. The chair-type massage device main body 10a includes, for example, a seat on which the user sits, a backrest provided on the rear side of the seat, a footrest provided on the front side of the seat, and armrests provided on both the left and right sides of the seat. Be prepared. The seat, backrest, footrest, and armrest are each provided with a massage section to massage the entire body of the user 20.

The massage device 10 includes an information processing device 11. The information processing device 11 is, for example, a tablet type. The information processing device 11 is a computer including a processor 12 and a storage device 13. The processor 12 performs the processing to be performed in the information processing device 11 by executing the computer program stored in the storage device 13. The information processing apparatus 11 may execute the processing performed by the server 40.

The information processing device 11 is mounted on the massage device 10 in the vicinity of the armrest, for example, so that the user 20 seated in the massage device 10 can operate the information processing device 11. The information processing device 11 is wirelessly or wiredly connected to a main body control unit (not shown) of the massage device main body 10a.

The information processing device 11 functions as an operator of the massage device main body 10a and also functions as a communication terminal for communication via the network 30 or the like. By operating the information processing device 11 as an operating device, the user 20 can select and execute a massage course, adjust the operation of the massage unit, adjust the positions of the backrest portion and the footrest, and the like.

The information processing device 11 includes a display device 15. The display device 15 of the embodiment is a touch panel, and the user 20 can perform an input operation by the touch panel 15. The information processing device 11 is arranged on the chair-type massage device main body 10a so that the touch panel 15 can be operated by the user 20 seated on the chair-type massage device main body 10a.

The information processing device 11 includes a camera (first camera) 14. The camera 14 is arranged so that the vicinity of the face of the user 20 seated on the chair-type massage device main body 10a can be photographed. The information processing device 11 includes a microphone 16 and a speaker 17. The microphone 16 can input voice to the information processing device 11. The speaker 17 can output sound from the information processing device 11.

The camera 14, the touch panel 15, the microphone 16, and the speaker 17 function as a user interface.

The information processing device 11 includes a communication interface (IF) 18. The communication IF 18 is, for example, a short-range wireless communication unit. The communication IF 18 communicates with the communication terminals 21, 22, 23 of the user 20. The communication terminal 21 is, for example, a smartphone or tablet owned by the user 20. The communication terminal 21 includes a camera (second camera) 21a.

The communication terminal 22 is, for example, a wearable device of the user 20. The wearable device 22 is, for example, a watch type, an accessory type, a clothing type, an eyeglass type, a contact lens type, a sticking type to the body, and a built-in type to the body. The wearable device 22 acquires vital data (life log) such as blood pressure, body temperature, and pulse from the user. The device for acquiring vital data may be provided in the massage device 10.

The communication terminal 23 is, for example, a physical examination device. The inspection device 23 is a device that acquires more detailed biometric data than the data obtained by the wearable device 22. The communication terminal 21 (including the camera (second camera) 21a) and the communication terminals 22 and 23 function as user interfaces.

The information processing device 11 includes a communication interface (IF) 19. The communication IF 19 is, for example, a wireless LAN or a wired LAN communication unit. The information processing device 11 connects to a network 30 such as the Internet via a LAN. The user 20 of the massage device 10 can access the server 40 and receive the service provision from the server 40 by using the information processing device 11.

For example, when using the massage device 10, the user 20 accesses the server 40 prior to executing the massage. 1 and 2 show the processing performed on the server 40 until the user 20 accesses the server 40 and the massage is executed. The processes shown in FIGS. 1 and 2 may be performed independently of the massage execution.

In step S11 shown in FIGS. 1 and 2, a process of logging in to the server 40 by the user 20 is executed. In step S11, the authentication of the user 20 is performed by, for example, face authentication. Face recognition is performed based on a user face image taken by a camera 14 mounted on the information processing apparatus 11.

When the user 20 logs in to the server 40, the determination process 51 (see FIG. 3) relating to the physical condition of the user is executed in step S12 shown in FIGS. 1 and 2. The determination process 51 of the embodiment includes a primary determination process (step S32) and a secondary determination process (step S36). The determination process 51 of the embodiment is performed using, for example, artificial intelligence.

In step S31 shown in FIG. 1, the first information acquisition process used for the primary determination process is executed. As shown in FIG. 4, in the embodiment, the first information includes a face image 81 (first image; first information) taken by the camera 14. The face image 81 may be taken for the determination process, but it is preferable to use the image used for the user authentication. By using the face image used for user authentication also in the determination process S12, the number of times of shooting can be reduced and the burden on the user can be reduced.

In the embodiment, the first information includes dialogue information between the chatbot 51a and the user. The chatbot 51a asks a question about the physical condition of the user in the dialogue with the user, and acquires information indicating the physical condition of the user from the dialogue content. The information indicating the physical condition is, for example, a keyword related to the physical condition during the dialogue. The keywords are words extracted by morphological analysis from the dialogue contents such as "stiff", "low-grade fever", "appetite", "constipation", and "rough skin". The information indicating the physical condition may be information obtained by semantically analyzing the contents of the dialogue. The chatbot 51a may be a function of the server 40 (see FIG. 3) or a function of the information processing device 11.

In the embodiment, the first information includes vital data (life log) acquired from the wearable device 22. Vital data may be acquired from the smartphone 21 or the massage device 10.

In an embodiment, the first information includes personal information stored in a personal information database 66 (see FIG. 3). The personal information database 66 includes the gender and age of the user 20, information acquired in the past from the user 20 (first information and second information described later), and the result of the past determination process 51 for the user 20, the user 20. The massage history (contents and date and time of the massage operation by the massage device 10), the meal history of the user 20, the exercise history of the user 20, the medical history of the user 20, and the like are included.

The first information acquired from the camera 14, the chatbot 51a, and the wearable device 22 is data (new data) about the current user 20, whereas the personal information database 66 is stored for the past user 20. Data (past data). By using the past and present data for the determination, the difference between the past and the present can be used for the determination.

In the primary determination process of step S32, the physical condition of the user 20 is determined using the first information regarding the user 20. For the determination of the physical condition, for example, artificial intelligence machine-learned from the determination big data 67 (see FIG. 3) is used. Machine learning is, for example, deep learning. The determination big data 67 is configured to include, for example, a large amount of data composed of a combination of information used for determining a physical condition and a determination result.

When the first information acquired in step S31 is given to the learned artificial intelligence, the artificial intelligence outputs the physical state of the user 20. It should be noted that the determination of the physical condition does not have to be performed by machine-learned artificial intelligence, and may be performed by a process based on a rule for deriving the physical condition from the first information. Further, the determination of the physical condition may be performed by combining machine-learned artificial intelligence and processing based on rules.

In order to determine the physical condition based on the rule, for example, the complexion may be identified based on the facial image and a predetermined physical condition may be output based on the complexion. Further, the occurrence of eczema on the face may be detected by the image recognition process on the face image, and a predetermined physical condition may be output depending on the condition of the eczema. If there is a difference between the past data and the new data, a predetermined physical condition may be output based on the difference. Further, a predetermined physical condition may be output based on the keyword included in the dialogue information.

The first information which is new data and the result (physical condition) of the primary determination process are stored in the personal information database 66 and used for the future determination process 51.

After the primary determination process in step S32, the necessity of the secondary determination process, which is an additional determination process, is determined in step S33. In the embodiment, the secondary determination process makes a more detailed determination or a different determination than the primary determination process. In step S33, it is determined whether or not the physical condition of the user 20 is a state that requires such an additional determination.

Whether or not the secondary determination process is necessary is determined by referring to, for example, the secondary determination necessity table 61 shown in FIG. In the secondary determination necessity table 61, the physical condition and the necessity of the secondary determination are associated with each other. For example, the physical condition of "good" is associated with "unnecessary" as the necessity of secondary determination. In addition, it is related to physical conditions related to poor complexion such as "white complexion", "yellow complexion", "red complexion", "blue complexion" and "black complexion", and rough skin such as "pimples, acne", "stains" and "dryness". "Necessity" is associated with the physical condition and the physical condition related to lack of sleep such as "bear under the eyes" and "congestion of the eyes" as the necessity of secondary judgment.

In the determination in step S33, the necessity of the secondary determination process is determined by referring to the secondary determination necessity table 61 based on the physical condition that is the result of the primary determination process. It should be noted that the determination of the necessity of the secondary determination process may be performed by machine-learned artificial intelligence based on the result of the primary determination process instead of referring to the table 61.

When it is determined in step S33 that the secondary determination process is necessary, in step S34, the type of the second information used for the secondary determination process is determined. The type of the second information is also determined by referring to the table 61 shown in FIG. In the table 61, the type of the second information is also associated with the physical condition that requires the secondary determination process. For example, the physical condition of "white complexion" is associated with "enlarged image of nose, medical examination" and the like as second information. The physical condition of "yellow complexion" is associated with "enlarged image of mouth, medical examination" and the like as second information. The physical condition of "red complexion" is associated with "enlarged image of hand, enlarged image of tongue" and the like as second information. The physical condition of "blue complexion" is associated with "enlarged image of eyes, medical examination" and the like as second information. The physical condition of "black complexion" is associated with "enlarged image of ears, medical examination" and the like as second information. Further, the physical condition of "pimples and acne" is associated with "enlarged image of the position where pimples and acne are appearing" as the second information. The physical condition of "stain" is associated with "enlarged image of tongue, medical examination" and the like as second information. The physical condition of "dryness" is associated with "meal data" or the like as second information. Further, "sleep data" is associated with the physical condition of "bear under the eyes" as the second information. A "enlarged image of the tongue" is associated with the physical condition of "red eye" as the second information.

By determining the type of the second information, the second information to be acquired can be narrowed down to only those required according to the result of the primary determination process. As a result, the burden on the user can be reduced. Since the enlarged image of the tongue can obtain a lot of information for the secondary determination process, the enlarged image of the tongue may be included as the second information acquired in all the physical states.

In step S35, the second information acquisition process is executed. The second information is different from the first information. For example, if the first information is an entire image of the face, the image as the second information is an enlarged image of a part of the face. The part of the face is, for example, the nose, eyes (fundus), oral cavity, lips, tongue, ears, cheeks, and throat. The second image 82 may be an image of a portion other than the user's face. The parts other than the face are, for example, hands, feet, and other parts.

The image as the second information is preferably taken by a camera 21a mounted on a mobile device such as a smartphone 21 that can be taken by the user 20 in his / her hand. In order to capture an enlarged image of the face or an image of a part other than the face by the camera 14 arranged to capture the entire face of the user 20 seated on the massage device 10, the user 20 needs to move his / her body. The user burden is heavy. On the other hand, when the camera 21a of a mobile device that can be taken by hand is used, it is possible to take an enlarged image of a face or an image of a part other than the face with less movement such as moving the hand, and the burden on the user is small. It is also easy for the user to photograph various parts while sitting on the massage device 10. The image as the second information may include an image taken by the camera 14 mounted on the massage device 10.

FIG. 4 shows a screen 90 displayed on the screen of the touch panel 15 of the information processing apparatus 11 or the communication terminal 21 in order to acquire an image as the second information. On the screen 90, guidance for the user 20 to take an image of the type determined in step S34 is displayed.

A sample image 92 corresponding to the type of image determined in step S34 is displayed on the screen 90. For example, in step S34, when the type of the second image 82 determined includes the enlarged image of the tongue, the enlarged image of the tongue is displayed as the sample image 92. The sample image 92 may be an image obtained by photographing the tongue or may be an illustration image. By displaying the sample image 92, it becomes easy to obtain an image suitable for the determination.

On the screen 90, an explanatory text 91 urging the user to take an image of the type determined in step S34 is displayed. For example, when the type of the second image 82 determined in step S34 includes an enlarged image of the tongue, the explanatory text 91 "Please take an image of the tongue with reference to the sample image" is displayed.

The screen 90 includes an area 93 in which an image from the camera 21a is displayed. The user 20 can take an enlarged image of his / her tongue by sticking out his / her tongue and selecting the shooting button 94 with reference to the sample image 92.

When the first information is dialogue information, the dialogue information as the second information is dialogue information based on a dialogue including a question that was not asked in the dialogue for obtaining the dialogue information as the first information. In order to obtain the dialogue information as the second information, more detailed dialogue information can be obtained by asking an additional question for identifying a more detailed physical condition (pathological condition, etc.).

The second information can include inspection data of the inspection device 23 that was not included in the first information. In order to obtain the inspection data, it takes time to operate the inspection device 23 and perform the inspection, and the burden on the user is relatively large. However, since the second information is acquired only when it is determined as necessary as a result of the primary determination process, the burden on the user can be suppressed as compared with the case where the inspection data is uniformly acquired. The first information may include inspection data.

In the secondary determination process of step S36, the physical condition of the user 20 is determined using the second information regarding the user 20. For the determination of the physical condition in the secondary determination process, for example, artificial intelligence obtained by machine learning the determination big data 67 (see FIG. 3) is used.

When the second information acquired in step S35 is given to the learned artificial intelligence, the artificial intelligence outputs the physical state of the user 20. In the secondary determination process, since the second information different from the first information used in the primary determination process is used, additional determination can be made. The first information may also be used in the secondary determination process. In the secondary determination process, the past data stored in the personal information database 66 can also be used.

It should be noted that the determination of the physical state in the secondary determination process does not need to be performed by the machine-learned artificial intelligence, and may be performed by the process based on the rule for deriving the physical state from the second information. Further, the determination of the physical condition may be performed by combining machine-learned artificial intelligence and processing based on rules.

As described above, in the determination process 51 of the embodiment, when it is determined that the secondary determination process is necessary as a result of the primary determination process, necessary second information is acquired. On the other hand, if it is determined that the secondary determination process is unnecessary as a result of the primary determination process, the second information is not acquired. Therefore, even if the server 40 has a function of acquiring a large amount of information from the user 20, it is only necessary to acquire the information from the user 20. As a result, the burden on the user is reduced. On the other hand, since the server 40 can acquire a large amount of necessary information in the secondary determination process, it is possible to make a more appropriate determination.

The second information which is new data and the result (physical condition) of the secondary determination process are stored in the personal information database 66 and used for the future determination process 51.

When the above determination process 51 (step S12) is completed, the server 40 can execute various processes for the user based on the result of the determination process. In the embodiment, in step S13 shown in FIG. 2, the necessity of communication with the responder is determined. The determination in step S13 is a determination as to whether or not to take over the user response from the server 40, which is a machine (artificial intelligence), to the responder who is a human.

The necessity of communication is determined based on the result of the secondary determination (physical condition). The necessity of communication is determined, for example, by referring to the communication necessity table 62 shown in FIG. In the communication necessity table 62, the physical condition and the necessity of communication are associated with each other. For example, "no problem" and "lack of sleep" are associated with "unnecessary" as communication necessity. In addition, "necessity" is associated with the physical condition such as "undecidable", "major health problem", and "cosmetological improvement possible" as the necessity of communication.

In the determination in step S13, the necessity of communication is determined by referring to the communication necessity table 62 based on the physical condition that is the result of the secondary determination process. The determination of the necessity of communication may be performed by machine-learned artificial intelligence based on the result of the secondary determination process instead of referring to the table 62. Further, the result of the primary determination process may be used to determine the necessity of communication. Further, even when it is determined in the determination of step S13 that communication is unnecessary, if the server 40 receives a signal indicating that the user desires communication, it is possible to communicate with the corresponding person desired by the user. can. Further, even if it is determined in the determination of step S13 that communication is necessary, if the server 40 receives a signal indicating that the user does not want communication, the communication may not be executed. ..

If it is determined in step S13 that communication is necessary, the corresponding person is selected in step S14. Correspondents are selected by referring to the table 62 shown in FIG. In the table 62, a predetermined responder is also associated with the physical condition that requires communication with the responder. For example, "undecidable" is associated with "advisor" as a correspondent. A "respiratory doctor" is assigned as a responder to the physical condition of "possible problems with the respiratory system". A "gastroenterologist" is associated with the physical condition of "possible problems with the digestive system" as a responder. A "cardiologist" is associated with the physical condition of "possible problems with the circulatory system" as a responder. A "psychiatrist or psychiatrist" is associated with the physical condition of "possible problems with the autonomic nervous system". An "esthetician" is associated with the physical condition of "mild rough skin" as a responder. A "dermatologist" is associated with the physical condition of "severe rough skin" as a responder. An "advisor" is associated with the physical condition of "mild sleep deprivation" as a responder. A "psychiatrist or psychiatrist" is associated with the physical condition of "severe sleep deprivation" as a responder. According to the embodiment, an appropriate responder can be selected according to the situation of the user. The correspondent may be selected by the user.

In step S16, it is determined whether or not the selected responder is capable of dialogue at that time. Whether or not dialogue is possible is determined by referring to the correspondent databases 63, 64, 65 (see FIG. 7) having the schedule of the selected responder. In embodiments, the responder database includes a physician database 63, an esthetician database 64 and an advisor database 65. Each database 63, 64, 65 has available schedule information for each of a plurality of responders. The schedule information includes information indicating the day, day of the week, and time zone in which the responder can interact. In step S16, it is determined whether or not the selected responder can interact with each other at the current date and time in light of the schedule information of the selected responder.

If it is determined in step S16 that dialogue is possible, a communication session establishment process for communication with the correspondent is executed (steps S18, S21, S24). In the embodiment, as shown in FIG. 8, the communication sessions S1, S2, S3 are established between the massage device 10 and the corresponding person terminals 101, 102, 103 via the network 30. The communication session establishment process may be a process in which the server 40 forcibly establishes the communication sessions S1, S2, S3, or the communication session S1, S2, S3 is established by the operation of the user 20 or the corresponding person. The screen may be displayed on the massage device 10 or the corresponding person terminals 101, 102, 103.

In the embodiment, the communication sessions S1, S2, S3 are communication sessions capable of making a video call. The responder can respond while looking at the face of the user 20. When a communication session is established between the massage device 10 and the corresponding person terminals 101, 102, 103, the server 40 inputs the user information (first information and second information) used in the determination process 51 and information about other users. The process of transmitting to the corresponding person terminal is executed (steps S19, S22, S25). This makes it easier for the responder to understand the user's situation.

The user information may be transmitted directly from the server 40 to the corresponding person terminals 101, 102, 103, or may be transmitted to the corresponding person terminals 101, 102, 103 via the massage device 10 which is a user-side device.

When the dialogue between the correspondent and the user is completed, the communication session ends (steps S20, S23, S26).

If it is determined in step S16 that dialogue is not possible, the reservation process for communication with the corresponding person is executed in step S17. It is determined that dialogue is not possible, for example, when there is no correspondent who can talk at that time in the schedule information. For example, at night or on holidays, the reservation process is executed. In the reservation process, the server 40 causes the information processing apparatus 11 to display the date and time when reservations can be made and the list of responders. The user 20 completes the reservation by selecting the reservation date and time and the corresponding person. By processing the reservation, it is possible to communicate with the responder after the fact. It should be noted that the reservation process may be feasible even when it is determined that the responder can interact with the person.

By the way, even when it is determined in step S13 that communication with the corresponding person is unnecessary, the server 40 can execute other processing for the user in step S15.

Another process for the user is, for example, a process 54 (see FIG. 3) in which a video image corresponding to the result of the secondary determination process is displayed on the user terminal. The video image to be displayed is selected by artificial intelligence, for example, based on the result (physical condition) of the secondary determination process. Artificial intelligence that selects video images is machine learning of the relationship between physical condition and video images. The video image is preferably, for example, related to improvement of physical condition.

Another process for the user is, for example, process 55 (see FIG. 3) that recommends the user 20 to go to the hospital. By this process 55, it is possible to encourage the user 20 to go to the hospital when the health condition of the user 20 is in a situation requiring urgency.

Another process for the user is a process 56 (see FIG. 3) that causes the user terminal to output lifestyle-related improvement advice according to the result of the secondary determination process. The displayed advice may include advice to limit the amount of food and advice to increase the amount of exercise when the secondary determination result indicates, for example, an obesity tendency.

Another process for the user is a process 57 for setting a schedule for re-performing the secondary determination process or the entire determination process including the secondary determination. The server 40 causes the information processing apparatus 11 to display a screen for setting a schedule. Then, the schedule is set by the user input. This makes it possible for the user 20 to execute the determination process again when desired.

Another process for the user is the process 58 for displaying the result of the secondary determination process or the recommended product according to the result of the primary determination process on the user terminal. For example, if the determination result indicates malnutrition, a dietary supplement can be presented to the user. Further, when the determination result indicates lack of exercise, the exercise equipment can be presented to the user.

The processes 54, 55, 56, 57, 58 for the user may be executed when communication with the corresponding person is performed. Further, the processes 54, 55, 56, 57, 58 for the user may be executed in parallel during the execution of the massage operation determined by the massage operation determination process (step S27) described later, or the massage operation. It may be executed after execution.

In the massage operation determination process of step S27, the massage operation to be performed by the massage device 10 is determined based on the result of the determination process 51 of step S12. The determined massage operation is transmitted from the server 40 to the information processing device 11. The information processing device 11 causes the massage device main body 10a to execute the received massage operation. In this embodiment, an appropriate massage is performed according to the physical condition. Further, in the present embodiment, since the detailed physical condition determination is performed using a large amount of information as needed, the content of the massage can be finely adjusted according to the difference in the physical condition.

In the massage motion determination process, the massage motion can be determined by using the past data stored in the personal information database 66 as well. The past data is, for example, the content of the massage operation performed on the user 20 in the past. The content of past massage movements also indicates the user's massage preferences. Therefore, if the massage motion is determined by referring to the past data of the user, it is possible to determine a different massage motion according to the user's preference even in the same physical condition.

In the massage motion determination process, the massage motion determination method can be different depending on the presence or absence of the result of the secondary determination process. In many cases, the primary determination process is performed based on a small amount of information, so the accuracy of the determination is relatively low. Therefore, it is preferable to determine the massage operation by a simple process.

The method of determining the massage operation by a simple process is, for example, selection from a plurality of existing massage course candidates. For example, as shown in FIG. 9, by referring to the massage course table 68 in which the physical condition and the massage course are associated with each other, a plurality of massage courses can be provided according to the physical condition indicated by the result of the primary determination process. You can choose from the candidates.

Further, in many cases, the secondary determination process is performed based on more information, so that the accuracy of the determination is relatively high. Therefore, it is preferable that the massage operation is also determined not by selecting an existing massage course but by a process of automatically generating a new massage course according to the situation of the user 20.

The automatic generation of the massage course can be performed, for example, by appropriately modifying the standard massage course 201 according to the physical condition indicated by the result of the secondary determination process. Further, the automatic generation of the massage course may be performed by appropriately modifying the favorite massage course of the user 20 stored in the personal information database 66 according to the physical condition.

Furthermore, the automatic generation of the massage course is performed by combining the elements that define the massage course, such as the massage site (position of the meridians) 202, the massage movement (massage, tapping, etc.) 203, the massage strength 204, and the massage time 205. May be. When combining each element, the result of the secondary determination process is taken into consideration. When combining each element, past data stored in the personal information database 66 may be taken into consideration.

The determined massage action is stored as new data in the personal information database 66.

In the present embodiment, the massage motion determination process may always be executed regardless of the determination result of the determination process. However, when it is determined that communication with the responder is necessary, it is preferable to give priority to the process for communication without executing the massage action determination process. In this case, in a situation where it is desired to consult a doctor immediately, the user 20 can quickly communicate with a corresponding person such as a doctor by avoiding the execution of the massage operation.

<3. Addendum>
The present invention is not limited to the above embodiment, and various modifications are possible.

10 Massage device 10a Massage device body 11 Information processing device (terminal mounted on the massage device)
12 Processor 13 Storage device 14 First camera (terminal mounted on the massage device)
15 Touch panel 16 Microphone 17 Speaker 18 Communication IF
19 Communication IF
20 users 21 smartphones (mobile devices)
21a Second camera (terminal installed in mobile devices)
22 Wearable equipment 23 Inspection equipment (inspection application)
30 network 40 server (information processing device)
50 Processor 51 Judgment processing 51a Chatbot 52 Information processing for communication 53 Massage operation determination processing 54 Video display processing 55 Hospital display processing 56 Lifestyle improvement advice display processing 57 Re-judgment schedule setting processing 58 Recommended product display processing 60 Storage device 61 Secondary judgment necessity table 62 Communication necessity table 63 Doctor database 64 Esthetician database 65 Advisor database 66 Personal information database 67 Big data for judgment 68 Massage course table 70 Computer program 81 First image (first information)
82 Second image (second information)
90 Screen 91 Description display 92 Sample image 93 Second camera image display area 94 Shooting button 101 Doctor terminal 102 Esthetician terminal 103 Advisor terminal 201 Standard massage course 202 Massage site 203 Massage operation 204 Massage strength 205 Massage time S1 Communication session S2 Communication Session S3 Communication session

Claims (8)

Executes the judgment process related to the user's physical condition and
Based on the result of the determination process, the necessity of communication between the user and the human correspondent is determined.
If it is determined that the communication is necessary, the information processing for the communication is executed.
The information processing for the communication includes the preparation process of the communication.
The preparatory process includes a reservation process for the communication.
As a result of the information processing, when it is determined that dialogue with the corresponding person is not possible, the reservation process for the communication is executed .
An information processing device configured to further execute an operation determination process for determining an operation to be performed by the massage device used by the user by using the result of the determination process . The information processing apparatus according to claim 1, wherein the information processing for the communication includes a process of establishing a communication session for the communication. The information processing apparatus according to claim 1 or 2, wherein the information processing for the communication includes a process of displaying the information of the user used in the determination process on the terminal of the corresponding person. The information processing apparatus according to any one of claims 1 to 3, wherein the information processing for the communication is selected based on the result of the determination process. The information processing apparatus according to any one of claims 1 to 4, wherein the information processing for the communication is selected based on a day or a time. The information processing apparatus according to any one of claims 1 to 5, wherein the corresponding person is selected based on the result of the determination process. The information processing apparatus according to claim 1 to 6 , wherein when it is determined that the communication is necessary, the information processing for the communication is executed without executing the operation determination process. Executes the judgment process related to the user's physical condition and
Based on the result of the determination process, the necessity of communication between the user and the human correspondent is determined.
If it is determined that the communication is necessary, the information processing for the communication is executed.
The information processing for the communication includes the preparation process of the communication.
The preparatory process includes a reservation process for the communication.
As a result of the information processing, when it is determined that dialogue with the corresponding person is not possible, the reservation process for the communication is executed .
An operation method of an information processing apparatus including further executing an operation determination process for determining an operation to be performed by the massage device used by the user by using the result of the determination process .

Images