JP2023072649A - Information processing device, information processing method, information processing program, and application program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing device, method, and program, and an application program that indirectly express a user's physical condition using a robot.

SOLUTION: An information processing device includes: a user information acquisition unit that acquires a user's physical condition information from an information processing terminal 110; a command transmission unit that transmits a command corresponding to the physical condition information to a robot 120 such that the robot performs actions corresponding to the user's physical condition; and a display control unit that displays an inquiry image on a display unit to inquire about the user's status of the information processing terminal. The user information acquisition unit, when there is no response to the inquiry image for a certain period, acquires, from the information processing terminal, as user environment information, at least one of the user's exercise amount, sleep duration, terminal browsing time band, terminal browsing length, terminal browsing site tendency, contents transmitted by the terminal, music contents played by the terminal, terminal location information, climate, and temperature. The command transmission unit transmits a command corresponding to the user environment information to the robot.

SELECTED DRAWING: Figure 1

COPYRIGHT: (C)2023,JPO&INPIT

Description

The present invention relates to an information processing device, an information processing method, an information processing program, and an application program.

In the above technical field, Patent Literature 1 discloses an information processing apparatus capable of alleviating a user's sense of loneliness or anxiety using an avatar.

Japanese Patent Application Laid-Open No. 2020-201669

However, the technique described in the above document cannot prompt a user who is not good at self-expression to express his/her physical condition.
An object of the present invention is to provide a technique for solving the above problems.

To achieve the above object, the device according to the present invention comprises:
An information processing device that performs communication via a network between an information processing terminal having a display unit and a robot,
A user information acquisition unit that acquires physical condition information of a user from the information processing terminal;
a command transmission unit that transmits a command corresponding to the physical condition information to the robot so that the robot performs an action that matches the physical condition of the user;
a display control unit that causes the display unit to display an inquiry image for inquiring about the state of the user of the information processing terminal;
with
When there is no response to the inquiry image for a certain period of time, the user information acquisition unit obtains from the information processing terminal the user's exercise amount, sleep time, terminal browsing time zone, terminal browsing length, terminal browsing site tendency, transmission by the terminal acquiring at least one of content, music content played by the terminal, terminal location information, climate, and temperature as user environment information;
The command transmission unit is an information processing device that transmits a command corresponding to the user environment information to the robot.

In order to achieve the above object, the method according to the present invention comprises:
An information processing method for controlling an information processing terminal having a display unit and a robot via a network,
A user information acquisition step in which the user information acquisition unit acquires physical condition information of the user from the information processing terminal;
a command transmission step in which a command transmission unit transmits a command corresponding to the physical condition information to the robot so that the robot performs an action in accordance with the physical condition of the user;
a display control step in which a display control unit causes the display unit to display an inquiry image for inquiring about the state of a user of the information processing terminal;
including
If there is no response to the inquiry image for a certain period of time, in the user information acquisition step, from the information processing terminal, the user's exercise amount, sleep time, terminal browsing time period, terminal browsing length, terminal browsing site tendency, terminal transmission acquiring at least one of content, music content played by the terminal, terminal location information, climate, and temperature as user environment information;
In the command transmission step, the command transmission unit transmits a command corresponding to the user environment information to the robot.

In order to achieve the above object, the program according to the present invention
An information processing program for controlling an information processing terminal having a display unit and a robot via a network,
a user information acquisition step of acquiring physical condition information of a user from the information processing terminal;
a command transmission step of sending a command corresponding to the physical condition information to the robot so that the robot performs an action in accordance with the physical condition of the user;
a display control step of causing the display unit to display an inquiry image for inquiring about the state of the user of the information processing terminal;
An information processing program that causes a computer to execute
When there is no response to the inquiry image for a certain period of time, in the user information acquisition step, from the information processing terminal, the user's walking amount, sleep time, terminal browsing time zone, terminal browsing length, terminal browsing site tendency, terminal Acquiring at least one of transmission content, music content played by the terminal, terminal location information, climate, and temperature as user environment information,
In the information processing program, in the command sending step, a command corresponding to the user environment information is sent to the robot.

In order to achieve the above object, the program according to the present invention
An application program executed by an information processing terminal having a display,
a display step of displaying an inquiry image for inquiring about a user's physical condition on the display unit;
If there is no response to the inquiry image for a certain period of time, the user's exercise amount, sleep time, terminal browsing time period, terminal browsing length, terminal browsing site tendency, content sent by the terminal, music content played by the terminal, terminal location an acquisition step of acquiring at least one of information, climate, and temperature as user environment information;
an instruction step of instructing a server to cause the robot to perform an action corresponding to an answer to the inquiry image or an action corresponding to the user environment information;
is executed by the information processing terminal.

According to the present invention, a user can indirectly express his physical condition using a robot.

1 is a block diagram showing the configuration of an information processing apparatus according to a first embodiment; FIG. It is a figure which shows the structure and effect|action of the information processing system which concerns on 2nd Embodiment. It is a figure which shows the structure and effect|action of the information processing system which concerns on 2nd Embodiment. It is a figure which shows the internal structure and effect|action of the server which concerns on 2nd Embodiment. It is a figure which shows the operation|movement of the application which concerns on 2nd Embodiment. It is a figure which shows the operation|movement of the application which concerns on 2nd Embodiment. 9 is a flow chart showing the flow of processing of a server according to the second embodiment; 9 is a flow chart showing the flow of processing of a server according to the second embodiment; It is a table showing input items of the server according to the second embodiment. It is a figure which shows the example of a screen of the application which concerns on 2nd Embodiment. It is a figure which shows the cooperation of the application which concerns on 2nd Embodiment.

BEST MODE FOR CARRYING OUT THE INVENTION Exemplary embodiments of the present invention will be described in detail below with reference to the drawings. However, the components described in the following embodiments are merely examples, and the technical scope of the present invention is not limited to them.

[First embodiment]
An information processing apparatus 100 as a first embodiment of the present invention will be described using FIG. The information processing apparatus 100 is an information processing apparatus that communicates with an information processing terminal 110 having a display unit 111 and a robot 120 via a network 130 .

As shown in FIG. 1, the information processing apparatus 100 includes a user information acquisition section 101 and a command transmission section 102 .

The user information acquisition unit 101 acquires the physical condition information 151 of the user 150 from the information processing terminal 110 .

The command sending unit 102 sends a command 121 corresponding to the physical condition information to the robot 120 so that the robot 120 performs an action suitable for the physical condition of the user 150 .

With the above configuration, the user can indirectly express his or her physical condition using the robot.

[Second embodiment]
Next, an information processing system 200 according to a second embodiment of the present invention will be explained using FIG. FIG. 2 is a diagram for explaining an outline of overall processing of the information processing system 200 according to this embodiment.

The information processing system 200 includes a smartphone 201 having a display unit 211 , a server 202 , and a stuffed toy robot 203 .

First, the dedicated application 212 is activated using the smartphone 201, and the user account of the dedicated application 212 and the stuffed toy robot 203 are associated one-to-one.

User 210 then enters physical condition information 213 from the user account. The input physical condition information is sent to the server 202 by the dedicated application 212 . The server 202 stores the acquired physical condition information in the database 221 .

For example, the user may be prompted to enter the physical condition information 213 by notifying the user as follows. - Issue an alert prompting you to enter your physical condition information at a fixed time in the morning, day and night.・An alert prompting you to enter your physical condition information is displayed when the application does not start for a certain period of time even though there is an incoming call notification to the application that receives contact from others.・An alert prompting you to enter your physical condition information is issued when you are operating your smartphone for a certain period of time during the late night hours, such as 0:00 to 4:00.

The plush toy robot 203 periodically receives commands 222 from the server 202 and performs poses and facial expressions according to the received commands so as to perform actions that match the physical condition of the user 210 . As a result, the family of user 210 who sees stuffed toy robot 203 can guess the health condition of user 210 .

FIG. 3 is another diagram for explaining the outline of the overall processing of the information processing system 200 according to this embodiment.

The plush toy robot 203 transmits touch information 231 detected by the provided sensor to the server 202 at any time. That is, when a family member of the user 210 or the like strokes the stuffed toy robot 203 , information about the stroke is sent to the server 202 . The server 202 stores the touch information 231 in the database 221 and controls the smartphone 201 to notify the user 210 based on the touch information 231 .

FIG. 4 is a diagram showing the configuration of the server 202 as an information processing apparatus according to this embodiment. The server 202 includes a terminal control section 421 , a user information acquisition section 422 , a command transmission section 423 and a robot information acquisition section 424 . The terminal control unit (display control unit) 421 causes the display unit 211 to display an inquiry image for inquiring about the state of the user 210 of the smartphone 201 . Moreover, the terminal control unit 421 further controls the smartphone 201 to notify the user 210 based on the touch information 231 . In other words, the application 212 notifies the user that the stuffed toy robot 203 has been cared for. The user information acquisition unit 422 acquires the user's response to the inquiry image displayed on the display unit 211 . The command transmission unit 423 transmits a command according to the answer acquired by the user information acquisition unit 422 to the stuffed toy robot 203 to operate the stuffed toy robot 203 .

Specifically, as shown in FIG. 5, a character image 521 corresponding to the plush toy robot 203 is displayed as an inquiry image on the screen of the smartphone 201, and the user 210 moves the character image 521 by touch operation, drag operation, or the like. .

The user information acquisition unit 422 acquires the operation performed by the user 210 on the character image 521 as physical condition information, and the command transmission unit 423 transmits a command corresponding to the acquired operation to the plush toy robot 203 .

For example, when the user 210 is in a good mood or in good physical condition, the arm of the character image is twirled. Then, in conjunction with the input content of the smartphone 201, the arms of the stuffed toy robot 203 are raised, and the eyes are wide open. As a result, the family members 501 of the user 210 near the stuffed toy robot 203 can sense that the user 210 seems to be feeling well.

On the other hand, for example, when the user 210 is in poor physical condition or feels heavy, the character image is repeatedly tapped or long-pressed. Then, the stuffed toy robot 203 lowers its arms and ears and closes its eyes in conjunction with the input contents of the smartphone 201 . As a result, the family members 501 of the user 210 near the stuffed toy robot 203 can feel that the user 210 seems unwell.

The robot information acquisition unit 424 acquires the touch information 231 detected by the sensor provided in the stuffed toy robot 203 from the robot. Then, the terminal control unit 421 controls the smartphone 201 so as to perform notification 601 based on the touch information to the user 210 of the smartphone 201 (FIG. 6).

7 and 8 are flowcharts showing the processing flow of the server 202. FIG. FIG. 9 is a list of data acquired by application 212 . Here, the application 212 is, for example, an application specialized for monitoring the physical condition of cancer patients.

First, when the application 212 is started for the first time, in step S701, the stuffed toy ID (item 1 in FIG. 9) is entered, and the date and time (item 2 in FIG. 9) obtained from the database 221 and the ID (user account) of the application 212 are entered. It is linked and stored in the database 221 . As a result, the application 212 and the stuffed toy robot 203 are associated with each other. Next, user attribute information (items 3 to 6 in FIG. 9) is obtained (step S702). Specifically, the user's date of birth, sex, cancer type, cancer progress (stage), and the like are input. Cancer types include gastric cancer, penile cancer, various bone and soft tissue tumors, liver cancer, thyroid cancer, retroperitoneal tumor, bone metastasis, uterine cancer, esophageal cancer, kidney cancer, and renal pelvis. Ductal cancer, pancreatic cancer, testicular cancer, prostate cancer, colorectal cancer, biliary tract cancer, head and neck cancer, breast cancer, lung cancer, skin cancer, adrenal cancer, bladder cancer, and ovarian cancer. be done. Sarcomas include osteosarcoma, chondrosarcoma, rhabdomyosarcoma, leiomyosarcoma, fibrosarcoma, liposarcoma, and angiosarcoma. Furthermore, hematologic cancers include leukemia, malignant lymphoma, and myeloma. The stage of cancer is evaluated in five stages from stage 0 to stage IV according to three factors: size (spread) of cancer, presence or absence of metastasis to lymph nodes, and metastasis to other organs. be. Stage IV is the most advanced (worse) condition.
That is, the user information acquisition unit 422 acquires at least one of the user's date of birth, sex, disease, or disability from the smartphone 201 as a user attribute, and the command transmission unit 423 transmits a command according to the user attribute. It is sent to the plush toy type robot 203 .

Here, the case where the user is a leprosy patient is taken as an example, but the present invention is not limited to this. An application configuration specific to a patient may be used. Alternatively, it may be an application configuration for a user who has a disability due to an accident or the like. In particular, the present invention is very effective for patients with infectious diseases whose family members cannot be near the user, and users such as deaf people who find it difficult to express their physical condition and emotions.

In step S703, other applications to be linked are set. Specifically, as shown in items 9 to 19 in FIG. 9, an application such as a pedometer (registered trademark), an application that detects sleep time, an application that checks the usage status of a smartphone, a music playback application, and location information. Various information such as the amount of walking can be acquired by linking with a detection application and an application that checks the weather and temperature. In addition, it may be linked with an application that conducts a psychological test or a game that can grasp the psychological state.

FIG. 8 is a flow chart showing the flow of processing when the application 212 is started for the second time or later. In step S<b>801 , the terminal control unit 421 first displays a current mood (physical condition) input screen ( FIG. 5 ) on the screen of the smartphone 201 . If there is an input in this state, the process proceeds from step S802 to step S803, and the command transmission unit 423 generates a command based on the acquired physical condition information and transmits the command to the plush toy robot 203. FIG.

If there is no input on the current mood input screen for a certain period of time (for example, three days), the process proceeds from step S804 to step S805, and the terminal control unit 421 causes the display unit 211 to display the psychological test (FIG. 10). If there is an input, the process proceeds from step S806 to step S803, the user information acquisition unit 422 acquires the psychological test result from the smartphone 201, and the command transmission unit 423 transmits a command according to the psychological test result to the robot.

Further, if there is no input for a certain period of time regarding the psychological test, the process proceeds from step S806 to step S807 to step S808, and the user information acquisition unit 422 acquires information on the physical condition and mood of the user from another cooperative application.

Specifically, instead of the physical condition information directly input by the user, the user information acquisition unit 422 obtains the user's exercise amount (for example, walking amount), sleep time, terminal browsing time period, terminal browsing length, terminal browsing site tendency, At least one of the content of transmission by the terminal, the content of music played back by the terminal, the terminal location information, the climate, and the temperature is acquired as the user environment information (FIG. 11).

Then, proceeding to step S803, the command transmission unit 423 transmits a command corresponding to the user environment information to the robot.

By processing in this way, even if the input of the dedicated application 212 or the input of the psychological test result is interrupted, the user's physical and mental condition can be detected based on the data acquired from other applications and browsers accumulated in advance. Able to predict and control the movement of stuffed animals.

In this way, by accumulating a large amount of user's environmental information and physical condition information directly input by the user, machine learning can be performed on the correlation between season, weather, temperature, medicine, etc., and physical condition and emotion, and environmental information can be obtained. It becomes possible to estimate the physical condition information with high accuracy from the

As described above, according to the present embodiment, the user can indirectly express his or her physical condition using the robot.

[Other embodiments]
Although the present invention has been described with reference to the embodiments, the present invention is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the technical scope of the present invention. Also, any system or apparatus that combines separate features included in each embodiment is included in the technical scope of the present invention.

Further, the present invention may be applied to a system composed of a plurality of devices, or may be applied to a single device. Furthermore, the present invention can also be applied when an information processing program that implements the functions of the embodiments is supplied to a system or apparatus and executed by a built-in processor. In order to realize the functions of the present invention on a computer, the technical scope of the present invention includes a program installed in a computer, a medium storing the program, a server for downloading the program, and a processor executing the program. . In particular, non-transitory computer readable media storing programs that cause a computer to perform at least the processing steps included in the above-described embodiments fall within the scope of the present invention.

Claims (7)

An information processing device that performs communication via a network between an information processing terminal having a display unit and a robot,
A user information acquisition unit that acquires physical condition information of a user from the information processing terminal;
a command transmission unit that transmits a command corresponding to the physical condition information to the robot so that the robot performs an action that matches the physical condition of the user;
a display control unit that causes the display unit to display an inquiry image for inquiring about the state of the user of the information processing terminal;
with
When there is no response to the inquiry image for a certain period of time, the user information acquisition unit obtains from the information processing terminal the user's exercise amount, sleep time, terminal browsing time zone, terminal browsing length, terminal browsing site tendency, transmission by the terminal acquiring at least one of content, music content played by the terminal, terminal location information, climate, and temperature as user environment information;
The command transmission unit is an information processing device that transmits a command corresponding to the user environment information to the robot. a robot information acquisition unit that acquires from the robot touch information detected by a sensor provided on the robot;
a terminal control unit that controls the information processing terminal so as to notify a user of the information processing terminal based on the touch information;
The information processing apparatus according to claim 1, further comprising: The display control unit causes the display unit to display an image representing the robot,
The user information acquisition unit acquires, as the physical condition information, an operation performed by a user on the image of the robot displayed on the information processing terminal,
3. The information processing apparatus according to claim 1, wherein said command transmission unit transmits a command corresponding to said operation to said robot. The user information acquisition unit acquires at least one of a user's date of birth, gender, illness or disability from the information processing terminal as a user attribute,
3. The information processing apparatus according to claim 1, wherein said command transmission unit transmits a command corresponding to said user attribute to said robot. An information processing method for controlling an information processing terminal having a display unit and a robot via a network,
A user information acquisition step in which the user information acquisition unit acquires physical condition information of the user from the information processing terminal;
a command transmission step in which a command transmission unit transmits a command corresponding to the physical condition information to the robot so that the robot performs an action in accordance with the physical condition of the user;
a display control step in which a display control unit causes the display unit to display an inquiry image for inquiring about the state of a user of the information processing terminal;
including
If there is no response to the inquiry image for a certain period of time, in the user information acquisition step, from the information processing terminal, the user's exercise amount, sleep time, terminal browsing time period, terminal browsing length, terminal browsing site tendency, terminal transmission acquiring at least one of content, music content played by the terminal, terminal location information, climate, and temperature as user environment information;
The information processing method, wherein in the command transmission step, the command transmission unit transmits a command corresponding to the user environment information to the robot. An information processing program for controlling an information processing terminal having a display unit and a robot via a network,
a user information acquisition step of acquiring physical condition information of a user from the information processing terminal;
a command transmission step of sending a command corresponding to the physical condition information to the robot so that the robot performs an action in accordance with the physical condition of the user;
a display control step of causing the display unit to display an inquiry image for inquiring about the state of the user of the information processing terminal;
An information processing program that causes a computer to execute
When there is no response to the inquiry image for a certain period of time, in the user information acquisition step, from the information processing terminal, the user's walking amount, sleep time, terminal browsing time zone, terminal browsing length, terminal browsing site tendency, terminal Acquiring at least one of transmission content, music content played by the terminal, terminal location information, climate, and temperature as user environment information,
An information processing program for sending a command corresponding to the user environment information to the robot in the command sending step. An application program executed by an information processing terminal having a display,
a display step of displaying an inquiry image for inquiring about a user's physical condition on the display unit;
If there is no response to the inquiry image for a certain period of time, the user's exercise amount, sleep time, terminal browsing time period, terminal browsing length, terminal browsing site tendency, content sent by the terminal, music content played by the terminal, terminal location an acquisition step of acquiring at least one of information, climate, and temperature as user environment information;
an instruction step of instructing a server to cause the robot to perform an action corresponding to an answer to the inquiry image or an action corresponding to the user environment information;
is executed on the information processing terminal.

Images