JP2019113896A - Device, method, and program for processing information - Google Patents

Abstract

To ensure that a user does the cleaning effectively.SOLUTION: An information processing device 400 has a controller 430 comprising a first acquisition unit 131, action assessment unit 435, and granting unit 436. The action assessment unit 435 determines whether a user has done the cleaning or not on the basis of conversational information acquired by the first acquisition unit 131. The granting unit 436 grants a reward to a predetermined eligible person for the cleaning when the action assessment unit 435 determines that a cleaning has been done by the user.SELECTED DRAWING: Figure 15

Description

  Embodiments of the present invention relate to an information processing apparatus, an information processing method, and an information processing program.

  In recent years, with the spread of the Internet, various services for supporting daily life have come to be provided. For example, there is a technology for providing a user with a cleaning assistance.

  Patent Document 1 discloses a technology that enables the tidying robot to store any daily-use article at any position according to a person's instruction or voluntarily, and to tidy up any empty space. It is done.

JP 2007-152443 A

  However, in the above-described prior art, it is not always possible to make the user effectively clean. For example, the above-mentioned prior art detects the position of the user, moves to the side and stands by, recognizes the user's speech content, takes out the hand to receive the article, photographs the article, and uses the user name and article name by the user. It is a technique relating to a tidying robot that recognizes speech and makes it possible to store articles in the immediate storage location.

  In the above-described prior art, even if it is possible to store any daily-use article at any position according to a person's instruction to the cleaning-up robot and allow the user to clean up any space, it is possible for the user to However, it is not always possible to clean up effectively.

  This application is made in view of the above, and aims at making a user perform cleaning effectively.

  An information processing apparatus according to the present application includes: a determination unit that determines whether or not a user performs a cleaning action; and an assignment unit that rewards a predetermined target person regarding the cleaning action based on a determination result by the determination unit. It is characterized by having.

  According to one aspect of the embodiment, an effect is provided that the user can be effectively cleaned.

FIG. 1 is a diagram illustrating an example of information processing according to the embodiment. FIG. 2 is a diagram illustrating an example of the information processing according to the first embodiment. FIG. 3 is a diagram illustrating an exemplary configuration of the information processing system according to the first embodiment. FIG. 4 is a diagram illustrating an exemplary configuration of the information processing apparatus according to the first embodiment. FIG. 5 is a diagram showing an example of the user information storage unit according to the first embodiment. FIG. 6 is a diagram showing an example of the environment information storage unit according to the first embodiment. FIG. 7 is a flowchart illustrating an example of the information processing according to the first embodiment. FIG. 8 is a diagram illustrating an example of the information processing according to the second embodiment. FIG. 9 is a view showing an example of the arrangement of an information processing apparatus according to the second embodiment. FIG. 10 is a flowchart illustrating an example of the information processing according to the second embodiment. FIG. 11 is a diagram illustrating an example of the information processing according to the third embodiment. FIG. 12 is a view showing an example of the arrangement of an information processing apparatus according to the third embodiment. FIG. 13 is a flowchart illustrating an example of the information processing according to the third embodiment. FIG. 14 is a diagram illustrating an example of the information processing according to the fourth embodiment. FIG. 15 is a view showing an example of the arrangement of an information processing apparatus according to the fourth embodiment. FIG. 16 is a diagram showing an example of a reward information storage unit according to the fourth embodiment. FIG. 17 is a flowchart illustrating an example of the information processing according to the fourth embodiment. FIG. 18 is a hardware configuration diagram showing an example of a computer for realizing the function of the information processing apparatus.

(Overview of information processing)
[1. Overview of the whole]
Hereinafter, an information processing apparatus, an information processing method, and a mode for carrying out an information processing program according to the present application (hereinafter, referred to as “embodiment”) will be described with reference to the drawings. Note that the information processing apparatus, the information processing method, and the information processing program according to the present application are not limited by the embodiments. Moreover, in the following embodiments, the same reference numerals are given to the same parts, and the overlapping description will be omitted.

  First, an outline of information processing according to the embodiment will be shown using FIG. FIG. 1 is a diagram illustrating an example of information processing according to the embodiment. The information processing according to the embodiment is performed by the information processing device SV shown in FIG. For example, the information processing device SV is realized by a single device or a plurality of devices such as a server device or a cloud system, and is placed in, for example, a room where the user is located via a network such as a mobile communication network or a wireless LAN (Local Area Network). It is an information processing apparatus capable of communicating with various kinds of Internet of Things (IoT) devices including an audio device, a movable work robot (cleaning robot) and the like, or a terminal device 10 used by a user.

  The details of the information processing performed by the information processing apparatus SV are the four embodiments, specifically, the first embodiment, the second embodiment, the third embodiment, and the fourth embodiment. The details will be described later. Also, the information processing corresponding to the first embodiment is "processing A", the information processing corresponding to the second embodiment is "processing B", and the information processing corresponding to the third embodiment is "processing C", The information processing corresponding to the fourth embodiment is referred to as “process D”.

  The terminal device 10 is an information processing device used by a user. The terminal device 10 is, for example, a smartphone, a tablet terminal, a notebook PC (Personal Computer), a desktop PC, a mobile phone, a PDA (Personal Digital Assistant), or the like. In addition, it is assumed that an application (hereinafter, referred to as “application AP”) that enables transmission and reception of information with the information processing device SV is installed in the terminal device 10 in advance.

  In addition, words such as "cleaning" and "cleaning behavior" used in each of the following embodiments may be, for example, "clean up" which is an operation of returning a scattered object to a predetermined place, dirt attached to a floor or a wall, etc. The concept of “cleaning”, which is the task of removing dust, shall be included.

[2. Outline of Information Processing Corresponding to First Embodiment]
First, the premise on which the information processing (processing A) corresponding to the first embodiment is performed will be described. There are many users who are not good at cleaning, but it is not possible to make a decision as to when and what kind of cleaning should be done by yourself if you feel that you are not good at cleaning like this. Sometimes it's because you can't figure out where to start.

  Therefore, the information processing device SV acquires environment information indicating the user's peripheral environment, and determines the necessity of cleaning for the user based on the acquired environment information. Then, the information processing device SV notifies the user of information related to cleaning based on the determination result. In one example, the information processing apparatus SV acquires conversation information, which is information related to the user's conversation, as environment information indicating the user's peripheral environment. Such conversation information is, for example, conversation information input to a predetermined voice device.

  Then, the information processing device SV determines the necessity of cleaning for the user based on the content of the conversation indicated by the acquired conversation information, and when it is determined that the cleaning is necessary, for example, Notifies the user of the cleaning situation such as how unorganized (or dirty) the room is through a predetermined voice device, and also notifies that it is time to clean Do.

  Below, an example of the process A is demonstrated using the example of FIG. FIG. 1 includes all conceptual diagrams of the processes A to D. Attention is paid to FIG. 1 (a) for explaining the process A among them. In FIG. 1A, users U11 and U12 exist in the living room R. The users U11 and U12 have a parent-child relationship, and the user U11 is a son and the user U12 is a mother. When there is no need to distinguish between the users U11 and U12, they are simply described as "user".

  In the room R, a voice device DV1 is placed. The voice device DV1 is, for example, a voice interaction type device that realizes dialogue with the user by replying to the voice input from the user. In addition, the audio device DV1 enables transmission and reception of information with the information processing device SV via the Internet.

  For example, the audio device DV1 detects environment information indicating the user's peripheral environment. In the example of FIG. 1A, the environment information indicating the user's peripheral environment may be any information as long as the information indicates what environment the interior of the living room R is in. For example, the environment information may be information indicating various situations such as the situation where articles are placed in the living room R, the situation of dust in the living room R, and the conversation situation of the user in the living room R.

  For example, the audio device DV1 detects information on the user's conversation (information indicating the user's conversation content) as environment information (step S11), and transmits the detected environment information to the information processing apparatus SV (step S12). Thus, the information processing device SV can acquire environment information.

  Then, the information processing device SV determines the necessity of cleaning for the user based on the acquired environment information (step S13). In the example of FIG. 1A, the information processing apparatus SV determines the necessity of cleaning, such as whether the user needs to clean the living room R or not. For example, the information processing apparatus SV estimates that the room R is scattered and the user is in the room, when the acquired environment information includes the text such as "Scrap and clean up" in the conversation information. Determine that R needs to be cleaned. Then, when it is determined that the user needs to clean the living room R, the information processing device SV performs notification control to notify the user of information related to cleaning to the voice device DV1 (step S14).

  In response to the notification control, the audio device DV1 outputs the information regarding the cleaning as an audio. As an example, the audio device DV1 outputs an audio such as "The room is dirty. Please clean it." Thereby, the user U11 is pointed out not only by the user U12 who is the mother but also by the third party (the audio device DV1), so it becomes easy to realize that it is necessary to clean the living room R. In other words, the information processing device SV can effectively recognize that the timing for cleaning the user U11 is now.

[3. Outline of Information Processing Corresponding to Second Embodiment]
Next, information processing (process B) corresponding to the second embodiment will be described. First, the premise of the process B will be described. As described above, the reason why the user is not good at cleaning is because they can not make decisions themselves about when and what kind of cleaning should be done, or they can not find an opportunity to start cleaning. However, even if it is intended to clean, for example, if an object is scattered in the room, the cleaning robot can not even be operated.

  Therefore, the information processing device SV acquires environmental information indicating the user's peripheral environment and detected by the movable work robot, and estimates the cleaning situation of the user in the room based on the acquired environmental information. Do. In one example, the information processing device SV acquires, as environmental information, environmental information detected by a predetermined sensor function of the work robot. Then, the information processing device SV estimates the cleaning situation of the user in the room based on the acquired environment information.

  Note that such environmental information is, for example, information indicating in what situation a thing is placed in a room, or a movement distance such as how much the working robot can move when the thing is upset. Information (for example, transition of movement distance, etc.). Further, such environment information may be the environment information described in the information processing corresponding to the first embodiment, that is, conversation information.

  Below, an example of the process B is demonstrated using the example of FIG. Here, attention is paid to FIG. 1 (b) for explaining the process B. Also in FIG. 1 (b), a living room R is used as an example as in FIG. 1 (a). Although not shown, it is assumed that users U11 and U12 are also present.

  In the living room R, a cleaning robot RB1 (an example of a movable work robot) is placed. The cleaning robot RB1 includes various sensors, and detects environmental information using the sensors while moving around in the living room R. Examples of various sensors include a camera, a dust sensor, an echo location (ultrasonic position sensor) and the like. In addition, the cleaning robot RB1 enables transmission and reception of information with the information processing apparatus SV via the Internet. In addition, the cleaning robot RB1 may have a function to realize dialogue with the user by, for example, responding to the voice input from the user.

  For example, the cleaning robot RB1 detects arrangement information in which objects are arranged on the floor of the living room R as environmental information (step S21). Briefly, the cleaning robot RB1 photographs the floor of the living room R. Then, the cleaning robot RB1 transmits the detected environment information, that is, the photographed image to the information processing apparatus SV (step S22). Thus, the information processing device SV can acquire environment information.

  Then, the information processing device SV estimates the cleaning situation (ordering situation) of the living room R based on the acquired environment information (step S23). For example, the information processing device SV estimates the tidy status of the living room R by analyzing the captured image. Here, assuming that the information processing device SV estimates that the orderly state is “bad”, the information processing device SV controls the cleaning robot RB1 to notify the user of information related to cleaning (step S24).

  In response to the notification control, the cleaning robot RB1 outputs voice information on cleaning. As an example, the cleaning robot RB1 outputs an audio such as "room is not organized. Please clean up after cleaning up." Note that the information processing device SV may perform notification control so as to notify the user of information regarding cleaning to the audio device DV1. As a result, the information processing device SV can recognize the tidying state of the room, and for example, when the tidying state of the room is bad, the user can be notified of that. As a result, the information processing device SV can make the user aware that it is necessary to first arrange the room.

  Here, the information processing (process A) corresponding to the first embodiment includes the process of estimating the cleaning situation in the room based on the conversation information of the user as the environment information. On the other hand, the information processing (process B) corresponding to the second embodiment is to estimate the cleaning condition of the room based on the environmental information (in particular, information on the arrangement of objects) detected by the work robot as the environmental information. is there. Therefore, the process B can be said to be one of the variations of the process A.

[4. Outline of Information Processing Corresponding to Third Embodiment]
Next, information processing (process C) corresponding to the third embodiment will be described. First, the premise of the process C will be described. There are many users who can not easily clean up the room or can not clean it, but it is not possible to recognize, for example, what kind of harm is caused by things being scattered in the room, for example. Or, it is possible that there is no motivation for cleaning in the first place.

  Therefore, the information processing device SV acquires the determination result in which it is determined whether or not the user needs to be cleaned, and the acquired determination result indicates that the user needs to be cleaned. Output control is performed to output information on cleaning at a predetermined position.

  Below, an example of the process C is demonstrated using the example of FIG. Here, attention is paid to FIG. 1 (c) for explaining the process C. Also in FIG. 1 (c), a living room R is used as an example as in FIG. 1 (a). In the room R, a voice device DV1 is placed. Although not shown, it is assumed that users U11 and U12 are also present.

  In such a state, the information processing device SV acquires the determination result in which the necessity for cleaning is determined (step S31). Specifically, the information processing device SV acquires the determination result as to whether or not cleaning is necessary. Using the example of FIG. 1A, the information processing apparatus SV determines in step S13 that cleaning is necessary here. Therefore, in the example of FIG. 1A, the information processing device SV acquires that “cleaning is necessary” as the determination result.

  As described above, when the determination result indicates that cleaning is necessary, the information processing device SV performs output control so as to output information regarding cleaning to a predetermined position in the room with respect to the audio device DV1 (step S32) ). For example, the information processing device SV performs output control on the audio device DV1 so as to output information related to cleaning to the cleaning-required position that needs cleaning.

  In response to the output control, the audio device DV1 outputs information regarding cleaning to the cleaning required position. If an example is shown, audio | voice device DV1 will project the shadow of a harmful substance (for example, pest) to the cleaning required position as information regarding cleaning (step S33). As a result, since the information processing apparatus SV can virtually experience the actual harm that any pest will occur if it is not cleaned, the motivation for cleaning can be effectively performed.

[5. Outline of Information Processing Corresponding to Fourth Embodiment]
Next, information processing (process D) corresponding to the fourth embodiment will be described. First, the premise of the process D will be described. There are many users who are not good at cleaning, and it is difficult to motivate such users for cleaning. Therefore, the information processing device SV acquires environment information indicating the user's peripheral environment. Then, the information processing device SV determines whether or not the user has performed the cleaning action based on the acquired environment information, and based on the determination result, gives a reward to a predetermined target person regarding the cleaning action.

  In one example, the information processing apparatus SV acquires conversation information, which is information related to the user's conversation, as environment information indicating the user's peripheral environment. Such conversation information is, for example, conversation information input to a predetermined voice device. As another example, the information processing apparatus SV acquires environment information detected by a predetermined sensor function of the work robot as environment information indicating a user's peripheral environment.

  Below, an example of the process D is demonstrated using the example of FIG. Here, attention is focused on FIG. 1 (d) for explaining the process D. Also in FIG. 1D, a living room R is used as an example as in FIG. 1A, and in the living room R, users U11 and U12 are present. In the room R, a voice device DV1 is placed.

  Similar to the processing A, for example, the voice device DV1 detects, as environment information, conversation information which is information related to the user's conversation (step S41), and transmits the detected environment information to the information processing apparatus SV (step S42) . Thus, the information processing device SV can acquire environment information.

  Then, the information processing device SV determines whether the user has performed the cleaning action based on the acquired environment information (step S43). For example, the information processing device SV determines whether one of the users U11 and U12 has performed the cleaning action. The information processing device SV determines whether the user U11 has performed a cleaning action when it is set in advance that the user U11 is to be a processing target of the determination process.

  In the case where the information processing device SV includes, in the conversation information as the acquired environment information, a text indicating that the user U12 has called the user U11 "I was able to clean properly" and the like. Determines that the user U11 has performed a cleaning action. When it is determined that the user U11 has performed the cleaning action, the information processing device SV gives a predetermined reward to the user U11 (step S44). For example, the information processing device SV gives a predetermined point to the user U11, and controls the terminal device 10 of the user U11 to be able to confirm the current possession point via the application AP.

  As described above, when the user performs the cleaning action, the information processing device SV gives a reward to the user. Even if users who are not good at cleaning can get a reward, it is possible that their willingness to clean is higher. Therefore, the information processing device SV can effectively make the user clean.

[6. About processing order]
In the above example, the information processing apparatus SV estimates the cleaning status by processing A (and processing B), and when it is determined that there is a need for cleaning, projects the harmful substance by processing C, and further processing D In the case where it is determined that the cleaning action has been performed, an example of giving a reward is shown. However, the processing order is not limited to this, and for example, the information processing apparatus SV may perform the processing A (and the processing B) in order to determine whether the cleaning action has been performed in the processing D. When it is determined that the cleaning action is not performed in the process D, the information processing apparatus SV may perform the cleaning motivation by performing the process C. As described above, the processes A to D are not performed independently of one another, but are appropriately performed in combination.

First Embodiment
[1. Example of information processing]
Next, an example of the information processing according to the first embodiment will be described with reference to FIG. FIG. 2 is a diagram illustrating an example of the information processing according to the first embodiment. The information processing according to the first embodiment is performed by the information processing apparatus 100. The information processing device 100 is an example of the information processing device SV described with reference to FIG. Also, FIG. 2 explains FIG. 1 (a) in more detail. In FIG. 2, the users U11 and U12 exist in the living room R. The users U11 and U12 are in a parent-child relationship, the user U11 is a son, and the user U12 is a mother.

  In the room R, a voice device DV1 is placed. In the living room R, a cleaning robot RB1 (an example of a movable work robot) is placed.

  In such a state, the information processing apparatus 100 acquires environment information indicating the user's peripheral environment, and determines the necessity of cleaning for the user based on the acquired environment information. Then, the information processing apparatus 100 notifies the user of information related to cleaning based on the determination result.

  In one example, the information processing apparatus 100 acquires, as environment information indicating a user's peripheral environment, conversation information which is information related to the user's conversation. Such conversation information is, for example, conversation information indicating a conversation input to the voice device DV1. Moreover, if an example is shown if an example is shown, the information processing apparatus 100 will acquire the environment information detected by the sensor function which cleaning robot RB1 has as environment information which shows a user's peripheral environment. As environmental information detected by the sensor function, there is arrangement information indicating the arrangement of articles in the room R, and the like.

  Then, when the information processing apparatus 100 determines that the user needs to be cleaned, for example, how much the room is not organized (or dirty) to the user via the audio device DV1 In addition to notifying of the cleaning situation such as, it notifies that it is the timing which should just do cleaning now.

  For example, the voice device DV1 detects, as environment information, conversation information which is information related to the conversation of the user (step S11), and transmits the detected conversation information to the information processing apparatus 100 (step S12). Thus, the information processing apparatus 100 can acquire conversation information.

  In addition, for example, the cleaning robot RB1 detects, as environmental information, arrangement information in which objects are arranged on the floor of the living room R (also referred to as information indicating the scattering state of objects) (step S11). Briefly, the cleaning robot RB1 photographs the floor of the living room R. Then, the cleaning robot RB1 transmits the detected arrangement information, that is, the photographed image to the information processing apparatus 100 (step S12). Thus, the information processing apparatus 100 can acquire the arrangement information.

  Next, the information processing apparatus 100 determines whether there is a need for cleaning by estimating the cleaning status of the living room R based on the acquired environment information (step S13) (step S14). In the example of FIG. 2, the information processing apparatus 100 acquires conversation information indicating that the user U12 who is the mother is paying attention to the user U11 of the son as "so mess up and clean up". This is because the user U12 recognizes that the living room R is not cleaned. Therefore, the information processing apparatus 100 estimates that the living room R is scattered as the cleaning situation of the living room R. Further, in the example of FIG. 2, the information processing apparatus 100 estimates that the timbre of the room R is “bad” by analyzing the acquired captured image.

  The information processing apparatus 100 determines that the user U11 needs to be cleaned, for example, based on such an estimation result. If it is determined that the user U11 needs to clean the living room R, the information processing apparatus 100 performs notification control to notify the user of information related to cleaning to the voice device DV1 (step S15).

  In response to the notification control, the audio device DV1 outputs the information regarding the cleaning as an audio. As an example, the audio device DV1 outputs an audio such as "K (the name of the user U11), the room is dirty. Please clean it." Thereby, the user U11 is pointed out not only by the user U12 who is the mother but also by the third party (the audio device DV1), so it becomes easy to realize that it is necessary to clean the living room R. In other words, the information processing apparatus 100 can effectively recognize that the timing for cleaning the user U11 is now.

[2. Configuration of information processing system]
Next, the configuration of the information processing system according to the first embodiment will be described with reference to FIG. FIG. 3 is a diagram showing a configuration example of the information processing system 1 according to the first embodiment. As shown in FIG. 3, the information processing system 1 includes a terminal device 10, an IoT (Internet of Things) device 20, an audio device 30, and a mobile robot 40. The terminal device 10, the IoT device 20, the voice device 30, and the mobile robot 40 are communicably connected by wire or wireless via the network N. Note that a plurality of information processing apparatuses 100 may be included in the information processing system 1 illustrated in FIG. 3.

  The IoT device 20 is, for example, various household appliances such as a refrigerator and a washing machine, and is, for example, various toys for children. The audio device 30 is, for example, the audio device DV1 described in FIG. The mobile robot 40 is, for example, the cleaning robot RB1 described in FIG. The voice device 30 and the mobile robot 40 are devices installed in a room, and include various sensors. The information processing apparatus 100 is a server apparatus that performs the information processing described in FIG. Note that the information processing apparatus 100 illustrated in FIG. 3 can be replaced with information processing apparatuses 200, 300, and 400 described later.

[3. Configuration of information processing apparatus]
Next, the information processing apparatus 100 according to the first embodiment will be described with reference to FIG. FIG. 4 is a view showing a configuration example of the information processing apparatus 100 according to the first embodiment. As shown in FIG. 4, the information processing apparatus 100 includes a communication unit 110, a storage unit 120, and a control unit 130.

(About communication unit 110)
The communication unit 110 is realized by, for example, a network interface card (NIC). The communication unit 110 is connected to the network N in a wired or wireless manner, and transmits and receives information to and from, for example, the terminal device 10, the IoT device 20, the voice device 30, and the mobile robot 40.

(About storage unit 120)
The storage unit 120 is realized by, for example, a semiconductor memory device such as a random access memory (RAM), a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 120 includes a user information storage unit 121 and an environment information storage unit 122.

(About the user information storage unit 121)
The user information storage unit 121 stores various information on the user. Here, FIG. 5 shows an example of the user information storage unit 121 according to the first embodiment. In the example of FIG. 5, the user information storage unit 121 has items such as “family ID”, “user ID”, “device ID”, “address”, “age”, and “sex”.

  “Family ID” is identification information that identifies a family configured by each user indicated by the corresponding “user ID”. The “user ID” is identification information that identifies a user belonging to the family indicated by the corresponding “family ID”. The “device ID” is identification information for identifying a device such as the voice device 30 or the mobile robot 30. “Address”, “age”, and “sex” indicate the residence, age, and gender of the corresponding user.

  That is, in the example of FIG. 5, the user identified by the user ID “U11”, “U12”, “U13”, “U14” belongs to the family identified by the family ID “FM1”, and In this family home, there is shown an example in which the device indicated by the device ID “DV1” and the device indicated by the device ID “RB1” are placed. Further, in the example of FIG. 5, for example, an example is shown in which the address “ADD1” of the user identified by the user ID “U11”, the age “9 years old”, and the sex “male”.

(About environmental information storage unit 122)
The environment information storage unit 122 stores environment information acquired by the information processing device SV (here, the information processing device 100). For example, the environment information storage unit 122 stores environment information in which the information processing apparatus SV is detected by various devices. Here, FIG. 6 shows an example of the environment information storage unit 122 according to the first embodiment. In the example of FIG. 6, the environment information storage unit 122 has items such as “family ID”, “device ID”, and “environment information”.

  The “family ID” corresponds to the “family ID” stored in the user information storage unit 121. The “device ID” corresponds to the “device ID” stored in the user information storage unit 121. “Environmental information” indicates environmental information detected by the device indicated by the corresponding “device ID”. In the example of FIG. 6, for example, a conceptual symbol such as "DA1-11" is used as "environmental information", but actually, a photographed image, the amount of dust, a numerical value indicating the arrangement position where objects are arranged, etc. Is stored.

  That is, in the example of FIG. 6, the device indicated by the device ID “DV1” (voice device DV1) and the device indicated by the device ID “RB1” (cleaning robot) in the family house identified by the family ID “FM1” Environment information “DA1-11” detected by the audio device DV1 and environment information “DA1-21”, “DA1-22” and “DA1-23” detected by the cleaning robot RB1 are placed. The acquired example is shown.

(About the control unit 130)
Returning to FIG. 4, the control unit 130 executes various programs stored in a storage device inside the information processing apparatus 100 using a RAM as a work area by a central processing unit (CPU), a micro processing unit (MPU), or the like. Is realized by Further, the control unit 130 is realized by, for example, an integrated circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).

  As shown in FIG. 4, the control unit 130 includes a first acquisition unit 131, an estimation unit 132, a determination unit 133, and a notification unit 134, and implements the functions and operations of the information processing described below or Run. Note that the internal configuration of the control unit 130 is not limited to the configuration illustrated in FIG. 4, and may be another configuration as long as it performs the information processing described later. Further, the connection relationship of each processing unit included in the control unit 130 is not limited to the connection relationship illustrated in FIG. 4, and may be another connection relationship.

(About the first acquisition unit 131)
The first acquisition unit 131 acquires environment information indicating the user's peripheral environment. For example, the first acquisition unit 131 acquires environment information detected by a predetermined sensor function as environment information indicating the user's peripheral environment. In addition, the first acquisition unit 131 acquires environment information detected by a sensor function of a predetermined audio device as environment information indicating a user's peripheral environment. In addition, the first acquisition unit 131 acquires arrangement information indicating an arrangement state of articles in a room as environment information detected by a predetermined sensor function.

  In addition, the first acquisition unit 131 acquires, as environment information indicating a user's peripheral environment, conversation information which is information related to the user's conversation. In addition, the first acquisition unit 131 acquires behavior information indicating an action of the user as environment information indicating an environment around the user.

(About the estimation unit 132)
The estimation unit 132 estimates the cleaning status of the user based on the environment information acquired by the first acquisition unit 131. For example, the estimation unit 132 estimates the tidying state of the user in the room as the cleaning state of the user in the room. Also, for example, the estimation unit 132 estimates the cleaning status based on the index value calculated based on the environment information, which is the index value indicating the degree to which the user's room is cleaned.

(Regarding the determination unit 133)
The determination unit 133 determines the necessity of cleaning for the user based on the environment information acquired by the first acquisition unit 131. The determination unit 133 determines the necessity of cleaning for the user based on the estimation result by the estimation unit 132.

  The determination unit 133 determines the necessity of cleaning for the user based on the emotion information detected from the conversation information and indicating the emotion of the user. For example, when the emotion information indicates a negative emotion, the determination unit 133 determines that the user needs cleaning. Further, the determination unit 133 determines the necessity of cleaning for the user based on the keyword included in the conversation information. For example, when the conversation information includes a predetermined keyword, the determination unit 133 determines that the user needs to be cleaned.

  Further, the determination unit 133 determines the necessity of cleaning for the user based on the content of the conversation indicated by the conversation information. For example, based on the contents of the conversation, the determination unit 133 determines that the user needs to be cleaned when a habit of the conversation is detected for the user.

(About the notification unit 134)
The notification unit 134 notifies the user of information related to cleaning based on the determination result of the determination unit 133. For example, when the determining unit 133 determines that there is a need for cleaning, the notifying unit 134 notifies, as information related to cleaning, proposal information that proposes to be cleaned. Further, when the determination unit 133 determines that there is a need for cleaning, the notification unit 134 notifies information on the user's cleaning status as the information on cleaning. In addition, the notification unit 134 notifies proposal information that proposes a cleaning method according to the cleaning situation as the information on the cleaning situation.

[4. Example of action in information processing]
The contents of the processing executed and realized by each of the processing units 131 to 134 will be described below using the flowchart shown in FIG. FIG. 7 is a flowchart illustrating an example of the information processing according to the first embodiment. Also, the example of FIG. 1 will be used as appropriate.

  First, the first acquisition unit 131 determines whether or not conversation information has been acquired (step S101). For example, while not being transmitted from the conversation information by the voice device DV1, the first acquisition unit 131 determines that the conversation information is not acquired (step S101; No), and waits until acquisition.

  On the other hand, when the first acquisition unit 131 acquires the conversation information from the speech device DV1 by the speech device DV1 detecting the speech information (step S101; Yes), the estimation unit 132 determines that the room is based on the conversation information. The cleaning situation of R is estimated (step S102). In addition, the estimation part 132 may estimate the tidying-up condition of the living room R as a cleaning condition.

  For example, when emotion information indicating a user's emotion is detected from the conversation information by analyzing the conversation information, the estimation unit 132 estimates the cleaning situation based on the emotion information. For example, when the estimation unit 132 detects emotion information indicating a negative emotion as emotion information, the estimation unit 132 estimates that the cleaning status is “bad”. Here, the negative emotion is, for example, an angry emotion such as “frustration”. When a person is placed in a dirty environment, it tends to be unstable and angry easily. From such a thing, the estimation part 132 judges that the negative emotion was able to be detected as a negative emotion resulting from the room R being not cleaned (dirty), and as a result, cleaning It is estimated that the situation is "evil".

  The estimation unit 132 can also estimate the cleaning situation based on the keyword included in the conversation information. This point will be described using the example of FIG. In the example of FIG. 2, the first acquisition unit 131 acquires conversation information indicating that the user U12 who is the mother is paying attention to the user U11 of the son as "so mess up and clean up". Here, keywords such as "Scatter" and "Keep up" can be said to indicate that the room R can not be cleaned (dirty). When such a keyword is included in the conversation information, the estimation unit 132 estimates that the cleaning status is "bad".

  The estimation unit 132 can also estimate the cleaning status based on the content of the conversation indicated by the conversation information. For example, the estimation unit 132 estimates that the cleaning status is “bad” when the habit of conversation is detected for the user by analyzing the conversation information. For example, it is assumed that the user U11 repulses that "it is not such a thing" in response to the user U12 saying "not dirty" to U11. That is, it can be said that a habit has occurred between the conversation content of the user U11 and the conversation content of the user U12. Also, the user U11 has a lower position than the user U12. Therefore, in such a case, the estimation unit 132 detects a habit of conversation for the user U11, and further estimates that the cleaning situation is "bad".

  Next, the determination unit 133 determines the necessity of cleaning for the user (step S103). For example, when the estimation unit 132 estimates that the cleaning state is “good”, the determination unit 133 determines that the user U1 does not need to be cleaned (step S103; No), and ends the process. On the other hand, when the estimation unit 132 estimates that the cleaning situation is "bad" as in the above example, the determination unit 133 determines that the user U1 needs to be cleaned (step S103; Yes).

  Further, when the determining unit 133 determines that cleaning is necessary (Step S103; Yes), the notifying unit 134 notifies the user U11 of information related to cleaning (Step S104). For example, the notification unit 134 controls the audio device DV1 to notify the user U11 of information related to cleaning. In response to the notification control, the audio device DV1 outputs the information regarding the cleaning as an audio. As an example, the audio device DV1 outputs an audio such as "K (the name of the user U1), the room is dirty. Please clean it."

  Here, first, an example in which the estimation unit 132 estimates the cleaning situation based on the environmental information acquired by the first acquisition unit 131, and the determination unit 133 determines the necessity of cleaning based on the estimation result estimated. showed that. However, the determination unit 133 may perform the determination process including the process of the estimation unit 132. Specifically, the determination unit 133 may determine the necessity of cleaning directly from the environmental information acquired by the first acquisition unit 131.

[5. Modified example]
The information processing apparatus 100 according to the first embodiment may be implemented in various different forms other than the first embodiment. Therefore, another embodiment of the information processing apparatus 100 will be described below.

[5-1. Judgment based on environmental information detected by sensor]
For example, the first acquisition unit 131 may acquire, as a predetermined sensor, environment information detected by echo location. In addition, the first acquisition unit 131 has, as a predetermined sensor function, an environment included in a photographed image photographed by a camera installed in a state capable of photographing only an entity existing within a predetermined height range from the floor surface. Information may be acquired. Such environmental information can be said to be, for example, information indicating a scattering state of an object. Further, in the example of FIG. 2, for example, the sensor for echo location or the camera may be installed in the audio device DV1, or may be installed in the cleaning robot RB1. . Further, such environmental information may include, for example, numerical information such as what kind of object is present at what position in the room.

  Then, the estimation unit 132 can more accurately estimate the tidying state of the room as the cleaning state, based on the environmental information detected by the sensors. For example, it is assumed that the environmental information detected by echo location is acquired by the first acquisition unit 131. In such a case, the estimation unit 132 calculates an index value indicating the extent to which the room of the user is cleaned (sorted) based on the environmental information. In other words, the estimation unit 132 calculates an index value indicating how dirty the user's room is (not how well organized).

  For example, based on the environmental information detected by echo location, the estimation unit 132 indicates that the room R is dirty (not organized) as more people are placed on the floor of the room R. Calculate high index value. Further, for example, the more the estimation unit 132 is placed on the floor surface of the living room R based on the environmental information (captured image) detected by the camera, the dirtying of the living room R (not organized) Calculate a high index value to indicate that.

  Further, for example, when the index value calculated by the estimation unit 132 exceeds the predetermined value, the determination unit 133 determines that the user U1 needs to be cleaned.

  As a result, the information processing apparatus 100 according to the first embodiment can determine with high accuracy whether or not the user needs to be cleaned. Can be effectively cleaned by the user.

5-2. Judgment based on relative index value]
Further, the estimation unit 132 estimates the cleaning situation based on the relative index value calculated by comparing the environment information of the user with the environment information of another user different from the user as the index value. May be For example, when it is desired to calculate the index value for the user U11, the first acquisition unit 131 also acquires from the environment information storage unit 122 environment information other than the user U11 (for example, environment information detected by echo location).

  For example, the first acquisition unit 131 acquires environment information of the user U11 and environment information of the same age as the user U11. Further, the estimation unit 132 calculates an index value for each of the user U11 and the other users, and compares the calculated index values to calculate a relative index value of the user U11 in comparison with the other users. In addition, when the relative index value calculated by the estimation unit 132 exceeds the predetermined value, the determination unit 133 determines that the user U11 needs to be cleaned.

  In addition, the first acquisition unit 131 may acquire behavior information indicating a user's behavior as environment information indicating a user's peripheral environment. Then, when the action information includes action information indicating a predetermined action pattern or sound information indicating a predetermined action, the determination unit 133 determines that the user needs to be cleaned. Such action information is image information (or moving image information) detected by various sensors, and is image information (or moving image information) including the movement of the user (for example, the movement of walking on the floor). Further, such action information may be voice information detected by various sensors, and may be voice information including a motion of the user (for example, a voice walking on the floor).

  If an example is shown, for example, the estimation unit 132 analyzes the behavior information acquired by the first acquisition unit 131 to generate behavior information indicating a prescribed behavior pattern from the behavior information or sound information indicating a prescribed behavior. If it is detected, it is estimated that the cleaning situation is "bad". The predetermined behavior pattern is, for example, a constant pattern found when searching for a thing, and is a behavior pattern in which the same part is crawled many times. Further, sound information indicating a predetermined action is sound information indicating an action pattern in which the same part is crawled many times or an object sound when the object is collided.

  It is predicted that the user is searching for a thing because it is dirty (not organized) from the action of crawling the same part many times. If the noise of hitting an object seems to occur frequently, it is predicted that the room is interspersed with articles. From such a thing, when the estimation part 132 detects the action pattern which crawls the same location many times by analyzing action information, it estimates that it is the cleaning condition "bad". Further, the estimation unit 132 estimates that the cleaning situation is “bad” when the object sound when the object sound is in excess of the predetermined number of times. Further, the determination unit 133 determines that the user needs cleaning because the estimation unit 132 estimates that the cleaning situation is “bad”.

  As a result, the information processing apparatus 100 according to the first embodiment can determine with high accuracy whether or not the user needs to be cleaned. Can be effectively cleaned by the user.

[5-3. Judging based on elapsed time]
In addition, the determination unit 133 may determine the necessity of cleaning for the user based on an elapsed time since the user performed cleaning in the past. For example, based on the action information acquired by the first acquisition unit 131, the determination unit 133 determines whether the user has performed a cleaning action. For example, after the determination unit 133 determines that the user performed the cleaning action, "one month" has elapsed by the present, and further, the user performs the cleaning action during the "one month". It is assumed that the judgment has not been made. In such a case, the determination unit 133 determines that the user needs cleaning.

  As a result, the information processing apparatus 100 according to the first embodiment can accurately determine the timing at which the user needs cleaning, and thus the user can effectively perform cleaning at such a timing. Can.

[5-4. Information notification]
The notification unit 134 may notify proposal information that proposes a cleaning method according to the cleaning status as the information on the cleaning status. As described above, the information processing apparatus 100 can detect what kind of object is scattered in the room. Therefore, for example, when it is detected that dust is accumulated on the floor, the notification unit 134 proposes a soaking method. In addition, for example, when it is detected that oil adheres to the floor, the notification unit 134 proposes what detergent should be used. Also, for example, when it is detected that clothes are scattered on the floor, the notification unit 134 proposes a method of folding clothes and a storage method.

  As a result, the information processing apparatus 100 according to the first embodiment can propose a specific method of cleaning, so for example, for raising the user's willingness to clean the user who does not know what to start with. Motivating can be done effectively.

[6. effect〕
The information processing apparatus 100 according to the first embodiment includes a first acquisition unit 131, a determination unit 133, and a notification unit 134. The first acquisition unit 131 acquires environment information indicating the user's peripheral environment. The determination unit 133 determines the necessity of cleaning for the user based on the environment information acquired by the first acquisition unit 131. The notification unit 134 notifies the user of information related to cleaning based on the determination result of the determination unit 133.

  Thus, the information processing apparatus 100 according to the first embodiment can effectively make the user clean.

Second Embodiment
[1. Example of information processing]
Next, an example of the information processing according to the second embodiment will be described with reference to FIG. FIG. 8 is a diagram illustrating an example of the information processing according to the second embodiment. Information processing according to the second embodiment is performed by the information processing apparatus 200. The information processing device 200 is an example of the information processing device SV described in FIG. The information processing according to the second embodiment can also be understood as one of the variations of the information processing performed by the information processing apparatus 100 according to the first embodiment.

  Also, FIG. 8 explains FIG. 1 (b) in more detail. In the example of FIG. 1B, the cleaning robot RB1 (an example of a movable work robot) is placed in the living room R. The cleaning robot RB1 includes various sensors, and detects environmental information using the sensors while moving around in the living room R. Examples of various sensors include a camera, a dust sensor, an echo location (ultrasonic position sensor) and the like. In addition, the cleaning robot RB1 enables transmission and reception of information with the information processing apparatus 200 via the Internet. In addition, in the room R, a voice device DV1 is also placed. Although not shown, in the living room R, users U11 and U12 are also present.

  In such a state, the information processing apparatus 200 acquires environment information indicating environment around the user and detected by the movable work robot, and based on the acquired environment information, the information processing apparatus 200 can Estimate the cleaning situation to estimate. For example, the information processing apparatus 200 acquires environment information detected by a predetermined sensor function of the work robot. The information processing apparatus 100 according to the first embodiment determines the necessity of cleaning for the user using the environment information. That is, the environmental information acquired by the information processing apparatus 200 can be one material used for the determination process by the information processing apparatus 100.

  For example, the cleaning robot RB1 detects arrangement information in which objects are arranged on the floor of the living room R as environmental information (step S21). As an example, the cleaning robot RB1 takes a picture of the floor of the living room R. Then, the cleaning robot RB1 transmits the detected environment information, that is, the photographed image to the information processing apparatus 200 (step S22). Thus, the information processing device 200 can acquire environmental information.

  Then, the information processing device 200 estimates the tidying situation as the cleaning situation of the living room R based on the acquired placement information (step S23). For example, the information processing apparatus 200 estimates the tidying status of the living room R by analyzing the captured image. For example, when the information processing apparatus 200 estimates that the arrangement status is “bad”, the information processing apparatus 200 determines that the order is necessary (step S24). Then, the information processing apparatus 200 performs notification control so as to notify the user of information regarding cleaning to the voice device DV1 (step S25).

  In response to the notification control, the cleaning robot RB1 outputs voice information on cleaning. As an example, the audio device DV1 outputs an audio such as "The room is not tidy. Please clean up before tidying up." The information processing apparatus 200 may perform notification control so as to notify the user of information regarding cleaning to the cleaning robot RB1. As a result, the information processing apparatus 200 can recognize the tidying state of the room, and for example, when the tidying state of the room is bad, the user can be notified of that. As a result, the information processing apparatus 200 can make the user aware that it is necessary to first arrange the room.

[2. Configuration of information processing apparatus]
Next, an information processing apparatus 200 according to the second embodiment will be described with reference to FIG. FIG. 9 is a view showing an example of the arrangement of an information processing apparatus 200 according to the second embodiment. As shown in FIG. 9, the information processing apparatus 200 includes a communication unit 110, a storage unit 120, and a control unit 230. The description of processing units having the same reference numerals as the information processing apparatus 100 described in FIG. 4 will be omitted or simplified.

(About the control unit 230)
The control unit 230 is realized by executing various programs stored in a storage device in the information processing apparatus 200 by using a RAM as a work area by a CPU, an MPU, or the like. Further, the control unit 230 is realized by, for example, an integrated circuit such as an ASIC or an FPGA.

  As shown in FIG. 9, the control unit 230 includes a first acquisition unit 131, an estimation unit 132, a determination unit 133, a notification unit 134, and a second acquisition unit 235, and the information processing described below Implement or perform a function or action. Note that the internal configuration of the control unit 230 is not limited to the configuration shown in FIG. 9, and may be another configuration as long as it performs the information processing described later. Moreover, the connection relation of each processing unit included in the control unit 230 is not limited to the connection relation illustrated in FIG. 9, and may be another connection relation.

(About the second acquisition unit 235)
The second acquisition unit 235 acquires environment information indicating the environment around the user and detected by the movable work robot. Specifically, the second acquisition unit 235 acquires environment information detected by a predetermined sensor function of the work robot. For example, the second acquisition unit 235 acquires environment information detected by echo location as a predetermined sensor function. Also, for example, as the predetermined sensor function, the second acquisition unit 235 is included in the photographed image photographed by the camera installed in a state where only the entity present in the range of the predetermined height from the floor surface can be photographed. Get environmental information.

  For example, the second acquisition unit 235 acquires, as environmental information, information indicating a scattering state of an object or information on an airborne matter in a room. Information indicating the scattering state of an object can be rephrased as, for example, arrangement information in which an object is placed in a room, and how many objects of the arrangement information are present at which position in the room May contain numerical information such as

  In addition, for example, the second acquisition unit 235 acquires, as environmental information, a comparison result of the movement distance of the work robot in the room and the movement distance at a predetermined time in the past and the movement distance at the current time. Do. In addition, the second acquisition unit 235 may acquire, as the environment information, conversation information which is information related to the conversation of the user and which is input to the work robot. Further, the second acquisition unit 235 may acquire, as a movable work robot, environment information detected by a predetermined cleaning robot. The acquisition process by the second acquisition unit 235 described above may be performed by the first acquisition unit 131 of the information processing apparatus 100.

(About the estimation unit 132)
The estimation unit 132 estimates the cleaning status of the user in the room based on the environment information acquired by the second acquisition unit 235. For example, the estimation unit 132 estimates the tidying state of the user in the room as the cleaning state of the user in the room. For example, the estimation unit 132 estimates the cleaning state based on the index value calculated based on the environment information and indicating the degree to which the user's room is cleaned.

(About the notification unit 134)
The notification unit 134 notifies the user of information related to cleaning based on the estimation result by the estimation unit 132. Specifically, when it is determined that the user needs cleaning based on the estimation result, the notification unit 134 notifies the user of proposal information that is suggested to be cleaned, as the information related to the cleaning. For example, when it is determined that the user needs to be cleaned based on the estimation result, the notification unit 134 notifies proposal information to propose cleaning as information on cleaning. For example, the notification unit 134 notifies the cleaning procedure as information on cleaning. Further, for example, the notification unit 134 notifies information on a predetermined cleaning service as the information on cleaning.

[3. Example of action in information processing]
The contents of processing executed and realized by each of the processing units 132 to 134 and 235 will be described below using the flowchart shown in FIG. FIG. 10 is a flowchart illustrating an example of the information processing according to the second embodiment. Also, the example of FIG. 8 is used as appropriate.

  First, the second acquisition unit 235 determines whether arrangement information has been acquired as environment information (step S201). For example, while the arrangement information is not transmitted by the cleaning robot RB1, for example, the second acquisition unit 235 determines that the arrangement information is not acquired (step S201; No), and waits until acquisition.

  Here, for example, the cleaning robot RB1 transmits the arrangement information detected by performing the echo location in the room R to the information processing apparatus 200, so that the second acquisition unit 235 determines that the arrangement information is acquired. (Step S201; Yes). In the arrangement information, the arrangement information includes numerical information such as what kind of object is present at which position in the living room R and the movement distance of the cleaning robot RB1 within the living room R. I assume.

  In such a state, the second acquisition unit 235 acquires a comparison result obtained by comparing the movement distance at a predetermined time in the past and the movement distance at the present time (step S202). Specifically, the second acquisition unit 235 is a movement distance of the cleaning robot RB1 in the living room R and is a movement distance at a predetermined time in the past and a movement distance of the cleaning robot RB1 in the living room R at the present time A comparison result comparing the movement distance is acquired (calculated). Such comparison results can also be understood as an example of environmental information.

  Since the second acquisition unit 235 stores the arrangement information acquired from the cleaning robot RB1 in the environment information storage unit 122, for example, information (referred to as “past distance information”) indicating a movement distance at a predetermined time in the past Information indicating the moving distance at the current time (referred to as “current distance information”) can be acquired from the environment information storage unit 122. Here, the second acquisition unit 235 acquires the comparison result by comparing the past distance information and the current distance information, and based on the acquired comparison result, the movement distance at the present time is based on the movement distance at the predetermined time in the past. It is determined whether it is short (step S203).

  Here, it is assumed that the second acquisition unit 235 acquires a comparison result such as “moving distance at a predetermined point in the past <moving distance at the current time”. In such a case, the second acquisition unit 235 determines that the moving distance at the present time is not shorter than the moving distance at a predetermined time in the past (it has become longer) (Step S203; No). In such a case, the estimation unit 132 estimates that the tidying status “good” (tidyed up) of the living room R (step S204a), and ends the process.

  On the other hand, it is assumed that the second acquisition unit 235 acquires a comparison result such as “moving distance at a predetermined point in the past> moving distance at the current time”. In such a case, the second acquisition unit 235 determines that the moving distance at the present time is shorter than the moving distance at a predetermined time in the past (step S203; Yes). The cause of the fact that the moving distance at the present time is shorter than the moving distance at a predetermined point in the past is that the space that the cleaning robot RB1 can move becomes smaller due to the increase of objects scattered in the living room R Can be thought of. From such a thing, the estimation part 132 estimates that the tidying-up condition "bad" (it has not been done) of the living room R (step S204 b). The determination process in step S203 may be performed by the estimation unit 132.

  In addition, the notification unit 134 notifies the user U11 of information related to cleaning because it is estimated that the orderly state is "bad" (step S205). For example, the notification unit 134 controls the audio device DV1 to notify the user U11 of information related to cleaning. In response to the notification control, the audio device DV1 outputs the information regarding the cleaning as an audio. As an example, the audio device DV1 outputs an audio such as "The room is not tidy. Please clean up before tidying up."

[4. Modified example]
The information processing apparatus 200 according to the second embodiment may be implemented in various different forms other than the second embodiment. So, below, other embodiment of the information processing apparatus 200 is described.

[4-1. Area comparison]
In the second embodiment described above, the second acquisition unit 235 is the movement distance of the work robot in the room, and is the movement distance of the work robot at a predetermined time in the past and the movement distance of the work robot in the room at the present time An example of acquiring a comparison result comparing the movement distance of However, the second acquisition unit 235 is a movement distance of the work robot in the room and a movement area based on the movement distance at a predetermined time in the past, and a movement distance of the work robot in the room at the present time The comparison result comparing with the movement area based on the distance is acquired. The second acquisition unit 235 can perform such processing in steps S202 and S203 illustrated in FIG. 10, for example.

  As an example, the second acquisition unit 235 is a movement distance of the cleaning robot RB1 in the living room R and is a movement area based on the movement distance at a predetermined time in the past and a movement distance of the cleaning robot RB1 in the living room R A comparison result comparing the movement area based on the movement distance at the present time is acquired (calculated).

  The second acquisition unit 235 includes information indicating the movement area based on the movement distance at a predetermined time in the past (referred to as “past area information”) and information indicating the movement area based on the movement distance at the current time (“current area Information) can be acquired from the environment information storage unit 122. Here, the second acquisition unit 235 acquires the comparison result by comparing the past area information and the current area information, and based on the acquired comparison result, the movement area based on the movement distance at the current time is a predetermined time in the past. It is determined whether it is smaller than the movement area based on the movement distance of.

  Here, it is assumed that the second acquisition unit 235 acquires a comparison result such as “moving area based on moving distance at a predetermined time in the past <moving area based on moving distance at present”. In such a case, the second acquisition unit 235 determines that the moving surface unit based on the moving distance at the current time is not smaller than the moving area based on the moving distance at a predetermined time in the past (it has become larger). Thus, the estimation unit 132 estimates that the timbre of the living room R is “good” (tidy up).

  On the other hand, it is assumed that the second acquisition unit 235 acquires a comparison result such as “moving area based on moving distance at a predetermined point in the past> moving area based on moving distance at present”. In such a case, the second acquisition unit 235 determines that the moving area based on the moving distance at the current point has become smaller than the moving area based on the moving distance at a predetermined point in the past. Thus, the estimation unit 132 estimates that the timbre of the room R is "bad" (not tidy).

  Thus, the information processing apparatus 200 according to the second embodiment can estimate the tidying-up state of the room with high accuracy. For example, the user is asked to clean the room after tidying up and tidying first. On the other hand, efficient cleaning can be realized.

[4-2. Room arrangement comparison]
In addition, the second acquisition unit 235 may acquire, as the environmental information, a comparison result of comparing the room layout at a predetermined time in the past with the room layout at the current time. Here, for convenience of explanation, the movable work robot is assumed to be a robot (for example, a drone) capable of flying in the air. In such a case, the drone transmits the floor plan of the room to the information processing apparatus 200 by, for example, periodically photographing the room including the room R from above. Thus, the second acquisition unit 235 can acquire a floor plan as the environment information.

  In such a state, the second acquisition unit 235 acquires the comparison result of comparing the floor plan at a predetermined time in the past with the floor plan at the present time, and, for example, the room R is It is determined whether there is contamination from a predetermined time in the past, or whether the tidying condition of the living room R is deteriorated as compared with the predetermined time in the past. For example, the second acquisition unit 235 calculates the area of the vacant space at a predetermined time in the past in the living room R and the area of the vacant space at the present time, and compares them. Then, when it is determined by the second acquiring unit 235 that the area of the empty space at the present time is smaller than the area of the empty space at a predetermined time in the past, the estimating unit 132 arranges the room R Estimated as "bad" (not organized).

  Thus, the information processing apparatus 200 according to the second embodiment can estimate the tidying-up state of the room with high accuracy. For example, the user is asked to clean the room after tidying up and tidying first. On the other hand, efficient cleaning can be realized.

[4-3. Number of collisions]
Further, the second acquisition unit 235 may acquire, as the environmental information, the number of collisions in which the movable work robot is in the room and collides. For example, the second acquisition unit 235 acquires the number of collisions with the object while the cleaning robot RB1 moves in the living room R for a predetermined time. Then, the second acquisition unit 235 determines whether the number of collisions is equal to or more than a predetermined number. For example, it is considered that the number of collisions increases as the living room R is not organized and the more things are scattered. Therefore, when the second acquisition unit 235 determines that the number of collisions is equal to or more than the predetermined number, the estimation unit 132 estimates that the arrangement condition “bad” (not arranged) of the living room R.

  As a result, the information processing apparatus 200 according to the second embodiment can estimate the room tidying state with high accuracy.

[4-4. Estimation based on the number of movements]
In addition, the second acquisition unit 235 may acquire, as the environmental information, the number of times the collided object has moved due to the collision among the number of collisions in which the movable work robot is placed in the room and collides. For example, the second acquisition unit 235 acquires the number of times of movement of the collision object due to the collision among the number of times of collision of the cleaning robot RB1 with the object while moving the living room R for a predetermined time. When the cleaning robot RB1 collides with the same object a plurality of times and the object further moves, the second acquisition unit 235 may exclude the number of times of overlapping movement.

  Then, the second acquisition unit 235 determines whether the number of movements is equal to or more than a predetermined number. For example, as the living room R is not organized and the more things are scattered, it is considered that the number of movements increases. For example, even if the cleaning robot RB1 collides with a large piece of furniture such as a closet, the furniture does not move. On the other hand, when the cleaning robot RB1 collides with trash or a toy, for example, which is the cause of the unorganized organization, these move due to the force of the collision. That is, it suggests that the living room R can not be organized as the number of times of movement increases. Therefore, when it is determined by the second acquisition unit 235 that the number of movements is equal to or more than the predetermined number, the estimation unit 132 estimates that the arrangement status “bad” (not organized) of the living room R.

  As a result, the information processing apparatus 200 according to the second embodiment can estimate the room tidying state with high accuracy.

[5. effect〕
An information processing apparatus 200 according to the second embodiment includes a second acquisition unit 235 and an estimation unit 132. The second acquisition unit 235 acquires environment information indicating the environment around the user and detected by the movable work robot. The estimation unit 132 estimates the cleaning status of the user in the room based on the environment information acquired by the second acquisition unit 235.

  As a result, the information processing apparatus 200 according to the second embodiment can recognize the tidying state of the room, and can thus allow the user to perform an efficient cleaning action.

Third Embodiment
[1. Example of information processing]
Next, an example of the information processing according to the third embodiment will be described with reference to FIG. FIG. 11 is a diagram illustrating an example of the information processing according to the third embodiment. The information processing according to the third embodiment is performed by the information processing apparatus 300. The information processing device 300 is an example of the information processing device SV described with reference to FIG.

  Further, FIG. 11 explains FIG. 1 (c) in more detail. In the example of FIG. 11, in the living room R, the audio device DV1 is placed. In addition, in the room R, a lighting device R1 is installed. Although not shown, it is assumed that users U11 and U12 are also present.

  In such a state, the information processing apparatus 300 acquires the determination result in which it is determined whether the user needs cleaning or not, and the acquired determination result indicates that the user needs cleaning. In the case of indicating, the output control is performed to output information related to cleaning at a predetermined position in the room. For example, the information processing apparatus 300 performs output control to output information related to cleaning around the cleaning required position or around the cleaning required position when the determination result indicates the cleaning required position where there is a need for cleaning. The process of determining whether or not the user needs cleaning is performed by the determination unit 133 of the information processing apparatus 100 according to the first embodiment.

  The information processing apparatus 300 acquires the determination result as to whether or not cleaning is necessary (step S31). In the example of FIG. 1A, the information processing device SV determines in step S13 that cleaning is necessary. Therefore, in the case of such an example, the information processing apparatus 300 acquires that “cleaning is necessary” as the determination result.

  Here, as described above, the information processing apparatus 100 estimates the cleaning situation of the user based on the acquired environment information, and determines the necessity of cleaning based on the estimation result. Therefore, the determination result includes, for example, numerical information such as what kind of object is present at what position in the room and how much. Further, the determination result is stored in a predetermined storage unit of the information processing device 300.

  In addition, as described in the first embodiment, the information processing apparatus 100 calculates an index value indicating the degree to which the user's room is cleaned based on the environment information, and cleaning based on the index value. The situation may be inferred. Therefore, the determination result may also include an index value indicating the degree to which the room is cleaned.

  In the example shown in FIG. 11, for example, the cleaning required area "AR1", the degree of cleaning "index value 8", the thing to be cleaned up (the things scattered in the room R) "4 cardboard boxes, 3 bags of waste bags" It is assumed that information is obtained as a determination result. In such a case, the information processing apparatus 300 performs output control on the illumination device L1 so as to output information related to cleaning to the area AR1, which is the cleaning position requiring cleaning (step S32).

  In response to the output control, the lighting device L1 outputs information regarding cleaning to the cleaning required position AR1. If an example is shown, the lighting device L1 will project the shadow of a harmful substance (for example, a pest) as information regarding cleaning (step S33). As a result, since the information processing apparatus 300 can virtually experience the actual harm that any pest will occur unless it is cleaned, the motivation for cleaning can be effectively performed.

[2. Configuration of information processing apparatus]
Next, an information processing apparatus 300 according to the third embodiment will be described with reference to FIG. FIG. 12 is a view showing an example of the arrangement of an information processing apparatus 300 according to the third embodiment. As illustrated in FIG. 12, the information processing apparatus 300 includes a communication unit 110, a storage unit 120, and a control unit 330. The description of processing units having the same reference numerals as the information processing apparatus 100 described in FIG. 4 will be omitted or simplified.

(About the controller 330)
The control unit 330 is realized by executing various programs stored in a storage device in the information processing apparatus 300 by using a RAM as a work area by a CPU, an MPU, or the like. Further, the control unit 230 is realized by, for example, an integrated circuit such as an ASIC or an FPGA.

  As illustrated in FIG. 12, the control unit 130 includes a first acquisition unit 131, an estimation unit 132, a determination unit 133, a notification unit 134, a determination result acquisition unit 335, and an output control unit 336. Implement or execute the functions and actions of the information processing described below. Note that the internal configuration of the control unit 330 is not limited to the configuration shown in FIG. 12, and may be another configuration as long as it performs the information processing described later. Further, the connection relationship of each processing unit included in the control unit 330 is not limited to the connection relationship illustrated in FIG. 12, and may be another connection relationship.

(About the determination result acquisition unit 335)
The determination result acquisition unit 335 acquires the determination result on whether or not the user needs to be cleaned. The determination result acquired by the determination result acquisition unit 335 includes, for example, numerical information such as how much an object is present at which position in the room. The determination result also includes, for example, an index value indicating the degree to which the room is cleaned.

(About the output control unit 336)
The output control unit 336 performs output control to output information regarding cleaning at a predetermined position in the room when the determination result acquired by the determination result acquisition unit 335 indicates that the user needs cleaning. Specifically, the output control unit 336 outputs information about the cleaning at or around the cleaning required position where there is a need for cleaning in the room. For example, the output control unit 336 causes the cleaning-required position or the area around the cleaning-required position to output information about the cleaning-required, when the determination result includes position information indicating the cleaning-required position that needs cleaning in the room.

  The output control unit 336 outputs, as information on cleaning, information corresponding to the cleaning required position or the periphery of the cleaning required position. For example, the output control unit 336 causes the information on cleaning to be output in a mode according to the degree of the cleaning condition. More specifically, the output control unit 336 causes the information on cleaning to be output in a mode according to the index value indicating the degree of the cleaning condition. Also, for example, the output control unit 336 controls the output frequency at which information on cleaning is output or the number of outputs at which information on cleaning is output, in accordance with the degree of cleaning condition. Further, when it is determined that the user needs to be cleaned because the items are scattered in the house, the output control unit 336 causes the information related to the item to be output as the information related to the cleaning.

  Further, the output control unit 336 outputs, as the information related to the cleaning, information indicating that the cleaning of the house is necessary. For example, the output control unit 336 causes harmful substance information indicating the shape of a predetermined harmful substance to be projected as the information indicating that home cleaning is necessary. For example, the output control unit 336 outputs, as information indicating that home cleaning is necessary, audio information in which a predetermined harmful substance operates. For example, the output control unit 336 causes the odor of a predetermined harmful substance to be output as information indicating that the cleaning of the house is necessary.

[3. Example of action in information processing]
The contents of the processing executed and realized by each of the processing units 335 and 336 will be described below using the flowchart shown in FIG. FIG. 13 is a flowchart illustrating an example of the information processing according to the third embodiment. Also, the example of FIG. 11 is used as appropriate.

  First, the determination result acquisition unit 335 determines whether or not the determination result determined as to whether or not cleaning is necessary has been acquired (step S301). For example, while the determination result acquisition unit 335 does not receive the determination result determined whether the cleaning is necessary or not from the determination unit 133, the determination result acquisition unit 335 determines that the determination result is not acquired (step S301; No). Wait until you do.

  On the other hand, when the output control unit 336 determines that the determination result determined by the determination result acquisition unit 335 whether or not cleaning is necessary is obtained (step S301; Yes), based on the determination result, Output control is performed to output information on cleaning at a predetermined position in the room (step S302). For example, it is assumed that the determination result acquired by the determination result acquisition unit 335 indicates that the user U11 needs to be cleaned.

  In addition, the judgment result acquired by the judgment result acquisition unit 335 includes the cleaning area “AR1”, the degree of cleaning “index value 8”, the thing to be cleaned up (the thing scattered in the room R) “cardboard box 4 It is assumed that information such as a box and 3 bags of waste bags is obtained as the determination result. The degree of being cleaned can be reworded as the degree of contamination, and the larger the index value, the worse the contamination, or the less orderly.

  In such a case, the output control unit 336 performs output control to output information related to cleaning at a predetermined position in the room. For example, the output control unit 336 performs output control on the lighting device L1 so as to output information on cleaning to the area AR1 which is a cleaning required position where cleaning is required. In the example of FIG. 11, the cardboard box and the waste bag are stacked in the area AR1. Such places (gaps) are good places for certain pests to hide. Therefore, the output control unit 336 causes the lighting device L1 to project the shadow of the shape of the pest. The pest may be, for example, any pest that can occur in the living space of a general household, such as cockroaches and bugs. Note that, when the area AR1 is around the kitchen, the output control unit 336 may project the shadow of a rat that easily collects on the leftovers and the like.

  In addition, since the degree of cleaning (the degree of contamination, the degree of unorganizedness) in the cleaning required area “AR1” is “index value 8”, the output control unit 336 has the number corresponding to the “index value 8”. You may project pests. For example, the output control unit 336 may project “8 animals” pests in correspondence with “index value 8”. The output control unit 336 may also control the frequency of projecting the pest. The output control unit 336 causes the pest to be projected "every 1 minute" in the case of "index value 8", and causes the pest to be projected "every 2 minutes" in the case of "index value 7". In addition, the output control unit 336 may simultaneously output the operation sound (for example, feather noise or movement sound) of the pest.

  In addition, since cardboard boxes and garbage bags are stacked in the area AR1, it is conceivable that the area AR1 is not sunny. Areas that are not sunny are humid and prone to mold. Therefore, the output control unit 336 may generate a musty odor near the area AR1.

[4. Modified example]
The information processing apparatus 300 according to the third embodiment may be implemented in various different forms other than the third embodiment. So, below, other embodiment of the information processing apparatus 300 is described.

[4-1. NG condition (1)]
In the second embodiment described above, the output control unit 336 outputs the information regarding the cleaning. However, the output control unit 336 performs output control so as not to output information regarding cleaning under a predetermined condition. For example, the output control unit 336 controls not to output information related to cleaning while cleaning is being performed.

  For example, even if the user U11 performs thorough cleaning, if a pest is projected at this time, there is a possibility that the user U11 loses the willingness to clean due to a surprise or a shock. In order to prevent such a situation, the output control unit 336 does not output cleaning information while cleaning is being performed.

[4-2. NG condition (2)]
Further, the output control unit 336 controls so as not to output information on the cleaning when the cleaning-required position requiring the cleaning is included in the predetermined area in the room. For example, when the cleaning position is on a stairway, if a pest is projected near the stairway while the user is using the stairway, the user may step out of the foot due to surprise, which is dangerous. . Therefore, the output control unit 336 does not output the information regarding the cleaning when the cleaning required position is included in the predetermined area in the room.

[5. effect〕
The information processing apparatus 300 according to the third embodiment includes a determination result acquisition unit 335 and an output control unit 336. The determination result acquisition unit 335 acquires the determination result on whether or not the user needs to be cleaned. The output control unit 336 performs output control to output information regarding cleaning at a predetermined position in the room when the determination result acquired by the determination result acquisition unit 335 indicates that the user needs cleaning.

  Thereby, the information processing apparatus 300 according to the third embodiment can effectively perform motivation for cleaning the user.

Fourth Embodiment
[1. Example of information processing]
Next, an example of the information processing according to the fourth embodiment will be described using FIG. FIG. 14 is a diagram illustrating an example of the information processing according to the fourth embodiment. The information processing according to the fourth embodiment is performed by the information processing apparatus 400. The information processing device 400 is an example of the information processing device SV described in FIG.

  FIG. 14 explains FIG. 1 (d) in more detail. In the example of FIG. 14, a voice device DV1 is placed in the living room R. In the room R, there are users U11 and U12.

  For example, the voice device DV1 detects, as environment information, conversation information which is information related to the user's conversation (step S41), and transmits the detected conversation information to the information processing apparatus 400 (step S42). Thus, the information processing apparatus 400 can acquire environmental information.

  Next, the information processing apparatus 400 determines whether the user has performed a cleaning action (step S43). For example, the information processing apparatus 400 determines whether the user performed the cleaning action based on the acquired conversation information.

  In one example, the information processing apparatus 400 determines whether or not a cleaning action has been performed such as returning the predetermined object to a fixed position (the original place). Further, when it is determined that the information processing apparatus 400 has performed the cleaning action, the information processing apparatus 400 also identifies who is the person performing the cleaning action. Further, assuming that the information processing apparatus 400 specifies that the user U11 is the one who performed the cleaning action, for example, the user U11 voluntarily performed the cleaning action or someone is instructed to perform the cleaning action To determine if it has been done. In addition, when it is determined that the cleaning action has been performed, the information processing apparatus 400 identifies the time taken for the cleaning action.

  In the example of FIG. 14, the information processing apparatus 400 acquires conversation information indicating that the user U2 who is the mother has called for “cleanly done properly” to the user U11 who is vacuuming. It will be done. Because of this, the information processing apparatus 400 determines that the user U11 has performed the cleaning action, and gives the user U11 a predetermined reward (step S44). For example, when a predetermined point is given as a reward, the information processing apparatus 400 controls the terminal device 10 of the user U11 so that the given point and the present accumulated point can be confirmed via the application AP.

  As described above, when the user performs a cleaning action, the information processing apparatus 400 gives a reward to the user. Even if users who are not good at cleaning can get a reward, it is possible that their willingness to clean is higher. Therefore, the information processing apparatus 400 can effectively make the user clean.

[2. Configuration of information processing apparatus]
Next, an information processing apparatus 400 according to the third embodiment will be described using FIG. FIG. 15 is a view showing an example of the arrangement of an information processing apparatus 400 according to the fourth embodiment. As illustrated in FIG. 15, the information processing device 400 includes a communication unit 110, a storage unit 420, and a control unit 430. The description of processing units having the same reference numerals as the information processing apparatus 100 described in FIG. 4 will be omitted or simplified.

(Regarding storage unit 420)
The storage unit 420 is realized by, for example, a semiconductor memory device such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 420 includes a user information storage unit 121, an environment information storage unit 122, and a reward information storage unit 423.

(Reward information storage unit 423)
The reward information storage unit 423 stores information on the reward given to the user. Here, FIG. 16 illustrates an example of the reward information storage unit 423 according to the fourth embodiment. In the present embodiment, the reward is a predetermined point. In the example of FIG. 16, the reward information storage unit 423 has items such as “family ID”, “user ID”, and “point”.

  The “family ID” and the “user ID” are as shown in FIG. "Point" indicates the current accumulated point given to the corresponding user. That is, in the example of FIG. 16, an example in which “50 points” is currently assigned to the user identified by the user ID “U11” is shown.

(About the control unit 430)
Referring back to FIG. 15, the control unit 430 is realized by the CPU, the MPU, or the like, which executes various programs stored in the storage device in the information processing apparatus 400 using the RAM as a work area. Further, the control unit 430 is realized by, for example, an integrated circuit such as an ASIC or an FPGA.

  As illustrated in FIG. 15, the control unit 430 includes a first acquisition unit 131, an estimation unit 132, a determination unit 133, a notification unit 134, an action determination unit 435, and an application unit 436. Implement or execute the functions and actions of the information processing to be described. Note that the internal configuration of control unit 430 is not limited to the configuration shown in FIG. 15, and may be another configuration as long as it performs the information processing described later. Further, the connection relationship of the processing units included in the control unit 430 is not limited to the connection relationship illustrated in FIG. 15, and may be another connection relationship.

(About the action determination unit 435)
The action determination unit 435 determines whether the user has performed a cleaning action. Here, as described in the first and second embodiments, the first acquisition unit 131 acquires environment information indicating the user's peripheral environment. For example, the first acquisition unit 131 acquires conversation information, which is information related to the user's conversation, as environment information indicating the user's surrounding environment. For example, the first acquisition unit 131 acquires conversation information indicating a conversation input to a predetermined audio device. In addition, the first acquisition unit 131 acquires environment information detected by a predetermined sensor function as environment information indicating a user's peripheral environment. Therefore, based on the environmental information acquired by the first acquisition unit 131, the behavior determination unit 435 determines whether the user has performed the cleaning action.

  In addition, when the progress information indicating the progress status of the cleaning action by the user is included in the conversation information, the action determination unit 435 determines whether the user performed the cleaning action based on the progress information. In addition, the action determination unit 435 determines that the user performed the cleaning action when the environment information detected by the predetermined sensor function indicates that the predetermined object is returned to the home position. In addition, when the voice of a related person having a predetermined relationship with the user is registered, the action determination unit 435 is the voice data corresponding to the conversation information, and the user performs the cleaning action based on the voice data of the related person. To determine if it has been done. In addition, the action determination unit 435 determines that the user performed the cleaning action when the environment information detected by the predetermined sensor function indicates that the predetermined object is returned to the home position.

(About grant section 436)
The giving unit 436 gives a reward to a predetermined target person regarding the cleaning action based on the determination result by the action determination unit 435. For example, the granting unit 436 grants, as a reward, content related to the object cleaned up by the cleaning action.

  Furthermore, when the action determination unit 435 determines that the user performed the cleaning action, the giving unit 436 rewards the user or a related person having a predetermined relationship with the user as a predetermined target person regarding the cleaning action. Grant For example, when a related party causes the user to perform a cleaning action, the giving unit 436 gives a reward to the related person.

  Also, for example, the giving unit 436 gives, as a reward, content related to the object that has been cleaned up by the cleaning action. Further, the giving unit 436 gives a reward according to the time from the start of the cleaning action to the end of the cleaning action.

[3. Example of action in information processing]
The contents of processing executed and realized by each processing unit of the information processing apparatus 400 will be described below using the flowchart shown in FIG. FIG. 17 is a flowchart illustrating an example of the information processing according to the fourth embodiment. Also, the example of FIG. 14 is used as appropriate.

  First, the first acquisition unit 131 determines whether or not conversation information has been acquired (step S401). For example, while not being transmitted from conversation information by the audio device DV1, the first acquisition unit 131 determines that conversation information is not acquired (step S401; No), and waits until acquisition.

  On the other hand, when the first acquisition unit 131 acquires the conversation information from the audio device DV1 by the speech device DV1 detecting the speech information (step S401; Yes), the behavior determination unit 435 detects the conversation information based on the conversation information. It is determined whether the user has performed a cleaning action (step S402). For example, the behavior determination unit 435 analyzes the conversation information to determine whether the user performed the cleaning action based on the content of the conversation indicated by the conversation information.

  Here, it is assumed that the conversation information indicates the progress of the cleaning action by the user. As an example, in the conversation information, content indicating that the mother user U12 is not currently performing a cleaning action such as "set up quickly" for the user U11, and the user U12 for the user U11 It is assumed that "I was able to clean properly" and a content indicating that the cleaning action was performed were included according to the change over time. In this case, the action determination unit 435 determines that the user U11 has performed the cleaning action.

  In addition, the action determination unit 435 can use a technology of voice recognition for the determination process. For example, in the above-described example, the behavior determination unit 435 specifies which of the utterance contents included in the conversation information is an utterance by the user U12. Such specification is possible because, for example, voice data of the user U12 having a family relationship (parent-child relationship) with the user U11 is registered in the information processing apparatus 400 in advance. For example, if the user U11 is a small child, the user U11 may say, for example, "cleaned up" by joke, even though the user U11 is not performing the cleaning action. On the other hand, since the user U12 is an adult, the possibility of making such a joke is low, and it can be said that the uttered content is more reliable than children.

  Because of this, if the voice data of the user U12 is registered in advance, the action determination unit 435 can focus on the conversation information corresponding to the user U12 and perform the determination process, so for example, the cleaning action It is possible to determine with high accuracy whether or not it has been performed, and when it is determined that the cleaning action has been performed, it is possible to specify, for example, who instructed the cleaning action by whom.

  In addition, the action determination unit 435 can determine that the user performed the cleaning action when the environment information detected by the predetermined sensor function indicates that the predetermined object is returned to the home position. The predetermined sensor function has been described in each of the above embodiments, but is, for example, an echo location, a camera, a dust sensor, etc., and is installed in the audio device DV1 or the cleaning robot RB1.

  For example, the action determination unit 435 combines the conversation information and the captured image by the sensor function, and after the utterance “Please put it away quickly” to the user U12, the toy scattered so far in the living room R is returned to the home position When it determines, it determines with user U11 having performed cleaning action. Further, for example, when the amount of dust by the dust sensor is decreased after the speech “please put it away quickly” to the user U12, the behavior determination unit 435 determines that the user U11 has performed the cleaning action.

  In addition, since the sensor is attached in advance also to the cleaning target, the behavior determination unit 435 may make the determination based on the information acquired from the sensor. For example, it is assumed that the toy G to be cleaned up by the user U11 is (IoT toy). The toy G can transmit position information and the like to the information processing device 400 via the network N. The action determination unit 435 determines that the user U11 has performed the cleaning action when the information indicating that the toy G has been returned to the fixed position is acquired based on the position information.

  As described above, when the action determination unit 435 determines that the user does not perform the cleaning action (Step S402; No), the process ends. On the other hand, when the action determination unit 435 determines that the user performed the cleaning action (step S402; Yes), the giving unit 436 gives a reward to a predetermined target person (step S403).

  Here, assuming that the action determination unit 435 determines that the user U11 performs the cleaning action, specifically, it is determined that the user U11 cleans up the toy G, the giving unit 436 sends a predetermined point to the user U11. Grant Also, for example, the giving unit 436 may give the user U11 a reward associated with the toy G, which is an object that has been put away. The giving unit 436 gives the user U11 the content related to the toy G (for example, an animation in which the toy G appears). Moreover, the provision part 436 may provide the coupon about the related components of toy G as a content relevant to toy G, for example.

  Further, since the action determination unit 435 can identify the progress status of the cleaning action by analyzing the conversation information, it can also calculate the time from the start of the cleaning action to the end thereof. Accordingly, the giving unit 436 may give a higher reward as the time from the start of the cleaning action to the end thereof is shorter. Thus, the information processing apparatus 400 can make the user perform an efficient cleaning action in a short time. In addition, for example, based on the voice data detected by the sensor, the action determination unit 435 determines, for example, a time from the start of the cleaning action to the end from the start of the cleaning action. It may be calculated as

  Furthermore, the granting unit 436 may grant a reward to the user U12 instead of the user U11. For example, it is assumed that the behavior determination unit 435 determines that the user U11 has performed a cleaning action in response to the utterance “Please put it away quickly” of the user U12. This indicates that the user U12 in a parent-child relationship has caused the user U11 to perform a cleaning action. That is, it can be said that the action of the user U12 affects the cleaning action performed by the user U11. In addition, it can be said that the user U12 indirectly performs the cleaning action. Therefore, in such a case, the giving unit 436 gives a reward to the user U12, not to the user U11.

  For example, even if the user U11 is cleaned, if a reward is given to the user U12 of the mother, the user U11 may be dissatisfied with this and may be actively cleaned from the next time. As such, the information processing apparatus 400 can effectively motivate cleaning for the user.

[4. Modified example]
The information processing apparatus 400 according to the fourth embodiment may be implemented in various different forms other than the fourth embodiment. Therefore, another embodiment of the information processing apparatus 400 will be described below.

[4-1. Content assignment based on purchasing information]
The granting unit 436 may grant content based on purchase information of a predetermined target person as a reward. Here, for example, it is assumed that the user U12 is to be rewarded because it is determined that the user U12 has performed the cleaning action. In such a case, for example, the assignment unit 436 acquires purchase information of the user U12. The purchase information includes information on products that the user U12 has purchased so far. For example, the assignment unit 436 may acquire purchase information from a predetermined server device (for example, a shopping server) that cooperates with the information processing device 400. Furthermore, when the information processing apparatus 400 has a storage unit that stores purchase information, the assignment unit 436 may acquire the purchase information from the storage unit.

  Then, the granting unit 436 grants, as a reward, content (for example, a coupon) related to a product recently purchased by the user U12 based on purchase information, for example. Since it can be said that such a product is a product in which the interest of the user U12 is increasing at the current point of time, the business owner who manages the information processing apparatus 400 highly evaluates the user U12 You can get it. Further, the information processing apparatus 400 can effectively make the user U12 clean.

  Note that, for example, when the user U12 purchases monthly moving image content, the giving unit 436 may be able to view part of the moving image content of the next month for free as a reward.

[4-2. Compensation competition within the group]
Further, the granting unit 436 grants a reward to the user who has performed the cleaning action among the plurality of users belonging to the predetermined group, and controls so that the competition of the reward can be performed among the plurality of users belonging to the predetermined group . This point will be described using the example of FIG.

  In the example of FIG. 16, the users U11, U12, U13, and U14 are identified by one family ID “FM1”, which indicates that the users U11, U12, U13, and U14 are in a family relationship. Further, the example of FIG. 5 is also applied, and the user U11 is a younger brother, the user U13 is a younger brother, the user U12 is a mother, and the user U14 is a father according to the age and sex. The application AP is installed on the terminal devices 10 of these four users.

  In such a state, the giving unit 436 controls so that each of the four users can confirm the current points of the other three users, including themselves, via the application AP. Thus, for example, in addition to the fact that the user U11 is currently "50 points" using the application AP, for example, the user U12 is "15 points", the user U13 is "35 points", and the user U14 is "40 points". It can be confirmed that it is a point. The same applies to the users U12 to U14. As a result, the user U13 who is the brother may be able to actively perform the cleaning action to lose points and increase the points more than the brother. From such a thing, since the information processing apparatus 400 can raise competition awareness to a user, it can perform cleaning action effectively.

[4-3. Fraud prevention]
Furthermore, the granting unit 436 does not grant a reward when it is determined that the user has performed a cleaning action in a state where the situation requiring the cleaning has been intentionally generated. For example, when the action determination unit 435 determines that the user U11 has performed the cleaning action, the giving unit 436 determines whether the situation targeted for the cleaning action, that is, the situation requiring the cleaning has been generated intentionally. Determine if

  Situations that require cleaning can be made in less time than naturally contaminating. Also, when creating a situation that requires cleaning, unique voice patterns occur. One example is, for example, the Mitsuo pattern showing an aspect in which an article contained in a box is scattered at a stretch. For example, when the assigning unit 436 identifies this unique voice pattern by analyzing voice data detected by the sensor, the assigning unit 436 determines that the user U11 has intentionally generated a situation that requires cleaning. That is, the granting unit 436 determines that the user U11 has made a fraudulent effort to pay for compensation, and does not give a reward. Thereby, the information processing apparatus 400 can prevent an act of illegally obtaining a reward.

[4-4. Learning]
Also, the giving unit 436 may learn the relationship between the granted reward and the cleaning action. For example, the giving unit 436 learns a tendency as to what kind of thing is given as a reward as the user is more likely to take a cleaning action. Then, the granting unit 436 grants a reward based on the learned relationship. Thus, the information processing apparatus 400 can specify what kind of reward it is effective to perform, and therefore can perform cleaning action more effectively using the specified reward. . Note that such learning processing may be performed by a processing unit other than the adding unit 436. For example, the information processing apparatus 400 may have a learning unit that performs learning processing.

[5. effect〕
An information processing apparatus 400 according to the fourth embodiment includes an action determination unit 435 and an assignment unit 436. The action determination unit 435 determines whether the user has performed a cleaning action. The giving unit 436 gives a reward to a predetermined target person regarding the cleaning action based on the determination result by the action determination unit 435.

  Thereby, the information processing apparatus 400 can effectively make the user clean.

(Others)
[1. Stand alone]
The information processing performed by the information processing apparatuses 100 to 400 in each of the above-described embodiments may be performed by, for example, a predetermined device installed indoors in a stand-alone manner. The predetermined device is, for example, an audio device DV1 or a cleaning robot RB1.

[2. Hardware configuration]
The information processing apparatuses 100, 200, 300, and 400 according to the above-described embodiments are realized by, for example, a computer 1000 configured as shown in FIG. Hereinafter, the information processing apparatus 100 will be described as an example. FIG. 18 is a hardware configuration diagram showing an example of a computer 1000 for realizing the functions of the information processing apparatus 100. The computer 1000 includes a CPU 1100, a RAM 1200, a ROM 1300, an HDD 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F) 1700.

  The CPU 1100 operates based on a program stored in the ROM 1300 or the HDD 1400 to control each part. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 starts up, a program depending on the hardware of the computer 1000, and the like.

  The HDD 1400 stores programs executed by the CPU 1100, data used by the programs, and the like. The communication interface 1500 receives data from another device via the communication network 50, sends the data to the CPU 1100, and transmits data generated by the CPU 1100 to the other device via the communication network 50.

  The CPU 1100 controls an output device such as a display or a printer and an input device such as a keyboard or a mouse via the input / output interface 1600. The CPU 1100 acquires data from an input device via the input / output interface 1600. The CPU 1100 also outputs the generated data to the output device via the input / output interface 1600.

  The media interface 1700 reads a program or data stored in the recording medium 1800 and provides the CPU 1100 with the program via the RAM 1200. The CPU 1100 loads such a program from the recording medium 1800 onto the RAM 1200 via the media interface 1700 and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a digital versatile disc (DVD) or a phase change rewritable disc (PD), a magneto-optical recording medium such as a magneto-optical disk (MO), a tape medium, a magnetic recording medium, or a semiconductor memory. Etc.

  For example, when the computer 1000 functions as the information processing apparatus 100 according to the first embodiment, the CPU 1100 of the computer 1000 implements the function of the control unit 130 by executing a program loaded on the RAM 1200. Further, data in the storage unit 120 is stored in the HDD 1400. The CPU 1100 of the computer 1000 reads these programs from the recording medium 1800 and executes them, but as another example, these programs may be acquired from another device via the communication network 50.

  Also, for example, when the computer 1000 functions as the information processing apparatus 200 according to the second embodiment, the CPU 1100 of the computer 1000 implements the function of the control unit 230 by executing the program loaded on the RAM 1200. .

[3. Other]
Among the processes described in each of the above embodiments, all or part of the process described as being automatically performed can be manually performed, or all the processes described as being manually performed. Alternatively, some of them can be performed automatically by known methods. In addition, information including processing procedures, specific names, various data and parameters shown in the above-mentioned documents and drawings can be arbitrarily changed unless otherwise specified.

  Further, each component of each device illustrated is functionally conceptual, and does not necessarily have to be physically configured as illustrated. That is, the specific form of the distribution and integration of each device is not limited to that shown in the drawings, and all or a part thereof may be functionally or physically dispersed in any unit depending on various loads, usage conditions, etc. It can be integrated and configured.

  Although the embodiments of the present application have been described in detail based on the several drawings, these are merely examples, and various modifications can be made based on the knowledge of those skilled in the art, including the aspects described in the section of the disclosure of the invention. It is possible to implement the invention in other improved forms.

  In addition, the "section (module, unit)" described above can be read as "means" or "circuit". For example, the acquisition unit can be read as an acquisition unit or an acquisition circuit.

10 terminal device 100 information processing device 121 user information storage unit 122 environment information storage unit 131 first acquisition unit 132 estimation unit 133 determination unit 134 notification unit 200 information processing device 235 second acquisition unit 300 information processing device 335 determination result acquisition unit 336 Output control unit 400 Information processing apparatus 423 Remuneration information storage unit 435 Behavior determination unit 436 Addition unit

Claims (18)

A determination unit that determines whether the user has performed a cleaning action;
An information processing apparatus, comprising: a grant unit that rewards a predetermined target person regarding the cleaning action based on the determination result by the determination unit. The system further includes an acquisition unit that acquires environment information indicating the environment around the user,
The information processing apparatus according to claim 1, wherein the determination unit determines whether the user has performed a cleaning action based on the environmental information acquired by the acquisition unit. The information processing apparatus according to claim 2, wherein the acquisition unit acquires, as environment information indicating a peripheral environment of the user, conversation information which is information related to a conversation of the user. The information processing apparatus according to claim 3, wherein the acquisition unit acquires the conversation information indicating a conversation input to a predetermined voice device. The determination unit is configured to determine whether or not the user performed the cleaning action based on the progress information when progress information indicating a progress status of the cleaning action by the user is included in the conversation information. The information processing apparatus according to claim 3 or 4. When the voice of a person having a predetermined relationship with the user is registered, the determination unit is the voice data corresponding to the conversation information, and the user cleans the voice based on the voice data of the person. The information processing apparatus according to any one of claims 3 to 5, wherein it is determined whether or not an action has been performed. The information processing apparatus according to any one of claims 2 to 6, wherein the acquisition unit acquires environmental information detected by a predetermined sensor function as environmental information indicating a peripheral environment of the user. . The determination unit is characterized in that the user performs the cleaning action when the environmental information detected by the predetermined sensor function indicates that the predetermined object has been returned to the home position. The information processing apparatus according to claim 7. The information processing apparatus according to any one of claims 1 to 8, wherein the giving unit gives, as a reward, content related to the object cleaned up by the cleaning action. The information processing apparatus according to any one of claims 1 to 9, wherein the giving unit gives a reward according to a time from the start of the cleaning action to the end of the cleaning action. The giving unit rewards the user or a person having a predetermined relationship with the user as a predetermined target person regarding the cleaning action when the determination unit determines that the user has performed the cleaning action. The information processing apparatus according to any one of claims 1 to 10, wherein the information processing apparatus is provided. The information processing apparatus according to claim 11, wherein the granting unit grants a reward to the person concerned when the person concerned causes the user to perform a cleaning action. The information processing apparatus according to claim 11, wherein the giving unit gives, as a reward, content based on purchase information of the predetermined target person. The giving unit gives a reward to a user who has performed a cleaning action among a plurality of users who belong to a predetermined group, and controls so that a competition of the remuneration can be performed between a plurality of users who belong to the predetermined group. The information processing apparatus according to any one of claims 1 to 13, which is characterized by the following. The giving unit does not give a reward when it is determined that the user has performed a cleaning action in a state where a situation requiring cleaning is intentionally generated. The information processing apparatus according to any one of the above. It further has a learning unit that learns the relationship between the reward given by the giving unit and the cleaning action,
The information processing apparatus according to any one of claims 1 to 15, wherein the giving unit gives a reward based on the relationship learned by the learning unit. An information processing method executed by the information processing apparatus;
A determination step of determining whether the user has performed a cleaning action;
A granting step of giving a reward to a predetermined target person regarding the cleaning action based on the judgment result of the judging step. A determination procedure for determining whether the user has performed a cleaning action;
An information processing program causing a computer to execute a granting procedure for rewarding a predetermined target person regarding the cleaning action based on a determination result by the determination procedure;

Images