JP2020017257A - Information processing method, information processing apparatus, and information processing program - Google Patents

Abstract

To provide an information processing method capable of presenting a good more suitable for an owner, an information processing apparatus, and an information processing program.SOLUTION: The information processing method in a server device 3 includes the steps of: acquiring a piece of first information on a suction target by a self-propelled vacuum cleaner 21; identifying a first article composed of the suction target based on the first information; identifying a second article related to the first article based on the second information on the first article and a piece of third information on the owner of the first article; and outputting a piece of fourth information about the identified second article.SELECTED DRAWING: Figure 1

Description

  The present disclosure relates to an information processing method, an information processing apparatus, and an information processing program for presenting information.

  Conventionally, during a cleaning operation, image recognition is performed by comparing a captured image captured by the imaging unit with an image of a registered foreign substance stored in the storage unit, and the registered foreign substance stored in the storage unit is compared. There is a known electric cleaning device that recognizes (see, for example, Patent Document 1). This electric cleaning device, when recognizing a registered foreign substance, controls the suction drive unit based on the control mode stored in the storage unit corresponding to the recognized foreign substance, and removes the recognized foreign substance. A display for identifying what is is displayed on the display screen.

  There is also known a recommendation system that not only searches for products that match search conditions, but also searches for and recommends products that do not match but are similar (for example, see Patent Document 2).

Japanese Patent No. 5771885 JP 2008-276449 A

  However, in the above-described conventional technique, there is a possibility that an article suitable for the owner may not be presented, and further improvement is required.

  The present disclosure has been made in order to solve the above-described problem, and has as its object to provide an information processing method, an information processing apparatus, and an information processing program that can present an article more suitable for an owner. It is.

  An information processing method according to an aspect of the present disclosure is an information processing method in an information processing apparatus, wherein first information about a suction target by a self-propelled cleaner is obtained, and the suction target is obtained based on the first information. A first article constituted by an object is identified, and a second article related to the first article is identified based on second information on the first article and third information on an owner of the first article. And outputting fourth information relating to the specified second article.

  According to the present disclosure, it is possible to present an article more suitable for the owner.

1 is a diagram illustrating a configuration of an information presentation system according to Embodiment 1 of the present disclosure. FIG. 2 is a diagram illustrating a configuration of a server device according to Embodiment 1 of the present disclosure. FIG. 3 is a diagram illustrating an example of user information stored in a user information storage unit according to the first embodiment. FIG. 3 is a diagram illustrating an example of article information stored in an article information storage unit according to the first embodiment. 5 is a flowchart for explaining an operation of the server device according to Embodiment 1 of the present disclosure. In Embodiment 1, it is a figure which shows an example of the presentation information displayed when a self-propelled (vacuum) cleaner starts cleaning a damaged article. FIG. 5 is a diagram illustrating an example of presentation information displayed when a substitute article is presented in the first embodiment. FIG. 5 is a diagram illustrating an example of presentation information displayed when a plurality of alternative articles are presented in the first embodiment. FIG. 9 is a diagram illustrating a configuration of a first server device and a second server device according to Embodiment 2 of the present disclosure.

(Knowledge underlying the present disclosure)
In Patent Literature 1, an image of a foreign substance other than an object to be cleaned is registered in a storage unit in advance, and a captured image captured during a cleaning operation is compared with an image of the foreign substance, and the registered foreign substance is recognized and recognized. A display identifying what the foreign substance is is displayed on the display screen. The foreign substances include, for example, “plastic bags”, “documents”, “cords”, and “screws” from the viewpoint of avoiding breakdown or breakage of the vacuum cleaner. From the viewpoint of securing and avoiding contamination and breakage, "documents", "micro SD cards", "banknotes", "jewels" and the like are mentioned. That is, in Patent Literature 1, although a foreign substance other than the object to be cleaned is recognized, a cleaning object such as a damaged mug is not recognized.

  Further, in Patent Literature 2, the attribute and attribute level of each product are stored in a product database, the desired level of each attribute is input, and the similarity between each input desired level and each attribute level of each product is determined. Acquired, using the similarity of each acquired attribute, the fit rate of each product to the desired product with the input desired level is calculated, based on the calculated fit rate, one or more Similar products are displayed as recommended products. That is, in Patent Literature 2, the user inputs a desired level of each attribute. However, since information such as whether or not the user owns the product is not considered, for example, a product suitable for the user is always recommended. Not necessarily.

  In order to solve the above problem, an information processing method according to an aspect of the present disclosure is an information processing method in an information processing device, wherein first information about a suction target by a self-propelled cleaner is obtained, A first article constituted by the suction target is specified based on the first information, and the first article is identified based on second information about the first article and third information about an owner of the first article. And outputting the fourth information relating to the specified second article.

  According to this configuration, the first article constituted by the suction target of the self-propelled cleaner is specified, and based on the second information on the first article and the third information on the owner of the first article, A second article related to one article is specified, and fourth information related to the specified second article is output. Therefore, when the second article related to the first article is specified, the third information on the owner of the first article constituted by the suction target of the self-propelled cleaner is taken into consideration, so that the owner can be further improved. Can be presented.

  Further, in the above information processing method, the suction target is the damaged first article, the first information is information on an appearance of the suction target, and the first article is specified by the The first article may be specified based on the appearance of the suction target.

  According to this configuration, it is possible to specify what the damaged first article is based on the appearance of the suction target.

  In the above information processing method, the information on the appearance may include an image captured by a camera included in the self-propelled cleaner, and the image may include the suction target.

  According to this configuration, the suction target is imaged by the camera included in the self-propelled cleaner, and the damaged first article can be specified based on the suction target included in the captured image.

  In the above information processing method, the first article may be identified by recognizing the image including the suction target and identifying the first article from the recognized image.

  According to this configuration, since the image including the suction target is recognized and the first article is specified from the recognized image, the first article can be easily specified by the image recognition.

  In the above information processing method, the second article may be the same article as the first article.

  According to this configuration, the same article as the first article is specified as the second article, and the fourth information on the specified second article is output, so that the same article as the first article is presented to the owner. be able to.

  In the above information processing method, the second article may be an article having the same attribute as the first article.

  According to this configuration, an article having the same attribute as the first article is specified as the second article, and the fourth information relating to the specified second article is output. Can be presented to others.

  In the above information processing method, the second article may be an article having the same attribute as the first article and having a higher strength than the first article.

  According to this configuration, an article having the same attribute as the first article and having a material higher in strength than the first article is specified as the second article, and the fourth information relating to the specified second article is output. , An article having the same attribute as that of the first article and having a stronger material than that of the first article can be presented to the owner.

  Further, in the above information processing method, the third information includes owned article information indicating a plurality of owned articles owned by the owner, and the identification of the second article is indicated by the owned article information. A third article different in type from the first article is specified from the plurality of owned articles, and at least one attribute is the same as the specified third article from a plurality of sold articles sold. And a fourth article of the same type as the first article may be specified as the second article.

  According to this configuration, the fourth article is different in type from the first article, has at least one attribute same as the third article owned by the owner, and has the same kind of fourth article as the first article. Is specified as a second article, and the fourth information relating to the specified second article is output. Therefore, although the first article is different from the first article, the other article owned by the owner has at least one attribute. The same item can be presented to the owner.

  Further, in the above information processing method, the third information includes house information indicating a position of a house of the owner, and the specification of the second article is within a predetermined range from the position of the house indicated by the house information. The second article that can be purchased at an internal store may be specified.

  According to this configuration, since the second article that can be purchased at a store within a predetermined range from the position of the owner's house is specified, the article that can be purchased near the owner's house can be presented to the owner. it can.

  In the above information processing method, the output of the fourth information may include transmitting the fourth information to a display device, and the display device may display the received fourth information in a predetermined mode.

  According to this configuration, the fourth information on the second article is transmitted to the display device, and the received fourth information is displayed on the display device in a predetermined manner. A second article that replaces the configured first article can be presented to the owner.

  In the above information processing method, the fourth information may include an object image for ordering the second article.

  According to this configuration, since the object image for ordering the second article is displayed, the owner can order the second article instead of the first article constituted by the suction target of the self-propelled cleaner from the owner. Can be done.

  In the above information processing method, the specification of the second article may specify a plurality of second articles, and the display device may display the plurality of second articles in a selectable manner.

  According to this configuration, the plurality of second articles are specified, and the plurality of second articles are displayed on the display device in a selectable manner, so that the first object constituted by the suction target of the self-propelled cleaner is provided. The owner can select an article to replace the article from among the plurality of second articles.

  An information processing device according to another aspect of the present disclosure includes an acquisition unit configured to acquire first information on an object to be suctioned by a self-propelled cleaner, and a first unit configured by the object to be suctioned based on the first information. A second specifying unit that specifies a second article related to the first article based on a first specifying unit that specifies the article, second information about the first article, and third information about an owner of the first article; An identification unit is provided, and an output unit that outputs fourth information about the identified second article is provided.

  According to this configuration, the first article constituted by the suction target of the self-propelled cleaner is specified, and based on the second information on the first article and the third information on the owner of the first article, A second article related to one article is specified, and fourth information related to the specified second article is output. Therefore, when the second article related to the first article is specified, the third information on the owner of the first article constituted by the suction target of the self-propelled cleaner is taken into consideration, so that the owner can be further improved. Can be presented.

  An information processing program according to another aspect of the present disclosure obtains first information on an object to be suctioned by a self-propelled cleaner, and specifies a first article constituted by the object to be suctioned based on the first information. Then, based on the second information about the first article and the third information about the owner of the first article, a second article related to the first article is specified, and a fourth article about the specified second article is specified. Make the computer function to output information.

  According to this configuration, the first article constituted by the suction target of the self-propelled cleaner is specified, and based on the second information on the first article and the third information on the owner of the first article, A second article related to one article is specified, and fourth information related to the specified second article is output. Therefore, when the second article related to the first article is specified, the third information on the owner of the first article constituted by the suction target of the self-propelled cleaner is taken into consideration, so that the owner can be further improved. Can be presented.

  Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. The following embodiment is an example of the present disclosure, and does not limit the technical scope of the present disclosure.

(Embodiment 1)
FIG. 1 is a diagram illustrating a configuration of an information presentation system according to Embodiment 1 of the present disclosure. As shown in FIG. 1, the information presentation system includes a server device 3, a gateway (GW) 5, a first sensor 11, a self-propelled cleaner 21, and a display device 22.

  The gateway 5, the first sensor 11, the self-propelled cleaner 21 and the display device 22 are arranged in the house 10. The gateway 5 is communicably connected to the first sensor 11, the self-propelled cleaner 21 and the display device 22. The gateway 5 is communicably connected to the server device 3 via the network 4. The network 4 is, for example, the Internet.

  The first sensor 11, the self-propelled cleaner 21, and the display device 22 are communicably connected to the server device 3 via the gateway 5. The first sensor 11, the self-propelled cleaner 21 and the display device 22 may be connected to the server device 3 so as to be able to directly communicate with each other without passing through the gateway 5.

  FIG. 2 is a diagram illustrating a configuration of the server device according to Embodiment 1 of the present disclosure. The server device 3 is communicably connected to a sensor group 1 including a plurality of sensors arranged in the house 10 and a device group 2 including a plurality of devices arranged in the house 10. The sensor group 1 includes various sensors such as a first sensor 11 and a second sensor 12. The device group 2 includes various devices such as a self-propelled cleaner 21 and a display device 22. In FIG. 2, the gateway 5 is omitted.

  The first sensor 11 is, for example, a microphone device, collects sounds in the house 10, and transmits sound data to the server device 3. The second sensor 12 is, for example, an imaging device, which images the inside of the house 10 and transmits image data to the server device 3. Note that the sensor group 1 may include a thermal image sensor and a vibration sensor. The sensors constituting the sensor group 1 may be installed on walls, floors, and furniture of the house 10 or may be mounted on any of the devices in the device group 2.

  The self-propelled cleaner 21 performs suction cleaning while moving autonomously. The self-propelled cleaner 21 cleans the floor surface while autonomously moving on the floor surface in the house 10. Usually, the self-propelled cleaner 21 is connected to a charging device (not shown) installed at a predetermined place in the house 10, and a cleaning start button provided on the main body of the self-propelled cleaner 21 is provided. When pressed by the user or when cleaning instruction information is received from the server device 3, the user leaves the charging device and starts cleaning. The self-propelled cleaner 21 includes a control unit, a camera, a driving unit, a cleaning unit, and a communication unit (not shown).

  The control unit controls a cleaning operation by the self-propelled cleaner 21. The drive unit moves the self-propelled cleaner 21. The driving unit includes a driving wheel for moving the self-propelled cleaner 21 and a motor for driving the driving wheel. The drive wheels are installed at the bottom of the self-propelled cleaner 21. The cleaning unit is installed at the bottom of the self-propelled cleaner 21 and sucks the suction target.

  The camera captures an image of the traveling direction of the self-propelled cleaner 21. The communication unit transmits image data captured by the camera to the server device 3. In addition, the communication unit receives cleaning instruction information for starting cleaning from the server device 3. The control unit starts cleaning when the cleaning instruction information is received by the communication unit. Note that the cleaning instruction information includes a damaged position where the article 6 is damaged in the house 10. The broken position is a position where the article 6 such as a mug and a plate is broken. After moving to the damaged position, the self-propelled cleaner 21 captures an image of the suction target present at the damaged position, and transmits the captured image data to the server device 3. Then, the self-propelled cleaner 21 cleans the damaged position and returns to the charging device.

  The display device 22 is arranged on a wall of a predetermined room in the house 10. Further, the information presentation system according to the first embodiment may include a plurality of display devices 22. The plurality of display devices 22 may be arranged on a wall of each room such as a living room, kitchen, bedroom, bath, toilet, and entrance. The display device 22 may be an information terminal such as a smartphone or a tablet computer. The display device 22 includes a communication unit, a display unit, and an input unit (not shown).

  The communication unit receives information indicating a state of a device from a device arranged in the house 10. Further, the communication unit receives the presentation information from the server device 3.

  The display unit is, for example, a liquid crystal display device and displays various information. The display unit displays information related to devices arranged in the house 10. The display unit displays, for example, the current state of the washing machine, and displays the current state of the air conditioner. The display unit displays the presentation information received by the communication unit.

  The input unit is, for example, a touch panel, and receives an input operation by a user. The input unit receives an input of an operation instruction for a device arranged in the house 10. The input unit receives, for example, an input of an operation instruction to an air conditioner or an input of an operation instruction to a lighting device. The communication unit transmits the operation instruction input by the input unit to the device.

  The device group 2 includes a washing machine, a lighting device, an air conditioner, an electric shutter, an electric lock, an air cleaner, and the like, in addition to the self-propelled cleaner 21 and the display device 22. The devices that make up the device group 2 include, for example, home appliances, information devices, and home equipment.

  The server device 3 includes a communication unit 31, a processor 32, and a memory 33.

  The communication unit 31 includes a sensor data receiving unit 311, a control information transmitting unit 312, and a presentation information transmitting unit 313. The processor 32 includes a damage detecting unit 321, a damaged position specifying unit 322, a device control unit 323, a damaged item specifying unit 324, a user specifying unit 325, a substitute item specifying unit 326, and a presentation information generating unit 327. The memory 33 includes a user information storage unit 331 and an article information storage unit 332.

  The sensor data receiving unit 311 acquires sensor data acquired by at least one of one or more sensors installed in the house 10. The sensor data receiving unit 311 receives sensor data from each sensor of the sensor group 1. The sensor data includes sound data acquired by the first sensor 11 (microphone device) and image data acquired by the second sensor 12 (imaging device). The sensor data receiving unit 311 receives sound data from the first sensor 11 as sensor data, and receives image data from the second sensor 12 as sensor data.

  Further, the sensor data receiving unit 311 receives sensor data from each device of the device group 2. In the device group 2, there is also a device provided with a sensor. The device provided with the sensor transmits the sensor data to the server device 3. As described above, the self-propelled cleaner 21 includes the camera. Therefore, the sensor data receiving unit 311 receives image data from the self-propelled cleaner 21 as sensor data. Further, the display device 22 may include a microphone and a camera, and the sensor data receiving unit 311 may receive sound data and image data from the display device 22 as sensor data.

  The damage detection unit 321 detects that an article in the house 10 has been damaged based on the sensor data received by the sensor data reception unit 311. When the sound data received from the first sensor 11 includes a feature of a sound generated when the article is damaged, the damage detection unit 321 detects that the article is damaged. The memory 33 may store in advance, for example, frequency components of a plurality of breakage sounds such as a sound of breaking ceramics or glass. The breakage detecting unit 321 compares the frequency component of the sound data received from the first sensor 11 with the frequency components of the plurality of breakage sounds stored in the memory 33. If the two frequency components match, the article is detected. Detects damage.

  Note that the damage detection unit 321 uses the sound data at the time of the occurrence of the article damage and the occurrence of the article damage as teacher data using a prediction model that is machine-learned as the teacher data, and receives the sound received from the first sensor 11. From the data, it may be estimated that the article has been damaged. In this case, the prediction model is stored in the memory 33 in advance.

  Further, the damage detection unit 321 may detect that the article has been damaged from the image data captured by the second sensor 12. For example, the sensor data receiving unit 311 may acquire temporally continuous image data from the second sensor 12. The damage detection unit 321 analyzes the acquired image data, and if the image data includes a state in which the article falls from a person's hand in the house 10 and the article is broken on the floor, the article is damaged. May be detected.

  Further, the damage detection unit 321 may detect that the article has been damaged using sensor data from another sensor such as a vibration sensor. Further, the damage detection unit 321 may detect that the article has been damaged using sensor data from a plurality of sensors in the sensor group 1.

  The damaged position specifying unit 322 specifies a damaged position of the article in the house 10. The memory 33 may store in advance, for example, a floor plan of the house 10 represented in a two-dimensional coordinate space. The self-propelled cleaner 21 may create a floor plan by moving in the house 10 and transmit the created floor plan to the server device 3. The damage position specifying unit 322 specifies the coordinates on the floor plan of the sound source where the article is damaged as the damage position.

  Note that the damaged position specifying unit 322 can more accurately specify the source of the sound of the damaged article by collecting the sound of the damaged article by the plurality of microphones. Further, the damaged position specifying unit 322 may specify a position where the article is damaged from the image data captured by the second sensor 12.

  The device control unit 323 controls the operation of the self-propelled cleaner 21. The device control unit 323 moves the self-propelled cleaner 21 to the damaged position specified by the damaged position specifying unit 322, and also provides cleaning instruction information for causing the self-propelled cleaner 21 to clean the damaged article at the damaged position. Generate

  The control information transmission unit 312 transmits the cleaning instruction information generated by the device control unit 323 to the self-propelled cleaner 21. Upon receiving the cleaning instruction information, the self-propelled cleaner 21 moves to the damaged position, captures an image of the suction target that is a damaged article at the damaged position, transmits the captured image data to the server device 3, and Aspirate things. The sensor data receiving unit 311 obtains first information on an object to be suctioned by the self-propelled cleaner 21. For example, the first information is information on the appearance of the suction target. The information on the appearance includes an image captured by a camera included in the self-propelled cleaner 21. The image includes the suction target. The sensor data receiving unit 311 receives the image data of the suction target transmitted by the self-propelled cleaner 21.

  The damaged article specifying unit 324 specifies a damaged article (first article) constituted by the suction target based on the image data (first information) including the suction target received from the self-propelled cleaner 21. The suction target is a damaged article (first article). The damaged article specifying unit 324 specifies the damaged article (first article) based on the appearance of the suction target. The damaged article specifying unit 324 recognizes an image including the suction target, and specifies a damaged article (first article) from the recognized image. The memory 33 may store in advance a table in which images of a plurality of articles are associated with the names (product names) of the plurality of articles. The damaged article specifying unit 324 compares the image data obtained by imaging the suction target with the images of the plurality of articles stored in the memory 33, and corresponds to the image of the article that partially matches the image of the suction target. The name of the attached article is specified as the name of the damaged article.

  The user information storage unit 331 stores user information on a user.

  FIG. 3 is a diagram illustrating an example of user information stored in the user information storage unit according to the first embodiment.

  As shown in FIG. 3, the user information includes a user ID for identifying the user, a name of the user, an address of the user, a date of birth of the user, a blood type of the user, a family structure of the user, and articles owned by the user. . The user information storage unit 331 stores user information in which a user ID, a name, an address, a date of birth, a blood type, a family structure, and a possessed item are associated with each other.

  Note that the user information illustrated in FIG. 3 is an example, and may include other information such as an image of a possessed article. Further, all of the user information may be managed in one table, or may be managed in a distributed manner in a plurality of tables. For example, the user ID and the possessed article may be managed in different tables, and the information in each table may be associated with the user ID as a key.

  The user specifying unit 325 specifies the user who owns the damaged article specified by the damaged article specifying unit 324, and acquires the user information of the specified user from the user information storage unit 331. For example, when the damaged article is “Mug AB”, the user information of the user ID “0001” in which “Mug AB” exists in the owned article is acquired.

  The article information storage unit 332 stores article information on articles.

  FIG. 4 is a diagram illustrating an example of article information stored in the article information storage unit according to the first embodiment.

  As shown in FIG. 4, the article information includes a product number for identifying the article, a product name of the article, an article type, an article category, an article color, an article size, an article weight, an article material, and an article name. Includes prices, article manufacturers, and article sales outlets. The article information storage unit 332 stores a product number, an article name, an article type, an article category, an article color, an article size, an article weight, an article material, an article price, an article manufacturer, and an article sale. The article information associated with the store is stored.

  The article information shown in FIG. 4 is an example, and may include other information such as an image of the article. Further, all of the article information may be managed in one table, or may be managed in a distributed manner in a plurality of tables.

  The substitute article specifying unit 326 determines the damaged article (second information) based on the article information (second information) on the damaged article (first article) and the user information (third information) on the owner of the damaged article (first article). An alternative article (second article) related to (one article) is specified. The substitute article specifying unit 326 acquires the article information of the damaged article from the article information storage unit 332.

  For example, the replacement article may be the same article as the damaged article. In this case, the substitute article specifying unit 326 specifies the same article as the damaged article as a substitute article.

  Further, for example, the substitute article may be an article having the same attribute as the damaged article. In this case, the substitute article specifying unit 326 specifies an article having the same attribute as the damaged article as a substitute article. The attribute is, for example, the color, size, weight, or material of the article. The substitute article specifying unit 326 specifies an article having the same color, size, weight, and material of the damaged article as a substitute article. Note that the substitute article specifying unit 326 may specify, as a substitute article, an article having at least one of the same color, size, weight, and material of the damaged article.

  Further, for example, the substitute article may be an article having an attribute similar to the attribute of the damaged article. In this case, the substitute article specifying unit 326 specifies an article having an attribute similar to the attribute of the damaged article as a substitute article. The attribute is, for example, the color, size, or weight of the article. The substitute article specifying unit 326 specifies an article similar to at least one of the color, size, and weight of the damaged article as a substitute article. For example, a color similar to blue is bluish purple or the like, and a similar color is stored for each color in advance. In addition, the article having a size similar to the size of the damaged article is, for example, an article having a size within a range of −1 to +1 cm in width, depth, and height of the damaged article. In addition, the article of the size similar to the size of the damaged article is not limited to the article whose size is within the predetermined value range as described above. For example, the width, the depth, and the height of the damaged article are from −10% to + 10%. The size may be an article whose size is within a predetermined ratio range, such as an article whose size is within the range of%. Further, an article having a weight similar to the weight of the damaged article is, for example, an article having a weight within the range of −10 grams to +10 grams of the weight of the damaged article. Note that the article having a weight similar to the weight of the damaged article is not limited to an article whose size is within a predetermined value range as described above. For example, the article may have a weight within a range of -10% to + 10% of the weight of the damaged article. It may be an article whose size is within a predetermined ratio range, such as a heavy article.

  Further, for example, the substitute article may be an article having the same attribute as the damaged article and having a higher strength than the damaged article. In this case, the substitute article specifying unit 326 specifies, as a substitute article, an article having the same attribute as the damaged article and having a higher strength than the damaged article. The attribute is, for example, the color of the article. When the material of the damaged article is pottery, the substitute article specifying unit 326 specifies a metal article having the same color as the damaged article and having higher strength than the damaged article as a substitute article.

  Further, the user information includes possessed article information indicating a plurality of possessed articles owned by the owner. The substitute article specifying unit 326 specifies an article (third article) different in type from the damaged article from among the plurality of owned articles indicated by the owned article information, and, from among the plurality of sold articles sold, An article (fourth article) having at least one attribute same as the specified article and having the same type as the damaged article may be specified as a substitute article.

  In addition, the user information includes house information indicating the position of the house of the owner. The substitute item specifying unit 326 may specify a substitute item that can be purchased at a store within a predetermined range from the position of the house indicated by the house information.

  The presentation information generation unit 327 generates presentation information (fourth information) related to the alternative article specified by the alternative article specification unit 326. The presentation information includes an image indicating the appearance of the substitute article. In addition, the presentation information may include an object image for ordering a substitute article, together with an image indicating the appearance of the substitute article.

  The presentation information transmitting unit 313 outputs presentation information (fourth information) related to the substitute article specified by the substitute article specifying unit 326. That is, the presentation information transmission unit 313 transmits the presentation information generated by the presentation information generation unit 327 to the display device 22. The display device 22 displays the received presentation information in a predetermined manner.

  FIG. 5 is a flowchart for explaining the operation of the server device according to Embodiment 1 of the present disclosure. Although FIG. 5 illustrates an example in which damage is detected based on sound data, damage may be detected based on other sensor data such as image data as described above.

  First, the sensor data receiving unit 311 receives sound data from the first sensor 11 as sensor data (Step S1).

  Next, the damage detection unit 321 determines whether damage to an article in the house 10 has been detected using the sound data received by the sensor data reception unit 311 (step S2). At this time, when the frequency component of the sound data received from the sensor data receiving unit 311 matches the frequency component of the sound data in which the stored article is damaged, the damage detection unit 321 determines that the article is damaged. Detect. Here, when it is determined that the damage of the article has not been detected (NO in step S2), the process returns to step S1.

  On the other hand, when it is determined that the damage of the article has been detected (YES in step S2), the damage position specifying unit 322 specifies the damage position of the article in the house 10 (step S3).

  Next, the device control unit 323 moves the self-propelled cleaner 21 to the damaged position specified by the damaged position specifying unit 322 and causes the self-propelled cleaner 21 to clean the damaged article at the damaged position. The cleaning instruction information is generated (Step S4).

  Next, the control information transmitting unit 312 transmits the cleaning instruction information generated by the device control unit 323 to the self-propelled cleaner 21 (Step S5). The self-propelled cleaner 21 receives the cleaning instruction information from the server device 3 and moves toward the damaged position included in the cleaning instruction information. When the self-propelled cleaner 21 arrives at the damaged position, the self-propelled cleaner 21 takes an image of the suction target with a camera, and transmits the image data of the taken image to the server device 3. When the self-propelled cleaner 21 transmits the image data including the suction target to the server device 3, the self-propelled cleaner 21 suctions the suction target.

  Next, the sensor data receiving unit 311 receives image data including the suction target from the self-propelled cleaner 21 as sensor data (step S6).

  Next, the damaged article specifying unit 324 specifies a damaged article constituted by the suction target based on the image data including the suction target received from the self-propelled cleaner 21 (step S7). The damaged article specifying unit 324 compares the image of a plurality of articles stored in advance with the image of the suction target included in the image data, and recognizes a damaged article formed by the suction target. For example, when the suction target is a piece of a ceramic mug, the damaged article specifying unit 324 recognizes an image of an article that partially matches the image of the piece included in the image data, and corresponds to the image of the recognized article. Items to be damaged are specified as damaged items.

  Next, the user specifying unit 325 specifies the user who owns the damaged article specified by the damaged article specifying unit 324, and acquires the user information of the specified user from the user information storage unit 331 (Step S8). The user identification unit 325 acquires user information indicating that a damaged article exists in the owned articles.

  Note that the user identifying unit 325 identifies the user who owns the damaged article based on the damaged location of the article identified by the damaged location identifying unit 322 and the location information indicated by the address included in the user information. Good. Specifically, the user specifying unit 325 specifies the position on the map corresponding to the damaged position specified by the damaged position specifying unit 322, and possesses the damaged item by the user having the specified position on the map as the address. May be specified.

  Next, the substitute article specifying unit 326 acquires the article information of the damaged article from the article information storage unit 332 (Step S9).

  Next, the substitute article specifying unit 326 specifies a substitute article related to the damaged article based on the article information about the damaged article and the user information about the owner of the specified damaged article (Step S10). Here, the substitute article specifying unit 326 performs the first to fourth specifying processes and specifies the substitute article related to the damaged article. Hereinafter, an example in which “Mug AB” owned by the user with the user ID “0001” is damaged using the user information shown in FIG. 3 and the article information shown in FIG. 4 will be described.

  In the first specifying process, the substitute article specifying unit 326 specifies the same article as the damaged article as a substitute article. For example, the substitute article specifying unit 326 specifies the same article as the damaged article “Mag AB” as a substitute article.

  In the second specifying process, the substitute article specifying unit 326 specifies, as a substitute article, an article having at least one of a plurality of attributes of a damaged article that is the same. For example, the substitute article specifying unit 326 specifies, as a substitute article, an article “Cup B” that has a different manufacturer from the damaged article, but has the same color and material and a similar size.

  Further, in the third specifying process, the substitute item specifying unit 326 specifies an article different in type from the damaged article from among the plurality of owned articles indicated by the owned article information, and determines a plurality of sold articles that are sold. From among them, an article having at least one attribute same as the specified article and of the same type as the first article is specified as a substitute article. For example, the substitute article specifying unit 326 specifies an article “dish AG” having a different type from the damaged article “mag AB” from among a plurality of owned articles indicated by the owned article information. Then, the substitute article specifying unit 326 selects an article “Mag A-G” having the same color as the specified article “Dish AG” from the plurality of sold articles sold and of the same type as the damaged article. Is specified as a substitute.

  Further, in the fourth specifying process, the alternative article specifying unit 326 determines that at least one of the plurality of attributes of the damaged article is the same, that the material is higher in strength than the damaged article, and that the location of the owner's residence is An article that can be purchased at a store within a predetermined range is specified as a substitute article. For example, the substitute article specifying unit 326 may be configured such that the damaged article has the same color and size among a plurality of attributes, is made of a metal whose strength is higher than that of the damaged article, and is within a predetermined range from the position of the owner's residence. The product “Mug Z” that can be purchased at the store is specified as a substitute product.

  The substitute article specifying unit 326 performs the first to fourth specifying processes, and outputs the substitute articles specified in each of the first to fourth specifying processes to the presentation information generating unit 327.

  In each of the first to fourth specifying processes, a substitute article is not always specified. For example, when the sale of the damaged article has already been completed and the article information of the damaged article does not exist in the article information storage unit 332, the substitute article is not specified even if the first specifying process is performed. Therefore, the alternative item specifying unit 326 may perform the first to fourth specifying processes and output the alternative item specified in any of the first to fourth specifying processes to the presentation information generating unit 327.

  In addition, the priority order may be set to the first to fourth specifying processes, and the substitute article specifying unit 326 may select one of the first to fourth specifying processes to replace one of the first to fourth specifying processes. Only the presentation information generation unit 327 may be output.

  Further, in the first embodiment, the alternative article specifying unit 326 performs the first to fourth specifying processes in parallel, but the present disclosure is not particularly limited to this. The substitute article specifying unit 326 may sequentially perform the first to fourth specifying processes until a substitute article is specified. In this case, first, the substitute article specifying unit 326 performs a first specifying process. Next, the presentation information generating unit 327 determines whether or not a substitute article has been specified by the first specifying process. Here, when it is determined that the substitute article is specified by the first specifying process, the presentation information generating unit 327 generates the presentation information regarding the substitute article specified by the first specifying process of the substitute product specifying unit 326. On the other hand, when it is determined that the alternative article has not been identified by the first identification processing, the alternative article identification unit 326 performs the second identification processing. Thereafter, the substitute article specifying unit 326 performs the third and fourth specifying processes in order until a substitute article is specified. Then, when it is determined that the substitute article has not been specified by the fourth specifying process, the presentation information generation unit 327 may generate presentation information indicating that there is no substitute article.

  Further, the specifying process performed by the substitute article specifying unit 326 is not limited to the above-described first to fourth specifying processes. The substitute article specifying unit 326 may perform a specific process other than the above-described first to fourth specifying processes, and may specify a substitute article related to the damaged article.

  Next, the presentation information generation unit 327 generates presentation information on the substitute article specified by the substitute article specification unit 326 (Step S11).

  Next, the presentation information transmission unit 313 transmits the presentation information generated by the presentation information generation unit 327 to the display device 22 (Step S12). The display device 22 receives the presentation information transmitted by the server device 3 and displays the received presentation information. The display device 22 displays the presentation information while the suction target is being sucked by the self-propelled cleaner 21. The display device 22 may display the presentation information together with the start of the suction of the suction target by the self-propelled cleaner 21. Further, the display device 22 may continuously display the presentation information even after the suction of the suction target by the self-propelled cleaner 21 is completed.

  In this manner, the damaged article constituted by the suction target of the self-propelled cleaner 21 is specified, and the substitute article related to the damaged article is determined based on the article information on the damaged article and the user information on the owner of the damaged article. Is specified, and presentation information on the specified substitute article is output. Therefore, when the alternative article related to the damaged article is specified, the user information regarding the owner of the damaged article constituted by the suction target of the self-propelled cleaner 21 is considered, so that the user is more suitable for the owner. Articles can be presented.

  Here, the presentation information generated in the server device 3 and displayed on the display device 22 will be described.

  FIG. 6 is a diagram illustrating an example of presentation information displayed when the self-propelled cleaner starts cleaning a damaged article in the first embodiment. When generating the cleaning instruction information, the device control unit 323 may generate presentation information for notifying the user that cleaning is to be started. In this case, the control information transmitting unit 312 transmits the cleaning instruction information generated by the device control unit 323 to the self-propelled cleaner 21, and transmits the presentation information generated by the device control unit 323 to the display device 22. You may.

  As shown in FIG. 6, the display device 22 may display presentation information 221A for notifying a user that cleaning is to be started. The presentation information 221A includes, for example, a sentence “Are you okay? Not introduced? I'm going to clean now.”

  FIG. 7 is a diagram showing an example of presentation information displayed when a substitute article is presented in the first embodiment. The presentation information generation unit 327 generates presentation information on the substitute article specified by the substitute article specification unit 326. The presentation information transmission unit 313 transmits the presentation information generated by the presentation information generation unit 327 to the display device 22. The display device 22 receives the presentation information transmitted by the server device 3 and displays the received presentation information. In FIG. 7, the display device 22 displays presentation information 221B including an image 222 for confirming whether to purchase the same substitute article as the damaged article.

  As shown in FIG. 7, the presentation information 221B includes, for example, a sentence “Would you buy a new mug?”, An image showing the appearance of the substitute article, and a button for switching to an order screen for ordering the substitute article. And an image 222 containing

  Further, in the first embodiment, the substitute article specifying unit 326 may specify a plurality of substitute articles (second articles). The display device 22 may display a plurality of alternative articles in a selectable manner.

  FIG. 8 is a diagram illustrating an example of presentation information displayed when a plurality of alternative articles are presented in the first embodiment. The substitute article specifying unit 326 specifies the same article as the damaged article as the first substitute article, and specifies, as the second substitute article, an article having the same color and size as the damaged article and having a higher strength than the damaged article. Then, an article having a different color from the damaged article and having the same size as the damaged article is specified as a third alternative article. The presentation information generation unit 327 generates presentation information on the first to third alternative articles specified by the alternative article specification unit 326. The presentation information transmission unit 313 transmits the presentation information generated by the presentation information generation unit 327 to the display device 22. The display device 22 receives the presentation information transmitted by the server device 3 and displays the received presentation information. In FIG. 8, the display device 22 includes a first image 223 for confirming whether to purchase the first substitute article and a second image 224 for confirming whether to purchase the second substitute article. And the third image 225 for confirming whether or not to purchase the third alternative article.

  As shown in FIG. 8, the first image 223 includes, for example, an image showing the appearance of the first substitute article, the price of the first substitute article, and a button for ordering the first substitute article. The first substitute article is the same article as the damaged article.

  In addition, the second image 224 includes, for example, an image indicating the appearance of the second alternative item, the price of the second alternative item, and a button for ordering the second alternative item. The second substitute article is an article made of a material having the same color and size as the damaged article and having higher strength than the damaged article. When the material of the damaged article is pottery, the material of the second alternative article is metal.

  In addition, the third image 225 includes, for example, an image indicating the appearance of the third alternative item, the price of the third alternative item, and a button for ordering the third alternative item. The third alternative article is an article that is different in color from the damaged article and has the same size as the damaged article. In particular, the third substitute article is an article that is the same in color and is different from the damaged article among the plurality of articles owned by the owner of the damaged article and is different in kind and color, and is the same in type and size as the damaged article. It is. For example, if the damaged article is a blue mug and the article different in type and color from the damaged article is a green dish, a green mug having the same size as the damaged article is specified as the third alternative article.

  In addition, the first image 223, the second image 224, and the third image 225 may include evaluation information in which each of the first substitute article, the second substitute article, and the third substitute article is evaluated by another user.

  In addition, the presentation information 221B and 221C may include information regarding a store that sells the presented alternative article. Further, the presentation information 221B and 221C may include an image of a state where the substitute article is stored on the shelf.

(Embodiment 2)
The information presentation system according to the first embodiment includes one server device, but the information presentation system according to the second embodiment includes two server devices.

  FIG. 9 is a diagram illustrating a configuration of the first server device and the second server device according to Embodiment 2 of the present disclosure.

  The information presentation system according to Embodiment 2 includes a first server device 3A, a second server device 3B, a gateway 5 (not shown), a first sensor 11, a self-propelled cleaner 21, and a display device 22. In the second embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and description thereof will be omitted. The sensor group 1 includes various sensors such as a first sensor 11 and a second sensor 12. The device group 2 includes various devices such as a self-propelled cleaner 21 and a display device 22. In FIG. 9, the gateway 5 is omitted.

  The first server device 3A is communicably connected to the sensor group 1, the device group 2, and the second server device 3B via a network. The second server device 3B is communicably connected to the device group 2 and the first server device 3A via a network.

  The first server device 3A is operated by, for example, a platformer. The second server device 3B is operated by, for example, a third party.

  The first server device 3A includes a communication unit 31A, a processor 32A, and a memory 33A.

  The communication unit 31A includes a sensor data receiving unit 311, a control information transmitting unit 312, and a user information transmitting unit 314. The processor 32A includes a damage detection unit 321, a damage position identification unit 322, a device control unit 323, a damaged article identification unit 324, and a user identification unit 325. The memory 33A includes a user information storage unit 331.

  The user information transmitting unit 314 transmits to the second server device 3B the damaged article information indicating the damaged article specified by the damaged article specifying unit 324 and the user information of the user specified by the user specifying unit 325.

  The second server device 3B includes a communication unit 31B, a processor 32B, and a memory 33B.

  The communication unit 31B includes a presentation information transmission unit 313 and a user information reception unit 315. The processor 32B includes a substitute article specifying unit 326 and a presentation information generating unit 327. The memory 33B includes an article information storage unit 332.

  The user information receiving unit 315 receives the damaged article information and the user information transmitted by the first server device 3A.

  In the second embodiment, the first server device 3A transmits the damaged article information and the user information to the second server device 3B. However, the present disclosure is not particularly limited to this, and the second server device 3B A request for requesting the damaged item information and the user information may be transmitted to the first server device 3A, and the first server device 3A may transmit the damaged item information and the user information to the second server device 3B in response to the request.

  In the second embodiment, the information presentation system may include a plurality of second server devices 3B.

  In each of the above embodiments, each component may be configured by dedicated hardware, or may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

  Some or all of the functions of the device according to the embodiment of the present disclosure are typically realized as an LSI (Large Scale Integration) that is an integrated circuit. These may be individually integrated into one chip, or may be integrated into one chip so as to include some or all of them. Further, the integrated circuit is not limited to the LSI, and may be realized by a dedicated circuit or a general-purpose processor. An FPGA (Field Programmable Gate Array) that can be programmed after manufacturing the LSI, or a reconfigurable processor that can reconfigure the connection and setting of circuit cells inside the LSI may be used.

  Further, some or all of the functions of the device according to the embodiment of the present disclosure may be realized by a processor such as a CPU executing a program.

  In addition, the numbers used above are merely examples for specifically describing the present disclosure, and the present disclosure is not limited to the illustrated numbers.

  Further, the order in which the steps shown in the above flowchart are executed is merely an example for specifically describing the present disclosure, and may be any other order as long as a similar effect is obtained. . Also, some of the above steps may be performed simultaneously (in parallel) with other steps.

  Since the information processing method, the information processing apparatus, and the information processing program according to the present disclosure can present an article more suitable for the owner, the information processing method, the information processing apparatus, and the information processing program for presenting information are useful. is there.

REFERENCE SIGNS LIST 1 sensor group 2 equipment group 3 server device 3A first server device 3B second server device 4 network 5 gateway 6 article 10 house 11 first sensor 12 second sensor 21 self-propelled cleaner 22 display device 31, 31A, 31B communication Unit 32, 32A, 32B Processor 33, 33A, 33B Memory 311 Sensor data receiving unit 312 Control information transmitting unit 313 Presentation information transmitting unit 314 User information transmitting unit 315 User information receiving unit 321 Damage detecting unit 322 Damage position specifying unit 323 Equipment control Part 324 Damaged article identification part 325 User identification part 326 Alternative article identification part 327 Presentation information generation part 331 User information storage part 332 Article information storage part

Claims (14)

An information processing method in an information processing device,
Obtaining first information about an object to be suctioned by a self-propelled cleaner;
On the basis of the first information, a first article constituted by the suction target is specified,
Based on the second information on the first article and the third information on the owner of the first article, specify a second article related to the first article,
Outputting fourth information about the specified second article;
Information processing method. The suction target is the damaged first article,
The first information is information on the appearance of the suction target,
The specification of the first article is based on the appearance of the suction target, and specifies the first article.
The information processing method according to claim 1. The information on the appearance includes an image captured by a camera included in the self-propelled cleaner,
The image includes the suction target,
The information processing method according to claim 2. The specification of the first article recognizes the image including the suction target, and specifies the first article from the recognized image.
The information processing method according to claim 3. The second article is the same article as the first article,
The information processing method according to claim 1. The second article is an article having the same attribute as the first article.
The information processing method according to claim 1. The second article has the same attribute as the first article, and is an article of a material having higher strength than the first article.
The information processing method according to claim 1. The third information includes possessed article information indicating a plurality of possessed articles owned by the owner,
The second article is specified by identifying a third article different in type from the first article from among the plurality of owned articles indicated by the owned article information, and identifying a third article that is being sold. From the above, at least one attribute is the same as the specified third article, and a fourth article of the same type as the first article is specified as the second article,
The information processing method according to claim 1. The third information includes house information indicating a position of the house of the owner,
The specification of the second article specifies the second article that can be purchased at a store within a predetermined range from the location of the house indicated by the house information,
The information processing method according to claim 1. Outputting the fourth information, transmitting the fourth information to a display device,
The display device displays the received fourth information in a predetermined mode,
The information processing method according to claim 1. The fourth information includes an object image for ordering the second article,
The information processing method according to claim 10. The specification of the second article specifies a plurality of second articles,
The display device displays the plurality of second articles in a selectable manner.
The information processing method according to claim 10. An acquisition unit configured to acquire first information on a suction target by the self-propelled cleaner;
A first specifying unit that specifies a first article constituted by the suction target object based on the first information;
A second specifying unit that specifies a second article related to the first article based on second information about the first article and third information about an owner of the first article;
An output unit that outputs fourth information about the specified second article;
An information processing apparatus comprising: Obtaining first information about an object to be suctioned by a self-propelled cleaner;
On the basis of the first information, a first article constituted by the suction target is specified,
Based on the second information on the first article and the third information on the owner of the first article, specify a second article related to the first article,
An information processing program for causing a computer to output fourth information on the specified second article.

Images