JP7490347B2 - Tidying up support device, tidying up support program, and tidying up support method - Google Patents

Description

The present invention relates to a tidying up support device, a tidying up support program, and a tidying up support method.

Tidying up toys, clothing, electronic devices, books, stationery, tools, and other items left behind in a room is an essential part of daily life. One example of technology that supports the task of tidying up is the item position estimation device disclosed in Patent Document 1.

This item position estimation device uses item detection time information stored in the item management database and person movement history information stored in the person management database to identify people detected within a specified period of time including the item detection time, and, based on the person movement history information in the people management database, when a person and an item are detected simultaneously by the person detection device and the item detection device, estimates the subsequent movement area of the detected person as the item presence area of the item.

Patent No. 4006471

However, the above-mentioned item position estimation device eliminates the need for users to think back on past memories when searching for an item by estimating the area where the item may be located, and does not assist with the task of putting the item away itself.

The present invention was made in consideration of these circumstances, and aims to provide a tidying up support device, a tidying up support program, and a tidying up support method that can assist with tidying up.

One aspect of the present invention is a tidying support device that includes a data acquisition unit that acquires fixed position data indicating a fixed position of an item, current position data indicating the current position of the item generated using images of the item and the space in which the item is present, and user data indicating the user using the item or owner data indicating the owner of the item, which are generated using images of the item and the user who has used the item ; a tidying necessity determination unit that compares the fixed position data with the current position data to determine whether the current position is different from the fixed position; and a signal output unit that, if it is determined that the current position is different from the fixed position, outputs to an output device a first signal for notifying the user to perform tidying work to put the item away, or a second signal for notifying the owner to perform the tidying work based on the owner data .

One aspect of the present invention is a tidying support device that includes a data acquisition unit that acquires , for each item, fixed position data indicating a fixed position of an item, and current position data that is generated using an image of the item and the space in which the item is present and indicates the current position of the item, and acquires user data indicating the user or owner data indicating the owner of the item, which is generated using an image of the item and a user who has used the item; a tidying necessity determination unit that compares the fixed position data with the current position data and determines for each item whether the current position differs from the fixed position; and a signal output unit that, if it is determined that the current position differs from the fixed position, outputs a signal to a tidying execution device to cause a tidying operation to be performed to tidy up the item, and outputs at least one of a first signal for notifying the user that the tidying operation has been performed or a second signal for notifying the owner that the tidying operation has been performed based on the owner data, and a signal for causing an output device to output information related to the number of the items whose current position differs from the fixed position .

One aspect of the present invention is a tidying support program that has a computer include a data acquisition function that acquires, for each item, fixed position data indicating the fixed position of an item, and current position data that is generated using images of the item and the space in which the item is present and indicates the current position of the item, and acquires user data indicating the user or owner data indicating the owner of the item, which is generated using images of the item and a user who has used the item; a tidying need determination function that compares the fixed position data with the current position data to determine for each item whether the current position differs from the fixed position; and a signal output function that, if it is determined that the current position differs from the fixed position, outputs to an output device at least one of a first signal for notifying the user to perform tidying up the item or a second signal for notifying the owner to perform tidying up based on the owner data, and a signal for causing the output device to output information related to the number of items whose current positions differ from their fixed positions .

One aspect of the present invention is a tidying support program that has a computer implement a data acquisition function that acquires, for each item, fixed position data indicating the fixed position of an item , and current position data that is generated using an image of the item and the space in which the item is present and indicates the current position of the item, and acquires user data indicating the user or owner data indicating the owner of the item, which is generated using an image of the item and a user who has used the item; a tidying up necessity determination function that compares the fixed position data with the current position data and determines for each item whether the current position differs from the fixed position; and a signal output function that, if it is determined that the current position differs from the fixed position, outputs a signal to a tidying up execution device to cause the owner to perform a tidying up task of putting the item away, and outputs at least one of a first signal for notifying the owner to perform the tidying up task based on the owner data or a second signal for notifying the owner that the tidying up task has been performed based on the owner data, and a signal for causing an output device to output information related to the number of the items whose current positions are different from the fixed positions.

One aspect of the present invention is a tidying support method including: a data acquisition step in which a tidying support device acquires fixed position data indicating a fixed position of an item ; acquires, for each item, current position data indicating a current position of the item, which is generated using an image of the item and the space in which the items are present, and acquires user data indicating the user or owner data indicating the owner of the item, which is generated using an image of the item and a user who has used the item; a tidying need determination step in which the tidying support device compares the fixed position data with the current position data to determine for each item whether the current position differs from the fixed position; and a signal output step in which, if it is determined that the current position differs from the fixed position, the tidying support device outputs to an output device at least one of a first signal for notifying the user to perform a tidying task of putting the item away or a second signal for notifying the owner to perform the tidying task based on the owner data, and a signal for causing the output device to output information related to the number of the items whose current positions are different from the fixed positions .

The present invention provides a tidying up support device, a tidying up support program, and a tidying up support method that can assist in tidying up.

FIG. 1 is a diagram illustrating an example of a tidying support system according to an embodiment of the present invention. FIG. 4 is a diagram showing an example of item-related data generated by a data generating unit according to the embodiment of the present invention. 10 is a diagram showing an example of resident-related data generated by a data generating unit according to an embodiment of the present invention. FIG. FIG. 11 is a diagram showing an example of tidying-up related data generated by a data generating unit according to the embodiment of the present invention. 4 is a flowchart illustrating an example of a process executed by the tidying up support device according to the embodiment of the present invention.

[Embodiment]
Fig. 1 is a diagram showing an example of a tidying up support system according to an embodiment of the present invention. As shown in Fig. 1, the tidying up support system 1 includes a data collection device 10, a data storage device 20, a tidying up support device 30, an output device 40, and a tidying up execution device 50. The data collection device 10, the data storage device 20, the tidying up support device 30, the output device 40, and the tidying up execution device 50 are connected to each other by a network NW. The network NW is, for example, a wide area network (WAN), a local area network (LAN), the Internet, or an intranet.

The data collection device 10 includes an imaging unit 11, an image analysis unit 12, an input reception unit 13, and a data generation unit 14.

The photographing unit 11 is a camera that photographs images of objects and the space in which the objects exist, and generates a first object/space image and a second object/space image. The objects referred to here are, for example, toys, clothing, accessories, electronic devices, books, stationery, tools, and trash. The spaces referred to here are, for example, rooms, entrances, hallways, kitchens, bathrooms, washrooms, balconies, terraces, verandas, warehouses, and garages in the house in which the user of the tidying support system 1 resides.

The first item/space image is an image taken in a state where all items in the space have been put away, and is taken before the second item/space image is taken. Tidying up here means storing items in a fixed position designated as a position where the items should be stored, or in a specified position different from the fixed position. The fixed position is the position where each item should originally be stored. Fixed positions include, for example, shelves, boxes, tables, etc. shared by residents, or baskets, desks, cabinets, etc. that are private to each resident. Fixed positions may also include wastebaskets. A unique space is a space that each resident of the above-mentioned house uses preferentially over other residents, such as a room, desk, or basket that is private to each resident. A single resident may have multiple unique spaces. A unique space is an example of a specified position different from a fixed position, and may change due to moving, rearranging, etc.

On the other hand, the second object/space image is an image taken when at least one of the objects in the space has not been put away. The timing at which the second object/space image is taken is not particularly limited, but may be preferably the time when the occupants of the house are scheduled to return home, the time when the occupants of the house start eating, or a time a predetermined time earlier than these times.

The image capturing unit 11 also captures images of residents residing in the above-mentioned house to generate a resident image. Furthermore, the image capturing unit 11 captures images of items and people using the items to generate a user image.

The first item/space image, the second item/space image, the resident image, and the user image may be still images or images constituting a video. The image capturing unit 11 may be fixed to a predetermined position inside or outside the above-mentioned space, or may be attached to a robot that moves within the above-mentioned space. Furthermore, the image capturing unit 11 may switch the range of images captured at any timing.

The image analysis unit 12 executes a process to recognize the items depicted in the first item/space image and the fixed positions of the items. The image analysis unit 12 also executes a process to recognize the items depicted in the second item/space image and the current positions of the items. The image analysis unit 12 also executes a process to recognize the resident depicted in the resident image. The image analysis unit 12 also executes a process to recognize the user depicted in the user image.

The image analysis unit 12 may execute these four processes by image recognition using machine learning. Specifically, the image analysis unit 12 performs preprocessing on the four types of images described above. The preprocessing here includes, for example, removing noise, removing distortion, emphasizing the contours of objects depicted in the image, and adjusting the brightness and color of the image. The image analysis unit 12 then reads the preprocessed image into a machine learning device that has learned by reinforcement learning, supervised learning, or unsupervised learning, and causes the device to recognize the objects depicted in the image. The machine learning here includes, for example, neural networks and deep learning, and in particular, a convolutional neural network (CNN) is suitable for executing image recognition.

The input reception unit 13 receives information input using a keyboard, mouse, etc. connected to the data collection device 10. This information may be, for example, information indicating the name of an item, the name of a fixed position, the name of a resident, or the name of the resident's unique space, or may be other information.

The data generation unit 14 generates item-related data, resident-related data, and tidying-related data using the results of the processing performed by the image analysis unit 12 and the information received by the input reception unit 13.

2 is a diagram showing an example of item-related data generated by a data generating unit according to an embodiment of the present invention. The item-related data is data indicating, for each item, item identification information, item name, item image, fixed position identification information, name of the fixed position, current position coordinates, and the date and time when the current position coordinates were updated. The item-related data identifies each item by the item identification information, item name, and item image, identifies the fixed position of each item by the fixed position identification information and name of the fixed position, and identifies the current position of each item by the current position coordinates. The item identification information is a unique code assigned to each item. The fixed position identification information is a unique code assigned to the fixed position of each item, and is associated with the fixed position coordinates indicating the position of the fixed position. The item identification information and the fixed position identification information are both expressed by a combination of letters, numbers, symbols, etc. The date and time when the current position coordinates were updated is, for example, the date and time when the current position of the item was recognized when the shooting unit 11 shoots a video as a second item/space image and the image analysis unit 12 executes a process of recognizing the current position of the item in real time from the images constituting the video.

After the input receiving unit 13 receives information indicating the item name, the item identification information may be automatically generated based on the information, or may be input using a keyboard or the like connected to the data collection device 10. The item name is input using a keyboard or the like connected to the data collection device 10. The image of the item is an image extracted from the first item/space image by the data generating unit 14 based on the result of image recognition performed by the image analyzing unit 12 on the first item/space image. However, the image of the item may also be an image extracted from an image other than the first item/space image based on the result of image recognition performed on the image.

The fixed position identification information may be automatically generated based on the information after the input reception unit 13 receives information indicating the fixed position, or may be input using a keyboard or the like connected to the data collection device 10. The name of the fixed position is input using a keyboard or the like connected to the data collection device 10. The current position coordinates are calculated by the data generation unit 14 using the results of image recognition performed by the image analysis unit 12 on the second item/space image. The date and time when the current position coordinates are updated may be automatically generated after the current position coordinates are calculated by the data generation unit 14, or may be input using a keyboard or the like connected to the data collection device 10.

As shown in the first line from the top of FIG. 2, if the item is a radio-controlled car, the item-related data includes item identification information "B001", item name "radio-controlled car", image data of the item "radio-controlled car.image", localization identification information "T001", name of the fixed location "toy box", coordinates of the current location "X1, Y1, Z1", and date and time when the current location coordinates were updated "20** year, month, day, hour, minute". Similarly, as shown in the second line from the top of FIG. 2, if the item is a stuffed teddy bear, the item-related data includes item identification information "B002", item name "stuffed teddy bear", image data "stuffed teddy bear.image", localization identification information "T002", name of the fixed location "toy box", coordinates of the current location "X2, Y2, Z2", and date and time when the current location coordinates were updated "20** year, month, day, hour, minute".

Figure 3 is a diagram showing an example of resident-related data generated by a data generation unit according to an embodiment of the present invention. The resident-related data is data indicating, for each resident, the resident identification information, the resident name, an image of the resident, unique space identification information, and the name of the resident's unique space. The resident-related data identifies each resident by the resident identification information, the resident name, and an image of the resident, and identifies each resident's unique space by the unique space identification information and the name of the resident's unique space. The resident-related data may also be managed separately into data identifying each resident and data identifying the unique space. The resident identification information is a unique code assigned to each resident, and is represented by a combination of letters, numbers, symbols, etc.

The resident identification information may be automatically generated based on information indicating the resident name after the input receiving unit 13 receives the information, or may be input using a keyboard or the like connected to the data collection device 10. The resident name is input using a keyboard or the like connected to the data collection device 10. The resident image is an image extracted from the resident image by the data generation unit 14 based on the result of image recognition performed on the resident image by the image analysis unit 12. There are few cases in which the resident identification information, resident name and resident image need to be changed due to moving, rearranging, etc.

The unique space identification information may be automatically generated based on information indicating the name of the resident's unique space after the input receiving unit 13 receives the information, or may be input using a keyboard or the like connected to the data collection device 10. The name of the resident's unique space is input using a keyboard or the like connected to the data collection device 10. In addition, the unique space identification information and the name of the resident's unique space are updated when the unique space is changed due to moving, rearranging, etc.

As shown in the first line from the top of FIG. 3, when the resident is a school-age child "XXXX Taro," the resident-related data includes resident identification information "K001," resident name "XXXX Taro," resident image data "XXXX Taro.image," unique space identification information "S001," and the name of the resident's unique space "study desk." Similarly, as shown in the second line from the top of FIG. 3, when the resident is a toddler "XXXX Hanako," the resident-related data includes resident identification information "K002," resident name "XXXX Hanako," resident image data "XXXX Hanako.image," unique space identification information "S002," and the name of the resident's unique space "toy box."

Note that, although an example has been described in which the data generation unit 14 generates resident-related data relating to the schoolchild "〇〇 Taro" and the toddler "〇〇 Hanako" shown in FIG. 3, the present invention is not limited to this. For example, the data generation unit 14 may generate resident-related data relating to residents other than schoolchildren and toddlers. Furthermore, when multiple unique spaces exist for one resident, the data generation unit 14 may generate resident-related data that includes multiple unique space information and names of the resident's unique spaces for the resident identification information, resident name, and resident image of the resident.

Figure 4 is a diagram showing an example of tidying-related data generated by the data generation unit in an embodiment of the present invention. The tidying-related data is data in which, for example, the date and time when the user of the item was identified, item identification information, fixed position identification information, fixed position identification information flag, current position coordinates, the user of the item, the user who last used the item, and the owner of the item are associated with each owner. The tidying-related data identifies the user of the item, the user who last used the item, and the owner of the item, and associates them with the fixed position and current position of the item.

The date and time when the user of the item is identified may be generated automatically after the name of the user of the item and the name of the user who last used the item are identified by the data generation unit 14, or may be input using a keyboard or the like connected to the data collection device 10. The fixed position identification information flag is a binary number indicating the area in the memory area of the data storage device 20 in which the fixed position identification information is stored, and is automatically generated depending on whether the fixed position identification information is in a fixed position or not after the fixed position identification information is generated. The name of the user of the item and the name of the user who last used the item are identified by the data generation unit 14 based on the result of comparing the result of the image recognition performed by the image analysis unit 12 on the resident image with the resident image shown in FIG. 3. The name of the owner of the item may be generated automatically or may be input using a keyboard or the like connected to the data collection device 10. Note that the tidying-up related data does not have to include fixed position identification information.

As shown in the first line from the top of Figure 4, in the case where the item is a radio-controlled model car, the tidying-up related data is data that associates the date and time when the user of the item was identified (20** year x month x day x hour x minute), item identification information (B001), fixed location identification information (T001), fixed location information identification flag (***0), current location coordinates (X1, Y1, Z1), the name of the user of the item (X〇 Taro), the name of the user who last used the item (X〇 Taro), and the name of the owner of the item (X〇 Taro). Similarly, as shown in the second line from the top in Figure 4, when the item is a teddy bear, the tidying-related data is data that associates the date and time when the user of the item was identified (20** year ◇ month ◇ day ◇ hour ◇ minute), item identification information "B002", fixed location identification information "T002", fixed location information identification flag "***1", current location coordinates "X2, Y2, Z2", the name of the user of the item "XX Hanako", the name of the user who last used the item "XX Taro", and the name of the owner of the item "XX Hanako".

The data generation unit 14 stores the item-related data, resident-related data, and tidying-related data in the data storage device 20.

The data storage device 20 stores the item-related data, resident-related data, and tidying-related data generated by the data generation unit 14. The data storage device 20 is, for example, a hard disk drive (HDD), a flash memory, a random access memory (RAM), or a read only memory (ROM).

The tidying support device 30 includes a data acquisition unit 31, a tidying necessity determination unit 32, and a signal output unit 33.

The data acquisition unit 31 acquires fixed position data indicating the fixed position of the item. This fixed position data is, for example, the fixed position identification information shown in Figures 2 and 4. The data acquisition unit 31 also acquires current position data indicating the current position of the item. This current position data is, for example, the current position coordinates shown in Figures 2 and 4.

Furthermore, the data acquisition unit 31 may acquire user data indicating the user of the item. This user data is resident identification information assigned to a resident with the same name as the user name of the item shown in FIG. 4 or the name of the user who last used the item. The data acquisition unit 31 may also acquire owner data indicating the owner of the item. This owner data is, for example, resident identification information assigned to a resident with the same name as the owner name of the item shown in FIG. 4.

The tidying up necessity determination unit 32 compares the fixed position data with the current position data to determine whether the current position is different from the fixed position. For example, if the current position coordinates do not match the fixed position coordinates associated with the fixed position identification information within a specified range, the tidying up necessity determination unit 32 determines that the current position of the item is different from the item's fixed position. On the other hand, if the current position coordinates match the fixed position coordinates associated with the fixed position identification information within a specified range, the tidying up necessity determination unit 32 determines that the current position of the item is equal to the item's fixed position.

When the signal output unit 33 determines that the current position is different from the home position, it outputs a signal to the output device 40 to notify the user to perform the tidying up work to put away the items. This signal is, for example, a signal that causes the output device 40 to display a text string, image, video, etc., that prompts the user to perform the tidying up work, or causes the output device to output a voice guide, alarm, etc., that prompts the user to perform the tidying up work.

When it is determined that there is no fixed position, the signal output unit 33 may output a signal to the output device 40 to notify the user to perform tidying up the item. A case in which there is no fixed position may be when the item is trash. Furthermore, the signal output unit 33 may output a signal to the output device based on user data to notify the user to perform tidying up. Alternatively, the signal output unit 33 may output a signal to the output device based on owner data to notify the owner to perform tidying up.

Furthermore, when it is determined that the current position is different from the home position, the signal output unit 33 may output a signal to the tidying up execution device 50 to execute a tidying up task. This signal is a signal that controls each part of the tidying up execution device 50.

At least a part of the tidying support device 30 may be included in a server or the like connected to the network NW shown in FIG. 1, or may be installed inside or near the house where the user of the tidying support system 1 resides.

The output device 40 is a device that notifies the user or owner of the item to perform tidying up work based on the signal input by the signal output unit 33, and is, for example, a display or a speaker.

The tidying up execution device 50 is a robot that performs tidying up work on behalf of the user or owner of an item, etc., based on a signal input by the signal output unit 33. Note that any configuration may be adopted for the tidying up execution device 50 as long as it is capable of performing tidying up work.

Next, an example of the process executed by the tidying support device 30 will be described with reference to FIG. 5. FIG. 5 is a flowchart showing an example of the process executed by the tidying support device according to an embodiment of the present invention. The process shown in FIG. 5 is executed for each item.

In step S10, the data acquisition unit 31 acquires fixed position data indicating the fixed position of the item, and acquires current position data indicating the current position of the item, which is generated using images captured of the item and the space in which the item exists.

In step S20, the tidying necessity determination unit 32 determines whether the current position indicated by the current position data acquired in step S10 is different from the fixed position indicated by the fixed position data acquired in step S10. If the tidying necessity determination unit 32 determines that the current position is different from the fixed position (step S20: YES), the process proceeds to step S30. On the other hand, if the tidying necessity determination unit 32 determines that the current position is equal to the fixed position (step S20: NO), the process ends.

In step S30, the signal output unit 33 outputs a signal to the output device 40 to notify the user to perform the tidying up task of putting the items away.

In addition, in step S30 described above, the tidying support device 30 may output a signal to the tidying execution device 50 to cause the tidying task of putting away items to be performed, instead of outputting a signal to the output device 40 to notify the user to perform the tidying task of putting away items.

When the process shown in FIG. 5 is performed for multiple items, the signal output unit 33 may output a signal to cause the output device 40 to output information related to the number of items whose current location is different from the fixed location for each user or owner of the item. Such information is, for example, the number or percentage of items whose current location does not match the fixed location. Alternatively, when the process shown in FIG. 5 is performed for multiple items, the signal output unit 33 may output a signal to cause the output device 40 to output information indicating a value obtained by dividing the period during which at least one item whose current location does not match the fixed location existed by a predetermined period for each user or owner of the item. Furthermore, the predetermined period may be, for example, a period during which the above-mentioned second item/space image can be captured, or a fixed period such as one day, one week, or one month.

The tidying up support device 30 according to the embodiment has been described above. When the tidying up support device 30 determines that the current position is different from the designated position, it outputs a signal to the output device 40 to notify the user to perform the tidying up task of putting the items away. In this way, the tidying up support device 30 can notify the user that the items are not stored in the designated position and support the user in putting the items away. For example, the tidying up support device 30 can encourage the residents of a home, particularly school children and infants, to tidy up and help them learn how to tidy up.

The tidying support device 30 also uses the fixed position data generated from the first item/space image and the current position data generated from the second item/space image to determine whether the current position of the item matches the fixed position. This allows the tidying support device 30 to reduce the effort required by the resident of the home to determine whether each item is stored in its fixed position, even if the position of each item frequently changes.

The tidying support device 30 may output a signal to the output device 40 to notify the user to perform tidying up, based on the user data. This allows the tidying support device 30 to make the person who actually uses the item and is appropriate to perform the tidying up of the item recognize that the tidying up of the item is necessary, and urge them to perform the tidying up of the item. Furthermore, the tidying support device 30 may output a signal to the output device 40 to notify the user who last used the item to perform tidying up. In this case, the tidying support device 30 can make the person who is considered most appropriate to perform the tidying up of the item recognize that the tidying up of the item is necessary, and urge them to perform the tidying up of the item.

Based on the owner data, the tidying support device 30 may output a signal to the output device 40 to notify the owner to perform tidying work. In this way, the tidying support device 30 can make a person who actually owns the item and is appropriate to tidy up the item recognize that tidying up the item is necessary and urge them to tidy up the item. In particular, it is preferable for the tidying support device 30 to perform such processing when the item is shared among residents of a house.

Alternatively, when the tidying support device 30 determines that the current position is different from the fixed position, it may output a signal to the tidying execution device 50 to execute the tidying work. In this way, when a user of an item, an owner of an item, a resident of a house, etc. is unable to tidy up the item due to circumstances, the tidying support device 30 can cause the tidying execution device 50 to execute the tidying up of the item on behalf of these people.

The tidying support device 30 may also output a signal to cause the output device 40 to output information related to the number of items whose current location is different from the designated location for each user or owner of the item. Alternatively, the tidying support device 30 may output a signal to cause the output device 40 to output information indicating a value obtained by dividing the period during which there was at least one item whose current location is different from the designated location for each user or owner of the item by a predetermined period. In this way, the tidying support device 30 can report information that quantitatively indicates the degree to which tidying work is being performed, and can inspire users or owners of the items to tidy up together.

At least some of the functions of the data collection device 10 or the tidying support device 30 may be realized by hardware including a circuit section (circuitry) executing a program. The hardware referred to here is, for example, a CPU (Central Processing Unit), an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a GPU (Graphics Processing Unit). The above-mentioned program is stored in a storage device having a storage medium. The storage medium referred to here is, for example, a HDD, a flash memory, or a ROM. Furthermore, the above-mentioned program may be a differential program that realizes some of the functions of the data collection device 10 or the tidying support device 30.

The above describes an embodiment of the present invention with reference to the drawings. However, the tidying support system 1 is not limited to the above-described embodiment, and various modifications, substitutions, combinations, or design changes can be made without departing from the spirit of the present invention.

1... Tidying up support system, 10... Data collection device, 11... Photography unit, 12... Image analysis unit, 13... Input reception unit, 14... Data generation unit, 20... Data storage device, 30... Tidying up support device, 31... Data acquisition unit, 32... Tidying up necessity determination unit, 33... Signal output unit, 40... Output device, 50... Tidying up execution device

Claims (16)

a data acquisition unit that acquires, for each of the items, fixed position data indicating a fixed position of the item, current position data indicating a current position of the item, which is generated using an image of the item and a space in which the item is present, and user data indicating the user using the item or owner data indicating the owner of the item, which is generated using an image of the item and a user using the item ;
a tidying necessity determination unit that compares the fixed position data with the current position data and determines for each of the items whether the current position is different from the fixed position;
a signal output unit that outputs, when it is determined that the current position is different from the fixed position, at least one of a first signal for notifying the user to perform a tidying up task of putting away the items or a second signal for notifying the owner to perform the tidying up task based on the owner data, and a signal for causing the output device to output information related to the number of the items at which the current position is different from the fixed position ;
A cleaning assistance device comprising: The data acquisition unit acquires the user data indicating the user who last used the item.
The tidying-up assistance device according to claim 1. The signal output unit outputs the signal for causing the output device to output information related to the number of the articles whose current positions are different from the home positions for each of the users.
The tidying support device according to claim 1 or 2. the signal output unit further outputs a signal for causing the output device to output information indicating a value obtained by dividing a period during which at least one of the articles was present and the current position of the article was different from the home position for each of the users by a predetermined period.
The tidying support device according to claim 1 or 2. the signal output unit outputs the signal for causing the output device to output information related to the number of the articles whose current positions are different from the home positions for each of the owners.
The tidying-up assistance device according to claim 1. the signal output unit further outputs a signal for causing the output device to output information indicating a value obtained by dividing a period during which at least one of the articles, the current position of which is different from the home position, exists for each of the owners by a predetermined period.
The tidying-up assistance device according to claim 1. The tidying up work is a work of storing the items in the designated positions.
The tidying support device according to any one of claims 1 to 6. The tidying up work is a work of storing the item in a predetermined position different from the fixed position.
The tidying support device according to any one of claims 1 to 7. a data acquisition unit that acquires, for each item, fixed position data indicating a fixed position of the item and current position data that is generated using an image of the item and a space in which the item is present and indicates a current position of the item, and acquires user data indicating the user who has used the item or owner data indicating the owner of the item, that is generated using an image of the item and a user who has used the item;
a tidying necessity determination unit that compares the fixed position data with the current position data and determines for each of the items whether the current position is different from the fixed position;
a signal output unit which, when it is determined that the current position is different from the fixed position, outputs a signal to a tidying up execution device to execute a tidying up task of putting the items away, and outputs at least one of a first signal for notifying the user that the tidying up task has been executed or a second signal for notifying the owner that the tidying up task has been executed based on the owner data, and a signal for outputting information related to the number of the items at which the current position is different from the fixed position to an output device ;
A cleaning assistance device comprising: The signal output unit outputs the signal for causing an output device to output information related to the number of the articles whose current positions are different from the home positions for each user who has used the article or for each owner of the article.
The tidying-up assistance device according to claim 9. the signal output unit further outputs a signal for causing an output device to output information indicating a value obtained by dividing a period during which at least one of the articles, the current location of which is different from the home location, was present, for each user who used the article or each owner of the article, by a predetermined period.
The tidying-up assistance device according to claim 9. The tidying up work is a work of storing the items in the designated positions.
The tidying support device according to any one of claims 9 to 11. The tidying up work is a work of storing the item in a predetermined position different from the fixed position.
The tidying support device according to any one of claims 9 to 11. On the computer,
a data acquisition function for acquiring, for each item, fixed position data indicating a fixed position of the item and current position data indicating a current position of the item, which is generated using an image of the item and a space in which the item is present, and acquiring user data indicating the user who has used the item or owner data indicating the owner of the item, which is generated using an image of the item and a user who has used the item;
a tidying up necessity determination function for determining whether or not the current position differs from the fixed position for each of the items by comparing the fixed position data with the current position data;
a signal output function for outputting, when it is determined that the current position is different from the fixed position, at least one of a first signal for notifying the user to perform a tidying up task of putting away the items or a second signal for notifying the owner to perform the tidying up task based on the owner data, and a signal for outputting information related to the number of the items at which the current position is different from the fixed position to the output device ;
A tidying up support program that makes this a reality. On the computer,
a data acquisition function for acquiring, for each item, fixed position data indicating a fixed position of the item and current position data indicating a current position of the item, which is generated using an image of the item and a space in which the item is present, and acquiring user data indicating the user who has used the item or owner data indicating the owner of the item, which is generated using an image of the item and a user who has used the item;
a tidying up necessity determination function for determining whether or not the current position differs from the fixed position for each of the items by comparing the fixed position data with the current position data;
a signal output function for outputting, when it is determined that the current position is different from the fixed position, a signal for executing a tidying up task of putting the items away to a tidying up execution device, and outputting at least one of a first signal for notifying the owner to execute the tidying up task based on the owner data or a second signal for notifying the owner that the tidying up task has been completed based on the owner data, and a signal for outputting information related to the number of the items at which the current position is different from the fixed position to an output device ;
A tidying up support program that makes this a reality. a data acquisition step in which the tidying support device acquires fixed position data indicating a fixed position of an item , acquires current position data indicating a current position of the item for each of the items, the current position data being generated using an image of the item and the space in which the items are present, and acquires user data indicating the user or owner data indicating the owner of the item, the current position data being generated using an image of the item and a user who has used the item;
a tidying up necessity determination step in which the tidying up support device compares the fixed position data with the current position data to determine whether the current position is different from the fixed position for each of the items ;
a signal output step of outputting to an output device, when the tidying support device determines that the current position is different from the fixed position, at least one of a first signal for notifying the user to perform a tidying task of putting the items away or a second signal for notifying the owner to perform the tidying task based on the owner data , and a signal for outputting to the output device information related to the number of the items at which the current position is different from the fixed position;
This includes methods to help with tidying up.

Images