JP2021134040A - Information processing device, information processing method and program - Google Patents

Abstract

To improve the convenience of forgetting to take out a stored article from a storage shelf.SOLUTION: An information processing device comprises: an acquisition unit which acquires a photographed image obtained by imaging a storage shelf having a plurality of storage parts; and a setting unit which calculates an amount of stored articles stored in the storage parts on the basis of the photographed image, sequentially adds the amount of stored articles for each storage part in the order according to a prescribed work order performed to the plurality of storage parts, and sets the storage part or subsequent ones whose total value exceeds a prescribed value as a non-object of notification of forgetting to take out stored articles.SELECTED DRAWING: Figure 1

Description

The present invention relates to an information processing device, an information processing method, and a program.

In recent years, work using storage shelves having a plurality of storage units has been performed in various situations. It is possible to store an object related to work in each of the plurality of storage units. In addition, the object stored in each of the plurality of storage units is taken out by the operator as needed. For example, in Patent Document 1 below, in the mail delivery business, the pre-work of mail delivery using the shelves is performed manually by the worker.

Further, in Patent Document 2 below, as a technique related to parts assembly work, a storage shelf having a plurality of storage units is used as a parts warehouse, and information instructing an assembly procedure and parts to be collected is transmitted to a predetermined member of the storage shelf by a projector. The technique of projection is disclosed.

Further, Patent Document 3 below discloses a technique in which when all the postcards are taken out from the sorting box, the lamp provided on the upper part of the sorting box to be taken out next lights up.

Further, regarding the technique of notifying the forgetting to take the object from the device, for example, in Patent Document 4 below, as a technique of detecting the forgetting to pick up the change in the coin processing machine, an image of an empty change tray and a change tray are provided. A technique for determining the presence or absence of residual change by comparing with the current image of the above and notifying the display unit is disclosed. Further, Patent Document 5 below discloses a technique for notifying a registered handy terminal (information processing terminal possessed by a clerk) when a forgotten document is detected in a multifunction device.

Japanese Unexamined Patent Publication No. 2005-288240 JP-A-2018-45669 Japanese Unexamined Patent Publication No. 10-192789 Japanese Unexamined Patent Publication No. 2008-97260 Japanese Unexamined Patent Publication No. 2018-128989

Here, in the work of taking out an object from the storage shelf described above, depending on the amount of the object, the worker may take out only a part of the object without taking out all the objects from the storage shelf and move to the next work process. There is. However, in a system that detects forgetting to remove an object based on the presence or absence of residual object, it is difficult to appropriately determine whether the object left on the storage shelf is forgotten to be removed or intentionally left behind.

Therefore, the present invention has been made in view of the above problems, and an object of the present invention is a new and improved method capable of further improving the convenience of notifying that a stored item has been forgotten to be taken out from a storage shelf. The purpose is to provide information processing devices, information processing methods, and programs.

In order to solve the above problems, according to a certain viewpoint of the present invention, an acquisition unit that acquires an image of a storage shelf having a plurality of storage units and a storage unit that is stored in the storage unit based on the captured image. The amount of stored items is calculated, and the amount of the stored items is sequentially added to each of the storage units in the order according to a predetermined work order performed on the plurality of storage units, and the total value is calculated. An information processing device is provided that includes a storage unit that exceeds a predetermined value and a setting unit that sets the storage unit and subsequent units as non-targets for notification of forgetting to take out stored items.

After the predetermined work is completed, the information processing device forgets to take out the stored item for the worker when the stored item remains in the storage part other than the storage part set as a non-target for the notification of forgetting to take out the stored item. A notification control unit that controls to notify the information may be further provided.

The notification control unit compares the captured image obtained by capturing the empty state of the storage shelf with the captured image obtained by capturing the image of the storage shelf after the completion of the predetermined work, and detects the difference, and the difference is detected. In some cases, it may be determined that the stored items remain.

The information processing device transmits to the administrator terminal that the amount of the stored items stored in the storage shelf exceeds a predetermined value when the non-target setting for forgetting to take out the stored items is set. Further units may be provided.

The predetermined value may be a value of an amount that can be worked in the predetermined work.

The stored items stored in the storage shelf may be mail items.

The predetermined work order may be the order in which the mail items are collected from the storage unit according to the actual delivery route.

The predetermined value may be an allowable amount in the delivery of the mail.

The information processing device may control the storage shelves to display a display indicating a storage unit for which the notification of forgetting to take out stored items is not targeted.

Further, in order to solve the above problems, according to another aspect of the present invention, the processor acquires an image of a storage shelf having a plurality of storage units, and based on the captured image, the above-mentioned image is obtained. The amount of stored items stored in the storage unit is calculated, and the amount of the stored items is sequentially added to each of the storage units in an order according to a predetermined work order performed on the plurality of storage units. An information processing method is provided, which includes setting a storage unit and subsequent units whose total value exceeds a predetermined value as non-targets for notification of forgetting to take out stored items.

Further, in order to solve the above-mentioned problems, according to another viewpoint of the present invention, a computer is based on an acquisition unit that acquires an image of a storage shelf having a plurality of storage units and an image taken from the image. The amount of stored items stored in the storage unit is calculated, and the amount of the stored items is sequentially added to each of the storage units in an order according to a predetermined work order performed on the plurality of storage units. A program is provided for functioning as a setting unit for setting the storage unit and subsequent units whose total value exceeds a predetermined value as non-targets for the notification of forgetting to take out stored items.

As described above, according to the present invention, it is possible to further improve the convenience of notifying that a stored item has been forgotten to be taken out from the storage shelf.

It is a figure which shows an example of the structure of the work support system which concerns on this embodiment. It is a figure which shows an example of the structure of the information processing system including the control terminal and the administrator terminal by this embodiment. It is a figure which shows the functional structure example of the control terminal by this embodiment. It is a figure which shows an example of the reference image which image | imaged the state which all the storage parts are empty by this Embodiment. It is a figure which shows an example of the captured image which imaged the state which the mail matter was stored in the storage part by this Embodiment. It is a flowchart which shows an example of the flow of the forgotten take-out notification processing by this embodiment. It is a flowchart which shows an example of the flow of the operation process at the time of setting for forgetting to take out by this embodiment. It is a block diagram which shows an example of the hardware composition of the information processing apparatus which embodies the work support system which concerns on this embodiment.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the present specification and the drawings, components having substantially the same functional configuration are designated by the same reference numerals, so that duplicate description will be omitted.

<1. About work using storage shelves>
In recent years, work using storage shelves having a plurality of storage units has been performed in various situations. It is possible to store an object related to work in each of the plurality of storage units. In addition, the object stored in each of the plurality of storage units is taken out by the operator as needed. For example, as described in Patent Document 1 above, in the mail delivery business, the pre-work of mail delivery using the shelves is performed manually by the worker. At this time, the mail corresponds to an example of an object related to work.

Preliminary work for mail delivery using shelves is performed according to the following procedures 1 to 3.
-Procedure 1 ... Multiple mail items are collected for each destination corresponding to the same direction and stored in the corresponding storage unit (sorting work).
-Procedure 2: Take out the mail from the storage section, sort it in the order of the actual delivery route, and return it to the storage section (sorting work).
-Procedure 3 ... Mail is taken out from a plurality of storage units according to the actual delivery route order and loaded into a carry box or the like used at the time of delivery (collection work for delivery).

Here, the destinations corresponding to the same direction may include destinations having the same or similar directions with respect to the departure point of delivery (note that the similar range is not particularly limited). In the shelves used for work, each of the plurality of storage units is associated with a direction, and in "Procedure 1", the worker stores each of the plurality of mail items (corresponding to the direction to which the destination corresponds). Store in. As a result, a plurality of mail items are grouped according to the destination corresponding to the same direction.

For "Procedure 2", it is also referred to as "delivery ledger (for sorting)" including information in which destinations are arranged in the order of delivery routes corresponding to each storage unit (each direction). ) Is prepared in advance. While referring to the delivery ledger, the worker takes out the mail stored in the storage section, sorts it in the order of the delivery route, and then returns the sorted mail to the original storage section. Perform this sequentially for all the storage units. Such mail sorting work is also called "direction assembly work".

Further, for "Procedure 3", the order information including the information in which the directions are arranged in the order of the delivery route (hereinafter, also referred to as "delivery ledger (for loading)". Such delivery ledger is referred to as the above-mentioned "delivery ledger". The original book (which may be the original book containing the information of "original book (for sorting)") is prepared in advance. A worker (for example, a delivery person) takes out the mail stored in the storage unit and loads it into a carry box or the like in the order of the delivery route while referring to the delivery ledger. For example, when viewed from the front of the carry box, the mail items taken out from the storage unit are loaded as they are (without changing the order) in order from the front side, so that the specified (delivery target) mail items can be delivered in order from the front side at the time of delivery. It can be taken out and work efficiency is improved.

When loading into such a carry box or the like, the mail is the capacity of the carry box or the like (that is, the delivery capacity. In the case of a transport vehicle that can load a large number of carry boxes, the upper limit of the load capacity of the transport vehicle is used. Since it can only be loaded within (may), mail may remain (dare to be left) on the storage shelf. On the other hand, there may be a mistake that the mail that must be loaded is left behind on the storage shelf.

However, with a system that simply detects forgotten items based on the presence or absence of residual mail, it is difficult to properly determine whether the object left on the storage shelf is forgotten or intentionally left behind. rice field.

In the following, the technology that makes it possible to further improve the convenience of notifying that a stored item has been forgotten to be taken out from the storage shelf will be mainly described. More specifically, in the embodiment of the present invention, a technique for appropriately setting a storage unit that is not subject to forgetting to take out according to the amount of stored items and appropriately notifying the forgetting to take out after the removal (collection) operation will be described. do.

In the following, a case where a mail item is used as an example of the stored item will be described. However, the work support system according to this embodiment is not limited to the work support for mail, and the work for parts and luggage (sorting and sorting work according to the assembly order of parts, sorting and sorting according to the distribution order of luggage). Work, etc.) may be supported. Further, the configuration of the shelf provided with the plurality of storage units may be appropriately changed according to the type of work.

<2. System configuration example>
FIG. 1 is a diagram showing an example of the configuration of the work support system 10 according to the present embodiment. As shown in FIG. 1, the work support system 10 according to the present embodiment includes a control terminal 11 (information processing device), a shelf 12 (also referred to as a storage shelf), a work table 13, a sensor unit 14, and a display unit 15. And a mirror 18. As an example, the work support system 10 is installed at a place where route assembly work is performed (for example, a post office). The work support system 10 presents various information to the worker who performs the route assembly work to support the route assembly work.

As shown in FIG. 1, in the present specification and the drawings, the direction from the shelf 12 to the workbench 13 is the forward direction, and the opposite direction is the rearward direction. The directions are upward, downward, left, and right, respectively.

Further, the control terminal 11 that controls the overall operation of the work support system 10 can be connected to the administrator terminal 30 operated by the administrator by communication or wirelessly. FIG. 2 is a diagram showing an example of the configuration of the information processing system 1 including the control terminal 11 and the administrator terminal 30 according to the present embodiment. As shown in FIG. 2, one or more control terminals 11 can communicate with the administrator terminal 30 via the network 40 to transmit and receive data.

Hereinafter, each configuration of the work support system 10 and the administrator terminal 30 for communication connection with the control terminal 11 included in the work support system 10 will be sequentially described.

(2-1. Shelf 12)
The shelf 12 functions as a storage shelf. The shelf 12 includes a plurality of storage units 121. In the example shown in FIG. 1, a total of 16 storage units 121 are provided on the shelf 12, with four stages in the vertical direction and four rows in the horizontal direction. However, the number of storage units 121 provided on the shelf 12 is not limited, and may be 30 or 50. The worker can put his / her hand in any of the storage units 121 to store the mail in the storage unit 121. In addition, the worker can put his / her hand in one of the storage units 121 and take out the mail stored in the storage unit 121.

(2-2. Worktable 13)
The work table 13 is a table used by the worker for the route assembly work. The work table 13 has a flat table surface (upper surface). The pedestal surface is arranged so as to extend in the horizontal direction over the entire width of the shelf 12, for example. The workbench 13 can also function as a projectable region on which the projected image projected from the display unit 15 is imaged. The table surface of the work counter 13 may be used as an area for displaying images such as a ledger display start button for starting the display of the ledger, a delivery ledger, and a work start button for inputting the start of work. .. The image of the original book display start button, the delivery original book, the work start button, and the like may be displayed at a place different from the work table 13. Further, the delivery ledger may be displayed on an output device such as a display or a tablet (not shown).

(2-3. Sensor unit 14)
The sensor unit 14 has a function of sensing information about work by the operator. In the following, it is mainly assumed that the sensor unit 14 is configured to include a camera that detects visible light. In such a case, sensing is performed by capturing an image with a camera. However, the type of sensor is not limited. For example, the sensor may include a camera that detects infrared light, or may include a camera that obtains depth information. Further, the sensor unit 14 may be a USB (Universal Serial Bus) camera. As an example of the information indicating the sensing result, the sensor unit 14 outputs the image obtained by capturing the imaging range by the camera to the control terminal 11.

For example, the sensor unit 14 is located above the height of the head of a worker of standard height (for example, above the uppermost storage unit 121) and in front of the front surface of the shelf 12. It is desirable to be placed in a position. By installing the sensor unit 14 at such a position, the sensor unit 14 can capture an image including (a part of or the whole body of) an operator located in front of the work support system 10. For example, as shown in FIG. 1, the sensor unit 14 may be arranged on a support frame 17 that supports the mirror 18.

Further, as shown in FIG. 1, it is desirable that the sensor unit 14 is arranged so that the imaging direction faces the direction of the shelf 12. By installing the sensor unit 14 in this direction, as will be described later, the mail is stored or stored in the storage unit 121 by the operator based on the image captured by the sensor unit 14. It can be determined that the mail has been taken out from unit 121. However, the number and installation location of the sensor units 14 are not limited.

(2-4. Display 15)
The display unit 15 has a function of displaying various information for supporting the work of the operator according to the control by the control terminal 11. In the present embodiment, it is mainly assumed that the display unit 15 is configured by a projector. At this time, the display unit 15 projects information (specifically, a projected image) on the table surface of the work table 13 by using a so-called projection mapping technique. However, the form of the display unit 15 is not particularly limited. For example, the display unit 15 may be configured by a display device other than the projector, as will be described later.

As shown in FIG. 1, the display unit 15 is arranged on the shelf 12. The display unit 15 irradiates the projected light toward the mirror 18. The projected light emitted from the display unit 15 is reflected by the mirror 18 and reaches the table surface of the work table 13. That is, the display unit 15 projects information onto the table surface of the work table 13 via the mirror 18. Further, the display unit 15 may project information onto other areas of the table surface of the work table 13 via the mirror 18.

The display unit 15 is not limited to the top of the shelf 12, and may be arranged at a position (such as a ceiling or a wall (not shown)) at which the projected light directly reaches the table surface of the work table 13. In that case, the mirror 18 may not be provided. Alternatively, a plurality of display units 15 may be arranged separately, and may be divided into a projector that directly projects the projected light onto the table surface of the work table 13 and a projector that directly projects the projected light onto another region.

(2-5. Mirror 18)
As shown in FIG. 1, as an example, the mirror 18 is positioned above the head height of a worker of standard height by the support frame 17 (for example, a position above the uppermost storage portion 121). And, it is arranged at a position in front of the front surface of the shelf 12. Specifically, the mirror 18 is arranged above the work table 13 and diagonally upward of the shelf 12 so that the reflecting surface faces the display unit 15 and the table surface of the work table 13. Then, as shown in FIG. 1, the mirror 18 reflects the projected light emitted from the display unit 15 toward the table surface of the work table 13.

The mirror 18 is rotatably supported by a support mechanism so that the reflection angle can be changed in the vertical direction, and can be fixedly installed at an arbitrary reflection angle. As described above, the mirror 18 may not be provided when the projected light from the display unit 15 directly reaches the table surface of the work table 13.

(2-6. Control terminal 11)
The control terminal 11 is an information processing device composed of a computer and controlling the overall operation of the work support system 10. The control terminal 11 may correspond to an example of a work support device. An example of the functional configuration of the control terminal 11 will be described later with reference to FIG.

Further, a card reader 19 for reading an operator's ID (identification) card may be connected to the control terminal 11. The card reader 19 is provided around the shelf 12 and the workbench 13. The operator has the card reader 19 read his / her own ID card when starting the work. The card reader 19 reads the worker information (for example, the worker's identification number, the name, etc.) from the ID card and outputs the worker information to the control terminal 11. The ID card may be a magnetic card or an IC (integrated circuit) card. The control terminal 11 can recognize which worker started the work by reading the ID card. Further, a work start button may be provided on or around the work table 13. The work start button notifies the control terminal 11 that the button has been pressed by the operator. The control terminal 11 can recognize the start of work by pressing the work start button. Further, when the work start button is provided, the card reader 19 may not be provided.

Further, the present embodiment is not limited to the configuration having the card reader 19, and instead of or in addition to the card reader 19, a biometric information recognition device that recognizes biometric information such as a fingerprint or a palm print, or an ID for inputting an ID number. The configuration may include a number input device and a two-dimensional code reader device that reads a two-dimensional code (for example, a bar code or a QR code (registered trademark)) in which worker information is stored.

(2-7. Administrator terminal 30)
The administrator terminal 30 is an information processing device configured by a computer and controlling the overall operation of the information processing system 1. Further, the administrator terminal 30 is operated by the administrator. The administrator is a user who has the authority to operate the administrator terminal 30. The administrator terminal 30 includes a communication unit, a control unit, and a display unit, and can control to appropriately display the information received from each control terminal 11 on the display unit.

<3. Configuration example of control terminal 11>
FIG. 3 is a diagram showing a functional configuration example of the control terminal 11. As shown in FIG. 3, the control terminal 11 includes a control unit 110, an I / F (interface) unit 120, and a storage unit 130.

(3-1. Control unit 110)
The control unit 110 includes an arithmetic unit such as a CPU (Central Processing Unit), and a program stored in a ROM (Read Only Memory) is expanded and executed in a RAM (Random Access Memory) by the arithmetic unit. That function can be realized. At this time, a computer-readable recording medium on which the program is recorded may also be provided. Alternatively, these blocks may be composed of dedicated hardware or may be composed of a combination of a plurality of hardware. The data required for the calculation by the arithmetic unit is appropriately stored by the storage unit 130.

The control unit 110 has a function of controlling the overall operation of the work support system 10. The control unit 110 includes an image acquisition unit 111, a work progress estimation unit 112, a notification non-target setting unit 113, and a notification forgetting notification control unit 114.

The image acquisition unit 111 acquires real-time captured images (real-time images) continuously obtained by the sensor unit 14 via the I / F unit 120. Further, the image acquisition unit 111 stores a real-time image in the storage unit 130. The image acquisition unit 111 may store a real-time image for a certain period of time in the storage unit 130, or may update (overwrite) each time it is acquired from the sensor unit 14.

Further, the image acquisition unit 111 acquires an image of the empty shelf 12 in which no mail is stored in any of the storage units 121 before the sorting work (procedure 1) is started. , The acquired image is stored in the storage unit 130 as a reference image. Here, FIG. 4 shows an example of the reference image 200 according to the present embodiment. The reference image 200 is an captured image obtained by the sensor unit 14. The reference image 200 may be acquired before the start of the sorting operation and stored in the storage unit 130, or may be stored in the storage unit 130 in advance.

The work progress estimation unit 112 estimates the progress of the work based on the captured image of the shelf 12 acquired by the image acquisition unit 111. Specifically, the work progress estimation unit 112 compares the real-time image acquired by the image acquisition unit 111 with the captured image (stored in the storage unit 130) captured time before the real-time image. And detect the difference. The image acquisition unit 111 may update (overwrite) the real-time image in the storage unit 130 after the difference detection is performed.

Then, the work progress estimation unit 112 recognizes (identifies) the storage unit 121 corresponding to the area where the difference has occurred as the storage unit 121 in which the work is being performed by the operator. In the work shown in steps 1 to 3 described above, when the operator performs the work of storing the mail in the storage unit 121 and the work of taking out the mail from the storage unit 121, the operator directly under the storage unit 121 or the storage unit 121. (For example, the display area 123 shown in FIG. 4 or any other area that can be shielded by the operator's hand when viewed from the sensor unit 14) will be shielded by hand. As a result, a difference occurs in the captured image (presence or absence of a hand), so that the work progress estimation unit 112 can recognize which storage unit 121 the work is currently being performed on. That is, the work progress estimation unit 112 can recognize (estimate) the storage unit 121 in which the work is being performed based on the position of the worker's hand included in the captured image.

Further, since the order in which each of the operations shown in the above-mentioned procedures 1 to 3 is performed is determined, the work progress estimation unit 112 estimates what kind of work the worker works on the storage unit 121. Can be done. For example, when the worker's hand shields a part of the storage unit 121 when the procedure 1 is started, the work progress estimation unit 112 stores the mail in the storage unit 121 in the procedure 1 (sorting work). Is presumed to be done. Further, when the worker's hand shields a part of the storage unit 121 when the procedure 2 is started, the work progress estimation unit 112 states that the work of taking out the mail from the storage unit 121 was performed in the procedure 2. It is estimated that, when a part of the same storage unit 121 is shielded by hand again, it is presumed that the work of returning the rearranged mail (which has been subjected to the route assembly work) to the storage unit 121 has been performed. Then, when the worker's hand shields a part of the storage unit 121 when the procedure 3 is started, the work progress estimation unit 112 takes out the mail from the storage unit 121 in the procedure 3 (collection work). Is presumed to have been done.

Further, the work progress estimation unit 112 has a ledger display start button displayed on the table surface based on a real-time image of the table surface of the work table 13 acquired by the image acquisition unit 111 (an image captured by the sensor unit 14). It is also possible to recognize whether or not the work start button has been selected. For example, the work progress estimation unit 112 recognizes that the button selection operation has been performed when the original book display start button or the work start button displayed on the table surface is shielded by the operator's hand. The work progress estimation unit 112 compares the real-time image of the table surface with the captured image of the table surface captured in time and detects a difference, and the difference is the original book display start button or the manual display start button by the operator. When the work start button is shielded, it may be recognized that the button selection operation has been performed.

The estimation of the work progress based on the detection of the difference described above is an example, and the present embodiment is not limited to this. The work progress estimation unit 112 can estimate the work progress by various image recognition processes. Alternatively, the work progress estimation unit 112 may estimate the work progress based on a sensing result other than the captured image (for example, each storage unit 121 is provided with a sensor for detecting a hand and the sensing result).

The notification non-target setting unit 113 has a function of setting a storage unit 121 to be excluded from the notification target forgotten to be taken out. In the present embodiment, the removal forgetting notification control unit 114 can control the worker to be notified of the removal forgetting. The removal forgetting notification control unit 114 detects the difference by comparing the reference image obtained by capturing the empty state of the storage unit 121 described above with the real-time image captured after the worker takes out the mail. When the difference is detected, it can be determined that the storage unit 121 has forgotten to take out the mail. Therefore, the forgotten take-out notification control unit 114 controls the display unit 15 or the like to notify the worker that the mail has been forgotten to be taken out. conduct. The method for determining that the mail has been forgotten to be taken out is not limited to the difference detection, and may be performed by image analysis (object recognition, etc.) of a real-time image, or a sensor (infrared sensor, etc.) provided in each storage unit 121. A contact sensor, a pressure sensor, etc.) may detect the presence or absence of (residual) mail in the storage unit 121.

Here, as described above, in step 3 (the work of taking out the mail for delivery), the mail is taken out within the delivery allowable amount, so that the mail may be left in the storage unit 121. .. In this embodiment, the notification non-target setting unit 113 sets the notification non-target storage unit 121 so that the forgetting to take out is not notified in such a case. The take-out forgetting notification control unit 114 notifies the worker that the mail has been forgotten to be taken out when the mail remains in the storage unit other than the storage unit that is not subject to notification. As a result, it is possible to prevent the residual mail other than the forgotten take-out from being notified as forgotten to take out, and to further enhance the convenience of the forgotten take-out notification.

The notification non-target setting unit 113 calculates the amount of mail stored in the storage unit 121 based on the captured image, and sets the notification non-target storage unit 121 in consideration of the delivery allowance. As described above, in the procedure 3, the mail items are taken out (collected) from each storage unit 121 in the order according to the actual delivery route. Therefore, the notification non-target setting unit 113 sequentially adds the amount of mail in the storage unit 121 in this order (also referred to as the collection order in the present specification), and the added amount is a predetermined value (predetermined in advance). For example, a value of an amount that can be worked in a predetermined work can be mentioned. As an example, the storage unit 121 and subsequent units that exceed (here, the allowable delivery amount is used) are set to be non-notification targets. The collection order is determined according to the actual delivery route (delivery ledger) regardless of the arrangement of the storage units 121. It is assumed that the worker sequentially collects the mail items and loads them into the carry box or the like while referring to the delivery ledger, for example, and the notification non-target setting unit 113 can acquire the data of the collection order corresponding to the delivery ledger in advance. .. In the collection operation of step 3, mail is collected in units of storage units 121. Therefore, the notification non-target setting unit 113 sequentially adds in units of storage units 121, and the storage unit 121 that exceeds a predetermined value is added. Include in non-notification.

Next, an example of calculating the amount of mail based on the captured image will be described. The notification non-target setting unit 113 can calculate the amount of mail stored in each storage unit 121 based on the captured image of the shelf 12 after storing the mail acquired by the image acquisition unit 111. FIG. 5 shows an example of the captured image 210 of the shelf 12 in which the mail is stored in the storage unit 121. The captured image 210 shown in FIG. 5 is captured by the sensor unit 14 and output to the control terminal 11. As shown in FIG. 5, when one or more mail items 300 are stored in the storage unit 121 in a state of being stacked in the vertical direction, the notification non-target setting unit 113 sets the height of the stacked mail items (vertical direction). ) May be used to calculate the number of mail items. The height of the mail is obtained by image analysis of the captured image 210. At this time, the notification non-target setting unit 113 may use table data in which the height of the mail and the number of mail prepared in advance based on statistics or the like are associated with each other.

In the present embodiment, it is described that "the storage unit 121 and subsequent units exceeding the predetermined value are set as the storage units that are not subject to notification", but "the storage unit 121 before the storage unit 121 exceeding the predetermined value is notified. It may be set in the target storage unit.

(3-2. Storage unit 130)
The storage unit 130 is a storage device capable of storing programs and data for operating the control unit 110. In addition, the storage unit 130 can temporarily store various data required in the process of operation of the control unit 110. The storage device may be a non-volatile storage device. Further, as an example of various data, the storage unit 130 stores a delivery ledger, a real-time image, a delivery allowance, a collection order in step 3 based on the delivery ledger, a location of a storage unit 121 set as a non-notification target, and the like. Can be done.

(3-3. I / F part 120)
The I / F unit 120 inputs / outputs data to / from an external device by wire or wirelessly. For example, the I / F unit 120 may be an interface composed of a communication device or the like for connecting to a network. For example, the I / F unit 120 communicates with the sensor unit 14 and receives the captured image acquired by the sensor unit 14. Further, the I / F unit 120 communicates with the card reader 19 and receives the ID information read by the card reader 19.

Further, the I / F unit 120 communicates with the display unit 15 and transmits a signal to the display unit 15 for controlling to display information for notifying the worker of forgetting to take out. Further, the I / F unit 120 communicates with the administrator terminal 30 and notifies the administrator terminal 30 that the notification non-target is set (or the amount of mail stored on the shelf 12 exceeds the delivery allowance). Send to.

<4. Operation processing>
Subsequently, the operation processing of the information processing system 1 according to the present embodiment will be specifically described with reference to FIGS. 6 and 7.

(4-1. Forgotten removal notification processing)
FIG. 6 is a flowchart showing an example of the flow of the forgotten removal notification process according to the present embodiment. As shown in FIG. 6, first, the control terminal 11 acquires an captured image (for example, the reference image 200 shown in FIG. 4) of the empty shelf 12 before the sorting operation (procedure 1) is started (step). S103). In the sorting work (procedure 1), a plurality of mails placed on the table surface of the work table 13 are collected for each destination corresponding to the same direction while referring to the delivery ledger, and stored in the corresponding sorting port (storage unit 121). Sorting work is done manually by the operator. The delivery ledger may be displayed on the base surface of the work table 13 in response to the pressing of, for example, the delivery ledger display button (which may be displayed on the table surface of the work table 13 or may be a hardware button provided with a physical structure). Is displayed in. In addition, the delivery direction (for example, the name of the district and the name of the building) is described (or pasted) in the area (for example, the display area 123 shown in FIG. 4) directly below the plurality of division ports provided on the shelf 12. Or, it is displayed (projected) by the display unit 15. The worker can sort the mail by storing each mail in the sorting port associated with the direction corresponding to the destination. As a result, a plurality of mail items are grouped according to the destination corresponding to the same direction.

Next, the control terminal 11 acquires an captured image (for example, the captured image 210 shown in FIG. 5) of the shelf 12 after the sorting operation (procedure 1) is completed (step S106). The start and end of the work can be recognized by the control terminal 11 by detecting a predetermined trigger determined in advance. For example, the operator may swipe the ID card through the card reader 19, or the work start / end button (may be displayed on the table surface of the work table 13 or may be a hardware button provided with a physical structure. ) Is pressed. Alternatively, the control terminal 11 detects, based on the real-time image of the table surface of the work table 13 obtained by the sensor unit 14, when all the plurality of mails placed on the table surface are lost as the end of the sorting work. You may.

Next, the notification non-target setting unit 113 of the control terminal 11 sequentially adds the amount of mail stored in the sorting port in a predetermined order based on the captured image acquired in step S106 (step S109). .. The predetermined order is the collection order when the mail is collected in units of divisions for delivery in step 3 (that is, for the next work process), and specifically, the actual delivery route. The collection order is according to. Since the mail items sorted by destination corresponding to the same direction are stored in the sorting port, in step 3, the mail items are collected in the order of the delivery direction according to the delivery route and put into a carry box or the like. The loading work is done. Therefore, the notification non-target setting unit 113 sequentially adds the amount of mail in the order of collection for each division port. As described above, the amount of mail stored in each division port can be calculated based on, for example, the height at which the mail is stacked.

The addition of the amount of mail can be performed sequentially according to the collection order until the total value exceeds a predetermined value (here, “delivery allowance”) (step S109, step S112 / No, S115 / No).

Next, when the total value exceeds the permissible delivery amount (step S112 / Yes), the notification non-target setting unit 113 includes the classification port after the classification port exceeding the permissible amount (including the classification port exceeding the permissible amount). Is set as a division port that is not subject to the notification of forgetting to take out (step S118). For example, the notification non-target setting unit 113 may store the location of the division port of the notification non-target for forgetting to take out in the storage unit 130. In step 3, mail items within the delivery allowance are collected (the delivery allowance is, for example, the load capacity of a carry box, etc., and mail items exceeding this capacity cannot be loaded), so the items are sequentially added. This is because the mail items left in the divisions after the divisions whose total exceeds the permissible amount are not forgotten to be taken out.

If the total value does not exceed the delivery allowance and the calculation of all the sorting ports for storing the mail is completed (step S115 / Yes), the setting for notifying the forgetting to take out is not performed.

Subsequently, the sorting operation (procedure 2) is performed (step S121). In step 2, the worker manually sorts one or more mail items (stored in each division port) for each destination in the same direction in the order of the actual delivery route. The work of step 2 may be continued by the worker who performed step 1, or may be performed by another worker. For example, a worker takes out a plurality of mail items (whose destinations correspond to the same direction) stored in the sorting port, places them on the table surface of the work table 13, and refers to the delivery ledger in the order of the actual delivery route. Sort and return to the sorting port.

Next, the control terminal 11 acquires the captured image (real-time image) of the shelf 12 at any time (continuously in chronological order) during the work of step 2 (step S124).

Next, the take-out forgetting notification control unit 114 detects the take-out forgetting during the work of step 2 based on the reference image and the real-time image acquired in advance (step S127). Specifically, the control terminal 11 compares the real-time image with the reference image and takes out the mail after a predetermined time (for example, 10 seconds) after the worker takes out the mail from the sorting port. Detect the difference in the classification port. The work of taking out the mail from the sorting port by the worker and which sorting port the work was performed on can be estimated by the work progress estimation unit 112 based on the captured image. Since the reference image is an image obtained by capturing an image in which the division port is empty, the forgotten removal notification control unit 114 compares the difference with the real-time image of the target classification port, and when a difference is detected, the mail is sent to the classification port. Can be determined to remain (that is, forgotten to take out).

Next, when a forgotten take-out is detected (step S127 / Yes), the forgotten take-out notification control unit 114 notifies the worker of the forgotten take-out (step S130). For example, the removal forgetting notification control unit 114 may display a warning such as "There is a removal forgetting" on the table surface of the work table 13 by the display unit 15, or output a warning voice from the voice output unit (not shown). You may try to do it. As a result, the worker notices that he / she has forgotten to take out the mail, and can take out the mail from the sorting port of the work target.

The above-mentioned detection and notification of forgetting to take out may be performed every time the mail is taken out from the sorting port.

Next, a collection operation (procedure 3) for delivery is performed (step S133). In step 3, each mail item (sorted) stored in one or more sorting ports on the shelf 12 is collected (taken out) from the sorting port in a predetermined order (collection order) according to the actual delivery route. The work of loading into a carry box or the like used at the time of delivery is manually performed by an operator. The work of step 3 may be continued by the worker who performed step 2, or may be performed by another worker (delivery worker, etc.). For example, a worker refers to a delivery ledger (for loading) of a plurality of mail items stored in one or more division ports (addresses correspond to the same direction and sorted in order of delivery route). Then, in the predetermined order (collection order) according to the actual delivery route, the items are taken out in units of divisions and loaded in the carry box in order. Here, the worker (delivery worker) finishes the work by loading the mail within the delivery allowance determined according to the capacity of the carry box or the like. As described above, the end of the work can be recognized by the control terminal 11 by detecting a predetermined trigger determined in advance. For example, a worker swipes an ID card through a card reader 19, or a work end button (which may be displayed on the table surface of the work table 13 or may be a hardware button provided with a physical structure). It may be pressed. Alternatively, a case where a predetermined movement is detected by a camera or the like (sensor unit 14), such as when the worker is away from the shelf 12 for a certain period of time or more, may be recognized as the end of the work.

Subsequently, after the work is completed, the control terminal 11 acquires the captured image of the shelf 12 (step S136), and the removal forgetting notification control unit 114 detects the removal (collection) forgetting (step S139). Specifically, the take-out forgetting notification control unit 114 compares the real-time image with the reference image after a predetermined time (for example, 5 minutes) after the worker finishes the work, and "not picks up the forgotten notification". Detects the difference between the classification ports other than "target" (in other words, the classification port of the target for forgetting to take out). Since the reference image is an image obtained by capturing an image of the empty division port, the forgotten removal notification control unit 114 will leave mail in the classification port when a difference is detected in comparison with the real-time image of the classification port. It can be determined that the item has been removed (that is, the item has been forgotten to be taken out).

Then, when the forgotten take-out is detected (step S139 / Yes), the take-out forgetting notification control unit 114 notifies the worker (for example, the delivery person) of the forgotten take-out (step S142). For example, the removal forgetting notification control unit 114 may display a warning such as "There is a removal forgetting" on the table surface of the work table 13 by the display unit 15, or output a warning voice from the voice output unit (not shown). You may try to do it. Further, since it is assumed that the delivery person is already away from the shelf 12, the take-out forgetting notification control unit 114 takes out the handy terminal owned by the delivery person from the I / F unit 120 via the network. Controls the transmission of information notifying you of forgetting. As a result, the delivery person notices that he / she has forgotten to take out the mail and returns to the shelf 12 to collect the mail.

(4-2. Operation processing when forgetting to take out is set)
Next, the notification process to the administrator terminal 30 when the control terminal 11 is set to not target the notification of forgetting to take out will be described. The setting of non-target for forgetting to take out notification is set when the delivery allowance is exceeded, but it is necessary to take measures such as having another delivery person collect the mail for the amount exceeding the allowance. Therefore, when the control terminal 11 sets the non-target for forgetting to take out notification, the administrator can quickly respond to the current situation of the shelf 12 by notifying the administrator terminal 30. It becomes.

FIG. 6 is a flowchart showing an example of the flow of operation processing at the time of setting forgetting to take out according to the present embodiment. As shown in FIG. 6, first, when the control terminal 11 is set to “not target for forgetting to take out” (step S153 / Yes), the control terminal 11 notifies the administrator terminal 30 that the delivery allowance has been exceeded. (Step S156). As a result, the manager can grasp the current state of the shelf 12 at an early stage (for example, when the work of step 1 is completed on the shelf 12), increase the number of delivery personnel assigned to step 3, and increase the load capacity. It is possible to change to a delivery person who can deliver by many vehicles.

<5. Supplement>
In the above-described embodiment, it is explained that whether or not the delivery allowance is exceeded is determined by the notification non-target setting unit 113 based on the number of mail items calculated from the height of the mail items stored in the classification port. However, the present invention is not limited to this, and the delivery allowance is set to the height of the mail, and it is not notified whether or not the total height of the mail stored in the sorting port exceeds the delivery allowance. The target setting unit 113 may make a determination.

Further, in the above procedure 3, the control terminal 11 may perform control to clearly indicate the position of the classification port to be collected next based on the collection order according to the actual delivery route. For example, the control terminal 11 may perform display control such as blinking the display area 123 corresponding to the classification port (storage unit 121) to be collected next.

Further, on the shelf 12 in which the non-target for forgetting to take out notification is set, that is, the shelf 12 in which the mail exceeding the delivery allowance is stored, the collection by the first delivery person is completed, and then the other delivery person is on the shelf. When collecting the mail from 12, the control terminal 11 may perform display control such as blinking the display area 123 corresponding to the division port set as the non-target for forgetting to take out notification. As a result, it is possible to easily take over, and the occurrence of recognition discrepancy in taking over is suppressed.

<6. Hardware configuration>
The embodiments of the present invention have been described above. The various types of information processing performed by the work support system 10 described above are realized by the collaboration between the software and the hardware of the work support system 10 described below.

FIG. 8 is a block diagram showing an example of the hardware configuration of the information processing device 900 that embodies the work support system 10 (more specifically, for example, the control terminal 11) according to the present embodiment. The information processing device 900 includes a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, a RAM (Random Access Memory) 903, a host bus 904, a bridge 905, an external bus 906, and an interface 907. The input device 908, the output device 909, the storage device 910, the drive 911, and the communication device 913 are provided.

The CPU 901 functions as an arithmetic processing device and a control device, and controls the overall operation in the information processing device 900 according to various programs. Further, the CPU 901 may be a microprocessor. The ROM 902 stores programs, calculation parameters, and the like used by the CPU 901. The RAM 903 temporarily stores a program used in the execution of the CPU 901, parameters that are appropriately changed in the execution, and the like. These are connected to each other by a host bus 904 composed of a CPU bus or the like. The function of the control unit 110 described above is realized by the cooperation of the CPU 901, the ROM 902, and the RAM 903.

The host bus 904 is connected to an external bus 906 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 905. It is not always necessary to separately configure the host bus 904, the bridge 905, and the external bus 906, and these functions may be implemented in one bus.

The input device 908 is derived from an input means for the user to input information such as a mouse, keyboard, touch panel, button, switch or microphone, and an input control circuit that generates an input signal based on the input by the user and outputs the input signal to the CPU 901. It is configured. By operating the input device 908, the user who operates the information processing device 900 can input various data to the information processing device 900 and instruct the processing operation. For example, the operator can input various data to the work support system 10 or instruct the processing operation by operating the input device 908.

Also, the input device 908 may be formed by a device that detects information about the work. For example, the input device 908 includes various sensors such as an image sensor (for example, a camera), a depth sensor (for example, a stereo camera), an acceleration sensor, a gyro sensor, a geomagnetic sensor, an optical sensor, a sound sensor, a distance measuring sensor, and a force sensor. May include. These input devices 908 can realize the function of the sensor unit 14.

The output device 909 includes, for example, a CRT (Cathode Ray Tube) display device, a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Node) device, a display device such as a lamp, and an audio output device such as a speaker. The output device 909 can realize the function of the display unit 15 described above.

The storage device 910 is a device for storing data. The storage device 910 may include a storage medium, a recording device for recording data on the storage medium, a reading device for reading data from the storage medium, a deleting device for deleting the data recorded on the storage medium, and the like. The storage device 910 realizes the storage unit 130 described above.

The drive 911 is a storage medium reader / writer, and is externally attached to the information processing device 900. The drive 911 reads the information recorded in the removable storage medium 912 such as the mounted magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and outputs the information to the RAM 903. The drive 911 can also write information to the removable storage medium 912.

The communication device 913 is a communication interface composed of a communication device or the like for performing communication. The communication device 913 may be a wireless LAN (Local Area Network) compatible communication device or a wire communication device that performs wired communication. The communication device 913 realizes the above-mentioned I / F unit 120.

The hardware configuration of the information processing device 900 is not limited to the configuration shown in FIG. For example, the information processing device 900 does not have to include the communication device 913 when communicating via an external communication device to which the information processing device 900 is connected. Further, the information processing device 900 does not have to include, for example, an input device 908 or an output device 909. Further, for example, a part or all of the configuration shown in FIG. 8 may be realized by one or two or more ICs (Integrated Circuits).

Further, the hardware configuration of the information processing device 900 described above may be used for the hardware configuration of the administrator terminal 30. Various types of information processing performed by the information processing system 1 are realized by the cooperation between the software and the hardware of the control terminal 11 and the administrator terminal 30.

<7. Effect>
As described above, according to the embodiment of the present invention, by setting the storage unit that is not subject to the notification of forgetting to take out according to the amount of the stored items stored in the storage shelf, the stored items other than those forgotten to be taken out are set. It is possible to prevent the residue from being notified as forgetting to take out, and to further enhance the convenience of notifying that the residue has been forgotten to be taken out.

In addition, by connecting the control terminal 11 that provides such work support to the administrator terminal 30 via communication, the administrator can grasp the status of the storage shelves, and it is possible to take prompt action such as increasing the number of delivery staff. Become.

<8. Summary>
Although the preferred embodiments of the present invention have been described in detail with reference to the accompanying drawings, the present invention is not limited to such examples. It is clear that a person having ordinary knowledge in the field of technology to which the present invention belongs can come up with various modifications or modifications within the scope of the technical ideas described in the claims. , These are also naturally understood to belong to the technical scope of the present invention.

For example, the processes described with reference to the flowcharts herein may not necessarily be performed in the order shown. Some processing steps may be performed in parallel. Further, additional processing steps may be adopted, and some processing steps may be omitted.

In addition, the series of processes by each device described in the present specification may be realized by using software, hardware, or a combination of software and hardware. The programs constituting the software are stored in advance in, for example, a storage medium (non-temporary medium: non-transitory media) provided inside or outside each device. Then, each program is read into RAM at the time of execution by a computer and executed by a processor such as a CPU. The storage medium is, for example, a magnetic disk, an optical disk, a magneto-optical disk, a flash memory, or the like. Further, the above computer program may be distributed via, for example, a network without using a storage medium.

Further, the functions of the control terminal 11 described in the present specification may be distributed and implemented in a plurality of devices.

10 Work support system 11 Control device (work support device)
110 Control unit 111 Image acquisition unit 112 Work progress estimation unit 113 Notification non-target setting unit 114 Forgotten removal notification control unit 120 I / F unit 130 Storage unit 12 Shelf 121 Storage unit (classification port)
123 Display area 13 Worktable 14 Sensor unit 15 Display unit 17 Support frame 18 Mirror 19 Card reader 30 Administrator terminal 40 Network

Claims (11)

An acquisition unit that acquires a captured image of a storage shelf having a plurality of storage units, and an acquisition unit.
Based on the captured image, the amount of stored items stored in the storage unit is calculated, and the storage is sequentially performed for each storage unit in an order according to a predetermined work order performed on the plurality of storage units. A setting unit that adds up the amount of items and sets the storage unit and subsequent units whose total value exceeds a predetermined value as non-targets for notification of forgetting to remove stored items.
Information processing device. The information processing device
After the predetermined work is completed, if the stored item remains in a storage unit other than the storage unit set as a non-target for the stored item forgetting to remove notification, control is performed to notify the worker of the forgetting to remove the stored item. The information processing apparatus according to claim 1, further comprising a notification control unit. The notification control unit compares the captured image obtained by capturing the empty state of the storage shelf with the captured image obtained by capturing the image of the storage shelf after the completion of the predetermined work, and detects the difference, and the difference is detected. The information processing apparatus according to claim 2, wherein it is determined that the stored items remain in the case. The information processing device transmits to the administrator terminal that the amount of the stored items stored in the storage shelf exceeds a predetermined value when the non-target setting for forgetting to take out the stored items is set. The information processing apparatus according to any one of claims 1 to 3, further comprising a unit. The information processing apparatus according to any one of claims 1 to 4, wherein the predetermined value is a value of an amount that can be worked in the predetermined work. The information processing device according to any one of claims 1 to 5, wherein the stored items stored in the storage shelf are mail items. The information processing apparatus according to claim 6, wherein the predetermined work order is an order in which the mail items are collected from the storage unit according to an actual delivery route. The information processing device according to claim 7, wherein the predetermined value is an allowable amount in delivery of the mail. The information processing device
The information processing device according to any one of claims 1 to 8, which controls the storage shelves to display a display indicating a storage unit for which the notification of forgetting to take out stored items is not targeted. The processor
Acquiring captured images of storage shelves with multiple storage units
Based on the captured image, the amount of stored items stored in the storage unit is calculated, and the storage is sequentially performed for each storage unit in an order according to a predetermined work order performed on the plurality of storage units. The amount of items is added, and the items after the storage unit whose total value exceeds the predetermined value are set as non-targets for the notification of forgetting to take out the stored items.
Information processing methods, including. Computer,
An acquisition unit that acquires a captured image of a storage shelf having a plurality of storage units, and an acquisition unit.
Based on the captured image, the amount of stored items stored in the storage unit is calculated, and the storage is sequentially performed for each storage unit in an order according to a predetermined work order performed on the plurality of storage units. A setting unit that adds up the amount of items and sets the storage unit and subsequent units whose total value exceeds a predetermined value as non-targets for notification of forgetting to remove stored items.
A program to function as.

Images