JP6733635B2 - Goods management system - Google Patents

Description

The present invention relates to an article management system that manages taking out articles.

You may want to monitor the movement of people in the room to prevent unauthorized removal. For example, you may want to monitor the room where important items, materials, and documents are stored. An image pickup device (camera) may be used for monitoring. An example of a monitoring technique using an image pickup device is described in Patent Document 1.

Specifically, in Patent Document 1, an identification image for identifying a person entering the room and identification information for identifying a person leaving the room are acquired, and a captured image at the time of entry into the room searched based on the identification information of the person leaving the room. , A monitoring terminal device to be displayed together with an imaged image of the person when leaving the room is described. With this configuration, the gate passing image at the time of leaving the room and the gate passing image at the time of entering the room are displayed so that the surveillance staff can efficiently monitor (Patent Document 1: Claim 1, paragraph [0007]).

Japanese Patent No. 5004845

A room may be provided to store rentable assets (articles). Items are taken out of the storage room when it becomes necessary for business. There are various items stored. For example, a PC or a portable memory may be stored.

In order to prevent missing items, it is necessary to manage the removal of items. For example, it is necessary to keep a record of who brought out which item. The manager of the article needs to make a detailed check to see whether the record of taking out is complete or correct. Since it takes time to manage the goods, there is a problem that the burden on the manager is heavy. The greater the number of items to be stored and the more people who take out the items, the greater the burden on the administrator.

In the invention described in Patent Document 1, the person in charge of checking the moving image of the surveillance camera (surveillance person) can compare the states when entering the room and when leaving the room. It is possible to check the inappropriate removal of goods. However, Patent Document 1 does not describe an appropriate record of taking out an article. Therefore, the technique described in Patent Document 1 cannot solve the above problem.

The present invention has been made in view of the above-mentioned problems of the conventional art, and leaves accurate records of articles and reduces the burden on the administrator of the articles.

In order to solve the above problems, the article management system according to claim 1 includes a surveillance camera and an image processing device. The surveillance camera is provided in a storage room for storing articles. The surveillance camera photographs the inside of the storage room and outputs photographed data. The image processing apparatus identifies the person who has entered the storage room by using personal information data registered in advance, which is data of a person who can take out the article. The image processing apparatus recognizes the entering person information, which is information that is input by the identified person who is the identified entering person and is necessary for managing the article. The image processing apparatus collates the personal information data of the specific person with the room entry information to determine whether the room entry information is correct. When the image processing apparatus determines that the room entry information is correct, the image processing apparatus generates article management data including the room entry information. The image processing apparatus stores the generated article management data in a storage unit, and permits exit from the storage room. The image processing apparatus does not permit exit from the storage room when it is determined that the entry information is incorrect.

As described above, according to the present invention, it is possible to reduce the burden on the manager of the article and leave an accurate record of taking out the article.

FIG. 1 is a diagram showing an example of an article management system according to an embodiment. FIG. 2 is a diagram illustrating an example of the multifunction peripheral according to the embodiment. FIG. 3 is a diagram showing an example of the article management system according to the embodiment. FIG. 4 is a diagram showing an example of processing when entering the storage room in the article management system according to the embodiment. FIG. 5 is a diagram showing an example of personal information data according to the embodiment. FIG. 6 is a diagram showing an example of the flow of processing when the article management system according to the embodiment specifies a person who has entered the room. FIG. 7 is a diagram showing an example of a selection screen according to the embodiment. FIG. 8 is a diagram illustrating an example of a flow of processing when the first button according to the embodiment is operated. FIG. 9 is a diagram showing an example of the flow of processing when the second button according to the embodiment is operated. FIG. 10 is a diagram showing an example of the article management information according to the embodiment. FIG. 11 is a diagram illustrating an example of a flow of processing when the third button according to the embodiment is operated.

The article management system 100 according to the present invention will be described below with reference to FIGS. 1 to 11. The article management system 100 includes an image processing device and a surveillance camera 300. In the following description, the multifunction machine 200 will be described as an example of the image processing apparatus. The multifunction device 200 is also an image forming apparatus. However, each element such as the configuration and arrangement described in the present embodiment does not limit the scope of the invention and is merely an example for explanation.

(Goods management system 100)
An example of the article management system 100 according to the embodiment will be described with reference to FIG. 1. FIG. 1 is a diagram showing an example of an article management system 100.

The article management system 100 includes a multifunction machine 200 (image processing apparatus) and a surveillance camera 300. FIG. 1 shows an example in which a multifunction peripheral 200 and a surveillance camera 300 are installed in a storage room 400. As shown in FIG. 1, the surveillance camera 300 may be attached to the multifunction peripheral 200. The surveillance camera 300 may be mounted on the ceiling. The surveillance camera 300 photographs the inside of the storage room 400. The surveillance camera 300 photographs a person who has entered the storage room 400. For example, the lens 301 of the surveillance camera 300 is directed toward the entrance/exit of the storage room 400. A plurality of surveillance cameras 300 may be provided. In this case, each surveillance camera 300 is communicatively connected to the multifunction device 200.

Articles are stored in the storage room 400. In FIG. 1, the illustration of the article is omitted for convenience. There is no particular limitation on the type of articles stored. In the case of the storage room 400 provided in the company, articles lent from the company to employees are stored. The employee takes out the article from the storage room 400 according to business needs.

The storage room 400 can be entered through the door 500. A locking device 600 is attached to the door 500. The multi-function device 200 controls the locking device 600. The multifunction device 200 has the door 500 locked. When taking out an article to the outside of the storage room 400, a person who can take out the article (a qualified person) performs an operation for recording the take-out of the article in the multifunction machine 200. If there is no problem in the operation, the multifunction device 200 permits the exit.

(Multifunction device 200)
An example of the multifunction machine 200 according to the embodiment will be described based on FIG. FIG. 2 is a diagram illustrating an example of the multifunction machine 200 according to the embodiment.

The multifunction machine 200 includes a control unit 1, a storage unit 2, an image reading unit 3, an operation panel 4, a printing unit 5, and a communication unit 6.

The control unit 1 controls each unit of the multifunction machine 200. The control unit 1 includes a CPU 11 and an image processing unit 12. The CPU 11 performs calculation and control. The image processing unit 12 applies image processing to image data. The storage unit 2 includes a non-volatile storage unit 2 and a volatile storage unit 2. The storage unit 2 includes a ROM 21 and a storage 22 (HDD or SSD) as a non-volatile storage device. The storage unit 2 includes a RAM 23 as a volatile storage device. The storage unit 2 stores control programs and data.

In the case of a job for reading a document (copy job, scan save job, scan transmission job), the control unit 1 causes the image reading unit 3 to read the document. The image reading unit 3 generates image data of a document.

The control unit 1 is communicatively connected to the operation panel 4. The operation panel 4 includes a display panel 41 (corresponding to a notification unit), a touch panel 42 (corresponding to an acquisition unit and an input device), a hard key 43, a speaker 44 (corresponding to a notification unit), and a reader 45. The control unit 1 controls the display on the display panel 41. The control unit 1 displays the operation image for setting on the display panel 41. The operation image is, for example, a soft key or a button. The control unit 1 recognizes the operated operation image based on the output of the touch panel 42. The control unit 1 also recognizes the operated hard key 43. The operation panel 4 receives user operations (operation images and operations on the hard keys 43). The speaker 44 emits sound. The control unit 1 inputs an audio signal into the speaker 44. The speaker 44 emits a voice based on the input voice signal.

The printing unit 5 carries out printing on the paper while conveying the paper. The printing unit 5 performs printing based on the print data and discharges the printed matter to the discharge tray. The printing unit 5 includes a paper feeding unit 5a, a paper transporting unit 5b, an image forming unit 5c, and a fixing unit 5d.

The control unit 1 controls the operation of the printing unit 5. The control unit 1 controls the operations of the paper feeding unit 5a, the paper transporting unit 5b, the image forming unit 5c, and the fixing unit 5d. The paper feeding unit 5a stores paper. For a print job, the control unit 1 causes the paper feeding unit 5a to supply paper. The control unit 1 causes the paper transport unit 5b to transport the paper. The control unit 1 causes the image forming unit 5c to form a toner image based on the image data. The control unit 1 causes the image forming unit 5c to transfer the formed toner image onto the conveyance paper. The control unit 1 causes the fixing unit 5d to heat and pressurize the sheet on which the toner image is transferred. As a result, the toner image is fixed on the paper. The control unit 1 conveys the fixed (printed) sheet to the sheet conveying section 5b up to the discharge tray.

The communication unit 6 includes hardware and software necessary for communication. The hardware is, for example, a communication circuit or a communication memory. The communication unit 6 communicates with the computer 700. The computer 700 is, for example, a PC. The communication unit 6 can communicate with a plurality of computers 700. The communication unit 6 can communicate with the computer 700 of the manager of the article (storage room 400).

Further, the communication unit 6 is connected to the locking device 600 so as to communicate with each other. The locking device 600 includes a locking mechanism 601 and a metal lock 602. The locking mechanism 601 and the metal lock 602 are provided on the door 500. The locking mechanism 601 includes a motor and gears. The locking mechanism 601 moves the metal lock 602. The control unit 1 controls locking and unlocking of the door 500. When locking, the control unit 1 causes the locking device 600 to transmit a locking instruction signal to the communication unit 6. When the locking instruction signal is received, the locking mechanism 601 moves the metal lock 602 to lock it. In the locked state, the door 500 cannot be opened. When unlocking, the control unit 1 causes the communication unit 6 to transmit an unlocking instruction signal toward the locking device 600. When the unlocking instruction signal is received, the locking mechanism 601 moves the metal lock 602 to unlock it. In the unlocked state, the door 500 can be opened.

By operating the locking device 600, the locking device 600 can be unlocked from the outside of the room. The administrator's computer 700 can control locking and unlocking of the door 500. When receiving the unlocking instruction from the administrator's computer 700, the control unit 1 causes the communication unit 6 to transmit an unlocking instruction signal to the locking device 600. When the communication unit 6 receives a lock instruction from the administrator's computer 700, the control unit 1 causes the communication unit 6 to transmit a lock instruction signal to the lock device 600.

Further, the door 500 is provided with a door sensor 800 for detecting opening/closing of the door 500. The output of the door sensor 800 is input to the control unit 1. The control unit 1 recognizes that the door 500 has been opened and closed based on the output of the door sensor 800.

The communication unit 6 is also connected to the surveillance camera 300. The surveillance camera 300 takes an image and generates shooting data. Shooting data is output from the surveillance camera 300. The communication unit 6 receives the shooting data.

(Identification of people entering the room)
Next, an example of identifying a person who enters the storage room 400 in the article management system 100 according to the embodiment will be described with reference to FIGS. 3 to 5. FIG. 3 is a diagram showing an example of the article management system 100 according to the embodiment. FIG. 4 is a diagram showing an example of processing when the article management system 100 according to the embodiment enters the storage room 400. FIG. 5 is a diagram showing an example of the personal information data 7 according to the embodiment.

The surveillance camera 300 is provided at a position where an image of a person entering the room can be taken. In other words, the surveillance camera 300 photographs the door 500 and the vicinity of the door 500. As shown in FIG. 3, the surveillance camera 300 includes a lens 301, an image sensor 302, and a camera module 303. The lens 301 guides the incident light to the image sensor 302. The image sensor 302 includes a plurality of light receiving elements arranged in a plane. Each light receiving element of the image sensor 302 outputs an analog signal (image signal) according to the amount of received light. Each light receiving element of the image sensor 302 outputs an analog signal (image signal) at a constant cycle. The camera module 303 generates shooting data (image data) based on the image signal output by the image sensor 302. The camera module 303 generates shooting data at regular intervals.

Then, the start of FIG. 4 is the start point of the monitoring of entry into the storage room 400. For example, it is the time when the main powers of both the monitoring camera 300 and the multifunction peripheral 200 are turned on. When continuing the monitoring, the monitoring camera 300 and the multi-function device 200 are maintained in the state where the main power is turned on. The surveillance camera 300 continues shooting. Electric power is continuously supplied to a portion of the multi-function device 200 that processes the shooting data generated by the monitoring camera 300. Note that, during the continuation of the monitoring, the control unit 1 stops the power supply to the portion that has not been used for a certain period of time.

The control unit 1 continues to check whether or not a person has entered the storage room 400 (step #11, No in step #11 → step #11). When recognizing that the door 500 has been opened/closed based on the output of the door sensor 800, the control unit 1 may determine that a person has entered the storage room 400. Further, the control unit 1 may determine that a person has entered the storage room 400 based on the shooting data. The shooting range of the surveillance camera 300 is fixed. When there are no people in the room, the captured image does not change significantly. The generation of similar shooting data is repeated. When recognizing the presence of a moving object, the control unit 1 may determine that a person has entered the storage room 400. For example, the control unit 1 monitors the shooting data. The control unit 1 compares two pieces of imaging data that are continuous in time, and counts the number of pixels whose pixel values have changed by a predetermined value or more. The control unit 1 may determine that the storage room 400 has been entered when the count number is equal to or greater than a certain number.

When it is determined that a person has entered storage room 400 (Yes in step #11), control unit 1 causes communication device 6 to transmit a lock instruction signal to lock device 600 (step #12). Based on the locking instruction signal, the locking mechanism 601 locks the door 500 (step #13).

After locking the door 500, the control unit 1 starts the process of identifying the person who entered the room. Here, the personal information data 7 is stored in the storage unit 2 in a non-volatile manner in order to identify the person entering the room. For example, the personal information data 7 is stored in the storage 22. The personal information data 7 is data of a person (qualified person) who can take out the article. The personal information data 7 is prepared for each person who can take out the article. The personal information data 7 can be input on the operation panel 4. The personal information data 7 can also be registered by transmitting the personal information data 7 from the computer 700.

In the personal information data 7, information on a person who can take out the article is written. Information about a predetermined item is written. In the personal information data 7 shown in FIG. 5, the predetermined items are employee number, name, address, and face image data 71. Each piece of personal information data 7 includes face image data 71 of the corresponding person.

The control unit 1 identifies a person who has entered the room based on the image data and the face image data 71 obtained by the image capturing by the surveillance camera 300. In other words, the control unit 1 identifies a person who has entered the room by face recognition. The control unit 1 (image processing unit 12) processes photographed data. Face authentication is performed based on the processing of the image processing unit 12. For face recognition, the surveillance camera 300 is provided at a position where the face of a person entering the room can be captured.

In order to identify the person who entered the room, the control unit 1 (image processing unit 12) performs a face area detection process on the latest image pickup data generated by the monitoring camera 300 (step #14). A range of pixel values to be treated as a skin color (skin color range) is predetermined. For example, the control unit 1 recognizes flesh color pixels in the captured data. The control unit 1 obtains the contour of the skin color pixel. For example, the control unit 1 recognizes an area in which the number of pixels in the contour is equal to or larger than a predetermined reference value and the number of pixels in the contour is the largest as a face area. The control unit 1 may perform the face area detection process using a known algorithm.

Then, the control unit 1 performs a feature point detection process for the face area (step #15). The control unit 1 determines the positions of facial feature points such as eyes, nose, and mouth. The control unit 1 normalizes the position and size of the face area using the obtained feature point positions, and generates matching data (step #16).

The controller 1 compares the collation data with each face image data 71 (step #17). The position and size of the face area of the face image data 71 are normalized in advance for comparison with the matching data. The control unit 1 compares the positions of the characteristic points and the positional relationship between the characteristic points. Then, the control unit 1 calculates the degree of coincidence. The closer the face of the matching data D4 and the face image data 71 are to each other, the smaller the calculated degree of coincidence.

The control unit 1 confirms whether or not the person who entered the room can be identified (step #18). When there is face image data 71 whose degree of coincidence exceeds the reference value, control unit 1 determines that the person who entered the room can be identified (Yes in step #18). In this case, the control unit 1 identifies the person corresponding to the face image data 71 having the highest degree of coincidence as the person entering the room (step #19). Then, this flow ends (end).

When there is no face image data 71 whose degree of coincidence exceeds a predetermined reference value, the control unit 1 determines that the occupant cannot be specified (No in step #18). Accurate identification may not be possible depending on the angle of the face, the orientation of the face, and the lighting conditions. Even if a person who has registered the personal information data 7 enters the room, the control unit 1 may determine that no one can be identified. Therefore, when the person who has entered the room cannot be specified (No in step #18), the control unit 1 confirms whether or not the determination of non-identification has been performed continuously for a predetermined reference number of times (step #110). The reference number of times is set appropriately.

When it is determined that the identification cannot be performed continuously for the reference number of times (No in step #110), the flow returns to step #14. When the determination of non-identification continues for the reference number of times (Yes in step #110), an unrelated person may enter the storage room 400. Therefore, the control unit 1 causes the communication unit 6 to transmit to the address of a predetermined manager that the person who cannot enter the room cannot be specified (step #111). The administrator is notified of the abnormality. Note that the door 500 remains locked in step #13. Then, this flow ends (end).

An example has been described in which the surveillance camera 300 is used to identify a person entering the room by face authentication. However, the person entering the room may be identified based on the information input to the operation panel 4. In this case, the person entering the room inputs information using the operation panel 4 (touch panel 42). The touch panel 42 functions as an acquisition unit. The acquisition unit acquires information for identifying a person who has entered the room. The person entering the room inputs predetermined information among the information defined in the personal information data 7. For example, a person entering the room inputs an employee number and a name. The control unit 1 confirms whether the stored personal information data 7 matches the input information. When they match, the control unit 1 identifies the person corresponding to the matched data as the person who entered the room. When they do not match, the control unit 1 determines that the occupant cannot be specified. The control unit 1 determines that there is no entry authority. In this case, when the input information does not match the personal information data 7 a plurality of times in succession, the control unit 1 causes the communication unit 6 to send a message to the administrator's address that the occupant cannot be identified.

Further, the person who enters the room may be identified by reading the information registered in the card or the mobile communication device. The mobile communication device is, for example, a smartphone. In this case, the multifunction device 200 is provided with a reader 45 for reading information (see FIG. 2). The reader 45 functions as an acquisition unit. The reader 45 reads information from a card or a mobile communication device by wireless communication, for example. The control unit 1 confirms whether or not the stored personal information data 7 matches the read information. When they match, the control unit 1 identifies the person corresponding to the matched data as the person who entered the room. When they do not match, the control unit 1 determines that the occupant cannot be specified. When it is determined that the person who entered the room cannot be identified, the control unit 1 causes the communication unit 6 to transmit to the address of the administrator that the person who cannot enter the room cannot be identified.

In addition, in the following description, the person who entered the room specified by the control unit 1 is referred to as a specified person.

(Processing when identifying a person entering the room)
Next, an example of the flow of processing when the article management system 100 according to the embodiment identifies a person who enters the room will be described with reference to FIGS. 6 and 7. FIG. 6 is a diagram showing an example of a flow of processing when the article management system 100 according to the embodiment identifies a person who has entered the room. FIG. 7 is a diagram showing an example of the selection screen 46 according to the embodiment.

When the person entering the room is specified, the control unit 1 displays the selection screen 46 on the display panel 41 (step #24). The selection screen 46 is a screen for selecting an operation to be performed. The control unit 1 causes the selection screen 46 to display a plurality of buttons. FIG. 7 shows an example of the selection screen 46.

The selection screen 46 is provided with a first button B1, a second button B2, and a third button B3. The specific person operates the first button B1 when simply leaving the storage room 400 without taking out or returning. The specific person operates the second button B2 when taking out the article. The specific operator operates the third button B3 when returning the article. Operation panel 4 accepts selection of any button (step #22). After that, the processing corresponding to the selected button is performed.

(Processing flow when the first button B1 is operated)
Next, with reference to FIG. 8, an example of the flow of processing when the first button B1 according to the embodiment is operated will be described. FIG. 8 is a diagram illustrating an example of a processing flow when the first button B1 according to the embodiment is operated.

There are cases where it is desired to leave the storage room 400 without taking out or returning. For example, it is conceivable that a person has entered the storage room 400 but does not have a desired article in the storage room 400. In addition, there may be cases where the user has forgotten the item to be returned. Then, the start in FIG. 8 is the time when the first button B1 is operated. In other words, the start of FIG. 8 is the time when the control unit 1 recognizes that the occupant desires to simply exit the storage room 400.

When the first button B1 is operated, the control unit 1 permits the exit from the storage room 400 (step #31). When permitting the exit, the control unit 1 causes the locking mechanism 601 to unlock (step #32). Then, the control unit 1 causes the storage unit 2 to store the personal information data 7 of the specific person who has just entered and left the room as the entry and exit history information H1 (step #33, see FIG. 3). With the entry/exit history information H1, it is possible to leave a history of persons who have entered/exited the room. Then, this flow ends (end).

(Processing flow when the second button B2 is operated)
Next, an example of a processing flow when the second button B2 according to the embodiment is operated will be described with reference to FIGS. 9 and 10. FIG. 9 is a diagram illustrating an example of a processing flow when the second button B2 according to the embodiment is operated. FIG. 10 is a diagram showing an example of the article management information according to the embodiment.

When the second button B2 is operated, the control unit 1 and the specific person perform a procedure for recording taking out the article. First, the control unit 1 displays the entry information screen (not shown) on the display panel 41 (step #41). Then, the control unit 1 recognizes the entered occupant information (step #42). The person entering information is information necessary for entering the storage room 400, taking out the article, and returning the article. The specific person inputs the information about the occupants.

The room entry information input screen is provided with input fields for predetermined items. When the input field is operated, the control unit 1 displays the software keyboard screen on the display panel 41. The specific person inputs information (character string or number) on the software keyboard screen. The touch panel 42 is used as an input device for inputting information. The touch panel 42 receives an input of occupant information. The specific person inputs information such as employee number, name, and address. The control unit 1 recognizes the entered occupant information.

Further, the specific person can cause the multi-function device 200 to recognize the person entering the room by displaying the person entering the room on the entry form on the surveillance camera 300. In this case, an entry form (entry ledger) is provided in the storage room 400. The entry form is a form for entering the information about the occupants with a writing instrument. The specific person fills out the information on the form. The specific person shows the entry form on the surveillance camera 300. As a result, the surveillance camera 300 photographs the entry form. Surveillance camera 300 outputs shooting data obtained by shooting the entry form. The control unit 1 (image processing unit 12) performs OCR processing on the captured data. The control unit 1 processes the photographed data and recognizes the character strings and numbers included therein. The control unit 1 recognizes the recognized character string or number as the occupant information.

The control unit 1 determines whether the recognized entering person information is correct (step #43). Specifically, the control unit 1 confirms whether or not the recognized entry person information matches the personal information data 7 of the specific person. When they match, the control unit 1 determines that the entry information is correct (Yes in step #43). When they do not match, the control unit 1 determines that the entry information is incorrect (No in Step #43).

When the occupant information is not correct (No in step #43), the controller 1 does not permit the exit (step #44). The door 500 is kept locked, which does not permit exit. When the exit is not permitted, the control unit 1 causes the communication unit 6 to transmit to the administrator's address that it is determined that the exit is not permitted (step #45). Then, the flow returns to step #41.

When the occupant information is correct (Yes in step #43), control unit 1 causes the notification unit to notify the request message (step #46). The request message is a message requesting an operation for specifying an item to be brought out to a specific person.

In the article management system 100, a code is attached in advance to each article stored in the storage room 400. The code includes information for identifying the item. The code is, for example, a QR code (registered trademark) or a bar code. The request message is a message requesting that the code attached to the article be directed to the surveillance camera 300. For example, the control unit 1 causes the display panel 41 to display the request message. Moreover, the control unit 1 may cause the speaker 44 to reproduce the request message. Thereby, it is possible to inform the specific person that the code of the article should be directed to the camera.

Then, the control unit 1 (image processing unit 12) confirms whether or not the article which the specific person is going to bring can be specified (step #47). Here, a number is assigned to each stored item. The storage unit 2 stores the article code data C1. The item code data C1C1 defines a number corresponding to the item. Further, in the item code data C1, the type of item corresponding to each number is defined.

Specifically, the control unit 1 recognizes the code of the article included in the shooting data. In other words, the control unit 1 recognizes the code attached to the article. When the code can be recognized, the control unit 1 decodes (decodes) the code and recognizes the coded number. The control unit 1 refers to the recognized number and the item code data C1 to specify the item.

When the code cannot be recognized, or when the code is decrypted and the article to be brought out cannot be specified (No in step #47), the control unit 1 may notify the notification unit of the message ( Step #48). The message informs that the item should be aimed at the surveillance camera 300 so that the item can be identified. For example, the control unit 1 may cause the display panel 41 to display that the article cannot be identified and that the angle or position of the article should be changed. Further, the control unit 1 may cause the speaker 44 to reproduce a voice indicating that the article cannot be specified and that the angle or position of the article should be changed. Then, the flow returns to step #47.

When the article can be identified (Yes in step #47), the control unit 1 permits the exit from the storage room 400 (step #49). When permitting the exit, the control unit 1 causes the locking mechanism 601 to unlock (step #410). Control unit 1 stores article management data 8 in storage unit 2 (step #411). This ends the flow (end).

FIG. 10 shows an example of the article management data 8. The control unit 1 combines the plurality of pieces of information to generate the article management data 8. In the article management data 8 of FIG. 10, the information in the columns of employee number, name, and address is information based on the occupant information. The item number information in the item management data 8 in FIG. 10 is a number obtained by analyzing the code. The information in the article type column is information obtained by reading out the article type corresponding to the number from the article code data C1. Further, the control unit 1 adds the take-out date and time to the article management data 8. The control unit 1 treats the unlocked date and time as the brought-out date and time.

The control unit 1 may add the information indicating the return deadline of the article to the article management data 8. The control unit 1 may automatically set the return deadline. The operation panel 4 may also accept the setting of the return deadline. When the return deadline is set on the operation panel 4, the set return deadline is added to the article management data 8.

When the article management data 8 includes a return deadline, the control unit 1 causes the communication unit 6 to send a return deadline message toward the address of the specific person corresponding to the article management data 8. The address of the specific person corresponding to the article management data 8 is included in the article management data 8. The return deadline message is a message notifying the return deadline of the article. For example, the communication unit 6 sends an electronic mail. When the return deadline is reached or before the return deadline is reached, the control unit 1 causes the communication unit 6 to transmit a return deadline message. For example, the control unit 1 causes the communication unit 6 to transmit a return deadline message one to several days before the return deadline.

(Processing flow when the third button B3 is operated)
Next, with reference to FIG. 11, an example of a flow of processing when the third button B3 according to the embodiment is operated will be described. FIG. 11 is a diagram illustrating an example of a flow of processing when the third button B3 according to the embodiment is operated.

When the third button B3 is operated (when returning the article), the control unit 1 causes the notification unit to notify the request message (step #51). The control unit 1 (code analysis unit) confirms whether or not the specific person has specified the item to be returned (step #52). The control unit 1 recognizes the code of the article included in the shooting data. In other words, the control unit 1 recognizes the code attached to the article. When the code can be recognized, the control unit 1 decodes (decodes) the code and recognizes the coded number. The control unit 1 refers to the recognized number and the item code data C1 to identify the returned item.

When the code cannot be recognized, or when the decrypted code cannot identify the returned article (No in step #52), the control unit 1 may cause the notification unit to notify the message (step #53). The message here is a message informing that the article should be directed to the surveillance camera 300 so that the article can be identified. For example, the control unit 1 may cause the display panel 41 to display that the article cannot be identified and that the angle or position of the article should be changed. Further, the control unit 1 may cause the speaker 44 to reproduce a voice indicating that the article cannot be specified and that the angle or position of the article should be changed. Then, the flow returns to step #51.

When the article can be identified (Yes in step #52), the control unit 1 permits the exit from the storage room 400 (step #54). When permitting the exit, the control unit 1 causes the locking mechanism 601 to unlock (step #55). The control unit 1 updates the article management data 8 in the storage unit 2 (step #56). Specifically, the control unit 1 adds data (flag) indicating that the product has been returned to the product management data 8 corresponding to the specified product. The rightmost column of the article management data 8 shown in FIG. 10 is data indicating whether or not the item has been returned. At this time, the control unit 1 may cause the display panel 41 to display a map indicating the storage location of the article. This ends the flow (end).

In this way, the article management system 100 according to the embodiment includes the monitoring camera 300 and the image processing device (multifunction device 200). The surveillance camera 300 is provided in a storage room 400 that stores articles. The surveillance camera 300 photographs the inside of the storage room 400 and outputs the photographing data. The image processing apparatus identifies the person who has entered the storage room 400 by using the personal information data 7 registered in advance, which is the data of the person who can take out the article. The image processing apparatus recognizes the entering person information, which is information that is input by the identified person who is the identified entering person and is necessary for managing the article. The image processing apparatus collates the personal information data 7 of the specific person with the entry person information to determine whether the entry person information is correct. The image processing apparatus, when determining that the entry information is correct, generates the article management data 8 including the entry information. The image processing apparatus stores the generated article management data 8 in the storage unit 2 and permits the storage unit 400 to exit. The image processing apparatus does not permit the exit from the storage room 400 when it is determined that the entry information is incorrect.

As a result, it is possible to leave accurate room visitor information as a record of taking out. The administrator does not have to check whether the record of taking out is correct. The burden on the administrator can be made lighter than before. In addition, exit permission is issued to those who can take out the article. It is possible to enhance security in storage of articles. The decision as to whether or not to permit the exit from the storage room 400 can be automated.

The image processing apparatus recognizes the code attached to the article based on the captured data. The image processing apparatus identifies the article to be taken out based on the code. The image processing apparatus includes information indicating the specified item in the item management data 8. The image processing apparatus determines the exit permission after the article to be taken out can be specified. As a result, the information indicating the brought-out article and the person entering the room can be automatically included in the article management data 8. It is possible to accurately record who takes out what item.

The image processing device includes a notification unit (display panel 41, speaker 44). When the article to be taken out cannot be specified, the image processing apparatus causes the notification unit to notify that the article should be directed to the surveillance camera 300 so that the article can be specified. This can inform that the code should be directed to the surveillance camera 300 so that the item can be identified.

The image processing apparatus includes an input device (touch panel 42). The input device receives an input of occupant information. As a result, the specific person can input the entering person information to the image processing apparatus using the input device.

The image processing apparatus recognizes the occupant information entered in the entry sheet based on the image data obtained by taking an image of the entry sheet for entering the occupant information. As a result, it is possible to easily take in the room entry information entered on the form. It is not necessary to input the person entering information entered on the form into the image processing apparatus.

Each piece of personal information data 7 includes face image data 71 of the corresponding person. The image processing device recognizes a face image area included in the captured data. The image processing apparatus compares the face image area with the face image data 71 to identify a person who has entered the room. As a result, it is possible to identify the person who entered the room by the face authentication. It is possible to easily and quickly identify the person who entered the room.

The image processing apparatus includes an acquisition unit (reader 45) that acquires information for identifying a person who has entered the room. The image processing apparatus compares the information acquired by the acquisition unit with each piece of personal information data 7 to identify a person who has entered the room. Thus, the person entering the room can be authenticated (specified) by inputting the information into the image processing apparatus.

The article management system 100 includes a locking device 600 that locks a door 500 provided at an entrance of a storage room 400. When the exit is not permitted, the image processing device sends a signal to the locking device 600. The image processing apparatus keeps the door 500 locked. This makes it possible to prevent the specified person from leaving when the take-out of the article cannot be correctly recorded. If inaccurate information is recorded, the item can be kept out.

The image processing device includes a communication unit 6. When the exit is not permitted, the image processing apparatus causes the communication unit 6 to transmit to the predetermined administrator address that the exit is not permitted. As a result, it is possible to inform the manager of the article that the take-out of the article cannot be correctly recorded.

The image processing device causes the locking device 600 to lock the door 500 when the person entering the room cannot be identified. The image processing apparatus causes the communication unit 6 to transmit to the address of a predetermined manager that the person who has entered the room cannot be identified. Thus, when an unauthorized person who takes out the article enters the storage room 400, the intruder can be confined. In addition, the administrator can be notified that the intruder has entered the storage room 400.

When the article management data 8 includes a return deadline, the image processing apparatus directs the return deadline toward the address of the specific person corresponding to the article management data 8 when the return deadline is reached or before the return deadline is reached. The message is transmitted to the communication unit 6. Thereby, the person who takes out the article can be notified of the return deadline. You can encourage the return of goods.

Although the embodiment of the present invention has been described, the scope of the present invention is not limited to this, and various modifications may be made without departing from the spirit of the invention.

INDUSTRIAL APPLICABILITY The present invention can be used for an entry/exit management system including an image processing device and a surveillance camera.

100 Item management system 200 Multi-function machine (image processing device)
300 Monitoring Camera 400 Storage Room 600 Locking Device 41 Display Panel (Notification Unit)
42 Touch panel (acquisition unit, input device)
44 speaker (notification section) 45 reader (acquisition section)
6 Communication Department 7 Personal Information Data 71 Face Image Data 8 Goods Management Data

Claims (11)

A surveillance camera that is provided in a storage room for storing articles, shoots the storage room, and outputs shooting data,
The data of persons who can take out the article, by using the personal information data registered in advance to identify the person who entered the storage room,
It is entered by the specific person who is the person who entered the room, and recognizes the person entering the room, which is information necessary for managing the article,
By collating the personal information data of the specific person with the entry information, it is determined whether the entry information is correct,
When it is determined that the room entry information is correct, the article management data including the room entry information is generated,
While storing the generated article management data in the storage unit, permitting exit from the storage room,
An article management system, comprising: an image processing device that does not permit exit from the storage room when it is determined that the room entry information is incorrect. The image processing device,
Recognize the code attached to the article based on the shooting data,
Based on the code, identify the item to be taken out,
Including information indicating the specified item in the item management data,
The article management system according to claim 1, wherein the exit permission is determined after the article to be taken out can be specified. The image processing device,
Including the notification unit,
The article management system according to claim 2, wherein when the article to be taken out cannot be identified, the notification unit is informed that the article should be directed to the surveillance camera so that the article can be identified. The image processing apparatus includes an input device,
The article management system according to any one of claims 1 to 3, wherein the input device receives an input of the entering person information. The image processing device,
2. The room entry information entered in the entry sheet is recognized based on the image data obtained by shooting an entry sheet for entering the entry person information. Item 4. The article management system according to any one of item 4. Each of the personal information data includes face image data of a corresponding person,
The image processing device,
The face image area included in the captured data is recognized, and the face image area and the face image data are compared to identify the person who entered the room. The article management system described. The image processing device,
Including an acquisition unit that acquires information for identifying the occupants,
The article management system according to any one of claims 1 to 6, wherein the person who entered the room is specified by comparing the information acquired by the acquisition unit with each piece of the personal information data. Including a locking device for locking the door provided at the entrance of the storage room,
When you do not permit exit
The image processing device,
Sends a signal to the locking device,
The article management system according to claim 1, wherein the door is maintained in a locked state. The image processing device,
Including communication section,
9. When the exit is not permitted, the communication unit is caused to transmit to the address of a predetermined administrator, the decision that the exit is not permitted is transmitted to the communication unit. Goods management system. Including a locking device for locking the door provided at the entrance of the storage room,
The image processing device,
Including communication section,
When the room occupant cannot identify who is, the lock device is caused to lock the door, and the fact that the room occupant cannot be identified is transmitted to the communication unit toward a predetermined administrator address. The article management system according to any one of claims 1 to 9, which is characterized. The image processing device,
Including communication section,
If the article management data includes a return deadline,
When the return deadline is reached or before the return deadline is reached, a return deadline message is transmitted to the communication unit toward the address of the specific person corresponding to the article management data. The article management system according to any one of claims 1 to 10.

Images