KR20140028351A - System and method for controling book rent/return using camera - Google Patents

Abstract

The present invention relates to a book rental system of a library and, more particularly, to a system and a method for controlling book rental and return using a camera, which comprise: photographing rented and returned books using a camera; managing book rental and return; and performing user authentication using an allowed face image of a user. According to the present invention, disputes with users and civil complaints can be reduced by photographing books which are being rented or returned and using the photographed images as proof when a problem occurs with a user.

Description

System and method for book situation control using cameras {System and method for controling book rent / return using camera}

The present invention relates to a book loan system of a library, and more particularly, to manage loans and returns of books by photographing loans and returned books using a camera, and performing user authentication using a user's allowed face image. It relates to a book situation control system and method using a camera.

In general, the library is a local community place where residents and students acquire the necessary knowledge and information through space, and realize cultural activities and lifelong education.

Normally, the library borrows books and returns books to enable residents and students (hereinafter referred to as "users") to acquire knowledge and information. Generally, these libraries are equipped with book borrowing systems to manage the borrowing and returning of books.

Typically, the book borrowing system reads the information of the RFID tag and the RFID tag attached to each of the books held in the library, and the user's information such as a name, a unique number, an address and a telephone number for each user is registered in advance And a book borrowing / returning device for reading the information and managing the borrowing and returning of the book. The book information of the attached book is stored in the RFID tag, and the book lending / returning device stores the information of the RFID tag (hereinafter referred to as "book information") and the information (Hereinafter referred to as "booklet information") to manage the book borrowing and returning.

Recently, unauthorized book lending / returning system which can borrow books directly by users by using the unauthorized book lending machine is applied without going through the book lending manager.

In this way, the book can be loaned and returned without going through the book borrowing manager, and even when the book borrowing manager is used, the book is loaned and returned by the radio book recognition using the RFID tag, The number of books at the time of return and the number of books at the time of return may be different from each other. Even if such a problem occurs, there is no definite evidence, and there was a problem that a dispute may arise between the observation of the book and the user.

In addition, there is a problem that an untrained book loan manager may cause an error in operation, the book may be lost, disputes with the users of the book, and complaints may occur.

In addition, the unauthorized book lending / returning system of the prior art can be illegally borrowed through the unmanned lending / returning machine by relying only on the information read from the RFID tag (chip) attached to the book by unmanned and it is difficult to manage the appendix attached to the book There was a problem.

Accordingly, an object of the present invention is to control the loan and return of the book by using the camera to manage the loan and return of the book, the book situation control system and method using a camera to perform the user authentication using the user's allowed face image In providing.

In order to accomplish the above object, the system for controlling the book situation using the camera of the present invention is a system for reading book information attached to a book at the time of lending or returning a book, reading information of a user's book, And transmits the book use request signal including the photographed book loan / return video, the book information, and the deposit information, and receives the book grant / return permission notification according to the book use request signal, Book borrowing / paying for performing the loan and return processing of the book; And a book borrowing / returning image containing the book use request signal and storing the included book borrowing / returning image, displaying a book return image of the book returned when the book is returned and a previously stored book borrowing image corresponding to the book, And a book control server unit for notifying the book use permission to the return unit.

The book borrowing / returning unit transmits a book use request signal to the book control server unit when the book is returned / returned, and transmits the book use request signal of the book use request signal from the book control server unit And transmits a legitimate user notification by approval of the book loan / return from the book loan manager to the book control server unit, and in response thereto, transmits the book use permission notice from the book control server unit And a librarian terminal for performing lending and return processing of the book.

The book borrowing / returning unit transmits to the book control server unit a book use request signal including the book information, the book borrowing information and the book borrowing / returning image including the face of the user at the time of borrowing / returning the book, The book management server unit registers the face image of the user included in the book use request signal and the book borrowing certificate information in advance, The facial image or facial image of the facial feature information is compared with each other to perform user authentication by facial recognition to determine whether to notify the use of the book.

The book borrowing / returning unit transmits a book use request signal to the book control server unit when the book is returned / returned, and transmits the book use request signal of the book use request signal from the book control server unit And transmits a legitimate user notification from the book borrowing manager to the book control server unit via the book borrowing / return approval, and then transmits the book use permission notice from the book control server unit to the book control server unit A librarian terminal for performing lending and return processing of the book, and a book use request signal including the book information, the book lending information, and the book lending / return image including the face of the user at the lending / returning of the book, In response to this, the user is notified of permission to use the book, The library control server unit receives a book use request signal from the librarian terminal and receives a face image of the user corresponding to the book rental request information of the book use request signal, The face image of the user included in the book use request signal from the unmanned lending / returning terminal is compared with face image information which is registered in advance with respect to the book borrowing certificate information, And the user authentication is performed to determine whether the user is allowed to use the book.

The facial image information registered in advance by the book control server unit with respect to the booklet lease information is an image of a face of at least one or more family members including the user of the book lease certificate and the user of the user's family.

The librarian terminal includes a video processing unit for outputting a video of the book position, including a camera for photographing a specific book position on which a book to be borrowed and returned is placed, book information and book information attached to the book An input unit for inputting a command from the book borrowing / returning manager, a display unit for displaying face image information of the user corresponding to the read book information and book lease information, , A communication unit for performing data communication with the book control server unit, and a book reading unit for reading the book information and the book lending information of the user through the information reader unit when lending and returning the book, and controlling the image processing unit, The photographed book borrowing / returning image, the book information, Transmitting a book using the request signal also through the communication unit, and to receive a book loan / return permit notification according to the book using the request signal via the communication unit a control unit for performing the loan and return processing of the book characterized.

The book information and the book lease information are stored in respective RFID tags, and the information reader unit is an RFID reader unit for reading book information and book lease information from the RFID tags wirelessly.

The unmanned lending / returning terminal includes an unmanned lending / returning terminal including an image of the book position and the user's face photographed including at least one camera for photographing a specific book position and a user's face on which a book to be borrowed and returned is placed, An information reader for reading out and outputting book information and book borrowing information of each book from an RFID tag attached to the book placed at the book position, an input unit for receiving a command from the book borrowing / returning manager, A display unit for displaying the read book information and the book lending information and the face image information of the user corresponding to the book lending information, a communication unit for performing data communication with the book control server unit, Reading the book information and the information of the user's book lease information through the book, The control unit controls the processing unit to photograph the book and the face of the user placed at the book location, transmit the book use request signal including the photographed book loan / return image, the face image of the user, the book information, And a controller for receiving the book borrowing / return permission notification according to the book use request signal through the communication unit and performing the borrowing and return processing of the book.

Wherein the control unit compares the image data input from the image processing unit with image data of a predefined book location to determine whether the shooting range of the camera is out of the book position, A camera for judging whether a book of image data is out of the book position, a camera for controlling the alarm unit to generate an alarm when the shooting range of the camera is out of the book position or the book is out of the book position, And a position recognition module.

Wherein the control unit compares the image data input from the image processing unit with image data of a predefined book location to determine whether the shooting range of the camera is out of the book position, A camera for judging whether a book of image data is out of the book position, a camera for controlling the alarm unit to generate an alarm when the shooting range of the camera is out of the book position or the book is out of the book position, And a position recognition module.

The book control server unit includes a network video recorder for storing the book borrowing / returning image, a book borrowing / returning image receiving unit for receiving the book borrowing request signal and storing the book borrowing / returning image in the network video recorder, And a book control server displaying the book return image of the book and the previously stored book rental image corresponding to the book, and notifying the book borrowing / returning unit of the book use permission.

The book control server comprises: a communication unit for performing data communication with the network video recorder and the book borrowing / paying unit; And determines whether the received book use request signal is received from the librarian terminal or received from the unmanned lending / return terminal, determines whether the request signal is a loan request signal or a return request signal, and outputs a book use request signal A face recognition module for performing face recognition by comparing the face image data of the user included in the book use request signal with a preset face image of the user, and a book use request signal through the book lending / If the signal is a signal received from the terminal, outputs a face image of the user corresponding to the book borrowing information of the use request signal, and if the book use request signal is a signal received from the unmanned lending / The face image data of the user A user identification unit for receiving a face recognition result and performing a user authentication; a book use request signal input through the book borrowing / return destination determination unit is a book borrowing request signal received from a librarian terminal; And transmits the user's facial image output from the user to the librarian terminal through the communication unit, and when a legitimate user communication signal is received, / Returning terminal, if the user who has performed the face recognition through the lending user identification unit succeeds in the authentication of the book, the book use permission notification signal is provided to the unmanned lending / returning terminal to allow the book use, Data via the communication unit. A lending module for storing a user face image output from the lending user identification unit when the book use request signal input through the book lending / return destination determining unit is a book return request signal received from the librarian terminal, And when a legitimate user communication signal is received, a book use permission notification signal is acquired and provided to the terminal to allow return of the book, and when the book use request signal is a book return request signal received from the unmanned lending / When the user who has performed face recognition through the lending user identification unit succeeds in the authentication, a book use permission notification signal is provided to the unmanned lending / returning terminal to permit the book use, and the book return image data is stored in the network video recorder Return module .

In order to achieve the above object, the present invention provides a method for controlling a book situation using a camera, the method comprising the steps of: reading / reading book information from an RFID tag attached to the book at the time of lending / A loan / return for requesting lending / returning by sending a book use request signal including the photographed book borrowing / returning image, the book information, The book control server receives the book use request signal and stores the photographed book loan / return image included therein, and stores the book return image of the book returned when the book is returned and the previously stored book loan image A book control process for notifying the book borrowing / returning unit of permission to use the book, and the book borrowing / returning And a book borrowing / returning process for borrowing and returning the book by receiving the book borrowing / return permission notice according to the book borrowing request signal.

The book control process includes an image storage step in which the book control server unit receives the book use request signal and stores the included image book borrowing / returning image, a book returning image of the book returned when the book is returned, If the book lending / return unit receives the book use request signal, the face image of the user corresponding to the book lending information included in the book use request signal, And a step of allowing the book borrowing / returning unit to notify the book use permission when a proper approver notification is received in response to the transmission of the face image of the user, The processing is such that the librarian terminal of the book borrowing / Displaying a face image of the user corresponding to the book borrowing information of the book use request signal from the server unit and displaying the face image of the user corresponding to the book borrowing information of the book use request signal from the server unit; And a book borrowing / returning processing step of receiving the book use permission notice from the book control server unit in response to the legitimate approver notification and performing the book borrowing and return processing, .

The lending / return requesting step includes a book information obtaining step of reading book information of the book to be loaned or returned, a book borrowing information obtaining step of reading book borrowing information of the user who borrowed the book, And acquiring face image data of the user by photographing the face of the user and the face of the user, and transmitting the book use request signal including the book information, the book rental information, the book, and the face image data of the user, The book control process includes a book control server unit receiving the book use request signal and storing the taken book and user face image data including the book and user face image recording step And the return image of the book to be returned when the book is returned and the corresponding to the book A user authentication step of loading a user face image of a user corresponding to the face image data of the user and the user's face image information and authenticating the user by face recognition And allowing the use of the book to be notified to the unmanned lending / returning terminal when the user is successfully authenticated.

The user face image includes at least one family face image including at least a face image of the user among the user and the user family.

The lending / return requesting step includes a book information obtaining step of reading the book information of the book to be loaned or returned, a book borrowing information obtaining step of reading book borrowing information of the user who borrowed the book, A video data acquisition step of acquiring book borrowing / returning video data by photographing a book, and a book requesting a loan / return by transmitting a book use request signal including the book information, book borrowing stamp information, and book borrowing / The book control process includes a video recording step of storing the photographed book image data that is received by the book control server unit from the book use request signal, A book use display step for displaying a book return image and a previously stored book loan image corresponding to the book And a user image providing step of loading a user image of the user corresponding to the book loan certificate information of the book use request signal and transmitting the user image to the librarian terminal, and receiving a legitimate user notification from the librarian terminal in response to the user image provision. And a book use permission step of providing a book use permission notification to a terminal, wherein the librarian terminal displays a user image of the user received from the book control server unit in the user image providing step and displays the user image displayed from the book loan / return manager. Determining whether or not to input a legitimate user authentication success command based on a match between a user and a user to be loaned or returned, and further comprising a user authentication process of notifying the book user server to the book control server unit when the authentication success command is input. Thing .

The image data acquiring step may include acquiring image data obtained by driving the camera by comparing the photographed image data with photographed image data of a book location on which a book is to be placed, A bookmark position determination step of determining whether a book is placed in the bookmark area if it is determined that the bookmark area is being photographed; And an image data storing step of storing image data of a taken book.

And generates an alarm when the camera determines that the book position area is not photographed or the book is not located in the book position area in the book position photographing area determination step.

The present invention has the effect of reducing disputes and complaints with users because it can be used as evidence when a problem with a user occurs because the user borrows or returns the book by using a camera when borrowing or returning the book.

In addition, the present invention can be applied to a case where a book is loaned and returned by using an unmanned book borrowing terminal, the face of the user is photographed, and a face image of the user, which is photographed in advance, It is possible to prevent the book borrowing and return by the person other than the user of the book borrowing certificate by performing the recognition, and it is possible to prevent the loss of the book due to the effect.

In addition, the present invention can register the still image or facial feature information of the user's family in advance and allow the user to borrow and return the book in addition to the user of the booklet, thereby improving the convenience of the user while preventing illicit lending of the book It has the effect of being able to.

In addition, the present invention detects and notifies a focus deviation so that an area photographed through a camera can continuously photograph a book position area on which a book to be borrowed and returned is placed, It is possible to improve convenience in terms of the book loan / return manager.

In addition, the present invention prevents personal information from being unnecessarily exposed by editing and storing personal information cards automatically in the image of a personal information card such as a resident registration card and a personal credit card, which may be required when lending and returning, .

1 is a block diagram of a system for managing a book situation using a camera according to the present invention.
FIG. 2 is a block diagram of a book borrowing / returning unit of a book situation control system using a camera according to the present invention.
3 is a block diagram of a book control server of a book situation control system using a camera according to the present invention.
FIG. 4 is a flowchart illustrating a method of controlling a book situation using a camera when a book lending / returning unit is a librarian terminal according to the present invention.
FIG. 5 is a flowchart illustrating a method of controlling a book situation using a camera when the book borrowing / returning unit according to the present invention is an unmanned (book) borrowing / returning terminal.
FIG. 6 is a flowchart illustrating a camera photographing position and a method of notifying a lending / returning book position in a book borrowing / paying part according to the present invention.
FIG. 7 is a flowchart illustrating a method for deleting a personal information card in a photographed image in a book borrowing / paying-in method according to the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout.

1 is a block diagram of a system for managing a book situation using a camera according to the present invention.

The book situation control system using a camera according to the present invention includes a book borrowing / paying part 100 and a book control server part 400 connected to the book borrowing / paying part 100 through a network 150. [

The network 150 may be a private network, a local area network (LAN), a WiFi network, or the like.

The book borrowing / paying part 100 reads and acquires the book information from the RFID tag attached to the book at the time of borrowing and returning the book, reads the book borrowing information from the book borrowing certificate, acquires the book borrowing and returning money, The book is photographed to obtain book borrowing / returning image data, book borrowing / returning image data, and user face image data. The photographed book borrowing / returning image data is transmitted to the book control server unit 400 on the basis of the book use request signal together with the book information and the book borrowing certificate information. In response to the book use request signal, the book borrowing / returning unit 100 performs a book borrowing and return processing when a book borrowing / returning permission notice (signal) is received from the book control server unit 400.

The book borrowing / returning unit 100 includes at least one of the librarian 110 and the unmanned lending / returning terminal 120. However, it would be desirable to be configured to include both.

When the book borrowing / paying part 100 is the librarian terminal 110, the librarian terminal 110 can not photograph the face of the customer. Accordingly, the librarian 110 transmits a book use request signal including book information, book borrowing information, and book borrowing / returning image data to a book control server unit 400, 400) receives and displays a user face image related to the user corresponding to the book lending information included in the book use request signal, and a legitimate user approval instruction is inputted by the book lending / return manager (or "librarian" It will process the loan and return of the book. The user face image may be one or more family face pictures or facial feature information including at least a user of the user and the user's family.

On the other hand, when the book borrowing / returning unit 100 is the unmanned lending / returning terminal 120, the unmanned lending / returning terminal 120 can photograph the face of the user, And sends the book and user face image data to the book control server unit 400 in the book use request signal.

Then, the book control server unit 400 performs face recognition by comparing the book and user face image data with facial image information of the user and the user family stored in advance, and notifies the book use permission notice when the authentication is successful by face recognition To the unmanned lending / returning terminal 120.

The book control server unit 400 includes a network video recorder (NVR) 300 and a book control server 200.

The book control server 200 stores and displays the book borrowing and returning images so as to control the overall situation of the book borrowing and returning in the library and performs the overall operation related to the user authentication.

Specifically, the book control server 300 receives the book use request signal from the book borrowing / returning unit 100 as described above, and transmits the book borrowing / returning image data or the book borrowing / And the face image data of the user are stored and managed in the NVR 300, and the loan and return image data and the user face image data are displayed on the screen so that the administrator can control the book borrowing and returning status.

In addition, the user authentication process is performed according to whether the book borrowing / paying part 100 is the librarian 110 or the unmanned lending / returning terminal 120, and the book use permission notice corresponding to the user authentication success is stored in the book borrowing / (100).

FIG. 2 is a block diagram of a book borrowing / returning unit of a book situation control system using a camera according to the present invention.

Referring to FIG. 2, the configuration of the librarian 110 and the unmanned lending / returning terminal 120 are the same as the book borrowing / paying part 100, and the number and position of the cameras, whether the book borrowing / Only the user interface and the control operation are different.

More specifically, the book borrowing / loading section 100 includes a control section 111, a storage section 112, an input section 113, a display section 114, a communication section 115, an information reader section 116, (117) and an alarm unit (119).

The control unit 111 controls the overall operation of the book borrowing / returning unit 100 of the present invention for performing book borrowing and returning processing. In particular, the control unit 111 acquires the book information, the user's lending information, the book borrowing / returning image data, the book borrowing / returning image data, and the user's face image data, and generates a book use request signal including the information do. The control unit 111 defines a predetermined book location area to acquire the book borrowing / returning image data, determines whether the area photographed by the camera photographs an area other than the book location area, And an autofocusing module 10 for determining whether a book is placed in the area or is out of the area.

In addition, the control unit 111 monitors whether the personal information card such as a personal identification card and a driver's license such as a user's personal identification card and a driver's license is present in the photographed book loan / return video data, And a personal information processing module 20 for editing and erasing the personal information card from the image data and storing the personal information card. Upon detection of the personal information card, the personal information processing module 20 may be configured to output an alarm sound or an alarm sound through the alarm unit 119 and the speaker SP.

When the book borrowing / circulating unit 100 is the librarian terminal 110, the control unit 111 displays the face image of the user received in response to the transmission of the book use request signal on the display unit 1140, ), A legitimate user notification signal is generated from the book borrowing / returning administrator through the book borrowing / returning manager and provided to the book control server unit 400. When the book use permission notifying signal is received in response to the legitimate user notification signal Perform the loan or return approval dynamics.

On the other hand, when the book borrowing / returning unit 100 is the unmanned lending / returning terminal 120, the control unit 111 not only transmits the book borrowing / returning image data but also the face image data of the user through the image processing unit 117 And generates and transmits the book use request signal. When the book use permission notification signal is received through the communication unit 115, the book borrowing or return processing is performed.

The storage unit 112 includes a program storage area for storing a control program for controlling the operation of the book borrowing / loading unit 100 according to the present invention, a temporary area for temporarily storing data generated during the execution of the program, A book borrowing history DB storing book borrowing history information according to the book borrowing and returning, and an identification card such as a resident registration card, a student ID card, a driver's license, and a credit card (hereinafter, (Hereinafter referred to as "personal information card"), and the like.

The input unit 113 may include at least one of a keyboard, a mouse, and a touch pad. The input unit 113 outputs a signal corresponding to a book borrowing / returning manager or a key or location selected or selected by the user to the control unit 111.

The display unit 114 displays various information such as book information on loan and return of books, information on the rental of books, user information, face photographs of users, and the like.

The communication unit 115 is connected to the book control server unit 400 through the network 150 so that the control unit 111 can perform data communication with the book control server unit 400.

The information reader unit 116 reads the book information and the book borrowing information of the user and outputs the read information to the control unit 111. [ If the RFID tag storing the book information and the book borrowing certificate information is attached to the book and the book borrowing certificate, the information reader unit can be the RFID reader unit 116. [ However, since only the bar code may be attached or printed, the information reader unit 116 may include an RFID reader unit and a barcode reader (not shown). In the latter case, it is necessary to have a member DB for storing user information corresponding to the barcode in the book control server unit 400 or the storage unit 112.

The image processing unit 117 photographs the book location area in which the book is placed when the book borrowing / returning unit 100 is the librarian 110, outputs the book borrowing / returning image data to the control unit 111, When the paying unit 100 is the unmanned lending / returning terminal 120, it captures the book position area and the face of the user and outputs the book borrowing / returning image data to the control unit 111. In the latter case, a camera for photographing the book position area and a camera for photographing the face of the user may be provided.

Under the control of the control unit 111, the alarm unit 119 outputs a warning sound or a warning sound.

3 is a block diagram of a book control server of a book situation control system using a camera according to the present invention.

The book control server 200 includes a control unit 210, a communication unit 220, a display unit 230, and a book borrowing / returning DB 240.

The communication unit 220 is connected to the network 150 and performs data communication with the book borrowing / loading units 100.

The display unit 230 displays images and information related to book borrowing and returning from the control unit 210.

The book borrowing / returning DB 240 stores information on usage history of each book including book use information related to book borrowing and returning. The book use details are mapped and stored in the book borrowing / returning image data stored in the NVR (300).

The control unit 210 controls the overall operation related to the book situation control of the book borrowing and returning.

Specifically, the control unit 210 generates a book borrowing / return object determining unit 211, a borrowing module 212, a loan user identifying unit 213, a face recognition module 214, a return module 215, (217).

The book borrowing / return object determining unit 211 determines whether the book use request signal received through the communication unit 220 is received from the librarian 110 or from the unmanned lending / returning terminal 120, If the book request signal is a book borrowing request, the book request signal is output to the loan module 212. If the book request signal is a book borrowing request, . The book borrowing / returning object determining unit 211 also transmits request information about whether the book use request signal is received from the librarian 110 or received from the unmanned lending / returning terminal 120.

When the book use request signal is input together with the request object information, the loan module 210 detects the book rental image data included in the book use request signal and transmits the book rental image data to the NVR 300 through the communication unit 220 to store the book, And generates a book borrowing / returning history for the user of the information and stores it in the book borrowing / returning DB 240. If the request target is the librarian terminal 110, the lending user identification unit 213 transmits the book lending information of the user. If the request target is the unmanned lending / return terminal 120, the book lending information and the book borrowing face image data To the lending user identification unit 213, and transmits a book use permission notice signal to the unmanned lending / returning terminal 120 upon successful authentication after user authentication by face recognition.

The return module 215 detects the book borrowing image data included in the book use request signal when the book borrowing request signal is input together with the request object information from the book borrowing / return object determining unit 211, and transmits the book borrowing image data to the NVR If the request object is the librarian terminal 110, the lending user ID information of the user is transmitted to the lending user identification unit 213, the user face image inputted to the lending user identification unit 213 is received, And provides it to the terminal 110.

On the other hand, if the request object is the unmanned lending / returning terminal 120, the return module 215 transmits the face image data of the user included in the book use request signal and the face image of the user photographed when the book information included in the book use request signal is loaned Transmits the data to the lending user identification unit 213 to perform user authentication by face recognition, and then provides a book use permission notification signal to the unmanned lending / returning terminal 120 upon successful authentication.

If the book use request signal is received from the librarian terminal 110 as described above, the loan user identification unit 213 receives the book deposit information from the loan module 212 and the return module 215, The corresponding user image is loaded from the book borrowing / returning DB 240 or the NVR 300 and is provided to the librarian terminal 110. When the book use request signal is the unmanned lending / returning terminal 120, the face image data of the user included in the book use request signal and the face image of the user previously recorded in advance are output to the face recognition module 214, And provides the result to the loan module 212 or the return module 215 in which the book use request signal is received.

The face recognition module 214 performs face recognition by comparing the user face image data included in the book use request signal input from the loan user identification unit 213 with user image information stored in advance, And provides the result to the lending user identification unit 213. [ The user image means face image data or facial feature data of one or more family members including at least a user of the user and the user's family.

The book control information generating unit 217 receives the book borrowing / returning image data from the borrowing module 210 and displays it on the display unit 230, displays whether the user of the book borrowing / returning image is a normal user, And displays the information on the display unit 230. The display unit 230 displays the information on the display unit 230,

FIG. 4 is a flowchart illustrating a method of controlling a book situation using a camera in the case where the book lending / returning part according to the present invention is a librarian terminal. Hereinafter, a description will be given with reference to Figs. 1 to 4. Fig.

First, the control unit 111 of the librarian terminal 110 checks whether a book use request is generated through the input unit 113 and the information reader unit 116 (S111).

The control unit 111 of the librarian 110 drives the camera 118 by controlling the image processing unit 117 to photograph the book location area where the book is loaded in accordance with the camera shooting routine, / Return image data (S112).

When the book borrowing / returning image data is obtained, the control unit 111 reads the book information and the book borrowing information from the RFID tag and the book borrowing book through the information reader unit 116 (S113).

When the book information, the book borrowing information, and the book borrowing / returning image data are acquired, the control unit 111 generates book use information including the book information, the book borrowing information, and the book borrowing / returning image data at step S115.

When the book use information is generated, the control unit 111 determines whether the book use is a loan or a return (S117), and transmits a book use request signal including a book use information to the book control server unit 400 (Return) request signal including the book use information to the book control server unit 400 (S120) if it is returned (S119).

The control unit 210 of the book control server 200 receiving the book use request signal determines whether the received book use request signal is a use request signal for the loan or a use request signal for return (S121) And generates book borrowing / return history information based on the book information and the book borrowing certificate information, stores it in the book borrowing / returning DB 240, maps the book borrowing / returning DB 240 to the book borrowing / returning DB 240, The image data is transmitted to the NVR 300 through the communication unit 220 and stored (S123).

After storing the book use information, the control unit 210 of the book control server 200 loads the user image information of the user corresponding to the book use information of the book use information from the book borrowing / returning DB 240 (S125 ) To the librarian terminal 110 (S127).

On the other hand, if the book use request signal is a return request signal in step S121, the control unit 210 loads the book use information including the book borrowing image data (S141), and transmits the book borrowing image data and the book The returned image data is compared and analyzed to determine whether the book is returned or not (S143). The main body for comparing and analyzing the book return video data at the time of the previous lending and the book return request video signals included in the book use request signal at the time of the return request may be the control unit 210, It may be an administrator to view image data. In the former case, it would be desirable to comprehensively analyze the book information and the book information by character recognition, including a book recognition means and a character recognition means. Also, the book borrowing video data may be transmitted to the librarian 110 so that the book borrowing / returning manager may determine whether the book is returned as a subject.

If it is determined that a proper book is returned, the control unit 210 receives the book use (return) permission notification signal and transmits the information to the terminal 110. If it is determined that the wrong book is returned, the bookbinding notification information is generated and transmitted to the librarian 110 . The book return notification information may be information on which book is the wrong book, information on a book other than the book on loan, or a book without a loan (books that have been borrowed but not returned).

In step S127, the control unit 111 of the librarian 110, which has received the user face image by borrowing a book, checks whether a legitimate user approval command is input from the book borrowing / returning manager through the input unit 113 and the user interface means If the user is a legitimate user, the legitimate user notification signal is transmitted to the book control server 200 of the book control server unit 400 (S131). If a legitimate user reject command indicating that the user is an illegal user is input, To the book control server 200 of the book control server unit 400 (S133).

The control unit 210 of the book control server 200 providing the user face image data to the librarian 110 checks whether a legitimate user notification signal is received or not from the librarian terminal 110 S135).

When the legitimate user notification signal is received, the book use permission notification signal is transmitted to the terminal 110 (S137). If the legitimate user notification signal is received, the illegal use book information is stored in the book loan / return DB 240 (S137) .

FIG. 5 is a flowchart illustrating a method of controlling a book situation using a camera when the book borrowing / returning unit according to the present invention is an unmanned (book) borrowing / returning terminal.

Referring to FIG. 5, the controller 111 of the unmanned loan / return terminal 120 checks whether a book use request is generated through the input unit 113 or the information reader unit 116 (S211).

When a book use request is generated, the control unit 111 controls the image processing unit 117 to photograph the face of the user who is loaned or returned through the camera 118, acquires the book loan / return image data and the user face image data (S213).

While the book borrowing / returning image and the user's face are being photographed, the control unit 111 acquires the book information from the book placed in the book location area and acquires the book borrowing information from the book borrowing certificate of the user (S215).

When the image data, the book information, and the book borrowing information are obtained, the controller 111 generates book use information including the book borrowing image data, the user face image data, the book information, and the book borrowing information (S217).

When the book use information is generated, it is determined whether the book is a loan or a return (S219). If the book use information is generated, the book use request signal including the book use information is transmitted to the book control server 200 (S221), and if it is returned, transmits a book use (return) request signal to the book control server 200 (S223).

The control unit 210 of the book control server 200 determines whether a book use request signal is received and determines whether the book use request signal is a book return use request signal or a book book use request signal in step S225.

As a result of the determination, if the request signal is a book borrowing request signal, the control unit 210 detects book borrowing information, generates book borrowing / returning history information, and stores it in the book borrowing / return DB 240 (S227).

After storing the book borrowing / return history information, the control unit 210 detects the face image of the user included in the book use request signal, loads the existing user face image of the user who borrowed the book of the book information (S229) Then, the face recognition and user authentication are performed through the loan user identification unit 213 and the face recognition module 214 (S231).

After performing the user authentication, the controller 210 determines whether the authentication is successful (S233). If the authentication is successful, the controller 210 transmits a valid user notification signal to the unmanned lending / returning terminal 120 (S235) And sends an illegal user notification signal to the unmanned lending / returning terminal 120 (S237).

The controller 210 of the book control server 200 transmits the book use information including the book borrowing certificate information included in the book use request signal or the existing book borrowing image data corresponding to the book information to the book borrowing / (S241). The book return video data is compared with the book return video data included in the book use request signal to determine whether the book return video data is correct book return (S241). The main body for comparing and analyzing the book return video data at the time of the previous lending and the book return request video signals included in the book use request signal at the time of the return request may be the control unit 210, It may be an administrator to view image data. In the case of the former, it would be desirable to include the book recognition means and the character recognition means, and comprehensively analyze the book recognition and the book information by character recognition. In this case, in case of returning the book, only the book borrowing video data is compared to determine whether the book is returned correctly. However, as in the case of borrowing, the user face image data is compared with the preset face image of the user to perform the user authentication of the returning user .

The controller 210 of the library server 200 provides the book return permission notification signal to the unmanned lending / returning terminal 120 (S245).

On the other hand, if it is determined that the book is not returned, the control unit 210 provides the book return notification information to the unmanned lending / returning terminal 120 (S247).

Then, the unmanned lending / returning terminal 120 displays, through the display unit 114, that the return of the book has been completed upon receipt of the book return permission notification signal, and displays the book return notice information on the display unit 114). The book return notification information may be a book information of a corresponding book or a book information of a book that has not yet been returned, if the books other than the book are returned at the time of loan or the number of books is different.

FIG. 6 is a flowchart illustrating a method of notifying a camera photographing position and a loan / return book position in a book borrowing / returning machine according to the present invention.

The control unit 111 of the book borrowing / paying unit 100 drives the camera 118 to photograph a book placed at a position where the book position area is displayed in S112 of FIG. 4 and S213 of FIG. 5 (S311).

When the photographing of the book location area is started by driving the camera, the controller 111 acquires book borrowing / returning image data photographed through the camera (S313), and acquires the book borrowing / The region image or the pattern is compared and it is checked whether the photographing region photographed by the camera includes the book position region and whether the book is accurately placed in the book position region (S315). If the camera photographing position is out of the book position region (S317) and determines whether the book is located in the book location area (S321).

If the camera is out of the shooting position, the control unit 111 controls the alarm unit 119 to generate an alarm sound indicating that the camera shooting position is out of the book position area (S319) If it is determined that the book has been released, the alarm unit 119 outputs an alarm sound indicating that the book is out of the book location area (S323).

The control unit 111 generates an alarm until the camera photographing position photographs the book position area and the book is properly placed in the book position area and the camera 118 photographs the book position area, When it is set, the alarm sound is terminated and the photographed image is stored in the storage unit 112 (S325).

FIG. 7 is a flowchart illustrating a method of deleting a personal information card from a photographed image in a book borrowing / paying part according to the present invention, and shows a method of preventing personal information of a user from being exposed during lending / returning of the book.

7, when the control unit 111 starts to acquire an image by driving the camera 118 through the image processing unit 117 (S411) (S413), the personal information card The image pattern information is loaded to monitor whether the personal information card is being photographed on the photographed image (S415).

The monitoring of the personal information card is performed until the operation of the camera 118 is terminated (S419).

If the personal information card is detected during the monitoring (S417), the control unit 111 buffers the image data, edits the buffered image data, deletes the personal information card image (S421), and stores the personal information card image in the storage unit 112 (S423).

While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims. It will be easily understood. It is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, it is intended to cover various modifications within the scope of the appended claims.

10: auto focusing module 20: face recognition module
100: Book loan / half payment 110: Librarian terminal
111: control unit 112:
113: input unit 114:
115: communication unit 116: information reader unit
117: image processor 118: camera
119: alarm unit 120: unmanned (book) loan / return terminal
200: book control server 210: server control unit
211: book borrowing / return object judgment unit 212: loan module
213: lending user identification unit 214: face recognition module
215: return module 217: book control information generating section
220: communication unit 230: display unit
240: Book loan / return DB 300: Network video recorder
400: Book control server section

Claims (21)

The user can read the book information attached to the book at the time of borrowing and returning the book, read the information of the user's book borrowing certificate, photograph the borrowed and returned books when the book is returned or returned, And a book borrowing / returning unit for receiving the book borrowing request signal including the borrowing information, and receiving the book borrowing / return permission notification according to the book borrowing request signal to perform the borrowing and return processing of the book; And
Receiving the book use request signal and storing the included book loan / return image, and displays the book return image of the book returned when the book is returned and the pre-stored book loan image corresponding to the book, the book loan / return Book status control system using a camera, characterized in that it comprises a book control server unit for notification of book use permission.
The method of claim 1,
The book borrowing /
When the book is borrowed / returned, the book use request signal is transmitted to the book control server unit, and the user face image corresponding to the book loan certificate information of the book use request signal is received from the book control server unit in response to the book use request signal. After receiving and displaying, the book loan manager sends the right user notification by the book loan / return approval to the book control server unit, and in response to the book use permission notification from the book control server unit, processes the loan and return of the book. Book situation control system using a camera, characterized in that the librarian terminal performing the.
The method of claim 1,
The book borrowing /
A book use request signal including the book information, the book lease information, and the book lending / returning image including the face of the user is transmitted to the book control server unit when the book is returned / returned, and the book use permission notice is received in response thereto The unmanned lending / returning terminal performing the lending and return processing of the book,
The book control server unit compares a face image of a user included in the book use request signal with a face image that is pre-registered with respect to the book loan certificate information or a face image that is facial feature information, and performs user authentication by face recognition. Book situation control system using a camera, characterized in that for determining whether to use the book permission.
The method of claim 1,
The book borrowing /
And transmits a book request signal to the book control server unit at the time of loan / return of the book, and transmits a book use request signal to the book control server unit from the book control server unit in response to the book use request signal, After the image is received and displayed, a legitimate user notification by the book loan / return approval from the book loan manager is transmitted to the book control server unit, and the book use permission notice is received from the book control server unit, A librarian terminal for performing
When the book is borrowed / returned, a book use request signal including a book loan / return image including the book information, the book loan certificate information, and the user's face is transmitted to the book control server, and in response to the book use permission notification, Including an unmanned loan / return terminal for loan and return processing of books,
When the book control server unit receives a book use request signal from the librarian terminal, the book control server unit provides an image of the user's face corresponding to the book loan certificate information of the book use request signal to the purchaser terminal, and the book use request signal from the unmanned loan / return terminal. Determining whether to use the book permission or not by performing user authentication by face recognition by comparing the face image of the user included in the book image and the face image information, which is a face image or face feature information registered in advance, to the book loan certificate information. Book situation control system using camera characterized in that.
5. The method according to any one of claims 2 to 4,
Wherein the facial image information registered in advance by the book control server unit with respect to the book lease information is an image of a face of at least one family member including a user of the book lease certificate and a user of the user's family. Control system.
The method according to claim 2 or 4,
The librarian terminal comprises:
A video processor for outputting an image of the book position, including a camera for photographing a specific book position on which a book to be borrowed and returned is placed,
An information reader unit for reading out and outputting the book information and the book borrowing information attached to the book,
An input unit for receiving a command from a book borrowing / returning manager,
A display unit for displaying the read book information and the book owl information and the face image information of the user corresponding to the book owl information,
Communication unit for performing data communication with the book control server unit, and
When the book is loaned and returned, the book reader and the book loan information of the user are read through the information reader unit, the image processing unit is controlled to photograph the books placed at the book position, and the photographed book loan / return image, the book information and the loan certificate And a control unit which transmits a book use request signal including information through the communication unit and receives a book loan / return permission notification according to the book use request signal through the communication unit to perform loan and return processing of the book. Book situation control system using camera.
The method according to claim 6,
The book information and the book lease information are stored in respective RFID tags,
The information reader unit,
And the RFID reader unit reads the book information and the book borrowing information from the RFID tags wirelessly.
The method according to claim 3 or 4,
The unmanned lending / returning terminal comprises:
An image processor for outputting an unmanned loan / return terminal image including the image of the book position and the face of the user, including at least one camera for photographing a specific book position and a face of a user to place a book to be borrowed and returned,
An information reader unit reading and outputting the book information and the book borrowing information of each book from the RFID tag attached to the book placed at the book position,
An input unit for receiving a command from a book borrowing / returning manager,
A display unit for displaying the read book information and the book owl information and the face image information of the user corresponding to the book owl information,
Communication unit for performing data communication with the book control server unit, and
When the book is loaned and returned, the book reader and the book loan information of the user are read through the information reader unit, the image processing unit is controlled to photograph the face of the book and the user placed at the book position, and the photographed book loan / return image and the user. A book use request signal including a face image of the book information, the book information, and the loan certificate information is transmitted through the communication unit, and the book loan / return permission notification based on the book use request signal is received through the communication unit to perform loan and return processing of the book. Book situation control system using a camera comprising a control unit for performing.
The method according to claim 6,
And an alarm unit for outputting an alarm sound,
The control unit,
The image data input from the image processing unit is compared with the image data of the predefined book position to determine whether the shooting range of the camera is out of the book position and whether the book of the photographed image data is out of the book position And a camera and a book position recognition module for controlling the alarm unit to generate an alarm when the shooting range of the camera is out of the book position or the book is out of the book position. Control system.
9. The method of claim 8,
And an alarm unit for outputting an alarm sound,
The control unit,
The image data input from the image processing unit is compared with the image data of the predefined book position to determine whether the shooting range of the camera is out of the book position and whether the book of the photographed image data is out of the book position And a camera and a book position recognition module for controlling the alarm unit to generate an alarm when the shooting range of the camera is out of the book position or the book is out of the book position. Control system.
The method of claim 1,
The book control server unit,
A network video recorder for storing the book borrowing / returning video,
Receiving the book use request signal and storing the included book loan / return image in the network video recorder, displaying a book return image of the book returned when the book is returned and a previously stored book loan image corresponding to the book, And a book control server for notifying the book borrowing / returning unit of the book use permission notice.
12. The method of claim 11,
The book control server,
A communication unit for performing data communication with the network video recorder and the book lending / dispensing unit;
And determines whether the received book use request signal is received from the librarian terminal or received from the unmanned lending / return terminal, determines whether the request signal is a loan request signal or a return request signal, and outputs a book use request signal The judging unit,
A face recognition module for performing face recognition by comparing user face image data included in the book use request signal with a user face image set in advance,
If the book use request signal is a signal received from the librarian terminal through the book borrowing / return object determining unit, the face image of the user corresponding to the book borrowing information of the use request signal is output, When the signal received from the return terminal, outputs the face image data of the user included in the book use request signal to the face recognition module to receive the face recognition result and perform user authentication,
If the book use request signal inputted through the book borrowing / return object determining unit is a book borrowing request signal received from the librarian terminal, the face image outputted from the lending user identification unit is transmitted to the librarian terminal through the communication unit, When the user's communication signal is received, the user is allowed to use the book by providing the book use permission notification signal to the terminal, and if the book use request signal is the book rental request signal received from the unmanned lending / returning terminal, A loan module for providing a book use permission notification signal to the unmanned lending / returning terminal when the user authentication is performed successfully, allowing the use of the book, and storing the book borrowing video data in the network video recorder through the communication unit,
If the book use request signal input through the book borrowing / return destination determining unit is a book return request signal received from the librarian terminal, the user face image outputted from the lending user identification unit is transmitted to the librarian terminal through the communication unit, When the user use communication signal is received, the book use permission notification signal is received and provided to the terminal to allow the book returning. If the book use request signal is a book return request signal received from the unmanned lending / return terminal, face recognition is performed through the lending user identification unit And a return module for providing the book use permission notice signal to the unmanned lending / returning terminal when the user authentication is performed successfully, allowing the book use and storing the book return image data in the network video recorder through the communication unit Characterized by The book situation control system using the camera.
The method according to claim 6,
The librarian terminal further includes a storage unit for storing personal information card patterns for identifying an ID and a credit card shape.
The control unit,
Monitor whether the personal information card corresponding to the personal information card pattern is included in the image output from the image processing unit, and if the personal information card is detected, edit the image to delete and store the personal information card. Book situation control system using camera.
9. The method of claim 8,
The unmanned loan / return terminal further includes a storage unit for storing personal information card patterns for identifying an ID card and a credit card shape,
The control unit,
Monitor whether the personal information card corresponding to the personal information card pattern is included in the image output from the image processing unit, and if the personal information card is detected, edit the image to delete and store the personal information card. Book situation control system using camera.
The book lender / return book reads the book information from the RFID tag attached to the book when the book is loaned and returned, reads the book loan information of the user, photographs the book that is loaned and returned when the book is processed and loaned and returned, and photographed books A loan / return request process for requesting a loan / return by transmitting a book use request signal including a loan / return video, the book information, and a loan certificate information;
The book control server unit receives the book use request signal and stores the photographed book loan / return image included therein, and displays a book return image of the book returned when the book is returned and a pre-stored book loan image corresponding to the book. A book control process to notify the use of books to the book loan / return book,
And a book lending / returning process of the book lending / returning unit receiving a book lending / returning permission notice according to the book use request signal to perform lending and returning of books.
16. The method of claim 15,
The book control process,
An image storage step of receiving, by the book control server, the book use request signal and storing the photographed book loan / return image included therein;
An image display step of displaying a book return image of the book returned when the book is returned and a pre-stored book loan image corresponding to the book;
A user face image providing step of providing a user face image of a user corresponding to the book loan certificate information included in the book use request signal to a purchaser terminal if the book loan / return unit has received the book use request signal;
And a book use permission step of notifying the book use permission to the book loan / return unit when a valid approver notice is received in response to the user face image transmission.
The loan / return processing process,
A user face image display step of receiving and displaying a user face image corresponding to the book loan certificate information of the book use request signal from the book control server unit by a librarian terminal that is a book loan / return unit;
A legitimate approver notification step of the librarian terminal transmitting from the book loan manager the legitimate user notification by the book loan / return approval to the book control server unit;
And a book loan / return processing step of receiving a book use permission notification from the book control server unit in response to the legitimate approver notice and performing a loan and return process of the book.
16. The method of claim 15,
The loan / return request process,
Obtaining book information leading book information of the book being loaned or returned;
A book loan certificate information obtaining step of reading book loan certificate information of the user who borrowed the book;
Image data acquisition step of acquiring user face image data by photographing the book or the face of the borrowed or returned person;
A book loan / return request step of requesting loan / return by transmitting a book use request signal including the book information, book loan certificate information, and book and user face image data,
The book control process,
A book and user face image recording step of receiving a book use request signal from the book control server unit and storing the photographed book and user face image data included therein;
A book usage display step of displaying a book return image of the book returned when the book is returned and a pre-stored book loan image corresponding to the book;
A user authentication step of authenticating the user by face recognition by loading and comparing the user face image data and the user face image of the user corresponding to the book loan certificate information;
If the user authentication is successful, the book control method using a camera, characterized in that it comprises a book use permission step of the book use permission notification to the unmanned loan / return terminal.
18. The method according to claim 16 or 17,
The user face image is a book control method using a camera, characterized in that it comprises at least one family face image including a face image of the user of the user and the user family.
16. The method of claim 15,
The loan / return request process,
Obtaining book information leading book information of the book being loaned or returned;
A book loan certificate information obtaining step of reading book loan certificate information of the user who borrowed the book;
Image data acquisition step of acquiring book loan / return image data by photographing the loan or returned book;
A book loan / return request step of requesting a loan / return by transmitting a book use request signal including the book information, book loan certificate information, and book loan / return image data,
The book control process,
An image recording step of receiving, by the book control server unit, the book use request signal and storing the photographed book image data included;
A book usage display step of displaying a book return image of the book returned when the book is returned and a pre-stored book loan image corresponding to the book;
A user image providing step of loading a user image of the user corresponding to the book loan certificate information of the book use request signal and transmitting it to the librarian terminal;
Receiving a legitimate user notification from the librarian terminal in response to the user image providing includes the book use permission step of notifying the use of the book to the librarian terminal,
The librarian terminal displays the user image of the user received from the book control server unit in the user image providing step, and legitimate user authentication by matching the user of the displayed user image with the user who wants to loan or return from the book loan / return manager. And a user authentication process of determining whether to input a success command and notifying the user of the book control to the book control server unit when the authentication success command is input.
The method of claim 17 or 19,
The image data acquisition step,
A book position photographing area determination step of determining whether the camera is photographing the book position area by comparing the photographed image data driven by the camera with the photographed image data of the book position on which the book is to be placed in a predefined area;
A book position determining step of determining whether a book is placed in the book position area when it is determined that the book position area is photographed;
And a video data storing step of storing image data of photographing a book placed at the book position when it is determined that the book is placed at the book position.
21. The method of claim 20,
And alarming the camera when the book position photographing area determination step determines that the camera is not photographing the book location area or that the book is not placed in the book location area.

Images