JP6630519B2 - Book management apparatus, book management method, and program for book storage management system - Google Patents

Description

  The embodiment of the present invention relates to a book management device, a book management method, and a program of a book storage management system that manages books by storing books in containers and carrying the containers into a library.

  In a facility such as a large library that holds a large amount of books, a book storage management system that combines an automatic entry / exit system and storage management means of a free location type by size has been introduced.

  In order to streamline the work of lending and returning books, the automatic entry / exit system, for example, takes out books that have been requested for lending from the library, transports them to the counter, receives the lending registration for the taken out books, and returns them. The process of deleting the lending registration for the book, returning the returned book to the library and registering the accommodation position, and the like are automated.

  In the automatic entry / exit system, each book is provided with a book identification medium such as a barcode or an RFID tag as book identification information. Each book is stored in, for example, a container for each of a plurality of books, and is stored in and out of the container.

  For example, when the retrieval or lending of a book is requested, a container housing the requested book is automatically ejected from the library and transported to the counter. At the counter, a book requested to be borrowed is taken out, for example, by a librarian, and a book identification medium such as a bar code is read, and then lent to the user.

  For example, when a return of a book is requested, a container for accommodating the requested book is automatically ejected from the library and transported to the counter. At the counter, for example, a librarian reads a book identification medium, such as a barcode, of the book requested to be returned, and then stores the book in a container.

  According to the size-based free location storage management means, books are classified and managed based on dimensions, not contents, in order to improve the storage efficiency of books in the library. For example, books of the same size are stored in the same container, and the containers are stored in different areas of the library according to the size of the stored book. In the storage management means of the free location system, the identification information of the book stored in the container and the storage position of the container in the library are stored in association with each other, and each time the book is taken out and returned, the stored content is stored. Be updated.

JP 2014-251569 A JP 2000-229712 A

  In the book storage management system as described above, in a state in which a plurality of books are accommodated in a container, management of entry / exit to / from the library and storage management in the library are performed. Therefore, it is necessary to easily and accurately grasp the state in a container based on the number of books contained in each container, the filling rate of books in the container, or the empty space ratio in the container. Is done.

  The present embodiment intends to provide a book management device, a book management method, and a program of a book storage management system capable of accurately grasping the state in a container.

  The book management device according to the present embodiment includes a photographing device, a synthesizing unit, a detecting unit, a container recognizing unit, a book recognizing unit, a counting unit, an acquiring unit, and a storing unit. The photographing apparatus acquires a plurality of image data of a container to which the container identification data conveyed by the conveyance unit is attached in a direction facing a spine of a book contained in the container. The synthesizing means generates synthetic image data in which a book contained in the container is photographed in a direction facing the spine, based on the plurality of image data. The detecting means detects the position of the container identification data in the composite image data. The container recognizing means recognizes the container area in the composite image data based on the color analysis processing on the composite image data and the position of the container identification data in the composite image data. The book recognition unit recognizes a book contained in the container in the composite image data based on the composite image data and the container area. The counting unit counts the number of books stored in the container based on the book recognition result by the book recognition unit. The obtaining means obtains container identification data attached to the container. The storage unit stores the container identification data in association with the number of books.

  According to the present embodiment, by generating composite image data obtained by synthesizing a plurality of image data obtained by photographing a book stored in a container from the direction facing the spine, and performing color analysis processing on the composite image data , It is possible to recognize the state of storing books in the container with high accuracy.

1 is a block diagram illustrating the configuration of a book management device according to a first embodiment. FIG. 6 is a view showing a display example of combined image data combined by the book management device according to the first embodiment. 9 is a flowchart illustrating an example of a process of determining a book analysis area of the book management apparatus according to the first embodiment. 5 is a flowchart illustrating a book count process of the book management device according to the first embodiment. FIG. 7 is a block diagram illustrating the configuration of a book management device according to a second embodiment. 11 is a flowchart illustrating an example of a free space amount calculation process of the book management device according to the second embodiment. FIG. 10 is a diagram illustrating an example of inclination correction of a book candidate area of the book management apparatus according to the second embodiment. The figure which illustrates the teller mouth of the teller station which concerns on 3rd Embodiment. FIG. 13 is a block diagram illustrating the configuration of a book management device according to a third embodiment.

  Hereinafter, embodiments will be described with reference to the drawings. In the drawings, the same parts are denoted by the same reference numerals.

(1st Embodiment)
When managing multiple books in multiple containers at a large library or other facility, the state of the books stored in each container, for example, the number of books stored in a container, the number of books in a container, Accurate recognition of the filling rate, the amount of books in the container (total value of book thickness), the percentage of free space in the container, and the amount of free space in the container (total value of free space) This is useful for determining a candidate container for accommodating, and for checking the collection. These data are stored and managed in a database or the like, for example. Inspection work of the collection is carried out regularly or irregularly. The inspection work is performed based on, for example, whether or not the number of books stored in a container or the like assumed to be stored in the container matches the number of books actually stored in the container.

  In the present embodiment, synthetic image data is generated by synthesizing a plurality of image data obtained by photographing the books stored in the container from the direction facing the spine, and the number of books stored in the container is determined based on the synthesized image data. A book management apparatus for calculating the filling rate of books in a container, the amount of books in a container, the percentage of empty space in a container, and the amount of empty space in a container will be described.

  FIG. 1 is a block diagram illustrating an example of the book management device 1 of the book storage management system according to the present embodiment.

  The book management device 1 includes a transport conveyor 2, container position detectors 3a and 3b, a photographing device 4, an information processing device 5, a database 6, an operation terminal 7, and a storage medium 10. In the present embodiment, the books 91 and 92 are managed while being stored in the container 8.

  The transport conveyor 2 transports the container 8. In the following, the traveling direction of the conveyor 2 is parallel to the traveling direction F1, the direction parallel to the plane of the conveyor 2 and the direction perpendicular to the traveling direction F1 is perpendicular to the conveyor width direction F2, the traveling direction F1, and the conveyor width direction F2. Is defined as a height direction F3.

  In the present embodiment, the container 8 is divided into two blocks B1 and B2. In each of the blocks B1 and B2, a plurality of books 91 and 92 are accommodated in a line in the thickness direction. As a result, in the container 8, two rows of the book 91 stored in the block B1 and two rows of the book 92 stored in the block B2 are stored.

  In a state where the container 8 is being conveyed by the conveyor 2, the direction of the row of the books 91 stored in the block B1 and the direction of the row of the books 92 stored in the block B2 are parallel to the traveling direction F1. . The book 91 accommodated in the block B1 and the book 92 accommodated in the block B2 in the container 8 are accommodated such that the spine is directed outward (in the conveyor width direction F2). For example, in the container 8, the book 91 is accommodated such that the spine is oriented in one direction (first direction) F2a in the conveyor width direction F2, and the book 92 is the spine in the other direction in the conveyor width direction F2. It is accommodated so as to face the direction (second direction) F2b.

  The outer peripheral surface of the container 8 has a first surface facing the first direction F2a of the conveyor width direction F2, a second surface facing the second direction F2b of the conveyor width direction F2, and a second surface facing the reverse direction of the traveling direction F1. 3 and a fourth surface facing the traveling direction F1. For example, a barcode 8a is attached to the first surface of the container 8 as a container identification medium for identifying the container 8, for example.

  That is, in the present embodiment, the container 8 is placed on the transport conveyor 2 such that the spine of the book 91 and the barcode 8a attached to the container 8 face the first direction F2a of the conveyor width direction F2. .

  In this embodiment, to simplify the description, a case where the block B1 of the container 8 is photographed will be described as an example. However, the same applies to a case where the block B2 of the container 8 is photographed.

  The container position detectors 3a and 3b are installed at different positions along the traveling direction F1 of the transport conveyor 2, for example. The container position detectors 3a and 3b detect that the container 8 being transported by the transport conveyor 2 has passed in front of the container position detectors 3a and 3b, respectively, and notify the imaging device 4.

  The photographing device 4 is installed, for example, on the side of the first direction F2a in the conveyor width direction F2 of the conveyor 2 and photographs the container 8 in a second direction F2b opposite to the first direction F2a. That is, when the container 8 being conveyed by the conveyor 2 passes through the front of the photographing device 4, the photographing device 4 includes the barcode 8 a attached to the first surface of the container 8 and the spine of the book 91. opposite. In other words, in the present embodiment, the photographing direction of the photographing device 4 is the second direction F2b.

  The photographing device 4 continuously or at predetermined intervals photographs the container 8 from the time when the container 8 is detected by the container position detector 3a to the time when the container 8 is detected by the container position detector 3b. Then, a plurality of image data D11 to D1m are obtained. The photographing device 4 sends the acquired plurality of image data D11 to D1m to the information processing device 5.

  The photographing device 4 may photograph the container 8 continuously or at a predetermined interval from when the container 8 is detected by the container position detector 3a until a predetermined time elapses. In this case, the container position detector 3b may be omitted.

  In the present embodiment, the imaging device 4 may be an area sensor camera or a line sensor camera in which optical sensors are arranged one-dimensionally. When the imaging device 4 is a line camera, the imaging device 4 is installed such that the arrangement direction of the optical sensors is the height direction F3.

  The information processing device 5 includes a synthesis unit 501, a detection unit 502, an acquisition unit 503, a container recognition unit 504, a book recognition unit 505, a count unit 506, a storage unit 507, a read unit 508, an inspection unit 509, and a container selection unit 510. .

  Note that the information processing device 5 executes the program P stored in the storage medium 10 to execute the combining unit 501, the detecting unit 502, the acquiring unit 503, the container recognizing unit 504, the book recognizing unit 505, the counting unit 506, It may function as the storage unit 507, the reading unit 508, the inspection unit 509, and the container selection unit 510.

  The synthesizing unit 501 is housed in the container 8 based on a plurality of image data D11 to D1m obtained by shooting the book 91 housed in the container 8 by the imaging device 4 in the second direction F2b facing the spine. The composite image data (container front data) D2 in which each book 91 is photographed in the second direction F2b is composited. For example, the synthesizing unit 501 extracts image data corresponding to the front area A2 of the image capturing device 4 from image data D11 to D1m corresponding to the image capturing range A1 of the image capturing device 4, and connects the extracted image data. , The composite image data D2 of the container 8 is composed.

  The detecting unit 502 detects the position of the barcode 8a in the combined image data D2 based on the combined image data D2 combined by the combining unit 501, and acquires position information indicating the position of the barcode 8a.

  For example, the detection unit 502 specifies the position of the barcode 8a in the composite image data D2 by color analysis processing, and acquires the coordinates of the barcode 8a.

  The acquisition unit 503 acquires the container identification data D3 by performing image analysis on an area corresponding to the barcode 8a in the composite image based on the position information of the barcode 8a acquired from the composite image data D2.

  In this embodiment, the container identification data D3 is obtained based on the composite image data D2. However, the barcode reader may directly acquire the container identification data D3 from the barcode 8a attached to the container 8. In this case, the acquisition unit 503 may be omitted.

  The container recognition unit 504 is included in the composite image data D2 based on the preset color data of the container 8, the composite image data D2, and the position information of the barcode 8a acquired from the composite image data D2. The area of the container 8 and the shape of the container 8 are recognized.

  For example, based on the position information of the barcode 8a obtained from the composite image data D2, the container recognizing unit 504 extracts a region to be subjected to color analysis processing in the composite image data D2. The container recognizing unit 504 performs a color analysis process for recognizing an area corresponding to the color data of the container 8 on the extracted area, and recognizes the area of the container 8. For example, based on the color data of the container 8, the container recognizing unit 504 recognizes a continuous area of the same color in the composite image data D2 as an area of the container 8. The container recognizing unit 504 determines a region corresponding to the first surface of the container 8 and both ends corresponding to the third and fourth surfaces of the container 8 among the regions of the container 8 included in the composite image data D2. Recognize and recognize the shape of the container 8.

  The container recognizing unit 504 may recognize the area and the shape of the container 8 in the composite image data D2 based on the composite image data D2 and the color data of the container 8. That is, the container recognizing unit 504 performs the color analysis processing on the entire area corresponding to the composite image data D2 without extracting the area to be subjected to the color analysis processing based on the position information of the barcode 8a. 8 may be recognized.

  The book recognition unit 505 extracts a book analysis area based on the recognition result of the container recognition unit 504, performs image analysis on the book analysis area, and recognizes the spine of the book 91.

  For example, the book recognition unit 505 includes an area extraction unit 505a, an edge extraction unit 505b, a candidate detection unit 505c, and a determination unit 505d.

  The region extraction unit 505a extracts a book analysis region in the composite image data D2 based on the recognition result by the container recognition unit 504.

  For example, the region extracting unit 505a determines that the distance from the upper side (upper end) of the first surface of the container 8 in the composite image data D2 is equal to or less than a predetermined value. Then, an area corresponding to a region between both ends (third and fourth surfaces) of the container 8 is extracted as a book analysis area.

  For example, the area extracting unit 505a recognizes a background area in the composite image data D2 based on preset background color data, and extracts a book analysis area based on the background area and the area of the container 8. Good. That is, the area extracting unit 505a determines that the area of the combined image data D2 that is above the upper side of the first surface of the container 8 and below the background area and between the two ends of the container 8 is the book analysis area. May be extracted.

  The edge extraction unit 505b performs an edge extraction process on the book analysis area. For example, the edge extraction unit 505b extracts, as an edge pixel, a pixel in which a difference between a pixel value of a luminance and the like and an adjacent pixel is equal to or larger than a threshold value, and extracts an edge line segment based on the plurality of edge pixels. . The edge extraction unit 505b acquires, for example, coordinate data of both ends of the edge line segment.

  The candidate detection unit 505c is a book candidate area that is a candidate of the area indicating the book 91 in the book analysis area based on at least one of the edge line segment extracted by the edge extraction unit 505b and the color analysis processing on the book analysis area. Is detected.

  For example, when an edge line segment is detected in the book analysis area, the candidate detection unit 505c detects a region surrounded by the edge line segment whose length is equal to or greater than a predetermined value as a book candidate area.

  Alternatively, the candidate detection unit 505c determines a line segment area of a predetermined color (for example, black) by a color analysis process on the book analysis area, and sets a boundary between the book 91 and the book 91 or a boundary between the book 91 and the partition board. And a book candidate area may be detected based on the extracted boundary line.

  In the present embodiment, the book candidate area is, for example, a quadrangle. For example, the short side located above the book candidate area detected when the book 91 is tilted and accommodated in the container 8 is the short side of the book candidate area in the traveling direction F1 when the book 91 is not tilted in the container 8. A long side corresponding to an edge line segment and located on the side of the book candidate region detected when the book 91 is accommodated in the container 8 at a tilt is a book when the book 91 is not tilted in the container 8. The candidate area may be treated as corresponding to an edge line segment in the height direction F3.

  When a book candidate area is detected in the book analysis area, the determination unit 505d performs a color analysis process on the book candidate area, and determines whether the book candidate area is an area indicating the book 91 (book area). .

  For example, the determining unit 505d determines that the book candidate area is a book area when determining that the book candidate area has at least two areas of different colors whose areas are equal to or larger than a predetermined value. When the determination unit 505d determines that the book candidate area includes only one color, the determination unit 505d may determine that the book candidate area is a partition plate of the container 8. Alternatively, the determination unit 505d may determine that the book candidate area is the partition board of the container 8 when the book candidate area is similar to the preset color data of the partition board.

  If the edge extracting unit 505b does not extract, for example, an edge line segment along the direction (horizontal direction) corresponding to the traveling direction F1 in the book analysis area as a result of the edge extraction processing by the edge extracting unit 505b, An area where a line segment is not detected may be determined as an area corresponding to an empty space in the container 8 where there is no book 91 or a partition plate. Alternatively, the determination unit 505d may determine an area in which the upper side of the book candidate area is not detected as an area corresponding to an empty space.

  When a book candidate area is detected in the book analysis area, the counting unit 506 counts the number of book areas determined by the determination unit 505d, and obtains book number data D4 indicating the number of books 91 contained in the container 8. Generate

  When the book candidate area is not detected in the book analysis area, the counting unit 506 determines that the number of books 91 contained in the container 8 is 0, in other words, the number of books indicating that the container 8 is empty. Generate data D4.

  The storage unit 507 stores the plurality of pieces of image data D11 to D1m acquired by the photographing device 4, the combined image data D2 combined by the combining unit 501, and the number of books contained in the container 8 counted by the counting unit 506. The illustrated book number data D4 and the container identification data D3 acquired by the acquisition unit 503 are stored in the database 6 in association with each other.

  The reading unit 508 reads various data stored in the database 6 in association with the container identification data D3 based on the instruction received by the input unit 7a of the operation terminal 7.

  The checking unit 509 checks whether or not the number of books stored in the container 8 matches the number of books actually stored in the container 8 with reference to, for example, the database 6. For example, for the same container 8, the inspection unit 509 obtains the number of books that have been acquired by the previous counting of the number of books by the counting unit 506 and has already been stored in the database 6, and the current number of books that has been counted by the counting unit 506. Check whether the number of books obtained matches. That is, the inspection unit 509 obtains the number of books as final information already stored in the database 6 in association with the container identification data D3, and obtains the number of books by the counting unit 506 when the container 8 indicated by the container identification data D3 is transported. Check whether the number of books matches.

  For example, the inspection unit 509 identifies the container 8 in which the number of books indicated by the determination information stored in the database 6 does not match the number of books counted by the counting unit 506 when the container 8 is transported, for example, in the library. It may be selected as a container 8 to be inspected by an inspector such as a worker.

  For example, when the amount of the book 91 requested to be stored (returned) in the container is input via the input unit 7a, the container selection unit 510 selects the container 8 corresponding to the amount of the book 91 requested to be stored. select. It is preferable that the container selection unit 510 selects the container 8 based on the thickness of the book 91 requested to be stored, as described in a second embodiment described later. However, the container selection unit 510 refers to, for example, the book number data D4 stored in the database 6, and stores the container 8 in which the number of books contained in the container 8 is equal to or less than a predetermined number (for example, the number of books is 0 to 3). It is also possible to select the container 8 based on the number of books stored in the container 8, such as selecting the container 8 preferentially.

  The operation terminal 7 includes an input unit 7a and an output unit 7b. The input unit 7a receives an input from an operator such as a librarian, for example. The output unit 7b outputs various data read from the database 6 by the reading unit 508.

  FIG. 2 is a diagram illustrating a display example of combined image data combined by the book management device 1 according to the present embodiment.

  Generally, for example, in image data acquired by one image capturing using an area sensor camera or the like, a difference occurs in the image capturing direction between the center and the end of the image capturing range. That is, while the vicinity of the center of the photographing range is photographed from the front of the subject, the end of the photographing range is photographed obliquely with respect to the subject. Therefore, for example, when large and small books 91 are mixed in the container 8, in the image data obtained by one photographing, a small book may be hidden by a large book at the end of the container 8. That is, it may be difficult for the image data acquired by one photographing to accurately recognize the book 91 stored in the end of the container 8.

  On the other hand, as shown in FIG. 2, according to the present embodiment, the combined image data D2 is combined based on a plurality of image data in a range corresponding to the front of the imaging device 4, so that the combined image data D2 In, the spine of the book 91 is photographed from the front without depending on the accommodation position of the book 91 in the container 8. Therefore, the recognition accuracy of the book 91 can be improved.

  In the display example of FIG. 2, in the composite image (front image) when the composite image data D2 is displayed, the direction corresponding to the traveling direction F1 of the transport conveyor 2 is set as the x-axis direction, and the direction corresponding to the height direction F3. Is defined as the y-axis direction. In the composite image, a portion corresponding to the first surface of the container 8 to which the barcode 8a is attached is defined as a container front portion 8b, and one side end of the container front portion 8b (the third surface of the container 8 The corresponding portion) is a container side surface portion 8c, and the other side end of the container front portion 8b (a portion corresponding to the fourth surface of the container 8) is a container side surface portion 8d.

  For example, the container recognizing unit 504 recognizes the container front part 8b with the barcode 8a attached thereto and the container side parts 8c and 8d located at both ends of the container front part 8b in the composite image data D2. For example, it is assumed that the coordinate value of the container side surface 8c in the x-axis direction is smaller than the coordinate value of the container side surface 8d in the x-axis direction.

  For example, the area extracting unit 505a of the book recognition unit 505 is located above the upper side of the container front part 8b, the distance from the upper side of the container front part 8b is equal to or less than a predetermined value, and the distance between the container side parts 8c and 8d. A region between the two is extracted as a book analysis region. That is, the region extracting unit 505a determines that the y coordinate is larger than the y coordinate of the upper side of the container front part 8b and equal to or less than a predetermined value, and the x coordinate is a value corresponding to between the container side part 8c and the container side part 8d. Is extracted as a book analysis area.

  For example, the region extraction unit 505a is located above the upper side of the container front part 8b, below the background area recognized based on the preset background color data, and includes the container side parts 8c and 8d. May be extracted as a book analysis area.

  The edge extraction unit 505b performs an edge extraction process on the book analysis area.

  The candidate detection unit 505c detects a book candidate area based on at least one of the edge line segment extracted by the edge extraction unit 505b and color analysis processing on the book analysis area.

  For example, the candidate detection unit 505c detects a region surrounded by an edge line segment whose length is equal to or greater than a predetermined value as a book candidate region.

  For example, the candidate detection unit 505c may scan the book analysis area a plurality of times (seven times in the example of FIG. 2), for example, in the x-axis direction, and detect the book candidate area based on the color analysis processing. For example, the candidate detection unit 505c is a band-shaped region having a predetermined width in the y-axis direction along the x-axis direction, that is, a rectangle having a long side along the x-axis direction and a short side along the y-axis direction. In a region (hereinafter, referred to as a scanning line region), for example, a black line segment region is detected. For example, when a continuous black line segment region is detected over at least two adjacent scan line regions along the y-axis direction, the candidate detecting unit 505c converts the black line segment region into a book 91 and a book 91. , Or a boundary line indicating the boundary between the book 91 and the partition plate, and a book candidate area is detected based on the boundary line.

  FIG. 3 is a flowchart illustrating an example of a book analysis area determination process of the book management apparatus 1 according to the present embodiment.

  In step 301, the synthesizing unit 501 shoots each book 91 stored in the container 8 from the second direction F2b in the conveyor width direction F2 based on the plurality of image data D11 to D1m acquired by the imaging device 4. The composite image data D2 indicating the state of the generated image is generated.

  In step 302, the detecting unit 502 detects the position of the barcode 8a in the combined image data D2 based on the combined image data D2 generated by the combining unit 501, and acquires position information indicating the position of the barcode 8a. .

  In step 303, the container recognizing unit 504 converts the pre-set container color data, the composite image data D2, and the position information of the barcode 8a acquired by the detection unit 502 into the composite image data D2. The region and the shape of the contained container 8 are recognized.

  For example, the container recognizing unit 504 extracts an area to be subjected to color analysis processing in the composite image data D2 based on the position information of the barcode 8a obtained from the composite image data D2, and sets a container in the extracted area. The area corresponding to the color data 8 is recognized, and the area of the container 8 is recognized. For example, the container recognizing unit 504 recognizes the upper side of the container front part 8b and the container side parts 8c and 8d in the area of the container 8 included in the composite image data D2, and recognizes the shape of the container 8.

  In step 304, the region extracting unit 505a of the book recognition unit 505 selects a book analysis region based on the combined image data D2 and the recognition result by the container recognition unit 504.

  For example, the region extraction unit 505a is located above the upper side of the container front part 8b in the composite image data D2, the distance from the upper side of the container front part 8b is equal to or less than a predetermined value, and A region between the two is extracted as a book analysis region.

  Alternatively, the area extraction unit 505a is located above the upper side of the container front part 8b in the composite image data D2, below the background area recognized based on the preset background color data, and An area between the sections 8c and 8d is extracted as a book analysis area.

  FIG. 4 is a flowchart illustrating an example of the book number counting process of the book management device 1 according to the present embodiment. The book count processing is executed after the book analysis area determination processing shown in FIG.

  In step 401, the edge extraction unit 505b performs an edge extraction process on the book analysis area.

  In step 402, the candidate detection unit 505c determines whether an edge line segment is detected in the book analysis area.

  If an edge line segment is detected in the book analysis area, in step 403, the candidate detection unit 505c determines based on at least one of the edge line segment extracted by the edge extraction unit 505b and color analysis processing on the book analysis area. , A book candidate area in the book analysis area is detected.

  For example, when an edge line segment is detected in the book analysis area, the candidate detection unit 505c detects a region surrounded by the edge line segment whose length is equal to or greater than a predetermined value as a book candidate area. Alternatively, the candidate detecting unit 505c extracts a boundary line indicating a boundary between the books 91 and the book 91 or a boundary between the books 91 and the partition board by color analysis processing on the book analysis region, and based on the extracted boundary line. , A book candidate area may be detected.

  In step 404, the determination unit 505d performs a color analysis process on the book candidate region, and determines whether there are at least two regions of different colors whose areas are equal to or larger than a predetermined value in the book candidate region.

  If there are at least two regions of different colors having areas equal to or greater than the predetermined value in the book candidate region, in step 405, the determination unit 505d determines that the book candidate region is a book region indicating the spine of book 91. judge.

  If the book candidate area includes only one color, the determination unit 505d determines that the book candidate area is a partition plate of the container 8 in step 406. Note that the determination unit 505d may determine that the book candidate area is the partition board of the container 8 when the book candidate area is similar to the preset color data of the partition board.

  In step 407, if the determination by the determination unit 505d has not been completed for all book candidate areas, the process returns to step 403. When the determination by the determination unit 505d is completed for all book candidate regions, the process proceeds to step 408.

  In step 408, the counting unit 506 counts the number of book areas.

  If no edge line segment is detected in the book analysis area in step 402, the counting unit 506 determines that the number of books stored in the container 8 is 0 in step 409.

  In step 410, the counting unit 506 generates book number data D4 indicating the number of books contained in the container 8.

  As described above, according to the present embodiment, a plurality of image data are acquired for one container 8 by photographing the conveyed container 8 continuously or at predetermined intervals, and the acquired plurality of acquired image data are acquired. Among the image data, the combined image data D2 is generated by connecting the image data in a range corresponding to the front of the imaging device 4. In the composite image data, the spine of the book 91 is photographed from the front without depending on the accommodation position of the book 91 accommodated in the container 8. Therefore, the recognition accuracy of the book 91 can be improved.

  Further, according to the present embodiment, the region and the shape of the container 8 included in the composite image data D2 are determined based on the preset container color data, the composite image data D2, and the position information of the barcode 8a. Be recognized. Thereby, based on the region and shape of the container 8 in the composite image data D2, it is possible to extract a region to be subjected to image analysis processing for recognizing the book 91. That is, it is possible to select an appropriate range of the image analysis processing. For example, when performing image analysis processing by scanning the combined image data D2 in a predetermined direction, it is possible to accurately determine the scanning start position. Therefore, the recognition accuracy of the book 91 can be improved, and the book 91 stored in the container 8 can be accurately counted.

  Furthermore, according to the present embodiment, an area to be subjected to color analysis processing for recognizing the area and shape of the container 8 is extracted based on the position information of the barcode 8a in the composite image data D2. Therefore, for example, without using the position information of the container identification data D3, the color analysis processing is performed on the entire area corresponding to the composite image data D2 to recognize the area and shape of the container 8. The time required for recognizing the region and shape can be shortened.

  In addition, according to the present embodiment, while the container 8 is being conveyed by the conveyor 2, the image data D11 to D1m are obtained. Therefore, no special operation for photographing the container 8 is required. Further, a new device for counting books such as a laser distance meter is not required. Therefore, the number of books stored in the container 8 can be easily grasped at a low cost.

  In addition, according to the present embodiment, since the container 8 is photographed while the container 8 is being transported, every time the book 91 is taken out and returned (accommodated) to the container 8, the book 91 is automatically stored in the database 6. Data can be updated.

  Further, according to the present embodiment, since the fixedly installed photographing device 4 photographs the container 8 being transported, the influence of vibration and the like is smaller than in the case where the photographing device is moved and photographed. Thus, stable image data can be obtained.

(Second embodiment)
This embodiment is a modification of the first embodiment. In the present embodiment, when the books 91 are stored in the container 8 in a tilted state, the number of the books 91 stored in the container 8 based on the composite image data D2, the filling rate of the books 91 in the container 8 The book management apparatus 1A for calculating the amount of the book 91 in the container 8 (for example, the total value of the thickness of the book 91), the empty space ratio in the container 8, and the empty space amount in the container 8 will be described.

  Hereinafter, a case where the empty space amount of the container 8 is calculated based on the inclination angle of the book candidate area will be described as an example. However, the empty space amount of the container may be calculated based on the inclination angle of the book area.

  In the following, a case where a book candidate area is detected based on the edge line segment extracted by the edge extracting unit 505b will be described. However, the same applies to a case where a book candidate area is detected based on, for example, a color analysis process for the book analysis area.

  FIG. 5 is a block diagram illustrating an example of a configuration of the book management device 1A according to the second embodiment. In the present embodiment, the book management device 1A includes an information processing device 5A.

  The information processing device 5A includes an angle detection unit 511 and a calculation unit 512.

  The angle detection unit 511 detects the angle of inclination of, for example, the y-axis direction of the book candidate region detected by the candidate detection unit 505c.

  For example, the angle detection unit 511 detects, for example, an inclination (rotation) angle with respect to the y-axis direction based on the coordinates of at least two points on the edge line segment that defines the book candidate area. In the present embodiment, the inclination angle is, for example, less than 90 degrees, and when the direction of the edge line is the y-axis direction, the inclination angle is 0 degrees.

  The calculation unit 512 calculates a value indicating the amount of free space in the container 8 in which the book 91 is not stored, based on the inclination angle of the edge line detected by the angle detection unit 511 with respect to the y-axis direction.

  For example, based on the detected inclination angle of the book candidate area, the calculation unit 512 calculates the coordinates of the edge line segment defining the book candidate area so that the inclination angle of the book candidate area with respect to the y-axis direction is 0 degrees. Convert. For example, the calculation unit 512 calculates the width of the book candidate area in the x-axis direction when the inclination angle with respect to the y-axis direction is 0 degrees based on the x-coordinate of the converted edge line. For example, the calculation unit 512 calculates the total value of the widths in the x-axis direction of each candidate area, and calculates the amount of the empty space in the container 8 where the book 91 is not accommodated, based on the calculated total value.

  Note that the value calculated by the calculation unit 512 may be the amount of empty space (dimension value) in the container 8, the ratio of the empty space in the container 8, or the amount of the book 91 stored in the container 8 (for example, the book 91). Of the book 91 in the container 8.

  The storage unit 507 stores the free space amount data D5 calculated by the calculation unit 512 in the database 6 in association with the composite image data D2 and the container identification data D3.

  The container selection unit 510, when the input unit 7a of the operation terminal 7 inputs, for example, the amount of the book 91 requested to be stored (returned) in the container 8 (for example, the total thickness of the book 91), With reference to the free space amount data D5 stored in No. 6, a container 8 having a free space corresponding to the amount of the book 91 requested to be accommodated is selected.

  Other configurations and functions are the same as those of the first embodiment, and thus the description is omitted.

  FIG. 6 is a flowchart illustrating an example of a free space amount calculation process of the book management device 1A according to the present embodiment. The free space amount calculation processing is executed after the book analysis area determination processing similar to the first embodiment.

  In step 601, the edge extraction unit 505b performs an edge extraction process on the book analysis area.

  In step 602, the candidate detection unit 505c determines whether an edge line segment is detected in the book analysis area.

  When an edge line segment is detected in the book analysis area, in step 603, the candidate detecting unit 505c detects an area surrounded by the edge line segment whose length is equal to or greater than a predetermined value as a book candidate area.

  In step 604, the angle detection unit 511 detects the inclination angle of the book candidate area with respect to the y-axis direction, and determines whether the book candidate area is inclined with respect to the y-axis direction. For example, the angle detection unit 511 detects the inclination angle with respect to the y-axis direction based on the coordinates of at least two points on the edge line segment that defines the book candidate area.

  If the book candidate area is inclined with respect to the y-axis direction, in step 605, the calculation unit 512 performs coordinate conversion of the edge line of the book candidate area based on the detected inclination angle. For example, the calculation unit 512 performs the coordinate conversion of the edge line so that the inclination angle of the book candidate area with respect to the y-axis direction is 0 degrees.

  If the book candidate area is not inclined with respect to the y-axis direction, the process proceeds to step 606.

  In step 606, the calculation unit 512 calculates the width of the book candidate area in the x direction based on the x coordinate value of the book candidate area.

  If it is determined in step 607 that the detection of the inclination angle has not been completed for all the book candidate areas, the process returns to step 603. If the detection of the inclination angle has been completed for all the book candidate regions, the process proceeds to step 608.

  In step 608, the calculation unit 512 calculates the total value of the width of the book candidate area in the x-axis direction, and calculates the free space amount of the container 8 based on the calculated total value.

  If no edge line segment is detected in the book analysis area in step 602, in step 609, the calculation unit 512 determines that the container 8 is empty.

  In step 610, the calculation unit 512 generates free space amount data D5 indicating the free space amount of the container 8.

  FIG. 7 is a diagram illustrating an example of inclination correction of a book candidate area according to the present embodiment.

  In FIG. 7, the book candidate areas 131 to 133 are in an upright state, but the book candidate areas 134 and 135 are inclined. In this case, the angle detection unit 511 detects the inclination angles of the book candidate regions 134 and 135, and the calculation unit 512 executes the inclination correction of the book candidate regions 134 and 135 based on the inclination angles.

  According to the present embodiment described above, similarly to the first embodiment, all the books 91 stored in the container 8 are subjected to only the color analysis processing based on the composite image data D2 photographed from the spine side. Instead, the container 8 and the book 91 stored in the container 8 are recognized using the position of the barcode 8a attached to the container 8. Therefore, the free space amount of the book 91 and the container 8 accommodated in the container 8 can be accurately obtained.

  According to the present embodiment, since the free space amount of the container 8 can be obtained by the photographing device 4 and the information processing device 5, no additional equipment for obtaining the free space amount is required, and the introduction cost is suppressed. Can be.

  According to the present embodiment, since the empty space amount of the container 8 is calculated based on the composite image data D2, for example, the filling rate of the container 8 based on numerical data such as the average thickness of the book or the number of pages of the book Can be obtained without error as compared with the case where is calculated. Further, for example, since it is not necessary to obtain numerical data such as thickness data and the number of pages of each book, the amount of empty space in the container 8 can be easily and quickly calculated.

  According to the present embodiment, even when the book 91 is accommodated in a tilted state in the container 8, the inclination angle of the inclined book 91 is detected based on the composite image data D2, and the book 91 is detected. Can be calculated based on the inclination angle of the container 8. Therefore, the amount of empty space in the container 8 can be accurately obtained.

(Third embodiment)
This embodiment is a modified example of the first and second embodiments. Hereinafter, a case will be described in which the present embodiment is a modification of the second embodiment, but the same applies to a modification of the first embodiment. When the book 91 is stored in the container 8 (when the book 91 is returned), the book management device according to the present embodiment automatically detects the storage position of the book 91 in the container 8 and stores it.

  FIG. 8 is a diagram illustrating an example of the cash slot of the cash station according to the present embodiment.

  A cashier 12A of the cashier station 12 is provided with a position detector 11. When an operator such as a librarian stores the book 91 in the container 8 of the cash slot 12A, the storage position of the book 91 is detected based on the measurement value of the position detection device 11.

  The accounting station includes an output unit 7b such as a display. When the book 91 is to be taken out, the output unit 7b displays in which position of the container 8 the book 91 to be taken out is stored. Thus, the operator can easily grasp the book storage position.

  FIG. 9 is a block diagram illustrating an example of the book management device 1B according to the present embodiment. In the present embodiment, the book management device 1B includes an information processing device 5B and a position detection device 11. The information processing device 5B includes a coordinate specifying unit 513.

  In FIG. 9, a case will be described where the book 91 indicated by the book identification data D71 is accommodated in the container 8 and the accommodation position of the book 91 is indicated by the position data D61. However, the same applies to the case where the book indicated by the book identification data D72 to D7n is stored in the container 8, and the storage position of the book is indicated by the position data D62 to D6n.

  As described above, the position detecting device 11 is, for example, a laser distance meter. The laser distance meter is installed at a predetermined position of a cash slot where books are taken out and returned.

  The laser range finder measures the distance from the installation position of the laser range finder to the book 91 intersecting the laser, for example, when the book 91 requested to be stored is stored in the container 8, and the measured value is processed by the information processing device 5B. Send to

  The coordinate specifying unit 513 specifies the coordinates corresponding to the accommodation position of the book 91 in the composite image data D2 based on the measurement value measured by the laser distance meter. The coordinate specifying unit 513 generates position data D61 indicating the specified coordinates.

  The storage unit 507 indicates the book identification data D71 of the book 91 requested to be stored, the container identification data D3 of the container 8 in which the book 91 requested to be stored is stored, and the storage position of the book 91 requested to be stored. The position data D61 is associated and stored in the database 6.

  When the book 91 is taken out, the output unit 7b displays the position data D61 read out based on the book identification data D71 and the container identification data D3.

  As described above, a photographing device may be used as the position detecting device 11. That is, the image data of the work of housing the book 91 in the container 8 may be shot by the shooting device, and the coordinate specifying unit 513 may specify the housing position of the book 91 in the composite image data D2 based on the image data.

  According to the present embodiment described above, when the book 91 is stored in the container 8, the position data D61 of the book 91, the book identification data D71 of the book 91, and the container identification data D3 of the container 8 are stored in association with each other. can do. Then, when the book 91 is taken out of the container 8, the accommodation position of the book 91 accommodated in the container 8 can be displayed. Thus, the operator can easily grasp the accommodation position of the book 91.

  In the present embodiment, since the position data D61 is automatically detected, the work of the operator is not changed, and the work load does not increase.

  In the present embodiment, since the position of the book 91 is recognized when the book 91 is stored, the storage position of the book 91 can be accurately recognized.

  In the present embodiment, the book identification data D71 is applicable even if it is not, for example, a wireless tag, and the medium of the book identification data D71 is not restricted, and is easily introduced.

  In addition, the present invention is not limited to the above embodiments as they are, and can be embodied by modifying the constituent elements in the implementation stage without departing from the scope of the invention. Various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above embodiments. For example, some components may be deleted from all the components shown in the embodiment. Further, components of different embodiments may be appropriately combined.

  1, 1A, 1B: book management device, 2: transport conveyor, 3a, 3b: container position detector, 4: photographing device, 5, 5A, 5B: information processing device, 501: combining unit, 502: detecting unit, 503 ... Acquisition unit 504 Container recognition unit 505 Book recognition unit 505a Region extraction unit 505b Edge extraction unit 505c Candidate detection unit 505d Judgment unit 506 Count unit 507 Storage unit 508 ... Readout unit, 509 ... Inspection unit, 510 ... Container selection unit, 511 ... Angle detection unit, 512 ... Calculation unit, 513 ... Coordinate identification unit, 6 ... Database, 7 ... Operation terminal, 7a ... Input unit, 7b ... Output unit , 8 ... Container, 8a ... Barcode, 91, 92 ... Book, 10 ... Storage medium, 11 ... Position detector, 12 ... Payment station, 12A ... Payment port, 131-135 ... Book candidate area .

Claims (16)

A photographing device for acquiring a plurality of image data obtained by photographing a container attached with container identification data conveyed by the conveying means in a direction facing a spine of a book stored in the container;
Synthesizing means for generating synthetic image data in which the books stored in the container are photographed in a direction facing the spine, based on the plurality of image data,
Detecting means for detecting the position of the container identification data in the composite image data;
Container recognition means for recognizing a container area in the composite image data based on the color analysis processing and the position for the composite image data,
Book recognition means for recognizing the book contained in the container in the composite image data based on the composite image data and the container area;
Counting means for counting the number of books contained in the container, based on the recognition result of the books by the book recognition means,
Acquisition means for acquiring the container identification data attached to the container,
Storage means for storing the container identification data in association with the number of books,
A book management device for a book storage management system, comprising:   The container recognizing means is configured such that both ends of the container in the composite image data and a surface of the outer peripheral surface of the container facing the photographing device that acquires the plurality of image data are based on the position of the container identification data. The book management device according to claim 1, wherein the book management device recognizes an upper side portion.   3. The book recognition unit according to claim 2, wherein the book recognition unit recognizes a book analysis area on the upper side of the container, between the both ends of the container, and executes book recognition on the book analysis area. 4. Book management device as described. The book recognition means,
Extracting an edge line segment in the book analysis area,
Detecting a region surrounded by the edge line segment as a book candidate region,
The book management device according to claim 3, wherein the book is determined based on a color analysis process for the book candidate area. The book recognition means,
The book analysis area has a long side along the traveling direction of the container and a short side along a direction perpendicular to the traveling direction of the container, and is adjacent along the direction perpendicular to the traveling direction of the container. Detect line segments of a predetermined color for a plurality of rectangular areas,
Detecting a continuous line segment over at least two rectangular regions of the plurality of rectangular regions;
Detecting a book candidate area based on the continuous line segment,
The book management device according to claim 3, wherein the book is determined based on a color analysis process for the book candidate area. Based on the book of the recognition result of the book recognition means, books filling rate of the container, the free space ratio of the container, a library of the container, calculate the value of at least one of the free space of the container And
Detecting the inclination angle of the book candidate area in the book analysis area,
Execute the inclination correction of the book candidate area based on the inclination angle,
Further comprising a calculating means for calculating the at least one value based on the execution result of the tilt correction ,
The book management device according to claim 4 , wherein the storage unit stores the container identification data and the at least one value in association with each other.   When storing the book in the container, further comprising a position detecting means for detecting a storage position of the book in the container,
  The storage unit stores the storage position of the book detected by the position detection unit, book identification data indicating the book, and the container identification data in association with each other,
  The book management device according to any one of claims 1 to 6, further comprising a display unit that displays the accommodation position of the book stored in the storage unit in association with the container identification data.   The position detecting unit is configured to take out the book from the container and store the book in the container by using a laser distance meter installed at a cashier station, and photographing by a photographing device installed at the cashier station. The book management device according to claim 7, wherein the storage position is detected based on at least one of a recognition result of the storage position based on the obtained image data.   4. The image capturing device that acquires the plurality of image data is a line sensor camera or an area sensor camera, and captures the container being transported by the transport unit from a direction orthogonal to a traveling direction of the container. The book management device according to claim 8.   2. The book management device according to claim 1, wherein the color analysis processing recognizes the container area in the composite image data based on preset color data of the container. 3.   The book management device according to any one of claims 1 to 10, wherein the obtaining unit obtains the container identification data as a result of image analysis on the composite image data.   The book management device according to any one of claims 1 to 10, wherein the acquisition unit is a reading device that reads the container identification data attached to the container.   Does the number of books stored in the storage unit in association with the container identification data match the number of books obtained by the counting unit when the container indicated by the container identification data is transported? The book management device according to any one of claims 1 to 12, further comprising checking means for checking whether or not the book is checked.   Reading means for reading at least a part of data stored in the storage means;
  Output means for outputting the at least part of the data read by the reading means,
The book management device according to any one of claims 1 to 13, further comprising:   Acquires a plurality of image data obtained by photographing the container attached with the container identification data conveyed by the conveying means in a direction facing the spine of a book stored in the container,
  Based on the plurality of pieces of image data, the book contained in the container generates composite image data captured in a direction corresponding to the spine,
  Detecting the position of the container identification data in the composite image data,
  Based on the color analysis processing and the position for the composite image data, recognize a container area in the composite image data,
  Based on the composite image data and the container area, recognizes the book contained in the container in the composite image data,
  Counting the number of books contained in the container based on the recognition result of the books,
  Acquiring the container identification data attached to the container,
  A book management method for a book storage management system, wherein the container identification data and the number of books are stored in association with each other.   Book storage management including a photographing device for acquiring a plurality of image data obtained by photographing a container attached with container identification data conveyed by the conveying means in a direction facing a spine of a book contained in the container. In a program applied to the book management device of the system,
On the computer,
  A function of generating composite image data in which the books contained in the container are photographed in a direction corresponding to the spine, based on the plurality of image data;
  A function of detecting a position of the container identification data in the composite image data;
  A function of recognizing a container area in the composite image data based on the color analysis processing and the position with respect to the composite image data;
  A function of recognizing the book contained in the container in the composite image data based on the composite image data and the container area;
  A function of counting the number of books contained in the container based on the recognition result of the books,
  A function of acquiring the container identification data attached to the container;
  A function of storing the container identification data in association with the number of books,
The program to realize.

Images