JP2020039097A - Document reading system - Google Patents

Abstract

To provide a document reading system that can read, with high accuracy, an image of a large-size document with a simple operation by using one portable terminal device.SOLUTION: In a document reading system Sy, in a travel device 1, a control unit of a portable terminal device 3 controls traveling body driving units of traveling bodies 5A, 5B to cause the traveling bodies 5A, 5B to travel in the vertical direction, and thereby moves the portable terminal device 3 in the vertical direction above a document G, controls a holder driving unit to move a holder 7 in the transverse direction along a connection bar 6, and thereby moves the portable terminal device 3 in the transverse direction above the document G. Accompanying the movement in the vertical direction and the transverse direction of the portable terminal device 3, the control unit sequentially picks up partial images of the document with an imaging camera of the portable terminal device 3 and composites the plurality of picked-up partial images to create the entire image of the document.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a document reading system that reads an image of a document using an imaging camera of a portable terminal device, and more particularly to a technique suitable for reading an image of a document of a large size.

  The mobile terminal device can capture an image of a document using an imaging camera provided. However, when capturing an image of a large-sized document using the portable terminal device, the portable terminal device is separated from the document so that the entire document is within the imaging range of the imaging camera, and then the image of the document is captured. There is a need. Therefore, if the resolution of the image capturing camera with respect to the image of the document is low, the captured image of the document becomes coarse.

  On the other hand, in the portable information terminal described in Patent Document 1, a first moving image is photographed by a photographing unit of the portable information terminal, and a second moving image transmitted from another portable information terminal is received. A first still image is extracted from one moving image, a second still image is extracted from the second moving image, and a combined image is generated based on the first still image and the second still image. As a result, a combined image without a sense of incongruity is generated from the still images captured by each portable information terminal.

JP 2005-123807 A

  Here, using the technology described in Patent Document 1, a plurality of personal digital assistants photograph each image portion of a large-size document, and combine these image portions to obtain a highly accurate entire image of the document. However, it is necessary to use a plurality of portable information terminals, and it is difficult to efficiently perform the work. Further, as is well known, a scanner for reading an image of a document and outputting image data indicating the image is provided. However, the size of the document is limited, and a document of a large size cannot be read.

  The present invention has been made in view of the above circumstances, and it is an object of the present invention to use a single portable terminal device to read an image of a large-sized document with high accuracy by a simple operation.

  A document reading system according to one aspect of the present invention is a document reading system including a traveling device and a portable terminal device, wherein the traveling device is arranged in a predetermined first direction on a flat surface on which a document is placed. Two mobile running bodies, a connecting bar extending between the running bodies in a second direction orthogonal to the first direction, and a mobile terminal device provided movably along the connecting bar; A holder supporting the document at a position facing the original, a traveling body drive unit for traveling the traveling body on the flat surface in the first direction, and a holder moving the holder in the second direction along the connection bar. A mobile terminal, the mobile terminal includes an imaging camera, and a control unit for controlling the operation of the mobile terminal, the control unit controls the traveling body drive unit, Each running body in the first direction By moving the mobile terminal device in the first direction at a position facing the document, and controlling the holder driving unit to move the holder in the second direction along the connection bar. The portable terminal device is moved in the second direction at a position facing the document, and when the portable terminal device moves in the first direction and the second direction, the image capturing camera sequentially captures partial images of the document. Then, a plurality of partial images captured by the imaging camera are combined to generate an entire image of the document.

  According to the present invention, an image of a large-size document can be read with high accuracy by using a single portable terminal device with a simple operation.

1 is a perspective view schematically illustrating an embodiment of a document reading system according to the present invention. FIG. 2 is a side view schematically showing a traveling device in the document reading system according to the embodiment. FIG. 2 is a cross-sectional view schematically illustrating a connection bar, a holder, a portable terminal device, and the like in the document reading system. It is a figure which expands and shows a connection bar and a drive roller. FIG. 2 is a block diagram illustrating a configuration of a traveling device and a configuration of a mobile terminal device in the document reading system. 9 is a flowchart illustrating a process of moving an imaging camera of the portable terminal device, sequentially capturing partial images of a document by the capturing camera, and combining a plurality of captured partial images to generate an entire image of the document. It is a top view which shows the procedure of the movement of the imaging camera of a portable terminal device, and imaging. FIG. 3 is a diagram illustrating an entire image of a document formed by combining a plurality of partial images.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a perspective view schematically showing a document reading system according to an embodiment of the present invention. As shown in FIG. 1, the document reading system Sy of the present embodiment includes a traveling device 1 and a portable terminal device 3. The traveling device 1 includes a pair of traveling bodies 5A and 5B that vertically travel on a flat surface F on which a document G is placed, and a vertical direction shown in FIG. A connecting bar 6 extending in a lateral direction (an example of a second direction in the claims) orthogonal to a first direction in the range, and a holder 7 movably provided along the connecting bar 6. Have. The portable terminal device 3 is supported by the holder 7 above the document G (a position facing the document G).

  FIG. 2 is a side view schematically showing each of the traveling bodies 5A and 5B. As shown in FIG. 2, each of the traveling bodies 5A and 5B includes two traveling rollers 51 that are in contact with the flat surface F, and a traveling body drive unit 52 that drives the traveling rollers 51 to rotate. The traveling body drive unit 52 includes a motor and a power transmission mechanism such as a gearbox that transmits the rotational driving force of the motor to each traveling roller 51. In each of the traveling bodies 5A and 5B, each traveling roller 51 is rotationally driven by the traveling body drive unit 52, and travels on the flat surface F in the vertical direction.

  FIG. 3 is a cross-sectional view schematically showing the connection bar 6, the holder 7, the mobile terminal device 3, and the like. As shown in FIG. 3, the connection bar 6 has an outer pipe 61 and an inner pipe 62 movably inserted inside the outer pipe 61, and the inner pipe 62 moves within the outer pipe 61. The entire connecting bar 6 can be expanded and contracted. The traveling body 5A is connected to one end of the inner pipe 62, the traveling body 5B is connected to one end of the outer pipe 61, and the distance between the traveling bodies 5A and 5B is adjusted by expansion and contraction of the connecting bar 6.

  On the outer circumference of the outer pipe 61 and the inner pipe 62, three sets of groove-shaped depressions 61A (the outer pipe 61 side) and 62A (the inner pipe 62 side) are provided continuously in the longitudinal direction of the pipes 61 and 62. Each of the sets of groove-like depressions 61A and 62A is connected between the outer pipe 61 and the inner pipe 62 to form one groove-like depression.

  The convex portion facing the inside of each groove 61A of the outer pipe 61 is fitted into the concave portion facing the outside of each groove 62A of the inner pipe 62 to prevent the outer pipe 61 and the inner pipe 62 from rotating with each other. Have been.

  The holder 7 that supports the mobile terminal device 3 is attached to the connection bar 6 via a holder support 8. The holder support 8 includes a frame 81 arranged on the outer periphery of the connection bar 6 and a housing 82 fixed to the lower surface of the holder 7 and supporting the frame 81.

  The frame 81 has a polygonal cross-sectional shape surrounding the outer periphery of the connection bar 6, and a drive roller 83 and two driven rollers 84 are provided inside the frame 81. A driving roller 83 is fitted into the downward grooved depressions 61A, 62A of the pipes 61, 62, and two driven rollers 84 are fitted into respective grooved depressions 61A, 62A of the pipes 61, 62, which are diagonally upward. Thus, the frame 81 is held outside the connection bar 6, and the holder 7 is supported above the connection bar 6 via the frame 81 and the housing 82.

  As shown in FIG. 4, two drive rollers 83 are arranged in the longitudinal direction of each of the pipes 61 and 62, and are fitted into the downward groove-shaped depressions 61A and 62A of each of the pipes 61 and 62. These drive rollers 83 are driven to rotate by a holder drive unit 85 built in the housing 82. The holder driving unit 85 includes a motor and a power transmission mechanism such as a gearbox that transmits the rotational driving force of the motor to each driving roller 83. The two driven rollers 84 are also arranged two by two in the longitudinal direction of each of the pipes 61 and 62, and are fitted into the obliquely upward groove-shaped depressions 61A and 62A of each of the pipes 61 and 62. Therefore, a total of four driven rollers 84 are provided.

  When each driving roller 83 is rotationally driven by the holder driving unit 85, each driving roller 83 rolls along the downward grooved depression 61A, 62A of each pipe 61, 62, and each driven roller 84 moves each pipe 61. , 62 are driven and rotated along the diagonally downward groove-shaped depressions 61A, 62A, whereby the drive roller 83 self-runs on the groove-shaped depressions 61A, 62A, whereby the frame 81, the housing 82, and The holder 7 is moved laterally along the connecting bar 6.

  Here, as shown in FIG. 1, the holder 7 has a pair of grip portions 71 and 72. The grips 71 and 72 are configured so as to be able to approach and separate from each other, and one grip 72 is urged in a direction approaching the other grip 71, and between the grips 71 and 72. The portable terminal device 3 is sandwiched and held.

  In this state, when the traveling body drive unit 52 of each traveling body 5A, 5B causes each traveling body 5A, 5B to travel in the vertical direction, the connecting bar 6, the holder 7, and the portable terminal device 3 move in the vertical direction. When the holder driving unit 85 rotationally drives each driving roller 83, the holder 7 and the portable terminal device 3 are moved in the lateral direction. Accordingly, the mobile terminal device 3 is moved in the vertical direction by the running body drive unit 52 of each of the running bodies 5A and 5B, and the mobile terminal device 3 is moved in the horizontal direction by the holder drive unit 85.

  As shown in FIGS. 1 and 3, an imaging camera 31 facing downward is provided on the back side of the portable terminal device 3, and an image captured by the imaging camera 31 is displayed on the front side. A display unit 32 is provided. With the portable terminal device 3 supported above the document G placed on the flat surface F, the imaging camera 31 captures a partial image of the document G placed on the flat surface F, and the display unit 32 displays the image. Display a partial image. When the mobile terminal device 3 is moved in the vertical direction and the horizontal direction, the partial image of the document G captured by the imaging camera 31 changes, and the partial image displayed on the display unit 32 also changes as needed.

  Next, FIG. 5 is a block diagram showing a configuration of the traveling device 1 and a configuration of the portable terminal device 3 in the document reading system Sy.

  The traveling device 1 includes a short-range communication unit 11, a control unit 12, a power supply 13, a traveling unit driving unit 52 of each of the traveling units 5A and 5B, and a holder driving unit 85. These components can transmit and receive data or signals to and from each other via a bus.

  The short-range communication unit 11 is a communication interface that performs short-range communication based on, for example, Bluetooth (registered trademark), and communicates control data and the like with the portable terminal device 3.

  The control unit 12 includes a processor, a random access memory (RAM), a read only memory (ROM), and the like. The processor is, for example, a central processing unit (CPU), an application specific integrated circuit (ASIC), or a micro processing unit (MPU). The control unit 12 functions as the control unit 21 when the control program stored in the ROM is executed by the processor. Note that each of the above-described components of the control unit 12 may be configured by a hardware circuit without performing the operation based on the above-described control program.

  The control unit 12 is connected to the short-distance communication unit 11, the traveling unit driving unit 52 of each traveling unit 5A, 5B, the holder driving unit 85, and the like, and controls the operation of these components and the connection with each of the components. Transmission and reception of signals or data between devices.

  The control unit 21 functions as a processing unit that executes various processes, and controls the driving of the traveling body drive unit 52 and the holder drive unit 85 of each of the traveling bodies 5A and 5B. Further, the control unit 21 has a function of controlling the communication operation of the short-range communication unit 11.

  The power supply 13 is composed of, for example, a battery or the like, and supplies operating power to the short-distance communication unit 11, the control unit 12, the traveling unit driving unit 52 of each of the traveling units 5A and 5B, the holder driving unit 85, and the like. For example, the power supply 13 is provided inside the short-distance communication unit 11, the control unit 12, and the traveling unit driving unit 52 of the one traveling unit 5 </ b> A together with the short-distance communication unit 11, the control unit 12. The operating power is supplied to the traveling body drive unit 52 of the one traveling body 5A. In addition, the power source 13 is connected to the other traveling body 5A via a cable (not shown) that is passed through the inside of each of the pipes 61 and 62 of the connecting bar 6 and is guided to the other traveling body 5B. Electric power is supplied to the traveling body drive unit 52 of the body 5B. Further, the power supply 13 supplies electric power to the holder driving unit 85 via a cable (not shown) led out from one traveling body 5A and led to the holder driving unit 85.

  Next, the mobile terminal device 3 is, for example, a smartphone or a mobile device, and includes an imaging camera 31, a display unit 32, a touch panel 33, a physical key 34, a network communication unit 35, and a short-range communication unit 36. , A storage unit 38, and a control unit 39. These components can transmit and receive data or signals to and from each other via a bus.

  The imaging camera 31 is a camera including a lens and an imaging element (CCD, CMOS, or the like), and captures a partial image of the document G and outputs image data indicating the partial image.

  The display unit 32 includes a liquid crystal display (LCD: Liquid Crystal Display), an organic EL (OLED: Organic Light-Emitting Diode), and the like. For example, a plurality of icons are displayed on the screen of the display unit 32.

  The touch panel 33 is a touch panel of a so-called resistive type or a capacitive type. The touch panel 33 is arranged on the screen of the display unit 32, detects a touch (touch) of the user's finger or the like on the touch panel 33 together with the contact position, and inputs a user's instruction on the screen of the display unit 32. Therefore, the touch panel 33 functions as an operation unit through which a user operation on the screen of the display unit 32 is input.

  Further, the mobile terminal device 3 includes a physical key 34 in addition to the touch panel 33 as an operation unit to which an instruction by a user operation is input.

  The network communication unit (NW communication unit) 35 is a communication interface including a communication module such as a LAN chip (not shown). The network communication unit 35 is connected to a server, a PC, or the like via a LAN, the Internet, or the like.

  The short-range communication unit (NF communication unit) 36 is a communication interface that performs short-range communication based on, for example, Bluetooth, and communicates with the traveling device 1 such as control data.

  The storage unit 38 is a storage device such as a random access memory (RAM) and a hard disk drive (HDD), and stores various application programs and various information.

  The control unit 39 includes a processor, a RAM, a ROM, and the like. The processor is, for example, a CPU, an ASIC, an MPU, or the like. The control unit 39 functions as the control unit 41 when the operation control program stored in the ROM or the storage unit 38 is executed by the processor.

  The control unit 39 is connected to the imaging camera 31, the display unit 32, the touch panel 33, the physical keys 34, the network communication unit 35, the short-range communication unit 36, the storage unit 38, and the like. It transmits and receives signals or data to and from the components.

  The control unit 41 plays a role as a processing unit that executes various processes. Further, the control unit 41 has a function of controlling the display operation of the display unit 32. Further, the control unit 41 has a function of controlling communication operations of the network communication unit 35 and the short-range communication unit 36.

  The portable terminal device 3 is provided with a power supply 37 composed of, for example, a battery, and the power supply 37 supplies operating power to each component.

  In the document reading system Sy having such a configuration, control data and the like are transmitted and received between the traveling device 1 and the portable terminal device 3 by short-range communication based on Bluetooth. The control unit 41 of the portable terminal device 3 controls the driving of the traveling body drive units 52 of the traveling bodies 5A and 5B through the control unit 21 on the traveling device 1 side by transmitting and receiving the control data, and controls the holder driving unit 85. The portable terminal device 3 supported by the holder 7 is moved in the vertical direction or the horizontal direction above the document G by controlling the driving. Then, the control unit 41 of the mobile terminal device 3 sequentially captures partial images of the document G by the imaging camera 31 of the mobile terminal device 3 when the mobile terminal device 3 moves in the vertical direction or the horizontal direction. Are combined to generate an entire image of the document G.

  Next, as described above, the mobile terminal device 3 is moved in the vertical direction or the horizontal direction, the partial images of the original G are sequentially captured by the imaging camera 31, and a plurality of captured partial images are combined, and The process for generating the entire image will be described in more detail with reference to the flowchart shown in FIG.

  First, the user sets the portable terminal device 3 in the holder 7 of the traveling device 1 and turns on a power switch (not shown) of the traveling device 1 to activate the traveling device 1. In the traveling device 1, when the traveling device 1 is started, the control unit 41 puts the short-range communication unit 36 into a standby state.

  Further, the control unit 21 drives and controls the holder driving unit 85 to move the holder 7 to the one traveling body 5A side along the connecting bar 6 and move the holder 7 to the home position near the one traveling body 5A. (S101). For example, a limit switch or a sensor for detecting the holder 7 moved to the home position is provided on a side wall of the traveling body 5A facing the holder 7 side. The control unit 21 drives and controls the holder driving unit 85, moves the holder 7 based on the output of the limit switch and the sensor until the holder 7 reaches the home position, and positions the holder 7 at the home position.

  Subsequently, when the user performs a touch operation on a predetermined icon displayed on the screen of the display unit 32 of the mobile terminal device 3, for example, the control unit 41 performs a document reading instruction through the touch panel 33 in response to the operation. Is received (S102), the image capturing by the image capturing camera 31 is started, and the image captured by the image capturing camera 31 is displayed on the screen of the display unit 32 as needed (S103).

  Then, as shown in FIG. 1, the user places each of the traveling bodies 5A and 5B of the traveling device 1 on which the portable terminal device 3 is placed on the flat surface F on which the document G is placed, and expands and contracts the connecting bar 6. Then, the distance between the traveling bodies 5A and 5B is adjusted to be slightly wider than the width of the document G, and the traveling bodies 5A and 5B are arranged on both outer sides of the document G. Further, the user adjusts the direction of each of the traveling bodies 5A and 5B so that the vertical direction in which each of the traveling bodies 5A and 5B travels is parallel to the vertical side of the document G. Further, the user sets each traveling body 5A so that the upper left corner of the document G is displayed on the screen of the display unit 32 of the mobile terminal device 3, that is, the upper left corner of the document G is imaged by the imaging camera 31. Adjust the vertical position of 5B. Thereby, the portable terminal device 3 and each of the traveling bodies 5A and 5B are positioned as shown in FIG.

  In this state, when the user operates the physical key 34 of the portable terminal device 3 to input an image capture instruction, the control unit 41 changes the image of the imaging range R1 shown in FIG. 7 according to the image capture instruction. The image data shown is captured from the imaging camera 31, and the image data is stored in the storage unit 38 (S105).

  The control unit 41 determines whether or not a partial image of the original G in the imaging range R1 includes the upper left corner of the original G based on the image data indicating the image in the imaging range R1 (S106). When the upper left corner of the document G is included in the partial image of the document G in the imaging range R1, a shadow occurs along each side of the document G, and the density difference between the inside and outside of each side of the document G increases. The unit 41 analyzes the image of the imaging range R1 by using, for example, a known edge detection technique or the like, and detects each side of the document G and a corner of the document G at which each side intersects. Furthermore, the control unit 41 detects the direction of the corner (corner position) of the document G, and determines whether or not the upper left corner of the document G is included in the partial image of the document G.

  If the controller 41 determines that the partial image of the document G does not include the upper left corner of the document G (“No” in S106), the controller 41 prompts an error and prompts readjustment of the positions of the traveling bodies 5A and 5B. The message is displayed on the display unit 32 (S107). The process returns to S105. The user reads the message and adjusts the positions of the traveling bodies 5A and 5B again so that the upper left corner of the document G is displayed by the imaging camera 31.

  When the control unit 41 determines that the partial image of the document G includes the upper left corner of the document G (“Yes” in S106), the control unit 41 activates the short-range communication unit 36 and communicates with the short-range communication unit 36. The control data communication with the short-range communication unit 11 of the traveling device 1 is started (S108). Then, the control unit 41 generates control data for moving the holder 7 and the mobile terminal device 3 in the horizontal direction by the first distance D1 set in advance, and transmits the control data from the short-range communication unit 36 to the traveling device. Send to 1.

  In the traveling device 1, when the control data is received by the short-range communication unit 11, the control unit 21 drives and controls the holder driving unit 85 in accordance with the control data, and controls the holder 7 and the mobile terminal device 3. Before moving along the connecting bar 6 in the horizontal direction toward the vertical side VR on the right side of the document G shown in FIG. 7 by the first distance D1 or stopping, or before moving the first distance D1. Is stopped when approaching the traveling body 5B (S109).

  For example, the control unit 21 rotates each driving roller 83 of the holder driving unit 85 by a fixed rotation angle corresponding to the first distance D1, and moves the holder 7 and the portable terminal device 3 by the first distance D1. In addition, a limit switch and a sensor for detecting the holder 7 approaching the traveling body 5B are provided on a side wall of the traveling body 5B facing the holder 7 side. When the control unit 21 determines that the holder 7 has approached the traveling body 5B based on the output of the limit switch and the sensor while controlling the drive of the holder driving unit 85, the control unit 21 determines whether the holder 7 is in the middle of the movement of the first distance D1. In addition, the portable terminal device 3 is stopped.

  The first distance D1 is set slightly shorter than the length of the width of the imaging range of the mobile terminal device 3 by the imaging camera 31. For this reason, when the holder 7 and the portable terminal device 3 are moved laterally toward the right vertical side VR of the document G by the first distance D1 and stopped, the imaging range of the imaging camera 31 becomes one immediately before. Slightly overlaps with the imaging range in the horizontal direction. When the holder 7 and the mobile terminal device 3 are stopped by approaching the traveling body 5B before being moved by the first distance D1, the imaging range at the time of the stop is different from the immediately preceding imaging range. The direction will overlap much more.

  The control unit 41 waits for a certain period of time required for the holder 7 and the mobile terminal device 3 to move by the first distance D1, and when the holder 7 and the mobile terminal device 3 move by the first distance D1, as shown in FIG. (Preferably, the movement is stopped), image data representing an image in the imaging range R2 is captured from the imaging camera 31, and the image data is stored in the storage unit 38 (S110).

  Then, the control unit 41 determines whether or not a corner of the original G is included in the partial image of the original G in the imaging range R2 based on the image data indicating the image in the imaging range R2 (S111). It is determined whether or not the vertical side of G is included (S112).

  Here, since the partial image of the original G in the imaging range R2 does not include any of the corners and the vertical sides of the original G, the control unit 41 sets the corners and the vertical It is determined that none of the sides is included (S111 “No”, S112 “No”). In this case, the control unit 41 returns to the process from S109, and drives and controls the holder driving unit 85 through the control unit 21 on the traveling device 1 side by communication of control data between the portable terminal device 3 and the traveling device 1; Even before the holder 7 and the portable terminal device 3 are moved in the horizontal direction toward the right vertical side VR of the document G and moved by the first distance D1, and then stopped, or before the movement is performed by the first distance D1. When approaching the traveling body 5B, it is stopped.

  The control unit 41 waits for a certain period of time required to move the holder 7 and the mobile terminal device 3 for the first distance D1, and moves the holder 7 and the mobile terminal device 3 by the first distance D1 as shown in FIG. Then, the image data indicating the image in the imaging range R3 is captured from the imaging camera 31, and the image data is stored in the storage unit 38 (S110). When the holder 7 and the portable terminal device 3 are approached to the traveling body 5B and stopped before being moved by the first distance D1, the imaging range R3 is larger than the immediately preceding imaging range R2 in the lateral direction. Overlap.

  Here, in the case of image data indicating an image in the imaging range R3, the control unit 41 determines that a corner of the original G is included in the partial image of the original G in the imaging range R3 (“Yes” in S111). ), Based on the determination results in S106 and S111, it is determined whether or not the corner included in the partial image of the document G is the fourth corner (S113). Here, the first corner is included in the partial image of the original G in the imaging range R1, and the second corner is included in the partial image of the original G in the imaging range R3. In this case, the control unit 41 determines that the corner included in the partial image of the document G is not the fourth corner ("No" in S113), and thus determines whether or not the vertical side of the document G is included. A determination is made (S112).

  In this case, the partial image of the original G in the imaging range R3 includes the vertical side VR on the right side of the original G. Therefore, the control unit 41 includes the vertical side VR of the original G. Is determined (S112 “Yes”), control data for moving the connecting bar 6, the holder 7, and the mobile terminal device 3 in the vertical direction by the second distance D2 set in advance is generated, and the control data is generated. The data is transmitted from the short-range communication unit 36 to the traveling device 1.

  In the traveling device 1, when the control data is received by the short-range communication unit 11, the control unit 21 drives and controls the traveling body driving units 52 of the traveling bodies 5 </ b> A and 5 </ b> B according to the control data, and The bar 6, the holder 7, and the mobile terminal device 3 are moved vertically and by the second distance D2 toward the lower horizontal side HL of the document G (S114). For example, the control unit 21 rotates the running rollers 51 of the running body drive unit 52 by a fixed rotation angle corresponding to the second distance D2 for each of the running bodies 5A and 5B, and the connection bar 6, the holder 7, Then, the mobile terminal device 3 is moved by the second distance D2.

  The second distance D2 is set to be slightly shorter than the length of the vertical width of the imaging range of the mobile terminal device 3 by the imaging camera 31. For this reason, when the connecting bar 6, the holder 7, and the portable terminal device 3 are moved vertically and toward the lower side HL of the original G by the second distance D2 and stopped, the imaging camera 31 The imaging range slightly overlaps with the immediately preceding imaging range in the vertical direction.

  The control unit 41 waits for a certain period of time required for the connection bar 6, the holder 7, and the mobile terminal device 3 to move for the second distance D2, and then converts the image data representing the image of the imaging range R4 shown in FIG. 31 and the image data is stored in the storage unit 38 (S115).

  Then, the control unit 41 of the portable terminal device 3 communicates the control data between the portable terminal device 3 and the traveling device 1, and the holder 7 and the portable terminal device 3 by the holder driving unit 85 through the control unit 21 of the traveling device 1. Is reversed (S117), the process returns to S109, and the drive of the holder driving unit 85 is controlled to move the portable terminal device 3 in the horizontal direction toward the left vertical side VL of the document G. It is moved and stopped by the first distance D1 or stopped when approaching the traveling body 5A even before being moved by the first distance D1. Since the limit switch and the sensor for detecting the holder 7 moved to the home position are provided on the side wall of the traveling body 5A facing the holder 7 as described above, the control unit 21 drives the holder driving unit 85. If it is determined that the holder 7 has approached the traveling body 5A based on the output of the limit switch or the sensor while controlling, the portable terminal device 3 can be stopped.

  The control unit 41 waits for a certain period of time required for the mobile terminal device 3 to move the first distance D1, and assuming that the mobile terminal device 3 has been moved the first distance D1 as shown in FIG. The image data indicating the image is captured from the imaging camera 31 and the image data is stored in the storage unit 38 (S110).

  Subsequently, the control unit 41 determines that neither the corner nor the vertical side of the original G is included in the partial image of the original G in the imaging range R5 based on the image data indicating the image in the imaging range R5 ( (S111 “No”, 112 “No”), and return to the processing from S109, and drive control of the holder driving unit 85 through the control unit 21 of the traveling device 1 by communication of control data between the portable terminal device 3 and the traveling device 1. Then, even if the mobile terminal device 3 is moved in the horizontal direction toward the left vertical side VL of the document G and is stopped by moving the first distance D1, or even before the mobile terminal device 3 is moved by the first distance D1. Stop when approaching 5A.

  The control unit 41 waits for a certain time required for the mobile terminal device 3 to move the first distance D1, and assuming that the mobile terminal device 3 has been moved by the first distance D1 as shown in FIG. The image data indicating the image is captured from the imaging camera 31 and the image data is stored in the storage unit 38 (S110). When the mobile terminal device 3 is stopped by approaching the traveling body 5A before being moved by the first distance D1, the imaging range R6 largely overlaps the previous imaging range R5 in the horizontal direction.

  Next, the control unit 41 determines that the corners of the original G are not included in the partial image of the original G in the imaging range R6 based on the image data indicating the image in the imaging range R6 (S111 “No”). Further, if it is determined that the partial image of the document G includes the vertical side of the document G (S112 “Yes”), the control of the traveling device 1 is performed by communicating the control data between the portable terminal device 3 and the traveling device 1. The drive unit 52 of each of the traveling bodies 5A and 5B is drive-controlled through the unit 21 to move the portable terminal device 3 vertically and toward the lower side HL of the document G by the second distance D2. (S114). Then, the control unit 41 waits for a certain period of time required for the mobile terminal device 3 to move the second distance D2, and then takes in image data representing an image of the imaging range R7 shown in FIG. The data is stored in the storage unit 38 (S115).

  Further, the control unit 41 reverses the direction of movement of the portable terminal device 3 by the holder driving unit 85 through the control unit 21 of the traveling device 1 through communication of control data between the portable terminal device 3 and the traveling device 1 (S117). ), Returning to the processing from S109, the drive of the holder driving unit 85 is controlled, and the portable terminal device 3 is stopped by moving the portable terminal device 3 in the horizontal direction toward the right vertical side VR of the document G by the first distance D1. Alternatively, even before moving by the first distance D1, the vehicle is stopped when approaching the traveling body 5B.

  The control unit 41 waits for a certain time required for the mobile terminal device 3 to move the first distance D1, and assuming that the mobile terminal device 3 has been moved by the first distance D1 as shown in FIG. 7, the imaging range R8 The image data indicating the image is captured from the imaging camera 31 and the image data is stored in the storage unit 38 (S110).

  Subsequently, the control unit 41 determines that neither the corner nor the vertical side of the original G is included in the partial image of the original G in the imaging range R8 based on the image data indicating the image in the imaging range R8 ( (S111 “No”, S112 “No”), and return to the processing from S109, drive control of the holder driving unit 85 through the control unit 21 of the traveling device 1 by communication of control data, and change the portable terminal device 3 to the original G Is moved in the horizontal direction toward the right vertical side VR and stopped by the first distance D1 or stopped when approaching the traveling body 5B even before being moved by the first distance D1.

  The control unit 41 waits for a certain period of time required for the mobile terminal device 3 to move the first distance D1, and assuming that the mobile terminal device 3 has been moved by the first distance D1 as shown in FIG. The image data indicating the image is captured from the imaging camera 31 and the image data is stored in the storage unit 38 (S110). Note that, when the mobile terminal device 3 is stopped by approaching the traveling body 5B before being moved by the first distance D1, the imaging range R9 largely overlaps with the immediately preceding imaging range R8 in the horizontal direction.

  Finally, when the control unit 41 determines that the corners of the original G are included in the partial image of the original G in the imaging range R9 based on the image data indicating the image in the imaging range R9 (“Yes” in S111). ), It is determined whether or not the corner included in the partial image of the original G is the fourth corner based on the determination results of S106 and S111 (S113). At this time, the first corner is included in the partial image of the original G in the imaging range R1, the second corner is included in the partial image of the original G in the imaging range R3, and the partial image of the original G in the imaging range R7 is included. Contains the third corner, and the fourth corner is included in the partial image of the document G in the imaging range R9. It is determined that the corner is the fourth corner ("Yes" in S113), and all the partial images of the document G in each of the imaging ranges R1 to R9 stored in the storage unit 38 are combined, as shown in FIG. An entire image of the document G is generated (S118), and the processing shown in FIG. 6 ends.

  For example, the control unit 41 calculates the similarity of a portion where the images of the two imaging ranges overlap while gradually changing the relative position and the relative angle of the images of the two imaging ranges adjacent to each other. A common portion of the images in the two imaging ranges is determined based on the image, and the images in the two imaging ranges are combined in a state where the common portions overlap. That is, the control unit 41 removes the same image portion included in the image of the other adjacent imaging range from the image of one adjacent imaging range (the same image portion included in the image of the other imaging range). Are not removed), and these adjacent images are combined. The control unit 41 performs the synthesizing process on the images in the imaging range adjacent in the vertical direction and the horizontal direction.

  As described above, in the present embodiment, the control unit 41 of the mobile terminal device 3 moves the mobile terminal device 3 vertically or horizontally above the document G, and the document camera G of the mobile terminal device 3 is captured by the imaging camera 31 of the mobile terminal device 3. Are sequentially captured, and a plurality of partial images captured by the imaging camera 31 are combined to generate an entire image of the document G. Therefore, an image of a large-sized document can be read with high accuracy by a simple operation using one portable terminal device.

  For example, when the whole document is imaged at once from the large-size document by the imaging camera 31 of the mobile terminal device 3 and is captured as one image, the captured image may depend on the resolution of the imaging camera 31. According to the above embodiment, even when the resolution of the imaging camera 31 is relatively low, it is possible to read an image of a large-sized document with high accuracy using one portable terminal device 3. Can be.

  The configuration and processing of the above-described embodiment described with reference to FIGS. 1 to 8 are merely examples of the present invention, and are not intended to limit the present invention to the configuration and processing.

DESCRIPTION OF SYMBOLS 1 Traveling device 3 Mobile terminal device 5A, 5B Traveling body 6 Connecting bar 7 Holder 8 Holder support part 11, 36 Short-range communication part 12, 39 Control unit 21, 41 Control part 31 Imaging camera 32 Display part 33 Touch panel 34 Physical key 35 Network communication unit 38 Storage unit 52 Traveling body drive unit 85 Holder drive unit Sy Document reading system

Claims (7)

A document reading system including a traveling device and a portable terminal device,
The traveling device,
Two traveling bodies traveling in a predetermined first direction on a flat surface on which a document is placed;
A connecting bar extending between the traveling bodies in a second direction orthogonal to the first direction;
A holder that is provided movably along the connection bar and supports the portable terminal device at a position facing the document.
A traveling body driving unit that causes the traveling bodies to travel in the first direction on the flat surface;
A holder driving unit that moves the holder in the second direction along the connection bar,
The mobile terminal,
An imaging camera;
A control unit for controlling the operation of the mobile terminal,
The control unit controls the traveling body driving unit to move the mobile terminal device in a first direction at a position facing the document by causing each traveling body to travel in the first direction, and the holder By controlling a driving unit, the portable terminal device is moved in the second direction at a position facing the document by moving the holder in the second direction along the connection bar, When moving in the first direction and the second direction, partial images of the document are sequentially captured by the imaging camera, and a plurality of partial images captured by the imaging camera are combined to generate an entire image of the document. Document reading system.   The control unit determines both sides of the document in the first direction based on the partial image of the document captured by the imaging camera, controls the holder driving unit, and determines the mobile terminal device. The document is reciprocated in the second direction with both sides of the original in the first direction as a turning position, and when the portable terminal device is at the turning position, the traveling body driving unit is controlled to move the portable terminal device to the 2. The original reading system according to claim 1, wherein the original is moved in a first direction.   The control unit controls the holder driving unit to start the movement of the mobile terminal device in the second direction from the turnback position, and moves the mobile terminal device to a first distance set in the second direction in advance. 3. The document reading system according to claim 2, wherein the image capturing camera captures a partial image of the document each time the document is moved.   The control unit controls the traveling body drive unit when the mobile terminal device is at the turnback position, moves the mobile terminal device in a first direction by a second distance set in advance, and performs the imaging. The document reading system according to claim 2, wherein a partial image of the document is captured by a camera.   The control unit controls the holder driving unit to start the movement of the mobile terminal device in the second direction from one side of the document in the first direction to another side, and the image is captured by the imaging camera. The document according to any one of claims 1 to 4, wherein when the other side of the document in the first direction is determined based on the partial image of the document, the movement of the mobile terminal device in the second direction is terminated. Reading system.   The control unit determines a corner of the document based on a partial image of the document captured by the image capturing camera, and determines that the corner is the fourth corner of the document by using the image capturing camera. The document reading system according to claim 1, wherein imaging of the document is terminated.   7. The connecting bar according to claim 1, wherein the connecting bar is expandable and contractable in a second direction, and a distance between the traveling bodies is set according to a length of the connecting bar in the second direction. 8. Document reading system according to the above.