JP6843373B2 - Slip processing device, slip processing method and program - Google Patents

Description

The present invention relates to a slip processing apparatus, a slip processing method and a program.

A handy terminal is known as a data collection terminal device for business use. Some handy terminals are equipped with a barcode scanner and a camera, and acquire barcode identification information printed on the barcode and image information of the slip captured by the camera from various slips.

Conventionally, when data management is performed by associating the barcode identification information printed on a slip with the image information of the slip, the identification information is first obtained by scanning the barcode with a barcode scanner, and then the camera. There is known a management method of storing identification information and image information in association with each other by imaging a slip (see Patent Document 1).

Japanese Unexamined Patent Publication No. 11-349114

However, since the above-mentioned conventional management method requires two actions of performing imaging after reading the barcode, extra time and labor are required as compared with the case of simply acquiring the identification information of the barcode. There was a problem that it was extremely wasteful, for example, when processing a large number of slips.

An object of the present invention is to improve the workability of a slip processing operation for acquiring identification information and image information from a slip.

To solve the above problem, in the document processing apparatus according to the present invention, based on the live view image obtained by the first photographing by the imaging means in the predetermined slip photographing subject, the in the live view in the image The detection means for detecting the area occupied by the slip, and when the detection means detects the area occupied by the slip, the identification information is read from the barcode attached to the slip in response to a predetermined user operation. When it is determined that the reading means to be started and the identification information have been successfully read by the reading means, the still image is captured by the second shooting by the photographing means which starts the identification information in response to the predetermined user operation. On the other hand, when it is determined that the reading of the identification information by the reading means has failed, it is started in response to the predetermined user operation. Position information including an image recording control means for discarding the slip image even if the slip image has been acquired by the second shooting by the photographing means, and the barcode is added to the predetermined slip. However, the reading means is registered in advance in a predetermined database, and the reading means identifies a position to which the barcode is added based on the position information.

Further, the slip processing method according to the present invention is a slip processing method executed by the slip processing device, and is based on a live view image acquired by the first shooting by a shooting means for shooting a predetermined slip. , A detection step for detecting an area occupied by the slip in the live view image, and a bar added to the slip according to a predetermined user operation when the area occupied by the slip is detected in the detection step. when a reading control step to start reading by the reading means of the identification information from the code, the reading of the identification information by the reading unit in the reading control step is determined to be successful, the predetermined the identification information While recording in a predetermined recording means in association with the slip image acquired as a still image by the second photographing by the photographing means started in response to the user operation of the above, the identification by the reading means in the reading control step. When it is determined that the reading of the information has failed, the slip image is discarded even if the slip image has already been acquired by the second shooting by the shooting means started in response to the predetermined user operation. The position information in which the bar code is added to the predetermined slip is registered in advance in a predetermined database, and the reading control step is based on the position information. It is characterized in that the position to which the bar code is added is specified.

Further, in the program according to the present invention, a computer document processing apparatus, based on the live view image obtained by the first photographing by the imaging means in the predetermined slip photographing subject, the in the live view in the image detecting means for detecting an area where slip occupied, if the area occupied by the document by the detecting means is detected, the reading means of the identification information from the bar code attached to the document in response to a predetermined user operation When it is determined that the reading control means for initiating the reading by the reading means has succeeded in reading the identification information, the second imaging by the photographing means in which the identification information is started in response to the predetermined user operation. While recording in a predetermined recording means in association with the slip image acquired as a still image by the above, when it is determined that the reading of the identification information by the reading means has failed, in response to the predetermined user operation. the image recording control means also discards the document image as the document image is a acquired, to function as, the barcode is added to the predetermined slip by the second photographing by said photographing means which is initiated The position information is registered in advance in a predetermined database, and the reading means identifies the position to which the bar code is added based on the position information.
It is characterized by that.

According to the present invention, it is possible to improve the workability of the slip processing work of acquiring the identification information and the image information from the slip.

It is a front view which showed one Embodiment of the handy terminal which concerns on this invention. It is a side view of a handy terminal. It is a perspective view which showed the back side of the handy terminal. It is a figure which shows the relationship between the light trail of a laser beam at the time of reading a bar code, and the shooting range of a camera. It is a block diagram which shows the outline of the electric structure of a handy terminal. It is a conceptual diagram which shows the slip data. It is a flowchart which shows the processing in a slip shooting mode. It is a figure which shows an example of a live view image.

Hereinafter, embodiments of the present invention will be described. 1 to 3 are views showing a handy terminal according to an embodiment of the slip processing device of the present invention.

This handy terminal is provided with a photographing function for photographing an object such as various slips or articles provided with a barcode, and is provided with an equipment case 1 as shown in FIGS. 1 to 3. There is. The device case 1 is composed of an upper case 2 and a lower case 3. The upper case 2 is provided with a display 4 and an input unit 5. The lower case 3 is provided with a reading device 6 and a battery lid 7.

In the device case 1, the tip side (upper side in FIG. 1) located on the display 4 side of the upper case 2 and the corresponding lower case 3 on the reading device 6 side is in the front-rear direction (vertical direction in FIG. 1). The front side (lower side in FIG. 1) formed on the long rectangular main body 1a and located on the input portion 5 side of the upper case 2 and the battery lid 7 side of the corresponding lower case 3 is in the front-rear direction. It is formed on a long rectangular grip portion 1b. Further, in the device case 1, the width of the grip portion 1b is narrower than the width of the main body portion 1a, and the entire device case 1 is formed in a battledore shape.

As shown in FIG. 1, the input unit 5 includes various keys 5a such as a numeric keypad, an arithmetic key, a cursor key, an enter key, and a power key, which are arranged in an upper case 2 located on the grip portion 1b side. There is. A center trigger key 5b is provided on the upper side of the input unit 5, while side trigger keys 5c are provided on both side surfaces of the device case 1.

The reading device 6 is composed of a scanner and a camera provided inside the unit case 10 provided on the lower surface (upper surface in FIG. 3) of the lower case 3 corresponding to the back surface side of the display 4, and the unit case 10 includes a scanner and a camera. Is provided with a reading window portion 11 corresponding to a scanner and a photographing window portion 12 corresponding to a camera.

The scanner of the reading device 6 irradiates the object with laser light through the reading window portion 11, and while moving the irradiation position back and forth in a predetermined direction, receives the reflected light to read the barcode and code data. Is a common one to get. Further, the camera of the reading device 6 captures an object by an image sensor via a photographing window portion 12, and an image of the object or the like captured by the camera is displayed on the display 4.

Here, in the handy terminal, as shown in FIG. 2, the irradiation direction S1 of the laser light in the reading device 6 and the shooting direction S2 of the camera are set in the same direction, and the laser moves back and forth when reading the barcode. The light trail is configured to cross the shooting range of the camera at a predetermined position.

FIG. 4 is a diagram showing the relationship between the light trail T of the laser beam L and the shooting range 100 of the camera when the barcode is read. In the present embodiment, the shooting range 100 of the camera is rectangular, the moving direction of the laser beam L is in the left-right direction, and the light trail T is located slightly below the center of the shooting range 100 and crosses the shooting range 100. .. Further, the crossing position N of the light trail T, that is, the vertical position in the photographing range 100 is constant.

Further, the laser beam irradiation direction S1 and the camera shooting direction S2 are ensured to be tilted at a predetermined angle θ with respect to the lower surface of the device case 1, that is, the lower surface of the lower case 3, and the user (worker) can use the barcode. When performing the reading work and the shooting work of the object, the work can be easily performed while looking at the display 4. It is desirable that the predetermined angle θ is tilted toward the tip end side (upper side side in FIG. 2) of the lower case 3 in an angle range of 40 ° to 80 °, preferably an angle of 60 °.

On the other hand, FIG. 5 is a block diagram showing an outline of the electrical configuration of the handy terminal. The handy terminal has a CPU (Central Processing Unit) 21 and a RAM (Random) connected to the CPU 21.
It is composed of an Access Memory) 22, a main storage unit 23, a storage unit 24, a key input unit 25, a display unit 26, a scanner unit 27, a camera unit 28, a communication unit 29, and a clock unit 30.

The main storage unit 23 is composed of a rewritable non-volatile memory such as a flash memory built in the handy terminal. The main storage unit 23 stores various setting information and the like related to the control program, the operation of the handy terminal set by the user, and the like. Further, the handy terminal can handle a plurality of types of slips, and the main storage unit 23 stores information regarding the plurality of types of slips (hereinafter referred to as slip information) preset by the user in advance together with the control program. The slip information includes the shape (aspect ratio) of the slip, the actual size, the description position of the barcode, and the type of the barcode.

The CPU 21 reads a control program from the main storage unit 23, expands it into the RAM 22, and controls the operation of the handy terminal based on the expanded control program. At that time, the RAM 22 is used as a work memory, and various data including image data are temporarily stored as needed.

The key input unit 25 includes various keys 5a (numeric keypad, calculation key, cursor key, enter key, power key, etc.), a center trigger key 5b, and a side trigger key 5c, detects the presence or absence of an operation on them, and detects them. The operation information of is supplied to the CPU 21. The display unit 26 includes a display 4 and a drive circuit thereof. The display 4 is, for example, an LCD (Liquid Crystal Display) or an ELD (Electro Luminescent Display).

The scanner unit 27 is a laser scanner module or the like housed in the reading device 6 described above, and is a laser diode that emits laser light, reflects the laser light, and rotates within a predetermined angle on the surface of the article. It is equipped with a movable mirror that scans barcodes and a light receiving element that receives diffusely reflected light on the surface of the article. The scanner unit 27 includes a laser control circuit that controls the light emission of the laser diode, a mirror drive circuit that drives a movable mirror, an analog signal processing circuit that processes an analog signal output by a light receiving element and performs A / D conversion, and a digital after processing. A decoding circuit that decodes code data from a signal and supplies the code data to the CPU 21 is included.

The camera unit 28 is a digital camera module or the like housed in the reading device 6 described above, and is composed of an image sensor or the like that images a subject through a photographing lens including a focus lens. The image sensor is, for example, a CCD (Charge Coupled Device) or CMOS (Complementary Meta10xide Semiconductor) type.

Although not shown, the camera unit 28 processes a drive circuit for driving the image sensor and an image pickup signal read from the image sensor, performs various signal processing such as white balance and brightness adjustment, and supplies the image data to the CPU 21. It includes an image processing circuit that performs AF (Auto Focus) and an AF drive circuit that realizes an AF (Auto Focus) function by driving the image sensor and adjusting the focus.

The storage unit 24 is composed of, for example, various memory cards that can be attached to and detached from the handy terminal, and a card interface that enables data input / output to / from the memory card. The storage unit 24 is associated with the code data acquired by the scanner unit 27, that is, the identification information unique to the slip, and the image data acquired by the camera unit 28, and the slip data 50 shown in FIG. 6 together with other information. Is remembered as.

FIG. 6 is a conceptual diagram showing slip data 50 stored in the storage unit 24. The slip data 50 is composed of slip management ID 51, code data 52, image data 53, and shooting date / time 54. Here, the slip management ID 51 is identification information used for managing the slip data 50, and the shooting date and time 54 is the acquisition date and time of the image data 53.

The communication unit 29 communicates with an external information device by wired or wireless communication as needed, and transmits the slip data 50 stored (stored) in the storage unit 24 to the external information device. The external information device is, for example, a computer or a data management server used for management work such as warehousing / delivery of goods and inventory.

The clock unit 30 is a real-time clock having a calendar function, measures the current date and time, and outputs the time information to the CPU 21.

Next, the operation of the handy terminal when the user acquires the identification information and the image information from the slip using the handy terminal will be specifically described. FIG. 7 is a flowchart showing a process in the slip shooting mode in which the CPU 21 executes according to the control program stored in the main storage unit 23 when the power is turned on.

In the slip shooting mode, the CPU 21 reads the slip information related to the slip designated in advance as the processing target from the main storage unit 23 (step S1). Further, the CPU 21 starts the live view display, that is, the camera unit 28 captures the image at a predetermined frame rate (for example, 30 fps) and displays the captured image (hereinafter, live view image) on the display 4 (step S2). ). Meanwhile, the camera unit 28 performs focus adjustment by the AF function.

After that, the CPU 21 recognizes the area corresponding to the slip (hereinafter, the slip area) from the live view image for each frame (may be several frames) sequentially captured (step S3). For the recognition of the slip area, for example, edge detection or straight line recognition is performed on the live view image, a plurality of rectangular areas partitioned along the recognized straight lines are detected, and the rectangular area having the largest area is detected. It is performed by specifying it as a slip area. Color information can also be used to specify the slip area.

When the slip area can be recognized (step S4: YES), the CPU 21 superimposes and displays a guide frame on a predetermined position of the live view image by the OSD (On Screen Display) function (step S5). FIG. 8A is a diagram showing an example of a live view image 201 in a state where the guide frame F is displayed on the live view image 201 in which the target slip 301 exists. The guide frame F indicates to the user the size and position of the slip 301 in the live view image 201 that should be secured when the slip 301 is photographed.

The size indicated by the guide frame F is the minimum size that can secure a predetermined resolution (pixel size) in the slip 301 portion in the image obtained by taking the slip 301. The position indicated by the guide frame F is a position suitable for reading the barcode 302 of the slip 301, and is a position corresponding to the position of the light trail T of the laser beam L at the time of reading the barcode (see FIG. 4). In the process of step S5, the shape, size, and display position of the guide frame F are set at that time in a configuration in which the number of effective pixels of the image sensor in the camera unit 28 or the number of pixels of the recorded image can be selected. It is determined based on the number of pixels and the slip information set in the slip to be processed, that is, the shape (aspect ratio) of the slip, the actual size, and the description position of the barcode.

Then, after displaying the guide frame F on the live view image 201, the CPU 21 determines whether or not the trigger key (center trigger key 5b or side trigger key 5c) is turned on, that is, whether or not the trigger key is pressed by the user. Is checked sequentially (step S6). During that time, the user adjusts according to the size and position of the slip 301 in the live view image 201 and the guide frame F.

Eventually, when the trigger key is pressed by the user (step S6: YES), the CPU 21 instructs the camera unit 28 to take a picture, and the camera unit 28 receives an imaging operation for acquiring an image for recording, that is, The shooting operation is performed (step S7), and the data of the shot image acquired by the camera unit 28 is temporarily stored in the RAM 22 (step S8). At this time, the current time information is acquired via the clock unit 30, and is temporarily stored in association with the data of the captured image.

Subsequently, the CPU 21 instructes the scanner unit 27 to read the barcode after incrementing the count value n of the number of times of the barcode reading operation set to "0" at the beginning of the process (step S9), and the scanner unit 27. In 27, a series of reading operations including irradiation of a laser beam, scanning of a barcode by the irradiated laser beam, and decoding of code data are performed (step S10).

Note that FIG. 8B is a diagram showing an example of the live view image 201 immediately after the barcode reading operation is started by the scanner unit 27. The light trail T of the laser beam is projected on the live view image 201 during the reading operation.

When the scanner unit 27 can acquire the code data (step S11: YES), the CPU 21 temporarily stores the acquired code data in the RAM 22 (step S12), and at the beginning of the process, the code is set to "0". The count value S of the number of successful data acquisitions is incremented (step S12). After that, the CPU 21 returns to the process of step S9 before the number of barcode reading operations reaches 10 times (n = 10) (step S13: NO), and repeats the subsequent processes.

Further, when the code data cannot be acquired by the scanner unit 27 (step S11: NO), the CPU 21 immediately returns to the process of step S9 before the number of barcode reading operations reaches 10 (step S13: NO). The subsequent processing is repeated.

Eventually, when the number of barcode reading operations reaches 10 times (n = 10) (step S13: YES), the CPU 21 confirms whether or not the number of successful code data acquisitions is 3 times or more (step S14: YES).

Then, if the number of successful acquisitions of the code data is 3 or more (step S15: YES), the CPU 21 finally determines that the barcode has been read successfully, and determines that the captured image data is temporarily stored in the RAM 22. The code data is associated with the code data and stored in the storage unit 24 (step S16). That is, the captured image data and the code data are stored in the storage unit 24 together with other data as new slip data 50. After that, the CPU 21 displays on the display 4 that the acquisition of the data (code data and the captured image data) has been completed (step S17), thereby ending one reading operation.

On the other hand, when the number of successful acquisitions of the code data is less than 3 (step S15: NO), the CPU 21 finally determines that the barcode reading has failed, and determines that the data (code data and captured image data) has failed. The fact that the acquisition is impossible is displayed on the display 4 (step S18). Further, the captured image temporarily stored in the RAM 22 is deleted (step S19). The CPU 21 prompts the user to redo the data acquisition work, and returns to the process of step S3 to repeat the subsequent processes.

As described above, in the present embodiment, once the user presses the trigger key (center trigger key 5b or side trigger key 5c), the barcode reading operation and the slip shooting operation are performed in response. Therefore, when data management is performed by associating the identification information (code data) of the barcode 302 printed on the slip 301 with the image information (photographed image data) of the slip 301, the workability of the slip processing required for the data management is improved. Can be made to. The effect is particularly large when processing a large number of slips.

Further, regarding the reading of the barcode, the scanner unit 27 was made to perform the reading operation a plurality of times (10 times in the above example), and the code data was successfully acquired a specified number of times or more (3 times or more in the above example). As a condition, the captured image data is associated with the code data and stored in the storage unit 24. As a result, for example, the bar code portion of the slip may be uneven or dirty, and the reading may be successful or unsuccessful due to a slight difference in the irradiation angle of the laser beam. However, the code data can be acquired more reliably. As a result, the workability of slip processing can be further improved.

In the present embodiment, the barcode reading operation is performed after the slip shooting operation is performed in response to the trigger key operation, but both operations may be performed in parallel at the same timing. Good. In that case, for example, by temporarily stopping the irradiation of the laser light in the scanner unit 27 only during the exposure period of the image sensor during the shooting operation of the camera unit 28, the reflection of the light trail of the laser light in the captured image can be achieved. Can be prevented.

The embodiments of the present invention and modifications thereof have been described above, but these can be appropriately changed as long as the effects of the present invention can be obtained, and the modified embodiments are also within the scope of claims. It is included in the scope of the described invention and the invention equivalent to the invention. The inventions described in the claims of the original application of this application are described below.
(Appendix 1)
A reading means that irradiates the slip with light and reads the identification information from the barcode provided on the slip.
Photographing means for photographing the slip and
An information acquisition control means that responds to an information acquisition instruction from the user and performs reading of the identification information by the reading means and photographing of the slip by the photographing means.
A recording control means for recording the photographed image of the slip in a predetermined recording means in relation to the acquired identification information based on the successful timing on the condition that the acquisition of the identification information is successful is provided. A slip processing device characterized by the fact that.
(Appendix 2)
The information acquisition control means responds to an information acquisition instruction from the user and causes the reading means to read the identification information a plurality of times.
The recording control means records the photographed image of the slip in a predetermined recording means in relation to the acquired identification information, provided that the reading means succeeds in acquiring the identification information more than a specified number of times. The slip processing device according to Appendix 1, wherein the slip processing apparatus is described.
(Appendix 3)
The slip processing device according to Appendix 1 or 2, wherein the photographing direction in the photographing means is set in the same direction as the irradiation direction of the light beam.
(Appendix 4)
A slip processing method in a slip processing device including a reading means for irradiating a slip with light rays and reading identification information from a barcode provided on the slip, and a photographing means for photographing the slip.
A step of reading the identification information by the reading means and taking a picture of the slip by the taking picture means in response to an information acquisition instruction from the user.
It is characterized by including a step of recording a photographed image of the slip in a predetermined recording means in relation to the acquired identification information based on the successful timing on condition that the acquisition of the identification information is successful. Slip processing method.
(Appendix 5)
A computer provided with a slip processing device including a reading means for irradiating a slip with light rays and reading identification information from a barcode provided on the slip and a photographing means for photographing the slip.
An information acquisition control means that responds to an information acquisition instruction from the user and performs reading of the identification information by the reading means and photographing of the slip by the photographing means.
The function as a recording control means for recording the photographed image of the slip in a predetermined recording means in relation to the acquired identification information based on the successful timing on the condition that the acquisition of the identification information is successful. A program characterized by letting you do it.

4 Display 5b Center trigger key 5c Side trigger key 11 Reading window 12 Shooting window 21 CPU
22 RAM
23 Main memory 24 Storage 25 Key input 26 Display 27 Scanner 28 Camera 50 Slip data 100 Shooting range 201 Live view image 301 Slip 302 Barcode F Guide frame L Laser light T Light trail S1 Irradiation direction S2 Shooting direction

Claims (6)

A detection means for detecting an area occupied by the slip in the live view image based on the live view image acquired by the first shooting by the shooting means for shooting the predetermined slip .
When the detection means detects the area occupied by the slip, the reading means that starts reading the identification information from the barcode attached to the slip in response to a predetermined user operation.
When it is determined that the reading of the identification information by the reading means is successful, the identification information is obtained as a still image by the second shooting by the shooting means started in response to the predetermined user operation. While recording in a predetermined recording means in association with each other, when it is determined that the reading of the identification information by the reading means has failed, the first image by the photographing means which is started in response to the predetermined user operation. (2) An image recording control means for discarding the slip image even if the slip image has already been acquired by shooting, and
With
The location information to which the barcode is added to the predetermined slip is registered in advance in the predetermined database.
The reading means identifies a position to which the barcode is added based on the position information.
A slip processing device characterized by this. The image recording control means reads the identification information a plurality of times by the reading means, and determines that the reading of the identification information is successful on condition that the acquisition of the identification information is successful more than a specified number of times.
The slip processing device according to claim 1, wherein the slip processing device is characterized in that. The image recording control means performs a decoding process based on the reflected light of the light beam applied to the barcode a plurality of times, and the barcode can be decoded a specified number of times or more by the decoding process. It is determined that the reading of the identification information is successful.
The slip processing device according to claim 1 or 2, characterized in that. The image recording control means determines that the reading of the identification information has failed when the barcode cannot be decoded more than a specified number of times by the decoding process.
The slip processing device according to claim 3, wherein the slip processing device is characterized in that. It is a slip processing method executed by the slip processing device.
A detection step of detecting an area occupied by the slip in the live view image based on the live view image acquired by the first shooting by the shooting means targeting the predetermined slip.
When the area occupied by the slip is detected in the detection step, a reading control step for starting reading of the identification information from the barcode attached to the slip by a reading means according to a predetermined user operation.
When it is determined that the reading means has succeeded in reading the identification information in the reading control step, the still image is captured by the second shooting by the photographing means in which the identification information is started in response to the predetermined user operation. When it is determined that the reading of the identification information by the reading means in the reading control step has failed while recording in the predetermined recording means in association with the slip image acquired as An image recording control step of discarding the slip image even if the slip image has already been acquired by the second shooting by the shooting means, which is started in response to the above.
Have,
The location information to which the barcode is added to the predetermined slip is registered in advance in the predetermined database.
In the reading control step, the position to which the barcode is added is specified based on the position information.
A slip processing method characterized by this. The computer of the slip processing device,
A detection means that detects an area occupied by the slip in the live view image based on the live view image acquired by the first shooting by the shooting means that targets the predetermined slip.
A reading control means that starts reading of identification information from a barcode attached to the slip in response to a predetermined user operation when the detection means detects an area occupied by the slip.
When it is determined that the reading of the identification information by the reading means is successful, the identification information is obtained as a still image by the second shooting by the shooting means started in response to the predetermined user operation. While recording in a predetermined recording means in association with each other, when it is determined that the reading of the identification information by the reading means has failed, the first image by the photographing means which is started in response to the predetermined user operation. 2 Image recording control means for discarding the slip image even if the slip image has already been acquired by shooting.
To function as
The location information to which the barcode is added to the predetermined slip is registered in advance in the predetermined database.
The reading means identifies a position to which the barcode is added based on the position information.
A program characterized by that.

Images