JP2011090662A - Business form reception system, cellular phone, server, program and duplicate business form - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reduce communication cost, and to easily perform data management by reducing a data amount of image data transmitted to a mobile POS server from a cellular phone, in a business form reception system using a mobile POS system. <P>SOLUTION: This business form reception system 1 performs business form reception by the use of the mobile POS system using the cellular phone 3. As a business form, a duplicate order slip 8 is used. Only ruled lines are printed on a duplicated paper sheet 82 of the order slip 8, rectangular frames are formed of the ruled lines, and written-down contents of the order slip 8 are duplicated in the rectangular frames. The cellular phone 3 cuts out frame area images 11 from the photographed duplicated paper sheet 82 based on a preset extraction pattern, removes an unnecessary portion, and transmits them to the server 4. The server 4 decides whether or not the number of the frame area images 11 transmitted from the cellular phone 3 and the number of pieces of registered entry data 12 accord with each other, and presents a warning of an effect of discordance when they does not accord with each other. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a form acceptance process in a POS system using a mobile phone.

Conventionally, every time a product is sold at a store, the sales information of the product is recorded at a store cash register, and the result of aggregation is collected by a server to be used as inventory management, customer management, order management, marketing materials, etc. Sales system) is used.
By the way, the purchase of goods is not always done at the store. For example, in order for the customer to purchase a product that is not displayed in the store by looking at the catalog, the destination and the ordered product are filled in the order form in the predetermined format. Sometimes order forms are accepted and settled. Further, for example, Patent Document 1 describes a method of performing settlement at the time of purchasing a product via a network and receiving a product at a convenience store.
As described above, in recent years, various mechanisms related to purchase and receipt of merchandise other than in stores have been proposed. In order to flexibly respond to such merchandise purchase trends, as a technology that can introduce the above-mentioned POS system more easily, mobile A portable POS system using a telephone has been developed. In this portable POS system, a cellular phone is used instead of the store cash register in the conventional POS system.

  Specifically, in the example of using the portable POS system for the above-mentioned order receipt of catalog product sales, when a customer accepts an order form filled with necessary items at a store, a store employee sends the contents of the order form to a mobile phone. Shoot using the digital camera function. The photographed order form image is sent to the mobile POS server using the communication function of the mobile phone. In order to leave the contents of the order form image sent from each mobile phone as the order data, the portable POS server sends the order form image to the entry center where the data input operation is performed, and receives the order data punch-input by the operator. The mobile POS server performs order processing with the supplier, performs inventory management, and performs settlement management according to the contents of the order data.

JP 2005-284524 A

  However, in the conventional order form (form) reception process, an image taken by the digital camera function of the mobile phone is uploaded to the mobile POS server as it is, as in the above example. For this reason, there is a problem that the amount of data to be communicated is large, and the communication cost and the data management equipment cost in the portable POS server are increased. Further, the image data is punch-input by an operator at the entry center, but there is a demand for preventing input leakage and preventing this.

  The present invention has been made in view of such a problem. In a form acceptance system using a portable POS system, the communication cost is reduced by reducing the data amount of image data transmitted from a cellular phone to a portable POS server. The goal is to reduce and make data easier to manage.

  In order to solve the above-described problem, the first invention has a server that manages data related to a form and has a communication function with a mobile phone, a communication function with the server, and a digital camera function that captures an image of the form. A mobile phone, wherein the mobile phone extracts, based on a preset extraction pattern, at least one frame region image from the entire captured form image; A form reception system comprising: a transmission unit configured to transmit a frame area image to the server.

  According to the first invention, the frame area image is extracted from the entire form image photographed by the digital camera of the mobile phone based on the extraction pattern set in advance, and the extracted frame area image is transmitted to the server. For this reason, unnecessary portions of the form image are removed, the amount of data can be reduced, communication costs can be reduced, and data can be easily managed.

Further, the form acceptance system presents the frame area image transmitted to the server to the worker to prompt the operator to input, and data for each frame area image input by the worker is used as entry data. Entry means for registering to the server is further provided, and the server determines whether or not the number of the frame area images transmitted from the mobile phone and the number of the entry data registered by the entry means match. And a warning means for presenting a warning to that effect when it is determined by the determination means that the number of frame area images and the number of entry data do not match.
Therefore, the server determines whether or not the number of frame area images transmitted from the mobile phone and the number of entry data registered by the entry means match. Since this warning is presented, omission of data input in the entry means is prevented, and data management in the server is facilitated.

  The form photographed by the mobile phone is a copy form of a copy form that is a combination of an entry form and a copy form, and the copy form contains a copy of the entry form to be copied. Ruled lines parallel to the vertical and horizontal sides of the copy paper are printed so as to form a rectangular frame surrounding the area corresponding to the area, and all the ruled lines extend to at least one side of the copy paper. desirable.

  As described above, if a copy sheet on which only ruled lines are printed and the written contents are copied is taken as an object to be photographed, the cellular phone does not need to photograph information other than that required by the server, and the data amount of the image is reduced. . In addition, the rectangular pattern formed by the ruled lines makes it easy to extract the above extraction pattern, and the extraction process in the mobile phone can be speeded up.

  The mobile phone preferably further includes a table holding unit that holds a pattern table storing one or more extraction patterns corresponding to the format of the form. Since the table holding means holds the extraction patterns of the various forms, the mobile phone can cut out the frame area images corresponding to the various forms.

  In addition, the mobile phone further includes a removing unit that removes blank frames from the frame region image extracted by the extracting unit, and the transmitting unit outputs the frame region image from which the blanks have been removed by the removing unit. It is desirable to send it to the server.

  In this way, by removing the blank frame area from the extracted frame area image, the data uploaded to the server can be made smaller.

The mobile phone preferably further includes correction means for correcting the inclination of the photographed form image.
As a result, the inclination of the captured form image can be corrected, so that the mobile phone can accurately extract the frame region image.

  A second invention is a mobile phone provided with a photographing means for photographing an image of a form and a means for communicating with a server, and is an image set in advance from the entire form image photographed by the photographing means. A mobile phone comprising: extraction means for extracting at least one frame area image based on an extraction pattern; and transmission means for transmitting the frame area image to the server.

  With the mobile phone of the second invention, it is possible to extract a frame area image based on an extraction pattern set in advance from the entire photographed form image and transmit the extracted frame area image to the server. For this reason, unnecessary portions of the form image are removed, the amount of data can be reduced, and the communication cost of the mobile phone can be reduced.

The mobile phone preferably further includes a table holding unit that holds a pattern table storing one or more extraction patterns corresponding to the format of the form.
In addition, the mobile phone further includes a removing unit that removes blank frames from the frame region image extracted by the extracting unit, and the transmitting unit outputs the frame region image from which the blanks have been removed by the removing unit. It is desirable to send it to the server.
Moreover, it is preferable that the mobile phone further includes a correction unit that corrects the inclination of the photographed form image.

  A third invention is a server that manages an image related to a form and entry data in which writing contents in the image are input and processed in a predetermined data format. The image is preset from the entire form image. A frame region image in which at least one frame region is extracted based on the extracted pattern, and the server presents the unprocessed frame region image to the work terminal to prompt the operator to input Entry means for accepting data for each frame area image input as entry data, determination means for determining whether the number of the frame area images matches the number of entry data, and the determination And a warning means for warning that the number of the frame area images and the number of the entry data are not matched by the means. .

  According to the third invention, the server presents the unprocessed frame area image to the work terminal to prompt the operator to input, and accepts data for each frame area image input by the worker as entry data, It is determined whether or not the number of frame area images matches the number of entry data. If it is determined that they do not match, a warning to that effect is given. Therefore, data input leakage is prevented and data management in the server is facilitated.

  According to a fourth aspect of the present invention, an entry sheet on which a form in a predetermined format is printed and a copy sheet to be stacked on the back side of the entry sheet are combined, and the written content on the entry sheet is copied to the copy sheet. The copy form has a vertical side and a horizontal side on the copy sheet so that a rectangular frame is formed surrounding the area corresponding to the copy target area in the print contents of the entry sheet. The copy form is characterized in that ruled lines parallel to the sides are printed and all the ruled lines extend to at least one side of the copy paper.

  In the copy form of the fourth invention, ruled lines are printed on the paper to be copied, and the written contents are only copied. Therefore, if this is taken as an object to be photographed by a mobile phone, the data amount of the photographed image is reduced. it can. Further, it is easy to extract a portion to be extracted by a rectangular frame formed by ruled lines of the copy paper. Therefore, it is possible to provide a form suitable for the form acceptance system of the first invention.

  A fifth invention is a program readable by a mobile phone, wherein an extraction step of extracting at least one frame region image from the entire photographed form image based on a preset extraction pattern, and the frame region A transmission step of transmitting an image to a server.

  By applying the program of the fifth invention to a mobile phone, it becomes possible to cause a general-purpose mobile phone to function as a mobile phone suitable for the form receiving system of the first invention.

  The sixth invention is a computer-readable program, wherein the number of frame area images in which at least one frame area is extracted from an entire form image based on a preset extraction pattern, and the frame area A determination step of determining whether or not the written content in the image matches the number of entry data input in a predetermined data format, and the determination step determines the number of the frame area images and the entry data When it is determined that the numbers do not match, the program includes a warning step for warning that effect.

  By applying the program of the sixth invention to a computer, a general-purpose computer can be caused to function as a server of the form receiving system of the first invention.

  7th invention manages the data regarding a form, the server which has a communication function with a mobile telephone and an entry terminal, the mobile phone which has a digital camera function which images | photographs the image of the communication function with the said server and the said form, An entry terminal for presenting the frame area image transmitted to the server to the worker to prompt the operator to input, and registering data for each frame area image input by the worker as entry data in the server In the form acceptance system, the mobile phone extracts at least one frame area image from the entire photographed form image based on an extraction pattern set in advance, and the frame area image to the server. Transmission means for transmitting, and the entry terminal is an image identification enable / disable flag indicating whether or not the worker can identify the contents of the frame region image, And flag addition means for accepting addition of at least one of deficiency confirmation flags indicating deficiencies in the description in the frame area image, and for the entry data, the identification information of the form and the clerk who photographed the form A flag is added by the identification information input means and the flag adding means to input the store clerk code or the store code to which the clerk belongs, and the clerk code of the clerk who photographed the form by the identification information input means or the clerk's Entry data registration means for registering the entry data associated with the store code to the server, the server according to the contents of the image identification enable / disable flag and the deficiency confirmation flag added to the entry data. , The identification information of the unclear or incomplete form, the clerk code of the clerk who took the form or Is a form accepted system characterized in that it comprises a blurred imaging management means for storing in association with the shop code belongs clerk.

According to the seventh invention, in the entry terminal, among the image identification enable / disable flag indicating whether or not the operator can identify the contents of the frame region image, and the defect confirmation flag indicating the defect in the description in the frame region image At least one of them is added to create entry data, and this entry data is associated with the clerk code of the clerk who photographed the form or the store code to which the clerk belongs. When such entry data is registered in the server, the server takes the identification information of the unclear or incomplete form according to the contents of the image identification enable / disable flag and the defect confirmation flag added to the entry data. Management is performed in association with the store clerk code of the store clerk or the store code to which the clerk belongs.
Therefore, it becomes possible to register the deficiency confirmation work, which has been handled by the entry center by inquiring the store clerk, in the server so that the entry data entry work can be made more efficient.

Further, the unclear photographing management means of the server, the unclear list generating means for creating a list of unclear or incomplete forms managed by the unclear photographing management means for each store clerk, mobile phone, or store, Transmitting means for transmitting a list of unclear or incomplete forms generated by the unclear list generating means to the mobile phone of the photographing source, and the mobile phone is a list of unclear or incomplete forms transmitted from the server. It is desirable to provide display means for displaying.
As a result, it becomes possible to transmit the unclear or incomplete form managed by the server to the mobile phone that has accepted the form for easy confirmation, and to prompt the user to re-shoot the form.

  According to the present invention, in a form acceptance system using a portable POS system, by reducing the amount of image data transmitted from a cellular phone to a portable POS server, it is possible to reduce communication costs and facilitate data management. It becomes possible.

System configuration diagram of form acceptance system 1 Hardware configuration diagram of mobile phone 3 Hardware configuration diagram of portable POS server 4 A diagram for explaining the entry form 81 and the copy form 82 of the copy form 8 Flowchart showing extraction of frame region image in mobile phone 3 and update to mobile POS server 4 The figure explaining the extraction of the frame area from the copy paper 82 The figure explaining the rectangular table 30 hold | maintained at the mobile telephone 3 The figure explaining the frame area image uploaded to the portable POS server 4 A flowchart showing a flow of registration of entry data in the entry terminal 51 and confirmation of unregistered data in the portable POS server An example of database management information 13 managed by the portable POS server 4 An example of a form image taken unclearly Hardware configuration diagram of entry terminal 51 Example of entry form 8 (second embodiment) Example of entry data entry rules The flowchart explaining the flow of the input process in the entry terminal 51 The flowchart explaining the flow of the input process in the entry terminal 51 In the second embodiment, an example of database management information 13 and clerk management information 15 managed by the portable POS server 4 In the second embodiment, an example of unclear image management information 17 managed by the portable POS server 4 The figure which shows the flow of the business application of the mobile telephone 3 The figure which shows the flow of the business application of the mobile telephone 3 The figure which shows the flow of the business application of the mobile telephone 3

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.
[First embodiment]
First, the configuration of the present invention will be described with reference to FIGS.

FIG. 1 is a diagram showing a system configuration of a form acceptance system 1 according to the present invention.
As shown in FIG. 1, the form acceptance system 1 uses a portable POS system, and its main configuration is a cellular phone 3 operated by an employee of the store 2 and a portable POS server 4. In the present embodiment, a form reception in product sales using a catalog is taken as an example. In this example, the form reception system 1 further includes an entry center 5, a supplier 6, a management center 7, and a call center 9. The portable POS server 4, the entry center 5, the supplier 6, the management center 7, and the call center 9 are each provided with a data processing terminal such as a computer, and each computer is a LAN (Local Area Network) or WAN (Wide Area Network). Are connected to each other via a network such as the Internet. The communication connection between the mobile phone 3 and the mobile POS server 4 is performed via various networks including a mobile phone line including a mobile phone base station, a PHS (Personal Handy-phone System), and a wireless LAN.

  The entry terminal 51 of the entry center 5 is realized by a general-purpose computer such as a personal computer equipped with a web browser, and information exchange between the entry terminal 51 and the portable POS server 4 is performed using the HTTP protocol. .

Next, the hardware configuration of the mobile phone 3 according to the present invention will be described with reference to FIG.
As shown in FIG. 2, the mobile phone 3 includes a control unit 301, a storage unit 302, a communication unit 303, an input unit 304, a display unit 305, an audio input unit 306, an audio output unit 307, a digital camera unit 308, a memory card input. An output unit 309 and the like are included.

The control unit 301 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like, and includes programs (including portable applications) stored in the ROM, the storage unit 302, a memory card, and the like. Are called and executed in the work memory area on the RAM, and each part of the mobile phone 3 is driven and controlled. The ROM permanently holds the OS (operating system) of the mobile phone 3, data necessary for program execution, and the like. The RAM temporarily holds the loaded program and data, and includes a work area used by the control unit 301 to perform various processes.
The storage unit 302 is a non-volatile storage medium such as a flash memory built in the mobile phone 3, a program (mobile application) installed in the mobile phone 3, address book data such as a telephone number and an e-mail address, etc. Store updatable data.

The input unit 304 includes a key button for inputting numbers, characters, operation instructions, and the like, and outputs a signal corresponding to the operation of the key button to the control unit 301.
A display unit 305 includes a liquid crystal display panel and the like, and performs display in accordance with an instruction from the control unit 301.

  The communication unit 303 includes a communication control unit, a modulator, a demodulator, an antenna, etc., and modulates the audio data input from the audio input unit 306 and transmits it to the base station, or demodulates the audio data received from the base station. Or output to the audio output unit 307. The communication unit 303 generates data for packet communication, transmits the data to the base station via the antenna, or receives a radio signal transmitted from the base station, demodulates the received signal, and performs packet communication. Get data for use.

  The voice input unit 306 includes a microphone, an A / D converter, and the like, converts the input voice signal into a digital signal, and outputs the digital signal to the communication unit 303. The audio output unit 307 includes an audio reproduction circuit, a speaker, an earphone, and the like. When the audio data received by the communication unit 303 and demodulated is received, the audio output unit 307 converts the audio data into audio by the audio reproduction circuit and outputs the audio from the speaker or the like.

The digital camera unit 308 includes a lens, a CCD (Charge Coupled Device), an image processing circuit, and the like, and generates an image signal by converting light received by the lens into an electrical signal by the CCD. An image photographed by the digital camera unit 308 is stored in the storage unit 302 under the control of the control unit 301.
The memory card input / output unit 309 is a communication interface with a memory card that is a detachable recording medium, and acquires data stored in the memory card under the control of the control unit 301 or with respect to the memory card. Write data.

Next, the hardware configuration of the portable POS server 4 according to the present invention will be described with reference to FIG.
As shown in FIG. 3, the portable POS server 4 includes a control unit 41, a storage unit 42, a media input / output unit 43, an input unit 44, a display unit 45, a peripheral device I / F unit 46, a communication unit 47, a database 48, and the like. Are connected via a bus 49.

The control unit 41 includes a CPU, a ROM, a RAM, and the like.
The CPU calls and executes a program stored in the storage unit 42, ROM, recording medium, or the like to a work memory area on the RAM, and drives and controls each unit connected via the bus 49. In the present embodiment, the CPU of the control unit 41 executes processing related to form reception (see FIGS. 5 and 9).

  The ROM permanently holds a computer boot program, a program such as BIOS, data, and the like. The RAM temporarily holds the loaded program and data, and includes a work area used by the control unit 41 for performing various processes.

  The storage unit 42 is an HDD (hard disk drive) or the like, and stores a program executed by the control unit 10, data necessary for program execution, an OS (operating system), and the like. These program codes are read by the control unit 41 as necessary, transferred to the RAM, and read and executed by the CPU.

  The media input / output unit 43 (drive device) is a media input / output device such as a floppy (registered trademark) disk drive, PD drive, CD drive, DVD drive, and MO drive, and performs data input / output.

The input unit 44 is an input device such as a keyboard, a pointing device such as a mouse, or a numeric keypad, and outputs input data to the control unit 41.
The display unit 45 includes a display device such as a liquid crystal panel or a CRT monitor, and a logic circuit for executing display processing in cooperation with the display device. The display unit 45 displays display information input by the control of the control unit 41. Display above.
The peripheral device I / F unit 46 is an interface with a printer and other peripheral devices.
The communication unit 47 has a communication control device, a communication port, and the like, and is a communication interface that mediates communication with the network.

  The database 48 accumulates and stores data managed by the mobile POS server 4. For example, the frame area image data 11 transmitted from each mobile phone 3, the entry data (order data) 12 registered from the entry terminal 51 of the entry center 5, and database management information which is information for managing these data 13. Stock management information is accumulated and stored. In addition, a rectangular table 30 described later is also stored in the database 48.

  Here, returning to FIG. 1, the flow of data when the form receiving system 1 of the present invention is used for receiving an order form for catalog sales will be described. In FIG. 1, a supplier 6 is a merchandise dealer, a management center 7 is a catalog distributor, and a call center 9 is an inquiry window from a user 10 or an inquiries window for incomplete orders.

  In the form acceptance system 1, first, a user 10 who places an order for a catalog refers to a catalog obtained in advance from the store 2 or the management center 7 (catalog seller) and enters desired order contents in the order form 8. Bring order slip 8 to store 2. In the order form 8, the written content on the entry sheet 81 is copied to the copy sheet 82. At the store 2, the employee confirms the contents of the order slip 8 on the spot and checks the inventory using the data communication function of the mobile phone 3. That is, the mobile phone 3 accesses the mobile POS server 4 via the communication unit 303 and inputs the product code and the number of orders entered in the order slip 8 on a predetermined inventory confirmation screen provided from the mobile POS server 4. The mobile POS server 4 confirms whether there is a stock from the input product code and the ordered quantity, and transmits the confirmation content to the mobile phone 3. The mobile phone 3 displays the received inventory confirmation content on the display unit 305 of the mobile phone 3. If the employee is in stock, the employee receives a payment from the user 10. Thereafter, the order slip 8 is accepted.

When receiving the order slip 8, the employee of the store 2 captures the order slip 8 with the digital camera unit 308 of the mobile phone 3 and transmits the captured image to the mobile POS server 4.
In the present embodiment, a copy-type order form 8 as shown in FIG. The employee of the store 2 photographs the copy-receiving sheet 82 of the copy-type order form 8 by the digital camera unit 308 of the mobile phone 3.

  As shown in FIG. 4, the order form 8 is a copy-form form in which (A) an entry sheet 81 and (B) a copy-receiving sheet 82 are combined. For example, the first order sheet is an entry sheet 81 and the second sheet is a copy sheet 82, and these sheets are written with handwritten characters or the like on the second copy sheet 82 by the pressure applied to the entry sheet 81. Paper that can be copied is used. For example, as the entry sheet 81, a carbon printing sheet having carbon ink applied on the back surface is used, or as the entry sheet 81 and the copy sheet 82, the color developer capsule and the developer are respectively applied to the surfaces in contact with each other. Carbonless paper (upper paper, middle paper, or lower paper) is used in appropriate combination. Furthermore, it is possible to add a sheet of a store copy, a user copy, a management center copy, etc. to the order slip 8 for spelling.

On the surface of the entry form 81, a unique code 83 of the order form 8, a requester entry field 85, and a plurality of destination entry fields 86 are printed.
The unique code 83 is an identification code that combines an identification code (order form ID) indicating the format type of the order form 8 and a serial number, and is expressed by a numerical value or text, or, for example, a QR code (registered trademark). It is expressed in the form of a two-dimensional code such as When expressed by a two-dimensional code, it can be read by the digital camera unit 308 of the mobile phone 3 or a predetermined reading device. In the following description, “order form code” has the same meaning as the unique code 83 of the order form 8.

In the requester entry field 85, the address, name, and telephone number of the requester (user 10) are entered by handwriting. In addition, in each destination entry field 86, information such as a product code and the number of orders is entered by hand in addition to the address, name and telephone number of the delivery destination.
The areas of the requester entry field 85 and the destination entry field 86 of the entry form 81 can be copied.

  Further, in the area 87 other than the unique code 83, the requester entry field 85, and the destination entry field 86 of the entry form 81, various guides, business contents, advertisements, and the like may be printed.

  Further, the copy sheet 82 is overlapped on the back side of the entry sheet 81, and surrounds the area corresponding to the copy target area (requester entry field 85, destination entry field 86) in the print contents of the entry sheet 81. Ruled lines K1 to K7 and T1 to T3 are printed so that a rectangular frame is formed. The ruled lines K1 to K7 and T1 to T3 are drawn parallel to the horizontal side (upper side or lower side) and vertical side (left side or right side) of the copy paper 82, respectively, and all extend to at least one side of the copy paper 82. To do. For example, the ruled lines K1 to K7 all extend to the left side of the copy sheet 82, and the ruled lines T1 to T3 all extend to the upper side of the copy sheet 82. The rectangular frames surrounded by the ruled lines K1 to K7 and T1 to T3 correspond to the requester entry field 85 or the address / name / phone number field of each destination entry field 86, respectively. On the copy paper 82, nothing other than the ruled lines K1 to K7 and T1 to T3 is printed. The written contents of the entry sheet 81 are copied into each rectangular frame.

  Next, with reference to FIG. 5, processing from the receipt of the order form in the mobile phone 3 to the update to the mobile POS server 4 will be described.

  First, the mobile phone 3 accesses the mobile POS server 4 at the time of activation, and checks whether or not the rectangular table 30 has been updated. If it has been updated, a new rectangular table 30 is downloaded and the rectangular table 30 held in the mobile phone 3 is overwritten.

  When accepting the order form 8, the employee of the store 2 operates the mobile phone 3 to read the unique code 83 by the digital camera unit 308 in a state where the order form acceptance application is activated. Take a picture. Then, an order button (a determination button of the mobile phone 3) is pressed (step S101).

  Then, the control unit 301 of the mobile phone 3 first determines whether or not the captured image is tilted, and corrects the tilt as necessary (step S102). Specifically, one ruled line or paper side is extracted from the photographed image, and it is determined whether or not the X coordinate or Y coordinate of both ends of the ruled line or side match. If they do not match, an inclination angle is calculated from the magnitude of the deviation of the X coordinate or Y coordinate at both ends of the ruled line (or side), and the image is rotated by that angle. In addition, when the camera lens is not positioned parallel to the surface of the copy paper 82, for example, when the image is taken so that the distance from the camera lens differs in the vertical direction of the paper, the lengths of the upper and lower sides are compared. Then, the ratio (enlargement ratio or reduction ratio) of the other length to one length is calculated, and each position in the vertical direction of the image is enlarged or reduced according to this ratio. The same processing is performed when the left and right sides are photographed with different side lengths.

  In order to prevent tilting during shooting, the guide line is displayed in at least one of the vertical and horizontal directions on the display unit 305 when the digital camera unit 308 is activated during execution of the order form acceptance application, and the operator recognizes the tilt of the image. You may make it easy. Further, when the captured image has a large inclination and cannot be corrected by the above-described correction processing, a warning may be displayed so that the image is captured again.

When the copy sheet 82 is photographed, the control unit 301 sets the corner of the photographed copy sheet 82 as the origin (0, 0), the side extending in the horizontal direction from the origin as the X axis, and the X axis on the X axis. Scan (step S103). Here, the upper left position of the copy sheet 82 is the origin, the upper side of the sheet is the X axis, and the left side of the sheet is the Y axis.
In the example shown in FIG. 6, ruled lines T1, T2, and T3 intersect with the upper side (X axis) of the copy paper 82 at the X1, X2, and X3 positions, respectively. The control unit 301 acquires the intersection X coordinate (X1, X2, X3) between each ruled line and the X axis, and stores it in the RAM (step S104).

Next, the control unit 301 scans the left side (Y axis) of the image (step S105).
In the example shown in FIG. 6, the ruled lines K1, K2, K3, K4, K5, K6, and K7 are located on the left side (Y axis) of the copy paper 82 at the Y1, Y2, Y3, Y4, and Y5 positions, respectively. , Y6 and Y7 positions. The control unit 301 acquires the intersection coordinates (Y1, Y2, Y3, Y4, Y5, Y6, Y7) between each ruled line and the Y axis, and stores them in the RAM (step S106).

  Next, the control unit 301 reads the extraction pattern of the corresponding order form 8 from the rectangular table 30. That is, the rectangular table 30 is searched using the unique code 83 read in step S101, and the extraction pattern of the order slip 8 is read (step S107).

  FIG. 7 shows an example of the rectangular table 30. As shown in FIG. 7, the rectangular table 30 defines a rectangular frame to be extracted and an extraction position for each type of order slip 8. The extraction position is determined in advance by the upper left position and the lower right position of each rectangular frame. The rectangular table 30 is constructed in the storage unit 302 of the mobile phone 3 when the mobile application is downloaded. The rectangular table 30 can be referenced (downloaded) at any timing from the portable application.

For example, in the rectangular table 30 shown in FIG. 7, the order form ID of the order form A and the order form ID of the order form B are stored as the type 30a of the order form 8, and the order form ID of the order form A includes Rectangle numbers 30b such as “1”, “2”, “3”, “4”, “5” are stored in association with each other. Each rectangular number 30b stores an extraction position 30c at the upper left of the rectangular frame and an extraction position 30d at the lower right of the rectangular frame. For example, the rectangular frame with the rectangular number “1” of the order slip A is determined by the upper left position (X1, Y1) and the lower right position (X2, Y2). Similarly, the rectangular frame with the rectangular number “2” of the order slip A is determined by the upper left position (X1, Y3) and the lower right position (X3, Y4).
The extraction positions X1, X2,..., Y1, Y2,... Of the rectangular table 30 store not the coordinate values but the ruled line reading order when scanning from the origin. This is because if the extraction pattern is determined by the coordinate value, it is not possible to cope with the positional deviation due to the photographing error.

  Such a rectangular table 30 is centrally managed in the database 48 of the portable POS server 4, and when a new order form (form) is added, the new rectangular table 30 is registered. When the order form (form) is abolished, the corresponding rectangular table 30 is deleted from the database 48.

The control unit 301 extracts each rectangular frame of the order form from the photographed image according to the read extraction pattern, and cuts out a frame area image as shown in FIG. 8B (step S108). The cut out frame area images 11a, 11b, 11c, 11d, and 11e are respectively individual images.
Further, the control unit 301 discards any blank image among the cut frame region images 11a, 11b, 11c, 11d, and 11e (step S109), and further compresses the data by a method such as run length compression, for example. (Step S110) and the unique code 83 (order slip ID) is transmitted to the portable POS server 4 (Step S111).

The portable POS server 4 receives the unique code 83 (including the order form ID) and the frame area images 11a to 11e (step T101) and stores them in the database 48 (step T102). Hereinafter, reference numeral 11 denotes a frame area image.
With the above processing, only the necessary area image (frame area image 11) is cut out from the order form 8 photographed by the mobile phone 3 and registered in the database 48 of the mobile POS server 4.

  The mobile POS server 4 transmits the frame area image 11 transmitted from each mobile phone 3 and registered in the database 48 to the entry terminal 51 of the entry center 5, and the written content in the frame area image 11 is converted into, for example, text data. Make a punch input. The punched data is registered in the database 48 of the server 4 as entry data (order data) 12.

  Here, with reference to FIG. 9, the punch input of the frame area image 11 in the entry center 5 and the management process of the entry data (order data) 12 in the portable POS server 4 will be described.

  The mobile POS server 4 is equipped with WWW (World Wide Web) server software that returns the execution result of a data file or a program in response to a request from the entry terminal 51, and a processing program that is called from the WWW software. The operation of the portable POS server 4 in FIG. 9 is realized by the functions of the WWW software and the processing program.

  As shown in FIG. 9, when a search request for an order form code list is transmitted from the entry terminal 51 to the portable POS server 4 (step U201), the portable POS server 4 obtains a list of order form codes from the database 48. A search is performed (step T201), and a list of order form codes is returned to the requesting entry terminal 51 (step T202).

  Next, a list of order form codes is displayed on the entry terminal 51 (step U202), and when one order form code for which punch input has not been completed is selected from the order form code list (step U203), the portable POS server 4 Retrieves a list of images related to the selected order form code from the database 48 (step T203), and returns a list of image IDs to the entry terminal 51 of the request source (step T204). When the entry terminal 51 receives a list of image IDs from the portable POS server 4, the entry terminal 51 displays the list of image IDs (step U204). When one image ID is selected from the list of image IDs in the entry terminal 51 (step U205), the mobile POS server 4 searches the database 48 for a frame area image 11 corresponding to the selected image ID (step S205). T205), the frame area image 11 is returned to the requesting entry terminal 51 (step T206). When the entry area 51 receives the frame area image 11 from the portable POS server 4, the entry area 51 displays the frame area image 11 (step U206). Since the frame area image 11 is sent in a compressed state, it is decompressed (decoded) by the entry terminal 51 and displayed.

  In the entry terminal 51, the operator inputs the written contents (handwritten characters, etc.) in the frame area image 11 as text data (step U207). If the written contents of the frame area image 11 are missed, the operator inputs “invalid”. The entered entry data (order data) 12 is transmitted to the portable POS server 4. The portable POS server 4 registers the entry data (order data) 12 in the database 48 (step T207).

  When the punch input for the frame area image 11 is completed at the entry terminal 51 and the end of the punch input is input by the operator, the entry terminal 51 transmits a punch input end instruction to the portable POS server 4 (step U208). ).

  When the portable POS server 4 receives the punch input end instruction, does the number of the frame area images 11 for the order form codes currently processed registered in the database 48 match the number of the order data 12? It is determined whether or not (step U209), and the determination result is returned to the entry terminal 51.

  FIG. 10 is a diagram showing an example of the database management information 13 of the mobile POS server 4. As shown in FIG. 10, the mobile POS server 4 manages the frame area image 11 and the entry data 12 in association with the unique code 83 that combines the order slip ID and the serial number. In the database management information 13, whether or not the number of frame area images 11 and the number of entry data 12 match is managed by an entry completion flag. After the entry is completed, the entry completion flag is set to “1” for those confirmed that the number of frame area images 11 and the number of entry data 12 match.

  When the entry terminal 51 receives the coincidence determination result between the frame area image 11 and the number of entry data (order data) 12 received from the mobile POS server 4, the entry terminal 51 displays the confirmation result (step U209). If the number of frame area images 11 and the number of entry data (order data) do not match, there is an input omission and a warning to that effect is displayed (step U210; Yes). When performing punch input for an input omission image, the process returns to step U204 to select an uninput frame area image 11 from the image ID list, obtain it from the portable POS server 4, and perform punch input. If the number of frame area images 11 and the number of entry data (order data) 12 match (step U210; No), the process proceeds to step U202, and punch input processing of the frame area image 11 for other order slip codes is performed. Do.

When the entry process as described above is completed, the mobile POS server 4 performs an order process for the supplier 7 in accordance with the contents of the order data. When the supplier 6 receives the order mail from the mobile POS server 4, the supplier 6 accesses the mobile POS server 4 and downloads the order data. The product is selected according to the order data, and packed and shipped.
In addition, the mobile POS server 4 transmits order data to the management center 7. The management center 7 collects and manages the order data received by the plurality of mobile POS servers 4. In addition, the call center 9 responds to inquiries, such as order contents, settlement, and other inquiries with the store 2 and the mobile POS server 4 in order to respond to inquiries from the user 9 by telephone or email.

As described above, in the form acceptance system 1 of the present embodiment, when sending image data from the mobile phone 3 to the mobile POS server 4, the mobile phone 3 is based on a preset extraction pattern. Then, at least one frame region image 11 is extracted from the entire photographed order form image and transmitted to the portable POS server 4.
Accordingly, it is possible to reduce the data amount of the captured image data, thereby reducing the communication cost.
Further, since the image data can be managed not in the order form unit but in a smaller frame area image unit, the portable POS server 4 can easily manage the data.

  In particular, after receiving the image data (frame region image 11) by the portable POS server 4, the content is punched as entry data (order data) 12, but the portable POS server 4 determines the number of frame region images 11 and By checking against the number of entry data 12, it is possible to easily confirm an input omission.

  4 is used as the order form 8, and only the vertical and horizontal ruled lines are printed on the copy paper 82 to be photographed, and the vertical and horizontal ruled lines are respectively arranged on the horizontal sides ( Since it extends to the upper side) or the vertical side (left side), it is easy to specify the rectangular frame formed by the ruled line after shooting with the digital camera unit 308 of the mobile phone 3, and image processing such as tilt correction and extraction can be performed. It becomes easy to do.

  In addition, since the mobile phone 3 holds a plurality of extraction patterns corresponding to the format of the form as the rectangular table 30, the mobile phone 3 can cut out the frame region image with a predetermined extraction pattern from various forms. It becomes.

  Furthermore, if the mobile phone 3 transmits the data to the mobile POS server 4 after removing blank space from the extracted frame area image 11 or compressing the data as necessary, the amount of data is further increased. Can be reduced.

  Further, when the order slip 8 is photographed by the mobile phone 3, if the inclination of the photographed image is corrected, the frame region image can be extracted more accurately.

In the above-described embodiment, the ruled line of the order form is an example in which the client, the address of the destination, the name, and the telephone number are cut out. However, the present invention is not limited to this. For example, when registering the product code and the number of orders as entry data, a rectangular frame (ruled line) may be formed so as to cut out the entry range.
The unit of the image data cut out as the frame area image may be a desired unit such as a product unit, not a requester or a destination unit.

  In addition, the vertical and horizontal ruled lines of the copy paper 82 of the form are each extended to one side (upper side and left side), but each ruled line is extended to both the upper and lower sides or both the left and right sides. When extracting the frame region in FIG. 5, the upper and lower sides and the left and right sides may be scanned in addition to the X and Y axes. When scanning the upper and lower sides and the left and right sides, it is easy to determine the mismatch between the ruled line positions in the vertical and horizontal directions, and it is easy to determine and correct the inclination of the image.

  Further, in the present embodiment, the case of receiving a form for ordering products has been described as an example. However, the present invention is not limited to this example, and various forms such as a customer management form and an inventory management form are accepted. Applicable.

[Second Embodiment]
Next, a second embodiment of the present invention will be described.
In the form acceptance system 1 of the first embodiment described above, the order form 8 is accepted at the store 2 and the store clerk photographs the order form 8 using the digital camera function of the mobile phone 3. May be unclear as shown in FIG. If the operator tries to punch input at the entry center 5 based on this unclear image, the operator may be confused because the contents of the image cannot be read, or he / she may be unsure of the input contents.
Further, when the image is unclear and the contents cannot be punch-inputted, the operator of the entry center 5 has to check the contents of the order slip 8 with the staff of the store and check it, which is a heavy work load.

  Therefore, in the second embodiment, when the image of the order form 8 is unclear or the contents of the entry are incomplete, the operator of the entry center 5 shows a flag indicating whether the entry data is unclear (image identification possibility / invalidity). Flag) or a flag (deficiency confirmation flag) indicating that there is an incomplete entry. Further, the store clerk code or the store code that has received the order for the form is input in association with the entry data. When the portable POS server 4 receives the entry data from the entry terminal 51, it recognizes the image identification flag or deficiency confirmation flag added to the entry data and manages it together with the clerk code or store code that received the order. Further, the mobile POS server 4 creates a list of the original order slip 8 of the entry data to which the image identification enable / disable flag and the deficiency confirmation flag are added for each clerk, store, or mobile phone, and transmits it to the corresponding mobile phone 3 To do. The business application of the mobile phone 3 displays a list of the order slips 8 in which the image identification enable / disable flag and the deficiency confirmation flag are set. When an order slip code or the like is selected from the list, the mobile phone 3 3 digital camera 308 is activated. An image photographed by the digital camera 308 is transmitted to the portable POS server 4 and then transmitted again from the portable POS server 4 to the entry center 5.

Hereinafter, the flag addition processing according to the second embodiment will be described.
Since the configuration of the form reception system 1 of the second embodiment is the same as that of the first embodiment, the description thereof is omitted, and the same parts are denoted by the same reference numerals.

The configuration of the entry terminal 51 is shown in FIG.
As shown in FIG. 12, the entry terminal 51 includes a control unit 511, a storage unit 512, a media input / output unit 513, an input unit 514, a display unit 515, a peripheral device I / F unit 516, a communication unit 517, and the like via a bus 518. Connected and configured.

  The order form 8 used in the second embodiment is a copy-type order form 8 similar to that in the first embodiment, but the first entry form has a form as shown in FIG. In addition, a unique code 83 (QR code or the like; hereinafter, the unique code 83 of the order form is referred to as an order form code), a requester entry field 85, and a plurality of destination entry fields 86 are printed. Store entry field 88, order slip code / catalog code 89, etc. are printed. The store entry field 88 has handwritten entry fields such as the order acceptance date, store name, store code, handler name (store clerk name), clerk code, etc. The area of the store entry field 88 can also be copied. The frame area image is to be extracted.

  The store clerk who accepted the order reads the unique code 83 using the digital camera unit 308 of the mobile phone 3, then shoots the entire copy paper 82, and in accordance with the extraction pattern corresponding to the order slip 8, the rectangular frame (Frame region image 11) is extracted and transmitted to the portable POS server 4. At this time, the mobile phone 3 transmits together with the identification information of the mobile phone 3. The mobile POS server 4 receives the frame area image 11 photographed and extracted by the mobile phone 3 and stores it in the database 48. Also, it is transmitted to the entry terminal 51 of the entry center 5.

At the entry terminal 51, the frame area image 11 is received from the portable POS server 4, the operator confirms the written content, and performs punch input (data input as text data) to the entry terminal 51.
The operator performs punch input according to a predetermined input rule to create entry data. The entry data entry rule is instructed to the operator by a specification corresponding to the order form 8.
The entry data is composed of an input field for inputting the written contents of each item of the order slip 8, a flag field for setting a flag indicating the deficiency of the item, and a flag field for setting a flag indicating the blur of the image. Is done. Hereinafter, a flag indicating an incomplete input item is referred to as an incompleteness confirmation flag, and a flag indicating unclear image is referred to as an image identification enable / disable flag.

FIG. 14 is a diagram illustrating an example of entry data input rules.
As shown in FIG. 14, the entry data includes items (“zip code”, “kanji address”, “kana name” in each frame area image 11 (“delivery address 1”, “delivery address 2”, etc.) of the order form 8. ”,“ Kanji name ”, etc.). In addition, a defect confirmation flag field corresponding to the input field of each item is provided. In addition, an image identification enable / disable flag field indicating whether or not the entire image is unclear is provided.
For each input field, a field name, a data length of the input field, a data start position, a data end position, and an input format of the input field are defined. If the input field is a flag, the value of the flag and its meaning are defined. 14, for example, “9” means a 1-byte number, “N” means a 2-byte character, and “X” means a 1-byte alphanumeric character.

  In accordance with such rules, the written contents of each item (“zip code”, “address”, “kana name”, “kanji name”, etc.) in the frame area image 11 of the order slip 8 are punched and input, for example, CSV Entry data is created as formatted text data. For each order form 8, one line (one record) of entry data is created.

  For the order slip 8 that the operator has determined that the image is entirely unclear and cannot be read, the image identification enable / disable flag is set to “1”, and the written content of each item is not punched. If the image is clear, the image identification flag is set to “0”, and the written content of each item is punched.

When the image is clear and can be normally input to each input field, the deficiency confirmation flag corresponding to the item is set to “0”.
On the other hand, if the image is clear but the entry contents are incomplete and cannot be determined, the incompleteness confirmation flag is set to “1” or “2”.
If there is no entry in the item, the deficiency confirmation flag is set to “1”.
In addition, when an unreadable character is written in the item or a character that is not actually used is used, if the character is a double-byte character (kana, kanji, etc.) In this specification, “=”) or a special symbol is input instead of the character, and if the character is a single-byte character (alphanumeric character), “#” is input instead. The deficiency confirmation flag corresponding to the item is set to “2”.
If the item is unclear and cannot be read, if the input format of the item is a 2-byte character (Kana, Kanji, etc.), “●” is entered instead, and the input format of the item is a 1-byte character. If it is (alphanumeric), "*" is entered instead. The deficiency confirmation flag corresponding to the item is set to “2”.

Next, input processing in the entry terminal 51 will be described with reference to FIGS. 15 and 16.
In the form acceptance system 1, the same processing as in the first embodiment is performed, and when the entry terminal 51 receives the frame area image 11 of the order form 8 from the portable POS server 4, the entry terminal 51 The image 11 is displayed on the display unit 515 (step U301 (same as step U206 in FIG. 9)).
At the entry terminal 51, the operator determines whether or not the frame area image 11 is clear as a whole. If it is determined as clear as a whole (Step U302; Yes), the entry item “image identification enable / disable flag” is set to “0”. Is input (step U303). Then, punch input of one item of the order slip 8 is started (step U304).
On the other hand, when it is determined that the image is unclear as a whole (step U302; No), “1” is input to the “image identification enable / disable flag” of the entry item (step U305), and punch input of this order form 8 is completed (step S305) U306).

When inputting the item of the order slip 8, the operator determines whether this item has been entered. If not (step U307; No), the operator sets “1” in the deficiency confirmation flag field corresponding to the item. (Step U308).
If the item has been entered but is not clear (step U309; No), “●” or “*” is input to the corresponding item (step U310), and “2” is set in the deficiency confirmation flag field corresponding to the item. (Step U311). The entry terminal 51 may set “2” in the corresponding deficiency confirmation flag field in conjunction with “●” or “*” being input in the item as in step U310.

In the case where an item is entered and the entire item is clear (step U309; Ys), if an unreadable character is included (step U312; No), “= (getter character) is displayed at the corresponding character. "Or"#"(step U315), and" 2 "is set in the deficiency confirmation flag field corresponding to the item (step U316). Also in this case, the entry terminal 51 may set “2” in the corresponding defect confirmation flag field in conjunction with the input of “=” or “#”.
If there is no unreadable character in the item (step U312; Yes), punch input is performed as described, and “0” is set in the corresponding defect confirmation flag field. When the entry terminal 51 determines the input content in the item and no special character or symbol such as “●”, “*”, “=”, “#” is input, the corresponding defect check flag field is displayed. “0” may be set.

If all items have been punched by the processing of steps U307 to U314 (step U317; Yes), the punching of this order form 8 is terminated (step U318), and the process proceeds to step U208 in FIG.
If punch input for all items has not been completed (step U317; No), punch input for the next item is started (step U319).

  After step U208 in FIG. 9, the entry terminal 51 checks whether or not there is an input omission, and at this time, the image identification enable / disable flag is “1” or the deficiency confirmation flag is “1” or “2”. The item is not determined to be input omission (step U210; No).

  When entry data is created for each order slip 8 by the above input process, the entry terminal 51 transmits (registers) the entry data to the portable POS server 4.

  The entry data is managed as database management information 13 by the portable POS server 4. As shown in FIG. 17 (a), the mobile POS server 4 associates a code indicating the type of order form (order form ID) with a unique code 83 (order form code) that is a combination of the serial number, The image 11 and the entry data 12 are managed. In the database management information 13, whether or not the number of frame area images 11 and the number of entry data 12 match is managed by an entry completion flag. In the second embodiment, the entry data corresponding to each frame area image 11 includes a deficiency confirmation flag, and the image identification enable / disable flag of the entire order form is associated with the clerk code that received the order form 8. Is remembered. As shown in FIG. 17B, the clerk code of each clerk is carried as clerk management information 15 in association with the identification information (mobile phone code) of the mobile phone 3 to be used and the store (store code) to which the clerk belongs. Managed by the POS server 4.

When the portable POS server 4 receives the entry data, the portable POS server 4 recognizes the image identification flag and the deficiency confirmation flag added to the entry data. For entry data to which an image identification enable / disable flag or an incompleteness confirmation flag is added, the identification information (order form code) of the original order form 8 and the clerk code of the clerk who accepted the order form 8 are associated with each other, and unclear image management is performed. Information 17 is stored in the database 12.
FIG. 18 shows an example of the unclear image management information 17.
In the unclear image management information 17, a store code or mobile phone identification information (mobile phone code) is managed in association with the original order slip 8 identification information (order slip code) instead of the store clerk code. May be.
In addition, the portable POS server 4 has an order form code to which at least one of an image identification flag and a deficiency confirmation flag is added based on the unclear image management information 17 after, for example, one day of entry work is completed. A list (unclear list) is created and stored for each clerk code.

The mobile phone 3 accesses the mobile POS server 4 when executing the order form reception application. At this time, the mobile phone code is transmitted from the mobile phone 3 to the mobile POS server 4.
When the mobile POS server 4 is accessed from the mobile phone 3, the mobile POS server 4 acquires the store clerk code associated with the mobile phone code of the mobile phone 3 from the store clerk management information 15, and uses the store clerk code as the store clerk code. The associated unclear list is read from the database 12 and transmitted to the mobile phone 3.

FIGS. 19 to 21 are diagrams showing screen transitions during execution of the order form reception application in the mobile phone 3.
As shown in FIG. 19A, a menu screen 31 is displayed on the mobile phone 3 when the order form acceptance application is started. For example, various menus such as “accept order”, “reshoot the order form”, “cancel before joining”, “confirm store information”, and the like are displayed on the display unit 305.
When a blurred list for a store clerk who uses the mobile phone 3 is created in the blurred image management information of the mobile POS server 4, a message such as “There is a new arrival” is displayed for the “order sheet re-shoot” menu image. Is displayed.

When the mobile phone 3 is operated and the “order form re-photographing” menu is selected, the mobile phone 3 accesses the mobile POS server 4 (FIG. 19B).
When the unclear list is transmitted from the mobile POS server 4 to the mobile phone 3, the mobile phone 3 displays the unclear list 32 on the display unit 305 as shown in FIG. When the unclear list 32 is not transmitted, the mobile phone 3 displays a message 33 such as “There is no order sheet that needs re-shooting”.

When an order form code is selected from the unclear list 32 by the mobile phone 3, details about the selected order form 8 are transmitted from the mobile POS server 4. As shown in FIG. 20A, the mobile phone 3 displays details 34 of the received order form 8 on the display unit 305.
The details 34 of the order slip 8 include basic information about the corresponding order slip such as the order date, establishment code, catalog code, catalog name, order slip code, “image blurry”, and “destination address 2 incomplete”. Information indicating the content of such deficiencies. It is desirable that the information indicating the contents of the deficiency clearly indicate information such as whether the whole image is unclear or partially deficient, or if there is deficiency in part. As a result, the store clerk can grasp the portion that was unclear or deficient in the previous shooting, and can call attention when performing the shooting again.

  Next, the corresponding order slip 8 stored in the store is confirmed by the store clerk, and the QR code is read on the order slip code input screen 35 shown in FIG. The mobile phone 3 activates the digital camera unit 308 (FIG. 20C). If the order slip code is not properly input, an error screen 37 is displayed.

  As shown in FIG. 21A, when the second copy sheet 82 of the order form 8 is photographed by the digital camera unit 308, the mobile phone 3 displays a preview image 38. When “Yes” is input in accordance with the confirmation message on the screen, the frame region image 11 is extracted from the image of the order form 8 photographed by performing the rectangular frame (frame region) extraction process shown in the first embodiment. And transmitted to the portable POS server 4 (FIG. 21B).

When the transmission is completed, various message screens 39, 40, and 41 as shown in FIG. 21C are displayed according to the transmission result (transmission completion, confirmation impossible, upload error).
The image (frame region image) transmitted to the portable POS server 4 is transmitted to the entry terminal 51 according to the flowcharts of the first and second embodiments described above, and entry data input processing is performed again.

As described above, in the form acceptance system according to the second embodiment, when the entry terminal 51 performs the input processing of the writing content of the frame area image, the image identification availability flag indicating whether or not the operator can identify the image. In addition, it accepts the setting of a deficiency confirmation flag indicating that the written content is deficient. Further, the store clerk code of the store clerk who received (photographed) the order form 8 is input as entry data.
When the entry data to which the flag is added is registered in the portable POS server 4, the portable POS server 4 recognizes the contents of the flag, and displays the identification information of the order slip 8 photographed unclearly and the order slip 8 The clerk code of the photographed clerk is associated and stored as unclear photographing management information 17.
Further, the portable POS server 4 creates a list of unclear order slips 8 (unclear list) for each clerk code based on the unclear shooting management information 17 and uses the order slip reception application of the mobile phone 3 used by the clerk. When accessed, the corresponding unclear list is transmitted to the mobile phone 3.
The mobile phone 3 receives the unclear list, and when any order slip 8 is selected from the list, the digital camera unit 308 is activated to prompt re-shooting.

  Therefore, according to the second embodiment, the unclear image confirmed by the operator of the entry terminal 51 can be managed by the portable POS server 4. Further, the mobile POS server 4 can collectively notify the contents of unclear orders to the store side. This makes it possible to improve the efficiency of the deficiency confirmation work that the entry center 5 has dealt with by directly inquiring the store clerk.

  In the above-described embodiment, the unclear photographing management information is managed by associating the unclear order form code with the clerk code of the clerk who photographed the order form. It may be managed in association with the mobile phone code, or may be managed in association with the store code of the store that received the order form. Further, in the above example, special characters and symbols such as “●”, “*”, “=”, “#”, etc., are input to defective characters and defective items. The special characters and symbols are not limited to the above, and any special characters or symbols may be used.

  In addition, it is obvious that those skilled in the art can come up with various changes and modifications within the scope of the technical idea disclosed in the present application, and these naturally belong to the technical scope of the present invention. It is understood.

DESCRIPTION OF SYMBOLS 1 ... Form reception system 2 ... Store 3 ... Mobile telephone 301 ... Control part 302 ... Memory | storage part 303 ... Communication part 308 ... Digital camera part 4 ... Mobile POS server 41 ... Control unit 42 ... Storage unit 43 ... Media input / output unit 47 ... Communication unit 48 ... Database 5 ... Entry center 51 ... Entry terminal 6 ... Supplier 7 ..Management center 8 ... Order slip (copy form)
81 ... Filling sheet 82 ... Copy paper 83 ... Unique code K1-K7, T1-T3 ... Ruled line 9 ... Call center 10 ... User 11 ... Frame region image 12. ..Entry data (order data)
13 ... Database management information 30 ... Rectangle table

Claims (16)

A form acceptance system comprising: a server that manages data related to a form and has a communication function with a mobile phone; and a mobile phone that has a communication function with the server and a digital camera function that captures an image of the form. ,
The mobile phone
Extracting means for extracting at least one frame region image from the entire photographed form image based on a preset extraction pattern;
Transmitting means for transmitting the frame region image to the server;
A form acceptance system characterized by comprising: The form acceptance system
Entry means for presenting the frame area image transmitted to the server to an operator, prompting the operator to input, and registering data for each frame area image input by the operator as entry data in the server Prepared,
The server
Determining means for determining whether or not the number of the frame area images transmitted from the mobile phone and the number of the entry data registered by the entry means match;
When the determination means determines that the number of the frame area images and the number of entry data do not match, warning means for presenting a warning to that effect,
The form receiving system according to claim 1, further comprising: The form photographed by the mobile phone is a copy form of a copy form that combines a form and a copy form,
On the copy paper, ruled lines parallel to the vertical and horizontal sides of the copy paper are printed so that a rectangular frame surrounding the area corresponding to the copy target area of the printed content of the entry paper is formed. 2. The form receiving system according to claim 1, wherein all the ruled lines extend to at least one side of the copy paper. The mobile phone
The form receiving system according to claim 1, further comprising a table holding unit that holds a pattern table storing one or more extraction patterns corresponding to the format of the form. The mobile phone
A removal means for removing blank ones of the frame region images extracted by the extraction means;
The form receiving system according to claim 1, wherein the transmitting unit transmits a frame area image from which blanks have been removed by the removing unit to the server. The mobile phone
The form receiving system according to claim 1, further comprising correction means for correcting the inclination of the photographed form image. A mobile phone comprising a photographing means for photographing a form image and a communication means with a server,
Extraction means for extracting at least one frame region image from the entire form image photographed by the photographing means based on a preset image extraction pattern;
Transmitting means for transmitting the frame region image to the server;
A mobile phone comprising: The mobile phone
8. The mobile phone according to claim 7, further comprising table holding means for holding a pattern table storing one or more extraction patterns corresponding to the format of the form. The mobile phone
A removal means for removing blank ones of the frame region images extracted by the extraction means;
8. The mobile phone according to claim 7, wherein the transmitting unit transmits a frame area image from which blanks are removed by the removing unit to the server. The mobile phone
8. The mobile phone according to claim 7, further comprising correction means for correcting the inclination of the photographed form image. A server that manages an image related to a form and entry data in which a writing content in the image is input in a predetermined data format;
The image is a frame region image in which at least one frame region is extracted based on a preset extraction pattern from the entire form image,
The server
Entry means for presenting the unprocessed frame area image to the work terminal to prompt the operator to input, and receiving data for each frame area image input by the worker as entry data;
Determination means for determining whether or not the number of the frame region images and the number of the entry data match;
If the determination means determines that the number of the frame area images and the number of entry data do not match, warning means for warning that effect;
A server comprising: The copy form is a copy form in which a form on which a form of a predetermined format is printed and a copy sheet to be overlaid on the back side of the form are combined, and the written contents on the fill sheet are copied onto the copy sheet. And
On the copy paper, ruled lines parallel to the vertical and horizontal sides of the copy paper are printed so that a rectangular frame surrounding the area corresponding to the copy target area of the printed content of the entry paper is formed. ,
A copy-form form in which all the ruled lines extend to at least one side of the copy paper. A program readable by a mobile phone,
An extraction step for extracting at least one frame region image from the entire photographed form image based on a preset extraction pattern;
A transmission step of transmitting the frame region image to a server;
The program characterized by including. A computer-readable program,
An entry in which the number of frame area images from which at least one frame area is extracted from the entire form image based on a preset extraction pattern and the writing contents in the frame area image are input in a predetermined data format A determination step of determining whether or not the number of data matches;
If it is determined by the determination step that the number of the frame area images and the number of the entry data do not match, a warning step for warning that effect;
The program characterized by including. A server that manages data related to a form and has a communication function with a mobile phone and an entry terminal, a mobile phone with a communication function with the server and a digital camera function that captures an image of the form, and the server sent to the server A form acceptance system including an entry terminal that presents a frame area image to an operator, prompts the operator to input, and registers data for each frame area image input by the worker as entry data in a server ,
The mobile phone
Extracting means for extracting at least one frame region image from the entire photographed form image based on a preset extraction pattern;
Transmission means for transmitting the frame region image to the server,
The entry terminal is
A flag for accepting addition of at least one of an image identification enable / disable flag indicating whether or not the worker can identify the contents of the frame region image, and a defect confirmation flag indicating a defect in the description in the frame region image Additional means;
Identification information input means for inputting the identification information of the form and the store clerk code of the store clerk who photographed the form or the store code to which the store clerk is associated with the entry data;
Entry data registration means for registering in the server the entry data associated with the store clerk code of the store clerk who has taken the form by the identification information input unit, or the store clerk code to which the store clerk belongs; With
The server
According to the contents of the image identification enable / disable flag and the deficiency confirmation flag added to the entry data, the identification information of the unclear or defective form corresponds to the clerk code of the clerk who photographed the form or the store code to which the clerk belongs. A form acceptance system comprising a blurry photographing management means for storing information. The blurred image management means of the server is
A blurred list generating means for creating a list of unclear or incomplete forms managed by the unclear photographing management means for each clerk, mobile phone, or store that has photographed;
Transmitting means for transmitting a list of unclear or incomplete forms generated by the unclear list generating means to the mobile phone of the photographing source,
The mobile phone
16. The form acceptance system according to claim 15, further comprising display means for displaying a list of unclear or incomplete forms transmitted from the server.

Images