JP7052586B2 - Printed matter ordering system, user terminal, server, printed matter ordering method, and program - Google Patents

Description

The present invention relates to a printed matter ordering system, a user terminal, a server, a printed matter ordering method, and a program, and more particularly to a printed matter ordering system for ordering printed matter by reading handwritten characters written on an order form.

At sports watching venues such as baseball and event venues, a service is provided in which photographs taken by photographers on the day of a match or event are printed at the venue and sold on the same day. There are many people who want to purchase this type of service, and there is a queue waiting for purchase. FIG. 23 shows an example of photo sales (printed matter ordering system 1000) currently being performed. In the example shown in FIG. 23, products such as photographs, posters, and key holders are displayed or displayed on the product catalog signage 1001, the wall 1002, and the shelf 1003, and the customer places an order on a predetermined order form while browsing these photographs and goods. Fill out. After completing the order form, the customers line up in the purchase line 1011 and proceed to the cash register area 1007 partitioned by the fence 1009 or the like to purchase the product. In the backyard of the cash register area 1007 where multiple cash registers are placed, a print area 1005 for printing printed matter such as photographs and a product picking area 1006 for picking products are provided, and the staff looks at the order form filled out by the customer. While collecting products, the amount is calculated and the accounting is done. At present, these operations are often performed manually by staff, and it is easy for mistakes in quantity and amount to occur. In addition, it is difficult to provide a wide product picking area 1006 and print area 1005 due to the size of the venue and area restrictions due to pillars 1008, etc., and if a large number of staff gather there, the efficiency of picking work will decrease. Become.

On the other hand, in mail-order sales, online orders are provided in which a customer accesses an order page via a network using a terminal such as a PC, tablet, or smartphone, and inputs an order for the product while browsing the product image. .. Further, a technique (for example, Patent Document 1) of receiving an order form handwritten by a customer by facsimile and reading an order number, quantity, etc. by OCR (Optical Character Recognition / Reader) has been widely used.

Therefore, when these ordering methods are applied to sales at the above-mentioned event venue, the method using a terminal such as a PC or a smartphone may cause an excessive amount of communication due to congestion, which may cause difficulty in communication. In addition, in the method using the order form, it is only necessary to read the order form and send the read contents to the server, so the terminal is compared with the case of directly inputting the order while displaying the product page on a PC or smartphone. It is considered that the processing load is light. Further, if the order form is used, it is not necessary to consider the communication load such as receiving the product selection page many times, and it is considered that the burden on the entire equipment is small and the practicality is good.

Japanese Unexamined Patent Publication No. 2004-160728

However, when the order form is used, there is a problem that the handwritten order number, quantity, and the like must be read more accurately. Especially in the case of photo sales, since many types of photos are handled, confusion is likely to occur, and the reading accuracy of the order form is required.

The present invention has been made in view of the above problems, and is a printed matter ordering system, a user terminal, and a server capable of smoothly ordering and selling by reducing mistakes in order quantity and amount calculation in selling printed matter and the like. , Printed matter ordering methods, and programs.

The first invention for solving the above-mentioned problems is installed in a server for storing original image data of a printed matter, a user terminal capable of communicating with the server, and a user terminal communicating with the server at the sales venue of the printed matter. The user terminal is provided with a print system and communication equipment installed at the sales venue, and the user terminal obtains an image acquisition means for acquiring an image of a completed order form and reference data which is an image of an unfilled order form. The handwritten characters entered in the order form are extracted and the order information is read based on the difference data obtained by the difference between the download means downloaded from the server and the image of the completed order form acquired by the image acquisition means and the reference data. The server includes an order reading means, a transmitting means for transmitting the order information to the server, and an output means for receiving and outputting the order identification information issued by the server, and the server is used at each sales venue. When the reference data storage means for storing the identification information of the communication equipment and the reference data of the order form used at each sales venue in association with each other and the download request of the reference data from the user terminal are received, the request source A reference data transmission means that identifies the communication equipment used by the user terminal, identifies a sales venue, acquires the corresponding reference data from the reference data storage means, and transmits the reference data to the requesting user terminal, and the user terminal. A receiving means for receiving the order information, an order storage means for issuing the order identification information for identifying the received order information and storing the order identification information together with the order information, and an order identification information transmitting means for transmitting the order identification information to the user terminal. And an original image data transmission means for transmitting the original image data of the printed matter included in the order information to the print system together with the order identification information, the print system acquires the original image data of the printed matter from the server. The printed matter ordering system is characterized by comprising an original image data acquisition means for printing and a printing means for printing the original image data of the acquired printed matter.

In the printed matter ordering system of the first invention, the user terminal requests the server for reference data which is an image of an unfilled order form used at the sales venue, and the server requests the communication equipment used by the requesting user terminal. It determines and identifies the sales venue, and sends the corresponding reference data to the requesting user terminal. The user terminal extracts the handwritten characters entered in the order form based on the difference data obtained by differentiating the reference data downloaded from the server and the image of the completed order form, reads the order information, and sends the order information to the server. When the server receives the order information transmitted from the user terminal, it issues the order identification information and sends it to the user terminal. Further, the server transmits the original image data of the printed matter included in the received order information to the print system, and the print system prints the acquired original image data.

As a result, the customer fills out the order on the order form while selecting the product and reads it on the user terminal, so the amount of communication with the server is less than when the order is entered directly on the user terminal, and the sales venue is crowded. It is possible to order printed matter smoothly. In addition, since the reference data is used, it is possible to improve the reading accuracy of the order form and reduce mistakes in order quantity and amount calculation. In addition, the server identifies the venue based on the information of the communication equipment of the venue transmitted from the user terminal, and sends the corresponding reference data to the user terminal, so that the user is smoothly appropriate without being aware of which venue. It is possible to download various reference data. In addition, orders from outside the sales venue can be excluded. In particular, in a situation where a large number of people are gathered, such as in a baseball field or a live venue, if the printed matter ordering system of the first invention is used, it is possible to reduce the communication between the server and the user terminal as much as possible.

In the first invention, it is desirable that the download means of the user terminal downloads the reference data from the server when the order reading means reads the order information from the filled-in order form. As a result, when reading the order information, the reference data of the order form can be downloaded from the server, so that the user terminal 3 does not need to store the reference data in advance.

It is desirable that the user terminal further includes a display means for displaying the order information read by the order reading means. Further, it is desirable that the user terminal further includes a correction input means for inputting a correction of the order information read by the order reading means. Further, it is desirable that the user terminal further includes a thumbnail image acquisition means for acquiring a thumbnail image of the printed matter from the server, and the display means displays a list of the acquired thumbnail images and reflects the order information. .. This makes it possible to check and correct the information read from the order form. Further, if the thumbnail image is displayed so that the order contents can be confirmed / corrected, the customer can easily confirm / correct the order.

Further, it is desirable that the output means of the user terminal displays the reception code indicating the order identification information. As a result, the customer can display the reception code on the user terminal and receive the product, and the process from ordering to receiving the product can be smoothly performed.

Further, it is desirable that the user terminal is provided with a camera, and the image acquisition means acquires an image of the completed order form by taking a picture with the camera. This makes it possible to use a smartphone with a camera, a tablet with a camera, or the like as a user terminal in the printed matter ordering system of the present invention.

Further, when the original image data transmitting means of the server receives the order information from the user terminal, it is desirable that the original image data of the printed matter included in the received order information is transmitted to the print system. As a result, the printed matter can be printed for each order in advance before the payment, and the customer can receive the printed matter without waiting time.

Further, the print system further includes an order identification information acquisition means for acquiring the order identification information output by the user terminal, and the original image data acquisition means is an order identification acquired by the order identification information acquisition means. The server is requested to transmit the original image data of the printed matter included in the order information corresponding to the information, and the original image data transmitting means of the server responds to the request from the printing system and the original image data of the printed matter is transmitted. Is desirable to send to the server. Further, the print system further includes a payment information transmitting means for transmitting payment information to the server when the payment processing of the printed matter printed by the printing means is completed, and the server receives the payment information from the print system. It is desirable to further provide a settlement information reflecting means for reflecting the settlement information in the order history information stored in the order storage means. As a result, the order identification information presented on the user terminal can be acquired by the print system, the payment process is performed, and then the original image data can be acquired from the server and printed. In addition, the payment status can be reflected on the server.

The second invention comprises a server that stores the original image data of the printed matter, a user terminal that can communicate with the server, a print system that is connected to the server by communication and installed at the sales venue of the printed matter, and the sales venue. The user terminal is provided with an image acquisition means for acquiring an image of a completed order form, and an order for transmitting an image of a completed order form acquired by the image acquisition means to the server. The server includes an image transmission means, an output means for receiving order information from the server and an output means for receiving and outputting order identification information issued by the server, and the server is a communication facility used at each sales venue. A reference data storage means for storing identification information in association with reference data of an order form used at each sales venue, a receiving means for receiving an image of a completed order form transmitted from the user terminal, and the above-mentioned. A reference data acquisition means for identifying the communication equipment used by the user terminal, specifying a sales venue, and acquiring the corresponding reference data from the reference data storage means, and an image of a completed order form received by the receiving means. The order reading means for extracting the handwritten characters entered in the order form and reading the order information based on the difference data obtained by differentiating the reference data acquired by the reference data acquisition means, and the order identification information for identifying the read order information. An order storage means that is issued and stored together with order information, a transmission means that transmits the order information and the order identification information to the user terminal, and the original image data of a printed matter included in the order information are described together with the order identification information. The print system includes an original image data transmission means for transmitting to a print system, and the print system includes an original image data acquisition means for acquiring the original image data of the printed matter from the server and a printing means for printing the acquired original image data of the printed matter. It is a printed matter ordering system characterized by being provided with.

In the printed matter ordering system of the second invention, the user terminal acquires the image of the completed order form and sends it to the server. When the server receives the image of the completed order form from the user terminal, it determines the communication equipment used by the user terminal, identifies the sales venue, and acquires the corresponding reference data. The server extracts the handwritten characters written on the order form based on the difference data that is the difference between the image of the completed order form received from the user terminal and the reference data, reads the order information, issues the order identification information, and together with the order information. Send to the user terminal. The user terminal receives and outputs order information and order identification information. In addition, the server sends the original image data of the printed matter included in the order information to the print system, and the print system prints the acquired original image data.

As a result, the customer fills out the order on the order form while selecting the product, shoots (scans) the order form on the user terminal, sends it to the server, and the server reads the order entered on the order form, so it is smooth. It is possible to place an order for printed matter. In addition, the server identifies the venue based on the information of the communication equipment of the venue sent from the user terminal and reads the order form using the corresponding reference data, so it is possible to improve the reading accuracy of the order form and place an order. It is possible to reduce mistakes in quantity and amount calculation. In addition, orders from outside the sales venue can be excluded.

A third invention is a user terminal capable of communicating with a server that stores original image data of a printed matter, and is an image acquisition means for acquiring an image of a completed order form and a reference that is an image of an unfilled order form. Order information by extracting the handwritten characters entered in the order form based on the difference data obtained by the difference data between the download means for downloading the data from the server and the image of the filled-in order form acquired by the image acquisition means and the reference data. It is a user terminal including an order reading means for reading an order, a transmitting means for transmitting the order information to the server, and an output means for receiving and outputting the order identification information issued by the server. ..

According to the third invention, the user terminal in the printed matter ordering system of the first invention can be provided.

The fourth invention is a server that stores original image data of a printed matter and is connected to a print system and a user terminal installed in the sales venue of the printed matter by communication, and identifies communication equipment used in each sales venue. A reference data storage means for storing information in association with reference data of an order form used at each sales venue, and when a request for downloading the reference data is received from the user terminal, the requesting user terminal used the data. The reference data transmission means that identifies the communication equipment, identifies the sales venue, acquires the corresponding reference data from the reference data storage means, and transmits the reference data to the requesting user terminal, and receives the order information from the user terminal. The receiving means, the order storage means for issuing the order identification information for identifying the received order information and storing the order identification information together with the order information, the order identification information transmitting means for transmitting the order identification information to the user terminal, and the order information. The server is characterized by comprising an original image data transmission means for transmitting the original image data of the included printed matter together with the order identification information to the print system.

According to the fourth invention, the server in the printed matter ordering system of the first invention can be provided.

A fifth invention includes a server that stores original image data of a printed matter, a user terminal that can communicate with the server, a print system that is connected to the server by communication and installed at a sales venue of the printed matter, and the sales venue. A method for ordering printed matter in a printed matter ordering system including a communication facility installed in the above, wherein the user terminal acquires an image of a completed order form and reference data which is an image of an unfilled order form. From the server, the step of extracting the handwritten characters entered in the order form based on the difference data obtained by the difference between the image of the completed order form and the reference data, and the step of reading the order information, and the order information. The server includes identification information of communication equipment used at each sales venue and each of the above, including a step of transmitting the data to the server and a step of receiving and outputting the order identification information issued by the server. When the reference data of the order form used at the sales venue is associated with the reference data and stored in the storage unit and the download request for the reference data is received from the user terminal, the communication equipment used by the requesting user terminal is determined. Identify the sales venue, acquire the relevant reference data from the storage unit and send it to the requesting user terminal, receive the order information from the user terminal, and identify the received order information. A step of issuing order identification information and storing it together with the order information, a step of transmitting the order identification information to the user terminal, and a step of transmitting the original image data of the printed matter included in the order information to the print system together with the order identification information. A printed matter ordering method comprising a step of transmitting, wherein the print system includes a step of acquiring original image data of a printed matter from the server, and a step of printing the original image data of the acquired printed matter. Is.

According to the printed matter ordering method of the fifth invention, the user terminal requests the server for reference data which is an image of an unfilled order form used at the sales venue, and the server requests the communication used by the requesting user terminal. The equipment is identified, the sales venue is identified, and the corresponding reference data is transmitted to the requesting user terminal. The user terminal extracts the handwritten characters entered in the order form based on the difference data obtained by differentiating the reference data downloaded from the server and the image of the completed order form, reads the order information, and sends the order information to the server. When the server receives the order information transmitted from the user terminal, it issues the order identification information and sends it to the user terminal. Further, the server transmits the original image data of the printed matter included in the received order information to the print system, and the print system prints the acquired original image data.

As a result, the customer fills out the order on the order form while selecting the product and reads it on the user terminal, so the amount of communication with the server is less than when the order is entered directly on the user terminal, and the sales venue is crowded. It is possible to order printed matter smoothly. In addition, since the reference data is used, it is possible to improve the reading accuracy of the order form and reduce mistakes in order quantity and amount calculation. In addition, the server identifies the venue based on the information of the communication equipment of the venue transmitted from the user terminal, and sends the corresponding reference data to the user terminal, so that the user can refer smoothly without being aware of which venue. It is possible to download the data. In addition, orders from outside the sales venue can be excluded. In particular, in a situation where a large number of people are gathered, such as in a baseball field or a live venue, if the printed matter ordering method of the fifth invention is used, it is possible to reduce the communication between the server and the user terminal as much as possible.

A sixth aspect of the present invention is a server that stores original image data of a printed matter, a user terminal that can communicate with the server, a print system that is connected to the server by communication and installed at a sales venue of the printed matter, and the sales venue. A method for ordering printed matter in a printed matter ordering system including a communication facility installed in the above, wherein the user terminal acquires an image of a completed order form, and the acquired image of the completed order form is obtained from the server. The server includes a step of receiving order information from the server and a step of receiving and outputting the order identification information issued by the server, wherein the server is used for communication equipment used at each sales venue. A step of associating and storing identification information with reference data of an order form used at each sales venue, a step of receiving an image of a completed order form transmitted from the user terminal, and a step used by the user terminal. The difference data is the difference between the step of identifying the communication equipment, specifying the sales venue, and acquiring the corresponding reference data from the reference data storage means, and the received image of the completed order form and the acquired reference data. Based on the step of extracting the handwritten characters entered in the order form and reading the order information, the step of issuing the order identification information for identifying the read order information and storing it together with the order information, the order information and the order identification information. The print system includes the step of transmitting the original image data of the printed matter included in the order information to the print system together with the order identification information, and the print system includes the step of transmitting the original image data of the printed matter included in the order information to the print system. It is a printed matter ordering method characterized by including a step of acquiring image data and a step of printing the original image data of the acquired printed matter.

In the printed matter ordering method of the sixth invention, the user terminal acquires an image of the completed order form and sends it to the server. When the server receives the image of the completed order form from the user terminal, it determines the communication equipment used by the user terminal, identifies the sales venue, and acquires the corresponding reference data. The server extracts the handwritten characters written on the order form based on the difference data that is the difference between the image of the completed order form received from the user terminal and the reference data, reads the order information, issues the order identification information, and together with the order information. Send to the user terminal. The user terminal receives and outputs order information and order identification information. In addition, the server sends the original image data of the printed matter included in the order information to the print system, and the print system prints the acquired original image data.

As a result, the customer fills out the order on the order form while selecting the product, shoots (scans) the order form on the user terminal, sends it to the server, and the server reads the order entered on the order form, so it is smooth. It is possible to place an order for printed matter. In addition, the server identifies the venue based on the information of the communication equipment of the venue sent from the user terminal and reads the order form using the corresponding reference data, so it is possible to improve the reading accuracy of the order form and place an order. It is possible to reduce mistakes in quantity and amount calculation. In addition, orders from outside the sales venue can be excluded.

The seventh invention is to acquire an image of a completed order form by using a computer that functions as a user terminal capable of communicating and connecting via a server that stores original image data of printed matter and communication equipment installed at a sales venue. The order form based on the means, the download means for downloading the reference data which is the image of the unfilled order form from the server, and the difference data obtained by the difference between the image of the filled order form acquired by the image acquisition means and the reference data. It functions as an order reading means for extracting the handwritten characters written in the above and reading the order information, a transmitting means for transmitting the order information to the server, and an output means for receiving and outputting the order identification information issued by the server. It is a program characterized by that.

According to the seventh invention, the computer can function as the user terminal of the first and third inventions.

The eighth invention functions as a server that stores the original image data of the printed matter and is communicated and connected to the print system and the user terminal installed in the sales venue of the printed matter, and communicates between the server and the user terminal. Stores the computer performed via the communication equipment installed at the sales venue in association with the identification information of the communication equipment used at each sales venue and the reference data of the order form used at each sales venue. When the reference data storage means receives the reference data download request from the user terminal, the communication equipment used by the requesting user terminal is identified, the sales venue is specified, and the corresponding reference data is stored in the reference data. A reference data transmitting means that is acquired from the means and transmitted to the requesting user terminal, a receiving means that receives order information from the user terminal, and an order that issues order identification information that identifies the received order information and stores it together with the order information. As a storage means, an order identification information transmitting means for transmitting the order identification information to the user terminal, and an original image data transmitting means for transmitting the original image data of the printed matter included in the order information to the print system together with the order identification information. It is a program characterized by making it work.

The eighth invention makes it possible to make a computer function as a server of the first and fourth inventions.

INDUSTRIAL APPLICABILITY The present invention provides a printed matter ordering system, a user terminal, a server, a printed matter ordering method, and a program capable of smoothly ordering and selling by reducing mistakes in order quantity and amount calculation in the sale of printed matter and the like. Is possible.

The figure which shows the whole structure of the printed matter ordering system 1. The figure which shows the flow of order in the printed matter order system 1. The figure which shows the hardware configuration of a server 2. The figure which shows the example of the data stored in the storage part 22 of a server 2. The figure which shows the data structure of the original image data 221 The figure which shows the data structure of a reference data group 222 The figure which shows the data structure of order information 223 The figure which shows the data structure of order history information 224 The figure which shows the hardware configuration of a user terminal 3. The figure which shows the example of the data stored in the storage part 32 of a user terminal 3. The figure which shows an example of the reference data 321 The figure which shows an example of the reference detailed data 322. The figure which shows the hardware composition of a print system 6. Sequence diagram showing the flow of orders in the printed matter ordering system 1 (in the case of pre-settlement printing) (A) Example of order form 4, (b) Example of reading order form 4 by user terminal 3, (c) Example of order content display screen 81, (d) Example of order content display screen 82 being modified, ( e) Example of reception screen 83 Flowchart showing the flow of order form reading process Diagram explaining the extraction of handwritten characters Diagram showing the flow of payment processing in the case of pre-payment printing Sequence diagram showing the flow of orders in the printed matter ordering system 1 (in the case of printing after payment) Diagram showing the flow of payment processing in the case of post-payment printing A sequence diagram showing an order flow in the printed matter ordering system 1 of the third embodiment. Flowchart showing the flow of order reading process The figure explaining the conventional printed matter ordering system 1000

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

[First Embodiment]
FIG. 1 is a diagram showing a printed matter ordering system 1 according to an embodiment of the present invention. As shown in FIG. 1, in the printed matter ordering system 1 according to the present invention, the user terminal 3 and the print system 6 are communicated with and connected to the server 2, respectively. The server 2 is a computer that stores the original image data 221 of the printed matter and manages the order / payment, and is connected to the user terminal 3 and the print system 6 via a network. The print system 6 is installed at the sales venue of printed matter. The user terminal 3 is in a state of being able to communicate with the communication equipment 8 arranged in the sales venue.

The user terminal 3 is a communication terminal owned by the customer, and is a tablet with a camera, a smartphone, a game machine, a computer, or the like. The user terminal 3 acquires an image of the order form 4 filled in by the customer, reads it by OCR, and acquires order information.

The print system 6 has one or more printers 67 and a computer 60 for controlling the printers 67, and prints printed matter according to the order information 223 read by the user terminal 3 and transmitted from the server 2. Since the original image data 221 of the printed matter is stored in the server 2, the print system 6 acquires the original image data 221 for the order from the server 2 and prints it.

The communication equipment 8 is a wireless communication equipment such as a Wi-Fi access point or a beacon, and performs wireless communication with the user terminal 3. The communication equipment 8 has different identification information for each sales venue. The user terminal 3 has acquired the identification information of the communication equipment 8 in the sales venue (the communication area of the communication equipment 8).

FIG. 2 is a diagram showing a data flow when the printed matter ordering system 1 of the present embodiment is used for selling photographs at an event venue.

Images taken during the event by the cameraman are uploaded to the server 2 at any time ((1) in FIG. 2). The person in charge of the company holding the event or the photo sales company confirms the image uploaded to the server 2 on the company management terminal 7 ((2) in FIG. 2) and approves the image to be sold (FIG. 2). (3)). The server 2 assigns a photo number (printed matter number) to the approved image as the original image data 221 for sale, and stores it in the storage unit 22. The server 2 transmits the thumbnail image 323 of the image for sale to the user terminal 3 ((4) in FIG. 2). The user terminal 3 stores the thumbnail image 323 in the storage unit 32. When the image is uploaded to the server 2 a plurality of times during the event, it is desirable that the server 2 sends the thumbnail image 323 to the user terminal 3 each time and updates the thumbnail image 323 stored in the user terminal 3. Since the original image data 221 is data to be sold, it is transmitted from the server 2 to the print system 6 only when an order is received.

The customer selects a photo while browsing the shelves, walls, product catalog signage, etc., and fills out the order on the order form 4. The photo number (printed matter number) of the photograph to be sold is printed in the table on the order form 4, and the customer fills in the quantity in the photo number (printed matter number) entry field of the desired photo. After completing the entry, the customer reads the order written on the order form 4 using his / her own user terminal 3 ((5) in FIG. 2).

When reading the order form 4, the user terminal 3 downloads the reference data 321 of the order form 4 used at the sales venue from the server 2 and stores it in the storage unit 32 ((6) in FIG. 2). The order form 4 is different for each sales venue and event, and the reference data 321 corresponding to all the order forms 4 is stored in the server 2 as the reference data group 222 (see FIG. 6). Reading the order form 4 will be described later.

The user terminal 3 transmits the order contents read from the order form 4 to the server 2 ((7) in FIG. 2).

When the server 2 receives the order content, it issues the order identification information and sends it to the user terminal 3. Further, the order information 223 in which the order identification information is added to the received order contents is generated and stored in the storage unit 32. Further, a new order record is added to the order history information 224, which is the history of the order, and stored in the storage unit 32. The server 2 transmits the original image data 221 of the photograph included in the order to the print system 6 ((8) in FIG. 2). The computer 60 of the print system 6 gives a print instruction to the printer 67 to print a photograph. The customer goes to the cashier staff, displays the order identification information (receipt code) on the user terminal 3, and presents it to the staff. The staff gives the photograph printed by the print system 6 to the customer and makes a payment.

Next, the configuration of each device of the printed matter ordering system 1 will be described.
FIG. 3 is a diagram showing the configuration of the server 2.
As shown in FIG. 3, the server 2 connects, for example, a control unit 21, a storage unit 22, a communication control unit 23, an input unit 24, a display unit 25, a peripheral device I / F unit 26, and the like by a bus 27 or the like. It can be realized by the configured computer. However, the present invention is not limited to this, and various configurations can be taken as appropriate.

The control unit 21 is composed of a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. The CPU calls and executes a program stored in the storage unit 22, ROM, recording medium, etc. in the work memory area on the RAM, and drives and controls each unit connected via the bus 27. The ROM permanently holds a computer boot program, a program such as a BIOS, data, and the like. The RAM temporarily holds the loaded program and data, and has a work area used by the control unit 21 to perform various processes. The control unit 21 functions as each means of the server 2 by reading and executing the above program.

The storage unit 22 is, for example, a storage device such as a hard disk drive, a solid state drive, or a flash memory. The storage unit 22 stores a program executed by the control unit 21, data necessary for program execution, an operating system, and the like. These program codes are read out by the control unit 21 as necessary, transferred to the RAM, read out by the CPU, and executed. Further, as shown in FIG. 4, the storage unit 22 stores the original image data 221, the reference data group 222, the order information 223, the order history information 224, and the like. Details of these data will be described later.

The communication control unit 23 has a communication control device, a communication port, and the like, and controls communication with a network and the like. The network is a LAN (Local Area Network) or a WAN (Wide) that is connected to a wider area.
Area Network), or public communication lines such as the Internet, base stations, etc. The network can be wired or wireless. The server 2 communicates with the user terminal 3 and the print system 6 installed at the sales venue via a network, and can transmit and receive various data.

The input unit 24 is, for example, an input device such as a touch panel, a keyboard, a pointing device such as a mouse, or a numeric keypad, and outputs the input data to the control unit 21.

The display unit 25 is composed of, for example, a display device such as a liquid crystal panel or a CRT monitor, and a logic circuit (video adapter or the like) for executing display processing in cooperation with the display device, and is input under the control of the control unit 21. Display the display information on the display device. The input unit 24 and the display unit 25 may be a touch panel display in which an input device such as a touch panel is integrally provided on the display screen.

The peripheral device I / F (interface) section 26 is a port for connecting peripheral devices, and transmits / receives data to / from peripheral devices via the peripheral device I / F section 26. The peripheral device I / F unit 26 is composed of USB or the like, and usually has a plurality of peripheral device I / Fs. The connection form with peripheral devices may be wired or wireless.
The bus 27 is a path that mediates the transfer of control signals, data signals, and the like between the devices.

FIG. 4 is a diagram showing an example of data stored in the storage unit 22 of the server 2.
As shown in FIG. 4, the storage unit 22 of the server 2 stores the original image data 221, the reference data group 222, the order information 223, the order history information 224, and the like.

As shown in FIG. 5, the original image data 221 stores an original image file in association with an image ID and a printed matter number (photo number). The image ID is information that identifies the original image data 221 of each photograph, and is given to all the photographs uploaded from the cameraman's camera. The printed matter number (photograph number) is a number given to the printed matter to be sold, and a number corresponding to the photo number (printed matter number) described on the order form 4 is given. The original image stores the original image data 221 itself, or the file name and storage destination information of the original image.

As shown in FIG. 6, the reference data group 222 is a data group in which reference data 321 (FIG. 11) used at all venues is stored in association with the venues used. Reference detailed data 322 (FIG. 12) is added to each reference data 321. The reference detailed data 322 is data in which the position in the image of the reference data 321 and the printed matter number (photograph number) are associated with each other, and is used when reading the order form 4.

As shown in FIG. 7, the order information 223 has data (order contents) of an order quantity for each printed matter number (photograph number). Further, the order identification information issued by the server 2 is also stored in the order information 223. The quantity information for each printed matter number of the order information 223 is the information read from the completed order form 41 by the user terminal 3 and is transmitted to the server 2 and stored.

As shown in FIG. 8, the order history information 224 stores order identification information, order date and time, presence / absence of payment (settlement information), and the like. In the order history information 224, when order information (quantity information for each printed matter number) is transmitted from the user terminal 3, new order identification information is issued by the server 2, a new order record is registered, and order date and time information is added. It is stored in the server 2. Further, the presence / absence of payment (payment information) is updated and stored when the payment information is received from the print system 6.

FIG. 9 is a diagram showing the configuration of the user terminal 3.
As shown in FIG. 9, the user terminal 3 uses, for example, a control unit 31, a storage unit 32, a communication control unit 33, a touch panel (display unit, input unit) 34, a camera 35, a peripheral device I / F unit 36, and the like as a bus 37. It can be realized by a tablet terminal or the like configured by connecting with or the like. However, the present invention is not limited to this, and various configurations can be taken as appropriate. The control unit 31, the storage unit 32, and the communication control unit 33 are composed of the peripheral device I / F unit 36, which is the control unit 21, the storage unit 22, the communication control unit 23, and the peripheral device I / F unit 26 of the server 2. Since it is the same as the above, the duplicate description will be omitted.

The storage unit 32 of the user terminal 3 stores an application program for executing the processing described later (FIGS. 14, 16, 19), and the user terminal 3 executes the processing described later by this application program. Let me.

The touch panel 34 is realized by a display with a touch panel that also serves as a display unit and an input unit. The display unit of the touch panel displays various screens related to the operation / selection of the customer, etc., and accepts the instruction input of the customer, etc. by the touch operation on the screen.

The camera 35 is a camera that uses an image pickup element such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and sends the captured image to the control unit 31. The camera 35 may be a camera mounted on the user terminal 3 or an external camera (a camera connected via the peripheral device I / F unit 36). The customer photographs the completed order form 41 with the camera 35 and acquires the image 41a of the completed order form 41.

FIG. 10 is a diagram showing an example of data stored in the storage unit 32 of the user terminal 3.
As shown in FIG. 10, the storage unit 32 of the user terminal 3 stores reference data 321, reference detailed data 322, thumbnail image 323, and the like.

As shown in FIG. 11, the reference data 321 is an image of an unfilled order form 4. Reference data 321 used at the venue where the user terminal 3 is installed is stored in the user terminal 3. When the user terminal 3 reads the order form 4, the user terminal 3 downloads the reference data 321 corresponding to the order form 4 from the server 2. As described above, the storage unit 22 of the server 2 stores all the reference data 321 used at all the venues (reference data group 222 in FIG. 6). The example of FIG. 11 shows an example of "s1001.bpm" of the reference data 321 used at the Sapporo venue.

The reference detailed data 322 is data in which the position in the image and the printed matter number (photograph number) are associated with the downloaded reference data 321. By referring to the reference detailed data 322, the control unit 31 can determine which printed matter number the order is for from the character entry position. The reference detailed data 322 is also downloaded from the server 2 together with the reference data 321.

The thumbnail image 323 is a thumbnail image of the printed matter to be sold. Each time the original image data 221 (original image data of the printed matter to be sold) in the server 2 is updated, the user terminal 3 receives the thumbnail image 323 from the server 2 and stores the update. The thumbnail image 323 of the latest printed matter is always stored in the user terminal 3.

FIG. 13 is a diagram showing the configuration of the print system 6.
As shown in FIG. 13, the print system 6 includes one or more printers 67 and a computer 60 that controls these printers 67. The computer 60 is configured by connecting a control unit 61, a storage unit 62, a communication control unit 63, an input unit 64, a display unit 65, a peripheral device I / F unit 66, and the like by a bus 68. One or more printers 67 are connected to the peripheral device I / F unit 66. However, the present invention is not limited to this, and various configurations can be taken as appropriate. The control unit 61, the storage unit 62, and the communication control unit 63 are composed of the input unit 64, the display unit 65, and the peripheral device I / F unit 66, which are the control unit 21, the storage unit 22, the communication control unit 23, and the input unit of the server 2. Since the configuration is the same as that of the unit 24, the display unit 25, and the peripheral device I / F unit 26, overlapping description will be omitted.

Next, the procedure of the printed matter ordering process executed by the printed matter ordering system 1 will be described with reference to FIG. In the present embodiment, an example of using the printed matter ordering system 1 of the present invention for a service of selling photographs (printed matter) taken at an event venue will be described.

When the sale is started, the customer fills out the order on the order form 4 while looking at the photograph posted at the venue (step S101; FIG. 15 (a)). After completing the order form 4, the customer reads the completed order form 41 on the user terminal 3 (step S102; FIG. 15B). At this time, the user terminal 3 downloads the reference data 321 corresponding to the order form 4 from the server 2 (step S103). The order form reading process in step S102 will be described with reference to FIG.

As shown in the flowchart of FIG. 16, first, the customer takes a picture of the completed order form 41 using the camera 35 of the user terminal 3 (step S201). The control unit 31 of the user terminal 3 sends a download request for the reference data 321 to the server 2 (step S202). When transmitting the download request, the user terminal 3 adds the identification information of the communication equipment 8 and transmits the request. When the control unit 21 of the server 2 receives the download request for the reference data 321, the control unit 21 identifies the communication equipment used by the user terminal 3 from the identification information of the communication equipment 8 added to the download request, thereby specifying the sales venue. .. Then, with reference to the reference data group 222 of the storage unit 32, the reference data 321 used at the specified sales venue is acquired. In this way, the control unit 21 of the server 2 identifies the sales venue where the user terminal 3 of the download request source is used, and transmits the corresponding reference data 321 to the user terminal 3 of the request source (step S203). .. When the user terminal 3 receives the reference data 321 from the server 2 (step S204), the user terminal 3 makes a difference between the order image (image 41a obtained by capturing the filled-in order form 41) and the reference data 321 (step S205).

As shown in FIG. 17, the control unit 31 superimposes and makes a difference between the captured image 41a of the completed order form 41 and the reference data 321 so as not to deviate from each other. Then, the image 42 of the handwritten character is extracted (step S206). In step S206, it is desirable that the control unit 31 perform a correction process for correcting the inclination, size, etc. of the image 41a obtained by photographing the completed order form 41.
Further, when the image 41a obtained by capturing the completed order form 41 is different from the format of the reference data 321, the control unit 31 may display an error such as "the form is different" on the touch panel (display unit) 34. This makes it possible to quickly notice that there is an error in either the downloaded reference data 321 or the order form 4 used by the orderer.

The control unit 31 performs OCR processing on the extracted handwritten character image 42 (step S207), generates order information 223 as a reading result, and outputs it (step S208). When reading the order, the control unit 31 refers to the reference detailed data 322 and obtains which photo number (printed matter number) the order is based on which position the handwritten characters are written.

Returning to the description of FIG.
When the completed order form 41 is read by the user terminal 3 by the order form reading process in step S102 and the information indicating the order contents (data in which the printed matter number (photo number) and the order quantity are associated with each other) is read, the user The control unit 31 of the terminal 3 displays information indicating the order details on the touch panel 34 (display unit) of the user terminal 3 (step S104).

At this time, the customer (orderer) may be asked to confirm the presence or absence of misreading by OCR. This makes it possible to prevent erroneous orders. In addition, when there is a misreading, the control unit 31 displays a question about "whether the data can be used for machine learning" on the touch panel (display unit) 34, and whether or not the orderer permits it. You may accept the input of and use the data licensed by the orderer for machine learning. As a result, the reading accuracy of characters can be gradually improved.

In addition, when displaying the above question, it may be displayed that "if the orderer permits, a 10% discount service that can be used at the time of this or subsequent purchases will be provided". This can prompt the orderer's approval. Further, it may be possible to set ON / OFF for the above service provision instead of every time (for example, the first 10 people at the same venue on the same day). This is effective in preventing the act of intentionally writing dirty characters to get a discount in order to provide services such as coupons.

Further, the user terminal 3 may manage the data by distinguishing between misreading and mere entry error. This can reduce the noise of optimizing the read parameters.

FIG. 15C is a diagram showing an example of an order content display screen 81 displaying order content. As shown in FIG. 15 (c), the thumbnail image 81b of the photograph sold and the order quantity 81c of the photograph are displayed on the order content display screen 81. The order quantity 81c is editable. If the order details are correct, the customer touches the confirmation button 81a. When changing the order contents, the customer touches the display field of the order quantity 81c.

When the display field of the order quantity 81c is touched, the control unit 31 of the user terminal 3 accepts the correction of the order quantity (step S105; FIG. 15D). When the order quantity is changed, the control unit 31 displays the order content display screen 82 reflecting the modification.

After that, when the "confirm" button 82a is touched, the control unit 31 confirms the order and transmits the order contents to the server 2 (step S106). When the server 2 receives the order content (step S107), the server 2 issues the order identification information and the reception code for each order and stores the order information 223 in the storage unit 22 (step S108). The reception code is obtained by converting the order identification information into code information such as a QR code (registered trademark). As a result, the photo number (printed matter number) and the number of orders are associated with each other, and order information 223 (see FIG. 7) to which order identification information is added is generated.

The server 2 notifies (transmits) the issued reception code and the order identification information to the user terminal 3 which is the transmission source of the order (step S109). In addition, this notification may be transmitted as a reception screen 83 (FIG. 15 (e)), or may be transmitted by using a communication means such as mail 84. In the case of mail 84, it is necessary to register the mail address of the user terminal 3 in the server 2 in advance.

The user terminal 3 receives the reception code and the order identification information from the server 2 and outputs them (step S110).
FIG. 15 (e) is a diagram showing an example of the reception screen 83.
As shown in FIG. 15 (e), the reception number is displayed on the reception screen 83. (Order identification information) 83d, reception code 83b, amount of money 83c, etc. are displayed. The amount of money 83c is a value calculated by the server 2 based on the order information 223. When the staff hands over the product to the customer at the cash register, the staff receives the reception number on the reception screen 83. The product (photograph) can be confirmed by looking at 83d or reading the reception code 83b with the code reader 70.

The control unit 21 of the server 2 transmits the original image data 221 of the photograph included in the order information 223 to the print system 6 (step S111). When the print system 6 receives the original image data 221 (step S112), the print system 6 prints a photo with the printer 67 (step S113).

The customer presents the reception code 83b (reception screen 83) transmitted from the server 2 to the cash register staff, receives the product (photograph), and pays the fee (step S114).

FIG. 18 is a diagram illustrating a flow of payment processing. FIG. 18 describes a case where the photographs 91, 92, and 93 for the order are printed before the settlement. The print system 6 receives the order No. 91, 92, and 93 together with the ordered photographs 91, 92, and 93. It is assumed that the order details 95 in which (order identification information), the total number of photographs, the order details, etc. are described are printed.

As shown in FIG. 18, the cashier staff reads the reception code 83b presented by the customer using the user terminal 3 using a code reader 70 (order identification information acquisition means) connected to the print system 6 (FIG. 18). (1)). The control unit 61 of the print system 6 has a reception number read from the reception code 83b. (Order identification information) is displayed on the display unit 65. The cashier staff is the displayed reception number. Confirm (order identification information) ((2) in FIG. 18). The control unit 61 of the print system 6 receives a reception number from the server 2. The order information 223 corresponding to (order identification information) may be received and displayed on the display unit 65. The cashier picks the printed photo to be given to the customer, and receives the order details 95. (Order identification information) and the reception number displayed on the display unit 65. (Order identification information) is collated ((3) in FIG. 18). Then, the photograph is put in a photo take-out bag and handed to the customer to perform payment processing ((4) in FIG. 18). In the payment process, the print system 6 may transfer the order information 223 to the receipt printer 71 and print the receipt 51. The payment information (whether or not payment is made) input to the cash register is transmitted from the print system 6 to the server 2, and the server 2 reflects the payment information in the order history information 224.

The print system 6 may print the photographs 91, 92, 93 and the order details 95 in step S113, and may also print the corporate advertisement 94.

As described above, the printed matter ordering system 1 of the first embodiment is connected to the server 2 for storing the original image data 221 of the printed matter, the user terminal 3 capable of communicating with the server 2, and the server 2. It is equipped with a print system 6 installed at the sales venue and a communication facility 8 installed at the sales venue. Then, the order is input by reading the completed order form 41 filled in by the customer with the user terminal 3. As a result, the customer can fill out the order form 4 while slowly browsing the photographs posted on the shelves, walls, etc. on the user terminal 3 owned by the customer. Further, when the user terminal 3 reads the order form 4, the user terminal 3 acquires the reference data 321 which is an unfilled image of the order form 4 used at the venue from the server 2, and the image 41a of the filled-in order form 41 is obtained. Since the OCR processing is performed after the handwritten characters are extracted by differentiating the reference data 321 and the reference data 321, the reading accuracy of the characters can be improved. The reference data 321 of the order form 4 used at the venue is specified smoothly because it is performed based on the identification information of the communication equipment 8 installed at the sales venue. In addition, since the printing of photos by the print system 6 is performed for each order, the work is compared with the case where all the photos are printed in advance and the staff picks the photos from the storage shelf while checking the order contents. Efficiency is greatly improved. It is also possible to reduce the picking space without the need to install a photo storage shelf. Further, as in the first embodiment, if the photograph is printed for each order before payment, the time for the customer to wait for printing can be reduced and the flow of the purchase queue can be improved. It becomes.

[Second Embodiment]
In the first embodiment, the flow of printing the photo before the payment has been described, but the flow of printing the photo after the payment may be used. Hereinafter, with reference to FIGS. 19 and 20, a flow of processing in the case of printing a photo after payment in the printed matter ordering system 1 of the present invention will be described.

FIG. 19 is a sequence diagram showing an order flow when printing a photo after payment in the printed matter ordering system 1, and FIG. 20 is a diagram illustrating post-settlement photo printing.

Steps S301 to S310 of FIG. 19 are the same as steps S101 to S110 of FIG. 14 (first embodiment).
That is, when the sale is started, the customer fills out the order on the order form 4 while looking at the photograph posted at the venue (step S301). When the entry of the order form 4 is completed, the customer reads the completed order form 41 with the user terminal 3 (step S302). At this time, the user terminal 3 downloads the reference data 321 corresponding to the order form 4 from the server 2 (step S303). Since the order form reading process in step S302 is the same as that in FIG. 16, the description thereof will be omitted.

When the completed order form 41 is read by the user terminal 3 by the order form reading process in step S302 and information indicating the order contents (data in which the printed matter number (photo number) and the order quantity are associated with each other) is generated. The control unit 31 of the user terminal 3 displays the generated information indicating the order content on the touch panel 34 (display unit) of the user terminal 3 (step S304; order content display screen 81 in FIG. 15C).

At this time, the customer (orderer) may be asked to confirm the presence or absence of misreading by OCR. In addition, when there is a misreading, the control unit 31 displays a question about "whether the data can be used for machine learning" on the touch panel (display unit) 34, and whether or not the orderer permits it. You may accept the input of and use the data licensed by the orderer for machine learning. In addition, when displaying the above question, it may be displayed that "if the orderer permits, a 10% discount service that can be used at the time of this or subsequent purchases will be provided". Further, it may be possible to set ON / OFF for the above service provision instead of every time (for example, the first 10 people at the same venue on the same day). Further, the user terminal 3 may manage the data by distinguishing between misreading and mere entry error.

The control unit 31 of the user terminal 3 accepts the correction of the order quantity (step S305). When the order is modified, the control unit 31 displays the order content display screen 82 (FIG. 15 (d)) reflecting the modification.

After that, when the "confirm" button 82a is touched, the control unit 31 confirms the order and transmits information indicating the order contents to the server 2 (step S306). When the server 2 receives the information indicating the order content (step S307), the server 2 issues the order identification information and the reception code for each order and stores them as the order information 223 (step S308).

The server 2 notifies (transmits) the issued reception code (order identification information) to the user terminal 3 which is the transmission source of the order (step S309). As in the first embodiment, this notification may be transmitted as the reception screen 83 (FIG. 15 (e)), or may be notified using a communication means such as mail 84.

The user terminal 3 receives the reception code (order identification information) from the server 2 and outputs it (step S310). Similar to the first embodiment, the user terminal 3 displays the reception screen 83 as shown in FIG. 15 (e). The reception number is displayed on the reception screen 83. (Order identification information) 83d, reception code 83b, amount of money 83c, etc. are displayed.

In the case of printing a photo after payment, the customer presents the reception code 83b (reception screen 83) transmitted from the server 2 to the cashier staff and performs payment processing (step S311). The cash register 69 is connected to the print system 6. Further, it is assumed that the code reader 70 is connected to the cash register 69 or the print system 6. The cashier reads the reception code 83b of the user terminal 3 with the code reader 70, receives the information on the price of the order corresponding to the reception code 83b from the server 2, and displays it on the display unit 65 or the display unit of the cash register 69. Payment is completed when the payment is received from the customer. The control unit 61 of the print system 6 has a reception number read from the reception code 83b. (Order identification information) and payment information (information with payment "Yes") are transmitted to the server 2 (step S312).

When the server 2 receives the order identification information and the payment information from the print system 6 (step S313), the server 2 transmits the original image data for the order to the print system 6 (step S314). Further, the control unit 21 of the server 2 updates the payment information of the corresponding record of the order history information 224 stored in the storage unit 22 to "payment available".

The print system 6 receives the original image data 221 from the server 2 (step S315), and prints the ordered photo with the printer 67 (step S316). The customer receives the printed photo from the cashier staff.

FIG. 20 is a diagram illustrating a flow of payment processing in the second embodiment. FIG. 20 describes a case where a photograph for an order is printed after payment.

As shown in FIG. 20, the cashier staff reads the reception code 83b presented by the customer using the user terminal 3 using the code reader 70 ((1) of FIG. 20). The print system 6 has a reception number read from the reception code 83b. The price information corresponding to (order identification information) is received from the server 2 and displayed on the display unit 65 of the print system 6 or the display unit of the cash register 69. The cashier receives the payment from the customer ((2) in Fig. 20).

In the payment process, the print system 6 may transfer the order information 223 to the receipt printer 71 and print the receipt 51. When the payment is completed, the control unit 61 of the print system 6 reads the reception number 83b from the reception code 83b. (Order identification information) and payment information (information with payment "Yes") are transmitted to the server 2. The server 2 updates the payment status of the corresponding record of the order history information 224 to "paid" ((3) in FIG. 20), and is stored in the "delivery folder" of the storage unit 22 of the server 2. From the original image data, the original image data for the order is transmitted to the print system 6 ((4) in FIG. 20). The control unit 61 of the print system 6 receives the original image data and stores it in the “print folder” of the storage unit 62.

It is assumed that the original image data of the photograph ordered in the past is already stored in the "printing folder" of the storage unit 62 of the print system 6. If the original image data included in this order has already been transmitted, the control unit 21 of the server 2 does not need to retransmit the original image data to the print system 6. Only the newly ordered original image data is sent to the print system 6 and copied from the "delivery folder" of the server 2 to the "print folder" of the print system 6 ((5) in FIG. 20).

The control unit 61 of the print system 6 transmits a print output instruction to the printer 67 so as to print the original image data for the current order from the original image data in the “print folder” ((6) in FIG. 20. )). The printer 67 prints the ordered photographs 91, 92, 93. At this time, the reception number. The order details 95 in which (order identification information) and the like are described are printed together with the photographs 91, 92, and 93. In addition, a corporate advertisement 94 or the like may be printed ((7) in FIG. 20). The cashier or picking staff picks the printed photos (products) 91 to 95 for each order and puts them in the photo take-out bag ((8) in FIG. 20). The cashier staff will give the reception number attached to the product (order details 95). And the reception number of the user terminal 3. And hand the product to the customer.

In the printed matter ordering system 1 of the second embodiment described above, since the product is printed after payment, in addition to the same effect as that of the first embodiment, there is an effect that the loss of the printed photo due to unpaid charges is eliminated. be.

[Third Embodiment]
In the first and second embodiments, the user terminal 3 is provided with the order reading means (OCR function), but the server 2 may be provided with the order reading means. Hereinafter, as a third embodiment of the present invention, an example in which the server 2 includes an order reading means will be described. The system configuration of the printed matter ordering system 1 of the third embodiment is the same as the configuration of the printed matter ordering system 1 of the first embodiment (FIG. 1). Further, the hardware configuration of the server 2, the user terminal 3, and the print system 6 included in the printed matter ordering system 1 is the same as that of the first embodiment except that the server 2 includes an order reading means. Hereinafter, duplicate description will be omitted, and the same parts will be described with the same reference numerals.

FIG. 21 is a diagram showing a flow of order processing in the printed matter ordering system 1 according to the third embodiment of the present invention.

When the sale is started, the customer fills out the order on the order form 4 while looking at the photograph posted at the venue (step S401). When the entry of the order form 4 is completed, the customer photographs the completed order form 41 with the user terminal 3 and transmits the photographed image 41a (order image) of the completed order form 41 to the server 2 (step S402). When transmitting the order image, the user terminal 3 adds the identification information of the communication equipment 8 and transmits the order image. The server 2 executes the order reading process (step S403). The order reading process in step S403 will be described with reference to FIG.

As shown in the flowchart of FIG. 22, when the server 2 receives the order image (image 41a of the completed order form 41) (step S501), the control unit 21 of the server 2 receives the communication added to the received order image. The communication equipment used by the user terminal 3 is specified from the identification information of the equipment 8, and the sales venue is specified by this. Then, the reference data group 222 of the storage unit 22 is referred to to acquire the reference data 321 used at the specified sales venue (step S502). The control unit 21 of the server 2 makes a difference between the order image received in step S501 (image 41a obtained by capturing the filled-in order form 41) and the reference data 321 acquired in step S502 (step S503).

If the received order image (image 41a obtained by taking the completed order form 41) is different from the format of the reference data 321 specified in step S502, the control unit 21 of the server 2 may make an error such as "the form is different". An instruction may be transmitted to the user terminal 3 to display the display. This makes it possible to quickly notice that there is an error in the order form 4 used by the orderer, or that there is an error in the correspondence between the reference data 321 and the sales venue.

As shown in FIG. 17, the control unit 21 superimposes and makes a difference between the captured image 41a of the completed order form 41 and the reference data 321 so as not to deviate from each other (step S503). Then, the image 42 of the handwritten character is extracted (step S504). In step S504, it is desirable that the control unit 21 performs a correction process for correcting the inclination, size, and the like of the image 41a obtained by photographing the completed order form 41.

The control unit 21 performs OCR processing on the extracted handwritten character image 42 (step S505), generates order information 223 as a reading result, and transmits it to the user terminal 3 (step S506). When reading the order, the control unit 21 refers to the reference detailed data 322 and obtains which photo number (printed matter number) the order is based on which position the handwritten characters are written.

Returning to the description of FIG. In the order reading process of step S403, the completed order form 41 is read by the server 2, and information indicating the order contents (data in which the printed matter number (photo number) and the order quantity are associated with each other) is transmitted to the user terminal 3. The control unit 31 of the user terminal 3 displays information indicating the order details on the touch panel 34 (display unit) of the user terminal 3 (step S404).

At this time, the customer (orderer) may be asked to confirm the presence or absence of erroneous reading by the OCR of the server 2. In addition, when there is a misreading, the control unit 31 displays a question about "whether the data can be used for machine learning" on the touch panel (display unit) 34, and whether or not the orderer permits it. You may accept the input of and use the data licensed by the orderer for machine learning. In addition, when displaying the above question, it may be displayed that "if the orderer permits, a 10% discount service that can be used at the time of this or subsequent purchases will be provided". Further, it may be possible to set ON / OFF for the above service provision instead of every time (for example, the first 10 people at the same venue on the same day). In addition, the data may be managed by distinguishing between misreading and mere entry error. This can reduce the noise of optimizing the read parameters.

The control unit 31 of the user terminal 3 accepts the modification of the order quantity (step S405). When the order quantity is changed, the control unit 31 displays the order content display screen 82 reflecting the modification.

After that, when the "confirm" button 82a is touched, the control unit 31 confirms the order and transmits the order contents to the server 2 (step S406). When the server 2 receives the order content (step S407), the server 2 issues the order identification information and the reception code for each order and stores the order information 223 in the storage unit 22 (step S408).

The server 2 notifies (transmits) the issued reception code and the order identification information to the user terminal 3 which is the transmission source of the order (step S409). In addition, this notification may be transmitted as a reception screen 83 (FIG. 15 (e)), or may be transmitted by using a communication means such as mail 84. In the case of mail 84, it is necessary to register the mail address of the user terminal 3 in the server 2 in advance.

The user terminal 3 receives the reception code and the order identification information from the server 2 and outputs them (step S410).
The control unit 21 of the server 2 transmits the original image data 221 of the photograph included in the order information 223 to the print system 6 (step S411). When the print system 6 receives the original image data 221 (step S412), the print system 6 prints a photo with the printer 67 (step S413).

The customer presents the reception code 83b (reception screen 83) transmitted from the server 2 to the cash register staff, receives the product (photograph), and pays the fee (step S414). The settlement process may be performed after printing as in the first embodiment, or may be performed before printing as in the second embodiment.

As described above, in the printed matter ordering system 1 of the third embodiment, the server 2 is provided with an order reading means, and the image of the completed order form 41 taken (scanned) by the user terminal 3 is transmitted to the server 2. , The server 2 performs the difference processing with the reference data and the OCR processing, reads the order information, and returns it to the user terminal 3. Even when the processing is performed by the procedure of the third embodiment, the order can be placed using the order form 4 as in the first and second embodiments, and the reading accuracy of characters can be improved. .. In addition, it is possible to improve the work efficiency of picking photographs and reduce the picking space.

However, in a situation where many people are gathered, such as in a baseball field or a live venue, it is desirable to reduce the communication between the server 2 and the user terminal 3 as much as possible. From this point of view, it is preferable to provide order reading means (difference processing from reference data, OCR processing) on the user terminal 3 side as in the first and second embodiments.

This is because the processing procedure of the first and second embodiments includes the following three points as a device for reducing communication.
A: You can download the reference data 321 at any time.
B: The reference data 321 and the order form 4 are compared on the user terminal 3 side. Since this process is burdensome, if it is performed on the user terminal 3 side, communication with the server 2 is unnecessary and is not affected by the communication environment of the venue.
C: Send and receive only the text of order information (unlike images, the data is light, so it is not easily affected by the communication environment).

Although preferred embodiments of the present invention have been described above with reference to the accompanying drawings, the present invention is not limited to such examples. It is clear that a person skilled in the art can come up with various modified or modified examples within the scope of the technical idea disclosed in the present application, and these also naturally belong to the technical scope of the present invention. Understood.

1 ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ Printed matter ordering system 2 ・ ・ ・ ・ ・ ・ ・ ・ Server 3 ・ ・ ・ ・ ・ ・ ・ ・ User terminal 4 ・ ・ ・ ・ ・ ・ ・ ・Order form 6 ・ ・ ・ ・ ・ ・ ・ ・ Print system 7 ・ ・ ・ ・ ・ ・ ・ ・ Corporate management terminal 8 ・ ・ ・ ・ ・ ・ ・ ・ Communication equipment 21, 31, 61 ・ ・ ・Control units 22, 32, 62 ... Storage units 23, 33, 63 ... Communication control units 24, 64 ... Input units 25, 65 ... Display units 26, 36, 66・ ・ ・ ・ ・ Peripheral device I / F part 34 ・ ・ ・ ・ ・ ・ ・ ・ ・ Touch panel 35 ・ ・ ・ ・ ・ ・ ・ ・ ・ Camera 41 ・ ・ ・ ・ ・ ・ ・ ・ ・ Filled order form 41a ・ ・ ・ ・・ ・ ・ ・ Image of completed order form 42 ・ ・ ・ ・ ・ ・ ・ ・ ・ Handwritten characters (image)
51 ・ ・ ・ ・ ・ ・ ・ ・ ・ Reception slip 60 ・ ・ ・ ・ ・ ・ ・ ・ ・ Computer 67 ・ ・ ・ ・ ・ ・ ・ ・ Printer 69 ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ Cash register 70 ・ ・ ・・ ・ ・ ・ ・ ・ ・ ・ Code reader 71 ・ ・ ・ ・ ・ ・ ・ ・ ・ Receipt printer 81 ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ Order content display screen 82 ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ Order content display screen being modified 83 ・ ・ ・ ・ ・ ・ ・ ・ Reception screen 84 ・ ・ ・ ・ ・ ・ ・ ・ ・ Email 221 ・ ・ ・ ・ ・ ・ ・ ・ Original image data 222 ・ ・ ・ ・ ・ ・ ・ ・ Reference data group 223 ・ ・ ・ ・・ ・ ・ ・ ・ ・ Order information 224 ・ ・ ・ ・ ・ ・ ・ ・ Order history information 321 ・ ・ ・ ・ ・ ・ ・ ・ Reference data 322 ・ ・ ・ ・ ・ ・ ・ ・ Reference detailed data 323 ・ ・ ・ ・ ・ ・・ ・ Thumbletter image

Claims (17)

A server that stores the original image data of the printed matter, a user terminal that can communicate with the server, a print system that is connected to the server and installed at the sales venue of the printed matter, and communication equipment installed at the sales venue. And with
The user terminal is
Image acquisition method to acquire the image of the completed order form,
A download method for downloading reference data, which is an image of an unfilled order form, from the server, and
An order reading means for extracting handwritten characters written on the order form and reading the order information based on the difference data obtained by subtracting the image of the filled-in order form acquired by the image acquisition means and the reference data.
A transmission means for transmitting the order information to the server, and
An output means for receiving and outputting order identification information issued by the server is provided.
The server
A reference data storage means for storing the identification information of the communication equipment used at each sales venue in association with the reference data of the order form used at each sales venue.
When the reference data download request is received from the user terminal, the communication equipment used by the requesting user terminal is identified, the sales venue is specified, and the corresponding reference data is acquired from the reference data storage means and requested. Reference data transmission means to be transmitted to the original user terminal,
A receiving means for receiving the order information from the user terminal, and
An order storage means that issues order identification information that identifies received order information and stores it together with the order information.
An order identification information transmitting means for transmitting the order identification information to the user terminal,
The original image data transmission means for transmitting the original image data of the printed matter included in the order information to the print system together with the order identification information is provided.
The print system is
An original image data acquisition means for acquiring original image data of printed matter from the server, and
A printing means for printing the original image data of the acquired printed matter, and
A printed matter ordering system characterized by being equipped with. The printed matter ordering system according to claim 1, wherein the download means of the user terminal downloads the reference data from the server when the order reading means reads the order information from the filled-in order form. The user terminal is
The printed matter ordering system according to claim 1 or 2, further comprising a display means for displaying the order information read by the order reading means. The user terminal is
The printed matter ordering system according to claim 3, further comprising a correction input means for inputting corrections of order information read by the order reading means. The user terminal is
Further provided with a thumbnail image acquisition means for acquiring a thumbnail image of the printed matter from the server.
The printed matter ordering system according to claim 3, wherein the display means displays a list of the acquired thumbnail images and reflects the order information. The printed matter ordering system according to any one of claims 1 to 5, wherein the output means of the user terminal displays a reception code indicating the order identification information. The user terminal is equipped with a camera.
The printed matter ordering system according to any one of claims 1 to 6, wherein the image acquisition means acquires an image of the completed order form by taking a picture with the camera. The original image data transmission means of the server is
The printed matter ordering system according to any one of claims 1 to 7, wherein when the order information is received from the user terminal, the original image data of the printed matter included in the received order information is transmitted to the print system. The print system is
Further provided with an order identification information acquisition means for acquiring the order identification information output by the user terminal.
The original image data acquisition means requests the server to transmit the original image data of the printed matter included in the order information corresponding to the order identification information acquired by the order identification information acquisition means.
The printed matter according to any one of claims 1 to 7, wherein the original image data transmitting means of the server transmits the original image data of the printed matter to the server in response to a request from the print system. Ordering system. The print system further includes a payment information transmitting means for transmitting payment information to the server when the payment processing of the printed matter printed by the printing means is completed.
Claim 1 to claim 1, wherein the server further includes a payment information reflecting means that reflects the payment information in the order history information stored in the order storage means when the payment information is received from the print system. The printed matter ordering system according to any one of 9. A server that stores the original image data of the printed matter, a user terminal that can communicate with the server, a print system that is connected to the server and installed at the sales venue of the printed matter, and communication equipment installed at the sales venue. And with
The user terminal is
Image acquisition method to acquire the image of the completed order form,
An order image transmission means for transmitting an image of a completed order form acquired by the image acquisition means to the server, and an order image transmission means.
It is provided with an output means for receiving order information from the server and receiving and outputting order identification information issued by the server.
The server
A reference data storage means for storing the identification information of the communication equipment used at each sales venue in association with the reference data of the order form used at each sales venue.
A receiving means for receiving an image of a completed order form transmitted from the user terminal, and
A reference data acquisition means for identifying the communication equipment used by the user terminal, specifying a sales venue, and acquiring the corresponding reference data from the reference data storage means.
An order reading means that extracts handwritten characters written on the order form based on the difference data obtained by the difference between the image of the completed order form received by the receiving means and the reference data acquired by the reference data acquiring means, and reads the order information. When,
An order storage means that issues order identification information that identifies the read order information and stores it together with the order information.
A transmission means for transmitting the order information and the order identification information to the user terminal, and
The original image data transmission means for transmitting the original image data of the printed matter included in the order information to the print system together with the order identification information is provided.
The print system is
An original image data acquisition means for acquiring original image data of printed matter from the server, and
A printing means for printing the original image data of the acquired printed matter, and
A printed matter ordering system characterized by being equipped with. A user terminal that can communicate with a server that stores original image data of printed matter.
Image acquisition method to acquire the image of the completed order form,
A download method for downloading reference data, which is an image of an unfilled order form, from the server, and
An order reading means for extracting handwritten characters written on the order form and reading the order information based on the difference data obtained by subtracting the image of the filled-in order form acquired by the image acquisition means and the reference data.
A transmission means for transmitting the order information to the server, and
An output means that receives and outputs order identification information issued by the server, and
A user terminal characterized by being provided with. A server that stores the original image data of the printed matter and is connected to the print system and the user terminal installed at the sales venue of the printed matter by communication.
A reference data storage means for storing the identification information of the communication equipment used at each sales venue in association with the reference data of the order form used at each sales venue.
When the reference data download request is received from the user terminal, the communication equipment used by the requesting user terminal is identified, the sales venue is specified, and the corresponding reference data is acquired from the reference data storage means and requested. Reference data transmission means to be transmitted to the original user terminal,
A receiving means for receiving order information from the user terminal, and
An order storage means that issues order identification information that identifies received order information and stores it together with the order information.
An order identification information transmitting means for transmitting the order identification information to the user terminal,
An original image data transmission means for transmitting the original image data of the printed matter included in the order information to the print system together with the order identification information.
A server characterized by being equipped with. A server that stores the original image data of the printed matter, a user terminal that can communicate with the server, a print system that is connected to the server and installed at the sales venue of the printed matter, and communication equipment installed at the sales venue. It is a printed matter ordering method in a printed matter ordering system equipped with
The user terminal
Steps to get an image of the completed order form,
The step of downloading the reference data, which is an image of the blank order form, from the server, and
A step of extracting the handwritten characters entered in the order form based on the difference data obtained by subtracting the image of the completed order form and the reference data and reading the order information.
The step of transmitting the order information to the server and
Including a step of receiving and outputting the order identification information issued by the server.
The server
The identification information of the communication equipment used at each sales venue is associated with the reference data of the order form used at each sales venue and stored in the storage unit.
When the download request for the reference data is received from the user terminal, the communication equipment used by the requesting user terminal is identified, the sales venue is specified, and the corresponding reference data is acquired from the storage unit of the requesting source. Steps to send to the user terminal and
The step of receiving the order information from the user terminal and
The step of issuing order identification information that identifies the received order information and storing it together with the order information,
The step of transmitting the order identification information to the user terminal,
Including a step of transmitting the original image data of the printed matter included in the order information to the print system together with the order identification information.
The print system
The step of acquiring the original image data of the printed matter from the server,
Steps to print the original image data of the acquired printed matter,
A method of ordering printed matter, characterized by including. A server that stores the original image data of the printed matter, a user terminal that can communicate with the server, a print system that is connected to the server and installed at the sales venue of the printed matter, and communication equipment installed at the sales venue. It is a printed matter ordering method in a printed matter ordering system equipped with
The user terminal
Steps to get an image of the completed order form,
The step of sending the acquired completed order form image to the server, and
Including a step of receiving order information from the server and receiving and outputting order identification information issued by the server.
The server
A step of associating and storing the identification information of the communication equipment used at each sales venue with the reference data of the order form used at each sales venue.
The step of receiving the image of the completed order form sent from the user terminal, and
A step of identifying the communication equipment used by the user terminal, specifying a sales venue, and acquiring the corresponding reference data from the reference data storage means.
A step of extracting the handwritten characters entered in the order form and reading the order information based on the difference data obtained by subtracting the received image of the completed order form and the acquired reference data.
A step to issue order identification information that identifies the read order information and store it together with the order information,
A step of transmitting the order information and the order identification information to the user terminal, and
Including a step of transmitting the original image data of the printed matter included in the order information to the print system together with the order identification information.
The print system is
The step of acquiring the original image data of the printed matter from the server,
Steps to print the original image data of the acquired printed matter,
A method of ordering printed matter, characterized by including. A computer that functions as a user terminal that can communicate with a server that stores original image data of printed matter.
Image acquisition method to acquire the image of the completed order form,
A download method for downloading reference data, which is an image of an unfilled order form, from the server.
An order reading means that extracts handwritten characters written on the order form based on the difference data obtained by the difference between the image of the completed order form acquired by the image acquisition means and the reference data and reads the order information.
A transmission means for transmitting the order information to the server,
An output means that receives and outputs order identification information issued by the server.
A program characterized by functioning as. A computer that stores the original image data of the printed matter and functions as a server that is connected to the print system and the user terminal installed at the sales venue of the printed matter.
A reference data storage means for storing identification information of communication equipment used at each sales venue in association with reference data of an order form used at each sales venue.
When the reference data download request is received from the user terminal, the communication equipment used by the requesting user terminal is identified, the sales venue is specified, and the corresponding reference data is acquired from the reference data storage means and requested. Reference data transmission means to send to the original user terminal,
A receiving means for receiving order information from the user terminal,
An order storage means that issues order identification information that identifies received order information and stores it together with the order information.
An order identification information transmitting means for transmitting the order identification information to the user terminal,
An original image data transmission means for transmitting original image data of a printed matter included in the order information to the print system together with the order identification information.
A program characterized by functioning as.

Images