JP2023126732A - Information processing method, information processing apparatus, program, and information processing system - Google Patents

Abstract

To provide an information processing method, an information processing apparatus, a program, and an information processing system in which accounting processing can be carried out with lessor burden and labor.SOLUTION: The present invention is directed to an information processing method including: acquiring article image data including image data of specific information for specifying a certain article and image data of a price of the certain article; generating data of an order reception image including an operation button for use in reception of an order of the certain article on the basis of the article image data; generating article data represented by the operation button and in which the certain article is associated with the price of the certain article on the basis of the article image data; displaying the order reception image corresponding to the data of the generated order reception image on a display screen so that an operation on the operation button can be received; discriminating whether the operation on the operation button included in the order reception image displayed on the display screen is carried out; and, if it is determined that the operation on the operation button is carried out, generating sales data on the basis of the article data of the certain article.SELECTED DRAWING: Figure 7

Description

The present invention relates to an information processing method, an information processing device, a program, and an information processing system.

Registers (cash registers, commonly known as cash registers) used for accounting processing at retail stores and other commercial facilities generally associate product names with amounts, and sales are recorded by pressing a button corresponding to the ordered product. Ru. In Patent Document 1, on a store terminal such as a tablet terminal, a user specifies a range for reading product names, prices, etc. from an image of a menu table, reads characters in the specified image range, and reads products and prices. A technique for generating associated data and registering it in a menu information database has been disclosed.

Patent No. 6099788

However, with the conventional technology, it is not possible to sufficiently reduce the user's operational effort for receiving an order for a product and processing the transaction at a register.

An object of the present invention is to provide an information processing method, an information processing device, a program, and an information processing system that enable accounting processing of products to be performed with less effort.

In order to achieve the above object, the present invention
Obtaining product image data including image data of specific information that identifies a certain product and image data of the price of the certain product,
Based on the product image data, generate order reception image data including operation buttons for accepting an order for the certain product;
generating product data that associates the certain product represented by the operation button with the price of the certain product based on the product image data;
displaying the order reception image according to the data of the generated order reception image on a display screen so as to be able to accept operations of the operation buttons;
determining whether or not the operation button included in the order reception image displayed on the display screen has been operated;
In the information processing method, when it is determined that the operation of the operation button has been performed, sales data of the certain product is generated based on the product data of the certain product.

According to the present invention, there is an effect that it becomes possible to perform accounting processing for products with less effort.

FIG. 1 is a block diagram showing the configuration of an information processing system according to the present embodiment. It is a figure explaining a menu table. It is a figure explaining the setting of a product and an amount. It is a figure explaining discount setting. It is a figure explaining discount application. 3 is a flowchart showing a control procedure of external setting control processing. FIG. 3 is a diagram showing an example of a generated order reception screen. It is a diagram explaining the flow of operations related to accounting processing.

Embodiments of the present invention will be described below based on the drawings.
FIG. 1 is a block diagram showing the configuration of an information processing system 100 of this embodiment.
The information processing system 100 includes an information processing device 1 and a register 4 (external device).

The information processing device 1 is a portable general-purpose terminal electronic device, and is, for example, a smartphone.
The information processing device 1 includes a CPU 11 (Central Processing Unit) (processing section), a storage section 12, a display section 13, an operation reception section 14, a photographing section 15, a communication section 16 (first communication section), etc. Equipped with

The CPU 11 is a hardware processor that performs arithmetic processing and centrally controls the operation of the information processing device 1 . The CPU 11 may be a single processor, or may have a plurality of processors, each of which performs common processing in parallel, or each of which performs different processing separately. At least this CPU 11 is included in the computer of this embodiment.

The storage unit 12 has a memory that stores data. The storage unit 12 includes a RAM that provides a working memory space for the CPU 11 and stores temporary data, and a nonvolatile memory that stores a program 121, setting data, and the like. The RAM is, for example, a DRAM, and the nonvolatile memory is, for example, a flash memory. The program 121 includes a program related to a function (OCR) for identifying characters from image data, and a register accounting assistance application to be described later. The setting data stored in the non-volatile memory includes the order reception image data 122 for order input operation used in the cash register accounting assistant application, and the product name and product name selected by the operation received via the order reception image data 122. , and a product list 123 that stores the sales amount corresponding to the product name.

The display unit 13 has a display screen, and displays information on the display screen under the control of the CPU 11. The display screen is, for example, a liquid crystal display (LCD), although it is not particularly limited. Furthermore, the display unit 13 may include an LED lamp for notifying statuses such as the operating state and the charging state.

The operation reception unit 14 receives an input operation from the outside such as a user, generates an input signal, and outputs the input signal to the CPU 11. The operation reception unit 14 includes, for example, a touch panel that overlaps the display screen. Further, the operation reception unit 14 may include a push button switch, a slide switch, or the like.

The photographing unit 15 is a digital camera that performs a photographing operation to generate and output image data. The photographing unit 15 includes, for example, a lens (optical system) and a two-dimensionally arranged CMOS sensor, and generates color image data by photographing in each RGB wavelength band.

The communication unit 16 performs wireless communication with an external device. Wireless communication that can be controlled by the communication unit 16 includes telephone communication, wireless LAN (Local Area Network) such as WiFi, and short-range wireless communication such as Bluetooth (registered trademark). Each has an antenna according to the communication frequency, polarization characteristics, etc. For communication with the register 4, Bluetooth is used here. Although the Bluetooth standard is not particularly limited, for example, by using the Low Energy standard, power consumption can be kept low even if the connection state is maintained while the store is open.

The register 4 is a cash register (cash register) located inside a store and used for transaction processing. The register 4 includes a CPU 41 (control section), a storage section 42, a display section 43, an operation reception section 44, a communication section 46 (second communication section), a printing section 47, a paper transport section 48, etc. Be prepared.

The CPU 41 performs arithmetic processing and centrally controls the operation of the register 4. The CPU 41 may include not only a general-purpose CPU but also a microcomputer or the like. Further, part of the arithmetic processing by the CPU 41 may be performed by a dedicated logic circuit or the like.

The storage unit 42 has a memory that stores data. The storage unit 42 may include a RAM that provides a working memory space for the CPU 41 and stores temporary data, and a nonvolatile memory that stores programs 421, setting data, sales information, and the like. Nonvolatile memory is, for example, flash memory. The setting data may include input settings 422 indicating the relationship between the registered product name, the price of the product, and the corresponding position of the reception button of the operation reception unit 44.

The display unit 43 has a display screen, and displays amounts and the like on the display screen based on the control of the CPU 41. The display screen is, for example, an LCD, but is not limited to this.

The operation reception unit 44 receives an input operation from an external source such as a user, generates an operation signal, and outputs the operation signal to the CPU 41 . The operation reception unit 44 is capable of inputting information such as the sales amount of the product and the amount received from the customer. Further, the operation reception unit 44 includes a registration button that allows the user to directly input the sales of the product assigned in the input settings 422, as described above.

The communication unit 46 controls communication with an external device, here, the information processing device 1. The communication unit 46 is capable of communicating with the information processing device 1 using a common communication standard, and here controls communication by Bluetooth via an antenna (not shown).

The printing unit 47 prints and records sales information on receipt paper. The recording method of the printing section 47 is not particularly limited, but may be, for example, a thermal transfer method.

The paper transport unit 48 moves the receipt paper by an appropriate length at an appropriate timing, and supplies and discharges the receipt paper to a position where print recording is to be performed. The paper transport unit 48 includes, for example, a rotating roller and a motor, and performs operations such as sending out the receipt paper by rotating the rotating roller to which a roll of receipt paper is attached by the motor.

Next, accounting processing in the information processing system 100 of this embodiment will be explained.
In the information processing system 100, final accounting processing is performed by the register 4. Register 4 allows normal accounting processing, where you input and add the sales amount for each product, and if necessary, calculate and add taxes other than consumption tax, or subtract discounts. You can The price of a product may be registered in a specific key or the like in association with the product to be sold, and in the register 4, a user such as a store clerk operates (presses, etc.) a key corresponding to the product ordered. Therefore, the amount of the product may be added as the sales amount, but it may also be possible to input the amount itself by directly operating (pressing) the numeric keypad. Note that the product may be a service in addition to or instead of an article.

In addition, the register 4 can acquire sales data from the information processing device 1 via the communication unit 46. In the information processing device 1, the sales amount and simple product information (specific information) of the ordered product (certain product) are transmitted to the register 4 via the communication unit 16 by the operation of the program 121 related to the generation of sales data. Ru. The generation of sales data in the information processing device 1 is a display displaying an order reception image created by importing (obtaining) photographic data (product image data) of a menu table created to present to customers etc. This is done using a screen.

FIG. 2 is a diagram illustrating the menu table M.
As shown in FIG. 2(a), the menu table M is a product image of the present embodiment, and includes, for example, an image of a food and beverage menu at a restaurant (including letters), an image of its price (an image of letters and numbers), and are shown in correspondence. The menu table M may be handwritten or a copy of a handwritten document, or may be created by a restaurant employee or the like using an application program such as a draw tool or a paint tool in an arbitrary arrangement. Good too.

Here, in the menu table M, menus such as a plurality of sets and set meals are listed in blocks, and some of the menus are displayed with photos and the like. That is, this menu table M was created to make it easy for customers to select the products they would like to order, and in order to register the products in the register 4, the product name (display of specific information) and the price of the product are clearly displayed. It does not have to be created as text data etc. that are associated with each other.

After photographing this menu table M with the photographing unit 15 (camera) of the information processing device 1 to obtain menu image data, characters and numbers (including symbols indicating prices) are captured using OCR software of the program 121. character strings and number strings can be extracted as shown in FIG. 2(b). These character strings and number strings are candidates for operation buttons indicating product names.

FIG. 3 is a diagram illustrating setting of products and amounts. Here, only the "A set" part located in the upper center of the menu image data shown in FIG. Setting processing is performed.

As shown in FIG. 3A, the extracted character strings and numeric strings are each shown with a simple outer frame or as an operation button with a planar shape of a push button switch drawn. First, a screen for selecting a product name (menu name, specific information for a certain product) is displayed. The operation of selecting an operation button that indicates one of the product names (for example, the operation of placing the cursor over the display range of the operation button using a pointing device such as a mouse and clicking it, the operation of tapping the display range with a finger, etc.). When this operation is referred to as an operation button operation (here, for example, "Soy Sauce Ramen (Small)"), the amount corresponding to the product name (the amount of a certain product ) is displayed. Here, by selecting the one located on the upper side of the two "950 yen", "950" is set as the price of "soy sauce ramen (small)" in "yen" units. That is, if characters indicating a currency unit or the like are included in the character/number string indicating the selected amount, the currency unit may be appropriately identified. Note that if auxiliary units such as cents are included in dollars and euros, these units (cuts) may be determined as appropriate. As a result, a certain product and the amount of the product are associated with each other. The character string (number string) indicated as the amount may be excluded from the operation button candidates, but it may be selected as the amount again in consideration of cases where a single amount is indicated for multiple products. It may be left as a possible operation button candidate.

The process of accepting the operation of the operation button that includes the product name (specific information) and the corresponding amount is repeated for all products. When the operation buttons for all products and the amount of the product are operated and the selection end button E is operated on the screen using a pointing device, etc., as shown in FIG. 3(c), the remaining buttons that have not been operated are The character string of the operation button is excluded from the display settings as the operation button.

FIG. 4 is a diagram illustrating discount settings. Here, of the menu image data shown in FIG. 2(b), the portion of the menu related to ramen located on the upper left side will be explained.

As shown in Figure 4(a), in addition to regular products, orders can also be made to display the changed amount related to changes (price fluctuation information) such as temporary discounts or premiums such as "100 yen off!!" may be included in the scope of Here, "100 yen discount" is displayed as the product name (specific information) and as the operation button R1 (change button), and at the same time, "-100" is registered as the amount. Although an example of a fixed amount discount is shown here, a ratio may be specified for the discount. The discount may be applied to the amount of the most recently ordered product. In addition to discounts, there may also be premiums. This can be displayed and used, for example, when there is a late-night surcharge. In addition, similar to the setting of the register 4 described above, in the information processing device 1 as well, the products may include services in addition to or instead of goods. By operating the confirm button C, the display contents of the order reception image are confirmed.

Note that this "100 yen discount" is only available for a limited time from "11:00 AM to 11:30 AM". The information processing device 1 may read this information or make the "100 yen discount" operation button operable only during the discount time period based on the user's operation. As shown in FIG. 4(b), the operation button R2 may be displayed in an inoperable state outside the target time, or the operation button R2 itself may be deleted outside the target time.

FIG. 5 is a diagram illustrating discount application.
In the above, the 100 yen discount is set to be entered by the user, but it is set to automatically switch to setting and displaying the discounted amount based on the discount target product and time zone settings. It's okay. In response to the display (second order reception image) with the price setting for the normal time shown in FIG. Depending on whether or not the application conditions are met, the amount Rd of "salt ramen" and "miso ramen" is displayed with a 100 yen discount (Figure 5(b), first order reception image). Data for multiple types of order reception images is defined. The discounted amount may be displayed by changing the display color or background color or by surrounding it with a frame or the like so that it can be seen that it is a discounted price. Alternatively, a specific sign or symbol indicating a discount/surcharge may be displayed along with the amount.

The data for these plural types (two types in this case) of order reception images may be generated all at once when setting products and amounts based on menu image data or the like. Furthermore, when the image data is display data such as HTML, it may be determined that a single data file includes a plurality of display patterns in an integrated manner and is selectively displayed. The price settings for the product may be stored in association with amounts depending on the presence or absence of discounts or premiums, or may be stored in association with the original price and discount/surcharge amounts.

Note that instead of the user specifying all the product names and the corresponding amounts, the product names and the amounts corresponding to the product names may be estimated first. In this case, a numerical string, especially one that includes a currency unit, is first estimated as the amount, and a position corresponding to the estimated amount, for example, a character string located side by side, is estimated as the product name. Estimation errors can be corrected by input operations by the user.

FIG. 6 is a flowchart showing a control procedure by the CPU 11 of the external setting control process executed by the information processing device 1. This external setting control process including the information processing method of the present embodiment is performed in advance, for example, before the opening of a store, and the cashier account assistant application is started in the information processing device 1, and the settings are performed within the application. It is started when an operation to start is accepted.

The CPU 11 acquires the photographic data of the menu table M (step S101; image acquisition step, image acquisition means). The photographic data may be selected from a file list or the like by photographing data that has been photographed in advance and stored in the storage unit 12 or an external network drive or folder, or may be selected from a file list or the like. Guidance may be given to the user so that the user can take a photograph using the photographing unit 15.

The CPU 11 identifies and extracts the characters (text portion) of the photographic data of the acquired menu table M, and generates text data having positional information of the characters (step S102). The CPU 11 divides the text data into written parts, and displays operation buttons in each position range (step S103). The CPU 11 also displays a product selection end button E.

The CPU 11 determines whether the selection end button E related to the end of product selection has been operated (step S104). If it is determined that the product selection end button E has not been operated (“NO” in step S104), the CPU 11 determines whether or not the operation button generated in step S103 has been operated (step S105). If it is determined that the operation button has not been operated ("NO" in step S105), the process of the CPU 11 returns to step S104.

If it is determined that the operation button has been operated ("YES" in step S105), the CPU 11 highlights (selects) the selected button display area as a product name (step S106). The CPU 11 determines whether or not the operation of the operation button indicating the price of the highlighted product has been accepted (step S107). If it is determined that the operation of the operation button has not been accepted (“NO” in step S107), the CPU 11 repeats the process of step S107.

If it is determined that the operation of the operation button has been accepted (“YES” in step S107), the CPU 11 reads a number from the text of the operation button for which the operation was accepted, sets it as an amount, and sets the amount as the amount that has been received. The information is stored in association with the product name obtained in (Step S108). Note that at this time, the CPU 11 may display the combination of amount and product name in a modifiable state and wait for a modification operation and an approval operation. Also, if the product name and amount are not separated properly (for example, when "large size" and "110 yen" are determined to be a series of texts), for example, the text can be separated into the product name and amount. After registering the product as both, a correction process may be performed to shorten the product name to only the "large portion" part. Only the number "110" can be extracted as the amount.

The CPU 11 confirms the display of the operation button on which the product is displayed, and cancels the display of the operation button on which the amount is displayed (step S109). Then, the process of the CPU 11 returns to step S104.

When it is determined in the determination process in step S104 that the product selection end button E has been operated ("YES" in step S104), the CPU 11 displays the remaining (unoperated operation buttons) text buttons. All are canceled (step S111). The CPU 11 finalizes and generates the order reception image data 122 including the button display of the confirmed product (step S112). Note that, before finalizing the order reception image data 122, the CPU 11 may perform processing such as rearranging the order reception image data 122 by filling in blank spaces as appropriate. Further, it may be possible to accept an operation for deleting a character string or the like that is unnecessary for an order operation.
The processing of steps S102 to S112 constitutes an image generation step (image generation means of the program).

The CPU 11 sets and stores the set of product name (specific information) and price that are associated and stored in step S108 as a product list 123 (step S113; list data generation step, list data generation means). Then, the CPU 11 ends the external setting control process.

FIG. 7 is a diagram showing an example of an order reception screen generated by the above external setting control process.
As shown in FIG. 7A, an image (order reception image O) is displayed on the order reception screen (display screen) according to the order reception image data generated in the external setting control process of FIG. In this order reception image O, the part where the product name that has been set in the external setting control process is displayed is included as selection operation buttons B1 to B3, and each selection operation button B1 to B3 can be operated at the time of ordering. . If the information processing device 1 is a smartphone, and the order reception images O for all products cannot be displayed on the order reception screen at once due to the size of the screen, scrolling display may be possible. Alternatively, it may be possible to display the image divided into multiple pages. In the case of split display on a plurality of screens, operation buttons for changing the page to be displayed (for example, operation buttons B4 and B5 for "previous page" and "next page") may be additionally displayed. Further, a subtotal button T (which may be displayed as "accounting") is added to this order reception screen (order reception image O) for accepting a subtotal operation indicating the end of an order operation.

In the order reception image O, product images etc. may be deleted as appropriate as they are unnecessary for order operations, and unnecessary spaces (blank) etc. may be deleted as described above or operation buttons may be deleted accordingly. The positions may be rearranged appropriately. Furthermore, font types and sizes for representing letters and numbers may be uniformly predetermined.

Some of the character strings that are not directly related to the product name and are not set as the product name may be necessary for grouping the products, so they do not necessarily need to be deleted uniformly. Whether or not these character strings can be deleted may be determined depending on the user's input operation. Here, since the character string "A set" representing the group of set menus is information necessary to specify the ordered product, this character string is left in the order reception image data without being deleted. Also, since the character string "Gyoza" is information that specifies the contents of Set A, this character string may also be left in the order reception image data without being deleted, or it may be unnecessary information for the store staff. It may also be deleted.
Alternatively, on the other hand, even if there are spaces or characters that are unnecessary for accounting processing, the positional relationship in the original menu table M may be generally maintained without being significantly changed such as deletion. That is, images included in the menu table M may be left as they are in the order reception image O. As a result, sales setting operations can be performed almost in accordance with the positional relationship on the menu table, so that store staff members do not have to struggle to find the product to be sold on the screen.

The information processing device 1 can accept orders by displaying an order reception image O including operation buttons that can accept operations on the generated order reception screen and detecting operations of each operation button. Sales data of the ordered product is generated based on the product name of the product for which the order has been accepted and the amount information associated with the product name. The generated sales data is transmitted to the register 4 by the communication unit 16. Note that if orders can be made from a plurality of seats or tables, identification information specifying the seats or tables may be included in the sales data and transmitted.

Although not particularly limited, here, as shown in FIG. 7(b), the products and their prices transmitted to the register 4 as sales data are displayed in the ordered column. The register 4 receives the product name and amount information and adds it to the transaction details. When the subtotal button T is operated, it is assumed that the order has been completed, and the accounting process at the register 4 can be completed. Note that the accounting process at the register 4 may be able to be terminated regardless of the operation of the subtotal button T.

In addition to the sales data received from the information processing device 1, the accounting details may include sales data directly received by the register 4. If there is a standard product that is registered in the register 4, or if there is a sale of a non-regular menu that has not been set in the information processing device 1, the sales will be sent directly to the register 4. In some cases, the amount or the like may be input. Accounting processing is performed based on the final input sales amount, and a receipt is printed and output.

Furthermore, when the register 4 holds today's sales history, etc., the sales amount received from the information processing device 1 may be processed all at once, or may be processed according to the product name (specific information) received at the same time. It may also be classified as such.

FIG. 8 is a diagram illustrating the flow of operations related to accounting processing.
As shown in the sequence diagram of FIG. 8(a), when the application startup operation is received by the user, the information processing device 1 launches the application, displays the order reception screen, and communicates with the register 4. A connection is established.

When the user operates the operation button corresponding to the ordered product on the order reception screen, the information processing device 1 specifies the ordered product and its price. Then, sales data is generated based on the specified product and the price of the product, and the generated sales data is transmitted to the register 4.

The register 4 performs overall accounting processing based on the sales data received from the information processing device 1. At this time, if a separate sales input operation has been/will be performed in register 4, the sales amount related to the received sales data and the sales amount related to the input operation to register 4 will be the sum (minus due to discounts, etc.) (including the amount). Once the exchange of charges with the customer is complete, a receipt is printed and output.

FIG. 8(b) is a flowchart showing a control procedure by the CPU 11 of the sales setting control process executed by the information processing device 1.
When the sales setting control process is started, the CPU 11 reads out the order reception image data 122 and displays the order reception image O on the display screen (step S141; display control step, display control means). The CPU 11 establishes a Bluetooth communication connection with the register 4 (step S142).

The CPU 11 determines whether or not the operation of the subtotal button T has been accepted (step S143). If it is determined that the operation of the subtotal button T has not been accepted (“NO” in step S143), the CPU 11 determines whether or not the operation of the operation button for accepting an order for a product (menu) has been accepted. It is determined (step S144; operation determination step, operation determination means). If it is determined that the operation of the operation button has not been accepted ("NO" in step S144), the process of the CPU 11 returns to step S143.

When it is determined that the operation of the operation button has been accepted ("YES" in step S144), the CPU 11 refers to the product list 123 to identify the information on the product corresponding to the operated operation button, such as the price, and Generate and store sales data based on the specified content. (Step S145; sales data generation step, sales data generation means). The CPU 11 transmits the generated sales data to the register 4 via Bluetooth via the communication unit 16 (step S146). The CPU 11 causes the display unit 13 to display the contents of the sales settings on the display screen (step S147). Then, the process of the CPU 11 returns to step S143.

Further, if it is determined in the determination process in step S143 that the operation of the subtotal button T has been accepted ("YES" in step S143), the CPU 11 sends a notification via Bluetooth via the communication unit 16 to the effect that the order has been completed. It is transmitted to register 4 (step S151). The CPU 11 initializes the sales setting contents (step S152), and also erases the sales contents displayed on the display screen (step S153). Then, the process of the CPU 11 returns to step S143.

Note that this process may be forcibly terminated by interrupt processing in response to an instruction to terminate the cashier account assisting application.

As described above, in the information processing method of the present embodiment, product image data (such as photographic data of menu table M) including image data of specific information such as a product name that identifies a certain product and image data of the price of the certain product. ) (step S101), and based on the product image data, generate data for an order reception image O including selection operation buttons (B1 to B3) for accepting an order for a certain product (steps S102 to S112); Also, based on the data of the product image (menu table M), a product list 123 is generated in which the products represented by the selection operation buttons B1 to B3 are associated with the price of the products (step S113). The order reception image O corresponding to the data of the order reception image O is displayed on the display screen so as to be able to accept operations of the selection operation buttons B1 to B3 (step S141), and the order reception image O displayed on the display screen is displayed. It is determined whether or not the selection operation buttons B1 to B3 have been operated (step S144), and if it is determined that the selection operation buttons B1 to B3 have been operated, the product corresponding to the operated operation button is Product data is acquired from the product list 123, and sales data for a certain product is generated based on the product data (step S145).
In this way, by making it possible to generate sales data using photographic data such as menu table M, accounting processing can be easily performed with less effort without having to register each product and amount in register 4. become. This is especially true in restaurants where menus are replaced or prices are changed on a daily, weekly, or irregular basis, and where it is difficult or troublesome to enter products by setting and reading various identification codes. Accounting processing) can be made easier by using a general-purpose information processing device 1 such as a smartphone. Furthermore, since the order reception image O corresponding to the menu table M is obtained, the time and effort required by the store clerk to search for the operation button for the ordered product can be reduced.

Further, in this information processing method, in the order reception image O, the portion where specific information is displayed is used as an operation button. In this way, text parts containing specific information are displayed almost as they are as operation buttons, so processing is easy, and users such as store clerks can easily and error-free input settings for sales according to the original menu table. I can do it.

Further, in this information processing method, a text portion in the product image data is extracted, and specific information and an amount are set from the extracted text portion. In other words, since the text part is recognized and extracted from the image data of the photographed menu table and the product name and price are set, the user does not have to enter the product name and price each time to make operational settings, reducing the time and effort. Ru.

Further, in this information processing method, when it is determined that the displayed operation button has been operated, the communication unit 16 transmits sales data of the amount of the corresponding product to the external device (register 4) (step S151 ). In this way, it is possible to perform the sales input operation (sales setting) based on the menu image outside the register 4 and send the sales input operation to the register 4, so that the product registration operation can be performed on the register 4. You can save time and effort. In addition, by making it possible to perform such sales input operations using a general-purpose external device that can take pictures of the menu table M, the register 4 does not need to be equipped with a taking mechanism, and the cost of the register 4 increases. can be suppressed.

Further, the sales data transmitted to the external device (register 4) includes specific information of a certain product. In other words, even if the product name is not accurately registered in the register 4, it is possible to obtain which product has been sold, so the product name etc. can be displayed on the receipt even if it is simple, and the customer's Convenience can be improved. Furthermore, even when the history of sales can be kept in the register 4, it becomes easier to identify and organize which products have been sold, thereby reducing the effort involved in sales management.

In addition, the data of the order reception image O includes an operation button R1 for accepting a premium or discount on the amount of a certain product, and based on the product image data, the amount of premium or discount indicated by the operation button R1 is accepted. If it is determined that the operation button and the operation button R1 have been operated, sales data of the certain product is generated based on the product data of the certain product and the change data. .
In this way, in addition to simply adding products and adding prices, it is also possible to process discounts, premiums, etc., making it possible to perform order operations from the information processing device 1 more flexibly. .

Alternatively, the menu image data includes price change information related to a premium or discount on a certain product (amount of premium/discount, specific information on a certain product, and application conditions for these), and the first image on which the price change information is reflected is Generate order reception image data and second order reception image data in which price fluctuation information is not reflected, and depending on whether the discount indicated by the price fluctuation information or the discount application conditions are satisfied, The order reception image may be displayed on the display screen based on the data of the first order reception image or the data of the second order reception image.
That is, a set amount such as a discount or premium may be displayed in place of the original amount after it is automatically determined whether the applicable conditions are satisfied. This prevents users (store staff) from omitting or inappropriately applying discounts/surcharges, and also eliminates the need for store staff to perform multiple operations, simplifying input operations when ordering. .

Further, the information processing device 1 of this embodiment includes a CPU 11. The CPU 11 acquires product image data (image of menu table M) including a display of specific information that identifies a certain product and a display of the price of the certain product (step S101), and based on the product image data, selects a certain product. The data (order reception image data 122) of the order reception image O having the selection operation buttons B1 to B3 for accepting the order is generated (steps S102 to S112), and the selection operation button B1 is generated based on the product image data. A product list 123 is generated in which a certain product represented by ~B3 is associated with the price of the certain product (step S113). Further, the CPU 11 displays the order reception image O corresponding to the generated order reception image data 122 on the display screen so as to be able to accept operations of the selection operation buttons B1 to B3 (step S141), and It is determined whether or not the selection operation buttons B1 to B3 included in the order reception image O have been operated (step S144), and if it is determined that the selection operation buttons B1 to B3 have been operated, the corresponding operation buttons are Product data of the product is acquired from the product list 123 (step S145).
According to this information processing device 1, by making it possible to perform an input operation to obtain information such as the amount of sold products from photographed data such as a menu table M, there is no need to register each product and amount in the register 4 (in particular, (In cases where there are many changes or turnovers), sales-related processing (accounting processing, etc.) can be easily performed with less effort. In addition, since the order reception image O corresponding to the menu table M is obtained, the information processing device 1 reduces the time and effort required by the store clerk to search for sold products, and allows the store clerk to easily operate the operation buttons corresponding to the products. I can do it.

Furthermore, by installing and executing the program 121 that enables the above-mentioned sales input operation on a computer, accounting processing can be performed more easily.

Further, the information processing system 100 of this embodiment includes the above-described information processing device 1, a communication unit 46 that performs communication, and a register 4 that includes a CPU 41. When sales data is transmitted from the information processing device 1 to the register 4 via the communication unit 16 (step S151), the CPU 41 of the register 4 performs accounting processing including the received sales data.
In this way, in the information processing system 100, all products are not registered in the register 4, but based on the contents easily and simply set on the external information processing device 1 based on the menu table M, etc. Since you can easily enter sales information and send it to the register 4, you can include sales of products (services) that are subject to replacement or price changes and are difficult to manage using identification codes. Accounting processing can be performed more easily than before. Furthermore, since the register 4 is not required to have significantly higher functionality, an increase in cost can be suppressed.

Note that the present invention is not limited to the embodiments described above, and various changes are possible.
For example, in the above embodiment, a menu table of a restaurant is photographed and described as being used to generate data for an order reception image O related to sales operations, but the present invention is not limited to this. Internal documents used by store staff may also be used. Furthermore, the photographic subject is not necessarily limited to one in which a plurality of product names are displayed as a list, such as a menu table. The shooting target may include only one product. Furthermore, when reflecting detailed changes in service content, price changes, etc. not only in restaurants but also in stores that provide other services, a service list or the like may be used to manipulate sales.

Further, in the above embodiment, the final accounting process is performed in the register 4, but the present invention is not limited to this. Accounting processing may be performed only by the information processing device 1. In this case, the information processing device 1 may be connected to a normal printer or the like, and a receipt or the like may be printed and recorded instead of a receipt.

Further, in the above embodiment, the sales operation is performed for each order one by one, but the sales quantity may also be inputtable. That is, in the above embodiment, if there are multiple orders for the same product, it is necessary to repeat the ordering operation for the product multiple times, but instead, the number of orders for the product once ordered is input. The operation may be accepted, and the number of orders may be displayed in parallel with the name of the ordered product. Alternatively, the sales data sent to the register 4 may be used to input the sales quantity in the register 4. Similarly, the register 4 may perform processing such as addition of consumption tax, discount, and premium to the sales details transmitted from the information processing device 1.

Further, in the above embodiment, the specific information is transmitted from the information processing device 1 to the register 4 along with the sales amount, but the specific information does not necessarily have to be transmitted to the register 4. If all that is needed is to calculate the fee, the amount of information may be reduced to further simplify the process.

Further, in the above embodiment, the product name itself is described as a button, but the specific form of the order reception screen may vary as appropriate, such as adding a separate operation button next to the product name. There may be.

Further, in the above embodiment, the communication is performed using Bluetooth, but the present invention is not limited to this. Communication may be performed using a wireless LAN such as WiFi, or may be infrared communication. If it is desired to reduce power consumption related to communication, the communication connection may be disconnected except during processing related to sales.

Furthermore, in the above embodiment, sales data is generated and transmitted to the register 4 when there is an order operation. However, when the sales data is immediately generated and transmitted, Not limited. After input operations for a plurality of orders are confirmed, sales data may be generated collectively and transmitted to the register 4.

Further, the destination of sales data related to an order may not be limited to the register 4. Sales data may be transmitted as order data to an order reception terminal device in a kitchen. That is, the generated and output sales data may be used not only for accounting processing, but also for preparing (cooking) and serving (serving) products. At this time, it may be possible to perform an input operation and display operation to indicate that the ordered product has been provided to the customer, or it may be possible to print out a paper order form separately from the receipt. Good too.
On the other hand, if it is used only for accounting purposes, regardless of product preparation or food and drink provision, sales data for ordered (sold) products is generated all at once at the time of accounting, and the register 4 is used for accounting purposes only. Information on the product and its price may be sent to the customer.

Further, in the above embodiment, the store clerk creates an order screen and actually performs order operations and performs checkout processing, but the present invention is not limited to this. The ordering operation may be made executable by installing an application on the order reception terminal or the user's terminal. In this case, instead of allowing an unspecified terminal to connect to Bluetooth, it may be communicatively connected to the register 4 via WiFi, a 4G line, a 5G line, or the like. In this case, it is necessary to enter information that identifies the customer's location, such as the seat number, when operating each terminal. A setting request is made, such as taking a picture with a camera or the like and having it read.

Furthermore, in the above description, the storage unit 12 made of a nonvolatile memory such as a flash memory is exemplified as a computer-readable medium that stores the program 121 related to external setting control, sales setting control, etc. of the present invention. However, it is not limited to these. As other computer-readable media, other nonvolatile memories such as MRAM, HDDs (Hard Disk Drives), and portable recording media such as CD-ROMs and DVD discs can be used. Further, a carrier wave is also applied to the present invention as a medium for providing data of the program according to the present invention via a communication line.
In addition, the specific configuration, contents and procedures of processing operations, etc. shown in the above embodiments can be changed as appropriate without departing from the spirit of the present invention.

Although several embodiments of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and equivalent ranges thereof.
Below, the invention described in the claims first attached to the application of this application will be added. The claim numbers listed in the supplementary notes are as in the claims originally attached to the request for this application.

[Additional notes]
<Claim 1>
Obtaining product image data including image data of specific information that identifies a certain product and image data of the price of the certain product,
Based on the product image data, generate order reception image data including operation buttons for accepting an order for the certain product;
generating product data that associates the certain product represented by the operation button with the price of the certain product based on the product image data;
displaying the order reception image according to the data of the generated order reception image on a display screen so as to be able to accept operations of the operation buttons;
determining whether or not the operation button included in the order reception image displayed on the display screen has been operated;
If it is determined that the operation button has been operated, the information processing method generates sales data of the certain product based on the product data of the certain product.
<Claim 2>
2. The information processing method according to claim 1, wherein in the order reception image, a portion where the specific information is displayed is the operation button.
<Claim 3>
Extracting a text part in the product image data,
The information processing method according to claim 1 or 2, wherein the specific information and the amount are set from the extracted text portion.
<Claim 4>
The information processing method according to any one of claims 1 to 3, wherein when it is determined that the operation has been performed, the sales data of the certain product is transmitted to an external device by the first communication unit.
<Claim 5>
The information processing method according to any one of claims 1 to 4, wherein the sales data of the certain product includes the specific information of the certain product.
<Claim 6>
The data of the order reception image includes a change button for accepting a price increase or discount for the certain product,
Generating change data that associates the certain product represented by the change button with a price premium or discount for the certain product based on the product image data;
If it is determined that the operation button and the change button have been operated, sales data of the certain product is generated based on the product data and the change data of the certain product. The information processing method described in item (1).
<Claim 7>
The product image data includes price change information regarding a premium or discount for the certain product,
generating data of a first order reception image in which the price fluctuation information is reflected and data of a second order reception image in which the price fluctuation information is not reflected;
The display screen is displayed based on the data of the first order reception image or the data of the second order reception image, depending on whether the discount indicated by the price change information or the discount application condition is satisfied. The information processing method according to any one of claims 1 to 5, further comprising displaying the order reception image.
<Claim 8>
Obtaining product image data including image data of specific information that identifies a certain product and image data of the price of the certain product,
Based on the product image data, generate order reception image data including operation buttons for accepting an order for the certain product;
generating product data that associates the certain product represented by the operation button with the price of the certain product based on the product image data;
displaying the order reception image according to the data of the generated order reception image on a display screen so as to be able to accept operations of the operation buttons;
determining whether or not the operation button included in the order reception image displayed on the display screen has been operated;
An information processing device comprising: a processing unit that generates sales data of the certain product based on the product data of the certain product when it is determined that the operation of the operation button has been performed.
<Claim 9>
computer,
image acquisition means for acquiring product image data including image data of specific information specifying a certain product and image data of the price of the certain product;
image generation means for generating data of an order reception image including operation buttons for accepting an order for the certain product based on the product image data;
list data generation means for generating product data that associates the certain product represented by the operation button with the price of the certain product based on the product image data;
display control means for displaying the order reception image according to the data of the generated order reception image on a display screen so as to be able to accept operations of the operation buttons;
operation determining means for determining whether or not the operation button included in the order reception image displayed on the display screen has been operated;
sales data generation means for generating sales data of the certain product based on the product data of the certain product when it is determined that the operation of the operation button has been performed;
A program that functions as
<Claim 10>
The information processing device according to claim 8;
a cash register comprising a second communication unit that communicates with the information processing device and a control unit;
An information processing system comprising:
The processing unit of the information processing device includes:
If it is determined that the operation has been performed, causing the first communication unit to transmit the sales data of the certain product to the cash register;
The control unit of the cash register includes:
An information processing system that performs accounting processing including the sales data received via the second communication unit.

1 Information processing device 11 CPU
12 Storage section 121 Program 122 Order reception image data 123 Product list 13 Display section 14 Operation reception section 15 Photography section 16 Communication section 4 Register 41 CPU
42 Storage section 421 Program 422 Input setting 43 Display section 44 Operation reception section 46 Communication section 47 Print section 48 Paper transport section 100 Information processing system B1 to B3 Selection operation buttons B4, B5 Operation button C Confirm button E Selection end button M Menu table O Order reception image T Subtotal button

Claims (10)

Obtaining product image data including image data of specific information that identifies a certain product and image data of the price of the certain product,
Based on the product image data, generate order reception image data including operation buttons for accepting an order for the certain product;
generating product data that associates the certain product represented by the operation button with the price of the certain product based on the product image data;
displaying the order reception image according to the data of the generated order reception image on a display screen so as to be able to accept operations of the operation buttons;
determining whether or not the operation button included in the order reception image displayed on the display screen has been operated;
If it is determined that the operation button has been operated, the information processing method generates sales data of the certain product based on the product data of the certain product. 2. The information processing method according to claim 1, wherein in the order reception image, a portion where the specific information is displayed is the operation button. Extracting a text part in the product image data,
The information processing method according to claim 1 or 2, wherein the specific information and the amount are set from the extracted text portion. The information processing method according to any one of claims 1 to 3, wherein when it is determined that the operation has been performed, the sales data of the certain product is transmitted to an external device by the first communication unit. The information processing method according to any one of claims 1 to 4, wherein the sales data of the certain product includes the specific information of the certain product. The data of the order reception image includes a change button for accepting a price increase or discount for the certain product,
Generating change data that associates the certain product represented by the change button with a price premium or discount for the certain product based on the product image data;
If it is determined that the operation button and the change button have been operated, sales data of the certain product is generated based on the product data and the change data of the certain product. The information processing method described in item (1). The product image data includes price change information regarding a premium or discount for the certain product,
generating data of a first order reception image in which the price fluctuation information is reflected and data of a second order reception image in which the price fluctuation information is not reflected;
The display screen is displayed based on the data of the first order reception image or the data of the second order reception image, depending on whether the discount indicated by the price change information or the discount application condition is satisfied. The information processing method according to any one of claims 1 to 5, further comprising displaying the order reception image. Obtaining product image data including image data of specific information that identifies a certain product and image data of the price of the certain product,
Based on the product image data, generate order reception image data including operation buttons for accepting an order for the certain product;
generating product data that associates the certain product represented by the operation button with the price of the certain product based on the product image data;
displaying the order reception image according to the data of the generated order reception image on a display screen so as to be able to accept operations of the operation buttons;
determining whether or not the operation button included in the order reception image displayed on the display screen has been operated;
An information processing device comprising: a processing unit that generates sales data of the certain product based on the product data of the certain product when it is determined that the operation of the operation button has been performed. computer,
image acquisition means for acquiring product image data including image data of specific information specifying a certain product and image data of the price of the certain product;
image generation means for generating data of an order reception image including operation buttons for accepting an order for the certain product based on the product image data;
list data generation means for generating product data that associates the certain product represented by the operation button with the price of the certain product based on the product image data;
display control means for displaying the order reception image according to the data of the generated order reception image on a display screen so as to be able to accept operations of the operation buttons;
operation determining means for determining whether or not the operation button included in the order reception image displayed on the display screen has been operated;
sales data generation means for generating sales data of the certain product based on the product data of the certain product when it is determined that the operation of the operation button has been performed;
A program that functions as The information processing device according to claim 8;
a cash register comprising a second communication unit that communicates with the information processing device and a control unit;
An information processing system comprising:
The processing unit of the information processing device includes:
If it is determined that the operation has been performed, causing the first communication unit to transmit the sales data of the certain product to the cash register;
The control unit of the cash register includes:
An information processing system that performs accounting processing including the sales data received via the second communication unit.

Images