JP2016095560A - Electronic apparatus, order entry system, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic apparatus for easily generating a table layout in a store, and to provide an order entry system and a program.SOLUTION: An electronic apparatus includes: a recognition part 114 which recognizes a table in a store from a floor image based on the floor image photographing a floor of the store and a table image photographing a same table as the table in the store; and a generation part 115 which generates layout data of the table in the store based on a position of the table, recognized by the recognition part, in the floor image.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an electronic device, an order entry system, and a program.

  In stores such as restaurants and taverns, an order entry system is used in which a store clerk who receives an order at a guest seat manages the order data by inputting the table number of the seat or the ordered item into the terminal. For example, a table layout in a store is displayed on a terminal possessed by a store clerk, and the store clerk selects a table to receive an order on the display screen of the table layout and inputs an order from a customer. . As a result, the table number of the selected table and the order data such as the input order are generated at the terminal, and transmitted to the controller installed in the store by wireless communication. The controller that has received the order data generates slip data, transmits the generated slip data to the printer through wireless communication, and prints it as a slip.

  By the way, table layouts in stores such as restaurants and pubs differ from store to store. Therefore, when an order entry system is introduced into a store, it is necessary to create a table layout from scratch for each store. In addition, when the table layout is changed due to time, season, store renovation, etc., it is necessary to recreate the table layout each time. As described above, in the order entry system, there is a problem that the work load due to the creation of the table layout is large and the cost of the store becomes high. As a method for reducing this work load, Patent Document 1 discloses a layout creation support method capable of creating a table layout by selecting and operating a table to be placed and a place to be placed on a display screen. Yes.

JP 2006-31472 A

  However, in the technique described in Patent Document 1, a layout must be manually created after all, and for example, the workload increases as the number of tables to be arranged increases.

  SUMMARY An advantage of some aspects of the invention is that it provides an electronic device, an order entry system, and a program capable of easily generating a table layout in a store.

  One aspect of the present invention is a table in the store from the floor image based on a floor image in which the floor in the store is photographed and a table image in which the same table as the table in the store is photographed. And a generating unit that generates layout data of a table in the store based on a position in the floor image of the table recognized by the recognizing unit. Equipment.

  Further, according to one aspect of the present invention, in the electronic device, when the generation unit includes a plurality of tables recognized by the recognition unit, a table number is assigned to each of the plurality of tables in a predetermined order. The layout data is generated.

  Further, according to one aspect of the present invention, in the electronic device, each of the plurality of tables in the store includes table identification information that can identify each table, and the recognition unit includes the floor The table recognizes the table in the store and the table identification information from the image, and the generation unit associates the table identification information of each table with each of the tables recognized by the recognition unit. Generating data.

  Further, according to one aspect of the present invention, in the electronic device, when the number of tables recognized by the recognition unit is less than the number of tables in the store, the layout data generated by the generation unit A data input processing unit that causes a display unit to display an input screen capable of adding an insufficient table layout, and the generation unit adds a table layout input from the input screen to the layout data. It is characterized by.

  In one aspect of the present invention, the electronic apparatus includes a data input processing unit that causes a display unit to display an input screen capable of deleting a table layout from the layout data generated by the generation unit, The generation unit deletes the layout of the table input from the input screen from the layout data.

  In one embodiment of the present invention, the electronic device displays a layout screen related to a floor in the store based on the layout data generated by the generation unit, and selects a table in the layout screen. An order receiving unit for executing an input process of order information associated with the selected table received by the input unit, a display unit for displaying input, an input unit for receiving an operation input for selecting a table on the layout screen And a processing unit.

  One embodiment of the present invention is based on a floor image obtained by photographing a floor in a store and a table image obtained by photographing the same table as the table in the store. A recognition unit that recognizes a table, a generation unit that generates layout data of a table in the store, based on the position of the table recognized by the recognition unit in the floor image, and the generation unit A display unit that displays a layout screen related to the floor in the store based on the layout data.

  Further, according to one aspect of the present invention, based on a floor image obtained by photographing a floor in a store and a table image obtained by photographing the same table as the table in the store, A program for executing a step of recognizing a table in a store and a step of generating layout data of the table in the store based on a position of the recognized table in the floor image. .

  According to the present invention, a table layout in a store can be easily generated.

It is a figure which shows an example of a structure of the order entry system by 1st Embodiment. It is a block diagram which shows an example of schematic structure of the terminal by 1st Embodiment. It is a figure which shows the imaging example of the floor image by 1st Embodiment. It is a figure which shows an example of the floor image image | photographed with the terminal by 1st Embodiment. It is a figure explaining an example of correction | amendment of the floor image by 1st Embodiment. An example of the floor image after correction by a 1st embodiment is shown. 3 shows a display example of a table layout according to the first embodiment. It is a figure which shows another example of a display of the table layout by 1st Embodiment. It is a flowchart which shows an example of the table layout production | generation process by 1st Embodiment. It is a figure which shows the imaging example of the floor image by 2nd Embodiment. It is a flowchart which shows an example of the table layout production | generation process by 2nd Embodiment. It is a figure which shows an example of the table in which the table number was described in 3rd Embodiment. It is a flowchart which shows an example of the table layout production | generation process by 3rd Embodiment. It is a flowchart which shows an example of the table layout production | generation process by 4th Embodiment. It is a figure which shows an example of the table addition input screen by 4th Embodiment.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[First embodiment]
A first embodiment of the present invention will be described.

  FIG. 1 is a diagram showing an example of the configuration of an order entry system 1 according to the first embodiment of the present invention. In FIG. 1, the order entry system 1 includes a plurality of terminals 10-n (n is a positive integer. Terminal 10-1, terminal 10-2,..., Terminal 10-n) and an access point (AP: Access Point). ) 20, a controller (CNT: Controller) 30, and a printer (PR: Printer) 40. The order entry system 1 is a management system that manages orders received from customers at stores (restaurants, taverns, etc.). The controller 30 receives the order data transmitted from the plurality of terminals 10 -n by wireless communication via the access point 20. The controller 30 generates slip data based on the received order data, transmits the generated slip data to the printer 40 by wireless communication, and prints it as a slip. Here, since the plurality of terminals 10-n have the same configuration, the description of “−1”, “−2”, etc. is omitted as the terminal 10 unless otherwise distinguished.

  The terminal 10 is an electronic device that is carried by a store clerk. For example, the terminal 10 may be one in which a general-purpose electronic device such as a smartphone or a tablet computer is applied as a terminal in the order entry system 1, or a dedicated terminal (for example, in the order entry system 1) It may be a handheld terminal (HT). Here, the terminal 10 is demonstrated as a smart phone.

  For example, the terminal 10 displays a table layout in the store, a menu provided at the store, and the like on the display unit 102 included in the terminal 10. When a table for receiving an order is selected by an operation of a store clerk on the display screen and an order received from a customer is input, the terminal 10 stores order data including data such as the table number of the selected table and the input order. And the generated order data is transmitted to the controller 30 by wireless communication.

  The access point 20 is a repeater for connecting the terminal 10 and the printer 40 to the controller 30 by wireless communication. The controller 30 is connected to the access point 20 via the network cable 50 and is connected to the terminal 10 and the printer 40 via the access point 20 by wireless communication.

  The controller 30 is a control device that controls the order data received from the terminal 10 and issues a slip based on the order data in the order entry system 1. For example, the controller 30 stores and manages the order data received from the terminal 10, generates slip data based on the order data, and transmits the generated slip data to the printer 40 by wireless communication. In this embodiment, the configuration in which the controller 30 transmits to the printer 40 by wireless communication is taken as an example. However, the controller 30 may transmit to the printer 40 by wired communication.

  In addition, the controller 30 manages layout data indicating a table layout in the store (hereinafter referred to as “table layout master”) and menus provided by the store. The controller 30 transmits these table layout masters and menus to the terminal 10 as necessary. Thereby, each of the plurality of terminals 10 can receive orders from customers using the same table layout and menu.

  Upon receiving the slip data, the printer 40 prints a slip (cooking slip or guest slip) according to the slip type set in the printer output setting information. The cooking voucher is a voucher for notifying a kitchen worker of the ordered menu. The guest voucher is a voucher on which an ordered menu and a payment amount are printed and used for settlement at the time of accounting.

(Configuration of terminal 10)
FIG. 2 is a block diagram illustrating an example of a schematic configuration of the terminal 10 according to the present embodiment. The terminal 10 includes a wireless communication unit 101, a display unit 102, an input unit 103, a camera unit 104, a storage unit 105, a sensor unit 106, and a control unit 110.

The wireless communication unit 101 connects to the access point 20 by wireless communication.
The display unit 102 and the input unit 103 are, for example, thin and substantially rectangular members, and are configured as a touch panel in which both are overlapped and integrated.

  The display unit 102 includes a liquid crystal display, an organic EL (Electro-Luminescence) display, and the like, and displays a table layout, menus, ordered items, quantities, amounts, and the like.

  In addition, the display unit 102 has provided a dish based on the data managed by the controller 30 in the table layout display (whether it is vacant, whether it has been ordered if it is not vacant, whether it has been ordered) Or not, whether or not it has been accounted, etc.) is also displayed in an identifiable manner. As a method for displaying the table status in an identifiable manner, the display color of the table displayed in the table layout may be changed according to the table status, or it corresponds to the table displayed in the table layout. In addition, characters, symbols or pictures indicating the state of the table may be displayed.

  The input unit 103 detects a contact on the display screen of the display unit 102 and receives an operation input from a store clerk. For example, the input unit 103 receives inputs such as an operation for selecting a table and an operation for inputting an order. Further, the input unit 103 outputs input information based on the received operation input to the control unit 110.

  The camera unit 104 includes a lens and an image sensor (such as a CMOS image sensor), outputs a captured image, and stores it in the storage unit 105. For example, the camera unit 104 is provided on the surface opposite to the surface on which the display unit 102 of the terminal 10 is provided.

  The storage unit 105 is configured using a recording medium such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash ROM, or a combination thereof. For example, the storage unit 105 stores a program for controlling the operation of each unit included in the terminal 10 and various information, a table layout master in the order entry system 1, menu data, order data, captured image data, and the like. The sensor unit 106 includes an acceleration sensor and the like, detects the posture and movement of the terminal 10, and outputs the detection result to the control unit 110.

  The control unit 110 controls the operation of each unit included in the terminal 10. In addition, the control unit 110 includes an order reception processing unit 111 and a table layout generation processing unit 112.

  The order reception processing unit 111 performs processing on the terminal side of order management in the order entry system 1. For example, the order reception processing unit 111 acquires a table layout master from the controller 30 and causes the display unit 102 to display a table layout based on the acquired table layout master. In addition, the table layout generation processing unit 112 acquires a menu provided by the store from the controller 30 and causes the display unit 102 to display a menu selection screen on which an order received from a customer can be input.

  When a table for receiving an order is selected by an operation of a store clerk on the display screen and an order received from a customer is input, the order reception processing unit 111 includes the table number of the selected table and the input order. Order data is generated, and the generated order data is transmitted to the controller 30 via the wireless communication unit 101.

  The table layout generation processing unit 112 generates a table layout master that is registered as a table layout master managed by the controller 30. For example, the table layout generation processing unit 112 includes a data input processing unit 113, a recognition unit 114, and a generation unit 115.

  The data input processing unit 113 displays a data input screen on the display unit 102 as necessary, and receives input information input by the operation from the input unit 103. For example, the data input processing unit 113 causes the display unit 102 to display an input screen for accepting input of the total number of tables to be generated when generating the table layout master, and input information on the total number of tables input by the operation. Is received from the input unit 103.

  The recognition unit 114 recognizes a table in the store from the floor image based on the floor image in which the floor in the store is photographed and the table image in which the same table as the table in the store is photographed. Here, the floor is a place targeted for a table layout in which a table on which a customer is seated is arranged. For example, the floor image is a captured image captured by the camera unit 104 of the terminal 10. The floor image is not limited to a captured image captured by the terminal 10 itself, but may be a captured image captured by another terminal 10 or a camera.

  FIG. 3 is a diagram illustrating an example of capturing a floor image according to the present embodiment. This figure shows the store floor viewed from the ceiling, and 10 tables are arranged on the floor. For example, the angle of view is determined by the camera unit 104 of the terminal 10 from any wall side of the floor (in this case, from the lower wall side in the figure) so that all of these ten tables fit in one photographed image. A floor image is taken at α.

  FIG. 4 is a diagram illustrating an example of a floor image taken by the terminal 10 according to the present embodiment. As shown in this figure, the floor image taken by the camera unit 104 is different from the floor shape (for example, a rectangle) seen from the ceiling side, because projection distortion occurs because the floor is taken from the wall side. Photographed in a shape (for example, trapezoid). The floor shape (for example, a rectangle) viewed from the ceiling side refers to the actual shape of the floor viewed from the ceiling side (the actual floor shape is not a simple rectangle) within the range where the table is placed. It is normalized based on this and corresponds to the target range of the table layout. Accordingly, the recognition unit 114 performs distortion correction processing on the floor image captured by the camera unit 104.

  For example, as shown in FIG. 3, the marker 5a, the marker 5b, the marker 5c, and the marker 5d are arranged at positions corresponding to the floor shape (here, the four rectangular positions). As illustrated in FIG. 4, the recognition unit 114 detects a floor shape (for example, a trapezoid) in which projective distortion has occurred by using a floor image that is captured so that these markers are included. In the example shown in this figure, trapezoids having points a1, b1, c1, and d1 corresponding to the markers 5a, 5b, 5c, and 5d, respectively, are projected floor distortions. Detected as a shape.

  Then, the recognizing unit 114 corrects the floor image so that the detected floor shape (for example, trapezoid) in which the projection distortion has occurred approaches the floor shape (for example, rectangular shape) viewed from the ceiling side. The correction processing may be processing using affine transformation, processing using linear transformation (enlargement / reduction, shearing, rotation, movement, etc.), or processing combining them.

FIG. 5 is a diagram illustrating an example of correction of the floor image according to the present embodiment.
In the floor image, the recognition unit 114 converts the trapezoid having points a1, b1, c1, and d1 as vertices into a rectangle having points a2, b2, c1, and d1 as vertices. To correct distortion. In addition, the recognition unit 114 expands the rectangles having the points a2, b2, c1, and d1 as vertices after distortion correction into rectangles having the points a3, b3, c3, and d3 as vertices. Make corrections. This enlargement correction is a process for making the range surrounded by the marker 5a, the marker 5b, the marker 5c, and the marker 5d equal to or greater than a predetermined ratio (for example, 80%) of the floor image. Thereby, it can suppress that a recognition rate falls because the table image | photographed on the floor image is too small.

  Here, when the length of the line segment connecting the point c1 and the point d1 is e1, and the length of the line segment connecting the point c3 and the point d3 is e3, the magnification after correction with respect to the correction is “e3 / e1”. " Further, when the length of the line segment connecting the points b1 and d1 is h1, and the angle between the line segment connecting the points b1 and d1 and the line segment connecting the points b1 and b2 is θ, the corrected rectangle The length h3 of the line segment connecting the points b3 and d3 is “h3 = h1 × sin θ × (e3 / e1)”. That is, the correction angle at the time of distortion correction can also be expressed as “sin θ = (h3 / h1) × (e1 / e3)”.

  FIG. 6 shows an example of the corrected floor image according to the present embodiment. In the corrected floor image, the shape is corrected to the floor shape (for example, a rectangle) viewed from the ceiling side, and the range in which the table is arranged is corrected to be equal to or greater than a predetermined ratio (for example, 80%) of the floor image. Has been.

  On the other hand, the table image is an image serving as a base for recognizing the table from the floor image. For example, a plurality of photographed images obtained by photographing one table from a plurality of angles are used as table images. This one table is a table in the store or the same table as that table. The table image may be a photographed image photographed by the terminal 10 itself or a photographed image photographed by another terminal 10 or a camera, like the floor image.

  Further, when there is one type of table, a table image for one table may be used, but when there are a plurality of types of tables, a table image for each type is required. In addition, a table photographed on the floor image may be photographed so as to overlap an adjacent table or a pillar in the floor. Therefore, the table image may include a captured image of a part of the table (for example, the upper surface portion of the table deck, the right half of the table, the left half of the table, etc.).

  Further, the recognition unit 114 generates identification sample data used for recognizing the table from the floor image based on the above-described table image.

  Then, the recognition unit 114 recognizes the table from the corrected floor image by comparing the corrected floor image with the identification sample data (table image). Specifically, the recognition unit 114 outputs position data recognized as a table in the corrected floor image using the identification sample data.

  For example, in the corrected floor image shown in FIG. 6, the horizontal axis (for example, the axis parallel to the straight line connecting the points a3 and b3) is taken as the X axis, and the vertical axis (for example, the points a3 and c3). (Axis parallel to the straight line connecting the two) is defined as the Y axis. The recognition unit 114 outputs position data recognized as a table in the corrected floor image as XY coordinate data in the XY coordinate system.

  Returning to FIG. 2, the generation unit 115 generates a table layout master of the table in the store based on the position data (XY coordinate data) in the floor image of the table recognized by the recognition unit 114. Here, the table layout master includes information necessary for display of the table layout such as, for example, floor shape data in the store, table position data (XY coordinate data), table shape data, and a table number to be described later. It is. The table layout master may include a table layout display image based on these pieces of information.

  The generation unit 115 transmits the generated table layout master to the controller 30 via the wireless communication unit 101. When receiving the table layout master from the terminal 10, the controller 30 updates the managed table layout master to the received table layout master. Thereby, each of the plurality of terminals 10 can receive the updated table layout master from the controller 30 and display the updated table layout.

  FIG. 7 shows a display example of a table layout based on the table layout master generated by the generation unit 115. FIG. 7 shows a display example of the table layout of the table recognized from the floor image shot in the shooting example shown in FIG. On the display screen G10, a table layout (L10) corresponding to the position of the table arranged on the floor shown in FIG. 3 is displayed.

  In addition, when there are a plurality of tables recognized by the recognition unit 114, the generation unit 115 generates a table layout master by assigning a table number to each of the plurality of tables in a predetermined order. FIG. 7 shows an example in which table numbers (1 to 10) are assigned to the 10 tables in the order from the upper left to the lower right. Thus, by assigning a table number, a table for receiving an order can be specified by the table number when selecting from the table layout. The order of the table numbers is not limited to the order from the upper left to the lower right, and can be arbitrarily set.

  FIG. 8 is a diagram illustrating another display example of the table layout. FIG. 7 shows a display example when the terminal 10 is held horizontally, whereas FIG. 8 shows a display example when the terminal 10 is held vertically. Here, the horizontal holding means a holding method in which the longitudinal direction of the display unit 102 is horizontal and the short side direction is vertical, and the vertical holding means that the short side direction of the display unit 102 is horizontal and the long side direction is vertical. How to hold.

  In the display example of FIG. 8, the table layout L10 is displayed in a smaller size than the display example of FIG. 4 so that the entire table layout L10 fits within the display screen G10. Even in the case of vertical holding, the table layout L10 may be displayed without being reduced. In this case, a part of the table layout L10 may be displayed, and the part of the table layout L10 that is not displayed may be scroll-displayed in response to a scroll operation on the display screen. The table layout L10 may be arbitrarily enlarged or reduced in accordance with an operation on the display screen. Further, when displayed on a display device other than the terminal 10, the display screen is arbitrarily enlarged or reduced according to the display screen specification (number of pixels or screen size) of the display device.

(Operation of table layout generation process)
Next, with reference to FIG. 9, the operation of the table layout generation process in which the terminal 10 according to the present embodiment generates a table layout will be described. FIG. 9 is a flowchart illustrating an example of the table layout generation process according to the present embodiment. Here, a case where the table image and the floor image are captured images captured by the camera unit 104 of the terminal 10 itself will be described as an example.

  First, the data input processing unit 113 causes the display unit 102 to display an input screen for inputting the total number of tables to be subjected to table layout. When the total number of tables (for example, the total number S = 10) is input to the input screen, the data input processing unit 113 receives the input information from the input unit 103 and outputs it to the recognition unit 114 (step S102). .

  Next, the recognition unit 114 captures a table image (step S104). For example, the recognition unit 114 reads out a table image previously captured by the camera unit 104 from the storage unit 105. At this time, a table image may be taken by the camera unit 104. And the recognition part 114 produces | generates the sample data for identification used in order to recognize a table from a floor image based on a table image (step S106).

  Further, the recognition unit 114 captures a floor image (step S108). The recognizing unit 114 reads the floor image previously captured by the camera unit 104 from the storage unit 105. At this time, a floor image may be taken by the camera unit 104 (see FIG. 3).

  Next, the recognition unit 114 performs correction processing on the captured floor image (step S110). Specifically, the recognition unit 114 performs distortion correction processing and enlargement correction processing on the floor image (see FIGS. 4 to 6).

  Subsequently, the recognition unit 114 recognizes the table from the corrected floor image by comparing the corrected floor image with the identification sample data (table image), and generates XY coordinate data of the recognized table. (Step S112).

  The generation unit 115 outputs coordinate data for the number of tables recognized from the floor image to the table layout master. Specifically, first, the generation unit 115 substitutes the number N of tables recognized from the floor image by the recognition unit 114 into a variable M (step S114). Next, the recognition unit 114 determines whether or not the variable M is greater than 0 (step S116). When it is determined that the variable M is greater than 0 (step S116: YES), the generation unit 115 outputs the coordinate data of one table to the table layout master (step S118), and subtracts 1 from the variable M ( M = M-1) (step S120), and the process returns to step S116.

  On the other hand, when it is determined that the variable M is 0 or less (that is, M = 0) (step S116: YES), the generation unit 115 determines that the recognized table number N is the total number of tables input in step S102. It is determined whether or not it matches S (step S122). In step S116, it is determined that the variable M is 0 or less (that is, M = 0) when coordinate data for the number of recognized tables is output to the table layout master, or a floor image. The table is not recognized from (i.e., N = 0).

  When it is determined that the recognized number of tables N does not match the total number S of input tables (step S122: NO), the generation unit 115 performs processing in step S108 in order to redo the shooting of the floor image. return. And the process of step S108-S122 is performed using the newly image | photographed floor image.

  On the other hand, when it is determined that the recognized number of tables N matches the total number S of input tables (step S122: YES), since all the tables on the floor are recognized, the generating unit 115 recognizes the recognized tables. Is given a table number. For example, the generation unit 115 sorts the recognized table (the table output to the table layout master) based on the XY coordinates (step S124), and sets the table numbers in a predetermined order (for example, the order from the upper left to the lower right). And output to the table layout master (step S126).

  Then, the generation unit 115 transmits the generated table layout master to the controller 30. Thereby, the table layout master generated using the terminal 10 is taken into the order entry system 1 and can be used (step S128).

  The order reception processing unit 111 of the terminal 10 displays the table layout on the display unit 102 by receiving the table layout master from the controller 30 (see step S130, FIGS. 7 and 8).

  The store clerk can grasp the state of the table (for example, an empty state) by referring to the table layout displayed on the display unit 102. Further, the store clerk can select a table from the table layout displayed on the display unit 102 and input an order received from a customer. When the order is received, the order reception processing unit 111 of the terminal 10 generates order data including the table number and the input order, and transmits the generated order data to the controller 30 (step S132).

  As described above, the terminal 10 (an example of an electronic device) includes the recognition unit 114 and the generation unit 115. The recognizing unit 114 recognizes the table in the store from the floor image based on the floor image in which the floor in the store is photographed and the table image in which the same table as the table in the store is photographed. The generation unit 115 generates a table layout master of the table in the store based on the position in the floor image of the table recognized by the recognition unit 114.

  As described above, since the terminal 10 according to the present embodiment recognizes a table from a floor image and generates a table layout master, it is not necessary to manually create a layout, and an in-store table layout can be easily generated. Can do. Therefore, in the order entry system 1 according to the present embodiment, the table layout in the store can be easily generated, and the table layout can be displayed on each terminal 10 when receiving an order from the customer.

  Further, in the present embodiment, since the table layout can be generated by correcting the projection distortion of the floor image, it is not necessary to install the floor image in a specific place such as a ceiling. Therefore, for example, since a floor image may be taken with the terminal 10 held by the store clerk, the table layout in the store can be easily generated.

[Second Embodiment]
Next, a second embodiment of the present invention will be described.
Since the configuration of the order entry system 1 of the present embodiment is the same as that of the first embodiment, characteristic processing in the present embodiment will be described. In the first embodiment, an example has been described in which all the tables that are targets of the table layout are photographed so as to fit on one floor image. However, depending on the size of the floor, the number and arrangement of the tables, the shooting angle of view of the camera, etc., not all of the tables can be accommodated in one floor image. Therefore, in the present embodiment, an example will be described in which one floor is photographed by dividing it into a plurality of sheets.

  FIG. 10 is a diagram illustrating an example of capturing a floor image according to the present embodiment. The example shown in this figure is different from the example shown in FIG. 3 in that ten tables arranged on the floor are photographed separately in two photographed images. In this example, two floor images of an angle of view α1 and an angle of view α2 are taken by the camera unit 104 of the terminal 10. Here, the angle of view α1 and the angle of view α2 are angles of view in which all 10 tables can be accommodated when the angle of view of both is added, and the angle of view α1 and the angle of view α2 partially overlap. I am doing so. The recognizing unit 114 combines the two floor images of the angle of view α1 and the angle of view α2 into one floor image by utilizing the fact that the overlapping portion is an image of the same subject, and then the table of the table. Authenticate. Since the combined floor image is the same as the floor image shown in FIG. 4, the correction process and the recognition process can be performed in the same manner as in the first embodiment.

  FIG. 11 is a flowchart illustrating an example of a table layout generation process according to the present embodiment. Each of the processes of steps S202 to S208 and steps S210 to S232 in FIG. 11 corresponds to each of the processes of steps S102 to S108 and steps S110 to S132 in FIG.

  In the present embodiment, the recognition unit 114 captures two floor images in step S208. The recognition unit 114 combines the two floor images to generate one floor image (step S209), and then performs distortion correction processing and enlargement correction processing on the combined floor images (step S209). S210). The subsequent processing is the same as that of the first embodiment described with reference to FIG.

  As described above, the terminal 10 according to the present embodiment can generate a table layout master from a floor image obtained by shooting one floor divided into a plurality of sheets. Therefore, according to the present embodiment, even if the entire table does not fit on a single floor image due to the size of the floor, the number and arrangement of the tables, or the shooting angle of view of the camera, A table layout in a store can be easily created by shooting in multiple sheets. That is, a table layout can be easily generated even in stores of various scales or stores of floors having complicated shapes.

  In the present embodiment, the example in which the table layout master is generated from the floor image obtained by dividing one floor into two images has been described. However, the terminal 10 performs the table layout from the floor image acquired by dividing the floor into three images. A master may be generated. Even if there are three or more images, the table layout master can be generated by combining the images into one floor image by sequentially capturing images while shifting the angle of view so that a part of the angle of view to be captured overlaps. .

  In addition, as a method of combining a plurality of floor images into one floor image, a method of sequentially capturing images while shifting the angle of view so that a part of the angle of view to be captured has been described, in this case, the terminal 10 The image at the end (right end or left end) of the previous image taken may be displayed in a semi-transparent manner on the display screen for checking the angle of view when the camera unit 104 is used for shooting. By displaying the guide in this way, the next shooting can be easily performed so that the previous shooting angle of view partially overlaps. When shooting a floor image, a shooting mode (so-called panorama mode) for shooting a single panorama image from images continuously shot while shifting the shooting angle of view to the right or left substantially horizontally may be used. .

[Third embodiment]
Next, a third embodiment of the present invention will be described.
Since the configuration of the order entry system 1 of the present embodiment is the same as that of the first embodiment, characteristic processing in the present embodiment will be described.

  In the first embodiment, an example in which a table layout master is generated by assigning table numbers to a recognized table in a predetermined order has been described. In the present embodiment, an example will be described in which when a table number is written in each table in a store, the table number is automatically recognized to generate a table layout master.

  FIG. 12 is a diagram illustrating an example of a table in which table numbers are written. Thus, for example, the table numbers (1, 2,..., 5, 6,...) Of the respective tables are written on the side surfaces of the tables. The recognition unit 114 recognizes the table from the floor image using the sample data for identifying the table number, and also recognizes the table number of the table.

  Here, the sample data for identifying the table number may be generated based on a photographed image obtained by actually capturing the table number recorded in the table, or using the identification sample data for identifying the number. Also good.

  The generation unit 115 generates a table layout master by associating the table recognized by the recognition unit 114 with the table number of the table.

  FIG. 13 is a flowchart illustrating an example of the table layout generation process according to the present embodiment. The processes in steps S302 to S316, steps S318 to S322, and steps S328 to S332 in FIG. 13 correspond to the processes in steps S102 to S116, steps S118 to S122, and steps S128 to S132 in FIG. The description will be omitted as appropriate.

  In the present embodiment, the terminal 10 recognizes the table number and outputs it in association with the coordinate data when outputting the coordinate data of the table to the table layout master. Specifically, the generation unit 115 assigns the number of tables N recognized from the floor image by the recognition unit 114 to the variable M (step S314), and determines whether the variable M is greater than 0 (step S316). . When it is determined that the variable M is greater than 0 (step S316: YES), the generation unit 115 instructs the recognition unit 114 to perform a table number recognition process. In response to this instruction, the recognition unit 114 recognizes the table number of the recognized table from the floor image, and outputs the recognized table number to the generation unit 115 (step S317).

  The generation unit 115 associates the coordinate data of one table recognized by the recognition unit 114 with the table number of the table and outputs the table data to the table layout master (step S318), and subtracts 1 from the variable M (M = M-1) (step S320), and the process returns to step S316.

  Then, the generation unit 115 determines that the variable M is 0 or less (that is, M = 0) when the coordinate data and the table numbers corresponding to the number of recognized tables are output to the table layout master (step S316). : YES), it is determined whether or not the number N of recognized tables matches the total number S of tables (step S322).

  When it is determined that the recognized number of tables N matches the total number S of tables input in step S <b> 302 (step S <b> 322: YES), the generation unit 115 transmits the generated table layout master to the controller 30. Thereby, the table layout master generated using the terminal 10 is taken into the order entry system 1 and can be used (step S328).

  As described above, in this embodiment, when a table number that can identify each table is written in each of the plurality of tables in the store, the recognition unit 114 determines the table and table in the store. Recognize numbers. Then, the generation unit 115 generates a table layout master by associating each table recognized by the recognition unit 114 with the table number of each table. Thereby, the terminal 10 according to the present embodiment can automatically recognize the table number of each table and assign it to the table layout. Therefore, according to the present embodiment, the table layout in the store can be easily generated.

[Fourth Embodiment]
Next, a fourth embodiment of the present invention will be described.
Since the configuration of the order entry system 1 of the present embodiment is the same as that of the first embodiment, characteristic processing in the present embodiment will be described. In the first embodiment, an example has been described in which the floor image is captured again when the number of recognized tables does not match the total number of tables. In the present embodiment, an example will be described in which a shortage of tables can be added manually when the number of recognized tables does not match the total number of tables.

  FIG. 14 is a flowchart illustrating an example of a table layout generation process according to the present embodiment. Each of the processes in steps S402 to S432 in FIG. 14 corresponds to each of the processes in steps S102 to S132 in FIG. 9, and description thereof will be omitted as appropriate. In the present embodiment, the process when a negative (NO) determination is made in step S422 is different from the process when a negative determination is made in step S122 of FIG.

  When it is determined that the recognized table number N does not match the total number S of input tables (step S422: NO), the generation unit 115 has a shortage of the recognized table number N relative to the total number S of tables. Notify you. As a result, the data input processing unit 113 causes the display unit 102 to display a table addition input screen in which a shortage of tables relative to the total number S of tables can be input (step S452).

  When an operation for adding a table is performed on the table addition input screen, the data input processing unit 113 receives coordinate data of the additionally input table from the input unit 103 and outputs it to the generation unit 115 (step S454). The generation unit 115 outputs the coordinate data of the added table to the table layout master (step S456), and adds 1 to the recognized number of tables N (N = N + 1) (step S458).

  Then, the generation unit 115 returns the process to step S422, and determines whether or not the number N of tables added with 1 matches the total number S of input tables. The generation unit 115 notifies the data input processing unit 113 that the total number S of tables is insufficient until it matches the total number S of tables, and if they match (step S422: YES), the table number And the table layout master is transmitted to the controller 30 (steps S424 to S428).

  FIG. 15 is a diagram illustrating an example of a table addition input screen according to the present embodiment. In the table addition input screen G20 shown in this figure, information K1 ("add table") indicating that it is a table addition input screen, a table layout L20, and an additional table K22 are displayed.

  The table layout L20 displays the recognized table layout. Here, a case is shown in which eight tables out of the ten tables on the floor shown in FIG. 3 are recognized by the recognition unit 114 and two tables are not recognized.

  Further, tables that can be added to the table layout L20 are displayed in the additional table K22. Here, an example in which there is one type of table is shown, and a table K23 is displayed as a table that can be added. When there are a plurality of types of tables, tables that can be added for each type are displayed.

  On this table addition input screen, the user wants to add by sliding the finger to the position to be added in the table layout L20 (for example, sliding along the arrow indicated by the symbol F1) while pressing the part of the table K23 with the finger. You can add a table to the location.

  As described above, when the number of tables recognized by the recognition unit 114 is less than the total number of tables in the store (in the floor), the data input processing unit 113 generates the table layout generated by the generation unit 115. The display unit 102 is caused to display a table addition input screen that allows the master to add an insufficient table layout to the master. Then, the generation unit 115 adds the table layout input from the table addition input screen to the table layout master.

  As a result, if there is a table that is difficult to recognize (or cannot be recognized) from the floor image depending on the number of tables and the arrangement state, the table that is not recognized with respect to the table layout master in which the recognized table is arranged. Can be added manually from the terminal 10. Therefore, according to the present embodiment, the terminal 10 can generate a table layout including all tables even when there is a table that cannot be automatically recognized. Even in this case, it is possible to reduce the work load of at least the tables that can be automatically recognized as compared with the case where the table layouts of all the tables are manually created from scratch.

  Note that a number of tables that are greater than the total number of tables may be recognized due to misrecognition. Even if the number of recognized tables is less than or equal to the total number of tables, there may be cases where misrecognized tables are included. Therefore, the terminal 10 may be configured to manually delete the misrecognition table. Here, as misrecognition, a table that is not a table may be recognized as a table, or a table that is not a table layout target may be recognized.

  For example, the data input processing unit 113 may cause the display unit 102 to display a table deletion input screen capable of deleting the layout of the erroneously recognized table from the table layout master generated by the generation unit 115. Then, the generation unit 115 deletes the table layout input from the table deletion input screen from the table layout master.

  Thereby, the erroneously recognized table can be manually deleted from the table layout master in which the recognized table is arranged.

  Note that the table addition input screen and the table deletion input screen may be different screens, or may be a single input screen capable of adding and deleting tables.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to the above-described embodiment, and includes a design and the like within a scope not departing from the gist of the present invention. For example, the configurations described in the first to fourth embodiments can be arbitrarily combined.

  Moreover, in the said embodiment, a marker is arrange | positioned in the position (for example, rectangular rectangular position) corresponding to the shape of a floor, and a floor image is image | photographed so that this marker may be included, and projection of a floor image is carried out. Although the example which correct | amends distortion was demonstrated, it is not restricted to this. For example, the terminal 10 may correct the projective distortion using a floor feature point instead of the marker. The feature points of the floor are, for example, wall boundaries (such as four corners of the floor) and floor patterns. When using the boundaries of the four corner walls of the floor, the floor image may be a combination of two photographed images photographed in the front-rear direction from the center of the floor so that all four corners are included in the floor image. The floor image may be a combination of four captured images captured in the front-rear and left-right directions from the center of the floor. Also, a panoramic image taken by rotating 360 degrees in the substantially horizontal direction from the center of the floor may be used as the floor image.

  Further, in the above embodiment, an example has been described in which the recognition unit 114 corrects the floor image (distortion correction, enlargement correction, etc.) before recognizing the table from the floor image (for example, steps S110 and S112 in FIG. 9). However, the order of processing may be changed. That is, the recognition unit 114 may correct the floor image after recognizing the table from the floor image. In this case, it is conceivable that the recognition rate of the table slightly decreases depending on the angle of view when shooting the floor image. However, by taking care that the photographer captures the angle of view so that the table can be easily recognized when capturing the floor image, or by enriching the sample data for identification used when setting the table, Decrease in the recognition rate can be suppressed.

  Moreover, although the case where the table number was a number was demonstrated to the example in the said embodiment, it is not restricted to a number. The table number is identification information that can identify the table, and may be any information that can identify the table. For example, the table number may be an alphabet, an object name (flower name, animal name, etc.), a symbol, or the like. The display format may be text or a picture.

  In the above embodiment, an example in which the terminal 10 that receives and inputs an order from a customer in the order entry system 1 generates a table layout master has been described. However, the present invention is not limited to this. For example, other electronic devices not included in the configuration of the order entry system 1 (smartphones, tablet computers, notebook computers, desktop computers, etc.) include the configuration of the table layout generation processing unit 112. A table layout master may be generated.

  Further, some or all of the functions of the table layout generation processing unit 112 described above may be realized by a computer. In that case, a program for realizing the above-described function is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system and executed to realize the above-described function. Also good. Here, the “computer system” includes an OS and hardware such as peripheral devices. The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Further, the “computer-readable recording medium” refers to a volatile memory (RAM) in a computer system that becomes a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. In addition, those holding programs for a certain period of time are also included. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

  Moreover, you may implement | achieve part or all of each part with which the terminal 10 in embodiment mentioned above is provided as integrated circuits, such as LSI (Large Scale Integration). Each functional block of the terminal 10 may be individually made into a processor, or a part or all of them may be integrated into a processor. Further, the method of circuit integration is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI appears due to the advancement of semiconductor technology, an integrated circuit based on the technology may be used.

1 order entry system 10 terminal 20 access point 30 controller 40 printer 50 network 101 wireless communication unit 102 display unit 103 input unit 104 camera unit 105 storage unit 106 sensor unit 110 control unit 111 Order Acceptance Processing Unit, 112 Table Layout Generation Processing Unit, 113 Data Input Processing Unit, 114 Recognition Unit, 115 Generation Unit

Claims (8)

A recognition unit for recognizing a table in the store from the floor image based on a floor image in which the floor in the store is photographed and a table image in which the same table as the table in the store is photographed;
A generating unit that generates layout data of a table in the store based on a position in the floor image of the table recognized by the recognizing unit;
An electronic device comprising: The generator is
When there are a plurality of tables recognized by the recognition unit, the layout data is generated by assigning a table number to each of the plurality of tables in a predetermined order.
The electronic device according to claim 1. Each of the plurality of tables in the store has table identification information that can identify each table,
The recognition unit
Recognize the table in the store and the table identification information from the floor image,
The generator is
The layout data is generated by associating each table recognized by the recognition unit with the table identification information of each table,
The electronic device according to claim 1. When the number of tables recognized by the recognizing unit is less than the number of tables in the store, an input screen is displayed that can add a missing table layout to the layout data generated by the generating unit. Data input processing part to be displayed on the part,
With
The generator is
Adding the layout of the table input from the input screen to the layout data;
The electronic apparatus according to any one of claims 1 to 3, wherein the electronic apparatus is characterized in that A data input processing unit for causing a display unit to display an input screen capable of deleting a table layout from the layout data generated by the generating unit;
With
The generator is
Deleting the layout of the table input from the input screen from the layout data;
The electronic apparatus according to any one of claims 1 to 3, wherein the electronic apparatus is characterized in that Based on the layout data generated by the generation unit, a display unit that displays a layout screen related to the floor in the store, and a table that can be selected and input in the layout screen;
An input unit for receiving an operation input for selecting a table on the layout screen;
An order reception processing unit that executes an input process of order information associated with the selected table received by the input unit;
The electronic apparatus according to claim 1, further comprising: A recognition unit for recognizing a table in the store from the floor image based on a floor image in which the floor in the store is photographed and a table image in which the same table as the table in the store is photographed;
A generating unit that generates layout data of a table in the store based on a position in the floor image of the table recognized by the recognizing unit;
Based on the layout data generated by the generation unit, a display unit that displays a layout screen related to the floor in the store;
An order entry system characterized by comprising: On the computer,
Recognizing a table in the store from the floor image based on a floor image in which the floor in the store is photographed and a table image in which the same table in the store is photographed;
Generating layout data of a table in the store based on a position in the floor image of the recognized table;
A program for running

Images