WO2017170632A1 - Commodity data registration terminal, commodity data registration method, and commodity data registration program - Google Patents

Commodity data registration terminal, commodity data registration method, and commodity data registration program Download PDF

Info

Publication number
WO2017170632A1
WO2017170632A1 PCT/JP2017/012791 JP2017012791W WO2017170632A1 WO 2017170632 A1 WO2017170632 A1 WO 2017170632A1 JP 2017012791 W JP2017012791 W JP 2017012791W WO 2017170632 A1 WO2017170632 A1 WO 2017170632A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
rectangle
image
product name
product
Prior art date
Application number
PCT/JP2017/012791
Other languages
French (fr)
Japanese (ja)
Inventor
史貴 菊川
雄一郎 鹿毛
晃平 西條
一寿 若林
Original Assignee
株式会社リクルートホールディングス
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社リクルートホールディングス filed Critical 株式会社リクルートホールディングス
Publication of WO2017170632A1 publication Critical patent/WO2017170632A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/12Hotels or restaurants
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries

Definitions

  • the present invention relates to a product data registration terminal, a product data registration method, and a product data registration program.
  • Patent Document 1 discloses a system that performs accounting processing using a cash register terminal installed in a restaurant.
  • the product data registration terminal has a moving direction from the start point to the end point for each means for displaying an image including a product name and a charge, and for an operation by the user to specify the start point and the end point. , Determining whether the first direction or a second direction opposite to the first direction corresponds, and designating a range associated with the determined direction and performing character recognition in the image Using a character recognition process specialized in product name pattern recognition, and means for displaying a rectangle for displaying on the image and a recognition target included in the image in the rectangle associated with the first direction. On the other hand, the recognition target included in the image in the rectangle associated with the second direction is converted into text data using character recognition processing specialized for fee pattern recognition.
  • Means for converting means for inputting and displaying each of the converted text data in a product name input field and a charge input field provided in a registration screen area for registering product data, and the product name input field And means for registering product data including product name data and fee data in the storage unit based on the data entered in the fee entry field.
  • the means for displaying the rectangle is the same as the stored size.
  • the rectangle having the width may be displayed.
  • the means for displaying the rectangle may display the rectangle having the same size as the stored size on the basis of the base point when an operation for designating a base point is performed by a user. .
  • Means for associating the rectangle associated with the first direction with the rectangle associated with the second direction wherein the means for inputting and displaying the text data comprises:
  • the text data corresponding to the rectangle may be input and displayed in the product name input column and the fee input column arranged on the same line in the registration screen area.
  • the association means associates the rectangles in the same order according to the order in which the rectangles associated with the first direction and the rectangles associated with the second direction are displayed on the image, respectively. It is good.
  • the apparatus further comprises means for accepting an operation for associating the rectangle associated with the first direction with the rectangle associated with the second direction, and the association means is associated with the accepted operation.
  • the rectangles may be associated with each other.
  • the image may be a menu image.
  • the product data registration method is a method executed by a terminal, and includes a step of displaying an image including a product name and a charge, and an operation for specifying a start point and an end point by a user, It is determined whether the moving direction from the start point to the end point corresponds to a predetermined first direction or a second direction opposite to the first direction, is associated with the determined direction, and the image A step of displaying a rectangle for designating a range for character recognition on the image and a recognition target included in the image in the rectangle associated with the first direction for pattern recognition of a product name.
  • the product data registration program includes a computer that moves from the start point to the end point for each operation for specifying a start point and an end point by a means for displaying an image including a product name and a charge. It is determined whether the direction corresponds to a predetermined first direction or a second direction opposite to the first direction, a range associated with the determined direction and character recognition in the image is determined.
  • the recognition target included in the image in the rectangle associated with the second direction is used for character recognition processing specialized for fee pattern recognition.
  • Means for converting to text data means for inputting and displaying the converted text data in a product name input field and a charge input field provided in a registration screen area for registering product data, and the product name Based on the data input in the input field and the fee input field, the product data including product name data and fee data is registered as a means for registering in the storage unit.
  • FIG. 1 It is a figure which illustrates the composition of the merchandise management system containing the store terminal in an embodiment. It is a figure which illustrates the structure of the shop terminal shown in FIG. It is a flowchart for demonstrating the process sequence at the time of registering menu data with a shop terminal. It is a figure which shows an example of the menu registration screen displayed on the screen of a shop terminal. It is a figure which shows an example of the menu registration screen displayed on the screen of a shop terminal. It is a figure which shows an example of the menu registration screen displayed on the screen of a shop terminal. It is a figure which shows an example of the menu registration screen displayed on the screen of a shop terminal. It is a figure which shows an example of the menu registration screen displayed on the screen of a shop terminal. It is a figure which shows an example of the menu registration screen displayed on the screen of a shop terminal. It is a figure which shows an example of the menu registration screen displayed on the screen of a shop terminal.
  • FIG. 1 is a schematic view illustrating the configuration of a product management system including a store terminal (product data registration terminal) according to an embodiment of the present invention.
  • the merchandise management system 1 includes one or a plurality of store terminals 2 and a management server 3.
  • the store terminal 2 and the management server 3 are configured to be able to communicate with each other via the network N.
  • each store terminal 2 is introduced into each store of the restaurant.
  • One or a plurality of store terminals 2 may be provided for each store.
  • a store clerk registers a product name and a charge included in the menu of the store as menu data (product data) in the store terminal 2 using a menu registration function described later.
  • the store terminal 2 uses, for example, the registered menu data to register the order reception process for registering the order contents from the customer who visited the store, and the accounting process (for example, sales registration). Processing, receipt issue processing) and the like.
  • Each data registered in the store terminal 2 is appropriately transmitted to the management server 3 and managed in a state where the store ID and the like are given in the management server 3.
  • a tablet terminal is assumed as the store terminal 2.
  • the store terminal 2 is not limited to this, and for example, a notebook PC (personal computer), a smartphone, a mobile phone, a personal digital assistant (PDA), and other terminal devices can be used as the store terminal 2 as appropriate.
  • a notebook PC personal computer
  • smartphone a smartphone
  • mobile phone a personal digital assistant (PDA)
  • PDA personal digital assistant
  • the management server 3 is configured by, for example, a computer having high arithmetic processing capability, and a server function is realized by a predetermined server program operating on the computer.
  • the computer which comprises the management server 3 does not necessarily need to be one unit
  • the network N includes a communication network capable of transmitting and receiving information between the store terminal 2 and the management server 3.
  • the network N is, for example, the Internet, a LAN, a dedicated line, a telephone line, a corporate network, a mobile communication network, Bluetooth (registered trademark), WiFi (Wireless Fidelity), other communication lines, or a combination thereof. It does not matter whether it is wired or wireless.
  • FIG. 2 is a block diagram schematically showing the configuration of the store terminal 2.
  • the store terminal 2 includes, for example, a processor 21, a communication interface 22, an input device 23, a display device 24, and a storage resource 25.
  • the processor 21 includes an arithmetic logic unit and various registers (a program counter, a data register, an instruction register, a general-purpose register, etc.), and executes a program 250 stored in the storage resource 25, whereby a menu registration function to be described later Various functions such as are realized.
  • the program 250 there is a menu registration application program (product data registration program; hereinafter also referred to as “menu registration application”) installed in the store terminal 2.
  • the application program is downloaded from the management server 3 through the network N and installed in the store terminal 2.
  • the communication interface 22 provides a connection interface with the management server 3 and includes a wireless communication interface or a wired communication interface.
  • the input device 23 provides an interface for accepting an input operation from a user, and examples thereof include a touch panel, a keyboard, a mouse, and the like.
  • the display device 24 provides an image display interface such as a menu registration screen described later to the user, and examples thereof include an organic EL display, a liquid crystal display, and a CRT display. In this embodiment, as the input device 23 and the display device 24, a display with a touch panel is used as an example.
  • Storage resource 25 is, for example, a logical device provided by a storage area of a physical device.
  • the physical device is a computer-readable recording medium such as a disk drive or a semiconductor memory.
  • the storage resource 25 stores an operating system program, a driver program, various data, and the like.
  • the driver program include an input device driver program for controlling the input device 23, an output device driver program for controlling the display device 24, and the like.
  • the various data include menu data including product name data and fee data.
  • the menu data is stored in, for example, the menu information DB 252.
  • the program 250 in this embodiment has a menu registration processing module 251 as an example.
  • a menu registration function is manifested.
  • FIG. 3 is a flowchart illustrating the basic processing flow in the store terminal 2 when registering menu data
  • FIGS. 4 to 8 are diagrams showing examples of display screens in the store terminal 2 at that time. is there.
  • the menu registration processing module 251 of the store terminal 2 displays the menu registration screen (registration screen area) shown in FIG. 24S is displayed on the display 24 (step S101).
  • the activation request for the menu registration application is made by, for example, tapping (selecting) an icon displayed on the display 24 of the store terminal 2.
  • the menu registration processing module 251 displays the menu image selection screen 241 shown in FIG. 5 as the menu registration screen 24S.
  • a pop-up is displayed above (step S102).
  • the menu image is an image obtained by photographing a menu for displaying product names and charges.
  • the display request for the screen for selecting the menu image is made by, for example, tapping the “display menu image” button 24a.
  • the menu registration processing module 251 displays the selected menu image 24f in the image display area of the menu registration screen 24S as shown in FIG. (Step S103).
  • the file name “IMG — 6198.JPG” 241a corresponding to the desired menu image 24f is selected on the menu image selection screen 241 shown in FIG. 5, and the “Open” button 241b is tapped. Do that.
  • the menu registration processing module 251 performs the following operation as shown in FIG. A rectangle 24g for demarcating a character recognition target range is displayed for each designated product name display area, and the rectangle 24h is displayed for each designated charge display area (step S104).
  • the product name and the charge display area are specified by, for example, tracing the menu image 24f, and two types of rectangles 24g and 24h are displayed according to the tracing direction. This will be specifically described below.
  • the product name display area is specified by the salesclerk tracing with the finger in the right direction from the left end of the product name to be registered toward the right end.
  • the menu registration processing module 251 determines that the moving direction from the start point to the end point is rightward based on the start point (contact start point) and end point (contact end point) specified by tracing the image displayed on the display 24. When it is determined that the product name is rectangular, the product name rectangle 24g is displayed.
  • the charge display area is specified by the clerk tracing with the finger in the left direction from the right end of the charge to be registered toward the left end.
  • the menu registration processing module 251 determines that the moving direction from the start point to the end point is the left direction based on the start point and the end point specified by tracing on the image displayed on the display 24, A rectangle 24h is displayed.
  • the start point and the end point are specified and the rectangular display position is determined. To do. This will be specifically described below.
  • the menu registration processing module 251 specifies the start point and the end point based on the contact start point and the contact end point detected by the display 24 with a touch panel.
  • the menu registration processing module 251 changes the Y coordinate of the end point to the same value as the Y coordinate of the start point.
  • This is a function provided in consideration that, for example, in a horizontally written menu, a product name and a charge are often displayed on a straight line in the horizontal direction, while the tracing operation is likely to be shaken.
  • the menu registration processing module 251 sets the midpoint of the left side (height) of the rectangle on the start point coordinates, and sets the midpoint of the right side (height) of the rectangle on the end point coordinates. Determine the display position. Subsequently, the menu registration processing module 251 displays a rectangle at the determined display position.
  • the display position of the rectangle can be changed arbitrarily by dragging the entire rectangle. Further, by selecting each of the displayed rectangles, for example, the size adjusting unit 24i appears at the four corners of the rectangle, and the size is adjusted by dragging the size adjusting unit 24i to adjust the size of the rectangle. Can be changed arbitrarily.
  • the changed rectangle size (for example, height (width), length, etc.) is stored in the memory.
  • the size of this rectangle may be stored for each type of rectangle.
  • the menu registration processing module 251 displays the rectangle having the same height based on the size stored in the memory at that time.
  • the function to display a rectangle with the same height is provided in consideration of the fact that the product name and price displayed on the menu are often displayed in the same size.
  • This function for example, when the height of the rectangle is changed to match the height of the characters of the horizontally written product name, when the rectangle is displayed for other product names and prices, A rectangle having the same height as the height can be displayed, and it is possible to save time and effort for adjusting the height of the rectangle.
  • the menu registration processing module 251 is double-tapped on the image, for example, the double-tapped coordinate is used as a starting point (base point), and a rectangle having the same size as the size stored in the memory at that time is used. indicate.
  • the rectangle displayed on the image is double-tapped, the rectangle is deleted.
  • the function to display rectangles of the same size can reduce the effort to change the size of the rectangles as the product names and prices displayed in the menu are the same, improving work efficiency. It becomes possible.
  • the length of the charge displayed on the menu is often the same length, so changing the size of the rectangle according to one of the charges will change the size of the rectangle for other charges to be displayed after that. It is possible to save the labor of changing, and to reduce the work load.
  • the length of the product name displayed in the menu is often not the same, but since the space between the product name and the price is often filled with the longest product name, the longest product name Character recognition accuracy can be maintained even when character recognition is performed using a rectangle matched to the above. Therefore, when displaying a rectangle in the product name, by changing the size of the rectangle according to the longest product name, you can save the trouble of changing the size of the rectangle of the other product name to be displayed after that, The work burden can be reduced.
  • the menu registration processing module 251 highlights the product name rectangle 24g displayed by tracing in the right direction by using, for example, light blue highlights, and the fee displayed by tracing in the left direction.
  • the rectangle 24h is highlighted using, for example, yellow highlights. This makes it easy to visually distinguish the product name display area and the charge display area.
  • the store clerk taps the “analysis” button 24b on the menu registration screen 24S shown in FIG.
  • the registration processing module 251 recognizes characters to be recognized included in the images in the rectangles 24g and 24h by using a character recognition process determined for each type of the rectangles 24g and 24h, and converts the recognition targets into text data (step S105). ). This will be specifically described below.
  • the rectangle is a product rectangle 24g displayed by tracing the image to the right
  • character recognition is performed using character recognition processing specialized for product name pattern recognition and converted to text data.
  • the rectangle is a fee rectangle 24h displayed by tracing the left direction on the image
  • character recognition is performed using character recognition processing specialized for fee pattern recognition, and the text data is converted into text data. Convert.
  • the content of the character recognition process is not particularly limited, and for example, an image recognition system application represented by a general OCR (Optical Character Reader) technology can be applied. Further, a so-called deep learning technique used for data learning can be applied instead of the OCR technique. Character recognition including such deep learning technology can be configured including, for example, steps of image processing, machine learning, and language processing (recognition result correction).
  • the menu registration processing module 251 sequentially converts each text data converted in step S105 to each product name field 24d and each price field 24e of the menu registration screen 24S shown in FIG. Input) and display (step S106).
  • the menu registration processing module 251 sequentially adds a product name field 24d and a charge field 24e on the menu registration screen 24S according to the number of converted text data.
  • the menu registration processing module 251 stores the text data corresponding to the associated product name rectangle 24g and the charge rectangle 24h on the same line on the menu registration screen 24S. And the charges are displayed in the charge column 24e.
  • the association between the product name rectangle 24g and the charge rectangle 24h can be performed, for example, by any one of the following (1) to (3).
  • Rectangles in the same order are associated with each other according to the order in which the rectangles 24g and 24h are displayed on the image. In that case, it is good also as displaying the number corresponding to each display order near the rectangle 24g and the rectangle 24h so that a salesclerk can confirm the order displayed.
  • the contents of the product name column 24d and the fee column 24e can be arbitrarily changed by the user. Further, when deleting the product name field 24d and the charge field 24e, the entire line corresponding to the delete button 24j can be obtained by tapping the delete button 24j on the same line as the product name field 24d and the charge field 24e. Can be deleted.
  • the menu registration processing module 251 is provided on the menu registration screen 24S when a registration request for menu data is received according to the operation of the store clerk.
  • Menu data is registered in the menu information DB 252 based on the data input to the product name column 24d and the fee column 24e (step S107).
  • the menu data registration request is made, for example, by tapping the “registration” button 24c on the menu registration screen 24S shown in FIG.
  • the menu image 24f including the product name and the charge is displayed on the menu registration screen 24S, and each time an operation of tracing the image by the store clerk is received, the start point to the end point are received. It can be determined whether the moving direction corresponds to the right direction or the left direction, and the rectangles 24g and 24h associated with the determined direction can be displayed on the image. Furthermore, the recognition target included in the image in the rectangle 24g associated with the right direction is converted into text data using a character recognition process specialized for product name pattern recognition, and is associated with the left direction.
  • the recognition target included in the image in the rectangle 24h is converted into text data by using a character recognition process specialized in fee pattern recognition, and is then displayed in the product name column 24d and the fee column 24e on the menu registration screen 24S, respectively.
  • the menu data can be registered in the menu information DB 252 based on the input data.
  • the labor for registering the menu data can be reduced, and the introduction of the system using the store terminal 2 can be promoted.
  • the present invention is characterized in that it has been made with attention to the following matters.
  • Menus product price lists
  • the character used for goods can be narrowed down to some extent by the kind of restaurant etc., for example, and it can narrow down to a number regarding a charge. Therefore, when the character recognition target is the product name, the recognition rate of the product name can be improved by performing the character recognition process using the character pattern used for the product name.
  • the object of character recognition is a charge
  • the charge recognition rate can be improved by performing character recognition processing using a numeric pattern used for the charge.
  • the present invention when the present invention is traced in the right direction on the menu image 24f, it is determined that the product name has been traced, and the product name rectangle 24g is displayed at the traced location.
  • the recognition target included in the image in the rectangle 24g is recognized by using a character recognition process specialized in the pattern recognition of the product name, and converted into text data.
  • the invention of the present application is able to reduce the labor when registering the menu data by providing these character recognition functions. Further, according to the present invention, since character recognition processing can be performed by specifying a point (product name and fee) necessary for recognition as a pinpoint, character recognition processing for unnecessary characters can be eliminated. Therefore, the character recognition processing speed can be shortened while improving the accuracy of character recognition.
  • the present invention is not limited to the above-described embodiment, and can be implemented in various other forms without departing from the gist of the present invention. For this reason, the said embodiment is only a mere illustration in all points, and is not interpreted limitedly. For example, the above-described processing steps can be arbitrarily changed in order as long as the processing contents do not contradict each other, or can be executed in parallel.
  • the store terminal 2 is described on the assumption that it is a tablet terminal equipped with a display with a touch panel. Therefore, the rectangles 24g and 24h are displayed by tracing the menu image 24f. However, when the store terminal 2 is a terminal equipped with a display without a touch panel, the rectangles 24g and 24h may be displayed as follows.
  • the product name rectangle 24g is displayed.
  • the charge rectangle 24h is displayed.
  • the product name rectangle 24g is displayed when the image is traced to the right, and the fee rectangle 24h is displayed when the image is traced to the left.
  • the product name rectangle 24g may be displayed when the image is traced to the left, and the fee rectangle 24h may be displayed when the image is traced to the right.
  • the present invention can also be applied to the case where the menu is vertically written.
  • the rectangles 24g and 24h may be displayed as follows.
  • the product name rectangle 24g is displayed.
  • the charge rectangle 24h is displayed.
  • the product name rectangle 24g may be displayed when the image is traced upward
  • the fee rectangle 24h may be displayed when the image is traced downward.
  • the menu image used for menu registration is selected from the stored images.
  • the present invention is not limited to this.
  • an image taken using a camera mounted on the store terminal 2 may be used as a menu image.
  • the present invention is not limited to this, and the present invention is applied to the case of registering the product data including the product name and the fee. Can do.
  • the size of the rectangles 24g and 24h is reduced to the display range of the product name and the charge. It is good also as adding the function to do.
  • a procedure for reducing the size of the rectangles 24g and 24h to the display range of the product name and the charge will be exemplified below.
  • the black range included in the binarized data is specified based on the restriction condition regarding the enumeration of characters.
  • the rectangles 24g and 24h are displayed in accordance with the specified black range. Thereby, the size of the rectangles 24g and 24h can be reduced to the display range of the product name and the charge.
  • the rectangles 24g and 24h set by the store clerk include character groups other than the product name and the fee
  • the rectangles 24g and 24h are displayed only in the display range of the product name and the fee.
  • a function to be displayed may be added.
  • a character group other than the product name and the charge for example, a description of the product is applicable.
  • a procedure for displaying the rectangles 24g and 24h only in the display range of the product name and the charge will be exemplified below.
  • the black range included in the binarized data is grouped on the basis of the restriction condition regarding the enumeration of characters.
  • the group formed by grouping is specified as a character group for each group.
  • the character group having the maximum display area is selected from the plurality of specified character groups, and the rectangles 24g and 24h are displayed only in the display range of the selected character group.
  • the plurality of specified character groups may be presented to the store clerk as candidates for character recognition, and the rectangles 24g and 24h may be displayed only in the display range of the character group selected by the store clerk.
  • the program in the embodiment is downloaded through various recording media (computer-readable recording media) such as an optical disk such as a CD-ROM, a magnetic disk, and a semiconductor memory, or via a communication network. Can be installed or loaded.
  • recording media computer-readable recording media
  • an optical disk such as a CD-ROM, a magnetic disk, and a semiconductor memory
  • the product data registration terminal, the product data registration method, and the product data registration program according to the present invention are suitable for reducing labor when registering product data.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Business, Economics & Management (AREA)
  • General Health & Medical Sciences (AREA)
  • Tourism & Hospitality (AREA)
  • Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Evolutionary Computation (AREA)
  • Databases & Information Systems (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • Human Computer Interaction (AREA)
  • Marketing (AREA)
  • Human Resources & Organizations (AREA)
  • Economics (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • User Interface Of Digital Computer (AREA)
  • Character Input (AREA)
  • Character Discrimination (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The present invention reduces labor when registering commodity data. The present invention includes: displaying a menu image; determining, for each operation for specifying a start point and an end point by a user, whether the direction of movement from the start point to the end point is a rightward direction or a leftward direction; displaying a rectangle correlated to the determined direction on an image; converting a recognition object included in an image within the rectangle correlated to the rightward direction into text data by utilizing a character recognition process specialized in pattern recognition of a commodity name; converting a recognition object included in an image within the rectangle correlated to the leftward direction into text data by utilizing a character recognition process specialized in pattern recognition of a fee; inputting each of the converted text data in a commodity name input column and fee input column of a menu registration screen; and registering commodity data that includes commodity name data and fee data in a menu information database on the basis of the inputted data.

Description

商品データ登録端末、商品データ登録方法および商品データ登録プログラムProduct data registration terminal, product data registration method, and product data registration program 関連出願の相互参照Cross-reference of related applications
 本出願は、2016年3月29日に出願された日本出願番号(特願)2016-066479号に基づくもので、ここにその記載内容を援用する。 This application is based on Japanese Application No. 2016-066479 filed on Mar. 29, 2016, the contents of which are incorporated herein by reference.
 本発明は、商品データ登録端末、商品データ登録方法および商品データ登録プログラムに関する。 The present invention relates to a product data registration terminal, a product data registration method, and a product data registration program.
 下記特許文献1には、飲食店に設置したレジ端末を利用して会計処理を行うシステムが開示されている。 The following Patent Document 1 discloses a system that performs accounting processing using a cash register terminal installed in a restaurant.
特開2013-137657号公報JP 2013-137657 A
 飲食店で提供される商品やその料金は店舗ごとに異なるのが一般的である。したがって、特許文献1のように店舗ごとにレジ端末を設置して利用する場合には、店舗ごとのメニューデータ(商品データ)を各レジ端末に事前に登録する作業が必要になる。レジ端末にメニューデータを登録する場合には、登録担当者が店舗ごとのメニューを見ながら、商品ごとに登録することになる。つまり、システムを利用する前に、商品および料金を入力して登録する作業が商品数分繰り返し発生することとなり、労力を要することになる。このような事前作業が存在すると、システムを導入する際の足かせになりかねない。
 本発明は、上述した課題を解決するためになされたものであり、商品データを登録する際の労力を軽減することができる商品データ登録端末、商品データ登録方法および商品データ登録プログラムを提供することを目的の一つとする。
In general, products provided at restaurants and their prices vary from store to store. Therefore, when a cash register terminal is installed and used for each store as in Patent Document 1, it is necessary to register menu data (product data) for each store in each cash register terminal in advance. When registering the menu data in the cash register terminal, the person in charge of registration registers for each product while looking at the menu for each store. In other words, before using the system, the work of inputting and registering products and charges repeatedly occurs for the number of products, which requires labor. The presence of such prior work can be a drag on the introduction of the system.
The present invention has been made to solve the above-described problems, and provides a product data registration terminal, a product data registration method, and a product data registration program capable of reducing labor when registering product data. Is one of the purposes.
 本発明の一態様である商品データ登録端末は、商品名および料金を含む画像を表示する手段と、ユーザによる始点および終点を特定するための操作ごとに、前記始点から前記終点までの移動方向が、予め定めた第1方向または当該第1方向と逆向きの第2方向のいずれに該当するかを判定し、当該判定した方向に対応付けられ、かつ前記画像において文字認識をする範囲を指定するための矩形を、前記画像上に表示する手段と、前記第1方向に対応付けられた前記矩形内の画像に含まれる認識対象を、商品名のパターン認識に特化した文字認識処理を利用してテキストデータに変換する、一方、前記第2方向に対応付けられた前記矩形内の画像に含まれる認識対象を、料金のパターン認識に特化した文字認識処理を利用してテキストデータに変換する手段と、商品データを登録するための登録画面領域に設けられる商品名入力欄および料金入力欄に、前記変換されたそれぞれのテキストデータを入力して表示する手段と、前記商品名入力欄および前記料金入力欄に入力されたデータに基づいて、商品名データおよび料金データを含む商品データを記憶部に登録する手段と、を備える。 The product data registration terminal according to one aspect of the present invention has a moving direction from the start point to the end point for each means for displaying an image including a product name and a charge, and for an operation by the user to specify the start point and the end point. , Determining whether the first direction or a second direction opposite to the first direction corresponds, and designating a range associated with the determined direction and performing character recognition in the image Using a character recognition process specialized in product name pattern recognition, and means for displaying a rectangle for displaying on the image and a recognition target included in the image in the rectangle associated with the first direction. On the other hand, the recognition target included in the image in the rectangle associated with the second direction is converted into text data using character recognition processing specialized for fee pattern recognition. Means for converting, means for inputting and displaying each of the converted text data in a product name input field and a charge input field provided in a registration screen area for registering product data, and the product name input field And means for registering product data including product name data and fee data in the storage unit based on the data entered in the fee entry field.
 ユーザの操作に従って、前記矩形のサイズを変更する手段と、最後に変更された前記矩形のサイズを記憶する手段と、をさらに備え、前記矩形を表示する手段は、前記記憶された前記サイズと同じ幅の前記矩形を表示することとしてもよい。 Means for changing the size of the rectangle according to a user's operation; and means for storing the size of the rectangle that was last changed. The means for displaying the rectangle is the same as the stored size. The rectangle having the width may be displayed.
 前記矩形を表示する手段は、ユーザにより基点を指定するための操作がなされた場合には、前記記憶された前記サイズと同じサイズの前記矩形を、前記基点を基準にして表示することとしてもよい。 The means for displaying the rectangle may display the rectangle having the same size as the stored size on the basis of the base point when an operation for designating a base point is performed by a user. .
 前記第1方向に対応付けられた前記矩形と前記第2方向に対応付けられた前記矩形とを対応付ける手段をさらに備え、前記テキストデータを入力して表示する手段は、前記対応付けられた双方の前記矩形に対応する前記テキストデータを、前記登録画面領域で同一行に配置されている前記商品名入力欄および前記料金入力欄にそれぞれ入力して表示させることとしてもよい。 Means for associating the rectangle associated with the first direction with the rectangle associated with the second direction, wherein the means for inputting and displaying the text data comprises: The text data corresponding to the rectangle may be input and displayed in the product name input column and the fee input column arranged on the same line in the registration screen area.
 前記対応付ける手段は、前記第1方向に対応付けられた前記矩形と前記第2方向に対応付けられた前記矩形とがそれぞれ前記画像上に表示された順番に従って、同じ順番の前記矩形同士を対応付けることとしてもよい。 The association means associates the rectangles in the same order according to the order in which the rectangles associated with the first direction and the rectangles associated with the second direction are displayed on the image, respectively. It is good.
 前記第1方向に対応付けられた前記矩形と前記第2方向に対応付けられた前記矩形とを関連付ける操作を受け付ける手段をさらに備え、前記対応付ける手段は、前記受け付けられた前記操作により関連付けられた前記矩形同士を対応付けることとしてもよい。 The apparatus further comprises means for accepting an operation for associating the rectangle associated with the first direction with the rectangle associated with the second direction, and the association means is associated with the accepted operation. The rectangles may be associated with each other.
 前記画像は、メニューの画像であることとしてもよい。 The image may be a menu image.
 本発明の一態様である商品データ登録方法は、端末が実行する方法であって、商品名および料金を含む画像を表示するステップと、ユーザによる始点および終点を特定するための操作ごとに、前記始点から前記終点までの移動方向が、予め定めた第1方向または当該第1方向と逆向きの第2方向のいずれに該当するかを判定し、当該判定した方向に対応付けられ、かつ前記画像において文字認識をする範囲を指定するための矩形を、前記画像上に表示するステップと、前記第1方向に対応付けられた前記矩形内の画像に含まれる認識対象を、商品名のパターン認識に特化した文字認識処理を利用してテキストデータに変換する、一方、前記第2方向に対応付けられた前記矩形内の画像に含まれる認識対象を、料金のパターン認識に特化した文字認識処理を利用してテキストデータに変換するステップと、商品データを登録するための登録画面領域に設けられる商品名入力欄および料金入力欄に、前記変換されたそれぞれのテキストデータを入力して表示するステップと、前記商品名入力欄および前記料金入力欄に入力されたデータに基づいて、商品名データおよび料金データを含む商品データを記憶部に登録するステップと、を含む。 The product data registration method according to one aspect of the present invention is a method executed by a terminal, and includes a step of displaying an image including a product name and a charge, and an operation for specifying a start point and an end point by a user, It is determined whether the moving direction from the start point to the end point corresponds to a predetermined first direction or a second direction opposite to the first direction, is associated with the determined direction, and the image A step of displaying a rectangle for designating a range for character recognition on the image and a recognition target included in the image in the rectangle associated with the first direction for pattern recognition of a product name. Conversion to text data using specialized character recognition processing, while the recognition target included in the image in the rectangle associated with the second direction is specialized for fee pattern recognition A step of converting to text data using a character recognition process, and inputting the converted text data into a product name input field and a charge input field provided in a registration screen area for registering product data. And a step of registering product data including product name data and fee data in a storage unit based on data input to the product name input column and the fee input column.
 本発明の一態様である商品データ登録プログラムは、コンピュータを、商品名および料金を含む画像を表示する手段、ユーザによる始点および終点を特定するための操作ごとに、前記始点から前記終点までの移動方向が、予め定めた第1方向または当該第1方向と逆向きの第2方向のいずれに該当するかを判定し、当該判定した方向に対応付けられ、かつ前記画像において文字認識をする範囲を指定するための矩形を、前記画像上に表示する手段、前記第1方向に対応付けられた前記矩形内の画像に含まれる認識対象を、商品名のパターン認識に特化した文字認識処理を利用してテキストデータに変換する、一方、前記第2方向に対応付けられた前記矩形内の画像に含まれる認識対象を、料金のパターン認識に特化した文字認識処理を利用してテキストデータに変換する手段、商品データを登録するための登録画面領域に設けられる商品名入力欄および料金入力欄に、前記変換されたそれぞれのテキストデータを入力して表示する手段、前記商品名入力欄および前記料金入力欄に入力されたデータに基づいて、商品名データおよび料金データを含む商品データを記憶部に登録する手段、として機能させる。 The product data registration program according to one aspect of the present invention includes a computer that moves from the start point to the end point for each operation for specifying a start point and an end point by a means for displaying an image including a product name and a charge. It is determined whether the direction corresponds to a predetermined first direction or a second direction opposite to the first direction, a range associated with the determined direction and character recognition in the image is determined. A means for displaying a rectangle for designating on the image, and a character recognition process specialized in pattern recognition of product names for recognition targets included in the image in the rectangle associated with the first direction. On the other hand, the recognition target included in the image in the rectangle associated with the second direction is used for character recognition processing specialized for fee pattern recognition. Means for converting to text data, means for inputting and displaying the converted text data in a product name input field and a charge input field provided in a registration screen area for registering product data, and the product name Based on the data input in the input field and the fee input field, the product data including product name data and fee data is registered as a means for registering in the storage unit.
 本開示によれば、商品データを登録する際の労力を軽減することができる。 According to the present disclosure, it is possible to reduce labor when registering product data.
実施形態における店舗端末を含む商品管理システムの構成を例示する図である。It is a figure which illustrates the composition of the merchandise management system containing the store terminal in an embodiment. 図1に示す店舗端末の構成を例示する図である。It is a figure which illustrates the structure of the shop terminal shown in FIG. 店舗端末でメニューデータを登録する際の処理手順を説明するためのフローチャートである。It is a flowchart for demonstrating the process sequence at the time of registering menu data with a shop terminal. 店舗端末の画面上に表示されるメニュー登録画面の一例を示す図である。It is a figure which shows an example of the menu registration screen displayed on the screen of a shop terminal. 店舗端末の画面上に表示されるメニュー登録画面の一例を示す図である。It is a figure which shows an example of the menu registration screen displayed on the screen of a shop terminal. 店舗端末の画面上に表示されるメニュー登録画面の一例を示す図である。It is a figure which shows an example of the menu registration screen displayed on the screen of a shop terminal. 店舗端末の画面上に表示されるメニュー登録画面の一例を示す図である。It is a figure which shows an example of the menu registration screen displayed on the screen of a shop terminal. 店舗端末の画面上に表示されるメニュー登録画面の一例を示す図である。It is a figure which shows an example of the menu registration screen displayed on the screen of a shop terminal.
 以下、本発明の実施形態について図面を参照しつつ詳細に説明する。なお、同一の要素には同一の符号を付し、重複する説明を省略する。 Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, the same code | symbol is attached | subjected to the same element and the overlapping description is abbreviate | omitted.
 図1は、本発明の一実施形態における店舗端末(商品データ登録端末)を含む商品管理システムの構成を例示する概略図である。商品管理システム1は、単数又は複数の店舗端末2と、管理サーバ3とを備える。店舗端末2および管理サーバ3は、ネットワークNを介して相互に通信できるように構成される。 FIG. 1 is a schematic view illustrating the configuration of a product management system including a store terminal (product data registration terminal) according to an embodiment of the present invention. The merchandise management system 1 includes one or a plurality of store terminals 2 and a management server 3. The store terminal 2 and the management server 3 are configured to be able to communicate with each other via the network N.
 本実施形態では、例示的に、飲食店の各店舗に店舗端末2を導入する場合について説明する。店舗端末2は、それぞれの店舗ごとに、単数又は複数備えることができる。各店舗では、店員が、後述するメニュー登録機能を利用して、自店舗のメニューに含まれる商品名および料金をメニューデータ(商品データ)として店舗端末2に登録する。 In the present embodiment, a case where the store terminal 2 is introduced into each store of the restaurant will be described as an example. One or a plurality of store terminals 2 may be provided for each store. In each store, a store clerk registers a product name and a charge included in the menu of the store as menu data (product data) in the store terminal 2 using a menu registration function described later.
 店舗端末2は、メニュー登録機能に加え、例えば、登録したメニューデータを用いて、来店した顧客からの注文内容を登録する注文受付処理や、登録した注文内容を用いて会計処理(例えば、売上登録処理、レシートの発行処理)を実行する機能等を有する。店舗端末2に登録された各データは、適宜管理サーバ3に送信され、管理サーバ3において店舗ID等が付与された状態で管理される。 In addition to the menu registration function, the store terminal 2 uses, for example, the registered menu data to register the order reception process for registering the order contents from the customer who visited the store, and the accounting process (for example, sales registration). Processing, receipt issue processing) and the like. Each data registered in the store terminal 2 is appropriately transmitted to the management server 3 and managed in a state where the store ID and the like are given in the management server 3.
 本実施形態では、店舗端末2として、タブレット端末を想定する。しかし、店舗端末2はこれに限定されず、店舗端末2として、例えば、ノートPC(パーソナルコンピュータ)、スマートフォン、携帯電話機、携帯情報端末(PDA)、その他の端末装置を適宜用いることができる。 In this embodiment, a tablet terminal is assumed as the store terminal 2. However, the store terminal 2 is not limited to this, and for example, a notebook PC (personal computer), a smartphone, a mobile phone, a personal digital assistant (PDA), and other terminal devices can be used as the store terminal 2 as appropriate.
 管理サーバ3は、例えば、演算処理能力の高いコンピュータによって構成され、そのコンピュータにおいて所定のサーバ用プログラムが動作することにより、サーバ機能を実現するものである。ここで、管理サーバ3を構成するコンピュータは、必ずしも1台である必要はなく、ネットワーク上に分散する複数のコンピュータから構成されてもよい。 The management server 3 is configured by, for example, a computer having high arithmetic processing capability, and a server function is realized by a predetermined server program operating on the computer. Here, the computer which comprises the management server 3 does not necessarily need to be one unit | set, and may be comprised from the some computer distributed on a network.
 ネットワークNは、店舗端末2と管理サーバ3との間で情報を送受信可能な通信網を含む。ネットワークNは、例えば、インターネット、LAN、専用線、電話回線、企業内ネットワーク、移動体通信網、ブルートゥース(登録商標)、WiFi(Wireless Fidelity)、その他の通信回線、それらの組み合わせ等のいずれであってもよく、有線であるか無線であるかを問わない。 The network N includes a communication network capable of transmitting and receiving information between the store terminal 2 and the management server 3. The network N is, for example, the Internet, a LAN, a dedicated line, a telephone line, a corporate network, a mobile communication network, Bluetooth (registered trademark), WiFi (Wireless Fidelity), other communication lines, or a combination thereof. It does not matter whether it is wired or wireless.
 図2は、店舗端末2の構成を概略的に示すブロック図である。店舗端末2は、例えば、プロセッサ21と、通信インタフェース22と、入力デバイス23と、表示デバイス24と、記憶資源25とを備える。 FIG. 2 is a block diagram schematically showing the configuration of the store terminal 2. The store terminal 2 includes, for example, a processor 21, a communication interface 22, an input device 23, a display device 24, and a storage resource 25.
 プロセッサ21は、算術論理演算ユニットおよび各種レジスタ(プログラムカウンタ、データレジスタ、命令レジスタ、汎用レジスタ等)から構成され、記憶資源25に格納されているプログラム250を実行することで、後述するメニュー登録機能等の各種機能を実現する。プログラム250の一例として、店舗端末2にインストールされたメニュー登録用のアプリケーションプログラム(商品データ登録プログラム。以下、「メニュー登録アプリ」ともいう。)がある。このアプリケーションプログラムは、例えば、管理サーバ3からネットワークNを通じてダウンロードし、店舗端末2にインストールする。 The processor 21 includes an arithmetic logic unit and various registers (a program counter, a data register, an instruction register, a general-purpose register, etc.), and executes a program 250 stored in the storage resource 25, whereby a menu registration function to be described later Various functions such as are realized. As an example of the program 250, there is a menu registration application program (product data registration program; hereinafter also referred to as “menu registration application”) installed in the store terminal 2. For example, the application program is downloaded from the management server 3 through the network N and installed in the store terminal 2.
 通信インタフェース22は、管理サーバ3との接続インタフェースを提供するものであり、無線通信インタフェースまたは有線通信インタフェースから構成される。入力デバイス23は、ユーザからの入力操作を受け付けるインタフェースを提供するものであり、タッチパネル、キーボード、マウス等を例示することができる。表示デバイス24は、後述するメニュー登録画面等の画像表示インタフェースをユーザに提供するものであり、例えば、有機ELディスプレイ、液晶ディスプレイ、CRTディスプレイ等が挙げられる。本実施形態では、入力デバイス23および表示デバイス24として、例示的にタッチパネル付きディスプレイを用いる。 The communication interface 22 provides a connection interface with the management server 3 and includes a wireless communication interface or a wired communication interface. The input device 23 provides an interface for accepting an input operation from a user, and examples thereof include a touch panel, a keyboard, a mouse, and the like. The display device 24 provides an image display interface such as a menu registration screen described later to the user, and examples thereof include an organic EL display, a liquid crystal display, and a CRT display. In this embodiment, as the input device 23 and the display device 24, a display with a touch panel is used as an example.
 記憶資源25は、例えば、物理デバイスの記憶領域が提供する論理デバイスである。物理デバイスは、例えば、ディスクドライブまたは半導体メモリ等のコンピュータ読み取り可能な記録媒体である。記憶資源25には、上記プログラム250に加え、オペレーティングシステムプログラム、ドライバプログラム、各種データ等が格納される。ドライバプログラムとしては、例えば、入力デバイス23を制御するための入力デバイスドライバプログラムや、表示デバイス24を制御するための出力デバイスドライバプログラム等がある。各種データとしては、例えば、商品名データおよび料金データを含むメニューデータがある。メニューデータは、例えばメニュー情報DB252に記憶される、 Storage resource 25 is, for example, a logical device provided by a storage area of a physical device. The physical device is a computer-readable recording medium such as a disk drive or a semiconductor memory. In addition to the program 250, the storage resource 25 stores an operating system program, a driver program, various data, and the like. Examples of the driver program include an input device driver program for controlling the input device 23, an output device driver program for controlling the display device 24, and the like. Examples of the various data include menu data including product name data and fee data. The menu data is stored in, for example, the menu information DB 252.
 本実施形態におけるプログラム250は、例示的に、メニュー登録処理モジュール251を有する。このメニュー登録処理モジュール251を実行することでメニュー登録機能が発現する。図3~図8を参照し、メニュー登録機能を利用してメニューデータを登録する際の手順について、その一例を説明する。図3は、メニューデータを登録する際の店舗端末2における基本的な処理の流れを例示するフローチャートであり、図4~図8は、その際の店舗端末2における表示画面の一例を示す図である。 The program 250 in this embodiment has a menu registration processing module 251 as an example. By executing the menu registration processing module 251, a menu registration function is manifested. An example of a procedure for registering menu data using the menu registration function will be described with reference to FIGS. FIG. 3 is a flowchart illustrating the basic processing flow in the store terminal 2 when registering menu data, and FIGS. 4 to 8 are diagrams showing examples of display screens in the store terminal 2 at that time. is there.
 最初に、ユーザである店員の操作に応じて、店舗端末2のメニュー登録アプリの起動要求を受け付けると、店舗端末2のメニュー登録処理モジュール251は、図4に示すメニュー登録画面(登録画面領域)24Sをディスプレイ24に表示させる(ステップS101)。上記メニュー登録アプリの起動要求は、例えば、店舗端末2のディスプレイ24に表示されたアイコンをタップ(選択)等することで行う。 First, when a request for starting the menu registration application of the store terminal 2 is received according to the operation of the store clerk who is the user, the menu registration processing module 251 of the store terminal 2 displays the menu registration screen (registration screen area) shown in FIG. 24S is displayed on the display 24 (step S101). The activation request for the menu registration application is made by, for example, tapping (selecting) an icon displayed on the display 24 of the store terminal 2.
 続いて、店員の操作に応じて、メニュー登録に利用するメニュー画像を選択する画面の表示要求を受け付けると、メニュー登録処理モジュール251は、図5に示すメニュー画像選択画面241を、メニュー登録画面24S上にポップアップ表示させる(ステップS102)。上記メニュー画像は、商品名および料金を表示するメニューを撮影した画像である。上記メニュー画像を選択する画面の表示要求は、例えば、“メニュー画像を表示する”ボタン24aをタップ等することで行う。 Subsequently, when a display request for a screen for selecting a menu image to be used for menu registration is received according to the operation of the store clerk, the menu registration processing module 251 displays the menu image selection screen 241 shown in FIG. 5 as the menu registration screen 24S. A pop-up is displayed above (step S102). The menu image is an image obtained by photographing a menu for displaying product names and charges. The display request for the screen for selecting the menu image is made by, for example, tapping the “display menu image” button 24a.
 続いて、店員の操作に応じて、メニュー画像の選択要求を受け付けると、メニュー登録処理モジュール251は、図6に示すように、選択されたメニュー画像24fをメニュー登録画面24Sの画像表示領域に表示させる(ステップS103)。上記メニュー画像の選択要求は、例えば、図5に示すメニュー画像選択画面241上で所望のメニュー画像24fに対応するファイル名“IMG_6198.JPG”241aを選択し、“開く”ボタン241bをタップ等することで行う。 Subsequently, when a menu image selection request is received according to the operation of the store clerk, the menu registration processing module 251 displays the selected menu image 24f in the image display area of the menu registration screen 24S as shown in FIG. (Step S103). For the selection request of the menu image, for example, the file name “IMG — 6198.JPG” 241a corresponding to the desired menu image 24f is selected on the menu image selection screen 241 shown in FIG. 5, and the “Open” button 241b is tapped. Do that.
 続いて、店員の操作に応じて、メニュー画像24fのうち、登録対象となる商品名および料金の表示領域がそれぞれ個別に指定されると、メニュー登録処理モジュール251は、図7に示すように、指定された商品名の表示領域ごとに、文字認識の対象範囲を画定するための矩形24gを表示させ、指定された料金の表示領域ごとに、上記矩形24hを表示させる(ステップS104)。上記商品名および料金の表示領域の指定は、例えば、メニュー画像24f上をなぞることで行い、なぞる方向に応じて2種類の矩形24g、24hを表示させる。以下に具体的に説明する。 Subsequently, when the product name and the charge display area to be registered are individually specified in the menu image 24f according to the operation of the store clerk, the menu registration processing module 251 performs the following operation as shown in FIG. A rectangle 24g for demarcating a character recognition target range is displayed for each designated product name display area, and the rectangle 24h is displayed for each designated charge display area (step S104). The product name and the charge display area are specified by, for example, tracing the menu image 24f, and two types of rectangles 24g and 24h are displayed according to the tracing direction. This will be specifically described below.
 商品名の表示領域は、店員が、登録対象となる商品名の左端付近から右端付近に向けて右方向に指でなぞることで指定する。メニュー登録処理モジュール251は、ディスプレイ24に表示された画像上をなぞることで特定される始点(接触開始点)と終点(接触終了点)とに基づいて、始点から終点までの移動方向が右方向であると判定した場合に、商品名用の矩形24gを表示する。 The product name display area is specified by the salesclerk tracing with the finger in the right direction from the left end of the product name to be registered toward the right end. The menu registration processing module 251 determines that the moving direction from the start point to the end point is rightward based on the start point (contact start point) and end point (contact end point) specified by tracing the image displayed on the display 24. When it is determined that the product name is rectangular, the product name rectangle 24g is displayed.
 一方、料金の表示領域は、店員が、登録対象となる料金の右端付近から左端付近に向けて左方向に指でなぞることで指定する。メニュー登録処理モジュール251は、ディスプレイ24に表示された画像上をなぞることにより特定される始点と終点とに基づいて、始点から終点までの移動方向が左方向であると判定した場合に、料金用の矩形24hを表示する。 On the other hand, the charge display area is specified by the clerk tracing with the finger in the left direction from the right end of the charge to be registered toward the left end. When the menu registration processing module 251 determines that the moving direction from the start point to the end point is the left direction based on the start point and the end point specified by tracing on the image displayed on the display 24, A rectangle 24h is displayed.
 本実施形態では、例示的に、メニュー画像の横方向をX軸とし、縦方向をY軸とするXY座標を利用して、始点および終点の特定や、矩形の表示位置の決定を行うこととする。以下に具体的に説明する。 In the present embodiment, for example, using the XY coordinates with the horizontal direction of the menu image as the X axis and the vertical direction as the Y axis, the start point and the end point are specified and the rectangular display position is determined. To do. This will be specifically described below.
 最初に、メニュー登録処理モジュール251は、タッチパネル付きディスプレイ24により検知される接触開始点と接触終了点とに基づいて始点と終点とを特定する。 First, the menu registration processing module 251 specifies the start point and the end point based on the contact start point and the contact end point detected by the display 24 with a touch panel.
 続いて、メニュー登録処理モジュール251は、終点のY座標を始点のY座標と同じ値に変更する。これは、なぞる操作にはぶれが生じ易いのに対し、例えば横書きのメニューでは、商品名や料金が横方向の直線上に表示されることが多いことを考慮して設けられた機能である。始点および終点のY座標を同じ値に揃えることで、矩形の長辺方向をメニューの文字方向に揃えることが可能となり、商品名や料金の表示方向に合わせて矩形を配置し易くする効果がある。 Subsequently, the menu registration processing module 251 changes the Y coordinate of the end point to the same value as the Y coordinate of the start point. This is a function provided in consideration that, for example, in a horizontally written menu, a product name and a charge are often displayed on a straight line in the horizontal direction, while the tracing operation is likely to be shaken. By aligning the Y coordinate of the start point and the end point to the same value, it is possible to align the long side direction of the rectangle with the character direction of the menu, and it has the effect of making it easier to arrange the rectangle according to the display direction of the product name and price .
 続いて、メニュー登録処理モジュール251は、矩形の左辺(高さ)の中点を始点座標上に設定し、矩形の右辺(高さ)の中点を終点座標上に設定することで、矩形の表示位置を決定する。続いて、メニュー登録処理モジュール251は、決定した表示位置に矩形を表示する。 Subsequently, the menu registration processing module 251 sets the midpoint of the left side (height) of the rectangle on the start point coordinates, and sets the midpoint of the right side (height) of the rectangle on the end point coordinates. Determine the display position. Subsequently, the menu registration processing module 251 displays a rectangle at the determined display position.
 矩形の表示位置は、矩形全体をドラッグすることで任意に変更することができる。また、表示されている各矩形は、それぞれを選択することで、例えば矩形の四隅にサイズ調整部24iが出現し、そのサイズ調整部24iをドラッグ等してサイズを調節することで、矩形のサイズを任意に変更することができる。 The display position of the rectangle can be changed arbitrarily by dragging the entire rectangle. Further, by selecting each of the displayed rectangles, for example, the size adjusting unit 24i appears at the four corners of the rectangle, and the size is adjusted by dragging the size adjusting unit 24i to adjust the size of the rectangle. Can be changed arbitrarily.
 矩形のサイズを変更すると、変更後の矩形のサイズ(例えば高さ(幅)、長さ等)がメモリに記憶される。この矩形のサイズは、矩形の種類ごとに記憶することとしてもよい。メニュー登録処理モジュール251は、矩形を表示する際に、その時点でメモリに記憶されているサイズに基づいて同じ高さの矩形を表示する。 When the rectangle size is changed, the changed rectangle size (for example, height (width), length, etc.) is stored in the memory. The size of this rectangle may be stored for each type of rectangle. When displaying the rectangle, the menu registration processing module 251 displays the rectangle having the same height based on the size stored in the memory at that time.
 同じ高さの矩形を表示する機能は、メニューに表示される商品名および料金が、同じ大きさの文字で表示されることが多いことを勘案して設けられたものである。この機能を利用することで、例えば、横書きの商品名の文字の高さに合わせて矩形の高さを変更した場合には、他の商品名や料金に矩形を表示する際に、変更後の高さと同じ高さの矩形を表示させることができることとなり、矩形の高さを調節する手間を省くことが可能となる。 The function to display a rectangle with the same height is provided in consideration of the fact that the product name and price displayed on the menu are often displayed in the same size. By using this function, for example, when the height of the rectangle is changed to match the height of the characters of the horizontally written product name, when the rectangle is displayed for other product names and prices, A rectangle having the same height as the height can be displayed, and it is possible to save time and effort for adjusting the height of the rectangle.
 また、メニュー登録処理モジュール251は、画像上を、例えばダブルタップされた場合に、そのダブルタップされた座標を始点(基点)として、その時点でメモリに記憶されているサイズと同じサイズの矩形を表示する。また、画像上に表示されている矩形がダブルタップされた場合には、その矩形を削除する。同じサイズの矩形を表示する機能は、メニューに表示されている商品名や料金の長さが揃っているほど、矩形のサイズを変更する手間を削減することができ、作業効率を向上させることが可能となる。 In addition, when the menu registration processing module 251 is double-tapped on the image, for example, the double-tapped coordinate is used as a starting point (base point), and a rectangle having the same size as the size stored in the memory at that time is used. indicate. When a rectangle displayed on the image is double-tapped, the rectangle is deleted. The function to display rectangles of the same size can reduce the effort to change the size of the rectangles as the product names and prices displayed in the menu are the same, improving work efficiency. It becomes possible.
 特に、メニューに表示される料金の長さは同じ長さになることが多いため、いずれかの料金に合わせて矩形のサイズを変更することで、その後に表示する他の料金の矩形のサイズを変更する手間を省略することができ、作業負担を軽減させることが可能となる。 In particular, the length of the charge displayed on the menu is often the same length, so changing the size of the rectangle according to one of the charges will change the size of the rectangle for other charges to be displayed after that. It is possible to save the labor of changing, and to reduce the work load.
 一方、メニューに表示される商品名の長さは揃わないことが多いが、商品名と料金との間には、最も長い商品名に合わせて空白が埋められることが多いため、最も長い商品名に合わせた矩形を用いて文字認識することとしても、文字認識の精度を維持することができる。そこで、商品名に矩形を表示させる際に、最も長い商品名に合わせて矩形のサイズを変更することで、その後に表示する他の商品名の矩形のサイズを変更する手間を省くことができ、作業負担を軽減させることが可能となる。 On the other hand, the length of the product name displayed in the menu is often not the same, but since the space between the product name and the price is often filled with the longest product name, the longest product name Character recognition accuracy can be maintained even when character recognition is performed using a rectangle matched to the above. Therefore, when displaying a rectangle in the product name, by changing the size of the rectangle according to the longest product name, you can save the trouble of changing the size of the rectangle of the other product name to be displayed after that, The work burden can be reduced.
 また、メニュー登録処理モジュール251は、右方向になぞることで表示される商品名用の矩形24gを、例示的に水色のハイライトを用いて強調表示し、左方向になぞることで表示される料金用の矩形24hを、例示的に黄色のハイライトを用いて強調表示する。これにより、商品名の表示領域と料金の表示領域とを視覚的に判別し易くすることができる。 Further, the menu registration processing module 251 highlights the product name rectangle 24g displayed by tracing in the right direction by using, for example, light blue highlights, and the fee displayed by tracing in the left direction. The rectangle 24h is highlighted using, for example, yellow highlights. This makes it easy to visually distinguish the product name display area and the charge display area.
 図3に示すフローチャートの説明に戻る。上記ステップS104で登録対象の商品名および料金に対してそれぞれ矩形24g、24hが表示された後、店員により、図7に示すメニュー登録画面24Sの“解析”ボタン24bがタップ等されると、メニュー登録処理モジュール251は、矩形24g、24h内の画像に含まれる認識対象を、矩形24g、24hの種類ごとに定められた文字認識処理を利用して文字認識し、テキストデータに変換する(ステップS105)。以下に具体的に説明する。 Returning to the flowchart shown in FIG. After the rectangles 24g and 24h are displayed for the product names and charges to be registered in step S104, the store clerk taps the “analysis” button 24b on the menu registration screen 24S shown in FIG. The registration processing module 251 recognizes characters to be recognized included in the images in the rectangles 24g and 24h by using a character recognition process determined for each type of the rectangles 24g and 24h, and converts the recognition targets into text data (step S105). ). This will be specifically described below.
 矩形が、画像上を右方向になぞることで表示された商品用の矩形24gである場合には、商品名のパターン認識に特化した文字認識処理を利用して文字認識し、テキストデータに変換する。一方、矩形が、画像上を左方向になぞることで表示された料金用の矩形24hである場合には、料金のパターン認識に特化した文字認識処理を利用して文字認識し、テキストデータに変換する。 If the rectangle is a product rectangle 24g displayed by tracing the image to the right, character recognition is performed using character recognition processing specialized for product name pattern recognition and converted to text data. To do. On the other hand, if the rectangle is a fee rectangle 24h displayed by tracing the left direction on the image, character recognition is performed using character recognition processing specialized for fee pattern recognition, and the text data is converted into text data. Convert.
 ここで、文字認識処理の内容は、特に制限されず、例えば、一般的なOCR(Optical Character Reader:光学式文字読取装置)技術に代表される画像認識系アプリケーションを適用することができる。また、OCR技術に代えて、データ学習に用いるいわゆるディープラーニング(Deep Learning)技術を適用することもできる。かかるディープラーニング技術を含む文字認識は、例えば、画像処理、機械学習および言語処理(認識結果補正)のステップを含めて構成することができる。 Here, the content of the character recognition process is not particularly limited, and for example, an image recognition system application represented by a general OCR (Optical Character Reader) technology can be applied. Further, a so-called deep learning technique used for data learning can be applied instead of the OCR technique. Character recognition including such deep learning technology can be configured including, for example, steps of image processing, machine learning, and language processing (recognition result correction).
 続いて、メニュー登録処理モジュール251は、上記ステップS105で変換した各テキストデータを、図8に示すメニュー登録画面24Sの各商品名欄24dおよび各料金欄24eに、順次(テキストデータに変換するごとに)入力し、表示する(ステップS106)。 Subsequently, the menu registration processing module 251 sequentially converts each text data converted in step S105 to each product name field 24d and each price field 24e of the menu registration screen 24S shown in FIG. Input) and display (step S106).
 ここで、メニュー登録処理モジュール251は、変換したテキストデータの数に合わせて、商品名欄24dおよび料金欄24eを、メニュー登録画面24S上に逐次追加していく。 Here, the menu registration processing module 251 sequentially adds a product name field 24d and a charge field 24e on the menu registration screen 24S according to the number of converted text data.
 また、メニュー登録処理モジュール251は、対応付けられた商品名用の矩形24gと料金用の矩形24hとに対応するテキストデータを、メニュー登録画面24S上で同一行に配置されている商品名欄24dおよび料金欄24eにそれぞれ入力して表示させる。商品名用の矩形24gと料金用の矩形24hとの対応付けは、例えば、以下の(1)~(3)のいずれかにより行うことができる。 Also, the menu registration processing module 251 stores the text data corresponding to the associated product name rectangle 24g and the charge rectangle 24h on the same line on the menu registration screen 24S. And the charges are displayed in the charge column 24e. The association between the product name rectangle 24g and the charge rectangle 24h can be performed, for example, by any one of the following (1) to (3).
 (1)矩形24gと矩形24hとがそれぞれ画像上に表示された順番に従って、同じ順番の矩形同士を対応付ける。その際、表示された順番を店員が確認できるように、矩形24gおよび矩形24hの近くにそれぞれの表示順に対応する番号を表示させることとしてもよい。 (1) Rectangles in the same order are associated with each other according to the order in which the rectangles 24g and 24h are displayed on the image. In that case, it is good also as displaying the number corresponding to each display order near the rectangle 24g and the rectangle 24h so that a salesclerk can confirm the order displayed.
 (2)解析を開始する前に、矩形24gおよび矩形24hを店員にそれぞれ順番にタップさせ、タップされた順番に従って、同じ順番の矩形同士を対応付ける。このとき、タップされた順番に対応する番号を矩形24gおよび矩形24hの近くにそれぞれ表示させることとしてもよい。 (2) Before starting the analysis, let the clerk tap the rectangles 24g and 24h in order, and associate the rectangles in the same order according to the tapped order. At this time, the numbers corresponding to the tapped order may be displayed near the rectangle 24g and the rectangle 24h, respectively.
 (3)解析を開始する前に、矩形24gと矩形24hとを結び付けるリンク線を店員に設定させ、そのリンク線で結ばれた矩形同士を対応付ける。 (3) Before starting the analysis, let the clerk set a link line connecting the rectangle 24g and the rectangle 24h, and associate the rectangles connected by the link line with each other.
 なお、商品名欄24dおよび料金欄24eの内容は、ユーザが任意に変更することができる。また、商品名欄24dおよび料金欄24eを削除する場合には、その商品名欄24dおよび料金欄24eと同一行にある削除ボタン24jをタップ等することで、その削除ボタン24jに対応する行全体を削除することができる。 The contents of the product name column 24d and the fee column 24e can be arbitrarily changed by the user. Further, when deleting the product name field 24d and the charge field 24e, the entire line corresponding to the delete button 24j can be obtained by tapping the delete button 24j on the same line as the product name field 24d and the charge field 24e. Can be deleted.
 図3に示すフローチャートの説明に戻る。上記ステップS106で商品名欄24dおよび料金欄24eにデータが入力された後、店員の操作に応じて、メニューデータの登録要求を受け付けると、メニュー登録処理モジュール251は、メニュー登録画面24Sに設けられた商品名欄24dおよび料金欄24eに入力されたデータに基づいて、メニュー情報DB252にメニューデータを登録する(ステップS107)。上記メニューデータの登録要求は、例えば、図8に示すメニュー登録画面24Sの“登録”ボタン24cをタップ等することで行う。 Returning to the flowchart shown in FIG. After the data is input to the product name column 24d and the fee column 24e in the above step S106, the menu registration processing module 251 is provided on the menu registration screen 24S when a registration request for menu data is received according to the operation of the store clerk. Menu data is registered in the menu information DB 252 based on the data input to the product name column 24d and the fee column 24e (step S107). The menu data registration request is made, for example, by tapping the “registration” button 24c on the menu registration screen 24S shown in FIG.
 上述したように、実施形態における店舗端末2によれば、商品名および料金を含むメニュー画像24fをメニュー登録画面24Sに表示し、店員による画像上をなぞる操作を受け付けるごとに、始点から終点までの移動方向が右方向または左方向のいずれに該当するかを判定し、その判定した方向に対応付けられた矩形24g、24hを、画像上に表示することができる。さらに、右方向に対応付けられた矩形24g内の画像に含まれる認識対象を、商品名のパターン認識に特化した文字認識処理を利用してテキストデータに変換し、左方向に対応付けられた矩形24h内の画像に含まれる認識対象を、料金のパターン認識に特化した文字認識処理を利用してテキストデータに変換してから、メニュー登録画面24Sの商品名欄24dおよび料金欄24eにそれぞれ入力し、その入力したデータに基づいて、メニュー情報DB252にメニューデータを登録することができる。 As described above, according to the store terminal 2 in the embodiment, the menu image 24f including the product name and the charge is displayed on the menu registration screen 24S, and each time an operation of tracing the image by the store clerk is received, the start point to the end point are received. It can be determined whether the moving direction corresponds to the right direction or the left direction, and the rectangles 24g and 24h associated with the determined direction can be displayed on the image. Furthermore, the recognition target included in the image in the rectangle 24g associated with the right direction is converted into text data using a character recognition process specialized for product name pattern recognition, and is associated with the left direction. The recognition target included in the image in the rectangle 24h is converted into text data by using a character recognition process specialized in fee pattern recognition, and is then displayed in the product name column 24d and the fee column 24e on the menu registration screen 24S, respectively. The menu data can be registered in the menu information DB 252 based on the input data.
 これにより、実施形態における店舗端末2によれば、メニューデータを登録する際の労力を軽減することができ、店舗端末2を利用するシステムの導入を促進させることが可能となる。 Thereby, according to the store terminal 2 in the embodiment, the labor for registering the menu data can be reduced, and the introduction of the system using the store terminal 2 can be promoted.
 ここで、本願発明は、以下の事項に着眼してなされたことに特徴がある。メニュー(商品価格表)は、商品とその料金との組み合わせが行単位に表示されることが多い。また、商品に利用される文字は、例えば飲食店の種類等によりある程度絞り込むことができ、料金に関しては数字に絞り込むことができる。したがって、文字認識の対象を商品名とする場合には、商品名に利用される文字のパターンを用いて文字認識処理を行うことで、商品名の認識率を向上させることができる。一方、文字認識の対象を料金とする場合には、料金に利用される数字のパターンを用いて文字認識処理を行うことで、料金の認識率を向上させることができる。 Here, the present invention is characterized in that it has been made with attention to the following matters. Menus (product price lists) often display combinations of products and their prices in line units. Moreover, the character used for goods can be narrowed down to some extent by the kind of restaurant etc., for example, and it can narrow down to a number regarding a charge. Therefore, when the character recognition target is the product name, the recognition rate of the product name can be improved by performing the character recognition process using the character pattern used for the product name. On the other hand, when the object of character recognition is a charge, the charge recognition rate can be improved by performing character recognition processing using a numeric pattern used for the charge.
 これらの点を勘案し、本願発明は、メニュー画像24f上で右方向になぞられた場合には、商品名がなぞられたと判定し、そのなぞられた箇所に商品名用の矩形24gを表示するとともに、矩形24g内の画像に含まれる認識対象を、商品名のパターン認識に特化した文字認識処理を利用して文字認識し、テキストデータに変換する。 Taking these points into consideration, when the present invention is traced in the right direction on the menu image 24f, it is determined that the product name has been traced, and the product name rectangle 24g is displayed at the traced location. At the same time, the recognition target included in the image in the rectangle 24g is recognized by using a character recognition process specialized in the pattern recognition of the product name, and converted into text data.
 また、メニュー画像24f上で左方向になぞられた場合には、料金がなぞられたと判定し、そのなぞられた箇所に料金用の矩形24hを表示するとともに、矩形24h内の画像に含まれる認識対象を、料金のパターン認識に特化した文字認識処理を利用して文字認識し、テキストデータに変換する。 When the menu image 24f is traced to the left, it is determined that the fee has been traced, and a fee rectangle 24h is displayed at the traced location, and the recognition included in the image within the rectangle 24h. Characters are recognized using character recognition processing specialized for fee pattern recognition, and converted into text data.
 本願発明は、これらの文字認識機能を備えることで、メニューデータを登録する際の労力を軽減させることを可能としたものである。また、本願発明によれば、認識に必要な箇所(商品名および料金)をピンポイントに指定して文字認識処理を行うことができるため、不要な文字に対する文字認識処理を排除することができる。それゆえ、文字認識の精度を向上させつつ、文字認識の処理速度を短縮することができる。 The invention of the present application is able to reduce the labor when registering the menu data by providing these character recognition functions. Further, according to the present invention, since character recognition processing can be performed by specifying a point (product name and fee) necessary for recognition as a pinpoint, character recognition processing for unnecessary characters can be eliminated. Therefore, the character recognition processing speed can be shortened while improving the accuracy of character recognition.
 [変形例]
 なお、本発明は、上述した実施形態に限定されるものではなく、本発明の要旨を逸脱しない範囲内において、他の様々な形で実施することができる。このため、上記実施形態はあらゆる点で単なる例示にすぎず、限定的に解釈されるものではない。例えば、上述した各処理ステップは処理内容に矛盾を生じない範囲で任意に順番を変更し、または並列に実行することができる。
[Modification]
The present invention is not limited to the above-described embodiment, and can be implemented in various other forms without departing from the gist of the present invention. For this reason, the said embodiment is only a mere illustration in all points, and is not interpreted limitedly. For example, the above-described processing steps can be arbitrarily changed in order as long as the processing contents do not contradict each other, or can be executed in parallel.
 また、上述した実施形態では、店舗端末2がタッチパネル付きディスプレイを搭載したタブレット端末であることを前提にして説明しているため、メニュー画像24f上をなぞることで矩形24g、24hを表示させているが、店舗端末2がタッチパネルのないディスプレイを搭載した端末である場合には、以下のようにして矩形24g、24hを表示させることとすればよい。 In the above-described embodiment, the store terminal 2 is described on the assumption that it is a tablet terminal equipped with a display with a touch panel. Therefore, the rectangles 24g and 24h are displayed by tracing the menu image 24f. However, when the store terminal 2 is a terminal equipped with a display without a touch panel, the rectangles 24g and 24h may be displayed as follows.
 例えば、店員が、登録対象となる商品名の左端付近でマウスをクリックし、クリックしたままマウスポインタを商品名の右端付近までドラッグした場合に、商品名用の矩形24gを表示させる。一方、店員が、登録対象となる料金の右端付近でマウスをクリックし、クリックしたままマウスポインタを料金の左端付近までドラッグした場合に、料金用の矩形24hを表示させる。 For example, when the store clerk clicks the mouse near the left end of the product name to be registered and drags the mouse pointer to the right end of the product name while clicking, the product name rectangle 24g is displayed. On the other hand, when the store clerk clicks the mouse near the right end of the charge to be registered and drags the mouse pointer to the vicinity of the left end of the charge while clicking, the charge rectangle 24h is displayed.
 また、上述した実施形態では、画像上を右方向になぞった場合に、商品名用の矩形24gを表示させ、画像上を左方向になぞった場合に、料金用の矩形24hを表示させているが、これに限定されない。例えば、画像上を左方向になぞった場合に、商品名用の矩形24gを表示させ、画像上を右方向になぞった場合に、料金用の矩形24hを表示させることとしてもよい。 In the above-described embodiment, the product name rectangle 24g is displayed when the image is traced to the right, and the fee rectangle 24h is displayed when the image is traced to the left. However, it is not limited to this. For example, the product name rectangle 24g may be displayed when the image is traced to the left, and the fee rectangle 24h may be displayed when the image is traced to the right.
 また、上述した実施形態では、メニューが横書きである場合について説明しているが、メニューが縦書きである場合にも本発明を適用することができる。縦書きの場合には、以下のようにして矩形24g、24hを表示させることとすればよい。 In the above-described embodiment, the case where the menu is horizontally written has been described. However, the present invention can also be applied to the case where the menu is vertically written. In the case of vertical writing, the rectangles 24g and 24h may be displayed as follows.
 例えば、店員が、登録対象となる商品名の上端付近から下端付近に向けて下方向になぞった場合に、商品名用の矩形24gを表示させる。一方、店員が、登録対象となる料金の下端付近から上端付近に向けて上方向になぞった場合に、料金用の矩形24hを表示させる。これとは別に、画像上を上方向になぞった場合に、商品名用の矩形24gを表示させ、画像上を下方向になぞった場合に、料金用の矩形24hを表示させることとしてもよい。 For example, when the store clerk traces downward from the vicinity of the upper end of the product name to be registered toward the lower end, the product name rectangle 24g is displayed. On the other hand, when the store clerk traces upward from the vicinity of the lower end of the charge to be registered toward the upper end, the charge rectangle 24h is displayed. Alternatively, the product name rectangle 24g may be displayed when the image is traced upward, and the fee rectangle 24h may be displayed when the image is traced downward.
 また、上述した実施形態では、メニュー登録に利用するメニュー画像を、保存されている画像の中から選択しているが、これに限定されない。例えば、店舗端末2に搭載されるカメラを用いて撮影した画像を、メニュー画像として利用することとしてもよい。 In the above-described embodiment, the menu image used for menu registration is selected from the stored images. However, the present invention is not limited to this. For example, an image taken using a camera mounted on the store terminal 2 may be used as a menu image.
 また、上述した実施形態では、商品名および料金を含むメニューデータを登録する場合について説明したが、これに限定されず、商品名および料金を含む商品データを登録する場合に本発明を適用することができる。 In the above-described embodiment, the case of registering the menu data including the product name and the fee has been described. However, the present invention is not limited to this, and the present invention is applied to the case of registering the product data including the product name and the fee. Can do.
 また、上述した実施形態において、店員が、商品名や料金の表示範囲よりも大きな範囲に矩形24g、24hを設定した場合に、矩形24g、24hの大きさを商品名や料金の表示範囲に縮小する機能を追加することとしてもよい。矩形24g、24hの大きさを商品名や料金の表示範囲に縮小する際の手順を以下に例示する。 Further, in the embodiment described above, when the store clerk sets the rectangles 24g and 24h in a range larger than the display range of the product name and the charge, the size of the rectangles 24g and 24h is reduced to the display range of the product name and the charge. It is good also as adding the function to do. A procedure for reducing the size of the rectangles 24g and 24h to the display range of the product name and the charge will be exemplified below.
 最初に、矩形内の画像を白黒に二値化する。続いて、文字の羅列に関する制約条件に基づいて、二値化データに含まれる黒の範囲を特定する。特定された黒の範囲に合わせて矩形24g、24hを表示する。これにより、矩形24g、24hの大きさを商品名や料金の表示範囲に縮小することができる。 First, binarize the image in the rectangle to black and white. Subsequently, the black range included in the binarized data is specified based on the restriction condition regarding the enumeration of characters. The rectangles 24g and 24h are displayed in accordance with the specified black range. Thereby, the size of the rectangles 24g and 24h can be reduced to the display range of the product name and the charge.
 さらに、上述した実施形態において、店員が設定した矩形24g、24hに、商品名や料金以外の文字群が含まれることとなった場合に、商品名や料金の表示範囲にのみ矩形24g、24hを表示させる機能を追加することとしてもよい。商品名や料金以外の文字群として、例えば、商品の説明文が該当する。商品名や料金の表示範囲にのみ矩形24g、24hを表示させる際の手順を以下に例示する。 Further, in the above-described embodiment, when the rectangles 24g and 24h set by the store clerk include character groups other than the product name and the fee, the rectangles 24g and 24h are displayed only in the display range of the product name and the fee. A function to be displayed may be added. As a character group other than the product name and the charge, for example, a description of the product is applicable. A procedure for displaying the rectangles 24g and 24h only in the display range of the product name and the charge will be exemplified below.
 最初に、矩形内の画像を白黒に二値化する。続いて、文字の羅列に関する制約条件に基づいて、二値化データに含まれる黒の範囲をグループ化していく。続いて、グループ化により形成されたグループを、グループ単位に文字群として特定する。続いて、特定した複数の文字群のうち、表示面積が最大となる文字群を選択し、その選択した文字群の表示範囲にのみ矩形24g、24hを表示させる。 First, binarize the image in the rectangle to black and white. Subsequently, the black range included in the binarized data is grouped on the basis of the restriction condition regarding the enumeration of characters. Subsequently, the group formed by grouping is specified as a character group for each group. Subsequently, the character group having the maximum display area is selected from the plurality of specified character groups, and the rectangles 24g and 24h are displayed only in the display range of the selected character group.
 この場合、特定した複数の文字群を、文字認識の候補として店員に提示し、店員により選択された文字群の表示範囲にのみ、矩形24g、24hを表示させることとしてもよい。 In this case, the plurality of specified character groups may be presented to the store clerk as candidates for character recognition, and the rectangles 24g and 24h may be displayed only in the display range of the character group selected by the store clerk.
 また、実施形態におけるプログラムは、CD-ROM等の光学ディスク、磁気ディスク、半導体メモリなどの各種の記録媒体(コンピュータ読み取り可能な記録媒体)を通じて、または通信ネットワークなどを介してダウンロードすることにより、コンピュータにインストールまたはロードすることができる。 In addition, the program in the embodiment is downloaded through various recording media (computer-readable recording media) such as an optical disk such as a CD-ROM, a magnetic disk, and a semiconductor memory, or via a communication network. Can be installed or loaded.
 本発明に係る商品データ登録端末、商品データ登録方法および商品データ登録プログラムは、商品データを登録する際の労力を軽減することに適している。 The product data registration terminal, the product data registration method, and the product data registration program according to the present invention are suitable for reducing labor when registering product data.
1…商品管理システム、2…店舗端末、3…管理サーバ、21…プロセッサ、22…通信インタフェース、23…入力デバイス、24…表示デバイス、24S…メニュー登録画面、24a…メニュー画像を表示するボタン、24b…解析ボタン、24c…登録ボタン、24d…商品名欄、24e…料金欄、24f…メニュー画像、24g…商品名用の矩形、24h…料金用の矩形、24i…サイズ調整部、24j…削除ボタン、25…記憶資源、250…プログラム、251…メニュー登録処理モジュール、252…メニュー情報DB、N…ネットワーク DESCRIPTION OF SYMBOLS 1 ... Merchandise management system, 2 ... Store terminal, 3 ... Management server, 21 ... Processor, 22 ... Communication interface, 23 ... Input device, 24 ... Display device, 24S ... Menu registration screen, 24a ... Button for displaying menu image, 24b ... Analysis button, 24c ... Registration button, 24d ... Product name column, 24e ... Price column, 24f ... Menu image, 24g ... Rectangle for product name, 24h ... Rectangle for fee, 24i ... Size adjustment section, 24j ... Delete Button, 25 ... Storage resource, 250 ... Program, 251 ... Menu registration processing module, 252 ... Menu information DB, N ... Network

Claims (9)

  1.  商品名および料金を含む画像を表示する手段と、
     ユーザによる始点および終点を特定するための操作ごとに、前記始点から前記終点までの移動方向が、予め定めた第1方向または当該第1方向と逆向きの第2方向のいずれに該当するかを判定し、当該判定した方向に対応付けられ、かつ前記画像において文字認識をする範囲を指定するための矩形を、前記画像上に表示する手段と、
     前記第1方向に対応付けられた前記矩形内の画像に含まれる認識対象を、商品名のパターン認識に特化した文字認識処理を利用してテキストデータに変換する、一方、前記第2方向に対応付けられた前記矩形内の画像に含まれる認識対象を、料金のパターン認識に特化した文字認識処理を利用してテキストデータに変換する手段と、
     商品データを登録するための登録画面領域に設けられる商品名入力欄および料金入力欄に、前記変換されたそれぞれのテキストデータを入力して表示する手段と、
     前記商品名入力欄および前記料金入力欄に入力されたデータに基づいて、商品名データおよび料金データを含む商品データを記憶部に登録する手段と、
     を備える商品データ登録端末。
    Means for displaying an image including the product name and price;
    Whether the moving direction from the start point to the end point corresponds to a predetermined first direction or a second direction opposite to the first direction for each operation for specifying a start point and an end point by the user Means for determining, on the image, a rectangle for designating a range associated with the determined direction and for character recognition in the image;
    The recognition target included in the image in the rectangle associated with the first direction is converted into text data using a character recognition process specialized for product name pattern recognition, while in the second direction Means for converting a recognition target included in the image in the associated rectangle into text data using a character recognition process specialized in fee pattern recognition;
    Means for inputting and displaying each of the converted text data in a product name input field and a charge input field provided in a registration screen area for registering product data;
    Means for registering product data including product name data and fee data in a storage unit based on the data input in the product name input column and the fee input column;
    A product data registration terminal comprising:
  2.  ユーザの操作に従って、前記矩形のサイズを変更する手段と、
     最後に変更された前記矩形のサイズを記憶する手段と、をさらに備え、
     前記矩形を表示する手段は、前記記憶された前記サイズと同じ幅の前記矩形を表示する請求項1記載の商品データ登録端末。
    Means for changing the size of the rectangle according to a user operation;
    Means for storing the size of the rectangle changed last, and
    The product data registration terminal according to claim 1, wherein the means for displaying the rectangle displays the rectangle having the same width as the stored size.
  3.  前記矩形を表示する手段は、ユーザにより基点を指定するための操作がなされた場合には、前記記憶された前記サイズと同じサイズの前記矩形を、前記基点を基準にして表示する請求項2記載の商品データ登録端末。 The means for displaying the rectangle displays the rectangle having the same size as the stored size based on the base point when an operation for designating a base point is performed by a user. Product data registration terminal.
  4.  前記第1方向に対応付けられた前記矩形と前記第2方向に対応付けられた前記矩形とを対応付ける手段をさらに備え、
     前記テキストデータを入力して表示する手段は、前記対応付けられた双方の前記矩形に対応する前記テキストデータを、前記登録画面領域で同一行に配置されている前記商品名入力欄および前記料金入力欄にそれぞれ入力して表示させる請求項1~3のいずれか1項に記載の商品データ登録端末。
    Means for associating the rectangle associated with the first direction with the rectangle associated with the second direction;
    The means for inputting and displaying the text data includes the product name input field and the fee input, wherein the text data corresponding to both of the associated rectangles are arranged on the same line in the registration screen area. The commodity data registration terminal according to any one of claims 1 to 3, wherein the commodity data is input and displayed in each of the columns.
  5.  前記対応付ける手段は、前記第1方向に対応付けられた前記矩形と前記第2方向に対応付けられた前記矩形とがそれぞれ前記画像上に表示された順番に従って、同じ順番の前記矩形同士を対応付ける請求項4記載の商品データ登録端末。 The association means associates the rectangles in the same order according to the order in which the rectangles associated with the first direction and the rectangles associated with the second direction are displayed on the image, respectively. Item 4. A product data registration terminal according to item 4.
  6.  前記第1方向に対応付けられた前記矩形と前記第2方向に対応付けられた前記矩形とを関連付ける操作を受け付ける手段をさらに備え、
     前記対応付ける手段は、前記受け付けられた前記操作により関連付けられた前記矩形同士を対応付ける請求項4記載の商品データ登録端末。
    Means for accepting an operation for associating the rectangle associated with the first direction and the rectangle associated with the second direction;
    The product data registration terminal according to claim 4, wherein the association unit associates the rectangles associated by the accepted operation.
  7.  前記画像は、メニューの画像である、請求項1~6のいずれか1項に記載の商品データ登録端末。 The product data registration terminal according to any one of claims 1 to 6, wherein the image is a menu image.
  8.  端末が実行する方法であって、
     商品名および料金を含む画像を表示するステップと、
     ユーザによる始点および終点を特定するための操作ごとに、前記始点から前記終点までの移動方向が、予め定めた第1方向または当該第1方向と逆向きの第2方向のいずれに該当するかを判定し、当該判定した方向に対応付けられ、かつ前記画像において文字認識をする範囲を指定するための矩形を、前記画像上に表示するステップと、
     前記第1方向に対応付けられた前記矩形内の画像に含まれる認識対象を、商品名のパターン認識に特化した文字認識処理を利用してテキストデータに変換する、一方、前記第2方向に対応付けられた前記矩形内の画像に含まれる認識対象を、料金のパターン認識に特化した文字認識処理を利用してテキストデータに変換するステップと、
     商品データを登録するための登録画面領域に設けられる商品名入力欄および料金入力欄に、前記変換されたそれぞれのテキストデータを入力して表示するステップと、
     前記商品名入力欄および前記料金入力欄に入力されたデータに基づいて、商品名データおよび料金データを含む商品データを記憶部に登録するステップと、
     を含む商品データ登録方法。
    A method performed by a terminal,
    Displaying an image including product name and price;
    Whether the moving direction from the start point to the end point corresponds to a predetermined first direction or a second direction opposite to the first direction for each operation for specifying a start point and an end point by the user Determining and displaying on the image a rectangle for designating a range associated with the determined direction and performing character recognition in the image;
    The recognition target included in the image in the rectangle associated with the first direction is converted into text data using a character recognition process specialized for product name pattern recognition, while in the second direction Converting a recognition target included in the image in the associated rectangle into text data using a character recognition process specialized in fee pattern recognition;
    Inputting and displaying each converted text data in a product name input field and a charge input field provided in a registration screen area for registering product data; and
    Registering product data including product name data and fee data in a storage unit based on the data input in the product name input column and the fee input column;
    Product data registration method including
  9.  コンピュータを、
     商品名および料金を含む画像を表示する手段、
     ユーザによる始点および終点を特定するための操作ごとに、前記始点から前記終点までの移動方向が、予め定めた第1方向または当該第1方向と逆向きの第2方向のいずれに該当するかを判定し、当該判定した方向に対応付けられ、かつ前記画像において文字認識をする範囲を指定するための矩形を、前記画像上に表示する手段、
     前記第1方向に対応付けられた前記矩形内の画像に含まれる認識対象を、商品名のパターン認識に特化した文字認識処理を利用してテキストデータに変換する、一方、前記第2方向に対応付けられた前記矩形内の画像に含まれる認識対象を、料金のパターン認識に特化した文字認識処理を利用してテキストデータに変換する手段、
     商品データを登録するための登録画面領域に設けられる商品名入力欄および料金入力欄に、前記変換されたそれぞれのテキストデータを入力して表示する手段、
     前記商品名入力欄および前記料金入力欄に入力されたデータに基づいて、商品名データおよび料金データを含む商品データを記憶部に登録する手段、
     として機能させる商品データ登録プログラム。
    Computer
    Means for displaying images including product names and prices;
    Whether the moving direction from the start point to the end point corresponds to a predetermined first direction or a second direction opposite to the first direction for each operation for specifying a start point and an end point by the user Means for displaying on the image a rectangle for determining and designating a range associated with the determined direction and performing character recognition in the image;
    The recognition target included in the image in the rectangle associated with the first direction is converted into text data using a character recognition process specialized for product name pattern recognition, while in the second direction Means for converting a recognition target included in the image in the associated rectangle into text data using a character recognition process specialized in fee pattern recognition;
    Means for inputting and displaying the converted text data in a product name input field and a charge input field provided in a registration screen area for registering product data;
    Means for registering product data including product name data and fee data in a storage unit based on data input to the product name input column and the fee input column;
    Product data registration program to function as
PCT/JP2017/012791 2016-03-29 2017-03-29 Commodity data registration terminal, commodity data registration method, and commodity data registration program WO2017170632A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016-066479 2016-03-29
JP2016066479A JP6099788B1 (en) 2016-03-29 2016-03-29 Product data registration terminal, product data registration method, and product data registration program

Publications (1)

Publication Number Publication Date
WO2017170632A1 true WO2017170632A1 (en) 2017-10-05

Family

ID=58363131

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/012791 WO2017170632A1 (en) 2016-03-29 2017-03-29 Commodity data registration terminal, commodity data registration method, and commodity data registration program

Country Status (2)

Country Link
JP (1) JP6099788B1 (en)
WO (1) WO2017170632A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110991446A (en) * 2019-11-22 2020-04-10 上海欧冶物流股份有限公司 Label identification method, device, equipment and computer readable storage medium

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7057583B2 (en) * 2017-07-23 2022-04-20 株式会社フューチャー・アイ Order system
JP2020095710A (en) * 2018-12-12 2020-06-18 京セラドキュメントソリューションズ株式会社 Information processing apparatus
JP7275563B2 (en) * 2018-12-20 2023-05-18 カシオ計算機株式会社 Product data registration device and program

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05151387A (en) * 1991-11-26 1993-06-18 Ricoh Co Ltd Recognition object area designating system
JPH11306281A (en) * 1998-04-27 1999-11-05 Nec Corp Recognizing condition specifying system, its method, and recording medium in which program to generate recognizing condition specifying function on computer is recorded
JP2004054540A (en) * 2002-07-19 2004-02-19 Kainoa Technologies Inc Commodity vending system and program for creating electronic catalogue
JP2014081888A (en) * 2012-10-18 2014-05-08 Zenrin Datacom Co Ltd Order support device, order support method and order support program
JP2015197685A (en) * 2014-03-31 2015-11-09 凸版印刷株式会社 Electronic leaflet information processing system and electronic leaflet information processing method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05151387A (en) * 1991-11-26 1993-06-18 Ricoh Co Ltd Recognition object area designating system
JPH11306281A (en) * 1998-04-27 1999-11-05 Nec Corp Recognizing condition specifying system, its method, and recording medium in which program to generate recognizing condition specifying function on computer is recorded
JP2004054540A (en) * 2002-07-19 2004-02-19 Kainoa Technologies Inc Commodity vending system and program for creating electronic catalogue
JP2014081888A (en) * 2012-10-18 2014-05-08 Zenrin Datacom Co Ltd Order support device, order support method and order support program
JP2015197685A (en) * 2014-03-31 2015-11-09 凸版印刷株式会社 Electronic leaflet information processing system and electronic leaflet information processing method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110991446A (en) * 2019-11-22 2020-04-10 上海欧冶物流股份有限公司 Label identification method, device, equipment and computer readable storage medium

Also Published As

Publication number Publication date
JP6099788B1 (en) 2017-03-22
JP2017182325A (en) 2017-10-05

Similar Documents

Publication Publication Date Title
JP6071948B2 (en) Information processing apparatus, display method, and control program
WO2017170632A1 (en) Commodity data registration terminal, commodity data registration method, and commodity data registration program
US20160011766A1 (en) Device and method for displaying information
US10013156B2 (en) Information processing apparatus, information processing method, and computer-readable recording medium
US20140321751A1 (en) Character input apparatus and method
US10642471B2 (en) Dual timeline
JP5453577B1 (en) Information processing apparatus, information processing method, and information processing program
JP2013235450A (en) Information processing apparatus, and control method and program of information processing apparatus
US10275439B2 (en) Information processing device, display method and control program
US20100138732A1 (en) Method for implementing small device and touch interface form fields to improve usability and design
JP5945645B1 (en) Product data registration terminal, product data registration method, and product data registration program
JP2019095849A (en) Document processing apparatus and program
JP2017204311A (en) Information processing device, document management system, document management server, information processing method, and program therefor
JP6657799B2 (en) Graphic processing apparatus, graphic processing method, and graphic processing program
EP3159783B1 (en) Selection option information presentation system and method
US10509543B2 (en) Control method for ordering of a displayed list, and control apparatus and storage medium provided therewith
JP2014174874A (en) List display device and list display program
JP5820891B2 (en) Information processing apparatus, information processing method, and information processing program
JP7310980B2 (en) Information processing device, graph display method and program
JP5638589B2 (en) POSITION DISPLAY CONTROL DEVICE, POSITION DISPLAY CONTROL METHOD, AND POSITION DISPLAY CONTROL PROGRAM
US20180081532A1 (en) Display device and display control method
EP3051795A1 (en) Image capturing device, image capturing method, and program
JP2018010382A (en) Display device and display control program
JP2016115127A (en) Document management program, document management method, and document management apparatus
JP5878489B2 (en) Information processing apparatus and program

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17775169

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 17775169

Country of ref document: EP

Kind code of ref document: A1