JP2014123240A - Order terminal, bag monitoring method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an order terminal for outputting a warning when a bag is moved from a table or a seat.SOLUTION: A CPU 10 of an order terminal 1 enters a bag monitoring mode when a touch operation of a bag monitoring mode button 141a is detected with a touch panel 15. The CPU determines whether a bag on a table or a seat is moved based on an image shot acquired by a camera 16. When it is determined that the bag has been moved, a warning is outputted from a display section 14 and a voice output section 17.

Description

  The present invention relates to an order terminal, a package monitoring method, and a program.

  Conventionally, when a customer performs a touch operation on a product image, an order terminal for self-order is known that determines an order (order) object and the number of orders and generates order information (see, for example, Patent Document 1). ).

JP 2010-44548 A

By the way, in restaurants and the like, customers often remove their seats.
However, conventional order terminals cannot exert deterrence against luggage theft. As a result, customers had to rush to work or carry their baggage every time they removed their seats.

  An object of the present invention is to enable a warning to be output when a load is moved from a table or a seat in an order terminal.

In order to solve the above-mentioned problem, the invention described in claim 1
In the order terminal that transmits the input order information to the server device,
Photographing means for photographing a table or a seat;
Determination means for determining whether or not a predetermined condition for shifting to the monitoring mode is satisfied;
Luggage movement determining means for determining whether or not the luggage on the table or the seat has been moved based on a photographed image acquired by the photographing means when it is determined by the determining means that the predetermined condition is satisfied; ,
A warning output means for outputting a warning when the load movement determination means determines that the load has been moved;
Is provided.

  According to the present invention, since a warning is output when a package is moved from a table or a seat at the order terminal, it is possible to prevent theft of the package without introducing a dedicated security camera system or the like.

It is a figure which shows the example of installation of the order terminal in this embodiment. It is a block diagram which shows the functional structure of the order terminal of FIG. It is a flowchart which shows the control processing performed by CPU of FIG. 2 in 1st Embodiment. It is a figure which shows an example of an initial screen. It is a flowchart which shows the monitoring object designation | designated mode process performed by CPU of FIG. It is a figure which shows an example of the monitoring target designation | designated screen. It is a flowchart which shows the package monitoring mode process performed by CPU of FIG. It is a figure which shows an example of the monitoring mode screen. It is a figure which shows an example of a warning screen. It is a flowchart which shows the control process B performed by CPU of FIG. 2 in 2nd Embodiment.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. The present invention is not limited to the illustrated example.

[First Embodiment]
<Configuration of order terminal 1>
As shown in FIG. 1, the order terminal 1 according to the present embodiment is arranged in each table of a restaurant, generates order information according to the input operation of the customer C of the table, and the customer C takes a seat off. It is a terminal device that sometimes monitors the load B placed on the table or its seat. The table includes a table and the like.

  FIG. 2 shows a functional configuration example of the order terminal 1. As shown in FIG. 2, the order terminal 1 includes a CPU (Central Processing Unit) 10, a RAM (Random Access Memory) 11, a storage unit 12, a wireless communication unit 13, a display unit 14, a touch panel 15, a camera 16, and an audio output unit. 17 and the like, and each part is connected by a bus 18.

  The CPU 10 reads out the program stored in the storage unit 12 and develops it in the work area of the RAM 11, and executes various processes including control processing described later according to the developed program. The CPU 10 functions as determination means, load movement determination means, and face recognition processing means by executing control processing.

The RAM 11 is a volatile memory, and has a work area for storing various programs executed by the CPU 10, data related to these various programs, and the like.
The RAM 11 includes a monitoring target area setting information area for storing monitoring target area setting information (details will be described later) and an area for storing order information.

  The storage unit 12 includes an HDD (Hard Disk Drive), a semiconductor nonvolatile memory, and the like. The storage unit 12 stores a system program executed by the CPU 10, various processing programs, data necessary for executing these programs, and the like. The program is stored in the storage unit 12 in the form of computer-readable program code. The CPU 10 sequentially executes operations according to the program code.

The wireless communication unit 13 includes a wireless local area network (LAN) module, and performs wireless communication with an external device such as the server device 2 via an access point (not shown).
Here, the server device 2 is a computer device that is arranged in a backyard or the like in a store and comprehensively manages the order information transmitted from each order terminal 1. A unique table number is assigned to each order terminal 1 in each table, and the server apparatus 2 manages the order information for each table transmitted from each order terminal 1 based on the table number. In addition, the server device 2 is connected to a cash register terminal (not shown), sends a payment completion notice to the order terminal 1 of the table number for which payment has been performed at the cash register terminal, and is stored in the order terminal 1 for the order terminal 1 The information related to the customer C (for example, information on a monitoring target area described later, order information, etc.) is reset.

  The display unit 14 is configured by an LCD (Liquid Crystal Display) or the like, and performs various displays according to a display control signal from the CPU 10.

  The touch panel 15 is a pressure-sensitive (resistive film pressure type) touch panel in which transparent electrodes are arranged in a grid pattern so as to cover the upper surface of the display unit 14. The touch panel 15 detects a touch operation with a finger, a touch pen, or the like, and The position information is output to the CPU 10. Note that the touch panel 15 is not limited to the pressure-sensitive type, and may be another type of capacitance, optical, electromagnetic induction, or the like. Further, in the present embodiment, the case where the operation means is the touch panel 15 will be described as an example, but hardware such as a keyboard and operation buttons and a mouse provided in the casing of the order terminal 1 may be used.

  The camera 16 includes an imaging element such as a lens, a diaphragm, a CCD (Charge Coupled Device), or a CMOS (Complementary Metal Oxide Semiconductor), and forms an optical image of a subject on the imaging element, and uses the image as an electrical signal. It outputs to CPU10. As shown in FIG. 1, the camera 16 is an imaging unit that is provided on an upper part of the display unit 14 of the order terminal 1 and photographs a range including at least the table on which the order terminal 1 is arranged or the seat thereof.

The audio output unit 17 outputs a predetermined warning sound from the speaker in accordance with a control signal from the CPU 10.
<Operation of order terminal 1>
Next, the operation in this embodiment will be described.

  FIG. 3 shows a flowchart of the control process executed by the order terminal 1. The control process is executed in cooperation with the CPU 10 and the program stored in the storage unit 12 while the order terminal 1 is powered on.

First, the CPU 10 displays an initial screen 141 on the display unit 14 (step S1).
FIG. 4 shows an example of the initial screen 141. As shown in FIG. 4, the initial screen 141 is provided with an order operation area 14A and a parcel monitoring operation area 14B.
The order operation area 14 </ b> A is an area for performing operations related to cooking orders. For example, buttons for selecting menu categories such as meat dishes, pasta, salad, and sweets are displayed in the order operation area 14A. When any button is touch-operated, a detailed menu screen (not shown) of a category corresponding to the touch-operated button is displayed. The order of dishes can be registered by inputting and confirming the number of menus to be ordered.
The package monitoring operation area 14B is an area for performing operations related to package monitoring. The package monitoring operation area 14B is provided with a package monitoring mode button 141a and a monitoring target designation mode button 141b. The package monitoring mode button 141a is a button for instructing a shift to the package monitoring mode. The monitoring target designation mode button 141b is a button for instructing a shift to the monitoring target designation mode.

When the operation of the order operation area 14A is detected by the touch panel 15 on the initial screen 141 (step S2; YES), the CPU 10 executes a process corresponding to the operation (step S3) and returns to the process of step S1.
For example, when the touch operation of any button in the order operation area 14A of the initial screen 141 is detected by the touch panel 15, the CPU 10 displays a detailed menu screen of the category corresponding to the touched button on the display unit 14. indicate. When the touch panel 15 detects the number of input operations (for example, touch operation of an arrow key, etc.) to any of the menus on the detailed menu screen, and then detects the confirmation operation (for example, the touch operation of the confirmation button), The CPU 10 generates order information based on the menu number, the number, and the table number of the menu, stores the generated order information in a predetermined area of the RAM 11, and transmits it to the server device 2 through the wireless communication unit 13.

  When the touch operation of the monitoring target designation mode button 141b is detected by the touch panel 15 on the initial screen 141 (step S2; NO, step S4; YES), the CPU 10 executes the monitoring target designation mode process (step S5). .

FIG. 5 shows a flowchart of the monitoring target designation mode process. This process is executed in cooperation with the CPU 10 and the program stored in the storage unit 12.
First, the CPU 10 displays a monitoring target designating screen 142 on the display unit 14 (step S401).

  FIG. 6 shows an example of the monitoring target designation screen 142. The monitoring target designation screen 142 includes a designation area 142a, an OK button 142b, and a cancel button 142c. The designation area 142a is an area that displays a captured image captured by the camera 16 and accepts an operation for designating a monitoring target area. The OK button 142b is a button for instructing to set an area designated in the designation area 142a as a monitoring target area. The cancel button 142c is a button for instructing to cancel the designation of the monitoring target area.

  Next, the CPU 10 causes the camera 16 to capture an image, and displays the obtained captured image in the designation area 142a of the monitoring target designation screen 142 (step S402).

When the touch panel 15 detects the designation operation of the area on the designation area 142a (step S403; YES) and then detects the touch operation of the OK button 142b (step S404; YES), the CPU 10 designates The area is set as a monitoring target area (step S405), and the process returns to step S1 in FIG.
For example, by touching two points on the designation area 142a, a rectangular area having a line connecting the two points as a diagonal line can be designated as the monitoring target area. When a plurality of areas are specified in step S403, the CPU 10 sets the specified areas as monitoring target areas. In step S405, specifically, the position information (coordinates) of the designated area is stored in the monitoring target area setting information area of the RAM 11 as monitoring target area setting information.

  When the touch operation of the cancel button 142c is detected by the touch panel 15 (step S403; NO, step S404; NO, step S406; YES), the CPU 10 returns to the process of step S1 in FIG.

  On the other hand, when the touch operation of the package monitoring mode button 141a is detected by the touch panel 15 on the initial screen 141 (step S2; NO, step S4; NO, step S6; YES), the CPU 10 shifts to the package monitoring mode. It is determined that the condition for satisfying the condition is satisfied, and the package monitoring mode process is executed (step S7).

FIG. 7 shows a flowchart of the package monitoring mode process. This process is executed in cooperation with the CPU 10 and the program stored in the storage unit 12.
First, the CPU 10 displays a monitoring mode screen 143 on the display unit 14 (step S701).

  FIG. 8 shows an example of the monitoring mode screen 143 displayed on the display unit 14 when the package monitoring mode is entered. As shown in FIG. 8, on the monitoring mode screen 143, a message 143a indicating that the operation is being performed in the package monitoring mode, such as “watching the package”, and an instruction to stop the monitoring. A monitoring stop button 143b is displayed.

  Next, the CPU 10 causes the camera 16 to capture a captured image (step S702), and determines whether there is a change in the image within the monitoring target area (step S703). When the monitoring target area setting information is stored in the monitoring target area setting area of the storage unit 12, the monitoring target area is an area indicated by the monitoring target area setting information, and the monitoring target area setting information is displayed in the monitoring target area setting area. Is not stored, it is the entire captured image. For example, whether or not there is a change in the image in the monitoring target area is determined by storing the image captured in the first (or previous) step S702 in the RAM 11, and the image stored in the RAM 11 and the current step. The images in the monitoring target area of the image taken in S702 are compared and collated. If they do not match, it is determined that the image in the monitoring target area has a change.

  When it is determined that there is no change in the image in the designated monitoring target area (step S703; NO), the CPU 10 determines whether or not the touch operation of the monitoring stop button 143b is detected by the touch panel 15 (step S705). . When determining that the touch operation of the monitoring stop button 143b has not been detected (step S705; NO), the CPU 10 returns to the process of step S702.

If it is determined in step S703 that there is a change in the image within the designated monitoring target area (step S703; YES), the CPU 10 determines that the luggage on the table or seat has been moved, and the monitoring mode of the display unit 14 is determined. The screen 143 displays a warning screen 144 that warns that the package has been moved, and outputs a warning sound by the audio output unit 17 (step S704), and returns to the processing of step S702.
FIG. 9 shows an example of the warning screen 144. As shown in FIG. 9, the warning screen 144 displays a warning message such as “Luggage is moved”.

  In step S705, when it is determined that the touch operation of the monitoring stop button 143b is detected from the touch panel 15 (step S705; YES), the CPU 10 cancels the package monitoring mode (step S706), and performs the process of step S1 in FIG. Return.

Thus, in the first embodiment, in the order terminal 1, when the package monitoring mode button 141a for instructing the transition to the package monitoring mode is touch-operated, a range including at least a table or a seat by the camera 16 Is periodically photographed (monitored), and there is a change in the image within the monitoring target area of the photographed image, it is determined that the package has been moved, and a warning screen 144 is displayed on the display unit 14 and an audio output unit 17 outputs a warning sound.
Accordingly, since the order terminal 1 can output a warning when the package is moved from the table or the seat, it is possible to prevent the package from being stolen without introducing a dedicated security camera system or the like. Further, the customer C can take his / her seat with confidence while leaving the luggage on the table or seat.

[Second Embodiment]
Hereinafter, the second embodiment will be described.
Since the configuration of the order terminal 1 in the second embodiment is the same as that described in the first embodiment, it will be described, and the operation of the second embodiment will be described below.

  FIG. 10 shows a flowchart of the control process B executed by the order terminal 1 in the second embodiment. The control process B is executed by the cooperation of the CPU 10 and the program stored in the storage unit 12 while the order terminal 1 is powered on.

  First, the CPU 10 displays an initial screen 141 on the display unit 14 (step S21). The initial screen 141 is the screen shown in FIG.

  Next, the CPU 10 causes the camera 16 to capture an image (step S22), and performs face recognition processing on the obtained captured image (step S23). For the face recognition process, for example, a known image processing technique such as a Viola-Jones method using AdaBoost can be applied.

If the face area is recognized as a result of the face recognition process, that is, if there is a person on the table (step S24; YES), the CPU 10 determines that the condition for shifting to the package monitoring mode is satisfied, and the initial screen 141 In response to the operation of the touch panel 15 from step S25 to step S28.
When the operation of the order operation area 14A is detected by the touch panel 15 on the initial screen 141 (step S25; YES), the CPU 10 executes a process corresponding to the operation (step S26), and returns to the process of step S21. The processing in step S26 is the same as that described in step S3 in FIG.
When the touch operation of the monitoring target designation mode button 141b is detected by the touch panel 15 on the initial screen 141 (step S25; NO, step S27; YES), the CPU 10 executes the monitoring target designation mode process (step S28). . Since the monitoring target designation mode process is the same as that described with reference to FIG. 5 in the first embodiment, the description is used.

  When the face area is not recognized as a result of the face recognition process, that is, when there is no person in the table (step S24; NO), the CPU 10 executes the package monitoring mode process (step S29). Since the package monitoring mode process is the same as that described with reference to FIG. 7 in the first embodiment, the description is used.

As described above, in the second embodiment, when the face is not recognized by the face recognition processing of the captured image in the order terminal 1, that is, when there is no person on the table, the camera 16 includes at least a table or a seat. When the range is periodically photographed (monitored) and there is a change in the image in the monitoring target area of the obtained photographed image, a warning screen 144 is displayed on the display unit 14 and a warning sound is output by the audio output unit 17. Is output.
Therefore, since the order terminal 1 can output a warning when the package is moved from the table or seat when there is no customer C, the order terminal 1 can prevent theft of the package without introducing a dedicated security camera system or the like. It becomes possible. Further, the customer C does not need to perform an operation of shifting to the luggage monitoring mode in the order terminal 1 when removing the seat, and can remove the seat with confidence while leaving the luggage in the seat.

  As described above, according to the CPU 10 of the order terminal 1, when a predetermined condition is satisfied, the baggage monitoring mode is entered and the baggage on the table or seat moves based on the captured image acquired by the camera 16. It is determined whether or not the package has been moved, and if it is determined that the package has been moved, a warning is output from the display unit 14 and the audio output unit 17.

  Accordingly, since the order terminal 1 can output a warning when the package is moved from the table or the seat and can notify the customer C, the order terminal 1 prevents theft of the package without introducing a dedicated security camera system or the like. It becomes possible. Further, the customer C can take his / her seat with confidence while leaving the luggage on the table or seat.

  Further, for example, when the touch operation of the package monitoring mode button 141a is detected by the touch panel 15, the package can be monitored when the customer C desires by shifting to the package monitoring mode. Become.

  In addition, for example, when the face area is not recognized from the photographed image taken by the camera 16, the customer C shifts to the baggage monitoring mode when he / she removes his / her seat. There is no need to operate, and convenience is improved.

  In addition, by configuring the monitoring target area so that the customer C can designate, it becomes possible to prevent malfunction due to movement of objects other than luggage (for example, dishes on a table, etc.).

  In addition, the description content in the said embodiment is a suitable example of the order terminal 1 which concerns on this invention, and is not limited to this.

For example, in the above embodiment, the CPU 10 has been described as releasing the package monitoring mode when the touch panel 15 detects that the monitoring stop button 143b is pressed. However, the CPU 10 performs identity verification when the monitoring stop button 143b is pressed, The baggage monitoring mode may be canceled when the identity is confirmed.
For example, an input button for the customer C to input a password number or the like is prepared in advance on the initial screen 141 or the like, and the input password number is stored in the RAM 11 or the like. The package monitoring mode may be canceled when the touch panel 15 detects that the monitoring stop button 143b is pressed and an input of a number that matches the password stored in the RAM 11 is detected.
Further, for example, the face image (latest face image) recognized in the face recognition process in step S23 of FIG. 10 is stored in the RAM 11, and the camera 16 takes a picture when the depression of the monitoring stop button 143b is detected. The face image recognized by the face recognition process is compared with the face image stored in the RAM 11 from the obtained captured image, and when the two match, the package monitoring mode is canceled and stored in the RAM 11. Delete the face image.
Thereby, security in the package monitoring mode can be improved.

  In the above embodiment, in the monitoring target designation mode process, the monitoring target area is designated by touching the designation area 142a. However, the present invention is not limited to this, and the CPU 10 may be an external terminal such as a portable terminal. May be acquired by the wireless communication unit 13, and an area on the designation area 142a corresponding to the luggage information may be designated as a monitoring target area by known image recognition.

  Also, as a computer-readable medium storing a program for executing each of the above processes, a non-volatile memory such as a flash memory, a portable recording medium such as a CD-ROM, in addition to a ROM, a hard disk, etc. Is also possible. A carrier wave is also used as a medium for providing program data via a predetermined communication line.

  In addition, the detailed configuration and detailed operation of each device constituting the order terminal can be changed as appropriate without departing from the spirit of the invention.

(Appendix)
Although several embodiments of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and equivalents thereof.
The invention described in the scope of claims attached to the application of this application will be added below. The item numbers of the claims described in the appendix are as set forth in the claims attached to the application of this application.
<Claim 1>
In the order terminal that transmits the input order information to the server device,
Photographing means for photographing a table or a seat;
Determination means for determining whether or not a predetermined condition for shifting to the monitoring mode is satisfied;
Luggage movement determining means for determining whether or not the luggage on the table or the seat has been moved based on a photographed image acquired by the photographing means when it is determined by the determining means that the predetermined condition is satisfied; ,
A warning output means for outputting a warning when the load movement determination means determines that the load has been moved;
Order terminal equipped with.
<Claim 2>
An operation means for instructing the transition to the monitoring mode is provided,
The order terminal according to claim 1, wherein the determination unit determines that the predetermined condition is satisfied when the operation unit instructs to shift to the monitoring mode.
<Claim 3>
Comprising face recognition processing means for performing face recognition processing on a photographed image photographed by the photographing means;
The order terminal according to claim 1, wherein the determination unit determines that the predetermined condition is satisfied when a face area is not recognized from the captured image by the face recognition processing unit.
<Claim 4>
Display means for displaying a photographed image acquired by the photographing means;
Designation means for designating a monitoring target area from the captured image displayed on the display means;
With
The said load movement determination means determines whether the load on the said table or a seat was moved based on the image of the said designated monitoring object area | region of the captured image acquired by the said imaging means. The order terminal as described in any one of.
<Claim 5>
A package information acquisition means for acquiring package information from an external terminal;
Designation means for designating a monitoring target area based on the baggage information from a photographed image photographed by the photographing means;
With
The said load movement determination means determines whether the load on the said table or a seat was moved based on the image of the said designated monitoring object area | region of the captured image acquired by the said imaging means. The order terminal as described in any one of.
<Claim 6>
A luggage monitoring method using an order terminal equipped with a photographing means for photographing a table or a seat,
A step of determining whether or not a predetermined condition for shifting to the monitoring mode is satisfied;
A step of determining whether or not a load on the table or the seat has been moved based on a captured image acquired by the imaging means when it is determined that the predetermined condition is satisfied;
Outputting a warning when it is determined that the package has been moved; and
Including luggage monitoring methods.
<Claim 7>
A computer used for an order terminal having a photographing means for photographing a table or a seat,
Determination means for determining whether or not a predetermined condition for shifting to the monitoring mode is satisfied;
A baggage movement determination unit that determines whether or not the baggage on the table or the seat has been moved based on a photographed image acquired by the photographing unit when the determination unit determines that the predetermined condition is satisfied;
A warning output means for outputting a warning when it is determined by the load movement determination means that the load has been moved;
Program to function as.

1 Order terminal 10 CPU
11 RAM
12 Storage unit 13 Wireless communication unit 14 Display unit 141 Initial screen 14A Order operation area 14B Luggage monitoring operation area 141a Luggage monitoring mode button 141b Monitoring target designation mode button 142 Monitoring target designation screen 142a Designation area 142b OK button 142c Cancel Button 143 Monitoring mode screen 143b Monitoring stop button 144 Warning screen 15 Touch panel 16 Camera 17 Audio output unit

Claims (7)

In the order terminal that transmits the input order information to the server device,
Photographing means for photographing a table or a seat;
Determination means for determining whether or not a predetermined condition for shifting to the monitoring mode is satisfied;
Luggage movement determining means for determining whether or not the luggage on the table or the seat has been moved based on a photographed image acquired by the photographing means when it is determined by the determining means that the predetermined condition is satisfied; ,
A warning output means for outputting a warning when the load movement determination means determines that the load has been moved;
Order terminal equipped with. An operation means for instructing the transition to the monitoring mode is provided,
The order terminal according to claim 1, wherein the determination unit determines that the predetermined condition is satisfied when the operation unit instructs to shift to the monitoring mode. Comprising face recognition processing means for performing face recognition processing on a photographed image photographed by the photographing means;
The order terminal according to claim 1, wherein the determination unit determines that the predetermined condition is satisfied when a face area is not recognized from the captured image by the face recognition processing unit. Display means for displaying a photographed image acquired by the photographing means;
Designation means for designating a monitoring target area from the captured image displayed on the display means;
With
The said load movement determination means determines whether the load on the said table or a seat was moved based on the image of the said designated monitoring object area | region of the captured image acquired by the said imaging means. The order terminal as described in any one of. A package information acquisition means for acquiring package information from an external terminal;
Designation means for designating a monitoring target area based on the baggage information from a photographed image photographed by the photographing means;
With
The said load movement determination means determines whether the load on the said table or a seat was moved based on the image of the said designated monitoring object area | region of the captured image acquired by the said imaging means. The order terminal as described in any one of. A luggage monitoring method using an order terminal equipped with a photographing means for photographing a table or a seat,
A step of determining whether or not a predetermined condition for shifting to the monitoring mode is satisfied;
A step of determining whether or not a load on the table or the seat has been moved based on a captured image acquired by the imaging means when it is determined that the predetermined condition is satisfied;
Outputting a warning when it is determined that the package has been moved; and
Including luggage monitoring methods. A computer used for an order terminal having a photographing means for photographing a table or a seat,
Determination means for determining whether or not a predetermined condition for shifting to the monitoring mode is satisfied;
A baggage movement determination unit that determines whether or not the baggage on the table or the seat has been moved based on a photographed image acquired by the photographing unit when the determination unit determines that the predetermined condition is satisfied;
A warning output means for outputting a warning when it is determined by the load movement determination means that the load has been moved;
Program to function as.

Images