JP2010026683A - Wearable device, ordering system, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a wearable device for easily confirming order even in a state where both hands are used. <P>SOLUTION: The wearable device includes: table specifying means 5, 22, 23, 24 for specifying tables in a restaurant, etc., within the visual field of a device wearing person H; order input means 5, 7, 26 for inputting the order content of the specified table; an order storage part 25 for storing the inputted order content; a display part 4 for displaying the order within the visual field; and a display control part 21 for controlling the displaying of the display part 4. The display control part 21 displays the order content of the table when the order content of the table specified by the table specifying means 5, 22, 23, 24 is stored in the order storage part 25. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a wearable device, an ordering system, and a program used for order management of restaurants and the like.

Conventionally, as an ordering system (ordering device), a waiter or waiter possesses a portable order terminal for inputting the order of each table, and an order controller for receiving and storing orders from the portable order terminal. Is known (see Patent Document 1). In the portable order terminal, the table (seat) number and the number of the dish ordered by the customer are input as an order.
JP 2002-123870 A

By the way, in order to efficiently perform customer service, waitresses and waiters need to perform customer service while confirming the order of each table. In the ordering system, it is conceivable to confirm the order by receiving and displaying the order of the target table from the order controller with the portable order terminal.
However, in such a configuration, in order to confirm the order, it is necessary to take out the portable order terminal and input the table number, and there is a problem that confirmation of the order is complicated. In addition, waitresses and waiters often have their hands blocked when performing customer service, and there is a problem that the order cannot be confirmed.

  An object of the present invention is to provide a wearable device, an ordering system, and a program capable of easily confirming an order even when both hands are closed.

  The wearable device of the present invention includes a table specifying means for specifying a table in a store included in the field of view of the wearer of the apparatus, an order input means for inputting an order of the specified table, and an order of each table input by the order input means. Order storage means for storing the information, display means for displaying the order stored in the order storage means in the field of view, and display control means for controlling display of the display means. The display control means is a table specifying means. When the order of the table specified by the above is stored in the order storage means, the order of the table is displayed.

  The ordering system of the present invention is an ordering system having a wearable device mounted on a store clerk and an in-store server arranged in the store, and the wearable device specifies a table in the store included in the field of view of the device wearer. The table specifying means to perform, the order input means for inputting the order of the specified table, the table specifying result by the table specifying means, and the order input by the order input means are transmitted to the in-store server and transmitted from the in-store server. An apparatus-side communication means for receiving information, a display means for displaying information transmitted from the in-store server in the field of view, and a display control means for controlling display of the display means, the in-store server communicates with the wearable device Received from the wearable device and server side communication means to Order storage means for storing the order of the table, and when receiving the table specification result from the wearable device, if the order of the table based on the table specification result is stored in the order storage means, information is transmitted via the server side communication means. And an information providing means for transmitting the order of the table to the wearable device.

  According to these configurations, when the device wearer looks at one table in the store, the table identified by the device wearer is specified by the table specifying means. When the specified table order is stored, the specified table order is displayed in the field of view of the apparatus wearer. In this way, when the device wearer sees the table on which the order has been input, the order of the table is displayed in the view of the device wearer, so that the device wearer can easily and simply view the table. You can confirm the order without using your hands. In addition, since the order is input for the table specified by the table specifying means, it is not necessary to input a table number or the like for specifying the table when inputting the order. Instead of performing each process in units of tables, each process may be performed in units of seats. In this case, instead of specifying the table, the seat is specified.

  In the wearable device, the display control means displays an operation screen for inputting an order by the order input means in the field of view when an arbitrary table is specified by the table specifying means. Preferably, the order is entered by sensing the movement of the device wearer's finger with respect to.

  According to this configuration, when the order is input by the display control means, an operation screen for inputting the order is displayed in the field of view of the apparatus wearer. When the device wearer moves his / her finger on the displayed operation screen, the order wearer senses the device wearer's finger. Thereby, the device wearer can input an order by moving a finger. In this way, a special terminal for inputting an order is not required, and the order can be input without taking out the terminal.

  In this case, an identification mark for identifying each table is affixed to the table, and the table specifying means has mark recognition means for capturing at least a part of the field of view and recognizing the identification mark. It is preferable to specify the table based on the recognition result of the identification mark by the recognition means.

  According to this configuration, when the identification mark is image-recognized by the mark recognition unit that captures at least part of the field of view of the apparatus wearer, the table viewed by the apparatus wearer is specified based on the recognized identification mark. . Thereby, the table that has entered the field of view of the apparatus wearer can be accurately identified with a simple configuration.

  In this case, the table specifying means includes face authentication data storage means for storing customer face authentication data in each table, face recognition means for capturing at least part of the field of view, and recognizing the customer's face, and face recognition means And a collating unit that collates each face authentication data stored in the face authentication data storage unit, and identifies the table based on the collation result of the face authentication data by the collating unit Is preferred.

  According to this configuration, when the customer's face is image-recognized by the face recognition unit that captures at least a part of the field of view of the apparatus wearer, the recognized face is authenticated to identify the customer. Since the customers of each table usually arrive at their tables, it is possible to identify the table that has entered the device wearer's field of view by identifying the customer who has entered the device wearer's field of view. Thereby, the table that has entered the field of view of the apparatus wearer can be identified with a simple configuration.

  In this case, the table specifying unit includes an in-store map storage unit that stores an in-store map indicating the arrangement of each table in the store, and a detection unit that senses movement and face orientation of the device wearer in the store, It is preferable to identify the table based on the reference result of the in-store map storage means and the detection result of the detection means.

  According to this configuration, the table viewed by the device wearer is specified from the in-store map, the movement of the device wearer, and the face orientation. Thereby, the table that has entered the field of view of the apparatus wearer can be identified with a simple configuration.

  In this case, the apparatus further includes data reading means for reading stored data stored in the electronic money medium through human body communication realized by touching the electronic money medium, and the display control means is provided by the data reading means. It is preferable to display the read storage data in the field of view.

  According to this configuration, when the device wearer touches the electronic money medium, the stored data stored in the electronic money medium is displayed in the field of view of the device wearer. In this way, the device wearer can confirm the stored data of the electronic money medium simply by touching the electronic money medium. Further, it is not necessary to use a special data reading device in order to confirm the stored data of the electronic money medium.

  Another wearable device of the present invention is input by an object specifying means for specifying an object included in the field of view of the wearer, an object input means for inputting information on the specified object, and an object input means. Object storage means for storing information on each object, display means for displaying information on the object stored in the object storage means in the field of view, display control means for controlling display of the display means, The display control means displays information on the target object when the target object information specified by the target object specifying means is stored in the target object storage means.

  According to this configuration, when the device wearer looks at the object, the object identified by the device wearer is identified by the object identifying means. When information on the identified object is stored, the information on the identified object is displayed in the field of view of the device wearer. In this way, when the device wearer sees the object for which information has been input, since the information on the object is displayed within the view of the device wearer, the device wearer simply looks at the object, Information on the object can be confirmed easily and without using a hand. Moreover, since it is the structure which inputs the information of the target object specified by the target object specifying means, it is not necessary to input the number etc. which specify a target object at the time of information input.

  A program according to the present invention causes a computer to function as each means of the wearable device.

  According to this configuration, each unit in the wearable device can be configured simply by installing this program in a computer.

  Hereinafter, a head mounted display to which the wearable device of the present invention is applied will be described with reference to the accompanying drawings. This head-mounted display is used for order management in restaurants, and is used by service staff (clerks) of restaurants. When a wait staff (hereinafter referred to as a device wearer) wearing a head-mounted display sees a customer, an order entry screen (operation screen) 31 of the table to which the customer belongs and an order information screen 41 related to the table are displayed in the field of view. To do. Thereby, order management can be performed efficiently. Furthermore, it has a function of reading stored data of the electronic money card through human body communication when the device wearer touches the electronic money card (electronic money medium) presented by the customer.

  As shown in FIGS. 1 and 2, the head mounted display 1 is a so-called monocular optically transmissive head mounted display 1, and the apparatus wearer H can observe the appearance of the outside world with both eyes. The image data is displayed in the field of view. The head mounted display 1 includes a frame 3 having an ear hook 2 for hanging on the ear of the device wearer H, and an eyepiece optical system 11 supported by the frame 3 and disposed in front of the eye of the device wearer H. And a storage case 9 disposed above the eyepiece optical system 11 and an imaging camera (imaging means) 5 that is supported by the frame 3 and images the front of the apparatus wearer H. Further, in the storage case 9, a projection unit 12 that projects image data onto the eyeball via the eyepiece optical system 11, a data reading unit 6 that reads out data stored in the customer's electronic money card, and a pressure sensor that detects air pressure 7 and a control unit 8 for controlling each part of the head mounted display 1 are disposed (see FIG. 2). When the head mount display 1 is attached to the device wearer H by the ear hook 2, the eyepiece optical system 11 and the projection unit 12 can display image data in the field of view of the device wearer H. In addition, the imaging camera 5 can capture an image of the front of the device wearer H.

  The head mounted display 1 is disposed in front of the eye of the apparatus wearer H, and is disposed above the eyepiece optical system 11 functioning as a beam splitter, and the eyepiece optical system 11, and via the eyepiece optical system 11. Then, the image data is displayed in the field of view of the device wearer H by the display unit 4 including the projection unit 12 that projects predetermined image data onto the eyeball. The eyepiece optical system 11 is configured to reflect the projection light from the projection unit 12 and guide it to the eyeball, and to transmit light from the outside world and guide it to the eyeball. Thereby, the apparatus wearer H can be made to observe the appearance of the outside world, and image data can be displayed in the view of the apparatus wearer H in that state.

  The imaging camera 5 is composed of a CCD camera or the like, and is fixed to the frame 3 so as to image the front of the face of the apparatus wearer H. Thereby, it is the structure which images at least one part of the visual field of the apparatus wearer H. FIG. The image of the customer's face is recognized by the imaging camera 5. Further, the imaging camera 5 is connected to the control unit 8 in the storage case 9 by a wiring cable 10. The face recognition means described in the claims is constituted by the imaging camera 5.

  The pressure sensor 7 detects ambient air pressure. When the hand of the device wearer H approaches the pressure sensor 7 at a close distance (10 to 20 cm), the air pressure around the pressure sensor 7 changes. Therefore, it can be detected from the detection value of the pressure sensor 7 that the hand of the device wearer H has approached the close distance to the pressure sensor 7. Further, if the state is close to the closest distance, the separation distance of the hand from the pressure sensor 7 can be detected from the detected value. The pressure sensor 7 is used for order input operation.

  The data reading unit 6 reads data stored in the electronic money card via human body communication. When the device wearer H touches the electronic money card, human body communication connecting the electronic money card and the head mounted display 1 is formed using the device wearer H as a medium. The data reading unit 6 communicates with an electronic money card, which is an IC card, using this human body communication, and reads data stored in the electronic money card. The human body communication referred to here is a communication form using the human body as a communication medium. Further, as human body communication, a current method in which a weak current is passed through the human body for communication may be used, or an electric field method in which communication is performed using an electric field of the human body may be used.

  Next, a control configuration of the head mounted display 1 will be described with reference to FIG. The control unit 8 includes a display control unit (display control unit) 21, a face authentication data storage unit (face authentication data storage unit) 22, a face collation unit (collation unit) 23, a table specifying unit 24, and an order storage unit. (Order storage means) 25, an order input unit 26, and a read control unit 27 are configured.

  The display control unit 21 controls the display unit 4 to appropriately display various image data in the field of view. The display control unit 21 displays the order input screen 31, the order information screen 41 (both refer to FIG. 3), the stored data of the electronic money card and the error message as image data.

  The face authentication data storage unit 22 stores face authentication data of the customer's face corresponding to the table number of each table. The face collation unit 23 collates the customer's face recognized by the imaging camera 5 with the face authentication data stored in the face authentication data storage unit 22. When the device wearer H looks at the customer's face, the customer's face is imaged by the imaging camera 5 and the image is recognized. When the customer's face is recognized, the face matching unit 23 immediately matches the face. The face authentication data stored in the face authentication data storage unit 22 acquires the face authentication data by recognizing the face of the customer with the imaging camera 5 when the customer enters the store. Is preferably registered in association with the table number.

  The table specifying unit 24 specifies a table included in the field of view of the device wearer H. Since the customers of each table usually arrive at their own tables, the table that has entered the field of view of the device wearer H can be identified by identifying the customer that has entered the field of view of the device wearer H. That is, when the customer's face located in front of the apparatus wearer H is image-recognized by the imaging camera 5 and face matching is performed by the face matching unit 23, the customer table number specified by the matching result is displayed. A table is specified by reading from the face authentication data storage unit 22. The table specifying means described in the claims includes the imaging camera 5, face authentication data storage unit 22, face collating unit 23, and table specifying unit 24.

  The order storage unit 25 stores the order information including the order contents (order) input by the order input unit 26 and the serving status thereof in association with the table number. Furthermore, it is preferable to store customer entry times and the like in each table. The order information stored here is read by the display control unit 21 and displayed in the field of view of the apparatus wearer H when confirming the order.

  The order input unit 26 is for causing the apparatus wearer H to input an order using the order input screen 31 displayed by the display control unit 21. Here, before describing the details of the order input unit 26, the order input screen 31 displayed by the display control unit 21 will be described. FIG. 3A is a diagram showing the order input screen 31. As shown in FIG. 3A, on the order input screen 31, a menu list display area 32 for displaying a menu list, an order list display area 33 for displaying an order list, and items to be selected from the menu list items are selected. An upper icon 34 and a lower icon 35 for selection, an addition icon 36 for setting the selected item as an additional order item, and an order confirmation icon 37 for confirming the order list are displayed. Also, the selected item in the menu list is highlighted.

  The order input unit 26 senses the movement of the finger of the device wearer H on the order input screen 31 using the imaging camera 5 and the pressure sensor 7. The order input unit 26 performs each corresponding process by detecting that the tip of the finger (hereinafter referred to as a fingertip) has moved onto each icon by the sensing. That is, the apparatus wearer H instructs each process by moving the fingertip into each icon. Hereinafter, this operation of moving the fingertip into the icon is referred to as an input operation on the icon. In addition, in the apparatus wearer H, the focal length of the order input screen 31 is set to the closest distance (about 10 cm to 20 cm) of the apparatus wearer H (the eyeball) so that the fingertip and the order input screen 31 are simultaneously focused. It is displayed so that it is located, and a finger at a close distance is sensed. The order input means described in the claims includes the imaging camera 5, the pressure sensor 7, and the order input unit 26.

  Here, a sensing method of finger movement on the order input screen 31 performed using the imaging camera 5 and the pressure sensor 7 will be described. When the device wearer H moves his / her finger in front of the eyes, the pressure sensor 7 detects that the hand is at a close distance, and the imaging camera 5 images the finger (fingertip). Since the detection result of the pressure sensor 7 can detect the presence of an object at a close distance and the imaging camera 5 can recognize the shape of the object, the fingertip in the captured image can be determined from the detection result and the imaging result. Is detected, and the position of the fingertip and the distance of the fingertip to the eyes are detected. Thereafter, the virtually input image and the order input screen 31 are overlapped to detect the position of the fingertip on the order input screen 31. By repeating this position detection, the movement of the fingertip on the order input screen 31 can be sensed.

  Note that it is conceivable that there is a discrepancy between the captured image and the image seen by the device wearer H due to the positional relationship between the imaging camera 5 and the eyeball of the device wearer H. Therefore, it is preferable to perform sensing in consideration of this. For example, recognition deviation information may be acquired from information (such as visual acuity) of the device wearer H and position information between the imaging camera 5 and the eyeball, and sensing may be performed by adding a deviation amount of the recognition deviation information. . Furthermore, the user may correct the misregistration by himself. In order to capture the same image as that seen by the wearer H, the light from the outside is divided by the eyepiece optical system 11 or a special beam splitter, and one of the divided lights is guided to the eyeball, and the other light May be configured to image.

  The read control unit 27 reads data stored in the electronic money card by the data reading unit 6. When the storage data of the electronic money card is read by the reading control unit 27, the storage data is displayed by the display control unit 21. With such a configuration, the device wearer H can confirm the stored data of the electronic money card simply by touching the electronic money card. Further, it is not necessary to use a special data reading device in order to confirm the data stored in the electronic money card. The data reading means described in the claims includes the data reading unit 6 and the read control unit 27.

  Next, the display operation of the head mounted display 1 will be described with reference to FIG. This display operation is performed when the apparatus wearer H sees the face of the customer wearing the table. As shown in FIG. 4, when the device wearer H sees the customer's face, the imaging camera 5 captures the customer's face and recognizes the image (S 1). When the customer's face is recognized, the face collation unit 23 collates the recognized face with each face authentication data stored in the face authentication data storage unit 22 (S2). When a plurality of faces are recognized by the imaging camera 5, a customer located in front of the face of the device wearer H (a position corresponding to the front of the face in the imaging range) is collated with priority.

  As a result of the collation, when the recognized face does not match each face authentication data in the face authentication data storage unit 22 (S3: No), an error message is displayed by the display control unit 21 (S4), and this operation is performed. finish. On the other hand, if there is face authentication data that matches the recognized face as a result of the collation (S3: Yes), the table specifying unit 24 reads the table number corresponding to the face authentication data from the face authentication data storage unit 22. Is read (S5). Thereby, the table contained in the visual field of the apparatus wearer H is specified.

  When the table is specified, the display control unit 21 refers to the order information corresponding to the table number from the order storage unit 25 (S6). Then, it is detected whether or not the order contents are stored in the order information (S7). In this manner, by detecting whether or not the order contents are stored, it is possible to determine whether or not the order has been input to the table.

  When the order contents are not stored in the referred order information (S7: No), the order input operation is performed assuming that the order input has not been completed yet. In the order input operation, first, the display control unit 21 displays the order input screen 31 (see FIG. 3A) of this table (S8). When the order input screen 31 is displayed, the order input unit 26 inputs the order contents accompanying the input operation of the device wearer H (S9).

  Strictly speaking, when the order input unit 26 detects an input operation on the upper icon 34 or the lower icon 35, the selection items in the menu list are sequentially changed via the display control unit 21. Thereby, the device wearer H can select a desired item (cooking) from the menu list as a selection item. Thereafter, when the order input unit 26 detects an input operation to the add icon 36, the selected selection item is displayed on the order list as an additional order item via the display control unit 21. By repeating the addition of such order items, an order list is created on the order list display area 33. When the order input unit 26 detects an input operation with respect to the order confirmation icon 37 in a state where the order list is created, the created order list is input as order contents.

  When the order content is input, the order storage unit 25 stores the order content in association with the read table number (S10), and ends this operation.

  On the other hand, when the order contents are stored in the referred order information (S7: Yes), the order confirmation operation is performed assuming that the order has been input. In the order confirmation operation, first, the display control unit 21 acquires the read order information of the table number from the order storage unit 25 (S11). If order information is acquired, the display control part 21 will display the order information screen 41 (refer FIG.3 (b)) in which this order information is contained (S12).

  As shown in FIG. 3B, the order information screen 41 displays the table number, the customer entry time, the order contents, and the service status of each order item (whether the service has been completed). In particular, order items that have not been served are underlined and highlighted. As shown in FIG. 3B, in addition to the order information, it is preferable to display the customer face 41a captured at the time of face matching. When such an order information screen 41 is displayed, this operation is terminated.

  According to this configuration, when the customer's face is image-recognized by the imaging camera 5 that captures at least a part of the field of view of the device wearer H, the recognized face is authenticated to identify the customer. Since the customers of each table are usually arriving at their own tables, the table that has entered the field of view of the device wearer H can be identified by identifying the customer who has entered the field of view of the device wearer H. Thereby, the table that has entered the field of view of the device wearer H can be identified with a simple configuration.

  In the above embodiment, the table included in the field of view is specified by specifying the customer included in the field of view of the device wearer H. However, the present invention is not limited to this. Therefore, a first modification and a second modification of this table specifying method will be described with reference to FIGS.

  First, the head mounted display 1 of the first modification will be described with reference to FIG. In the head mounted display 1 of this modification, the identification mark affixed to the table is image-recognized, and the table included in the field of view of the device wearer H is specified. As shown in FIG. 5, the head mounted display 1 has a configuration in which the face authentication data storage unit 22 and the face collation unit 23 are omitted from the components shown in FIG. 2. On the other hand, the table specifying unit 24 uses the identification mark recognized by the imaging camera 5 to acquire the table number of the table indicated by the identification mark, and specifies the table included in the field of view of the apparatus wearer H. As described above, when the identification mark is image-recognized by the imaging camera 5 that captures at least a part of the field of view of the apparatus wearer H, the table viewed by the apparatus wearer H is specified based on the recognized identification mark. Thus, the table entering the field of view of the device wearer H can be accurately identified with a simple configuration. In the present modification, the table specifying means described in the claims is configured by the imaging camera 5 and the table specifying unit 24. Further, the mark recognizing means described in the claims is constituted by the imaging camera 5.

  The identification mark may indicate a table number using a bar code, a two-dimensional code, or the like, or correspondence information between the identification mark and the table number is stored, and a unique identification mark is used. It may indicate a table number. Furthermore, the structure which uses the pattern of the whole table surface different for every table as an identification mark may be sufficient.

  Next, a head mounted display 1 according to a second modification will be described with reference to FIG. As shown in FIG. 6, in the head-mounted display 1 of this modification, a table included in the field of view of the device wearer H is specified using the in-store map, the movement of the device wearer H, and the face orientation. . The head mounted display 1 includes a triaxial acceleration sensor 42 and a triaxial angular velocity sensor 43 in addition to the components shown in FIG. Furthermore, instead of the face authentication data storage unit 22 and the face collation unit 23, a store map storage unit (store map storage means) 44 is provided. Note that the detection means described in the claims includes an acceleration sensor 42 and an angular velocity sensor 43.

  The in-store map storage unit 44 stores an in-store map showing the arrangement of each table in the store. The table specifying unit 24 includes the movement information of the device wearer H detected by the acceleration sensor 42 and the face angle (orientation) of the device wearer H detected by the angular velocity sensor 43. Using the (detection result) and the in-store map (reference result) stored in the in-store map storage unit 44, a table included in the field of view of the device wearer H is specified.

  With such a configuration, by identifying the table that the device wearer H is looking from the in-store map and the movement and face orientation of the device wearer H, the table that has entered the field of view of the device wearer H It can be specified with a simple configuration. In the present modification, the table specifying means described in the claims includes a table specifying unit 24, an acceleration sensor 42, an angular velocity sensor 43, and an in-store map storage unit 44.

  Next, an ordering system 51 according to the second embodiment of the present invention will be described with reference to FIG. The ordering system 51 includes a plurality of head mounted displays (wearable devices) 1, an in-store server 52 that collectively manages orders by the plurality of head mounted displays 1, and wireless communication between the plurality of head mounted displays 1 and the in-store server 52. And one or more access points 53 for performing communication, and a hub (HUB) 54 serving as a relay device between the one or more access points 53 and the in-store server 52. The ordering system 51 is configured to share the order information in the plurality of head mounted displays 1 with the in-store server 52.

  The in-store server 52 has the same configuration as a general computer, and includes at least a communication unit (server side communication means) 61 for communicating with each head mounted display 1 via the access point 53 and the hub 54, An order storage unit (order storage unit) 62 for storing order information including order contents from the head mounted display 1 and an information providing unit (information provision) for providing order information to the head mounted display 1 using the communication unit 61 Means) 63. The order storage unit 62 stores the order information in association with the table number as in the above embodiment.

  As shown in FIG. 8, the head mounted display 1 has a configuration in which the order storage unit 25 is omitted and a wireless communication unit (device-side communication unit) 64 is provided from the components of the embodiment shown in FIG. 2. It has become. The wireless communication unit 64 communicates with the in-store server 52 via the access point 53 and the hub 54.

  Here, the display operation of the head mounted display 1 in the ordering system 51 will be described with reference to FIG. This display operation is performed when the apparatus wearer H sees the customer who has arrived at the table, as in the above embodiment. Since the steps from S21 to S25 in this operation are the same as the steps from S1 to S5 in the display operation of the above-described embodiment shown in FIG. 4, the table number is read here and included in the field of view of the apparatus wearer H. The process after specifying the table to be described will be described.

  When the table is specified, the head mounted display 1 transmits the table number (specific result) to the in-store server 52 through the wireless communication unit 64 (S26). The in-store server 52 that has received the table number by the communication unit 61 (S27) refers to the order information corresponding to the table number from the order storage unit 62 (S28). Then, it is detected whether or not the order contents are stored in the order information (S29).

  When the order content is not stored in the referred order information (S29: No), the ordering system 51 performs an order input operation. In the order input operation, first, the in-store server 52 notifies the head mounted display 1 that the order contents are not stored by the communication unit 61 (S30). The head mounted display 1 that has received it by the wireless communication unit 64 (S31), the display control unit 21 displays the order input screen 31 (S32), and the order input unit 26 performs an input operation of the apparatus wearer H. Along with this, the order contents are input (S33). After inputting the order contents, the wireless communication unit 64 transmits the input order contents and the read table number (specific result) to the in-store server 52 (S34). The in-store server 52 that has received the information by the communication unit 61 (S35) stores the order contents in association with the table number in the order storage unit 62 (S36). As a result, this operation ends.

  On the other hand, when the order contents are stored in the referred order information (S29: Yes), the ordering system 1 performs an order confirmation operation. In the order confirmation operation, first, the in-store server 52 acquires the order information of the table number from the order storage unit 62 by the information providing unit 63 (S37), and head-mounts the order information via the communication unit 61. The data is transmitted to the display 1 (S38). The head mounted display 1 that has received it by the wireless communication unit 64 (S39) displays the order information screen 41 including the order information by the display control unit 21 (S40).

  According to the configuration as described above, when the device wearer H looks at the table of 1, the table specified by the device wearer H is specified by the table specifying means. When the order contents of the specified table are stored, the order information of the specified table is displayed in the field of view of the apparatus wearer H. As described above, when the device wearer H sees the table on which the order is input, the order information of the table is displayed in the field of view of the device wearer H, so that the device wearer H only looks at the table. Order information can be confirmed easily and without using a hand. In addition, since the order is input for the table specified by the table specifying means, it is not necessary to input a table number or the like for specifying the table when inputting the order.

  In addition, when inputting an order, the order input screen 31 for inputting the order contents is displayed in the field of view of the apparatus wearer H, and the order is input by sensing the apparatus wearer H's finger. No special terminal is required for inputting the order, and the order can be input without taking out the terminal.

  In addition, in the said embodiment, although it was the structure which performs each process per table, the structure which performs each process per seat may be sufficient. Further, depending on the arrangement in the store, processing in units of tables and processing in units of seats may be mixed.

  In the above embodiment, the eyepiece optical system 11 functioning as a beam splitter is used as the display unit 4 to display an image in the field of view of the device wearer H. Alternatively, a configuration may be used in which an image is displayed in the field of view using a mechanism for performing retinal scanning.

  Further, in the above embodiment, a kitchen contact icon may be arranged on the order information screen 41 so that an abnormality can be notified from the apparatus wearer H to the kitchen when confirming the order. That is, when the device wearer H finds an abnormality such as a long-time unsalted cooking, the input operation is performed on the kitchen contact icon by the same input operation as that on the order input screen 31. The head mounted display 1 detects this input operation and transmits an abnormal signal to the kitchen server using wireless communication. The server on the kitchen side having received the notification is configured to issue an alarm and notify the kitchen staff of the abnormality. In addition, it is good also as a structure which mounts the microphone in the head mounted display 1, and connects the audio | voice of this microphone to a kitchen when the input operation with respect to a kitchen contact icon is detected.

  Furthermore, in the said embodiment, the structure which has the switching mechanism which switches the mode of the head mounted display 1 between a display mode and a non-display mode may be sufficient. At this time, the display operation is performed in the display mode, and the display operation is not performed in the non-display mode.

  In the above embodiment, the table included in the field of view is specified indiscriminately, but the table that has been included in the field of view for a predetermined time (for example, 1 second) or the face of the apparatus wearer The configuration may be such that only the table that the device wearer H gazes on (assumed to be) is identified, such as a table included in the field of view when the movement stops for a predetermined time.

  In the above embodiment, each unit is arranged on the head mounted display 1, but one of the above units is connected to a separate device connected to the head mounted display 1 by wired, wireless, or human body communication. A configuration may be employed in which units (for example, the data reading unit 6 and the control unit 8) are arranged.

  In the above embodiment, the wearable device (wearable device) has been described as being used in a restaurant as an example, but is not limited thereto. Furthermore, although the head mounted display 1 to be worn on the head of the device wearer H is used, the present invention may be applied to a wearable device to be worn on the shoulder or chest of the device wearer H. The object specifying means in the claims corresponds to a table specifying means, and the object input means corresponds to an order input means. Further, the object storage means described in the claims corresponds to order storage means.

It is the schematic perspective view which showed the head mounted display which concerns on one Embodiment of this invention. It is the block diagram which showed the structure of the head mounted display. It is the figure which showed the order input screen (a) and the order information screen (b). It is the flowchart which showed the display operation of the head mounted display. It is the block diagram which showed the structure in the head mounted display of a 1st modification. It is the block diagram which showed the structure in the head mounted display of a 2nd modification. It is a system configuration figure showing an ordering system concerning a 2nd embodiment. It is the block diagram which showed the structure in the head mounted display of an ordering system. It is the flowchart which showed the display operation of the head mounted display in an ordering system.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1: Head mounted display, 4: Display part, 5: Imaging camera, 6: Data reading part, 7: Pressure sensor, 21: Display control part, 22: Face authentication data storage part, 23: Face collation part, 24: Table Specific part 25: Order storage part 26: Order input part 27: Reading control part 31: Order input screen 42: Acceleration sensor 43: Angular velocity sensor 44: Store map storage part 51: Ordering system 52 : Store server 61: Communication unit 62: Order storage unit 63: Information providing unit 64: Wireless communication unit H: Device wearer

Claims (9)

Table specifying means for specifying a table in the store included in the field of view of the device wearer;
Order input means for inputting the order of the identified table;
Order storage means for storing the order of each table input by the order input means;
Display means for displaying the order stored in the order storage means within the field of view;
Display control means for performing display control of the display means,
The display control means, when the order of the table specified by the table specifying means is stored in the order storage means, displays the order of the table. The display control means displays an operation screen for inputting the order by the order input means in the field of view when an arbitrary table is specified by the table specifying means,
The wearable device according to claim 1, wherein the order input unit inputs the order by sensing a movement of the finger of the device wearer with respect to the operation screen. An identification mark for identifying each table is affixed to the table,
The table specifying means includes
Image recognition means for recognizing the identification mark by imaging at least a part of the field of view;
The wearable device according to claim 1 or 2, wherein the table is specified based on a recognition result of the identification mark by the mark recognition means. The table specifying means includes
Face authentication data storage means for storing customer face authentication data of each table;
Face recognition means for capturing at least part of the field of view and recognizing the face of the customer;
Collating means for collating the face of the customer recognized by the face recognition means with the face authentication data stored in the face authentication data storage means,
The wearable device according to claim 1 or 2, wherein the table is specified based on a collation result of the face authentication data by the collation means. The table specifying means includes
In-store map storage means for storing an in-store map showing the arrangement of each table in the store;
Sensing means for sensing movement and face orientation of the device wearer in the store,
The wearable device according to claim 1 or 2, wherein the table is specified based on a reference result of the in-store map storage unit and a detection result of the detection unit. Further comprising data reading means for reading stored data stored in the electronic money medium via human body communication realized by the device wearer touching the electronic money medium;
6. The wearable device according to claim 1, wherein the display control unit displays the storage data read by the data reading unit in the field of view. An object identifying means for identifying an object included in the field of view of the device wearer;
Object input means for inputting information of the identified object;
Object storage means for storing information on each object input by the object input means;
Display means for displaying information on the object stored in the object storage means in the field of view;
Display control means for performing display control of the display means,
The display control means displays information on the target object when the information on the target object specified by the target object specifying means is stored in the target object storage means. A wearable device worn by a store clerk;
An ordering system having an in-store server disposed in the store,
The wearable device includes:
Table specifying means for specifying the table in the store included in the field of view of the device wearer;
Order input means for inputting the order of the identified table;
A device-side communication unit that transmits a table identification result by the table identification unit and the order input by the order input unit to the in-store server, and receives information transmitted from the in-store server;
Display means for displaying information transmitted from the in-store server within the field of view;
Display control means for performing display control of the display means,
The in-store server is
Server-side communication means for communicating with the wearable device;
Order storage means for storing the order of each table received from the wearable device;
When receiving the table specification result from the wearable device, if the order of the table based on the table specification result is stored in the order storage unit, the order of the table is used as the information via the server side communication unit. An ordering system comprising: information providing means for transmitting to the wearable device.   The program for functioning a computer as each means of the wearable apparatus in any one of Claim 1 thru | or 7.

Images