CN211979611U

CN211979611U - Integrated 3D projection touch self-service ordering device

Info

Publication number: CN211979611U
Application number: CN202020602364.8U
Authority: CN
Inventors: 杜国铭; 郑春雨; 冯大志
Original assignee: Harbin Tuobo Technology Co ltd
Current assignee: Harbin Tuobo Technology Co ltd
Priority date: 2020-04-21
Filing date: 2020-04-21
Publication date: 2020-11-20
Anticipated expiration: 2030-04-21

Abstract

The utility model provides an integrated 3D projection touch self-service ordering device, which comprises a camera 1, a camera 2, a control unit and a projection light machine; the control unit is based on an embedded ARM platform; the utility model discloses use two cameras, a camera is based on algorithm identification plate, and another camera is based on algorithm identification plane gesture, can satisfy the function that client realized using the gesture to order dishes when watching the vegetable. The utility model discloses can use single camera to accomplish the accurate discernment of object, can find the locating position of plate rapidly in projection area's optional position to with the 3D image projection of dish position. Customers can actually see the dish, so that users can have better experience.

Description

Integrated 3D projection touch self-service ordering device

Technical Field

The utility model belongs to the technical field of gesture recognition control, especially, relate to a self-service device of ordering dishes of integral type 3D projection touch.

Background

Most of the existing touch projection schemes are single touch systems, the touch systems comprise a projection module, an infrared camera acquisition module, an infrared laser module, a control unit module and a video output module, and the main principle is as follows: the video output module is connected with the projection module through video lines such as HDMI, the projection module projects the video onto a plane, the infrared camera acquisition module and the infrared laser module are jointly used, the infrared camera acquisition module can only filter visible light, and only can see light rays with the same wavelength as the infrared laser module. The light outlet of the infrared laser module is parallel to the plane. When a finger and an object appear on the table top, infrared laser emitted by the infrared laser module can be reflected to form light spots, the light spots are collected by the infrared camera collecting module and transmitted to the control unit module, and coordinates of the light spots are extracted through an algorithm after the control unit module obtains the images. After processing multiple frames of images through an algorithm, the motion of the finger and the object can be calculated. And then the action number is sent to a video output module, and the video output module receives a signal transmitted by the control unit module to switch corresponding video images.

The algorithm in the prior art must be operated on a high-performance PC host computer, so that the cost is high, objects to be identified in the market are generally identified by two or more cameras, so that the space is increased, the identification precision of a single-camera scheme is not high, and most of systems related to ordering in the market are handheld small-sized push-button ordering terminals or large-sized self-service ordering machines. The former has a disadvantage in that the customer must watch a paper menu and then tell the service person the number of the dishes, which results in that the customer cannot observe the dishes in advance, which leads to a poor experience for the customer if the customer finds a dish different from what he imagined by him after the dish is ready. The latter has the disadvantage of being large in size and space consuming.

SUMMERY OF THE UTILITY MODEL

The utility model discloses the purpose is in order to solve the problem among the prior art, has provided a self-service device of ordering dishes of integral type 3D projection touch. The utility model discloses based on embedded ARM platform, all algorithms are based on embedded platform optimization, the utility model discloses can use single camera to accomplish the accurate discernment of object, can find the locating place of plate rapidly in projection area's optional position to with the 3D image projection of vegetable to plate position. Customers can actually see the dish, so that users can have better experience. The utility model discloses use two cameras, a camera is based on algorithm recognition plate, and another camera is based on algorithm recognition plane gesture. The function of ordering dishes by using gestures can be realized while the customers watch the dishes.

The utility model is realized through the following technical scheme, the utility model provides an integrated 3D projection touch self-service ordering device, which comprises a camera 1, a camera 2, a control unit and a projection optical machine; the control unit is based on an embedded ARM platform;

the projection area of the projection optical machine comprises a dish containing area and a dish ordering interface area on a desktop, wherein the dish containing area is used for placing dishes containing dishes, and a customer carries out gesture operation in the dish ordering interface area; the camera 1 is used for automatically searching a utensil which is placed in a desktop projection area and is used for containing dishes, and the camera 2 is used for capturing gesture operation of fingers of a customer in a dish ordering interface area on a desktop; the projection optical machine is used for projecting the 3D dish image onto a dish containing dishes and projecting the menu onto a dish ordering interface area; after the control unit receives the utensil information searched by the camera 1 and the gesture operation information captured by the camera 2, the functions which the customer wants to complete are obtained according to the specific gesture and the ordering operation area, and meanwhile, the projection light machine is controlled to project the 3D dish images to the position of a utensil for containing dishes.

Further, the dish for containing the dishes is a plate.

Further, camera 1 is the RGB camera, camera 2 is infrared camera.

Further, the functions that the customer wants to perform include switching dishes, placing orders, and switching directories.

Further, if the ordering operation is the ordering operation, ordering information of the user is stored, and the control unit sends the ordering information to the server through the wifi network.

Further, the control unit comprises a plane gesture recognition device and a recognition device of a vessel containing dishes in a space, the plane gesture recognition device is used for recognizing gesture operation of a customer, and the recognition device of the vessel containing dishes in the space is used for recognizing the position of the vessel.

The utility model discloses the beneficial effect who brings:

1. the utility model can be carried by the catering service personnel under the size, and after the ordering device is placed on the desktop, the service personnel can leave by themselves, and customers can use the ordering terminal to order dishes by themselves, thereby not only saving the personnel cost, but also saving the space cost;

2. the utility model has simple operation, the catering service personnel can use the device quickly without training, and the training cost is saved;

3. the utility model discloses the 3D image of projection dish, customer can audio-visual true appearance of seeing the dish, can reduce like this because the dish of ordering is with the different problem of dish in oneself imagination to influence customer's experience.

Drawings

Fig. 1 is a general composition block diagram of an integrated 3D projection touch self-service ordering device according to the present invention;

fig. 2 is a hardware schematic diagram of the integrated 3D projection touch self-service ordering device according to the present invention;

FIG. 3 is a schematic view of a projection area of a desktop;

FIG. 4 is a schematic diagram of a gesture operation;

fig. 5 is a flow chart of the operation of the integrated 3D projection touch self-service ordering device and system of the present invention;

FIG. 6 is a flowchart illustrating the operation of the planar gesture recognition apparatus;

fig. 7 is a detailed operation flow chart of the identification device of the dish container.

Detailed Description

The technical solutions in the embodiments of the present invention will be described clearly and completely with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments in the present invention, all other embodiments obtained by a person skilled in the art without creative work belong to the protection scope of the present invention.

With reference to fig. 1-7, the utility model provides an integrated 3D projection touch self-service ordering device, which comprises a camera 1, a camera 2, a control unit and a projection optical machine; the control unit is based on an embedded ARM platform;

The dish for containing the dishes is a plate.

Camera 1 is the RGB camera, camera 2 is infrared camera.

The functions that the customer wants to accomplish include switching dishes, placing orders, and switching catalogs.

And if the order placing operation is the order placing operation, the order placing information of the user is stored, and the control unit sends the order placing information to the server through the wifi network.

The control unit comprises a plane gesture recognition device and a recognition device of a vessel for containing dishes in space, the plane gesture recognition device is used for recognizing gesture operation of a customer, and the recognition device of the vessel for containing dishes in space is used for recognizing the position of the vessel. The vessel position identification is specifically as follows: collecting images through an RGB camera, detecting the edge profile of the dish, using the edge profile to connect a moment calculation center, wherein the coordinate is an image coordinate, calculating the screen coordinate of the center of the dish through calibration parameters, and moving the corresponding dish to the screen coordinate position; the main principle of detecting the dish outline is that firstly, the dish needs to ensure that a black edge exists, the interior of the dish is composed of white, no pattern exists, exposure and brightness parameters of the camera 1 are adjusted, the camera 1 can only collect places with deep colors, a template is used for filtering out a software graphical interface, the exposure and brightness of the camera 1 are automatically adjusted by using an algorithm, finally, binaryzation is carried out on the detected outline, the outline is amplified by using a corrosion algorithm, the outline is clearer, meanwhile, the jitter change of the central position cannot be influenced when the outline has slight change, then, an anti-jitter algorithm is added to the dish position, and dish jitter is prevented.

The utility model also provides an integral type 3D projection touch self-service system of ordering dishes, the system includes camera image acquisition module, projection ray apparatus module, the control unit module and logic algorithm module; the control unit module is based on an embedded ARM platform;

the camera image acquisition module comprises a camera 1 and a camera 2, the camera 1 is used for automatically searching a utensil which is placed in a desktop projection area and is used for containing dishes, and the camera 2 is used for capturing gesture operation of fingers of a customer in a dish ordering interface area on a desktop;

the projection area of the projection optical-mechanical module comprises a dish containing area and a dish ordering interface area on a desktop, the dish containing area is used for placing dishes containing dishes, and a customer performs gesture operation in the dish ordering interface area; the ordering interface area displays a menu; the projection optical machine is used for projecting the 3D dish image onto a dish containing dishes and projecting the menu onto a dish ordering interface area;

the control unit module receives the ware information searched by the camera 1 and the gesture operation information captured by the camera 2, and then identifies the information, so that the identified gesture operation data and the ware position data are obtained;

the logic algorithm module is used for receiving the gesture operation data and the vessel position data sent by the control unit module, obtaining the functions which the customer wants to complete according to the specific gesture and the ordering operation area, and simultaneously controlling the projection light machine to project the 3D dish images to the position of the vessel containing the dishes. The functions that the customer wants to complete include dish switching, ordering, catalog switching and the like.

The control unit module includes a planar gesture recognition device operative to: firstly, calibrating a camera 2, recording calibration parameters into a local file, simultaneously adjusting the parameters of the camera 2 to enable a captured fingertip image to be clearer, enabling an image acquired by the camera 2 to be an infrared image, generating a white light spot when a fingertip is irradiated by an infrared laser, recording a light spot image coordinate, converting the image coordinate into a screen coordinate of a projection area through the calibration parameters, obtaining the screen coordinate, knowing a fingertip clicking position, and making a corresponding action.

The control unit module also comprises an identification device of a vessel for containing dishes in space, the vessel is a plate, the diameter of the plate is smaller than that of the plate placing area, the plate has obvious black edges or other dark edges, the center is white, no pattern is formed, and the identification device of the vessel for containing dishes in space is specifically operated as follows: the method comprises the steps of calibrating an RGB camera 1, using a template to scratch other areas, only leaving a plate placing area, automatically adjusting parameters of the camera 1, enabling the edge of the plate to be clearly visible as black, enabling the other areas to be white, using the template to scratch the other areas to be black, searching the black area from the position of an image (0, 0), stopping when the edge of the template is searched, enabling the searched area to be white, enabling the edge of the whole image to be black only if the edge of the plate is black, turning the color of the plate, enabling the edge of the plate to be white, using an expansion algorithm to enable the edge to be clearer, calculating the edge to be a circumscribed rectangle, using the center of the rectangle as the center of the plate, calculating the sub-desktop coordinates of the plate by calibrating the parameters.

The self-service ordering system also comprises a self-service ordering module, when the function which the customer wants to complete is ordering operation, ordering information of the customer is stored and sent to the self-service ordering module, and after the ordering information is received by the self-service ordering module, the ordering information is sent to a server through a WiFi network.

The above detailed description is made on the integrated 3D projection touch self-service ordering device provided by the present invention, and the specific examples are applied herein to explain the principle and the implementation of the present invention, and the description of the above embodiments is only used to help understand the method and the core idea of the present invention; meanwhile, for the general technical personnel in the field, according to the idea of the present invention, there are changes in the specific implementation and application scope, to sum up, the content of the present specification should not be understood as the limitation of the present invention.

Claims

1. The utility model provides an integral type 3D projection touch device of ordering dishes by oneself which characterized in that: the self-service ordering device comprises a camera 1, a camera 2, a control unit and a projection optical machine; the control unit is based on an embedded ARM platform;

2. The self-service ordering device according to claim 1, wherein: the dish for containing the dishes is a plate.

3. The self-service ordering device according to claim 1, wherein: camera 1 is the RGB camera, camera 2 is infrared camera.

4. The self-service ordering device according to claim 1, wherein: the functions that the customer wants to accomplish include switching dishes, placing orders, and switching catalogs.

5. The self-service ordering device according to claim 4, wherein: and if the order placing operation is the order placing operation, the order placing information of the user is stored, and the control unit sends the order placing information to the server through the wifi network.

6. The self-service ordering device according to claim 1, wherein: the control unit comprises a plane gesture recognition device and a recognition device of a vessel for containing dishes in space, the plane gesture recognition device is used for recognizing gesture operation of a customer, and the recognition device of the vessel for containing dishes in space is used for recognizing the position of the vessel.