CN111273771A - Control method, device and system of electric dining table and computer readable storage medium - Google Patents
Control method, device and system of electric dining table and computer readable storage medium Download PDFInfo
- Publication number
- CN111273771A CN111273771A CN202010049676.5A CN202010049676A CN111273771A CN 111273771 A CN111273771 A CN 111273771A CN 202010049676 A CN202010049676 A CN 202010049676A CN 111273771 A CN111273771 A CN 111273771A
- Authority
- CN
- China
- Prior art keywords
- dining table
- image
- electric dining
- electric
- hands
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Image Analysis (AREA)
Abstract
The invention provides a control method, a device and a system of an electric dining table and a computer readable storage medium, wherein the control method of the electric dining table comprises the following steps: s1, acquiring a desktop image; s2, preprocessing the desktop image to obtain a preprocessed image; s3, detecting the number of hands in the preprocessed image and judging whether the number of hands is larger than a preset threshold value or not; if so, sending a stop signal to the electric dining table; and S4, controlling the electric dining table to stop rotating according to the stop signal. The control method, the device and the system of the electric dining table and the computer readable storage medium can automatically control the rotation and the stop of the electric turntable, and are convenient for the use of the electric dining table.
Description
Technical Field
The invention relates to the technical field, in particular to a control method, a device and a system of an electric dining table and a computer readable storage medium.
Background
The electric dining table is characterized in that an electric turntable is arranged on a table top, and the turntable can automatically rotate at a low speed according to the setting during use, so that diners can conveniently take food dishes. A remote controller is generally provided to facilitate the waiter to serve. The wood-plastic composite board is mainly used for high-grade hotel rooms and is made of wood, density boards, multiple layers of boards and the like. The turntable is mostly made of toughened glass or a solid wood surface. The electric dining table is an innovative product of hotel dining tables and chairs in recent years, and can bring more convenience to people to have meals.
The technical scheme of the existing control electric dining table on the market is shown in figure 1, and comprises the following specific steps:
a: user clicking remote controller button to send out coding protocol
B: the coding protocol is transmitted by 433Mhz wireless communication mode
C: the coding protocol is decoded at the motor control panel to obtain control information
D: and rotating or stopping the motor according to the control information.
The most obvious defect of the mode is that the mode controlled by the remote controller is inconvenient, the dish is turned away when the dish is not clamped completely during dining, the remote controller is used for controlling the dining table to stop clamping the dish again, the remote controller is only one, and the use process is not intelligent enough and inconvenient.
Disclosure of Invention
In view of the above, the technical problem to be solved by the present invention is to provide a method, an apparatus, a system and a computer readable storage medium for controlling an electric dining table, which can automatically control the rotation and stop of an electric turntable, and facilitate the use of the electric dining table.
The technical scheme of the invention is realized as follows:
a control method of an electric dining table comprises the following steps:
s1, acquiring a desktop image;
s2, preprocessing the desktop image to obtain a preprocessed image;
s3, detecting the number of the hands in the preprocessed image and judging whether the number of the hands is larger than a preset threshold value or not; if so, sending a stop signal to the electric dining table;
and S4, controlling the electric dining table to stop rotating according to the stop signal.
Preferably, the preprocessing the desktop image specifically includes:
acquiring the area of the electric dining table;
and covering and filling the image of the range outside the area of the electric dining table in the desktop image.
Preferably, the area of the electric dining table is determined by a pre-calibration mode and/or acquired by an image recognition algorithm.
Preferably, the detecting the number of hands in the preprocessed image comprises:
carrying out bilinear interpolation scaling on the preprocessed image;
inputting the image into a neural network model;
obtaining the confidence degree of whether the region has the hand or not after obtaining the result from the neural network model, and judging that no hand appears in the region smaller than the threshold value by setting the threshold value;
areas above the threshold are considered as candidate positions where a hand may appear;
and checking out the overlapped candidate positions through non-maximum value inhibition processing to obtain the number of the hands.
A control device for an electric dining table, comprising:
the acquisition module is used for acquiring a desktop image;
the preprocessing module is used for preprocessing the desktop image to obtain a preprocessed image;
the judging module is used for detecting the number of the hands in the preprocessed image and judging whether the number of the hands is larger than a preset threshold value or not; if the threshold value is larger than the preset threshold value, a stop signal is sent to the control module;
and the control module is used for controlling the electric dining table to stop rotating according to the stop signal.
Preferably, the preprocessing module comprises a determining unit;
the determining unit is used for acquiring the area of the electric dining table;
and covering and filling the image of the range outside the area of the electric dining table in the desktop image.
Preferably, the area of the electric dining table is determined by a pre-calibration mode and/or acquired by an image recognition algorithm.
Preferably, the judging module comprises a calculating unit;
the computing unit is used for carrying out bilinear interpolation scaling on the preprocessed image;
inputting the image into a neural network model;
obtaining the confidence degree of whether the region has the hand or not after obtaining the result from the neural network model, and judging that no hand appears in the region smaller than the threshold value by setting the threshold value;
areas above the threshold are considered as candidate positions where a hand may appear;
and checking out the overlapped candidate positions through non-maximum value inhibition processing to obtain the number of the hands.
The invention also provides a control system of the electric dining table, which comprises the electric dining table and any one of the control devices.
The invention also provides a computer readable storage medium, which stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to execute the steps of the control method of the electric dining table.
According to the control method, the device and the system for the electric dining table and the computer readable storage medium, the number of hands is identified by acquiring the image of the dining table area, the identified number of hands is the number of the food clamping users, so that the electric dining table can be controlled according to the number of the food clamping users, and when the number of the food clamping users reaches a certain value, the electric dining table is controlled to stop, and the electric dining table is convenient to use.
Drawings
Fig. 1 is a flowchart of a control method for an electric dining table according to an embodiment of the present invention;
fig. 2 is a block diagram of a control device of the electric dining table according to the embodiment of the invention;
fig. 3 is a block diagram of a control system of the electric dining table according to the embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, an embodiment of the present invention provides a method for controlling an electric dining table, including the following steps:
s101, obtaining a desktop image.
In the present application, the purpose is to obtain the number of hands above the table, and Image information Image1 of the use condition of the table can be obtained by a camera overlooking shooting mode.
S102, preprocessing the desktop image to obtain a preprocessed image.
In the present application, since images other than the desktop area are acquired at the same time when acquiring the desktop Image, Image1 needs to be preprocessed to ensure the detection accuracy.
Taking a circular table as an example, the area range of the circular table can be obtained by determining the radius of the area of the table in the image in a manner of calibration in advance. Or the range of the circular table in Image1 is identified by means of an Image recognition algorithm.
After the range of the circular table is obtained, the Image outside the circular table area in Image1 is covered and filled, and finally Image information Image2 is obtained.
S103, detecting the number of hands in the preprocessed image and judging whether the number of hands is larger than a preset threshold value or not; if so, a stop signal is sent to the electric dining table.
The user can set a threshold value, and send a stop instruction if the threshold value is exceeded, and send a rotation instruction if the threshold value is lower. (for example, setting the threshold value to 5, giving a stop instruction when Image2 has more than 5 hands at the same time, and giving a rotation instruction otherwise).
And sending a stop command or a rotation command, and encoding the command.
The encoded command is transmitted by wireless communication (such as 433Mhz or bluetooth protocol).
And S104, controlling the electric dining table to stop rotating according to the stop signal.
The motor control board decodes and obtains the control instruction of the identification equipment through wireless communication.
Specifically, detecting the number of hands in the preprocessed image includes:
c, performing bilinear interpolation scaling on the color image obtained in the step C to reduce errors caused by resize;
inputting the image into a neural network model consisting of calculation modules such as convolution and residual error;
obtaining the confidence degree of whether the region has a hand or not through a series of processing after obtaining a result from the neural network model, and judging that no hand appears in the region smaller than the threshold value through setting the threshold value;
obtaining an area higher than a threshold value, and regarding the area as a candidate position where a hand is likely to appear;
checking out overlapped candidate positions through non-maximum suppression processing;
the non-maxima suppression formula is shown below:
Input:B＝{b1,...,bn},S＝{s1,...,sn}，Nt
b is a candidate frame for detection
S is confidence of the candidate box
Nt is a threshold for non-maximum suppression;
the algorithm process is as follows:
wherein:
IOU formula:
area (ROIT ∩ ROIG) the area where the candidate box T intersects G;
area (ROIT ∪ ROIG) the area where candidate box T is in phase with G.
Therefore, according to the control method of the electric dining table provided by the embodiment of the invention, the number of the identified hands is the number of the food clamping users by acquiring the image of the dining table area and identifying the number of the hands, so that the electric dining table can be controlled according to the number of the food clamping users, and when the number of the food clamping users reaches a certain value, the electric dining table is controlled to stop, so that the electric dining table is convenient to use.
As shown in fig. 2, the present invention further provides a control device for an electric dining table, comprising:
the acquisition module 10 is used for acquiring a desktop image;
the preprocessing module 20 is configured to preprocess the desktop image to obtain a preprocessed image;
the judging module 30 is used for detecting the number of the hands in the preprocessed image and judging whether the number of the hands is larger than a preset threshold value; if the threshold value is larger than the preset threshold value, a stop signal is sent to the control module 40;
and the control module 40 is used for controlling the electric dining table to stop rotating according to the stop signal.
In a preferred embodiment of the present invention, the preprocessing module 20 includes a determining unit 201;
the determination unit 201 is used for acquiring the area of the electric dining table;
and covering and filling the image of the range outside the area of the electric dining table in the desktop image.
In a preferred embodiment of the invention, the region of the electric dining table is determined by means of advanced calibration and/or acquired by an image recognition algorithm.
In a preferred embodiment of the present invention, the judging module 30 includes a calculating unit 301;
a calculating unit 301, configured to perform bilinear interpolation scaling on the preprocessed image;
inputting the image into a neural network model;
obtaining the confidence degree of whether the region has the hand or not after obtaining the result from the neural network model, and judging that no hand appears in the region smaller than the threshold value by setting the threshold value;
areas above the threshold are considered as candidate positions where a hand may appear;
and (4) checking out overlapped candidate positions through non-maximum suppression processing to obtain the number of hands.
Therefore, the control device of the electric dining table provided by the embodiment of the invention can control the electric dining table according to the number of the users who pick up the food by acquiring the image of the dining table area and identifying the number of hands, and the identified number of hands is the number of the users who pick up the food.
As shown in fig. 3, the present invention further provides a control system for an electric dining table, which comprises an electric dining table 31 and any one of the above control devices 32.
The control device of the electric dining table control system can comprise identification equipment fixed on a ceiling and a motor control board fixed on the electric dining table.
The invention also provides a computer readable storage medium, which stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to execute the steps of the control method of the electric dining table.
Through the above description of the embodiments, those skilled in the art will clearly understand that the present application can be implemented by software plus necessary general-purpose hardware, and certainly can also be implemented by special-purpose hardware including special-purpose integrated circuits, special-purpose CPUs, special-purpose memories, special-purpose components and the like. Generally, functions performed by computer programs can be easily implemented by corresponding hardware, and specific hardware structures for implementing the same functions may be various, such as analog circuits, digital circuits, or dedicated circuits. However, for the present application, the implementation of a software program is more preferable. Based on such understanding, the technical solutions of the present application may be substantially embodied in the form of a software product, which is stored in a readable storage medium, such as a floppy disk, a usb disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk of a computer, and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the method of the embodiments of the present application.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The procedures or functions according to the embodiments of the present application are all or partially generated when the computer program instructions are loaded and executed on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, e.g., the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. A computer-readable storage medium may be any available medium that a computer can store or a data storage device, such as a server, a data center, etc., that is integrated with one or more available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
When the control method, the device and the system for the electric dining table and the computer readable storage medium provided by the embodiment of the invention work, the electric dining table can normally rotate, image information on the dining table is collected, the number of hands appearing in an image is judged, when a user picks up dishes, the hands can extend above the dining table, whether the user picks up the dishes or not can be judged by detecting the number of the hands, a threshold value for stopping rotation of the dining table can be preset, for example, 5 people can be preset, namely, when the detected number of the hands is 5 or more, the situation that five or more users are picking up the dishes is indicated, and at the moment, the motor of the electric dining table can be controlled to stop rotating through the control panel, so that the user.
According to the control method, the device and the system for the electric dining table and the computer readable storage medium, the number of hands is identified by acquiring the image of the dining table area, the identified number of hands is the number of the food clamping users, so that the electric dining table can be controlled according to the number of the food clamping users, and when the number of the food clamping users reaches a certain value, the electric dining table is controlled to stop, and the electric dining table is convenient to use.
Finally, it is to be noted that: the above description is only a preferred embodiment of the present invention, and is only used to illustrate the technical solutions of the present invention, and not to limit the protection scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (10)
1. A control method of an electric dining table is characterized by comprising the following steps:
s1, acquiring a desktop image;
s2, preprocessing the desktop image to obtain a preprocessed image;
s3, detecting the number of the hands in the preprocessed image and judging whether the number of the hands is larger than a preset threshold value or not; if so, sending a stop signal to the electric dining table;
and S4, controlling the electric dining table to stop rotating according to the stop signal.
2. The method for controlling an electric dining table as claimed in claim 1, wherein the pre-processing of the desktop image specifically comprises:
acquiring the area of the electric dining table;
and covering and filling the image of the range outside the area of the electric dining table in the desktop image.
3. The method for controlling an electric dining table according to claim 2, wherein the area of the electric dining table is determined by means of advanced calibration and/or acquired by an image recognition algorithm.
4. The method of controlling a motorized dining table as set forth in claim 1, wherein said detecting the number of hands in the pre-processed image comprises:
carrying out bilinear interpolation scaling on the preprocessed image;
inputting the image into a neural network model;
obtaining the confidence degree of whether the region has the hand or not after obtaining the result from the neural network model, and judging that no hand appears in the region smaller than the threshold value by setting the threshold value;
areas above the threshold are considered as candidate positions where a hand may appear;
and checking out the overlapped candidate positions through non-maximum value inhibition processing to obtain the number of the hands.
5. A control device for an electric dining table, comprising:
the acquisition module is used for acquiring a desktop image;
the preprocessing module is used for preprocessing the desktop image to obtain a preprocessed image;
the judging module is used for detecting the number of the hands in the preprocessed image and judging whether the number of the hands is larger than a preset threshold value or not; if the threshold value is larger than the preset threshold value, a stop signal is sent to the control module;
and the control module is used for controlling the electric dining table to stop rotating according to the stop signal.
6. The control apparatus for an electric dining table as claimed in claim 5, wherein said preprocessing module comprises a determining unit;
the determining unit is used for acquiring the area of the electric dining table;
and covering and filling the image of the range outside the area of the electric dining table in the desktop image.
7. The control device for the electric dining table as claimed in claim 6, wherein the area of the electric dining table is determined by means of pre-calibration and/or acquired by an image recognition algorithm.
8. The control device for electric dining table as claimed in claim 5, wherein said judging module comprises a calculating unit;
the computing unit is used for carrying out bilinear interpolation scaling on the preprocessed image;
inputting the image into a neural network model;
obtaining the confidence degree of whether the region has the hand or not after obtaining the result from the neural network model, and judging that no hand appears in the region smaller than the threshold value by setting the threshold value;
areas above the threshold are considered as candidate positions where a hand may appear;
and checking out the overlapped candidate positions through non-maximum value inhibition processing to obtain the number of the hands.
9. A control system for an electric table, comprising an electric table and a control device according to any of claims 5-8.
10. A computer readable storage medium storing a plurality of instructions adapted to be loaded by a processor to perform the steps of the method for controlling a motorized dining table according to any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010049676.5A CN111273771A (en) | 2020-01-16 | 2020-01-16 | Control method, device and system of electric dining table and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010049676.5A CN111273771A (en) | 2020-01-16 | 2020-01-16 | Control method, device and system of electric dining table and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111273771A true CN111273771A (en) | 2020-06-12 |
Family
ID=70998882
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010049676.5A Pending CN111273771A (en) | 2020-01-16 | 2020-01-16 | Control method, device and system of electric dining table and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111273771A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115316788A (en) * | 2021-12-23 | 2022-11-11 | 宜春学院 | Artificial intelligence dining table based on vision gesture recognition system |
| CN115486640A (en) * | 2022-09-22 | 2022-12-20 | 深圳市金博奥科技有限公司 | Intelligent dining table and control method thereof |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102894652A (en) * | 2012-08-23 | 2013-01-30 | 安徽大学 | Intelligent rotating dining table |
| CN103778577A (en) * | 2013-08-30 | 2014-05-07 | 陈飞 | Method and device for regulating dining table and recording dining information according to tableware information |
| CN105223848A (en) * | 2015-09-30 | 2016-01-06 | 姜明勇 | A kind of control method of dining table automatic rotation and system |
-
2020
- 2020-01-16 CN CN202010049676.5A patent/CN111273771A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102894652A (en) * | 2012-08-23 | 2013-01-30 | 安徽大学 | Intelligent rotating dining table |
| CN103778577A (en) * | 2013-08-30 | 2014-05-07 | 陈飞 | Method and device for regulating dining table and recording dining information according to tableware information |
| CN105223848A (en) * | 2015-09-30 | 2016-01-06 | 姜明勇 | A kind of control method of dining table automatic rotation and system |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115316788A (en) * | 2021-12-23 | 2022-11-11 | 宜春学院 | Artificial intelligence dining table based on vision gesture recognition system |
| CN115486640A (en) * | 2022-09-22 | 2022-12-20 | 深圳市金博奥科技有限公司 | Intelligent dining table and control method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111273771A (en) | Control method, device and system of electric dining table and computer readable storage medium | |
| US9154739B1 (en) | Physical training assistant system | |
| CN107084795B (en) | Human body heat source identification method and device and equipment with device | |
| US10665015B2 (en) | Creating multi-dimensional object representations | |
| US20190371134A1 (en) | Self-checkout system, method thereof and device therefor | |
| US20120272158A1 (en) | Method and device for identifying devices which can be targeted for the purpose of establishing a communication session | |
| JP2019075009A (en) | Work support system, kitchen support system, work support method, and program | |
| EP3646776B1 (en) | Skin checking device, product information determination method, device and system | |
| CN105190481A (en) | User interface responsive to operator position and gestures | |
| JP2006035416A (en) | Method for gripping object by means of robot arm equipped with camera | |
| US20200126253A1 (en) | Method of building object-recognizing model automatically | |
| WO2022052613A1 (en) | Camera control method and apparatus, electronic device, and storage medium | |
| CN106845311A (en) | A kind of reading method and device of figure Quick Response Code | |
| CN110386515A (en) | The method and relevant device of control elevator dock floor based on artificial intelligence | |
| CN108108709B (en) | Identification method and device and computer storage medium | |
| CN112902406B (en) | Air conditioner and/or fan parameter setting method, control device and readable storage medium | |
| US20230062332A1 (en) | Image-based pairing and controlling of devices in a clinical environment | |
| CN111078336B (en) | Display method, device, equipment and storage medium | |
| US11620019B1 (en) | Adaptive predictions of contact points on a screen | |
| CN110765926A (en) | Drawing book identification method and device, electronic equipment and storage medium | |
| US20220292549A1 (en) | Systems and methods for computer-aided appraisal | |
| WO2019043734A1 (en) | System and method for generating 360 virtual view of a garment | |
| US20160027131A1 (en) | System and method for projecting an interactive image and processing user interaction | |
| CN111459287A (en) | Integrated 3D projection touch self-service ordering device and system | |
| CN113510707A (en) | Robot control method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |