CN111179123A - Tableware and user association method, device and storage medium - Google Patents
Tableware and user association method, device and storage medium Download PDFInfo
- Publication number
- CN111179123A CN111179123A CN201911285428.4A CN201911285428A CN111179123A CN 111179123 A CN111179123 A CN 111179123A CN 201911285428 A CN201911285428 A CN 201911285428A CN 111179123 A CN111179123 A CN 111179123A
- Authority
- CN
- China
- Prior art keywords
- user
- tableware
- associating
- cutlery
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 32
- 230000000007 visual effect Effects 0.000 claims description 10
- 238000012544 monitoring process Methods 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 6
- 230000001815 facial effect Effects 0.000 claims description 3
- 241001122767 Theaceae Species 0.000 description 2
- 235000021167 banquet Nutrition 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000035622 drinking Effects 0.000 description 1
- 239000003651 drinking water Substances 0.000 description 1
- 235000020188 drinking water Nutrition 0.000 description 1
- 239000000383 hazardous chemical Substances 0.000 description 1
- 231100000206 health hazard Toxicity 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
Landscapes
- Business, Economics & Management (AREA)
- Tourism & Hospitality (AREA)
- Health & Medical Sciences (AREA)
- Economics (AREA)
- General Health & Medical Sciences (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Strategic Management (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Table Devices Or Equipment (AREA)
Abstract
The invention relates to a tableware identification and matching method based on machine vision, in particular to a tableware and user association method, a tableware and user association device and a storage medium. The method for associating tableware with a user comprises the following steps: identification: identifying the user and the tableware; and (3) association step: automatically associating the user with the tableware used by the user when the first use of the tableware by the user is monitored; a prompting step: and when the user forgets the tableware associated with the user or misuses the tableware associated with other users, sending out an alarm. The invention solves the problems of easy loss, confusion and wrong tableware in social occasions.
Description
Technical Field
The invention relates to a tableware identification and matching method based on machine vision, in particular to a tableware and user association method, a tableware and user association device and a storage medium.
Background
In order to increase social atmosphere and social comfort, drinking water, tea, wine or other drinks can be drunk in many social occasions, even people can directly eat at a dining table and socialize, and the situations that cups are pushed, cups are changed, and the people can even move around often occur. Under the conditions, once the number of people who participate in social contact is large, the problems of losing, mixing and even using wrong tableware easily occur, so that the tableware is wasted, and even health hazards are brought by mixed use of the tableware.
Disclosure of Invention
The invention discloses a method, a device and a storage medium for associating tableware with a user, which are used for solving the problems that the tableware is easy to lose, confuse and use wrongly in social occasions.
In order to achieve the purpose, the invention adopts the following technical scheme:
a method of associating tableware with a user, comprising:
identification: identifying the user and the tableware;
and (3) association step: automatically associating the user with the tableware used by the user when the first use of the tableware by the user is monitored;
a prompting step: and when the user forgets the tableware associated with the user or misuses the tableware associated with other users, sending out an alarm.
Further, in the step of identifying, the tableware is identified according to the position where the tableware is located.
Further, in the identifying step, the user is identified according to a face image of the user.
Further, the associating step includes an associating table establishing step of: establishing an association table of users and tableware; the association table includes a utensil location field that records the location of the utensil in real time.
Further, the method for monitoring the position of the tableware in real time comprises the following steps: and establishing a space coordinate system, monitoring the three-dimensional coordinates of the tableware in the space coordinate system in real time, and recording the three-dimensional coordinates as the positions of the tableware.
Further, in the associating step, when a picture that the unassociated tableware is in contact with the mouth of the user is detected, the tableware is associated with the user.
Further, the prompting step further comprises an automatic searching step: when an instruction sent by a user for searching tableware is received, the fact that the user forgets the tableware related to the user is judged, the position of the tableware related to the user is found, and the position information is fed back to the user.
Further, the automatically searching step comprises a position reminding step: displaying, on a display screen or a mobile device of a user, location information of tableware associated with the user; or to voice-broadcast to the user the location information of the cutlery associated with the user.
Further, the prompting step comprises a misuse monitoring step of judging whether the tableware is associated with the user when the condition that the user takes the tableware and puts the tableware close to the mouth is monitored, and if not, judging that the user misuses the tableware associated with other users.
Further, in the prompting step, after the warning is sent out, the position information of the tableware associated with the warning is sent to the user.
A storage medium having stored thereon a computer program which, when executed, implements the method of associating cutlery with a user as described above.
The device for associating the tableware with the user is characterized by comprising a visual identification device, a reminding device and a processor, wherein the visual identification device acquires user image information and tableware image information in a visual range in real time and sends the user image information and the tableware image information to the processor, and the processor executes a method for realizing the association between the tableware and the user according to the user image information and the tableware image information and sends a reminding instruction to the reminding device.
Compared with the prior art, the invention has the beneficial effects that: according to the invention, through real-time monitoring of the user and the tableware, when the tableware is monitored to be used by the user for the first time, the tableware is associated with the user, and when the user does not know which tableware is used by the user or misuses the tableware of other users, the user can be timely prompted to find the tableware used by the user, so that the problems that the tableware is easy to lose, mix up and misuse in social occasions are solved. Compared with the prior art that the tableware is identified by setting the fixed pairing information on the tableware, the method has the advantage of being more flexible, does not need specific tableware, can flexibly and quickly determine the association relationship between the user and the tableware no matter how the user and the tableware are paired for use, and can determine the position of the tableware at any time.
Drawings
FIG. 1 is a block flow diagram of a method of associating cutlery with a user of the present invention.
Detailed Description
The specific embodiments described herein are merely illustrative of the invention and do not delimit the invention.
A device for associating tableware with a user is mainly applied to various social occasions, such as dining table banquet guests, tea room guests and the like, and is mainly used for distinguishing the tableware, matching the tableware with the user and providing the position of the used tableware for the user.
The device mainly comprises a visual identification device, a reminding device, a processor and a storage device. The visual recognition device acquires user image information and tableware image information in a visual range in real time and sends the user image information and the tableware image information to the processor, wherein the user image information comprises but is not limited to facial features and body languages of a user, the tableware mainly comprises dining or drinking appliances such as cups, bowls, chopsticks, spoons, forks and the like, and comprises all appliances in contact with the mouth of the user; the reminding device mainly sends out reminding information to a user by displaying picture information, sending out vibration information or sound information; the storage device is internally stored with computer programs, preset information and matching information of users and tableware, wherein the preset information comprises but is not limited to tableware information, human facial features information and body language information; the processor is used for receiving the identification information of the visual identification device and the instruction sent by the user and responding to the instruction and the identification information sent by the user according to a method executed when the computer program runs.
In order to increase the interactive mode of the user and the device, the device is further provided with a voice recording device and a wireless communication device, the user can send an instruction to the device through body language, can also send the instruction to the device through voice, can also wirelessly connect the mobile phone and the device, and sends the instruction through inputting characters or voice through an interface program (such as a payment service number, a WeChat applet and the like) of a mobile phone website, a special APP or other APPs.
Taking a device which is applied to dining table banquet occasions and is related to users as an example, the device mainly comprises a dining table, a plurality of cameras, a loudspeaker, a display screen, a wireless signal receiving/transmitting device, a memory and a processor, wherein the plurality of cameras are arranged above the dining table, and can freely rotate for 360 degrees, so that the users and the tableware can be conveniently shot in real time; the wireless signal receiver/transmitter is used for receiving the information for searching the tableware sent by the user; the camera and the wireless signal receiving/transmitting device are electrically or communicatively connected with the processor, and after the information received by the camera and the wireless signal receiving/transmitting device is transmitted to the processor, the processor responds to the instruction of the user according to the execution method of the computer program, and the position information of the tableware is displayed on the display screen or the position information of the tableware is played by the loudspeaker at the same time.
Referring to fig. 1, a method of associating cutlery with a user, comprising:
(1) identification:
identifying a user and tableware, specifically, identifying the user according to a face image of the user; the dishes are identified based on where they are located.
(2) And (3) association step:
establishing a space coordinate system, monitoring the three-dimensional coordinates of the tableware in the space coordinate system in real time, and recording the three-dimensional coordinates as the positions of the tableware;
automatically associating a user with the tableware used by the user when the tableware is monitored to be used for the first time, and particularly associating the tableware which is not associated with the user when a picture that the tableware is not associated with the user is monitored to be in contact with the mouth of the user;
and establishing an association table of the user and the tableware, wherein the association table comprises a tableware position field, and the position of the tableware is recorded in real time by the tableware position field.
The method for acquiring the position of the tableware in the space coordinate system mainly comprises the following steps:
the camera device collects images and transmits the images to the processor;
after receiving the collected image, the processor identifies the color and the shape of the collected image, calls preset information stored in the storage device for comparison, and determines a pattern to be identified;
after the identified pattern is determined, carrying out image enhancement, edge sharpening, noise reduction and other processing on the pattern, measuring the length and the area of a product, determining the center of the pattern, and taking the center of the pattern as a position representative of the pattern;
three-dimensional coordinates of the center of the pattern are read in a spatial coordinate system, and three-dimensional coordinate information is recorded in an association table of the user and the tableware.
(3) A prompting step:
when the situation that the user forgets the tableware associated with the user is monitored, or the user misuses the tableware associated with other users is monitored, a warning is sent out;
and after the warning is sent out, the position information of the tableware associated with the warning is sent to the user.
The step of prompting comprises a misuse monitoring step, wherein when the condition that the user takes the tableware and puts the tableware close to the mouth is monitored, whether the tableware is related to the user or not is judged, and if not, the fact that the user misuses the tableware related to other users is judged.
The prompting step also comprises an automatic searching step:
when an instruction sent by a user for searching tableware is received, the fact that the user forgets the tableware related to the user is judged, the position of the tableware related to the user is found, and the position information is fed back to the user.
The method for feeding back the position information to the user comprises the following steps: displaying, on a display screen or a mobile device of a user, location information of tableware associated with the user; or to voice-broadcast to the user the location information of the cutlery associated with the user.
The above description is only a preferred embodiment of the present invention, the present invention is not limited to the above embodiment, and there may be some slight structural changes in the implementation, and if there are various changes or modifications to the present invention without departing from the spirit and scope of the present invention, and within the claims and equivalent technical scope of the present invention, the present invention is also intended to include those changes and modifications.
Claims (12)
1. A method of associating tableware with a user, comprising:
identification: identifying the user and the tableware;
and (3) association step: automatically associating the user with the tableware used by the user when the first use of the tableware by the user is monitored;
a prompting step: and when the user forgets the tableware associated with the user or misuses the tableware associated with other users, sending out an alarm.
2. The method of associating cutlery with a user as claimed in claim 1, wherein in the step of identifying, the cutlery is identified according to where the cutlery is located.
3. The method of associating tableware with a user according to claim 1, wherein in said identifying step, the user is identified based on a facial image of the user.
4. The method of associating cutlery with a user as claimed in claim 2, wherein the associating step comprises an association table establishing step of: establishing an association table of users and tableware; the association table includes a utensil location field that records the location of the utensil in real time.
5. The method for associating tableware with a user according to claim 4, wherein the method for monitoring the position of the tableware in real time comprises the following steps: and establishing a space coordinate system, monitoring the three-dimensional coordinates of the tableware in the space coordinate system in real time, and recording the three-dimensional coordinates as the positions of the tableware.
6. The method of claim 1, wherein in the associating step, when a picture that the tableware which is not associated is in contact with the mouth of the user is monitored, the tableware is associated with the user.
7. The method of associating cutlery with a user as claimed in claim 1, wherein the step of prompting further comprises the step of automatically finding: when an instruction sent by a user for searching tableware is received, the fact that the user forgets the tableware related to the user is judged, the position of the tableware related to the user is found, and the position information is fed back to the user.
8. The method of associating cutlery with a user as claimed in claim 7, wherein the automatically finding step comprises a location alert step of: displaying, on a display screen or a mobile device of a user, location information of tableware associated with the user; or to voice-broadcast to the user the location information of the cutlery associated with the user.
9. The method of claim 1, wherein the step of prompting includes a misuse monitoring step of determining whether the utensil is associated with the user when the user is detected to take the utensil and bring the utensil close to the mouth, and if not, determining that the user misuses utensils associated with other users.
10. The method for associating tableware with a user according to claim 1, wherein in the step of prompting, after the warning is issued, the position information of the tableware associated with the warning is sent to the user.
11. A storage medium having stored thereon a computer program, wherein the computer program when executed implements a method of associating cutlery as claimed in any of claims 1 to 10 with a user.
12. An apparatus for associating tableware with a user, comprising a visual recognition device, a reminding device and a processor, wherein the visual recognition device acquires user image information and tableware image information in a visual range in real time and sends the user image information and the tableware image information to the processor, and the processor executes a method for realizing the tableware-user association according to any one of claims 1-10 according to the user image information and the tableware image information and sends a reminding instruction to the reminding device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911285428.4A CN111179123A (en) | 2019-12-13 | 2019-12-13 | Tableware and user association method, device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911285428.4A CN111179123A (en) | 2019-12-13 | 2019-12-13 | Tableware and user association method, device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111179123A true CN111179123A (en) | 2020-05-19 |
Family
ID=70651990
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911285428.4A Pending CN111179123A (en) | 2019-12-13 | 2019-12-13 | Tableware and user association method, device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111179123A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101727776A (en) * | 2008-10-14 | 2010-06-09 | 深圳市创翔通讯技术有限公司 | Easily-distinguished simple label |
| CN102897377A (en) * | 2012-09-10 | 2013-01-30 | 田治友 | Method enabling beverage containers and tableware to be not easy to be confused |
| CN104013306A (en) * | 2014-06-03 | 2014-09-03 | 上海理工大学 | Object recognition water dispenser and intelligent water drinking control system and method |
| CN105795832A (en) * | 2016-03-25 | 2016-07-27 | 宇龙计算机通信科技(深圳)有限公司 | Control method and device of intelligent cup and intelligent cup |
| US20180018669A1 (en) * | 2016-07-14 | 2018-01-18 | International Business Machines Corporation | Index of usability for a replacement payment card |
-
2019
- 2019-12-13 CN CN201911285428.4A patent/CN111179123A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101727776A (en) * | 2008-10-14 | 2010-06-09 | 深圳市创翔通讯技术有限公司 | Easily-distinguished simple label |
| CN102897377A (en) * | 2012-09-10 | 2013-01-30 | 田治友 | Method enabling beverage containers and tableware to be not easy to be confused |
| CN104013306A (en) * | 2014-06-03 | 2014-09-03 | 上海理工大学 | Object recognition water dispenser and intelligent water drinking control system and method |
| CN105795832A (en) * | 2016-03-25 | 2016-07-27 | 宇龙计算机通信科技(深圳)有限公司 | Control method and device of intelligent cup and intelligent cup |
| US20180018669A1 (en) * | 2016-07-14 | 2018-01-18 | International Business Machines Corporation | Index of usability for a replacement payment card |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10147184B2 (en) | Seizure detection | |
| WO2015133195A1 (en) | Information processing device, information processing method, and program | |
| CN104835084B (en) | System for acquiring food selection information | |
| CN109993157A (en) | Allocator, device, equipment and readable storage medium storing program for executing based on robot | |
| CN109816561A (en) | It is a kind of to take dish method, system and storage medium automatically | |
| WO2017152592A1 (en) | Mobile terminal application operation method and mobile terminal | |
| US11478096B2 (en) | Food monitoring system | |
| WO2018150756A1 (en) | Information processing device, information processing method, and storage medium | |
| CN108172273A (en) | A kind of refrigerator food materials based on visitor recommend method | |
| US10382611B2 (en) | Activity information sharing method and apparatus | |
| CN111179123A (en) | Tableware and user association method, device and storage medium | |
| WO2016188469A2 (en) | System for obtaining dish selection information | |
| CN104333661A (en) | Mobile device and limited communication method based on drunk detection | |
| JP2017503250A5 (en) | ||
| CN205427945U (en) | Get meal calling system | |
| CN109670986A (en) | A kind of method of ordering and system | |
| CN106372546B (en) | Intelligent catering device, information processing system and information processing method | |
| WO2017130431A1 (en) | Information processing device, information processing system, reception device, server device, information processing method, and program | |
| CN106125590A (en) | The based reminding method of intelligent appliance, device and intelligent appliance | |
| CN109346152A (en) | A kind of user's eating habit information acquisition system and method | |
| CN206179059U (en) | Dining room queueing system of calling out numbers based on electron paper | |
| CN107346522A (en) | A kind of meal ordering system based on Intelligent worn device | |
| CN110141089B (en) | Intelligent drinking amount reminding system and drinking suite thereof | |
| KR20180083784A (en) | Apparatus for providing information using image processing of table region and method thereof | |
| CN111192167A (en) | Working method and device of service platform based on mobile terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20230328 Address after: 510700 501-2, Guangzheng science and Technology Industrial Park, No. 11, Nanyun 5th Road, Science City, Huangpu District, Guangzhou City, Guangdong Province Applicant after: GUANGZHOU FUGANG LIFE INTELLIGENT TECHNOLOGY Co.,Ltd. Address before: 510700 501-1, Guangzheng science and Technology Industrial Park, No. 11, Yunwu Road, Science City, Huangpu District, Guangzhou City, Guangdong Province Applicant before: GUANGZHOU FUGANG WANJIA INTELLIGENT TECHNOLOGY Co.,Ltd. |
|
| TA01 | Transfer of patent application right |