CN111508142A - Sight voice interaction automatic cigarette vending machine - Google Patents
Sight voice interaction automatic cigarette vending machine Download PDFInfo
- Publication number
- CN111508142A CN111508142A CN202010306041.9A CN202010306041A CN111508142A CN 111508142 A CN111508142 A CN 111508142A CN 202010306041 A CN202010306041 A CN 202010306041A CN 111508142 A CN111508142 A CN 111508142A
- Authority
- CN
- China
- Prior art keywords
- module
- voice
- sight
- vending machine
- control system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 68
- 235000019504 cigarettes Nutrition 0.000 title claims abstract description 52
- 238000012795 verification Methods 0.000 claims abstract description 24
- 238000004891 communication Methods 0.000 claims abstract description 14
- 210000001508 eye Anatomy 0.000 claims description 27
- 238000000034 method Methods 0.000 claims description 22
- 238000013527 convolutional neural network Methods 0.000 claims description 12
- 238000004364 calculation method Methods 0.000 claims description 8
- 230000009467 reduction Effects 0.000 claims description 8
- 238000001514 detection method Methods 0.000 claims description 6
- 238000012549 training Methods 0.000 claims description 6
- 238000007781 pre-processing Methods 0.000 claims description 5
- 238000012545 processing Methods 0.000 claims description 4
- 210000005252 bulbus oculi Anatomy 0.000 claims description 3
- 238000005286 illumination Methods 0.000 claims description 3
- 238000005192 partition Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 claims description 3
- 238000012216 screening Methods 0.000 claims description 3
- 238000000638 solvent extraction Methods 0.000 claims description 3
- 230000008859 change Effects 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/62—Text, e.g. of license plates, overlay texts or captions on TV images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/197—Matching; Classification
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/28—Constructional details of speech recognition systems
- G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/28—Constructional details of speech recognition systems
- G10L15/34—Adaptation of a single recogniser for parallel processing, e.g. by use of multiple processors or cloud computing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Artificial Intelligence (AREA)
- General Health & Medical Sciences (AREA)
- Acoustics & Sound (AREA)
- Computing Systems (AREA)
- Evolutionary Computation (AREA)
- Mathematical Physics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biophysics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Ophthalmology & Optometry (AREA)
- Biomedical Technology (AREA)
- Software Systems (AREA)
- Molecular Biology (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Control Of Vending Devices And Auxiliary Devices For Vending Devices (AREA)
Abstract
The invention relates to the technical field of self-service vending machines, and discloses a sight line voice interaction automatic cigarette vending machine, which comprises a cigarette vending machine body, wherein the cigarette vending machine body internally comprises an edge computing processor, a central control system, a cloud server, a communication module, a controller, an input module, a display module, a voice module, a human-computer interaction module and an identity verification module; the human-computer interaction module, the identity authentication module, the voice module and the input module are respectively connected with an edge computing processor, the edge computing processor is connected with a central control system, the central control system is connected with a cloud server through a communication module, and the central control system is connected with a controller; the human-computer interaction module is used for receiving the instruction and identifying the instruction; the identity verification module is used for verifying whether the buyer is full of 18 years old; the invention has high intelligent degree and less contact, reduces the sanitary risk, and simultaneously avoids selling cigarettes to minors under 18 years old through identity verification.
Description
Technical Field
The invention relates to the technical field of self-service vending machines, in particular to a sight voice interaction automatic cigarette vending machine.
Background
With the evolution of computer computing speed and storage capacity, the development of artificial intelligence and machine learning, natural language understanding and recognition and speech synthesis in a specific range of computers become reality, and self-service becomes a part of convenient life of people and is more and more popular.
At present, the traditional shopping methods of the sight voice interaction automatic cigarette vending machine mainly comprise the following steps: (1) based on cash: the method has the disadvantages that the consumer is required to prepare paper money or coins with a specific denomination requirement, the use is inconvenient, and particularly when the paper money is used, the single shopping time is long, the rejection rate of the cash identification and receiving equipment is high, and the experience of the consumer is influenced; (2) based on mobile payment: the disadvantage is that the consumer is required to have a mobile phone with payment function; (3) based on face payment, the method also needs to bind the mobile phone of the consumer in advance, and each time the mobile phone is connected to the cloud end of the wide area network in real time, and the account number corresponding to the cloud end needs to have enough balance; (4) payment based on the membership card: each member is required to carry a membership card, and if the membership card is provided with a password, the operation is not convenient enough; if the password is not set, the password is lost and then the password is stolen.
However, no matter which payment method is adopted, the following technical problems exist: if the majority of smokers purchase cigarettes by using the method, the method is not a feasible or optimal method, and the behavior of 'forbidding the sale of cigarettes to minors' cannot be completely practiced; some old people can not use the cell-phone, and the membership card then loses easily, and sell the cigarette by oneself and need pay attention to personal health protection, uses public keyboard or touch-sensitive screen to have hidden health risk.
Disclosure of Invention
The invention provides a sight line voice interaction automatic cigarette vending machine for solving the problems in the prior art, which has high intelligent degree and less contact, reduces the sanitary risk, and simultaneously avoids the cigarette vending to minors under 18 years old through identity verification.
In order to solve the technical problems, the technical scheme of the invention is as follows: the sight line voice interaction automatic cigarette selling machine comprises a cigarette selling machine body, wherein the cigarette selling machine body internally comprises an edge computing processor, a central control system, a cloud server, a communication module, a controller, an input module, a display module, a voice module, a man-machine interaction module and an identity verification module; the human-computer interaction module, the identity authentication module, the voice module and the input module are respectively connected with an edge computing processor, the edge computing processor is connected with a central control system, the central control system is connected with a cloud server through a communication module, and the central control system is connected with a controller;
the human-computer interaction module is used for receiving the instruction and identifying the instruction;
the identity verification module is used for verifying whether the buyer is full of 18 years old.
Further, the display module is a display screen, and the voice module comprises a microphone and a loudspeaker.
Furthermore, the human-computer interaction module is a sight line interaction module, and the sight line interaction module judges the shopping requirements of the shopper according to the sight line of the eyeball.
Further, the sight line interaction module comprises a camera, a face database and a convolutional neural network model.
Further, the interaction method of the sight line interaction module comprises the following steps:
the method comprises the following steps: establishing a face database; acquiring data in the process that a plurality of individuals watch a fixation point randomly appearing on a display screen under the conditions of different illumination, different time and different positions, carrying out face detection and human eye detection on the acquired images to obtain human eye area images, establishing a human eye database and screening human eye images;
step two: dividing the human eye images into a training set and a verification set as input of a convolutional neural network model, partitioning the display screen according to actual application requirements, regarding the human eye images which are watched on the same partition of the display screen as a class, classifying the human eye images, and training the convolutional neural network model;
step three: when the sight line estimation is carried out, the eye image to be classified is input into the trained convolutional neural network model, the classification of the eye image can be judged, and a corresponding display screen fixation position block is correspondingly obtained, so that the sight line direction is estimated; the edge calculation processor transmits the result to the central control system, and outputs a sight line recognition result and plays the next operation guide through the loudspeaker;
step four: and the central control system changes the display screen page according to the sight line recognition result, and completes the selection, payment and purchase of the cigarettes one by one.
Furthermore, the man-machine interaction module is a voice interaction module, and the voice interaction module judges the shopping requirements of the shopper according to voice recognition.
Further, the voice interaction module comprises a voice recognition noise reduction device and a voice recognition server.
Further, the interaction method of the voice interaction module comprises the following steps:
the method comprises the following steps: inputting a voice signal through a microphone, and obtaining a voice recognition result signal after noise reduction processing is carried out on the voice signal through a voice recognition noise reduction device;
step two: a voice recognition result signal is uploaded to a voice recognition server of a cloud server through a communication module, and the voice recognition server analyzes the voice recognition result signal to obtain an online voice recognition result;
step three: the cloud server transmits the online voice recognition result to the edge computing processor through the wireless module;
step four: the edge calculation processor transmits the result to the central control system, and outputs a voice recognition result and plays the next operation guide through the loudspeaker;
step five: and the central control system changes the display screen display page according to the voice recognition result and completes the selection, payment and purchase of the cigarettes one by one.
Further, the identity verification module comprises: the system comprises a face acquisition unit, a face recognition unit, a certificate type selection unit, a certificate acquisition unit, an identity information interception unit, a preprocessing unit, an OCR unit, an identity verification unit and a database; face acquisition unit signal output part is connected with certificate type selection unit signal input part, certificate acquisition unit signal input part is connected with certificate type selection unit signal output part, identity information intercepting unit signal input part is connected with certificate acquisition unit signal output part, preprocessing unit signal input part is connected with identity intercepting unit signal output part, identity verification unit signal input part is connected with OCR unit's signal output part, face identification unit is connected with the database.
Further, sell cigarette machine body and still include box and chamber door, box and chamber door open and shut through hidden lock, be provided with lamp house and shipment mouth on the chamber door, be provided with power module, storage rack, goods way and delivery warehouse in the box, storage rack adopts clip goods way, clip goods way is controlled by the controller.
Compared with the prior art, beneficial effect does: towards vast smokers' group, use man-machine interaction module and authentication module, can be quick effectual realization authentication and friendly man-machine interaction to obtain required commodity, as novel intelligent shopping guide to attract customer to a certain extent and improve commodity purchase rate.
Drawings
FIG. 1 is a schematic structural view of a cigarette vending machine body;
FIG. 2 is a flowchart of a first embodiment;
FIG. 3 is a flowchart of the second embodiment.
The cigarette vending machine comprises a cigarette vending machine body 1, an edge computing processor 2, a central control system 3, a cloud server 4, a communication module 5, a controller 6, an input module 7, a display module 8, a voice module 9, a sight line interaction module 10, a voice interaction module 11, an identity verification module 12, a box body 13, a box door 14, a lamp box 16, a goods outlet 17, a power supply module 18, a storage rack 19, a goods channel 20 and a goods outlet 21.
Detailed Description
The technical scheme of the sight line voice interaction automatic cigarette vending machine related to the invention is further explained in detail by combining the embodiment.
The first embodiment is as follows:
the sight line voice interaction automatic cigarette selling machine of the embodiment shown in fig. 1 and fig. 2 comprises a cigarette selling machine body, wherein the cigarette selling machine body internally comprises an edge computing processor, a central control system, a cloud server, a communication module, a controller, an input module, a display module, a voice module, a man-machine interaction module and an identity verification module; the human-computer interaction module, the identity authentication module, the voice module and the input module are respectively connected with an edge computing processor, the edge computing processor is connected with a central control system, the central control system is connected with a cloud server through a communication module, and the central control system is connected with a controller; the display module is a display screen, and the voice module comprises a microphone and a loudspeaker;
the human-computer interaction module is used for receiving the instruction and identifying the instruction;
the identity verification module is used for verifying whether the buyer is full of 18 years old.
In the embodiment, the human-computer interaction module is a sight line interaction module, and the sight line interaction module judges the shopping requirements of the shopper according to the sight line of the eyeball; the sight line interaction module comprises a camera, a face database and a convolutional neural network model.
The interaction method of the line-of-sight interaction module in the embodiment comprises the following steps:
the method comprises the following steps: establishing a face database; acquiring data in the process that a plurality of individuals watch a fixation point randomly appearing on a display screen under the conditions of different illumination, different time and different positions, carrying out face detection and human eye detection on the acquired images to obtain human eye area images, establishing a human eye database and screening human eye images;
step two: dividing the human eye images into a training set and a verification set as input of a convolutional neural network model, partitioning the display screen according to actual application requirements, regarding the human eye images which are watched on the same partition of the display screen as a class, classifying the human eye images, and training the convolutional neural network model;
step three: when the sight line estimation is carried out, the eye image to be classified is input into the trained convolutional neural network model, the classification of the eye image can be judged, and a corresponding display screen fixation position block is correspondingly obtained, so that the sight line direction is estimated; the edge calculation processor transmits the result to the central control system, and outputs a sight line recognition result and plays the next operation guide through the loudspeaker;
step four: and the central control system changes the display screen page according to the sight line recognition result, and completes the selection, payment and purchase of the cigarettes one by one.
The operation steps of the sight line voice interaction automatic cigarette vending machine comprise:
1. before a consumer sells cigarette machines through line-of-sight voice interaction, a camera monitors face data and wakes up equipment;
2. the central control system broadcasts voice through a loudspeaker to prompt the consumer to place the identity document in a designated area;
3. the identity authentication module is used for authentication and comparison, if the age group which is in line with the purchase is confirmed, the display screen or the loudspeaker prompts that the authentication is successful, and the consumption program is entered for purchasing and payment, if the age group which is not in line with the purchase is confirmed, the display screen or the loudspeaker prompts that the authentication is failed;
4. after the consumer is prompted by successful verification, the consumer watches the commodity name needing to be purchased on the display screen according to the operation guide line of sight, the line of sight information is intelligently identified by the edge computing processor and is uploaded to the cloud server by the central control system through the communication module;
5. the central control system controls the page change of the display screen, after the content change of the display screen interface is seen by a consumer, follow-up operation is completed according to the guide, the cigarette vending machine commodity with the line of sight voice interaction is delivered according to the stock database in the cloud server, and meanwhile, the stock database and the consumption database related information in the cloud server are updated.
In this embodiment, the identity verification module includes:
the face acquisition unit is used for acquiring face information of a buyer;
the face recognition unit is used for acquiring the identity information of the purchaser from the database;
the certificate type selection unit is used for defaulting the identity card as a preferred certificate and manually selecting other identity card types through the input module;
the certificate acquisition unit is used for acquiring image information of the certificate;
the identity information intercepting unit is used for intercepting a face area and a birth date in the certificate image information area;
the preprocessing unit is used for processing the image information of the certificate to obtain machine-readable code information which can be recognized by the OCR unit;
an OCR unit for recognizing the machine-readable code information to obtain identity information;
the identity verification unit is used for verifying whether the identity information is aged up to 18 years old and whether the identity document and the buyer are the same person;
and the database is used for storing the identity information of the buyer, and if the face recognition unit acquires the buyer information from the database and the age is 18 years old, subsequent identity verification is not required.
In this embodiment, sell cigarette machine body and still include box and chamber door, box and chamber door open and shut through hidden lock, be provided with lamp house and shipment mouth on the chamber door, be provided with power module, storage rack, goods way and delivery storehouse in the box, storage rack adopts clip goods way, clip goods way is controlled by the controller.
Example two:
as shown in fig. 1 and fig. 3, compared with the first embodiment, the difference is that the line-of-sight interaction module is changed into a voice interaction module, and the interaction method of the voice interaction module includes:
the method comprises the following steps: inputting a voice signal through a microphone, and obtaining a voice recognition result signal after noise reduction processing is carried out on the voice signal through a voice recognition noise reduction device;
step two: a voice recognition result signal is uploaded to a voice recognition server of a cloud server through a communication module, and the voice recognition server analyzes the voice recognition result signal to obtain an online voice recognition result;
step three: the cloud server transmits the online voice recognition result to the edge computing processor through the wireless module;
step four: the edge calculation processor transmits the result to the central control system, and outputs a voice recognition result and plays the next operation guide through the loudspeaker;
step five: and the central control system changes the display screen display page according to the voice recognition result and completes the selection, payment and purchase of the cigarettes one by one.
The operation steps of the sight line voice interaction automatic cigarette vending machine comprise:
1. before the cigarette vending machine is automatically sold by the consumers through line of sight voice interaction, the devices are awakened through voices;
2. the edge calculation processor synthesizes a piece of voice information with the voice word stock according to the specific information and transmits the voice information to the central control system, and the central control system broadcasts the voice through a loudspeaker to prompt the consumer to place the identity document in a designated area;
3. the identity authentication module is used for authentication and comparison, if the age group which is in line with the purchase is confirmed, the display screen or the loudspeaker prompts that the authentication is successful, and the consumption program is entered for purchasing and payment, if the age group which is not in line with the purchase is confirmed, the display screen or the loudspeaker prompts that the authentication is failed;
4. after hearing the voice broadcast by the loudspeaker of the automatic cigarette selling equipment, the consumer speaks the name of the commodity to be purchased, and the voice information is intelligently identified by the edge computing processor and uploaded to the cloud server by the central control system through the communication module;
5. the edge calculation processor identifies a specific trade name keyword by extracting voice features, finds out a picture, a price and inventory information (whether goods exist) of the corresponding trade name, synthesizes the voice information with the voice word stock according to the specific information and transmits the voice information to the central control system, and the central control system sends the picture information and the price information of the goods to the display screen;
6. receiving commodity picture information, commodity names and price information by a display screen of the sight line voice interaction automatic cigarette vending machine, and simultaneously playing voice information by a loudspeaker;
7. the consumer sees the content displayed on the display, and after hearing the voice played by the loudspeaker, answers yes or no; the microphone collects the voice of the consumer and uploads the voice to the cloud server;
8. if the collected voice is confirmed to be 'yes', the cigarette vending machine commodities are automatically sold according to the sight voice interaction and delivered with the inventory database in the cloud server, and meanwhile, the relevant information of the inventory database and the consumption database in the cloud server is updated.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (10)
1. Sight voice interaction automatic cigarette selling machine comprises a cigarette selling machine body and is characterized in that: the cigarette vending machine body internally comprises an edge computing processor, a central control system, a cloud server, a communication module, a controller, an input module, a display module, a voice module, a human-computer interaction module and an identity verification module; the human-computer interaction module, the identity authentication module, the voice module and the input module are respectively connected with an edge computing processor, the edge computing processor is connected with a central control system, the central control system is connected with a cloud server through a communication module, and the central control system is connected with a controller;
the human-computer interaction module is used for receiving the instruction and identifying the instruction;
the identity verification module is used for verifying whether the buyer is full of 18 years old.
2. The line-of-sight voice-interactive cigarette vending machine according to claim 1, wherein: the display module is a display screen, and the voice module comprises a microphone and a loudspeaker.
3. The line-of-sight voice-interactive cigarette vending machine according to claim 2, wherein: the human-computer interaction module is a sight line interaction module, and the sight line interaction module judges the shopping requirements of the shopper according to the sight line of the eyeball.
4. The line-of-sight voice-interactive cigarette vending machine according to claim 3, wherein: the sight line interaction module comprises a camera, a face database and a convolutional neural network model.
5. The line-of-sight voice-interactive cigarette vending machine according to claim 4, wherein: the interaction method of the sight line interaction module comprises the following steps:
the method comprises the following steps: establishing a face database; acquiring data in the process that a plurality of individuals watch a fixation point randomly appearing on a display screen under the conditions of different illumination, different time and different positions, carrying out face detection and human eye detection on the acquired images to obtain human eye area images, establishing a human eye database and screening human eye images;
step two: dividing the human eye images into a training set and a verification set as input of a convolutional neural network model, partitioning the display screen according to actual application requirements, regarding the human eye images which are watched on the same partition of the display screen as a class, classifying the human eye images, and training the convolutional neural network model;
step three: when the sight line estimation is carried out, the eye image to be classified is input into the trained convolutional neural network model, the classification of the eye image can be judged, and a corresponding display screen fixation position block is correspondingly obtained, so that the sight line direction is estimated; the edge calculation processor transmits the result to the central control system, and outputs a sight line recognition result and plays the next operation guide through the loudspeaker;
step four: and the central control system changes the display screen page according to the sight line recognition result, and completes the selection, payment and purchase of the cigarettes one by one.
6. The line-of-sight voice-interactive cigarette vending machine according to claim 2, wherein: the man-machine interaction module is a voice interaction module, and the voice interaction module judges the shopping requirements of the shopper according to voice recognition.
7. The line-of-sight voice-interactive cigarette vending machine according to claim 6, wherein: the voice interaction module comprises a voice recognition noise reduction device and a voice recognition server.
8. The line-of-sight voice-interactive cigarette vending machine according to claim 7, wherein: the interaction method of the voice interaction module comprises the following steps:
the method comprises the following steps: inputting a voice signal through a microphone, and obtaining a voice recognition result signal after noise reduction processing is carried out on the voice signal through a voice recognition noise reduction device;
step two: a voice recognition result signal is uploaded to a voice recognition server of a cloud server through a communication module, and the voice recognition server analyzes the voice recognition result signal to obtain an online voice recognition result;
step three: the cloud server transmits the online voice recognition result to the edge computing processor through the wireless module;
step four: the edge calculation processor transmits the result to the central control system, and outputs a voice recognition result and plays the next operation guide through the loudspeaker;
step five: and the central control system changes the display screen display page according to the voice recognition result and completes the selection, payment and purchase of the cigarettes one by one.
9. The sight line voice interaction automatic cigarette vending machine according to any one of claims 1 to 8, characterized in that: the identity verification module comprises: the system comprises a face acquisition unit, a face recognition unit, a certificate type selection unit, a certificate acquisition unit, an identity information interception unit, a preprocessing unit, an OCR unit, an identity verification unit and a database; face acquisition unit signal output part is connected with certificate type selection unit signal input part, certificate acquisition unit signal input part is connected with certificate type selection unit signal output part, identity information intercepting unit signal input part is connected with certificate acquisition unit signal output part, preprocessing unit signal input part is connected with identity intercepting unit signal output part, identity verification unit signal input part is connected with OCR unit's signal output part, face identification unit is connected with the database.
10. The line-of-sight voice-interactive cigarette vending machine according to claim 9, wherein: the cigarette vending machine body further comprises a box body and a box door, the box body and the box door are opened and closed through a hidden door lock, a lamp box and a goods outlet are arranged on the box door, a power module, a storage rack, a goods channel and a goods outlet bin are arranged in the box body, the storage rack adopts a clip goods channel, and the clip goods channel is controlled by a controller.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010306041.9A CN111508142A (en) | 2020-04-17 | 2020-04-17 | Sight voice interaction automatic cigarette vending machine |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010306041.9A CN111508142A (en) | 2020-04-17 | 2020-04-17 | Sight voice interaction automatic cigarette vending machine |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111508142A true CN111508142A (en) | 2020-08-07 |
Family
ID=71864720
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010306041.9A Pending CN111508142A (en) | 2020-04-17 | 2020-04-17 | Sight voice interaction automatic cigarette vending machine |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111508142A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113965550A (en) * | 2021-10-15 | 2022-01-21 | 天津大学 | Intelligent interactive remote auxiliary video system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104216508A (en) * | 2013-05-31 | 2014-12-17 | 中国电信股份有限公司 | Method and device for operating function key through eye movement tracking technique |
| CN106875564A (en) * | 2017-02-06 | 2017-06-20 | 深圳市松禾信息技术有限公司 | Cigarette-vending machine and automatic selling cigarette method |
| CN107392120A (en) * | 2017-07-06 | 2017-11-24 | 电子科技大学 | A kind of notice intelligence direct method based on sight estimation |
| WO2018176015A1 (en) * | 2017-03-24 | 2018-09-27 | Magic Leap, Inc. | Accumulation and confidence assignment of iris codes |
| CN109658191A (en) * | 2018-12-20 | 2019-04-19 | 中南大学 | A kind of member's purchase system and method based on language identification and recognition of face |
| CN110865966A (en) * | 2019-11-21 | 2020-03-06 | 国网河北省电力有限公司邯郸供电分公司 | Community intelligent electricity service robot terminal based on ubiquitous Internet of things |
-
2020
- 2020-04-17 CN CN202010306041.9A patent/CN111508142A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104216508A (en) * | 2013-05-31 | 2014-12-17 | 中国电信股份有限公司 | Method and device for operating function key through eye movement tracking technique |
| CN106875564A (en) * | 2017-02-06 | 2017-06-20 | 深圳市松禾信息技术有限公司 | Cigarette-vending machine and automatic selling cigarette method |
| WO2018176015A1 (en) * | 2017-03-24 | 2018-09-27 | Magic Leap, Inc. | Accumulation and confidence assignment of iris codes |
| CN107392120A (en) * | 2017-07-06 | 2017-11-24 | 电子科技大学 | A kind of notice intelligence direct method based on sight estimation |
| CN109658191A (en) * | 2018-12-20 | 2019-04-19 | 中南大学 | A kind of member's purchase system and method based on language identification and recognition of face |
| CN110865966A (en) * | 2019-11-21 | 2020-03-06 | 国网河北省电力有限公司邯郸供电分公司 | Community intelligent electricity service robot terminal based on ubiquitous Internet of things |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113965550A (en) * | 2021-10-15 | 2022-01-21 | 天津大学 | Intelligent interactive remote auxiliary video system |
| CN113965550B (en) * | 2021-10-15 | 2023-08-18 | 天津大学 | Intelligent interactive remote auxiliary video system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11429712B2 (en) | Systems and methods for dynamic passphrases | |
| AU2017252625B2 (en) | Systems and methods for sensor data analysis through machine learning | |
| US20190095775A1 (en) | Artificial intelligence (ai) character system capable of natural verbal and visual interactions with a human | |
| CN110222554A (en) | Cheat recognition methods, device, electronic equipment and storage medium | |
| CN109658191A (en) | A kind of member's purchase system and method based on language identification and recognition of face | |
| CN107230142A (en) | Method and device, method of commerce and system based on speech production order | |
| CN109829358A (en) | Micro- expression loan control method, device, computer equipment and storage medium | |
| CN106611447A (en) | Work attendance method and apparatus | |
| CN105869278A (en) | A method, a system and a selling machine for automatic tobacco selling | |
| WO2022073519A1 (en) | Method, apparatus and device for applying for account in virtual bank, and computer storage medium | |
| CN111222410A (en) | Shop and merchant consumption behavior analysis guiding marketing system based on face recognition | |
| CN108985776A (en) | Credit card security monitoring method based on multiple Information Authentication | |
| CN108805644A (en) | The commercial articles vending method and machine for vending of machine for vending | |
| CN106897921A (en) | A kind of commodity purchasing method and apparatus based on express delivery cabinet | |
| CN111598651A (en) | Item donation system, item donation method, item donation device, item donation equipment and item donation medium | |
| KR102296404B1 (en) | Planning system and method of financial contents | |
| CN111508142A (en) | Sight voice interaction automatic cigarette vending machine | |
| JP7004886B1 (en) | A system, method, and program for determining the product or service that is suitable for the user. | |
| CN113887884A (en) | Business-super service system | |
| KR102035141B1 (en) | Planning system and method of financial contents | |
| US20240095651A1 (en) | System and method for unmanned or undermanned delivery of restricted products | |
| JP2020038562A (en) | Information processing device, information processing method, and information processing program | |
| CN112766824A (en) | Data processing method and device, electronic equipment and storage medium | |
| JP2023531946A (en) | interactive vending machine | |
| CN101599196B (en) | Automated transaction machine |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information |
Inventor after: Long Tao Inventor after: Chao Hang Inventor before: Yang Heng Inventor before: Long Tao Inventor before: Chao Hang |
|
| CB03 | Change of inventor or designer information | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200807 |
|
| RJ01 | Rejection of invention patent application after publication |