CN108170056A - A kind of interaction drive robot and its control method - Google Patents
A kind of interaction drive robot and its control method Download PDFInfo
- Publication number
- CN108170056A CN108170056A CN201711466493.8A CN201711466493A CN108170056A CN 108170056 A CN108170056 A CN 108170056A CN 201711466493 A CN201711466493 A CN 201711466493A CN 108170056 A CN108170056 A CN 108170056A
- Authority
- CN
- China
- Prior art keywords
- module
- fatigue
- driver
- processing unit
- central processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
- G05B19/042—Programme control other than numerical control, i.e. in sequence controllers or logic controllers using digital processors
- G05B19/0423—Input/output
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/25—Pc structure of the system
- G05B2219/25257—Microcontroller
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present patent application discloses a kind of interaction drive robot, is related to human-computer interaction technology, including face information identification module, for acquiring driver's face information, and judges expression type according to face information；Central processing unit for, according to pre-stored level of fatigue list deciding level of fatigue, and being sent to human-computer interaction module according to expression type, starts human-computer interaction module work；Human-computer interaction module, for receive according to central processing unit transmission come level of fatigue start corresponding conversations list and driver and engage in the dialogue communication.The present invention can effectively reduce driver because of traffic accident caused by fatigue driving.
Description
Technical field
The present invention relates to field of human-computer interaction, and in particular to a kind of interaction drive robot and its control method.
Background technology
Fatigue driving always is one of the main reason for causing traffic accident.However at these because fatigue driving causes
Traffic accident in, most people is that painful consequence is caused because oneself fatigue driving is not recognized.It is long-term single
The driving route of tune easily makes one to generate feeling of fatigue.And the animal that people is extremely strong as a kind of subjectivity, it tends not to objective correct
Ground judges the tired situation of oneself, especially when the judgement of itself can also be declined people under fatigue state, more holds
Easily judge oneself current tired situation by accident.
In order to reduce people because fatigue driving and caused by traffic accident, patent ZL 201510094772.0 discloses one
Anti-fatigue-driving safety equipment and its application method of the kind based on iris recognition, the anti-fatigue-driving safety equipment are adopted including iris
Collect unit, data transmission unit, data processing unit and alarm unit；Iris capturing unit is for the real-time rainbow for acquiring driver
Film feature；Data transmission unit is connect with iris capturing unit, and it is used for the collected driver's of iris capturing unit
Iris feature is sent to iris comparing module；Data processing unit is connect with data transmission unit, and it is used for iris capturing
The iris feature of the driver of unit acquisition is compared with acquiring the iris information template of characteristic point maximum in advance, calculates
Percentage, and judge according to percentage the degree of fatigue of driver；Alarm unit is connect with data processing unit, and it is used to work as
When data processing unit to be judged to the degree of fatigue of driver, warning is sent out to driver according to the degree of fatigue.
Although this anti-fatigue safety equipment can detect and remind its degree of fatigue of driver, it uses red film to know
Not, the applicability of anti-Fatigue equipment is strongly limited.Red film identification, it is necessary to which eye alignment iris capturing unit can just make rainbow
Film collecting unit collects the iris information in eyes, and eyes area is smaller blocking for eyelid and eyelashes, if iris
Collecting unit is not arranged in the front of eyes, and iris capturing unit can exist cannot collect the dead of iris information always
Angle, this causes the anti-Fatigue equipment to be formed, and there is the angles that can not be detected always, significantly reduce anti-Fatigue equipment
Adaptability and accuracy.And if iris capturing unit to be installed to the front of eyes, unless using quite advanced material,
Otherwise the sight of people can not be impacted, this causes the cost of entire anti-Fatigue equipment to significantly improve.
In consideration of it, applicant proposes a kind of interaction drive robot and its control method.
Invention content
It is an object of the present invention to provide a kind of interactions that can be detected and remind driver tired driving to drive
Sail robot.
To achieve the above objectives, using following scheme：
Interaction drive robot in this programme, including：
Face information identification module for acquiring driver's face information, and judges expression type according to face information；
Central processing unit, for according to expression type according to pre-stored level of fatigue list deciding level of fatigue, concurrently
Human-computer interaction module is given, starts human-computer interaction module work；
Human-computer interaction module, for receive according to central processing unit transmission come level of fatigue start corresponding conversations list
It engages in the dialogue communication with driver.
Principle and effect：
The present invention is directly acquired driver's face information by face information identification module, and according to collecting
Face information judge expression type, central processing unit is enable to be determined according to expression type according to level of fatigue decision table
The level of fatigue of driver, central processing unit start human-computer interaction module according to level of fatigue and talk with according to corresponding level of fatigue
List starts dialogue.
When the present invention makes the driver will go into fatigue state shortly, interaction drive robot can be automatically begun to
Engage in the dialogue and exchange with driver, driver is made to distract attention in dialog procedure, divert oneself from loneliness or boredom feeling of fatigue, prevent level of fatigue into
One step deepens and then brings bad effect.And the present invention is identified compared to red film, with its collection surface bigger of recognition of face, for
The installation site requirement of face information identification module is lower, can almost without dead angle complete acquisition and knowledge to face information
Not.The interaction robot of the present invention forms a kind of dialogue to personalize, driver can be allowed to feel in communication process is talked with
To the satisfaction with people's communication exchange, feeling of fatigue can be effectively diverted oneself from loneliness or boredom, body and mind is made one and feels pleasant, contribute to driver suitable
Profit is completed to drive route.
Further, the face information identification module, including the Image Acquisition mould being connect respectively with central processing unit signal
Block, image processing module and Expression Recognition module；
Described image acquisition module can be rotated as face rotates, for captured in real-time facial image, and by face figure
Image relaying is to image processing module；
Described image processing module, for handling facial image, including gray processing, Level tune and size tune
Section；
The Expression Recognition module, for according to treated facial image, being automatically identified using expression recognition method
Human face expression, and judge expression type.
Facial image is collected by image capture module, because image capture module can turn as face rotates
It is dynamic, so without dead angle facial image can be acquired in real time, by image processing module to collected facial image at
It manages, the identification behind convenience to facial image can be gone out the expression category identification on facial image by Expression Recognition module
Come, to judge that level of fatigue provides premise below.
Further, the temperature collecting module being connect with central processing unit signal is further included, in the central processing unit in advance
It is stored with body temperature fatigue and corresponds to table, central processing unit judges driver according to the collected human body temperature signal of temperature collecting module
Degree of fatigue.
Human body temperature signal is the physiological characteristic that can represent fatigue, and medical research is found, when people is in excessively tired
It when labor, often will appear situation about having a low fever, by temperature collecting module, can in real time be sent to human body temperature signal
Central processing unit, central processing unit can correspond to the level of fatigue that table judges driver according to pre-stored body temperature fatigue,
This strengthens the timely judgement to driver's fatigue degree from another point of view, even if face information identification module loses in a certain period
When going effect, also can real-time judge be carried out to fatigue level of human body by temperature collecting module, the present invention can be made to continue not
The entire driving procedure of driver is monitored disconnectedly, and provide whole process for driver services incessantly.
Further, the human-computer interaction module includes the voice module being connect respectively with central processing unit signal, plays mould
Block, action module and drive module；
The voice module for picking up driver's sound, and is arranged according to driver's sound according to pre-stored dialogue
Table feeds back response message, and each response message includes response image, response sound and responder action；
The playing module, for playing response image and response sound；
The action module, for demonstrating responder action；
The drive module, with being controlled by central processing unit, driving voice module, playing module or action module work
Make.
By human-computer interaction module, a certain group of dialog information that can be in conversations list is played automatically by playing module
Afterwards, driver's sound is collected, and then response message is gone out according to driver's sound feedback, is i.e. people, that is, interactive terminal energy after speaking
It is enough to carry out continuing to talk with according to the dialogue of driver in time, enable dialogue between human-computer interaction terminal and driver smoothly from
So go on, allow driver feel someone with his true communication exchange, effectively divert oneself from loneliness or boredom the feeling of fatigue of driver.
Further, the playing module includes display screen and loudspeaker, and the action module includes rotating cylinder, the drive module
Including motor, the display screen is fixed on rotating cylinder, and the rotating cylinder is driven by motor and rotates；The rotating cylinder, which is mounted on, to be driven
On platform.
Rotating cylinder is mounted on bridge, its display screen supported is enable to facilitate driver when response image is played
It checks.Display screen can make driver that can be clearly seen in different angles and drive rotation by rotating cylinder with drum rotation
Display screen.For display screen when response image is played, driver is it can be seen that the table that personalizes shown on display screen
Feelings make driver in communication process, not only link up and can also be increased by the expression to personalize by sound between robot
The enjoyment of communication.
It is a further object of the invention to provide a kind of interaction drive robot control methods, include the following steps：
Step 1, face information identification module acquisition driver's facial image, and judge after handling facial image
Go out expression type；
Step 2, central processing unit determine fatigue of driver etc. according to expression type according to level of fatigue decision table
Grade, central processing unit start human-computer interaction module according to level of fatigue and start dialogue according to corresponding level of fatigue conversations list；
Step 3, human-computer interaction module engage in the dialogue communication according to the conversations list of the startup of central processing unit.
By this method, when by facial expression recognition, having been detected by driver and being in fatigue state, pass through in time
The feeling of fatigue to divert oneself from loneliness or boredom driver is linked up in the dialogue of human-computer interaction module, and feeling of fatigue is prevented further to upgrade, can be effectively reduced
Because traffic accident caused by fatigue.
Further, mobile telephone module is equipped in playing module, when human-computer interaction module is in preset exchange time section
When not collecting driver's sound, human-computer interaction module sounding alarm is simultaneously put through simultaneously by mobile telephone module and is stored in advance in
Crisis phone only in playing module.
The playing module of human-computer interaction terminal is also connected with other than with display screen, loudspeaker there are one mobile telephone module,
Human-computer interaction module is enable to put through crisis phone only when being in an emergency to seek help.When driver does not have for a long time
When sound, illustrate that driver's refusal fatigue-relieving sense or driver by way of communication has occurred what can not be talked with
Emergency, therefore, human-computer interaction terminal are alarmed and are made a phone call and seek help.
Description of the drawings
Fig. 1 is the logic diagram of interaction drive robot embodiment of the present invention.
Fig. 2 is the structure diagram of interaction drive robot embodiment of the present invention.
Specific embodiment
Reference numeral in Figure of description includes：Pedestal 1, dial 2, rotating cylinder 3, motor 4, display screen 5, mounting disc 6.
As shown in Figure 1, interaction drive robot, including central processing unit and for including facial table to driver
Image capture module that facial image including feelings is acquired, for the image procossing mould that facial image is taken to be handled
Block, for Expression Recognition is carried out to treated facial image Expression Recognition module, for remind driver pay attention to driving it is tired
The human-computer interaction module of labor；Image capture module is used to acquire facial image and sends image processing module to；Image procossing mould
Block is adjusted for handling facial image including gray processing, Level tune and size；Expression Recognition module is used for according to place
Facial image after reason automatically identifies human face expression using expression recognition method, and judges expression type；Central processing unit
The current level of fatigue of driver is judged according to expression type, and is comformed according to level of fatigue table and is selected in more conversations lists at random
Take a corresponding conversations list of the correspondence level of fatigue.Human-computer interaction module is for man-machine according to designed by the conversations list
Interactive mode provides corresponding response to user；The expression type and fatigue state of user's different time are stored, and is provided
It is inquired to driver.
Meanwhile interaction drive robot further includes the temperature for being used for detecting human body temperature being connect with central processing unit
Acquisition module, temperature collecting module can select the temperature sensor sold on the market now.It is preset in central processing unit
Body temperature fatigue corresponds to table, and body temperature fatigue, which corresponds to, includes different body temperature and one-to-one degree of fatigue in table.It is passed by temperature
The body temperature of sensor detection further judges the degree of fatigue of driver, and driver is reminded to do corresponding adjusting, avoids fatigue driving.
Human-computer interaction module includes the voice module, playing module, action module being connect respectively with central processing unit signal
And drive module；
The playing module, including display screen 5, loudspeaker and mobile telephone module；It is pressed for playing according to driver's sound
The response image and response sound in the reply information are fed back according to conversations list；For in case of emergency putting through reserved answer
Urgent telegram is talked about.
The action module including rotating cylinder 3, carries out for the responder action in driver's sound demonstration response message
The rotation of certain angle；
The drive module including motor 4 and driving switch, with being controlled by central processing unit, drives the rotating cylinder 3 to rotate,
Driving sound pick-up, loudspeaker or display screen 5 work.
Voice module, the voice extraction module being connect including sound pick-up and with sound pick-up, for the sound to driver
Signal is detected in real time, and when sound pick-up detects the voice signal of driver, voice signal is sent to voice extraction mould
Block, voice extraction module extract corresponding voice messaging from voice signal and are sent to central processing unit；
Central processing unit is defeated for the voice messaging according to pre-stored conversations list after voice messaging is received
Go out response message to playing module, the display screen 5 in playing module is made to show response image, the loudspeaker in playing module is made to sound
Response sound.
Conversations list includes multigroup dialog information, and every group of dialog information has the problem of several are associated with successively and answer
It forms (answer of an i.e. upper problem can draw next problem), when central processing unit is in the voice messaging for receiving driver
Afterwards, the problem of identical with the voice messaging or answer can be found from every group of dialog information, when the voice messaging is asked with some
It is identical with the problem or answer to inscribe voice messaging when either answer dittograph language is most, then talk in the group
For the problem, either the answer of answer or problem just become the reply information of this voice messaging in information.Each problem and
Not only problematic image and problem sound and answer image and answer sound, therefore response message also has response image in answer
With response sound, when playing module is when response message is played, not only there is sound broadcast, also image synchronization is in display screen
It is shown on 5.These problem images and answer image are all the facial expression images that some personalize, it is corresponding the problem of and answer table
The information stated is consistent, this allows for playing module in interactive terminal in the reply information in playing conversations list, can not only
It says and goes back espressiove, make interactive terminal that there is the reaction to personalize for the sound of driver, driver and interactive terminal can be made
It generates dialogue to link up, shifts the sight of driver, reduce the adverse consequences that fatigue is brought to the greatest extent.
As shown in Fig. 2, image capture module includes the camera being arranged on display screen 5.The top setting of rotating cylinder 3 is useful
To install the mounting disc 6 of display screen 5 and motor 4.It is equipped in mounting disc 6 for detecting driver apart from 6 distance of mounting disc
Infrared range-measurement system, the infrared range-measurement system are connect with central processing unit signal；It is provided in the central processing unit for limiting
Driver to 6 distance of mounting disc gauged distance range, when the actually measured distance of infrared range-measurement system exceed gauged distance range
When, central processing unit makes motor 4 that rotating cylinder 3 be driven to rotate.Sound pick-up and loudspeaker are also disposed on display screen 5.Display screen 5 is both aobvious
Show response image, the carrier to driver feedback robot expression and the carrier for picking up driver's sound make entire machine
Device people can say the real people that can listen espressiove more like one.
Camera is arranged on display screen 5, and camera also rotates together when display screen 5 rotates, when face rotates
When direction, camera also corresponds to rotation direction, and camera is enable without dead angle to shoot servant's face image.Motor 4 and aobvious
Display screen 5 is all mounted in mounting disc 6, it can be made securely to connect.
By preset gauged distance range, define that driver to the distance of mounting disc 6, that is, defines driver to machine
The distance of device people, when the actual range that infrared range-measurement system measures is less or greater than gauged distance range, central processing
Device drives rotating cylinder 3 to rotate by motor 4, adjusts infrared range-measurement system and arrives the distance between driver, until actual range is in normal pitch
It stops operating when from the range of.Driver can be made to interact communication with robot on optimum distance in this way, increase and drive
The communication experience sense of member.
Interaction drive robot further includes the shell for installing display screen.It is equipped in shell for filling water
Water pocket.Multiple jet pipes for stretching out shell are communicated on water pocket.The first electromagnetism for blocking jet pipe is fitted on each jet pipe
Threshold switch.The first all electromagnetic valve switch are all connect with central processing unit signal, and each first electricity is controlled by central processing unit
The opening and closing of magnet valve switch.Jet pipe is arranged on the side of front, rear, left and right four of shell.In the side of each jet pipe position
It puts, the infrared ray sensor for detecting driver's direction is installed on the shell.All infrared ray sensor with
Central processing unit signal connects.When central processing unit judges that driver is in the state to tire out, central processing unit starts
Infrared ray sensor works, the detection signal determining driver position come by receiving infrared-ray sensor passes, central
The first electromagnetic valve switch in the jet pipe that processor controls the infrared ray sensor adjacent is opened.Water pocket is opened by this
The jet pipe of one electromagnetic valve switch is sprayed water on the face to driver.It enables a driver to after being washed one's face by water injection, it being capable of dispelling fatigue
It wakes up, enables a driver to be driven with a preferable state.
In addition, it is also equipped with that when shell rotation the flabellum of shell can be stretched out on shell.It is provided on the left and right sides of shell
Mounting groove, hinged in each mounting groove there are one flabellums.One end of flabellum is by bolted splice in the bottom of mounting groove, mounting groove
Side wall on be provided with for when shell does not rotate limit flabellum limiting slot.
Image clearly judgement table is previously provided in central processing unit, in addition to being used for shooting the camera of face on display screen
Outside, the also camera of face windshield, the camera of these face windshield is known as monitoring camera by us.Pass through
Monitoring camera passes to the monitoring image of central processing unit, and central processing unit judges table according to the prior art by image clearly
Whether judgement receives monitoring image clear, and then judges whether there is mist on windshield.If there is mist on windshield always, and
When driver does not do any processing, can judge from side driver fatigue to can not find there is mist on windshield
Degree.At this point, central processing unit elder generation driving motor drives rotating cylinder and the shell being arranged on rotating cylinder rotation, rotating flabellum
During flabellum is pulled out from limiting slot by centrifugal force, flabellum is unfolded.Flabellum after expansion with shell together after
During continuous rotation, wind is generated to driver and windshield.The wind that flabellum generates assists in driver and keeps clear
It wakes up, while interior temperature can be reduced, reduce the mist on windshield.
In order to make the defogging effect of interaction robot more preferable, it can also install rotate through inside the shell and carry out face
The hair-dryer of windshield.Hair-dryer can be used for removing the mist on windshield, can be provided for face up-draught, for driving
Member's dispelling fatigue.Installation resistive heater in hair-dryer, enable hair-dryer blown a cold wind over according to actual conditions to windshield or
Person's hot wind.The heater switch of driving motor and resistive heater in hair-dryer is all electrically connected with central processing unit, by centre
The startup and closing of device control hair-dryer are managed, by the startup and closing of central processing unit control resistive heater.
Because interaction drive robot is mounted on bridge by rotating cylinder all over, when rotating cylinder is by display screen
When rotating to the position of face windshield, the people of outside can also be made to see the content on display screen through windshield.
In daily life, adjacent parked vehicle passes in and out for convenience, often may require that the car owner of notice preceding vehicle moves vehicle and gives way always,
However the present car owner that can not make but below knows the approach of front car owner's contact method, can only generally seek help from security personnel side
Busy to find, whole process takes longer, it is also possible to the situation that can not find front truck car owner completely occurs.For this purpose, it can pass through
Interaction drive robot provides the platform linked up to be embodied as two car owners.
Be previously provided in central processing unit and move vehicle required list, move be provided in vehicle required list it is multiple be used for represent to move vehicle
Demand moves vehicle keyword.When central processing unit gets these keywords by sound pick-up, central processing unit makes voice mould
Block plays back pre-stored car owner's phone.Alternatively, central processing unit makes display screen show pre-stored car owner's phone
It shows to come.Under normal circumstances, need the car owner for moving vehicle that can find contact method beside vehicle, as long as at this time into vehicle
Interaction drive robot says the language containing keyword, with regard to Neng Shi interactions robot by the phone number of vehicle car owner
Code is shown, so that two car owners carry out communication exchange.
Interaction drive robot can also directly put through the electricity of car owner by the mobile telephone module in playing module
Number is talked about, the call for establishing car owner with other people contacts.Both sides is facilitated to link up and move vehicle matters.
Based on above-mentioned interaction drive robot, a kind of interaction drive robot control method is provided, including
Following steps：
Step 1, face information identification module acquisition driver's facial image, and judge after handling facial image
Go out expression type；
Step 2, central processing unit determine fatigue of driver etc. according to expression type according to level of fatigue decision table
Grade, central processing unit start human-computer interaction module according to level of fatigue and start dialogue according to corresponding level of fatigue conversations list；
Step 3, human-computer interaction module engage in the dialogue communication according to the conversations list of the startup of central processing unit；
Step 4, when human-computer interaction module does not collect driver's sound in preset exchange time section, man-machine friendship
Mutual module sound alarm simultaneously puts through the crisis phone only being stored in advance in playing module simultaneously.
By this method, when by facial expression recognition, having been detected by driver and being in fatigue state, pass through in time
The feeling of fatigue to divert oneself from loneliness or boredom driver is linked up in the dialogue of human-computer interaction module, and feeling of fatigue is prevented further to upgrade, can be effectively reduced
Because traffic accident caused by fatigue.
When driver for a long time there is no sound when, illustrate driver refusal by way of communication fatigue-relieving sense or
Has there is the emergency that can not talk in person driver, and therefore, human-computer interaction terminal is alarmed and made a phone call and seeks help.
Above-described is only the embodiment of the present invention, and the common sense such as well known concrete structure and characteristic are not made herein in scheme
Excessive description, technical field that the present invention belongs to is all before one skilled in the art know the applying date or priority date
Ordinary technical knowledge can know the prior art all in the field, and with using routine experiment hand before the date
The ability of section, one skilled in the art with reference to self-ability can improve and implement under the enlightenment that the application provides
This programme, some typical known features or known method should not implement the application as one skilled in the art
Obstacle.It should be pointed out that for those skilled in the art, without departing from the structure of the invention, it can also make
Go out several modifications and improvements, these should also be considered as protection scope of the present invention, these all do not interfere with the effect that the present invention is implemented
Fruit and practical applicability.The scope of protection required by this application should be based on the content of the claims, the tool in specification
The records such as body embodiment can be used for explaining the content of claim.
Claims (7)
1. a kind of interaction drive robot, it is characterised in that：Including：
Face information identification module for acquiring driver's face information, and judges expression type according to face information；
Central processing unit, for, according to pre-stored level of fatigue list deciding level of fatigue, and being sent to according to expression type
Human-computer interaction module starts human-computer interaction module work；
Human-computer interaction module, for receive according to central processing unit transmission come level of fatigue start corresponding conversations list with driving
The person of sailing engages in the dialogue communication.
2. interaction drive robot according to claim 1, it is characterised in that：The face information identification module,
Including the image capture module, image processing module and Expression Recognition module being connect respectively with central processing unit signal；
Described image acquisition module can be rotated as face rotates, for captured in real-time facial image, and facial image be passed
Pass image processing module；
Described image processing module for handling facial image, is adjusted including gray processing, Level tune and size；
The Expression Recognition module, for according to treated facial image, face to be automatically identified using expression recognition method
Expression, and judge expression type.
3. interaction drive robot according to claim 1, it is characterised in that：It further includes and central processing unit signal
The temperature collecting module of connection is previously stored with body temperature fatigue in the central processing unit and corresponds to table, and central processing unit is according to temperature
The degree collected human body temperature signal of acquisition module judges the degree of fatigue of driver.
4. interaction drive robot according to claim 1, it is characterised in that：The human-computer interaction module includes dividing
Voice module, playing module, action module and the drive module not connect with central processing unit signal；
The voice module, for picking up driver's sound, and it is anti-according to pre-stored conversations list according to driver's sound
Response message is presented, each response message includes response image, response sound and responder action；
The playing module, for playing response image and response sound；
The action module, for demonstrating responder action；
The drive module, with being controlled by central processing unit, driving voice module, playing module or action module work.
5. interaction drive robot according to claim 4, it is characterised in that：The playing module includes display screen
And loudspeaker, the action module include rotating cylinder, the drive module includes motor, and the display screen is fixed on rotating cylinder,
The rotating cylinder is driven by motor and rotates；The rotating cylinder is mounted on bridge.
6. a kind of control method of interaction drive robot, it is characterised in that：Include the following steps：
Step 1, face information identification module acquisition driver's facial image, and judge table after handling facial image
Affectionate person's class；
Step 2, central processing unit determine the level of fatigue of driver according to expression type according to level of fatigue decision table, in
Central processor starts human-computer interaction module according to level of fatigue and starts dialogue according to corresponding level of fatigue conversations list；
Step 3, human-computer interaction module engage in the dialogue communication according to the conversations list of the startup of central processing unit.
7. the control method of interaction drive robot according to claim 6, it is characterised in that：It is set in playing module
There is mobile telephone module, when human-computer interaction module does not collect driver's sound in preset exchange time section, man-machine friendship
Mutual module sound alarm simultaneously puts through the crisis phone only being stored in advance in playing module by mobile telephone module simultaneously.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711466493.8A CN108170056A (en) | 2017-12-28 | 2017-12-28 | A kind of interaction drive robot and its control method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711466493.8A CN108170056A (en) | 2017-12-28 | 2017-12-28 | A kind of interaction drive robot and its control method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108170056A true CN108170056A (en) | 2018-06-15 |
Family
ID=62519516
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711466493.8A Pending CN108170056A (en) | 2017-12-28 | 2017-12-28 | A kind of interaction drive robot and its control method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108170056A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109624985A (en) * | 2018-12-27 | 2019-04-16 | 苏州思必驰信息科技有限公司 | Anti-fatigue-driving method for early warning and device |
| CN110796838A (en) * | 2019-12-03 | 2020-02-14 | 吉林大学 | Automatic positioning and recognition system for facial expressions of driver |
| CN110825216A (en) * | 2018-08-10 | 2020-02-21 | 北京魔门塔科技有限公司 | Method and system for man-machine interaction of driver during driving |
| CN114694349A (en) * | 2020-12-30 | 2022-07-01 | 上海博泰悦臻网络技术服务有限公司 | Interaction method and interaction system |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5508685A (en) * | 1994-12-12 | 1996-04-16 | Monte, Jr.; Quentin G. | Vehicle and device adapted to revive a fatigued driver |
| US5684455A (en) * | 1996-01-29 | 1997-11-04 | Williams; Pete Bernard | Driver alert apparatus |
| CN201114421Y (en) * | 2007-07-27 | 2008-09-10 | 深圳市同洲电子股份有限公司 | A digital TV receiver |
| CN104050779A (en) * | 2014-06-10 | 2014-09-17 | 奇瑞汽车股份有限公司 | Anti-fatigue happy driving device, system and method |
| CN105700682A (en) * | 2016-01-08 | 2016-06-22 | 北京乐驾科技有限公司 | Intelligent gender and emotion recognition detection system and method based on vision and voice |
| CN105719431A (en) * | 2016-03-09 | 2016-06-29 | 深圳市中天安驰有限责任公司 | Fatigue driving detection system |
| CN106657648A (en) * | 2016-12-28 | 2017-05-10 | 上海斐讯数据通信技术有限公司 | Mobile terminal for preventing fatigue driving and realization method thereof |
| CN107362431A (en) * | 2017-08-30 | 2017-11-21 | 南京纬力创新能源科技有限公司 | Intelligent fatigue drive precaution device based on Internet of Things |
-
2017
- 2017-12-28 CN CN201711466493.8A patent/CN108170056A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5508685A (en) * | 1994-12-12 | 1996-04-16 | Monte, Jr.; Quentin G. | Vehicle and device adapted to revive a fatigued driver |
| US5684455A (en) * | 1996-01-29 | 1997-11-04 | Williams; Pete Bernard | Driver alert apparatus |
| CN201114421Y (en) * | 2007-07-27 | 2008-09-10 | 深圳市同洲电子股份有限公司 | A digital TV receiver |
| CN104050779A (en) * | 2014-06-10 | 2014-09-17 | 奇瑞汽车股份有限公司 | Anti-fatigue happy driving device, system and method |
| CN105700682A (en) * | 2016-01-08 | 2016-06-22 | 北京乐驾科技有限公司 | Intelligent gender and emotion recognition detection system and method based on vision and voice |
| CN105719431A (en) * | 2016-03-09 | 2016-06-29 | 深圳市中天安驰有限责任公司 | Fatigue driving detection system |
| CN106657648A (en) * | 2016-12-28 | 2017-05-10 | 上海斐讯数据通信技术有限公司 | Mobile terminal for preventing fatigue driving and realization method thereof |
| CN107362431A (en) * | 2017-08-30 | 2017-11-21 | 南京纬力创新能源科技有限公司 | Intelligent fatigue drive precaution device based on Internet of Things |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110825216A (en) * | 2018-08-10 | 2020-02-21 | 北京魔门塔科技有限公司 | Method and system for man-machine interaction of driver during driving |
| CN109624985A (en) * | 2018-12-27 | 2019-04-16 | 苏州思必驰信息科技有限公司 | Anti-fatigue-driving method for early warning and device |
| CN110796838A (en) * | 2019-12-03 | 2020-02-14 | 吉林大学 | Automatic positioning and recognition system for facial expressions of driver |
| CN114694349A (en) * | 2020-12-30 | 2022-07-01 | 上海博泰悦臻网络技术服务有限公司 | Interaction method and interaction system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108170056A (en) | A kind of interaction drive robot and its control method | |
| CN207473682U (en) | Intelligent barrier gate | |
| CN108986400A (en) | A kind of third party based on image procossing, which multiplies, drives safety automatic-alarming method | |
| CN110213516A (en) | Vehicular video recording method, device, storage medium and electronic device | |
| CN107848488A (en) | Multi-purpose vehicle intelligent monitor system and method | |
| CN107826117A (en) | A kind of automated driving system and control method | |
| CN107933471A (en) | The method and vehicle-mounted automatic help system of accident active call rescue | |
| CN107953830A (en) | A kind of motorbus blind area detection alarm system and its detection alarm method | |
| CN109819224A (en) | A kind of Vehicular video supervisory systems based on car networking | |
| CN107404570A (en) | A kind of method and system for improving travel safety | |
| CN106467057A (en) | The method of lane departure warning, apparatus and system | |
| CN108711202A (en) | A kind of Traffic Accident Rescue System based on big data | |
| CN106157537A (en) | Anti-fatigue-driving system | |
| CN109190600A (en) | A kind of driver's monitoring system of view-based access control model sensor | |
| CN110065439A (en) | A kind of car interactive system | |
| CN207895660U (en) | Humanoid-head expression AC machines people | |
| CN109291793A (en) | Net about vehicle passenger warning device and method | |
| CN107506698A (en) | The method of public transportation vehicle anti-fatigue-driving management based on Internet of Things | |
| CN205722310U (en) | A kind of train driver Activity recognition system based on video sequence | |
| CN107472131A (en) | Automobile door opening source of early warning, automobile door opening early warning system, automobile door opening method for early warning | |
| CN107230348A (en) | A kind of pedestrians disobeying traffic rule monitoring system, method and apparatus | |
| CN207752652U (en) | Video is anti-to scratch system | |
| CN111899471A (en) | Driver fatigue monitoring system | |
| CN206282368U (en) | A kind of multifunctional running recorder | |
| CN103552506B (en) | Automobile solar energy panorama monitors safety pre-warning system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180615 |