CN109606386A - Cockpit in intelligent vehicle - Google Patents
Cockpit in intelligent vehicle Download PDFInfo
- Publication number
- CN109606386A CN109606386A CN201811517842.9A CN201811517842A CN109606386A CN 109606386 A CN109606386 A CN 109606386A CN 201811517842 A CN201811517842 A CN 201811517842A CN 109606386 A CN109606386 A CN 109606386A
- Authority
- CN
- China
- Prior art keywords
- information
- driver
- master controller
- cockpit
- intelligent vehicle
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0967—Systems involving transmission of highway information, e.g. weather, speed limits
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0968—Systems involving transmission of navigation instructions to the vehicle
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Atmospheric Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Mathematical Physics (AREA)
- Remote Sensing (AREA)
- Computing Systems (AREA)
- Radar, Positioning & Navigation (AREA)
- Medical Informatics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses cockpit in a kind of intelligent vehicle, the driver including master controller, connection master controller monitors system and wireless communication module；It includes the first camera that driver, which monitors system,；Driver monitors the facial image that system is used to obtain driver by the first camera, and carries out facial expression recognition to the facial image of driver, and the corresponding emotional state information of facial image of driver is determined according to recognition result；And emotional state information is sent to master controller；Wireless communication module is used to the environmental data got by cloud platform server being sent to master controller；Environmental data includes weather data information and road data information；Master controller is used to export corresponding prompt information according to emotional state information and environmental data；The present invention can promote the interactive capability of interior cockpit, more humanized and intelligent.
Description
Technical field
The present invention relates to automobile technical field, in particular to cockpit in a kind of intelligent vehicle.
Background technique
Vehicle is one of most important trip tool of people's trip, and the gradually development of intellectual technology therewith, people are for multiplying
The demand that effective information is got when vehicle is increasingly promoted.
During realization, inventor has found that at least there are the following problems in traditional technology:
Interior cockpit in traditional technology largely fail to be provided according to the case where occupant corresponding scene mode and
Service Source, while resource consolidation is limited, needed for the trip requirements and driving process for not being able to satisfy user to a certain extent
Auxiliary.Interior cockpit intelligence degree as a result, in traditional technology is not high, lacks corresponding miscellaneous function.
Summary of the invention
It is an object of the invention to for the deficiency in traditional technology, provide cockpit in a kind of intelligent vehicle.
Embodiment according to the present invention, the present invention provides cockpits in a kind of intelligent vehicle, including master controller, connection master
The driver of controller monitors system and wireless communication module；It includes the first camera that driver, which monitors system,；
Driver monitors the facial image that system is used to obtain driver by the first camera, and to the face of driver
Image carries out facial expression recognition, and the corresponding emotional state information of facial image of driver is determined according to recognition result；And it will
Emotional state information is sent to master controller；
Wireless communication module is used to the environmental data got by cloud platform server being sent to master controller；Environment
Data include weather data information and road data information；
Master controller is used to export corresponding prompt information according to emotional state information and environmental data；Prompt information packet
Include any one of prompt information, the prompt information for switching music and periphery place prompt information of closing windows or any number of
Combination.
Master controller is used to be exported according to emotional state information and environmental data corresponding in one of the embodiments,
Prompt information, comprising:
Master controller is sadness in emotional state information, and weather data information indicates that weather conditions are good, and or road
When data information indicates that road conditions are good, the first prompt information is exported；
Master controller indicates that weather conditions are bad in weather data information, and emotional state information is output the when detesting
Two prompt informations；
Master controller emotional state information be pleasure, and road data information indicate road conditions it is good when, output third mention
Show information.
Driver monitors the face that system is also used to obtain driver by the first camera in one of the embodiments,
The folding frequency of expression and eyes；And the number yawned in the facial expression of driver is detected in preset interval time
More than or equal to preset times, and when the folding frequency of eyes is greater than or equal to predeterminated frequency, determine that driver is fatigue driving,
And export warning information.
It in one of the embodiments, further include the MIM message input module for connecting master controller；
MIM message input module is with being used to obtain travel time and the trip purpose of driver；
Master controller is also used to by travel time and trip purpose be transmitted to cloud platform clothes by wireless communication module
Be engaged in device, and receive cloud platform server according to the travel time, trip purpose and environmental data return best travel route.
MIM message input module is any in voice input module and touch key-press module in one of the embodiments,
Kind or combination.
MIM message input module is also used to obtain driver information and the control to vehicle arrangement in one of the embodiments,
Information processed, and the control information of driver information and vehicle arrangement is sent to master controller；
Master controller is also used to store the control information association of driver information and vehicle arrangement；Driver information
Including driving age information, account information and age information.
It in one of the embodiments, further include the second camera for connecting master controller；
Second camera is used to obtain the facial image of passenger, and the facial image of passenger is transferred to master controller；
Master controller is also used to when the facial image of passenger is not consistent with the facial image prestored, exports welcome's scene mould
Formula.
Master controller is also used to obtain vehicle trouble code information in one of the embodiments, and passes through wireless telecommunications
Fault code information is transmitted to cloud platform server by module.
It in one of the embodiments, further include set on interior vehicle-mounted AR navigation device.
On the other hand, the present invention also provides a kind of automobiles, including cockpit in intelligent vehicle.
A technical solution in above-mentioned technical proposal is had the following advantages and beneficial effects:
Cockpit in intelligent vehicle of the invention, the driver including master controller, connection master controller monitor system and nothing
Line communication module monitors system by driver and the facial image of driver is carried out facial expression recognition, so that master controller
The environmental data information got according to recognition result and wireless communication module, exports corresponding prompt information.The present invention is each
Cockpit in the intelligent vehicle of embodiment can be according to the mood and environmental data of driver based on the expression management to driver
Driver, which provides, has targetedly information, to control corresponding vehicle arrangement operation or provide corresponding information on services, to driving
The traveling for the person of sailing is assisted, to meet traveling demand.The present invention can promote the interactive capability of interior cockpit, more human nature
Change and intelligent.
Detailed description of the invention
Fig. 1 is the structural schematic diagram of cockpit in intelligent vehicle provided by one embodiment of the present invention；
Fig. 2 is the concrete structure schematic diagram of cockpit in intelligent vehicle provided by one embodiment of the present invention；
Fig. 3 is the application scenario diagram of cockpit in intelligent vehicle provided by one embodiment of the present invention.
Specific embodiment
To make the objectives, technical solutions, and advantages of the present invention more comprehensible, referring to the drawings in conjunction with the embodiments, right
The present invention is further described.
Hereinafter, various embodiments of the present invention will be described more fully.The present invention can have various embodiments, and
It can adjust and change wherein.It should be understood, however, that: there is no the scope of the present invention is limited to specific reality disclosed herein
The intention of example is applied, but should be all in the spirit and scope for falling into various embodiments of the present invention invention is construed as covering
Adjustment, equivalent and/or optinal plan.
Hereinafter, disclosed in the term " includes " that can be used in various embodiments of the present invention or " may include " instruction
Function, operation or the presence of element, and do not limit the increase of one or more functions, operation or element.In addition, such as existing
Used in various embodiments of the present invention, term " includes ", " having " and its cognate are meant only to indicate special characteristic, number
Word, step, operation, the combination of element, component or aforementioned item, and be understood not to exclude first one or more other
Feature, number, step, operation, element, component or aforementioned item combined presence or increase one or more features, number,
Step, operation, element, component or aforementioned item combination a possibility that.
In various embodiments of the present invention, statement " at least one of each or/and B " includes the text listed file names with
Any combination or all combinations.For example, statement " out or B go out or at least one of " out or/and B " may include A, may include B or
It may include A and B both.
The statement (" first ", " second " etc.) used in various embodiments of the present invention can be modified in various implementations
Various constituent element in example, but respective sets can not be limited into element.For example, the above statement is not intended to limit the sequence of element
And/or importance.The above statement is only used for the purpose for differentiating an element and other elements.For example, first user device
Different user device is indicated with second user device, although the two is all user apparatus.For example, of the invention various not departing from
In the case where the range of embodiment, first element is referred to alternatively as second element, and similarly, second element is also referred to as first yuan
Part.
It should also be noted that if a constituent element ' attach ' to another constituent element by description, it can be by the first composition member
Part is directly connected to the second constituent element, and " connection " third can form between the first constituent element and the second constituent element
Element.On the contrary, when a constituent element " being directly connected to " is arrived another constituent element, it will be appreciated that in the first constituent element
And second third constituent element is not present between constituent element.
The term used in various embodiments of the present invention is used only for the purpose of describing specific embodiments and not anticipates
In limitation various embodiments of the present invention.Unless otherwise defined, otherwise all terms used herein (including technical term and
Scientific term) there is contain identical with the normally understood meaning of various embodiments of the present invention one skilled in the art
Justice.Term (term such as limited in the dictionary generally used) is to be interpreted as having and language in the related technical field
The identical meaning of border meaning and it will be interpreted as having Utopian meaning or meaning too formal, unless in the present invention
Various embodiments in be clearly defined.
Referring to Fig. 1, in one embodiment, the present invention provides cockpit in a kind of intelligent vehicle, including master controller 110,
The driver for connecting master controller 110 monitors system 120 and wireless communication module 130；The driver monitors system 120 and wraps
Include the first camera 125；
Driver monitors the facial image that system 120 is used to obtain driver by the first camera 125, and to driver
Facial image carry out facial expression recognition, determine that the corresponding emotional state of facial image of driver is believed according to recognition result
Breath；And emotional state information is sent to master controller 110；
Wireless communication module 130 is used to the environmental data got by cloud platform server being sent to master controller
110；Environmental data includes weather data information and road data information；
Master controller 110 is used to export corresponding prompt information according to emotional state information and environmental data；Prompt letter
Breath includes any one of the prompt information of closing windows, the prompt information for switching music and periphery place prompt information or appoints
Meaning kind combination.
For example, facial image includes any one of static map and Dynamic Graph.Weather data information includes temperature and air
Quality, road data information include traffic information and periphery location information.The step of recognition of face includes carrying out to facial image
The normalization such as the size and gray scale of unified image pretreatment, and feature extraction is carried out to pretreated facial image.Wherein, special
Sign extract can with but be not limited to extract geometrical characteristic, statistical nature, frequency characteristic of field or motion feature etc..Further,
It can classify to feature extraction result, each classification results can correspond to a kind of feelings according to preset classification method
Not-ready status information thus can achieve the purpose of the corresponding emotional state information of determining facial image.It can be by human emotion point
For 6 kinds of basic emotions, including glad, sad, surprised, frightened, detest, indignation, every kind of basic emotion corresponds to a human face expression,
And corresponding model is trained according to corresponding human face expression feature.Driver monitors system and pre-enters every kind of human face expression pair
The expression model answered can obtain emotional state information by facial expression recognition as a result,.Further, believed according to emotional state
It ceases with environmental data, the exportable corresponding prompt information for being used to adjust mood, as whether opened vehicle window when weather conditions are preferable,
Whether select to go to the place place etc. for being suitble to amusement when road conditions are good.Further, master controller can be by being in advance embedded in
AI (Artificial Intelligence) artificial intelligence system is used for according to emotional state information and combining environmental data,
Active push exports corresponding prompt information.
Cockpit in the intelligent vehicle of the embodiment of the present invention, the driver including master controller, connection master controller monitor system
And wireless communication module, system is monitored by driver, the facial image of driver is subjected to facial expression recognition, so that main
The environmental data information that controller is got according to recognition result and wireless communication module, exports corresponding prompt information.This
Cockpit in the intelligent vehicle of inventive embodiments, can be based on the expression management to driver, according to the mood and environment number of driver
According to, providing for driver has targetedly information, to control corresponding vehicle arrangement operation or provide corresponding information on services,
The traveling of driver is assisted, to meet traveling demand.The present invention can promote the interactive capability of interior cockpit, more
Hommization and intelligence.
In a specific embodiment, master controller according to emotional state information and environmental data output phase for answering
Prompt information, comprising:
Master controller is sadness in emotional state information, and weather data information indicates that weather conditions are good, and or road
When data information indicates that road conditions are good, the first prompt information is exported；
Master controller indicates that weather conditions are bad in weather data information, and emotional state information is output the when detesting
Two prompt informations；
Master controller emotional state information be pleasure, and road data information indicate road conditions it is good when, output third mention
Show information.
For example, the first prompt information includes opening prompt information, first kind place prompt information and the class broadcasting of vehicle window
The prompt information etc. of first kind music.Master controller is when emotional state information indicates sad, and weather data information indicates
Weather conditions are good, and if fine, air quality are good and proper temperature, the exportable prompt information for opening vehicle window is so as to drive
The person of sailing, which has a breath of fresh air, loosens mood, and or good, the exportable first kind place according to road data information expression road conditions
The prompt information in the suitable place for loosening body and mind such as prompt information such as periphery park, and or output play first kind music and mention
Show information.
Further, the second prompt information includes closure vehicle window prompt information and message push prompt information etc..Master control
Device processed indicates that weather conditions are bad in weather data information, for example thunderstorm weather, and wind scale is larger, and in emotional state information
When being expressed as detesting, the prompt information of exportable closure vehicle window.Or message push prompt information, to calm down driver's mood.
Further, third prompt information includes playing the second class music prompt information and the second class place prompt information
Deng.Master controller can push the second class to driver according to current road data information when emotional state information is glad
Place prompt information such as public place of entertainment location information, or output play second class music prompt information etc..
Specifically, first kind place may include the place for being suitble to loosen body and mind, and first kind music may include the music releived,
Second class place may include lively public place of entertainment place, and the second class music may include lively music.More preferably, the first kind
The AI artificial intelligence system that point, the second class place, first kind music and the second class music can be embedded in based on master controller passes through
Cloud platform server acquires.
Cockpit in the intelligent vehicle of the embodiment of the present invention can make full use of big data resource, realize artificial intelligence to driver
Mood be managed, auxiliary can be played the role of and driven, while related service prompt being pointedly provided, so that interior cockpit
Feature-richization, can satisfy the use demand of a variety of users, intelligence degree is high.
Referring to Fig. 1, in a specific embodiment, driver monitors system 120 and is also used to through the first camera 125
Obtain the facial expression of driver and the folding frequency of eyes；And the facial table of driver is detected in preset interval time
The number yawned in feelings be greater than or equal to preset times, and the folding frequency of eyes be greater than or equal to predeterminated frequency when, determine
Driver is fatigue driving, and exports warning information.
For example, people has in fatigue than more typical facial expression and motion characteristic, as number it is more yawn and
Frequency is higher to blink.And then can in advance according to fatigue when facial expression and motion characteristic establish corresponding fatigue state and sentence
Other model.Therefore, the positioning that face recognition and eyes can be carried out in the facial expression for getting driver, in preset interval
The number that driver yawns is recognized in time and is greater than or equal to preset times, and the folding frequency of eyes is greater than recklessly equal to pre-
If when frequency, it is determined that be fatigue driving.
Cockpit in the intelligent vehicle of the embodiment of the present invention, can be by the facial expression feature and movement of driver to driver
Fatigue driving tested and analyzed, accuracy rate is higher, and can be issued when being determined as fatigue driving warning information remind drive
Member, to prevent accident caused by fatigue driving.
It referring to fig. 2, in a specific embodiment, further include the MIM message input module 220 for connecting master controller 210；
MIM message input module 220 is with being used to obtain travel time and the trip purpose of driver；
Master controller 210 is also used to travel time and trip purpose being transmitted to cloud platform by wireless communication module
Server, and receive cloud platform server according to the travel time, trip purpose and environmental data return best traveling road
Line.
For example, the jam situation and route distance of the route that road data information includes in environmental data, every route,
And then best travel route can be calculated in cloud platform server according to travel time and trip purpose.Wherein, best row
Sailing route is the route that time-consuming most short and congestion level is most light in each travel route.Master controller can pass through channel radio as a result,
News module gets the best travel route of cloud platform server transmission.
Cockpit in the intelligent vehicle of the embodiment of the present invention can be provided accurate by cloud intellectual analysis according to road data information
Navigation routine, and improve navigation efficiency, to avoid because stroke is delayed caused by road conditions are bad or congestion, the present invention is real
An intelligence degree height is applied, can satisfy the drive demand of user.
Referring to fig. 2, in a specific embodiment, MIM message input module 220 is that voice input module and touch are pressed
Any one of key module or combination.
The information input side that cockpit in the intelligent vehicle of the embodiment of the present invention can compliant speech identification and be manually entered etc.
Formula improves the ability of intelligence degree and human-computer interaction.
In a specific embodiment, MIM message input module is also used to obtain driver information and to vehicle arrangement
Information is controlled, and is sent to master controller by driver information and to the control information of vehicle arrangement；
Master controller is also used to store the control information association of driver information and vehicle arrangement；Driver information
Including driving age information, account information and age information.
For example, the control information of vehicle arrangement includes the opening degree of vehicle window, the set temperature of air-conditioning and vehicle audio
Any one of default volume etc. or any number of combination.Driver information is for establishing corresponding user account.Further, may be used
The control information of the vehicle arrangement of setting is sent to master controller by MIM message input module, so that master controller is by driver
It stores to information and the control information association of vehicle arrangement, so that it is corresponding with the control information of vehicle arrangement to establish user account
Relationship.In turn, when inputting driver information by MIM message input module, corresponding vehicle can be transferred according to the driver information
The control information of equipment, and vehicle arrangement is controlled according to the control information of the vehicle arrangement.Further, master controller
Also it can export according to the driving age information, age information and the environmental data got shown in driver information and drive instruction
Information.Drive speed prompt when instruction information includes such as volume adjustment prompt, road sign prompt and rainy day.
Cockpit in the intelligent vehicle of the embodiment of the present invention can associatedly deposit the control information of vehicle arrangement with driver information
Storage, and then the control information of corresponding vehicle arrangement can be transferred according to driver information when driving, meanwhile, it can also be according to driving
The person's of sailing information provides corresponding driving prompt.The embodiment of the present invention can analyze user, realize personalized service.
Fig. 2 is participated in, further includes the second camera 240 for connecting master controller 210 in a specific embodiment；
Second camera 240 is used to obtain the facial image of passenger, and the facial image of passenger is transferred to master controller
210；
Master controller 210 is also used to when the facial image of passenger is not consistent with the facial image prestored, output welcome
Scape mode.
For example, welcome's scene mode includes the voice of driving player output " welcome take " and customized preset
Voice prompting is such as arranged in when detecting that the facial image of passenger is not consistent with the facial image prestored, plays customized joyous
It meets voice and buckles the suggestion voices such as safety belt.
Cockpit in the intelligent vehicle of the embodiment of the present invention improves the ability of intelligence degree and human-computer interaction.
In a specific embodiment, master controller is also used to obtain vehicle trouble code information, and passes through channel radio
It interrogates module and fault code information is transmitted to cloud platform server.
Cockpit in the intelligent vehicle of the embodiment of the present invention can be sent vehicle trouble code information to by wireless communication platform
Cloud platform server realizes that remote system updates, it can be achieved that remote fault analysis and maintenance, provides maintenance in time for vehicle
Information is to improve maintenance efficiency.
It in a specific embodiment, further include set on interior vehicle-mounted AR navigation device.
Cockpit in the intelligent vehicle of the embodiment of the present invention, can real-time capture real roads scene, and combine vehicle it is current calmly
Position, digital map navigation information and scene Recognition carry out fusion calculation, generate virtual navigation directions model and the true road that is added to
On the road, to be created that the navigation screen more close to the true visual field of driver.
It in a specific embodiment, further include the radar 250 for being set to body exterior and connecting master controller 210.
Cockpit in the intelligent vehicle of the embodiment of the present invention can be realized by radar and predict barrier, prediction is collided and oneself
Adapt to cruise control.The security performance of vehicle can be improved in the embodiment of the present invention.
In a specific embodiment, master controller is also used to connect intelligent terminal by wireless communication module.
Cockpit in the intelligent vehicle of the embodiment of the present invention can connect intelligent terminal, be easy to implement operation and use.
For cockpit in the intelligent vehicle that the embodiment of the present invention will be further explained, it is illustrated by taking Fig. 3 as an example, wherein in Fig. 3
It is 2. correlation function realization 1. being hardware arrangement.
Cockpit in intelligent vehicle of the invention, including the master controller 310 in 1., and the driving of connection master controller 310
Member's monitoring system 320, wireless communication module 330, touch key-press 340, voice input module 350, second camera 360 and thunder
Up to 370.
Further, when master controller can obtain driver information, trip by touch key-press or voice input module
Between or trip purpose, the environmental data that wireless communication module can be will acquire by cloud platform server is sent to main control
Device.Thus master controller is in combination with environmental data, according to driver information, travel time and trip purpose, provides in 2.
Related prompt or service, as driver's Fuel Oil Remaining and travelable distance are reminded in oil mass planning；Traffic congestion processing provides
The light route information etc. of the degree of crowding.Further, driver, which monitors system, can recognize that the expression of the facial image of driver is known
Not, so that master controller is according to the related prompt or service in the offer 2. of Expression Recognition result, such as root when mood processing is i.e. sad
The periphery place that suitable leisure is loosened or the music that broadcasting is releived are provided according to weather condition, or detects detest in thunderstorm weather
When prompt closure vehicle window etc..Further, when detecting driver tired driving, it is pre- to realize that the fatigue processing in 2. exports
Alert prompt information prompts driver.Further, the facial image that passenger can be obtained by camera, realizes Intelligent greeting.Compared with
Excellently, cockpit in the intelligent vehicle of the embodiment of the present invention associatedly stores the control information of vehicle arrangement with driver information, with
Car owner's personalized service is provided.
Cockpit in the intelligent vehicle of the embodiment of the present invention, can be based on the expression management to driver, according to the feelings of driver
Thread and environmental data, providing for driver has targetedly information, to control corresponding vehicle arrangement operation or provide corresponding
Information on services, the traveling of driver is assisted, to meet traveling demand.The present invention can promote the man-machine friendship of interior cockpit
Mutual ability can be provided personalized service by cloud platform big data, and intelligence degree is high.
In one embodiment, the present invention also provides cockpits in a kind of automobile, including above-described intelligent vehicle.
It should be noted that the specific implementation of cockpit and intelligent vehicle described above in intelligent vehicle in the present embodiment automobile
Interior cockpit is identical, and details are not described herein.
The automobile of the embodiment of the present invention, including cockpit in intelligent vehicle, can be based on the expression management to driver, according to driving
The mood and environmental data for the person of sailing, providing for driver has targetedly information, with control corresponding vehicle arrangement operation or
Corresponding information on services is provided, the traveling of driver is assisted, to meet traveling demand.The automobile of the embodiment of the present invention into
The hommization and intelligence degree that one step is promoted.
It will be appreciated by those skilled in the art that the accompanying drawings are only schematic diagrams of a preferred implementation scenario, module in attached drawing or
Process is not necessarily implemented necessary to the present invention.
It will be appreciated by those skilled in the art that the module in device in implement scene can be described according to implement scene into
Row is distributed in the device of implement scene, can also be carried out corresponding change and is located at the one or more dresses for being different from this implement scene
In setting.The module of above-mentioned implement scene can be merged into a module, can also be further split into multiple submodule.
Aforementioned present invention serial number is for illustration only, does not represent the superiority and inferiority of implement scene.Disclosed above is only the present invention
Several specific implementation scenes, still, the present invention is not limited to this, and the changes that any person skilled in the art can think of is all
Protection scope of the present invention should be fallen into.
Claims (10)
1. cockpit in a kind of intelligent vehicle, which is characterized in that the driver including master controller, the connection master controller monitors system
System and wireless communication module；It includes the first camera that the driver, which monitors system,；
The driver monitors the facial image that system is used to obtain driver by first camera, and to the driving
The facial image of member carries out facial expression recognition, and the corresponding mood shape of facial image of the driver is determined according to recognition result
State information；And the emotional state information is sent to the master controller；
The wireless communication module is used to the environmental data got by cloud platform server being sent to the master controller；
The environmental data includes weather data information and road data information；
The master controller is used to export corresponding prompt information according to the emotional state information and the environmental data；Institute
State the prompt information, the prompt information of switch music and appointing in the prompt information of periphery place that prompt information includes closing windows
A kind of or any number of combination.
2. cockpit in intelligent vehicle according to claim 1, which is characterized in that the master controller is used for according to the mood
Status information and the environmental data export corresponding prompt information, comprising:
The master controller is sadness in the emotional state information, and the weather data information indicates that weather conditions are good,
When He or the road data information indicate that road conditions are good, the first prompt information is exported；
The master controller indicates that weather conditions are bad in the weather data information, and the emotional state information is to detest
When, export the second prompt information；
The master controller the emotional state information be pleasure, and the road data information indicate road conditions it is good when, it is defeated
Third prompt information out.
3. cockpit in intelligent vehicle according to claim 1, which is characterized in that the driver monitors system and is also used to pass through
First camera obtains the facial expression of driver and the folding frequency of eyes；And it is detected in preset interval time
The number yawned in the facial expression of the driver is greater than or equal to preset times, and the folding frequency of eyes is greater than or waits
When predeterminated frequency, determine that driver is fatigue driving, and export warning information.
4. cockpit in intelligent vehicle according to claim 1, which is characterized in that further include the information for connecting the master controller
Input module；
The MIM message input module is with being used to obtain travel time and the trip purpose of driver；
The master controller is also used to pass the travel time and the trip purpose by the wireless communication module
Transport to the cloud platform server, and receive the cloud platform server according to the travel time, the trip purpose with
And the best travel route that the environmental data returns.
5. cockpit in intelligent vehicle according to claim 4, which is characterized in that the MIM message input module is that voice inputs mould
Block and/or touch key-press module.
6. cockpit in intelligent vehicle according to claim 4, which is characterized in that the MIM message input module is also used to obtain and drive
The person's of sailing information and control information to vehicle arrangement, and by the control information of the driver information and the vehicle arrangement
It is sent to the master controller；
The master controller is also used to store the control information association of the driver information and the vehicle arrangement；Institute
Stating driver information includes driving age information, account information and age information.
7. cockpit in intelligent vehicle according to claim 1, which is characterized in that further include connect the master controller second
Camera；
The second camera is used to obtain the facial image of passenger, and the facial image of the passenger is transferred to the master control
Device processed；
The master controller is also used to when the facial image of the passenger is not consistent with the facial image prestored, output welcome
Scape mode.
8. cockpit in intelligent vehicle according to claim 1, which is characterized in that the master controller is also used to obtain vehicle event
Hinder code information, and the fault code information is transmitted to by the cloud platform server by the wireless communication module.
9. according to claim 1 to cockpit in intelligent vehicle described in 8 any one, which is characterized in that further include set on interior
Vehicle-mounted AR navigation device.
10. a kind of automobile, which is characterized in that including cockpit in intelligent vehicle described in claim 1 to 9 any one.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811517842.9A CN109606386A (en) | 2018-12-12 | 2018-12-12 | Cockpit in intelligent vehicle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811517842.9A CN109606386A (en) | 2018-12-12 | 2018-12-12 | Cockpit in intelligent vehicle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109606386A true CN109606386A (en) | 2019-04-12 |
Family
ID=66008128
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811517842.9A Pending CN109606386A (en) | 2018-12-12 | 2018-12-12 | Cockpit in intelligent vehicle |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109606386A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110807920A (en) * | 2019-10-23 | 2020-02-18 | 上海能塔智能科技有限公司 | Emotion determining and reporting method and device for vehicle driving, server, terminal and vehicle |
| CN111739450A (en) * | 2020-05-29 | 2020-10-02 | 惠州华阳通用电子有限公司 | Multi-cabin welcome method and system and vehicle |
| CN112036329A (en) * | 2020-09-02 | 2020-12-04 | 上海本安仪表系统有限公司 | Vehicle-mounted human-computer interface with face and emotion recognition function |
| WO2021023064A1 (en) * | 2019-08-07 | 2021-02-11 | 北京全路通信信号研究设计院集团有限公司 | Safe driving monitoring system and method for train |
| CN112418162A (en) * | 2020-12-07 | 2021-02-26 | 安徽江淮汽车集团股份有限公司 | Method, apparatus, storage medium, and device for vehicle control |
| CN112947759A (en) * | 2021-03-08 | 2021-06-11 | 上汽大众汽车有限公司 | Vehicle-mounted emotional interaction platform and interaction method |
| CN113212438A (en) * | 2021-05-31 | 2021-08-06 | 重庆工程职业技术学院 | Driving navigation system based on user driving behavior analysis |
| CN113380050A (en) * | 2021-08-12 | 2021-09-10 | 江西影创信息产业有限公司 | Driving safety prompting method and system based on intelligent glasses and intelligent glasses |
| CN114312669A (en) * | 2022-02-15 | 2022-04-12 | 远峰科技股份有限公司 | Intelligent cabin display system based on face recognition |
| CN114347788A (en) * | 2021-11-30 | 2022-04-15 | 岚图汽车科技有限公司 | Service-oriented intelligent cabin man-machine interaction key control system |
| CN114506334A (en) * | 2020-10-29 | 2022-05-17 | 上海汽车集团股份有限公司 | Vehicle control method and related device |
| CN116767255A (en) * | 2023-07-03 | 2023-09-19 | 深圳市哲思特科技有限公司 | Intelligent cabin linkage method and system for new energy automobile |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104548309A (en) * | 2015-01-05 | 2015-04-29 | 浙江工业大学 | Device and method for adjusting driver emotional state through different affective characteristic music |
| CN106650633A (en) * | 2016-11-29 | 2017-05-10 | 上海智臻智能网络科技股份有限公司 | Driver emotion recognition method and device |
| CN106926795A (en) * | 2017-01-22 | 2017-07-07 | 斑马信息科技有限公司 | System and method based on driving habit adjustment vehicle configuration |
| JP2017136922A (en) * | 2016-02-02 | 2017-08-10 | 富士通テン株式会社 | Vehicle control device, on-vehicle device controller, map information generation device, vehicle control method, and on-vehicle device control method |
| CN107144286A (en) * | 2016-03-01 | 2017-09-08 | 阿里巴巴集团控股有限公司 | Air navigation aid and device |
| CN108139222A (en) * | 2015-10-06 | 2018-06-08 | 歌乐株式会社 | Driving comfort calculating apparatus, driving comfort calculation method and driving comfort calculation system |
| CN108237976A (en) * | 2016-12-27 | 2018-07-03 | 广州市联奥信息科技有限公司 | Have the interaction driving system and method for emotion expression service ability |
| CN108267146A (en) * | 2016-12-30 | 2018-07-10 | 比亚迪股份有限公司 | Path planning apparatus, in-vehicle navigation apparatus, air navigation aid and system |
| CN108536035A (en) * | 2018-07-06 | 2018-09-14 | 盯盯拍（深圳）技术股份有限公司 | Intelligent home furnishing control method and intelligent home control device |
| CN108710821A (en) * | 2018-03-30 | 2018-10-26 | 斑马网络技术有限公司 | Vehicle user state recognition system and its recognition methods |
| CN108831460A (en) * | 2018-06-15 | 2018-11-16 | 浙江吉利控股集团有限公司 | A kind of interactive voice control system and method based on fatigue monitoring |
| CN208198314U (en) * | 2018-05-14 | 2018-12-07 | 浙江如新智能科技有限公司 | A kind of intelligent automobile virtual driving cabin control system |
-
2018
- 2018-12-12 CN CN201811517842.9A patent/CN109606386A/en active Pending
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104548309A (en) * | 2015-01-05 | 2015-04-29 | 浙江工业大学 | Device and method for adjusting driver emotional state through different affective characteristic music |
| CN108139222A (en) * | 2015-10-06 | 2018-06-08 | 歌乐株式会社 | Driving comfort calculating apparatus, driving comfort calculation method and driving comfort calculation system |
| JP2017136922A (en) * | 2016-02-02 | 2017-08-10 | 富士通テン株式会社 | Vehicle control device, on-vehicle device controller, map information generation device, vehicle control method, and on-vehicle device control method |
| CN107144286A (en) * | 2016-03-01 | 2017-09-08 | 阿里巴巴集团控股有限公司 | Air navigation aid and device |
| CN106650633A (en) * | 2016-11-29 | 2017-05-10 | 上海智臻智能网络科技股份有限公司 | Driver emotion recognition method and device |
| CN108237976A (en) * | 2016-12-27 | 2018-07-03 | 广州市联奥信息科技有限公司 | Have the interaction driving system and method for emotion expression service ability |
| CN108267146A (en) * | 2016-12-30 | 2018-07-10 | 比亚迪股份有限公司 | Path planning apparatus, in-vehicle navigation apparatus, air navigation aid and system |
| CN106926795A (en) * | 2017-01-22 | 2017-07-07 | 斑马信息科技有限公司 | System and method based on driving habit adjustment vehicle configuration |
| CN108710821A (en) * | 2018-03-30 | 2018-10-26 | 斑马网络技术有限公司 | Vehicle user state recognition system and its recognition methods |
| CN208198314U (en) * | 2018-05-14 | 2018-12-07 | 浙江如新智能科技有限公司 | A kind of intelligent automobile virtual driving cabin control system |
| CN108831460A (en) * | 2018-06-15 | 2018-11-16 | 浙江吉利控股集团有限公司 | A kind of interactive voice control system and method based on fatigue monitoring |
| CN108536035A (en) * | 2018-07-06 | 2018-09-14 | 盯盯拍（深圳）技术股份有限公司 | Intelligent home furnishing control method and intelligent home control device |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021023064A1 (en) * | 2019-08-07 | 2021-02-11 | 北京全路通信信号研究设计院集团有限公司 | Safe driving monitoring system and method for train |
| CN110807920B (en) * | 2019-10-23 | 2020-10-30 | 上海能塔智能科技有限公司 | Emotion determining and reporting method and device for vehicle driving, server, terminal and vehicle |
| CN110807920A (en) * | 2019-10-23 | 2020-02-18 | 上海能塔智能科技有限公司 | Emotion determining and reporting method and device for vehicle driving, server, terminal and vehicle |
| CN111739450B (en) * | 2020-05-29 | 2022-05-03 | 惠州华阳通用电子有限公司 | Multi-cabin welcome method and system and vehicle |
| CN111739450A (en) * | 2020-05-29 | 2020-10-02 | 惠州华阳通用电子有限公司 | Multi-cabin welcome method and system and vehicle |
| CN112036329A (en) * | 2020-09-02 | 2020-12-04 | 上海本安仪表系统有限公司 | Vehicle-mounted human-computer interface with face and emotion recognition function |
| CN114506334A (en) * | 2020-10-29 | 2022-05-17 | 上海汽车集团股份有限公司 | Vehicle control method and related device |
| CN112418162A (en) * | 2020-12-07 | 2021-02-26 | 安徽江淮汽车集团股份有限公司 | Method, apparatus, storage medium, and device for vehicle control |
| CN112418162B (en) * | 2020-12-07 | 2024-01-12 | 安徽江淮汽车集团股份有限公司 | Method, device, storage medium and apparatus for controlling vehicle |
| CN112947759A (en) * | 2021-03-08 | 2021-06-11 | 上汽大众汽车有限公司 | Vehicle-mounted emotional interaction platform and interaction method |
| CN113212438A (en) * | 2021-05-31 | 2021-08-06 | 重庆工程职业技术学院 | Driving navigation system based on user driving behavior analysis |
| CN113212438B (en) * | 2021-05-31 | 2022-07-08 | 重庆工程职业技术学院 | Driving navigation system based on user driving behavior analysis |
| CN113380050A (en) * | 2021-08-12 | 2021-09-10 | 江西影创信息产业有限公司 | Driving safety prompting method and system based on intelligent glasses and intelligent glasses |
| CN114347788A (en) * | 2021-11-30 | 2022-04-15 | 岚图汽车科技有限公司 | Service-oriented intelligent cabin man-machine interaction key control system |
| CN114347788B (en) * | 2021-11-30 | 2023-10-13 | 岚图汽车科技有限公司 | Intelligent cabin man-machine interaction key control system based on service |
| CN114312669A (en) * | 2022-02-15 | 2022-04-12 | 远峰科技股份有限公司 | Intelligent cabin display system based on face recognition |
| CN114312669B (en) * | 2022-02-15 | 2022-08-05 | 远峰科技股份有限公司 | Intelligent cabin display system based on face recognition |
| CN116767255A (en) * | 2023-07-03 | 2023-09-19 | 深圳市哲思特科技有限公司 | Intelligent cabin linkage method and system for new energy automobile |
| CN116767255B (en) * | 2023-07-03 | 2024-02-06 | 深圳市哲思特科技有限公司 | Intelligent cabin linkage method and system for new energy automobile |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109606386A (en) | Cockpit in intelligent vehicle | |
| CN109416733B (en) | Portable personalization | |
| EP3675121B1 (en) | Computer-implemented interaction with a user | |
| CN110834338B (en) | Vehicle-mounted robot and control method thereof | |
| DE102018001342A1 (en) | Method and system for assisting the driving of a vehicle and computer program product | |
| CN110876047A (en) | Vehicle exterior projection method, device, equipment and storage medium | |
| CN108791299A (en) | A kind of driving fatigue detection of view-based access control model and early warning system and method | |
| CN110871684A (en) | In-vehicle projection method, device, equipment and storage medium | |
| CN114445888A (en) | Vehicle-mounted interaction system based on emotion perception and voice interaction | |
| US10901503B2 (en) | Agent apparatus, agent control method, and storage medium | |
| CN111259719A (en) | Cab scene analysis method based on multi-view infrared vision system | |
| CN110580799A (en) | taxi network taxi appointment driver and passenger speaking automatic pre-judgment alarm system | |
| CN108923808A (en) | Vehicle and its car-mounted terminal and speech interaction mode active triggering method | |
| CN111750885B (en) | Control device, control method, and storage medium storing program | |
| CN110202587B (en) | Information interaction method and device, electronic equipment and storage medium | |
| CN111223479A (en) | Operation authority control method and related equipment | |
| CN112947759A (en) | Vehicle-mounted emotional interaction platform and interaction method | |
| CN107458381A (en) | A kind of motor vehicle driving approval apparatus based on artificial intelligence | |
| CN112837407A (en) | Intelligent cabin holographic projection system and interaction method thereof | |
| DE102018126525A1 (en) | In-vehicle system, procedure and storage medium | |
| CN111797755A (en) | Automobile passenger emotion recognition method and electronic equipment | |
| CN108556769A (en) | Automobile driving interaction system | |
| CN113320537A (en) | Vehicle control method and system | |
| CN112918381B (en) | Vehicle-mounted robot welcome method, device and system | |
| CN109835280A (en) | A kind of system and vehicle showing vehicle-state and driving behavior by speech recognition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Room 1601-35, No.8, second financial street, Wuxi Economic Development Zone, Wuxi City, Jiangsu Province, 214125 Applicant after: Wuxi cheliantianxia Information Technology Co.,Ltd. Address before: Room a-0465, 2 / F, building 3, yard 30, Shixing street, Shijingshan District, Beijing Applicant before: BEIJING AUTO-LINK WORLD INFORMATION TECHNOLOGY Co.,Ltd. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190412 |