CN104002818A - Interaction and automation integrated vehicle-mounted system - Google Patents

Interaction and automation integrated vehicle-mounted system Download PDF

Info

Publication number
CN104002818A
CN104002818A CN201410228554.7A CN201410228554A CN104002818A CN 104002818 A CN104002818 A CN 104002818A CN 201410228554 A CN201410228554 A CN 201410228554A CN 104002818 A CN104002818 A CN 104002818A
Authority
CN
China
Prior art keywords
module
control command
robot
processing module
driver
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201410228554.7A
Other languages
Chinese (zh)
Inventor
谢明
张吉稳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ICAR ELECTRONICS (KUNSHAN) CO Ltd
Original Assignee
ICAR ELECTRONICS (KUNSHAN) CO Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ICAR ELECTRONICS (KUNSHAN) CO Ltd filed Critical ICAR ELECTRONICS (KUNSHAN) CO Ltd
Priority to CN201410228554.7A priority Critical patent/CN104002818A/en
Publication of CN104002818A publication Critical patent/CN104002818A/en
Pending legal-status Critical Current

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2552/00Input parameters relating to infrastructure

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Human Computer Interaction (AREA)
  • Traffic Control Systems (AREA)

Abstract

The invention relates to the field of vehicle safe driving, and particularly to an interaction and automation integrated vehicle-mounted system. The vehicle-mounted system comprises an input module, a processing module and a robot module, wherein the input module is used for obtaining image information outside a motor vehicle and collecting voice information of the driver of the motor vehicle; the processing module is used for collecting, analyzing and processing the image information to extract information of the road where the motor vehicle is and sending a robot control command to the robot module based on the extracted road information and/or voice information; the robot module is used for carrying out corresponding operation based on the robot control command and/or the control command generated by the voice information. The vehicle-mounted system can improve the safety of the motor vehicle.

Description

A kind of interaction and onboard system automatically of integrating
Technical field
The present invention relates to safe driving of vehicle field, relate in particular to a kind of onboard system interactive and automatically that integrates.
Background technology
Chaufeur is on the run long-distance, owing to keeping for a long time anchor, action is subject to certain limitation, attention high concentration, be busy with judging the various stimulus informations outside car, state of mind high-pressure, thus easily produce eyes fuzzy, have a pain in the back, slow in reacting or drive the fatigue driving phenomenons such as dumb.Especially,, when chaufeur is driven in the environment that substantially remain unchanged such as express highway, grassland or desert, more easily cause eye fatigue.
The factor that causes fatigue driving is many-sided.The fatigue of chaufeur is mainly neural and sensory fatigue, and because keeping for a long time anchor, the caused limbs fatigue of poor blood circulation.General, chaufeur produces tired sequencing and is: eyes, neck, shoulder and waist are mainly wherein the fatigue of eyes and health.
At present, the common technology that prevents fatigue driving mainly contains: several based on the blink fatigue driving judgement of frequency, the judgement based on the running car time and judgement based on chaufeur action etc. of chaufeur.The technology of existing anti-fatigue-driving is mainly to remind after driver fatigue, but can not alleviate the fatigue of chaufeur.Therefore, even lack the vehicle-mounted technology of effectively alleviating driver tired driving, therefore there is safety issue in existing self-propelled vehicle.
Summary of the invention
In view of this, the embodiment of the present invention provides a kind of onboard system interactive and automatically that integrates, effectively to improve the safety of self-propelled vehicle.
The embodiment of the present invention provides a kind of onboard system interactive and automatically that integrates, and comprises load module, processing module and robot module, wherein,
Described load module, for obtaining the graphicinformation of vehicle exterior, and gathers the voice messaging of automobile driver;
Described processing module, for gathering, analyzing and process described graphicinformation, with extractor Motor Car Institute road information, and according to the road information extracting and/or described voice messaging to described robot module's distribution of machine people control command;
Described robot module, for carrying out corresponding operation according to the control command of described robot control command and/or the generation of described voice messaging.
What the embodiment of the present invention provided integrates onboard system interactive and automatically, analyze and process the graphicinformation of vehicle exterior by processing module to extract useful road information, and according to extract road information and/or described voice messaging to robot module's sending controling instruction, make robot module to carry out information interaction with automobile driver, thereby effectively alleviate the fatigue of automobile driver, and then improve the safety of self-propelled vehicle.
Brief description of the drawings
By reading the detailed description that non-limiting example is done of doing with reference to the following drawings, it is more obvious that other features, objects and advantages of the present invention will become:
Fig. 1 is the structural representation interactive and onboard system automatically that integrates in first embodiment of the invention;
Fig. 2 is the structural representation of robot module in the onboard system of first embodiment of the invention;
Fig. 3 integrates structural representation interactive and onboard system automatically in second embodiment of the invention;
Fig. 4 is the structural representation of module of cruising in the onboard system of second embodiment of the invention;
Fig. 5 is the workflow schematic diagram that adopts onboard system in second embodiment of the invention;
Fig. 6 integrates structural representation interactive and onboard system automatically in third embodiment of the invention.
Detailed description of the invention
Below in conjunction with drawings and Examples, the present invention is described in further detail.Be understandable that, specific embodiment described herein is only for explaining the present invention, but not limitation of the invention.It also should be noted that, for convenience of description, in accompanying drawing, only show part related to the present invention but not full content.
The embodiment of the present invention provides a kind of onboard system interactive and automatically that integrates, to improve the safety of self-propelled vehicle.Fig. 1 is the structural representation interactive and onboard system automatically that integrates in first embodiment of the invention, and as shown in Figure 1, onboard system comprises load module 11, processing module 12 and robot module 13.
Wherein, described load module 11, for obtaining the graphicinformation of vehicle exterior, and gathers the voice messaging of automobile driver.
Described load module 11 specifically comprises photographing module 112 and microphone 111, wherein, described photographing module 112 can comprise following at least one: be installed on self-propelled vehicle front front camera (not shown), be installed on self-propelled vehicle left left camera (not shown), be installed on right-hand right camera (not shown) of self-propelled vehicle and be installed on the rear camera (not shown) at self-propelled vehicle rear.Be installed on respectively effectively harvester motor-car graphicinformation around of self-propelled vehicle at least one camera all around.
Described microphone 111 is installed on the operator's compartment of self-propelled vehicle.Microphone 111 is for gathering the voice messaging of automobile driver, the onboard system providing in the embodiment of the present invention is provided, can obtains the voice messaging of automobile driver, and according to the voice messaging obtaining, alleviate the fatigue state of chaufeur, and then improve the safety of self-propelled vehicle.
Described processing module 12, for gathering, analyzing and process described graphicinformation, with extractor Motor Car Institute road information, and according to the road information extracting and/or described voice messaging to described robot module's 13 distribution of machine people control commands.
Wherein, described processing module 12 specifically can comprise image acquisition and processing module 121 and central processing module 122, wherein, described image acquisition and processing module 121, for receiving described graphicinformation, analysis from the photographing module 112 of described load module 11 and processing the graphicinformation receiving, to extract described road information; Described central processing module 122, for the voice messaging the road information extracting according to described image acquisition and processing module 121 and/or the identification receiving from sound identification module 131, to described robot module's 13 distribution of machine people control commands, so that described robot module 13 carries out action corresponding to described robot control command.
Concrete, described image acquisition and processing module 121 photographing module 112 from load module 11 receives, analyzes and process and obtains self-propelled vehicle graphicinformation around, with the road information of extractor motor-car from the graphicinformation of obtaining.Described image acquisition and processing module 121 sends to described central processing module 122 road information extracting.Central processing module 122, receive the road information extracting from described image acquisition and processing module, and the voice messaging from sound identification module receives identification, and then according to the voice messaging after the road information extracting and/or identification, to described robot module's distribution of machine people control command, so that described robot module carries out action corresponding to described robot control command.
Described robot module 13, for carrying out corresponding operation according to the control command of described robot control command and/or the generation of described voice messaging.Robot module 13, after the central processing module 122 of described processing module 12 receives robot control command, carries out operation corresponding to described robot control command, to carry out information interaction with chaufeur.
Fig. 2 is the structural representation of robot module in the onboard system of first embodiment of the invention.As depicted in figs. 1 and 2, described robot module 13 specifically can comprise: described sound identification module 131, for receive and identify the voice messaging of automobile driver from the described microphone 111 of load module, the voice messaging that central processing module 122 in described processing module sends after identification, and according to the voice messaging after identification, send controlled by sound and light instruction and send motion control instruction to described motion-control module 133 to described controlled by sound and light module 132.For example, when sound identification module 131 receives the voice messaging of microphone 111, and after speech recognition judgement, find that the voice after identification are certain voice in speech recognition library, sound identification module 131 will send corresponding instruction to controlled by sound and light module 132 or motion-control module 133.
Described controlled by sound and light module 132, for according to described controlled by sound and light instruction and/or described robot control command, controls described robot module 13 and sends the interactive informations such as different sound, light or speech; Described motion-control module 133, for according to described motion control instruction and/or described robot control command, controls described robot module 13 and carries out the different interactive informations such as countenance or limb action.
What in the embodiment of the present invention, provide integrates in interaction and onboard system automatically, and load module 11 can obtain the graphicinformation of vehicle exterior, for example, obtain the graphicinformation of self-propelled vehicle surrounding, can also obtain the voice messaging of interior of motor vehicles chaufeur.Processing module 12 is according to the graphicinformation of vehicle exterior and the voice messaging of interior of motor vehicles chaufeur, to robot module's 13 distribution of machine people control commands, the control command that robot module 13 can produce according to robot control command and/or described voice messaging be carried out corresponding operation, with chaufeur interaction.In the onboard system providing due to the embodiment of the present invention, robot module 13 can, according to the voice messaging of the graphicinformation of vehicle exterior and chaufeur and chaufeur interaction, effectively avoid the fatigue driving of chaufeur, and then improves the safety of self-propelled vehicle.
Fig. 3 integrates structural representation interactive and onboard system automatically in second embodiment of the invention, as shown in Figure 3, the onboard system providing in the embodiment of the present invention comprises load module 11, processing module 12 and robot module 13, wherein, described load module 11, for obtaining the graphicinformation of vehicle exterior, and gather the voice messaging of automobile driver; Described processing module 12, for gathering, analyzing and process described graphicinformation, with extractor Motor Car Institute road information, and according to the road information extracting and/or described voice messaging to described robot module's 13 distribution of machine people control commands; Described robot module 13, for carrying out corresponding operation according to the control command of described robot control command and/or the generation of described voice messaging.Wherein, described processing module 12 specifically can comprise image acquisition and processing module 121 and central processing module 122, described image acquisition and processing module 121, for receiving described graphicinformation, analysis from the photographing module 112 of described load module 11 and processing the graphicinformation receiving, to extract described road information; Described central processing module 122, for the road information extracting according to described image acquisition and processing module 121 and/or the voice messaging receiving from sound identification module 131, to described robot module's 13 distribution of machine people control commands, so that described robot module 13 carries out action corresponding to described robot control command.
As shown in Figure 3, in the onboard system providing in the embodiment of the present invention, described processing module 12 is also for producing according to the road information extracting and/or described voice messaging the control command of cruising, and can comprise the module 14 of cruising, wherein, described in the module 14 of cruising, for receiving from described processing module 12 control command of cruising, and according to the described control command of cruising, control automobile braking, accelerate and/or turn to, to realize the driving of cruising of automobile.
Concrete, when onboard system comprises that while cruising module 14, the central processing module 122 of described processing module 12, also, for according to the road information and/or the described voice messaging that extract, produces the control command of cruising; The described module 14 of cruising, for according to the control command of cruising that receives from described central processing module 122, control automobile braking, accelerate or turn to, to realize the driving of cruising of automobile.The module of for example, cruising, 14 can make self-propelled vehicle keep current track automatic running, keeps fixed vehicle speed automatic running and keep fixing spacing automatic running etc. with front truck according to the control command of cruising.
As shown in Figure 3, the onboard system providing in the embodiment of the present invention, can also comprise display module 15.In the time that onboard system comprises display module 15, described processing module 12, also for according to the road information extracting and/or described voice messaging produces and send and show control commands to described display module 15; Described display module 15, for according to the demonstration control command receiving, shows the graphicinformation of vehicle exterior and the road information that processing module 12 is extracted.
Fig. 4 is the structural representation of module of cruising in the onboard system of second embodiment of the invention, as shown in Figure 3 and Figure 4, the described module 14 of cruising, specifically can comprise: cruise control module 141, braking driver module 142, accelerate driver module 143, turn to driver module 144, braking motor 145, add speed motor 146 and steer motor 147, wherein, described cruise control module 141, for the control command of cruising receiving according to the central processing module 122 from processing module 12, to braking driver module 142, accelerate driver module 143 and turn to driver module 144 impulse singla corresponding to control command that cruise described in sending, described braking driver module 142, for according to the impulse singla receiving from cruise control module 141, produces the required braking current signal of braking motor 145, described acceleration driver module 143, for according to the impulse singla receiving from cruise control module 141, produces and adds the required acceleration current signal of speed motor 146, the described driver module 144 that turns to, for according to the impulse singla receiving from cruise control module 141, produces the required diverted current signal of steer motor 147.
Described braking motor 145, for according to the braking current signal receiving from braking driver module 142, drives described braking motor to rotate, and controls the brake of brake-pedal of automobile.Be that braking motor 145 can, according to the braking circuit signal of braking driver module 142, be controlled the brake of automobile, make self-propelled vehicle to realize brake operation according to the control command of cruising.The described speed motor 146 that adds, for according to from accelerating the acceleration current signal that receives of driver module 143, adds speed motor 146 described in drive and rotates, and controls the throttle of car ACCEL.Adding speed motor 146 can, according to the accelerating circuit signal that accelerates driver module 143, control the throttle of automobile, makes self-propelled vehicle to realize and to accelerate operation according to the control command of cruising.Described steer motor 147, for according to the diverted current signal from turning to driver module 144 to receive, drives described steer motor to rotate, and controls turning to of vehicle steering.Be that steer motor 147 can, according to the go to circuit signal that turns to driver module 144, be controlled turning to of automobile, make self-propelled vehicle to realize steering operation according to the control command of cruising.
Therefore,, when onboard system comprises while cruising module 14, described central processing module 122 sends to the module 14 of cruising the control command of cruising.The module of cruising 14 can be according to the control command of cruising, and the throttle of controlling machine motor-car, brakes and turns to, thereby realizing the automatic Pilot of self-propelled vehicle, has avoided the fatigue of chaufeur, and then has improved the safety of self-propelled vehicle.
When self-propelled vehicle remains unchanged in environment substantially in express highway, grassland or desert etc., while travelling for a long time, chaufeur is easy to tired tiredness, and the way of existing alleviation driver fatigue has: listening to the music, open a window to ventilate or tune up sound equipment stimulates the sense of hearing etc.And in the onboard system providing in the embodiment of the present invention, robot module 13 can also be by accompanying chaufeur chat, for chaufeur is said cross-talk, the mode of the interaction such as crack a joke is alleviated driver fatigue.When chaufeur is during in fatigue driving state, the module 14 of cruising in the embodiment of the present invention, can also realize drivings of cruising according to the control command of cruising, thereby replacement chaufeur carries out automatic cruising driving, and chaufeur can be had a rest.
Fig. 5 is the workflow schematic diagram that adopts onboard system in second embodiment of the invention, and as shown in Figure 5, the workflow of this system mainly comprises: step S1, judge whether chaufeur drives for a long time, if so, perform step S2; Otherwise terminating operation.Step S2, further judge whether chaufeur produces tired tiredness, if so, perform step S3; Otherwise terminating operation.Step S3, adopt robot module to accompany the modes such as chaufeur chat to alleviate the fatigue of chaufeur, also can be by listening to the music, open a window, tune up the modes such as sound equipment and alleviate the fatigue of chaufeur.Step S4, in the time that chaufeur need to rest, the automatic cruising that adopts the module of cruising to realize self-propelled vehicle is driven, and so that chaufeur can be taken a quick nap in car, and then eliminates the fatigue of chaufeur.
The onboard system providing in second embodiment of the invention comprises robot module, the module of cruising and display module, in chaufeur driving procedure, can adopt this onboard system to alleviate and eliminate the fatigue state of chaufeur, and then improves the safety of self-propelled vehicle.
Fig. 6 integrates structural representation interactive and onboard system automatically in third embodiment of the invention, as shown in Figure 6, the onboard system providing in third embodiment of the invention comprises: lay respectively at self-propelled vehicle front camera 1121, rear camera 1122, left camera 1123 and the right camera 1124 of four direction all around; Be installed on the microphone 111 of automobile driving cabin; Image acquisition and processing module 121, central processing module 122, robot module 13, the module of cruising 14 and display module 15.
Wherein, described image acquisition and processing module 121 specifically comprises image capture module 1211 and image processing module 1212; Described robot module 13 specifically comprises sound identification module 131, controlled by sound and light module 132 and motion-control module 133; The described module 14 of cruising specifically comprises cruise control module 141, braking driver module 142, accelerates driver module 143, turns to driver module 144, braking motor 145, adds speed motor 146 and steer motor 147.
Wherein, described image capture module 1211, for gathering the graphicinformation of described load module 11; Described image processing module 1212, for analyzing and process the graphicinformation receiving from described image capture module 1211, to extract road information, the road information wherein extracting comprises track, the speed of a motor vehicle, obstacle, target, road sign, guideboard or range finding.
It should be noted that, what central processing module 122 was concrete is connected with motion-control module 133 with the controlled by sound and light module 132 in robot module 13 respectively, with to described controlled by sound and light module 132 or to described motion-control module 133 distribution of machine people control commands.
In onboard system, four cameras are respectively used to take the graphicinformation of vehicle exterior, all send to image capture module 1211 graphicinformation photographing; Image processing module 1212 receives described graphicinformation by image capture module 1211, and the graphicinformation receiving is carried out to analyzing and processing, therefrom to extract road information, wherein, the road information of extraction comprises track, the speed of a motor vehicle, obstacle, target, road sign, guideboard or range finding.Microphone 111, for receiving the voice messaging of automobile driver, and sends to the sound identification module 131 in robot module 13 voice messaging receiving; Sound identification module 131 is identified the voice messaging receiving from microphone 111, and sends voice identification result to central processing module 122.The voice messaging that central processing module 122 is identified according to the road information extracting from image processing module 1212 and/or sound identification module 131, to robot module's 13 distribution of machine people control commands, send and cruise control command and send demonstration control command to display module 15 to the module 14 of cruising respectively.
Robot module 13 can carry out operation corresponding to robot control command, make robot module 13 can with automobile driver interaction.Sound identification module 131 in robot module 13 is also for sending controlled by sound and light instruction to controlled by sound and light module 132, and sends motion control instruction to motion-control module 133; Controlled by sound and light module 132, according to described controlled by sound and light instruction and/or described robot control command, is controlled described robot module 13 and is sent the interactive informations such as different sound, light or speech; Motion-control module 133, according to described motion control instruction and/or described robot control command, is controlled described robot module 13 and is carried out the different interactive informations such as countenance or limb action.
Wherein, sound interactive information is for playing music, song, essay or cross-talk etc. to chaufeur; Light interactive information, for adjusting light or the local light of operator's compartment, is alleviated the fatigue of chaufeur; Speech interactive information carries out language communication for robot module 13 with chaufeur.Robot module 13 countenance comprises: smile and nictation etc.Described robot module's 13 limb action, comprises: nod, shake the head and beat its wings etc.
The module of cruising 14 can controlling machine motor-car braking, accelerate and turn to, the automatic cruising that the module of cruising 14 can realize self-propelled vehicle accelerates.In the module of cruising 14 cruise control module 141 according to described in the control command of cruising, respectively to braking driver module 142, accelerate driver module 143 and turn to driver module 144 to send corresponding impulse singla; Described braking driver module 142, for according to the impulse singla receiving from cruise control module 141, produces the required braking current signal of braking motor 145; Described acceleration driver module 143, for according to the impulse singla receiving from cruise control module 141, produces and adds the required acceleration current signal of speed motor 146; The described driver module 144 that turns to, for according to the impulse singla receiving from cruise control module 141, produces the required diverted current signal of steer motor 147; Described braking motor 145, for according to the braking current signal receiving from braking driver module 142, drives described braking motor 145 to rotate, and controls brake-pedal of automobile, realizes the action that brake of motor-driven vehicle slows down; The described speed motor 146 that adds, for according to from accelerating the acceleration current signal that receives of driver module 143, adds speed motor 146 described in drive and rotates, and controls the throttle of car ACCEL, realizes the action that self-propelled vehicle step on the accelerator accelerates; Described steer motor 147, for according to the diverted current signal from turning to driver module 144 to receive, drives described steer motor 147 to rotate, and controls turning to of vehicle steering, drives the rotating of steering wheel of self-propelled vehicle, realizes motor turning action.
Described display module 15, for the demonstration control command according to receiving, shows the road information of vehicle exterior.For example, display module 15 is in real time to user's displays image information and Word message.
The onboard system providing in third embodiment of the invention, can realize robot module and user's interactive operation, automatic cruising driving and the demonstration self-propelled vehicle road information around etc. of self-propelled vehicle by robot module, the module of cruising and display module, and then the safety that can improve self-propelled vehicle.
Note, above are only preferred embodiment of the present invention and institute's application technology principle.Skilled person in the art will appreciate that and the invention is not restricted to specific embodiment described here, can carry out for a person skilled in the art various obvious variations, readjust and substitute and can not depart from protection scope of the present invention.Therefore, although the present invention is described in further detail by above embodiment, the present invention is not limited only to above embodiment, in the situation that not departing from the present invention's design, can also comprise more other equivalent embodiment, and scope of the present invention is determined by appended claim scope.

Claims (8)

1. integrate an onboard system interactive and automatically, it is characterized in that, comprise load module, processing module and robot module, wherein,
Described load module, for obtaining the graphicinformation of vehicle exterior, and gathers the voice messaging of automobile driver;
Described processing module, for gathering, analyzing and process described graphicinformation, with extractor Motor Car Institute road information, and according to the road information extracting and/or described voice messaging to described robot module's distribution of machine people control command;
Described robot module, for carrying out corresponding operation according to the control command of described robot control command and/or the generation of described voice messaging.
2. onboard system according to claim 1, is characterized in that, described robot module comprises: sound identification module, controlled by sound and light module and motion-control module, wherein,
Described sound identification module, for receive and identify the voice messaging of automobile driver from described load module, send the voice messaging after identification to described processing module, and according to the voice messaging after identification, send controlled by sound and light instruction and send motion control instruction to described motion-control module to described controlled by sound and light module;
Described controlled by sound and light module, for according to described controlled by sound and light instruction and/or described robot control command, controls described robot module and sends different sound, light or speech;
Described motion-control module, for according to described motion control instruction and/or described robot control command, controls described robot module and carries out different countenances or limb action.
3. onboard system according to claim 1, is characterized in that:
Described processing module, also for producing according to the road information extracting and/or described voice messaging the control command of cruising;
Described onboard system also comprises the module of cruising, wherein, described in the module of cruising, for receiving from described processing module the control command of cruising, and according to the described control command of cruising, control automobile braking, accelerate and/or turn to, to realize the driving of cruising of automobile.
4. onboard system according to claim 3, is characterized in that, described in the module of cruising, specifically comprise: cruise control module, brake driver module, accelerate driver module, turn to driver module, braking motor, add speed motor and steer motor, wherein,
Described cruise control module, for the control command of cruising described in basis, to braking driver module, accelerate driver module and turn to driver module send described in impulse singla corresponding to control command that cruise;
Described braking driver module, for according to the impulse singla receiving from cruise control module, produces the required braking current signal of braking motor;
Described acceleration driver module, for according to the impulse singla receiving from cruise control module, produces and adds the required acceleration current signal of speed motor;
The described driver module that turns to, for according to the impulse singla receiving from cruise control module, produces the required diverted current signal of steer motor;
Described braking motor, for according to the braking current signal receiving from braking driver module, drives described braking motor to rotate, and controls the brake of brake-pedal of automobile;
The described speed motor that adds, for according to the acceleration current signal receiving from accelerating driver module, drives described acceleration electric machine rotation, controls the throttle of car ACCEL;
Described steer motor, for according to the diverted current signal from turning to driver module to receive, drives described steer motor to rotate, and controls turning to of vehicle steering.
5. onboard system according to claim 1, is characterized in that:
Described processing module, also for producing demonstration control command according to the road information extracting and/or described voice messaging;
Described onboard system also comprises display module, and wherein, described display module, for receiving and show control command from described processing module, and according to the demonstration control command receiving, shows the graphicinformation of vehicle exterior and the road information that processing module is extracted.
6. onboard system according to claim 2, is characterized in that, described processing module comprises image acquisition and processing module and central processing module, wherein,
Described image acquisition and processing module, for receiving described graphicinformation, analysis from described load module and processing the graphicinformation receiving, to extract described road information;
Described central processing module, for the voice messaging the road information extracting according to described image acquisition and processing module and/or the identification receiving from sound identification module, to described robot module's distribution of machine people control command, so that described robot module carries out action corresponding to described robot control command.
7. onboard system according to claim 6, is characterized in that, described image acquisition and processing module, specifically comprises: image capture module and image processing module, wherein,
Described image capture module, for gathering the graphicinformation of described load module;
Described image processing module, for analyzing and process the graphicinformation receiving from described image capture module, to extract road information, the road information wherein extracting comprises track, the speed of a motor vehicle, obstacle, target, road sign, guideboard or range finding.
8. onboard system according to claim 1, is characterized in that, described load module comprises photographing module and microphone, wherein,
Described photographing module comprises following at least one: be installed on self-propelled vehicle front front camera, be installed on self-propelled vehicle left left camera, be installed on right-hand right camera of self-propelled vehicle and be installed on the rear camera at self-propelled vehicle rear;
Described microphone is installed on the operator's compartment of self-propelled vehicle.
CN201410228554.7A 2014-05-27 2014-05-27 Interaction and automation integrated vehicle-mounted system Pending CN104002818A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410228554.7A CN104002818A (en) 2014-05-27 2014-05-27 Interaction and automation integrated vehicle-mounted system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410228554.7A CN104002818A (en) 2014-05-27 2014-05-27 Interaction and automation integrated vehicle-mounted system

Publications (1)

Publication Number Publication Date
CN104002818A true CN104002818A (en) 2014-08-27

Family

ID=51363794

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410228554.7A Pending CN104002818A (en) 2014-05-27 2014-05-27 Interaction and automation integrated vehicle-mounted system

Country Status (1)

Country Link
CN (1) CN104002818A (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104460667A (en) * 2014-10-31 2015-03-25 成都众易通科技有限公司 Automatic drive system of automobile
CN105292052A (en) * 2015-11-12 2016-02-03 福州大学 Automatic monitoring and alarming system for vehicle traffic safety
WO2016178213A1 (en) * 2015-05-05 2016-11-10 B.G. Negev Technologies And Applications Ltd. Universal autonomous robotic driving system
CN106114518A (en) * 2016-06-29 2016-11-16 浙江吉利控股集团有限公司 Cruise system that a kind of phonetic entry is controlled and vehicle
CN107176095A (en) * 2016-03-10 2017-09-19 松下电器(美国)知识产权公司 Recognition result suggestion device and its method, identification object suggestion device and its method
CN108162977A (en) * 2017-11-25 2018-06-15 深圳市元征科技股份有限公司 Driving assistance system and control method
CN108215794A (en) * 2018-01-04 2018-06-29 项卢杨 A kind of anti-fatigue-driving system and method
WO2018187976A1 (en) * 2017-04-12 2018-10-18 深圳市南北汽车美容有限公司 Method for adjusting cruise control according to road sign, and cruise control system
CN109720355A (en) * 2017-12-15 2019-05-07 蔚来汽车有限公司 Method and apparatus for realizing human-computer interaction inside the vehicle
CN109961211A (en) * 2017-12-26 2019-07-02 丰田自动车株式会社 Vehicle Dispatch Administration device and storage medium
CN110116729A (en) * 2018-02-06 2019-08-13 丰田自动车株式会社 Occupant's assisting system, occupant's support method and program storage medium
CN110202587A (en) * 2019-05-15 2019-09-06 北京梧桐车联科技有限责任公司 Information interacting method and device, electronic equipment and storage medium
CN110871813A (en) * 2018-08-31 2020-03-10 比亚迪股份有限公司 Control method and device of virtual robot, vehicle, equipment and storage medium
CN111376857A (en) * 2018-12-27 2020-07-07 观致汽车有限公司 Vehicle control method, device, electronic equipment and computer storage medium
CN112947195A (en) * 2021-02-20 2021-06-11 广州橙行智动汽车科技有限公司 Interaction system, control method thereof, interaction control system and vehicle

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060155547A1 (en) * 2005-01-07 2006-07-13 Browne Alan L Voice activated lighting of control interfaces
CN201489315U (en) * 2009-08-08 2010-05-26 吉林大学 On-board voice recognition control system
CN103063225A (en) * 2012-12-21 2013-04-24 安科智慧城市技术(中国)有限公司 Vehicle-mounted robot, vehicle-mounted navigation system, vehicle-mounted navigation method and vehicle
CN203186256U (en) * 2013-04-28 2013-09-11 南京交通职业技术学院 Automobile voice control device
CN103287362A (en) * 2013-06-25 2013-09-11 安科智慧城市技术(中国)有限公司 Vehicle-mounted voice control system and method and electric automobile
CN103309356A (en) * 2013-06-24 2013-09-18 安科智慧城市技术(中国)有限公司 Car-mounted robot
CN103697900A (en) * 2013-12-10 2014-04-02 郭海锋 Method for early warning on danger through augmented reality by vehicle-mounted emotional robot

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060155547A1 (en) * 2005-01-07 2006-07-13 Browne Alan L Voice activated lighting of control interfaces
CN101501762A (en) * 2005-01-07 2009-08-05 通用汽车环球科技运作公司 Voice activated lighting of control interfaces
CN201489315U (en) * 2009-08-08 2010-05-26 吉林大学 On-board voice recognition control system
CN103063225A (en) * 2012-12-21 2013-04-24 安科智慧城市技术(中国)有限公司 Vehicle-mounted robot, vehicle-mounted navigation system, vehicle-mounted navigation method and vehicle
CN203186256U (en) * 2013-04-28 2013-09-11 南京交通职业技术学院 Automobile voice control device
CN103309356A (en) * 2013-06-24 2013-09-18 安科智慧城市技术(中国)有限公司 Car-mounted robot
CN103287362A (en) * 2013-06-25 2013-09-11 安科智慧城市技术(中国)有限公司 Vehicle-mounted voice control system and method and electric automobile
CN103697900A (en) * 2013-12-10 2014-04-02 郭海锋 Method for early warning on danger through augmented reality by vehicle-mounted emotional robot

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104460667A (en) * 2014-10-31 2015-03-25 成都众易通科技有限公司 Automatic drive system of automobile
US10613544B2 (en) 2015-05-05 2020-04-07 B. G. Negev Technologies And Applications Ltd. Universal autonomous robotic driving system
JP2018520408A (en) * 2015-05-05 2018-07-26 ビー.ジー.ネゲヴ テクノロジーズ アンド アプリケーションズ リミテッドB.G.Negev Technologies and Applications Ltd. Universal autonomous robot operation system
CN107614308A (en) * 2015-05-05 2018-01-19 B.G.内盖夫技术与应用有限公司 Generalized Autonomic robot driver system
WO2016178213A1 (en) * 2015-05-05 2016-11-10 B.G. Negev Technologies And Applications Ltd. Universal autonomous robotic driving system
JP7023116B2 (en) 2015-05-05 2022-02-21 ビー.ジー.ネゲヴ テクノロジーズ アンド アプリケーションズ リミテッド Universal autonomous robot driving system
CN105292052A (en) * 2015-11-12 2016-02-03 福州大学 Automatic monitoring and alarming system for vehicle traffic safety
CN107176095A (en) * 2016-03-10 2017-09-19 松下电器(美国)知识产权公司 Recognition result suggestion device and its method, identification object suggestion device and its method
CN107176095B (en) * 2016-03-10 2021-12-24 松下电器(美国)知识产权公司 Recognition result presentation device and method, and recognition object presentation device and method
CN106114518A (en) * 2016-06-29 2016-11-16 浙江吉利控股集团有限公司 Cruise system that a kind of phonetic entry is controlled and vehicle
WO2018187976A1 (en) * 2017-04-12 2018-10-18 深圳市南北汽车美容有限公司 Method for adjusting cruise control according to road sign, and cruise control system
CN108162977A (en) * 2017-11-25 2018-06-15 深圳市元征科技股份有限公司 Driving assistance system and control method
CN109720355A (en) * 2017-12-15 2019-05-07 蔚来汽车有限公司 Method and apparatus for realizing human-computer interaction inside the vehicle
CN109961211B (en) * 2017-12-26 2023-12-05 丰田自动车株式会社 Vehicle scheduling management device and storage medium
CN109961211A (en) * 2017-12-26 2019-07-02 丰田自动车株式会社 Vehicle Dispatch Administration device and storage medium
CN108215794A (en) * 2018-01-04 2018-06-29 项卢杨 A kind of anti-fatigue-driving system and method
CN110116729A (en) * 2018-02-06 2019-08-13 丰田自动车株式会社 Occupant's assisting system, occupant's support method and program storage medium
CN110871813A (en) * 2018-08-31 2020-03-10 比亚迪股份有限公司 Control method and device of virtual robot, vehicle, equipment and storage medium
CN111376857A (en) * 2018-12-27 2020-07-07 观致汽车有限公司 Vehicle control method, device, electronic equipment and computer storage medium
CN110202587B (en) * 2019-05-15 2021-04-30 北京梧桐车联科技有限责任公司 Information interaction method and device, electronic equipment and storage medium
CN110202587A (en) * 2019-05-15 2019-09-06 北京梧桐车联科技有限责任公司 Information interacting method and device, electronic equipment and storage medium
CN112947195A (en) * 2021-02-20 2021-06-11 广州橙行智动汽车科技有限公司 Interaction system, control method thereof, interaction control system and vehicle

Similar Documents

Publication Publication Date Title
CN104002818A (en) Interaction and automation integrated vehicle-mounted system
US10112623B2 (en) Sensory stimulation system for an autonomous vehicle
US9304515B2 (en) Regional operation modes for autonomous vehicles
US9902403B2 (en) Sensory stimulation for an autonomous vehicle
CN103448719B (en) Neuro-cognitive driver status processes
KR102137213B1 (en) Apparatus and method for traning model for autonomous driving, autonomous driving apparatus
EP3357778A1 (en) Driving control device, driving control method, and program
KR20170016174A (en) Driver assistance apparatus and control method for the same
JPWO2017057060A1 (en) Operation control apparatus, operation control method, and program
CN107215294A (en) The determination of device location in crowded indoor environment
CN108657178A (en) A kind of intelligent network connection electric instruction car and control method
JP6188795B2 (en) On-vehicle device, server device, and running state control method
CN108688675B (en) Vehicle driving support system
US20200070848A1 (en) Method and System for Initiating Autonomous Drive of a Vehicle
EP3920159A1 (en) Image output device
US11661069B2 (en) Driver screening using biometrics and artificial neural network analysis
US11494865B2 (en) Passenger screening
CN110944896A (en) Road vehicle and method for re-engaging in manual driving
CN112947759A (en) Vehicle-mounted emotional interaction platform and interaction method
CN111223479A (en) Operation authority control method and related equipment
KR20190105538A (en) Engine sound synthesis device and engine sound synthesis method
CN111047047A (en) Driving model training method and device, electronic equipment and computer storage medium
DE102015014652A1 (en) Method for operating a motor vehicle, in which a text of a piece of music is output, and motor vehicle
KR20190018322A (en) Apparatus and Method for Training Autonomous Driving of Self-driving Car, Apparatus for Autonomous Driving Thereof
US20230215151A1 (en) Information processing apparatus, information processing method, information processing system, and a program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20140827