CN104620259B - Use the Vehicle security system of audio/visual clue - Google Patents
Use the Vehicle security system of audio/visual clue Download PDFInfo
- Publication number
- CN104620259B CN104620259B CN201380047098.XA CN201380047098A CN104620259B CN 104620259 B CN104620259 B CN 104620259B CN 201380047098 A CN201380047098 A CN 201380047098A CN 104620259 B CN104620259 B CN 104620259B
- Authority
- CN
- China
- Prior art keywords
- audio
- data
- sound
- visual cues
- processing module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000000007 visual effect Effects 0.000 title claims abstract description 37
- 230000005540 biological transmission Effects 0.000 claims abstract description 8
- 238000001914 filtration Methods 0.000 claims description 7
- ZRHANBBTXQZFSP-UHFFFAOYSA-M potassium;4-amino-3,5,6-trichloropyridine-2-carboxylate Chemical compound [K+].NC1=C(Cl)C(Cl)=NC(C([O-])=O)=C1Cl ZRHANBBTXQZFSP-UHFFFAOYSA-M 0.000 claims description 7
- 230000007613 environmental effect Effects 0.000 claims description 2
- 230000005236 sound signal Effects 0.000 abstract description 4
- 230000015654 memory Effects 0.000 description 27
- 238000001514 detection method Methods 0.000 description 18
- 230000006870 function Effects 0.000 description 9
- 238000000034 method Methods 0.000 description 7
- 238000004891 communication Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 4
- 230000005611 electricity Effects 0.000 description 3
- 230000001953 sensory effect Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000001427 coherent effect Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 230000002708 enhancing effect Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 241000209140 Triticum Species 0.000 description 1
- 235000021307 Triticum Nutrition 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000002238 attenuated effect Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 238000009792 diffusion process Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000002045 lasting effect Effects 0.000 description 1
- 231100000225 lethality Toxicity 0.000 description 1
- 230000005389 magnetism Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000003584 silencer Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 238000010977 unit operation Methods 0.000 description 1
- 238000009941 weaving Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0965—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages responding to signals from another vehicle, e.g. emergency vehicle
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/165—Anti-collision systems for passive traffic, e.g. including static obstacles, trees
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/166—Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/167—Driving aids for lane monitoring, lane changing, e.g. blind spot detection
-
- A—HUMAN NECESSITIES
- A42—HEADWEAR
- A42B—HATS; HEAD COVERINGS
- A42B3/00—Helmets; Helmet covers ; Other protective head coverings
- A42B3/04—Parts, details or accessories of helmets
- A42B3/0406—Accessories for helmets
- A42B3/042—Optical devices
- A42B3/0426—Rear view devices or the like
Abstract
A kind of system may include one or more data modules, can operate with reception, processing and transmission data associated with the one or more audios and/or visual cues of surrounding from the user.The system may also include one or more cameras and one or more microphones, it is communicatively coupled to one or more of data modules, wherein one or more of cameras and one or more of microphones can operate with: record one or more of audios and/or visual cues respectively；And the data associated with one or more of audios and/or visual cues are transmitted to one or more of data modules respectively.Moreover, the system may include one or more speakers, by from the received audio-signal-driven of one or more of data modules.
Description
Technical field
The present invention relates to Vehicle security systems, the Safety system for motorcycle comprising using audio/visual clue
Background of invention
In the U.S., millions of car accidents may be present every year.Tens of thousands of in these accidents can be it is fatal.These
Majority in fatal accident is motorcycle accident, and the accident than not being related to motorcycle has bigger lethality.
Brief summary of the invention
A kind of system may include one or more data modules, can operate with reception, processing and transmission with from user
Surrounding one or more audios and/or the associated data of visual cues.The system may also include one or more
A camera and one or more microphones, are communicatively coupled to one or more of data modules.It is one or more
A camera and one or more of microphones can operate with: record one or more of audios and/or visual line respectively
Rope；And respectively will the data associated with one or more of audios and/or visual cues be transmitted to it is one
Or multiple data modules.Moreover, the system may include one or more speakers, can operate with from one or more of
Data module receives processed data associated with one or more of audios and/or visual cues.In addition, the system
System may include attachment part, can operate vehicle will be attached to the user in terms of the system or apparatus (for example, head
Helmet) so that the user is vigilant the audio and/or visual cues of the record.
After explaining following figures and detailed description, other systems, equipment, feature and advantage can to those skilled in the art
To be or may become apparent from.Wish that all such additional systems, method, feature and advantage include in being described herein, at this
In the range of invention, and protected by the appended claims.
Brief description
Vehicle security system (also referred to as VSS) can be preferably understood referring to following figures and description.Component in schema is not
Must be drawn to scale, but focus on and illustrate in the principle of the present invention.In addition, in the drawings, similar reference number refers to
Show the corresponding component in all different views.
It is described it includes the birds-eye perspective of embodiment motorcycle helmet in terms of Fig. 1 shows the embodiment of embodiment VSS
Motorcycle helmet includes the camera for recording rearview and side view.
Fig. 2 illustrates the block diagram in terms of the embodiment of embodiment VSS.
Fig. 3 illustrates the embodiment sound processing module of VSS (for example, VSS of Fig. 2) and the block diagram of embodiment microphone.
Fig. 4 illustrates the embodiment video/image processing module of VSS (for example, VSS of Fig. 2) and the block diagram of embodiment camera.
Specific embodiment
It should be understood that being described below for the embodiment of implementation is presented purpose to be merely to illustrate without should be by limitation
Property meaning carry out.The segmentation of functional block, module shown in schema or the embodiment in unit should not be construed as indicating these function
Energy block, module or unit must be implemented as physically separated unit.Functional block, module or the unit displayed or described can be real
It is now isolated unit, circuit, chip, function, module or circuit element.One or more functions block or unit can also be common
Circuit, chip, realize in circuit element or unit.
Described herein is a kind of Vehicle security system (also referred to as VSS), is mentioned to user (for example, user of vehicle)
For the sensory information about user and/or the surrounding (for example, the driving at vehicular sideview or rear or situation of riding) of vehicle.
For example, via audio and/or visual sensor (for example, microphone and/or camera), family is vigilant can be used connecing for VSS
Close vehicle or other objects (for example, can be harmful object to vehicle and/or user).On the one hand, user can be through
Audio entertainment is received by the loudspeaker of VSS, until VSS detects close harmful or urgent driving situation
(for example, being the close car driven over the speed limit or close emergency vehicles respectively) and until keeping user vigilant.
In addition, the vigilant other purposes that can be used for other than enhancing safety, for example, provide a certain position or location type, appointment,
The notice of time or date, weather condition etc..User can be interacted by tactile or voice input with VSS to select, manage or
Control sensory information.As used herein, term " sensory information " includes audio, video, vigilant etc..
VSS may include information system, such as in conjunction with vehicle or the clothes and/or the letter that uses of apparatus of the user for combining vehicle
Breath system.For example, VSS attach to vehicle or Vehicle Information System associated with vehicle or with the vehicle or vehicle
Integration of information system.Moreover, VSS is embeddable or is fastened to the clothes and/or apparatus of user.For example, VSS can be with the helmet
(for example, vehicle helmet of bicycle helmet, motorcycle helmet (for example, motorcycle helmet 100 of Fig. 1) or any other type)
Combination.VSS can also be with other types of head-shield (for example, cap, belt or the helmet for moving or building, herein
To be collectively referred to as " helmet ") combination.
VSS may include one or more cameras (for example, camera 104 and 106 of Fig. 1), one or more microphone (examples
Such as, the microphone 302 of Fig. 3)；One or more speakers；And one or more controls and data module, is used to receive,
It handles data associated with the audio of from the user and/or vehicle surrounding and/or visual cues and sends out data
It send to the user of VSS.VSS may include a part as audio/visual output system, can be autonomous system, or can be with sound
Frequently/visual output system communication.
One or more cameras can be any kind of imaging sensor, such as low resolution video camera.For example,
The resolution ratio of imaging sensor can be public intermediate form (CIF) 352x288 to dual CIF (DCIF) 528x384.One or
Multiple cameras can be arranged by any means to record the side view of the user of vehicle or vehicle and rearview.For example, one
Or multiple cameras can be arranged in vehicle from vehicle, the helmet and/or other types of user's clothes and/or apparatus towards other places respectively
, on the one or more sides or rear surface regions of user's clothes of the helmet and/or any other type and/or apparatus.Moreover,
One or more cameras can be arranged so that its view is overlapped.In this situation, one or more cameras can be operated with substantially
On record complete rearview and side view.
One or more microphones can be arranged by any means most preferably to receive the sound around VSS.For example, wheat
Gram wind can be arranged in vehicle, the helmet from vehicle, the helmet and/or other types of user's clothes and/or apparatus towards other places respectively
And/or any other type user's clothes and/or apparatus one or more sides or rear surface regions on.Moreover, one or
Multiple microphones can be arranged so that its sound received field or bram pattern overlapping.Microphone can be omnidirectional or unidirectional
, and any other function of the detection for the sound that noise is eliminated, Wave beam forming and/or enhancing are audible can be arranged to provide
Property.These embodiments arrangement can enhance one or more microphones connecing to one or more voice signals from ambient enviroment
It receives.
Audio/visual output system may include host computer of vedio device on vehicle, amplifier, display device, user interface and to user
Any other component of audio or visual output is provided.The functionality of audio/visual output device may include user circle of system
Face control, navigation, audio balance, wireless communication, vehicle-state and diagnosis, and any other operation function related with vehicle
Property.Audio/visual output system may also include with audio-signal-driven one or more speakers to export audible sound
Ability.
By VSS driving one or more speakers can using or can not include as the audio/visual for being included on vehicle
The part of system.Therefore, VSS can either directly or indirectly drive one or more speakers, or signal can be provided to audio/
Vision system is to drive one or more speakers.Loudspeaker can be arranged by any means with to the user for the vehicle for using VSS
Audible audio signal is provided.For example, one or more speakers may be arranged at the one or more of vehicle and/or the helmet
On front, side or rear surface regions, and can user oriented.One or more speakers attach to, be fastened to (for example, fastening
In pocket) or be embedded in the above-mentioned zone of vehicle and/or the helmet.
One or more control and data module may include sound processing module (for example, the sound processing module of Fig. 2
202), video/image processing module (for example, video/image processing module 204 of Fig. 2), geographical location processing module (for example,
The geographical location of Fig. 2 handles module 206) and one or more control modules (for example, priority allocation device/detection mould of Fig. 2
Block 208 and media management module 210).
Sound processing module may include the submodule that can produce information (comprising safety or grade) related with safety
Block.Sound processing module also may include that noise can be selectively filtered out from one or more voice signals (for example, background or ring
Border noise) submodule, a for example, at least filter (for example, filter 304 of Fig. 3).Sound processing module also may include
Optionally audible sound is filtered for detecting the warning sound in one or more voice signals (for example, vehicle
Alarm device or loudspeaker) one or more submodules, such as one or more filter is (for example, 306 He of filter of Fig. 3
308).Moreover, sound processing module may include the submodule that can determine the direction or position of one or more voice signal origins
(for example, direction processing module 310 of Fig. 3).In one embodiment, wherein only one more than microphone in VSS can get
Directional audio clue.
The submodule that can produce information related with safety in sound processing module can be at least partially based on one or
Multiple voice signals through filtering generate safety or grade.In one embodiment, one or more sound through filtering
Signal may be filtered to obtain warning sound and/or by corresponding one of above-mentioned filter and/or submodule or
More persons filter out noise.
Sound processing module also may include that can determine sound and/or pattern and/or sound classification to sound classification respectively
Device (for example, pattern and/or sound classifier 312 of Fig. 3).Pattern and/or sound classifier can determine one or more through filtering
Wave or unfiltered voice signal and/or it is classified as being stored in database (for example, the acoustic vector data base administration of Fig. 3
System (DBMS) 314) in predetermined sound.The identification of sound can be based in identification sound wave detected and sound vector data library
Acoustic vector similar characteristic, such as matching frequency characteristic, pusle response characteristics or any other sound relevant parameter.It is real
Apply the sound that example classification may include car engine, loudspeaker and/or alarm device.
Similar to sound processing module, video/image processing module may include that can produce information (packet related with safety
Containing safety or grade) submodule.Moreover, video/image processing module also may include for one or more videos/
The similar submodule of picture signal filtering.
Moreover, video/image processing module may include the submodule comprising image identification ability, image identification ability can be true
Determine object recorded in videograph.For example, artificial intelligence, image mapping techniques or some other form of image are distinguished
Know and can recognize vehicle and/or type of vehicle (for example, bicycle, motorcycle, car and truck).In one embodiment, this
A little determine can also be carried out by sound processing module or combination sound processing module.For example, the vehicle classification device module of Fig. 3
316 can according to received voice signal, received image or received voice signal and picture signal combination come really
Determine type of vehicle.
Image identification may further determine that the attribute of object, for example, object be movable or abiotic, object size, its
The position of user relative to VSS and its behavior (for example, the module 404 to 408 for seeing Fig. 4).For example, image identification
It can determine close to the vehicle (for example, vehicle driven over the speed limit from user rear) of user driven over the speed limit and Shandong
The vehicle (for example, the vehicle for turning to and/or weaving suddenly in passage) driven bigly.In one embodiment, can lead to
The abiotic object (for example, roadblock and/or traffic lane line) crossed on more close object and road determines
The speed of close object and move horizontally (for example, the speed of close vehicle and turn to and/or weave suddenly).
Moreover, virtual or projection object (for example, projection line) can assist these determinations.
In addition, video/image processing module may act as the false alarm detector for sound processing module, and in turn
Equally.For example, sound processing module can recognize close emergency vehicles (for example, gradually becoming much larger by detection
The alarm device of sound).However, in some cases, it appears that may be close emergency vehicles may be close
Vehicle engine or silencer sound, or by the audible sound of the flat surfaces such as such as building or tunnel reflection/diffusion.
Video/image processing module can detect this miscalculation.For example, video/image processing module can distinguish emergency vehicles (example
Such as, police car, fire fighting truck, trailer or medical vehicle) and non-emergency vehicle.Video/image processing module can be by (for example) detecting
Emergency light on emergency vehicles distinguishes.
In addition, in some cases, being selected to detected close vehicle (for example, emergency vehicles or crudity
The vehicle that ground drives) it can be can be detected before it can be detected by sound processing module by video/image processing module or anti-mistake
Come same.Module tracks and/or identification can be handled by geographical location using the position of the user of VSS, so that VSS recognizes
The situation of user.By this identification of user, VSS may depend on situation and activate (for example, power on or be powered) respectively and/or go
Activation (for example, lower electricity or power-off) sound processing module and/or video/image processing module.For example, when the environment of surrounding
When noise conditions are below predetermined threshold (for example, on having the local road compared with low noise level), VSS can be to video/image
Electricity or power-off under processing module；And when the ambient noise conditions of surrounding are more than predetermined threshold (for example, having compared with high noisy
On the highway of grade or hypervelocity arterial highway), video/image processing module can be powered on or is powered.In order to enhance the position to user
The determination set, geographical location processing module may include global positioning system (GPS) or operate together with GPS.
In addition, preferred value can be distributed to sound processing module by the control module such as priority allocation device/detection module
And/or the one or more safeties or ranking of video/image processing module.For example, corresponding preferred value (is respectively
P1And P2) safety (being S (t) and V (t) respectively) of sound and video/image processing module can be distributed to.Moreover, these phases
The preferred value answered can be based on another score, such as the safety (G (t)) from geographical location processing module.Phase reserved portion with
The summation of the product of preferred value can be equal to total security level (T).It speaks briefly, P1S(t)+P2V (t)=T.
Wherein T is less than the threshold value (it can be adjusted for road conditions) of minimum main safety, safety hazards flag
Mark can be triggered by priority allocation device/detection module.This safety hazards flag then can be directly or through the media control of VSS
Unit processed is transferred to loudspeaker.
S (t) and V (t) can be changed over time, and can be RealTime scores.For example, score can be relative to high speed sound
Record and video/image record the time to determine.In this embodiment, score can be determined and/or be updated within several nanoseconds.
In the case where flag is transmitted to media control unit, the audio frequency media of user's perception can be mute or be attenuated to quiet
Sound.In one embodiment, the volume of audio frequency media can be relative between possible harmful or emergency vehicles and user
Distance and reduce.As harmful or emergency vehicles are close to danger area (away from the scheduled risk distance of user), media can weaken.
Once vehicle is in danger area, media can be completely mute.
About Fig. 1, in terms of the embodiment for depicting embodiment VSS, it includes the vertical views of embodiment motorcycle helmet 100
Perspective view, motorcycle helmet 100 include the camera 104 of the VSS of the rearview and side view for recording the user relative to VSS
With 106.Further depict corresponding centerline 104a and 106a, corresponding boundary 104b, 104c, 106b of the view of camera 104 and 106
And 106c, and corresponding visual angle 104d and 106d.In Fig. 1, view overlapping 108 so that VSS can record continuous rearview and
Side view.Similarly, microphone in a similar manner, or by any other of audible sound around record can match placement location.
About Fig. 2, in terms of the embodiment for depicting embodiment VSS 200.As depicted, VSS 200 includes at sound
Module and one or more microphones 202, video/image processing module and one or more cameras 204 are managed (for example, the phase of Fig. 1
Machine 104 and 106), geographical location processing module and GPS 206, priority allocation device/detection module 208, media management module
210, host computer of vedio device on vehicle 212 (it can drive the energy converter such as head-telephone or one or more speakers), Yi Jitong
The control bus 214 of the aspect of the above-mentioned description of letter ground coupling VSS 200.It further depicts and is wirelessly communicated with network 216
The geographical location processing module and GPS 206 of ground coupling.Network 216 can be GPS satellite network, telecommunication network etc..
Also illustrating sound processing module and video/image processing module can be with other element of VSS 200 (for example, excellent
First weigh distributor/detection module 208) it is respectively transmitted S (t) and V (t).In addition, Fig. 2 describes other elements of VSS (200), such as
S ' (t) and V ' (t) is sent back to sound processing module to priority allocation device/detection module 208 and video/image handles mould
Block；Wherein S ' (t) and V ' (t) indicates the respective feedback signal of the control loop by S (t) and V (t) starting.Receiving S ' (t)
And after V ' (t), S ' (t) and V ' (t) can be at least partially based on correspondingly to adjust S (t) and V (t).S ' (t) can be indicated (for example)
The instruction of environmental noise.V ' (t) can (for example) provide signal used in auto-focusing, auto contrast etc..
In addition, feedback signal can provide the information of the resolution ratio of the sensitivity or camera that can be used to control microphone.Citing
For, in the case where vigilant lasting generation, resolution changing to higher level can be used to verify by priority allocation device.?
Under this situation and other situations, feedback signal can be the flag of the parameter for microphone or camera reconfigured automatically,
Such as auto-focusing, auto contrast etc..
Fig. 3 illustrates the block diagram of sound processing module 202 and one or more embodiment microphones 302.Also illustrate sound
The process of the inside and outside one or more coherent signals of processing module 202.
As demonstrated, voice signal can be recorded by microphone 302.Then the unrelated background or environment in voice signal is made an uproar
Sound is filtered by noise filter 304.Next, the signal through filtering is transferred at bandpass filter 306 and/or direction
Manage module 310.Direction processing module 310 can determine the position for generating the object of element of voice signal, besides or furthermore ground, it can
Determine sound from direction.In addition, the voice signal through filtering can pass through band point after through bandpass filter 306
Resolution filter 308.In one embodiment, filter 306 and 308 can enhance the clarity and/or amplification sound of voice signal
The wanted component of sound signal.
It can come the component of the voice signal and/or voice signal that carry resolution ratio filter 308 and direction processing module 310
It is identified and is classified by the pattern and/or sound classifier 312 that are communicatively coupled to acoustic vector data base management system 314.?
After this assorting process, component can further classify at vehicle classification device 316 by type of vehicle.
About the part outside sound processing module 202 of VSS, as depicted, direction processing module 310 can be by direction
Information is sent to priority allocation device/detection module 208.Moreover, vehicle classification device 316 and/or pattern and/or sound classifier
312 can be sent to voice signal classification information priority allocation device/detection module 208.In addition, vehicle classification device 316 can be from
Video/image processing module 204 receives vehicle classification information.
Fig. 4 illustrates video/image processing module 204 and one or more embodiment cameras 402 (for example, the camera of Fig. 1
104 and block diagram 106).Also illustrate the inside and outside one or more coherent signals of video/image processing module 204
Process.
As depicted, video/image signal can be recorded by camera 402.According to these video/image signals, track/lane
Detection and scene detection module 404 can detect and the speed of close object and move horizontally associated data.Then
Computing module 406 can be close to determine according to the data detected at track/lane detection and scene detection module 404
It the speed of object and moves horizontally.Next, correlation module 408 can make this information with and corresponding object classification (for example, vehicle
Classification) and/or the associated information of voice signal from sound processing module 202 it is related.
About the part outside video/image processing module of VSS, as depicted, track/lane detection and scene inspection
Surveying module 404 speed and can will move horizontally data transmission to host computer of vedio device on vehicle 212 and/or media management module 210.And
And computing module 406 can be received and user's and approached from network 216, geographical location processing module 206 and/or GPS 206
Object location information.In addition, correlation module 408 can be by relevant data transmission to priority allocation device/detection module
208。
About priority allocation device/detection module (or only priority allocation device), this module can be by priority allocation to letter
Number V (t) and S (t) and determine whether output and these signals are effective.For example, it is just being driven on a highway in driver
In the case where, V (t) will be given larger priority, such as 30% priority relative to S (t) is 70% priority.In high speed
On highway, it is contemplated that the engine noises of driver oneself may interfere with the voice signal from other vehicles.And at lower speeds,
S (t) can have priority than V (t) because of opposite reason.Moreover, distributor/detection module can from other modules (for example,
Geographic position module) information is received to reinforce the determination of its priority.
In general, the other aspects of VSS, any module, interface or VSS, or combine any other device of VSS operation
Or system may include component in various one or more computing devices, partly or entirely.The component of computing device, part or
It all may include the component that can be executed to cause computing device, partly or entirely execute disclosed process or computer based
Any one of function or the instruction set of more persons.The component of computing device, partly or entirely can be used as self-contained unit operation or can
(for example) using network connection to other computer systems or peripheral unit.The component of computing device partly or entirely can be used
The electronic device for providing voice, audio, video or data communication is realized.
The component of computing device also may include partly or entirely processor, for example, central processing unit (CPU), one or
The a certain combination of multiple digital signal processors or different or identical processor.Processor can be in multiple systems
Component.Processor can be one or more general processors, digital signal processor, specific integrated circuit, field-programmable
Gate array, server, network, digital circuit, analog circuit, a combination thereof, or for analyze and handle data it is other now
Device that is knowing or developing later.Processor can realize software program, such as the code for manually generating or programming.
Term " module " can be defined to include multiple executable modules.Module may include software, hardware, firmware, or can
Its a certain combination executed by processor.Software module may include another storage that is stored in memory or can be executed by processor
Instruction in device device.Hardware module may include the various devices that can be performed, instructed or control with for being executed for processor,
Component, circuit, door, circuit board etc..
The component of computing device, partly or entirely also may include can be via the memory of bus communication.Memory can be
Main memory, static memory or dynamic memory.Memory may include computer-readable storage medium, such as various types of
Volatile and non-volatile stores media, can comprising random access memory, read-only memory, programmable read only memory, electricity
Program read-only memory, electric erasable read-only memory, flash memory, tape or disk, optical media etc..Moreover, depositing
Reservoir may include the cache or random access memory for processor.Alternatively, memory can be separated with processor, such as handle
Memory cache, system storage or the other memories of device.Memory can be external memory for storing data
Or database.Embodiment includes hard disk drive, compact disk (" CD "), digital video disk (" DVD "), storage card, memory
Stick, floppy disk, universal serial bus (" USB ") memory device, or operation is with any other device of storing data.Memory can
Operation is to store the instruction that can be executed by processor.
Module illustrate in schema or described, function, movement or task can be by executing finger stored in memory
The processor of the programming of order executes.Module, function, movement or task can be independently of certain types of instruction set, storage media, place
It manages device or processing strategie, and can be held by the software, hardware, integrated circuit, firmware, microcode etc. operated either individually or in combination
Row.Processing strategie may include multiprocessing, multitask, parallel processing etc..
Computer-readable media or machine-readable medium may include any non-transitory memory device, it includes or storage
Software for or combine instruction executable system, device use.Machine-readable medium can be electronics, magnetism, optics,
Electromagnetism, infrared ray or semiconductor system, device.Embodiment may include portable disk or CD, such as arbitrary access
The volatile memory such as memory " RAM ", read-only memory " ROM " or erasable programmable read-only memory " EPROM " are fast
Flash memory.Machine readable memory also may include the non-transitory tangible medium for storing software thereon.Software can be with electronics side
Formula is stored as image or stores by another format (for example, passing through optical scanner), is then compiled or interprets or in other ways
Processing.
The component of computing device also may include partly or entirely any being configured to allow in the component of user and VSS
The input unit of person's interaction.Input unit may include for receiving voice input or tactile input (for example, pressing on a keypad
Key) hardware and/or software.
The component of computing device also may include partly or entirely for via transmission of network voice, video, audio, image
Or communication interface or the port of any other data.This interface or port can be connected to any or all that can connect computing device
The bus of part or part.
Term " computer-readable media " may include single storage media or store media more, such as centralization or distributed
Database, or store the associated memory cache and server of one or more instruction set.Term " computer-readable matchmaker
Body " also may include that can store, encode or carry instruction set device for processing to execute or keep computer system execution disclosed
Any media of any one of method or operation or more persons." computer-readable media " can be non-transitory, and can be with
It is tangible.
In alternative embodiments, specialized hardware implementation (for example, specific integrated circuit, programmable logic array and its
Its hardware device) various aspects of VSS can be realized through construction.Described one or more embodiment can be used two or more
A hardware module specifically interconnected or device by it is relevant control and data signal or as specific integrated circuit part
To realize function, controling and data signal can transmit between module and passes through module.VSS can cover software, firmware and hardware
Implementation.
Described VSS can be realized that software program can be executed by computer system by software program.Implementation may include
Distributed treatment, component/object distributed treatment and parallel processing.Alternatively, virtual computer system processing can be through construction with reality
The various aspects of existing VSS.
In order to illustrate the use in claims co-pending and therefore provide notice to the public, unless applicant is on the contrary
Clearly assert, otherwise phrase "<A>,<B>... and at least one of<N>" or "<A>,<B>...<N>, or combinations thereof
At least one of " defined in the broadest sense by applicant, to replace above or below any other implicit
Definition, with refer to selected from including A, B ... and N group one or more elements, that is to say, that comprising individually or and its
The element A, B of any one element of one or more of its element combination ... or any group of one or more of N
It closes, other elements include unlisted additional element with can also be combined.
It, can be it is readily apparent that more for those skilled in the art although having described various embodiments of the present invention
More embodiments and implementation may be within the scope of the invention.For example, many described above presents the present invention
The aspect utilized by vehicle viewing system；However, other types of viewing system can also be used the aspects of the invention and
Other aspects.Therefore, the present invention should not be restricted, except in the appended claims and its equivalent.
Claims (15)
1. a kind of system for vehicle safety comprising:
One or more data modules, can operate with reception, processing and transmission with one of surrounding from the user or
Multiple audios or audio and the associated data of visual cues；
One or more cameras and one or more microphones, are communicatively coupled to one or more of data modules,
Wherein one or more of cameras and one or more of microphones can operate with:
One or more of audios or audio and visual cues are recorded respectively；And
Respectively will the data associated with one or more of audios or audio and visual cues be transmitted to it is one
Or multiple data modules；And
One or more speakers can be operated to receive and one or more of sounds from one or more of data modules
Frequency or audio and the associated processed data of visual cues, and relative to one or more of audios or audio and view
Feel that the distance between clue and user reduce the volume of audio frequency media, the processed data are based on one or more sounds
Frequency clue determines into predetermined sound or predetermined sound type and one or more audio cues is categorized into predetermined sound or are made a reservation for
Obtained from one of sound type or a variety of processing.
2. the system as claimed in claim 1, wherein one or more of cameras include at least one low resolution video camera.
3. system as claimed in claim 1 or 2, wherein one or more of cameras can be operated to record the side of the user
View and rearview.
4. system as claimed in claim 1 or 2, wherein two or more views of one or more of cameras weigh each other
It is folded.
5. system as claimed in claim 1 or 2, wherein two or more sound received fields of one or more of microphones
It overlaps each other.
6. system as claimed in claim 1 or 2, wherein one or more of loudspeakers, one or more of microphones
And one or more of cameras are attached to, are fastened to or are embedded in the vehicle, the helmet or other types of use of the user
One or more front, side or the rear surface regions of tool.
7. the system as claimed in claim 1, wherein one or more of data modules include sound processing module, at image
Manage module, geographical location processing module and one or more control modules.
8. system as claimed in claim 7, wherein one or more of control modules include media management module.
9. system as claimed in claim 7 or 8, wherein the sound and described image processing module include can operate with from
One or more audios or audio and the associated data of visual cues generate the phase of the security information comprising safety
Answer submodule.
10. system as claimed in claim 7 or 8, wherein the sound processing module include can operate with from it is one
Or multiple associated data of audio cue selectively filter out the submodule of the noise comprising background or environmental noise.
11. system as claimed in claim 7 or 8, wherein the sound processing module include can operate with from it is one
Or multiple associated data of audio cue are selectively directed to comprising vehicle alarm or the progress of the alarm data of loudspeaker
The submodule of filtering.
12. system as claimed in claim 7 or 8, wherein the sound and described image processing module include that can operate with true
The corresponding son of one or more of the position in source or the source of fixed one or more of audios or audio and visual cues
Module.
13. system as claimed in claim 7 or 8, wherein the sound and described image processing module include that can operate with right
What aspect corresponding to the associated processed data of one or more of audios or audio and visual cues was classified
Corresponding pattern classifier.
14. a kind of head-shield comprising:
One or more data modules can be operated with the sound of reception, processing and transmission and the surrounding from the head-shield
Frequency and the associated data of visual cues；
One or more cameras and one or more microphones, are communicatively coupled to one or more of data modules,
Wherein one or more of cameras and one or more of microphones can operate with:
The audio and visual cues are recorded respectively；And
The data associated with the audio and visual cues are transmitted to one or more of data modules；And
One or more speakers can be operated to receive and the audio and visual line from one or more of data modules
The associated processed data of rope, and relative to one or more of audios or the distance between visual cues and user
Reduce the volume of audio frequency media, the processed data be based on by the determination of one or more audio cues at predetermined sound or
Predetermined sound type and one or more audio cues are categorized into one of predetermined sound or predetermined sound type or a variety of
Obtained from processing.
15. a kind of equipment for being vigilant the user of motorcycle comprising:
Attachment part can be operated so that the equipment to be attached to the motorcycle or apparatus of the user；
One or more circuits comprising processor and storage device refer to wherein the storage device includes that processor is executable
It enables, the processor-executable instruction can operate side or rear surrounding with reception, processing and transmission with the equipment
Audio or audio and the associated data of visual cues；
One or more cameras and one or more microphones, are communicatively coupled to one or more of circuits, wherein
One or more of cameras and one or more of microphones can operate with:
The audio or audio and visual cues are recorded respectively；And
The data associated with the audio or audio and visual cues are transmitted to one or more of circuits；And
One or more speakers can be operated to receive and the audio or audio and vision from one or more of circuits
The associated processed data of clue, and relative to one or more of audios or audio and visual cues and user it
Between distance reduce audio frequency media volume, the processed data be based on by one or more audio cues determination at pre-
Determine sound or predetermined sound type and one or more audio cues are categorized into one in predetermined sound or predetermined sound type
Obtained from kind or a variety of processing.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US13/608,722 US9417838B2 (en) | 2012-09-10 | 2012-09-10 | Vehicle safety system using audio/visual cues |
| US13/608,722 | 2012-09-10 | ||
| PCT/US2013/058486 WO2014039805A1 (en) | 2012-09-10 | 2013-09-06 | Vehicle safety system using audio/visual cues |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104620259A CN104620259A (en) | 2015-05-13 |
| CN104620259B true CN104620259B (en) | 2019-01-15 |
Family
ID=49305074
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201380047098.XA Active CN104620259B (en) | 2012-09-10 | 2013-09-06 | Use the Vehicle security system of audio/visual clue |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US9417838B2 (en) |
| EP (1) | EP2893488B1 (en) |
| JP (1) | JP6389179B2 (en) |
| CN (1) | CN104620259B (en) |
| WO (1) | WO2014039805A1 (en) |
Families Citing this family (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9576208B2 (en) | 2013-12-11 | 2017-02-21 | Continental Automotive Systems, Inc. | Emergency vehicle detection with digital image sensor |
| GB2521274B (en) * | 2013-12-11 | 2018-07-04 | Continental automotive systems inc | Emergency vehicle detection with digital image sensor |
| DE102014207666A1 (en) * | 2014-04-23 | 2015-10-29 | Bayerische Motoren Werke Aktiengesellschaft | Autonomous driving in a dangerous situation |
| US20150365743A1 (en) * | 2014-06-14 | 2015-12-17 | GM Global Technology Operations LLC | Method and apparatus for including sound from an external environment into a vehicle audio system |
| US9800983B2 (en) | 2014-07-24 | 2017-10-24 | Magna Electronics Inc. | Vehicle in cabin sound processing system |
| US9278689B1 (en) * | 2014-11-13 | 2016-03-08 | Toyota Motor Engineering & Manufacturing North America, Inc. | Autonomous vehicle detection of and response to emergency vehicles |
| CN107852251A (en) * | 2014-11-28 | 2018-03-27 | 埃里克·S·塔马姆 | Strengthen accentuation sensory perceptual system |
| US20160355126A1 (en) * | 2015-06-05 | 2016-12-08 | Strategic Technology Group LLC | Helmet with integrated camera and safety light system including same |
| ITUB20152855A1 (en) * | 2015-08-04 | 2017-02-04 | Andrea Manco | Device to signal the arrival of emergency vehicles. |
| US9873428B2 (en) * | 2015-10-27 | 2018-01-23 | Ford Global Technologies, Llc | Collision avoidance using auditory data |
| CN105430462A (en) * | 2015-11-30 | 2016-03-23 | 四川诚品电子商务有限公司 | Vehicle-mounted television video switching method |
| US20170158117A1 (en) * | 2015-12-08 | 2017-06-08 | Denso International America, Inc. | Methods and Systems for Alerting Drivers of Hazards |
| ES2903165T3 (en) * | 2015-12-11 | 2022-03-31 | Yamaha Motor Co Ltd | Device for presenting an onomatopoeia relating to results of evaluating a surrounding environment and method for presenting an onomatopoeia |
| US9996080B2 (en) * | 2016-02-26 | 2018-06-12 | Ford Global Technologies, Llc | Collision avoidance using auditory data |
| GB2550620B (en) * | 2016-05-26 | 2020-07-29 | Michael Child John | A camera apparatus |
| US11244564B2 (en) | 2017-01-26 | 2022-02-08 | Magna Electronics Inc. | Vehicle acoustic-based emergency vehicle detection |
| US20190061617A1 (en) * | 2017-08-29 | 2019-02-28 | GM Global Technology Operations LLC | Audio Control Systems And Methods Based On Driver Helmet Use |
| IT201800010591A1 (en) * | 2018-11-26 | 2020-05-26 | Basicnet S P A | Integrated active safety system for individuals at risk of a road accident |
| CN110022427A (en) * | 2019-05-22 | 2019-07-16 | 乐山师范学院 | Automobile uses intelligent assistance system |
| US11866063B2 (en) | 2020-01-10 | 2024-01-09 | Magna Electronics Inc. | Communication system and method |
| CN112489363A (en) * | 2020-12-04 | 2021-03-12 | 广东美她实业投资有限公司 | Rear-coming vehicle early warning method and device based on intelligent wireless earphone and storage medium |
| CN112633182A (en) * | 2020-12-25 | 2021-04-09 | 广州文远知行科技有限公司 | Vehicle state detection method, device, equipment and storage medium |
| CN114968428A (en) * | 2021-02-20 | 2022-08-30 | 上海博泰悦臻网络技术服务有限公司 | Method, system, medium, and apparatus for setting silent mode of virtual role |
| US20230139105A1 (en) * | 2021-11-02 | 2023-05-04 | Lightspeed Aviation, Inc. | Circumaural ear cushion/seal |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101753743A (en) * | 2009-12-23 | 2010-06-23 | 中国安全生产科学研究院 | Major accident mobile monitoring and commanding platform system and working method thereof |
Family Cites Families (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPS5746318U (en) * | 1980-08-28 | 1982-03-15 | ||
| JP2763685B2 (en) * | 1991-02-28 | 1998-06-11 | 株式会社ケンウッド | Emergency vehicle position display device |
| JP3197203B2 (en) * | 1996-01-29 | 2001-08-13 | 三菱重工業株式会社 | Directional sound collector and sound source locator |
| JPH11306494A (en) * | 1998-04-15 | 1999-11-05 | Matsushita Electric Ind Co Ltd | Approach information system |
| JP2002319091A (en) | 2001-04-20 | 2002-10-31 | Fuji Heavy Ind Ltd | Device for recognizing following vehicle |
| US20040226079A1 (en) * | 2002-08-09 | 2004-11-18 | Rainey Margaret A. | Helmet having audio features |
| US8001623B2 (en) * | 2005-05-26 | 2011-08-23 | Gertsch Jeffrey H | Electronic helmet |
| EP1727131A2 (en) * | 2005-05-26 | 2006-11-29 | Yamaha Hatsudoki Kabushiki Kaisha | Noise cancellation helmet, motor vehicle system including the noise cancellation helmet and method of canceling noise in helmet |
| JP4459144B2 (en) * | 2005-09-26 | 2010-04-28 | アルパイン株式会社 | Image display device for vehicle |
| US8010171B2 (en) * | 2006-09-01 | 2011-08-30 | Pinnacle Peak Holding Corporation | Wireless portable radio vehicle communication system |
| GB0703192D0 (en) | 2007-02-19 | 2007-03-28 | White Jason | Road traffic monitoring system |
| US8692886B2 (en) * | 2007-10-31 | 2014-04-08 | Timothy James Ennis | Multidirectional video capture assembly |
| JP2009211397A (en) * | 2008-03-04 | 2009-09-17 | Toyota Infotechnology Center Co Ltd | Radio communication method and vehicle communication system |
| US20120076317A1 (en) * | 2010-09-23 | 2012-03-29 | Lsi Corporation | Media player system with anti-voice operated switch |
| US8995670B2 (en) * | 2011-04-29 | 2015-03-31 | Dell Products L.P. | Systems and methods for local and remote recording, monitoring, control and/or analysis of sounds generated in information handling system environments |
| US9064152B2 (en) * | 2011-12-01 | 2015-06-23 | Elwha Llc | Vehicular threat detection based on image analysis |
-
2012
- 2012-09-10 US US13/608,722 patent/US9417838B2/en active Active
-
2013
- 2013-09-06 JP JP2015531232A patent/JP6389179B2/en active Active
- 2013-09-06 WO PCT/US2013/058486 patent/WO2014039805A1/en unknown
- 2013-09-06 CN CN201380047098.XA patent/CN104620259B/en active Active
- 2013-09-06 EP EP13773889.4A patent/EP2893488B1/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101753743A (en) * | 2009-12-23 | 2010-06-23 | 中国安全生产科学研究院 | Major accident mobile monitoring and commanding platform system and working method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| EP2893488A1 (en) | 2015-07-15 |
| CN104620259A (en) | 2015-05-13 |
| WO2014039805A1 (en) | 2014-03-13 |
| US9417838B2 (en) | 2016-08-16 |
| EP2893488B1 (en) | 2020-10-28 |
| JP2015535972A (en) | 2015-12-17 |
| JP6389179B2 (en) | 2018-09-12 |
| US20140071280A1 (en) | 2014-03-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104620259B (en) | Use the Vehicle security system of audio/visual clue | |
| US9870764B2 (en) | Using external sounds to alert vehicle occupants of external events and mask in-car conversations | |
| US10078966B2 (en) | Warning method outside vehicle, driver assistance apparatus for executing method thereof and vehicle having the same | |
| US9247779B1 (en) | Enhanced global positioning system (GPS) based functionality for helmets | |
| US10219571B1 (en) | In helmet sensors providing blind spot awareness | |
| US20170309149A1 (en) | A portable alerting system and a method thereof | |
| KR102134583B1 (en) | Image-processing Apparatus for Car and Method of Providing Information Using The Same | |
| US20160251081A1 (en) | Apparatus and method employing autonomous vehicles to reduce risk | |
| JP2014232411A (en) | Portable terminal, and danger notification system | |
| WO2009093726A1 (en) | Dangerous drive preventive intention judgment system and dangerous drive preventive intention judgment method | |
| US9571057B2 (en) | Altering audio signals | |
| US11812245B2 (en) | Method, apparatus, and computer-readable storage medium for providing three-dimensional stereo sound | |
| KR101423396B1 (en) | Multipurpose smart safety guidance system on crosswalk | |
| JP2016164793A (en) | Portable terminal | |
| JP2015138534A (en) | Electronic device | |
| US20170270782A1 (en) | Event detecting method and electronic system applying the event detecting method and related accessory | |
| CN111147738A (en) | Police vehicle-mounted panoramic and coma system, device, electronic equipment and medium | |
| KR20230025738A (en) | Detecting objects within a vehicle | |
| JP2020030769A (en) | Information processing device, information processing method, and program | |
| TWI501759B (en) | Movie-record analyzing and navigating system for blind people | |
| KR102255429B1 (en) | Image-processing Apparatus for Car and Method of Providing Information Using The Same | |
| JP2017126892A (en) | Electronic apparatus | |
| JP2022101447A (en) | System and the like | |
| KR20230059681A (en) | Accessibility system for assisting a user in interacting with a vehicle | |
| WO2015111264A1 (en) | Electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |