CN110065439A - A kind of car interactive system - Google Patents

A kind of car interactive system Download PDF

Info

Publication number
CN110065439A
CN110065439A CN201910359309.2A CN201910359309A CN110065439A CN 110065439 A CN110065439 A CN 110065439A CN 201910359309 A CN201910359309 A CN 201910359309A CN 110065439 A CN110065439 A CN 110065439A
Authority
CN
China
Prior art keywords
module
back seat
vehicle
camera
driver
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910359309.2A
Other languages
Chinese (zh)
Inventor
王昊
王智琨
F·库巴特
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mercedes Benz Group AG
Original Assignee
DaimlerChrysler AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by DaimlerChrysler AG filed Critical DaimlerChrysler AG
Priority to CN201910359309.2A priority Critical patent/CN110065439A/en
Publication of CN110065439A publication Critical patent/CN110065439A/en
Pending legal-status Critical Current

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8006Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring and displaying scenes of vehicle interior, e.g. for monitoring passengers or cargo
    • B60R2300/8013Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring and displaying scenes of vehicle interior, e.g. for monitoring passengers or cargo for child monitoring
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command

Abstract

The present invention relates to automobile technical fields, disclose a kind of interior interactive system, which includes: camera, display module, vehicle-mounted voice identification module, vehicle-carrying communication module and microphone module.The invention also discloses a kind of interior exchange methods.Technical solution of the present invention easily observes back seat situation convenient for driver safety.

Description

A kind of car interactive system
Technical field
The present invention relates to automobile technical fields, specifically, being related to a kind of interior interactive system.
Background technique
In running car, for driver it sometimes appear that respectant situation of turning one's head, this is a kind of driving behavior of danger, It is easy to cause traffic accident.For example, provide that children must be sitting in automobile rear in 12 years old or less according to China traffic law, So when they, which sit in the back row, cries and shout, it will turn one's head as driver father, mother and watch child situation;In addition, driving The person of sailing understands not timing observation child either with or without unlocking safety belt or leave safety seat.For another example, when several friends drive together When automobile is gone out, the passenger of heel row, which has a joke, to laugh and frolick, and driver extremely wants to participate, the participation of turning one's head that will can't help Wherein.In another scene, when car owner is outgoing with pet and pet is on back seat, driver is in the presence of the sight that can turn one's head The case where seeing pet.In above situation driver turn one's head it is respectant movement be all easy to cause traffic accident.
In addition, after switch-off leaves automobile, child, pet but pass into silence in the car driver sometimes.Exist for a long time Child, pet easily suffocate and die in closed environment.
In addition, more and more families buy 7 or more automobiles since China has decontroled two tire policies.Because last One row's seat distance front-seat (for example, driver) is too far, and car, which is linked up, becomes more and more difficult.Passenger of last row must be with Very high sound can just speak with driver, this will affect other passengers.
In order to solve problem above, it is furnished with reflective mirror in current automobile, it can be by the interior heel row situation of observation.But driver It needs to come back and looks up, diverts sb.'s attention, and be limited to the angle of reflective mirror, usually can only see some position of heel row, or Person can not be observed because children, pet are too small by rearview mirror.Simultaneously when child, pet are locked in car, vapour at present Vehicle cannot automatically contact driver, especially without any operation.And current automobile is not equipped with dialogue system System so that rear passenger can active and driver dialogue.
Summary of the invention
In order to overcome the above technical problems, convenient convenient for driver safety the present invention provides a kind of interior interactive system Observe back seat situation in ground.
To achieve the goals above, the present invention provides a kind of interior interactive systems, comprising:
Camera, display module, vehicle-mounted voice identification module, vehicle-carrying communication module and microphone module;
The camera is for shooting back seat situation;
The vehicle-mounted voice identification module back seat user issues for identification specific sound and driver are looked into See instruction;
The microphone module integrates in the stereo set of seat each in the car;The display module is used in the vehicle Carry speech recognition module identify the specific sound or it is described check instruction in the case where show camera shooting after Arrange seat conditions, and display back seat graphical interfaces, and in the graphical interfaces to open microphone module after Row's seat is prompted;
The vehicle-carrying communication module is used to the back seat situation that the camera is shot being sent to mobile terminal;
Wherein the interior interactive system is also receiving the driver to the rear row seat for opening microphone module In the case where the confirmation operation of chair, connects the stereo set of the back seat for opening microphone module and close other heel row The microphone module and stereo set of seat.
In a kind of optional embodiment of the invention, the camera is located at front windshield top or inside roof lining Front end.
In a kind of optional embodiment of the invention, the display module includes:
Display screen positioned at meter panel of motor vehicle, the new line positioned at front windshield show HUD.
In a kind of optional embodiment of the invention, the specific sound that the user issues includes:
The cry of animal, the crying of children, children voice.
The present invention also provides a kind of interior exchange methods, comprising:
Shoot back seat situation;
The specific sound and driver that identification back seat user issues check instruction;
Identify that the specific sound or described check show institute in the case where instruction in the vehicle-mounted voice identification module The back seat situation of camera shooting, and the graphical interfaces of display back seat are stated, and split in the graphical interfaces The back seat for opening microphone module is prompted, wherein the microphone module integrates the stereo set of seat each in the car In;
The back seat situation that the camera is shot is sent to mobile terminal;And
In the case where receiving confirmation operation of the driver to the back seat for opening microphone module, connect Lead to the stereo set of the back seat for opening microphone module and closes the microphone module and sound equipment of other back seats Equipment.
In a kind of optional embodiment of the invention, the specific sound that the user issues includes:
The cry of animal, the crying of children, children voice.
It is of the present invention car interactive system, the system include: camera, display module, vehicle-mounted voice identification module, Vehicle-carrying communication module;Camera is for shooting back seat situation;Back seat uses vehicle-mounted voice identification module for identification The specific sound that person issues;Display module in the case where the vehicle-mounted voice identification module identifies specific sound for showing The back seat situation of camera shooting;Vehicle-carrying communication module is for the back seat situation that the camera is shot to be sent to Mobile terminal.Technical solution of the present invention makes driver safety easily observe back seat situation, is identified by vehicle-mounted voice Module controls the display of interior heel row image, mentions driver it is easily observed that the case where heel row, in the case where not turning one's head Traffic safety is risen.And it is issued in technical solution of the present invention when vehicle-mounted voice identification module recognizes back seat user Uncomfortable sound or when calling for help, also actively carries out call to driver by vehicle-carrying communication module, so as in time to driving The person of sailing notifies emergency.
Detailed description of the invention
Fig. 1 is the system block diagram of interior interactive system of the present invention;
Fig. 2 is the schematic diagram that position is arranged in camera of the present invention;
Fig. 3 is the schematic diagram that position is arranged in display module of the present invention;
Fig. 4 is the schematic diagram that position is arranged in microphone module of the present invention;
Fig. 5 is the schematic diagram of display module of the present invention.
Fig. 6 is the flow chart of the method for the invention.
Specific embodiment
Below with reference to the accompanying drawings illustrate the embodiment of the present invention.It is retouched in an attached drawing of the invention or a kind of embodiment The elements and features stated can be combined with elements and features shown in one or more other drawings or embodiments.It answers When note that for purposes of clarity, being omitted known to unrelated to the invention, those of ordinary skill in the art in attached drawing and explanation Component or processing expression and description.
The embodiment of the invention provides a kind of interior interactive systems, as shown in Figure 1, the system includes:
Camera 11, display module 12, vehicle-mounted voice identification module 13, vehicle-carrying communication module 14 and microphone module 15.
Camera 11 is used to shoot interior back seat situation.
The specific sound that back seat user issues for identification of vehicle-mounted voice identification module 13.
Display module 12 is for showing camera 11 in the case where vehicle-mounted voice identification module 13 identifies specific sound The back seat situation of shooting.
Vehicle-carrying communication module 14 is used to the back seat situation that camera 11 is shot being sent to mobile terminal.
In the integrated stereo set of seat in the car of microphone module 15.
Further, vehicle-mounted voice identification module 13 is also used to identify that driver's checks instruction.Display module 12 is also used The back seat situation that the shooting of camera 11 is shown in the case where instruction is checked in identifying in vehicle-mounted voice identification module 13.
As shown in Fig. 2, camera 11 can be set in front windshield top (camera position 1) or inside roof lining front end (camera position 2).Camera is convenient for omnidirectional shooting entirely interior heel row situation when being located at roof, driver is given to provide full side The picture images in face.
The case where 11 captured in real-time of camera, the passenger for recording back seat, pet, children.And there is infrared night vision The camera of function can also be clearly captured at night.
As shown in figure 3, display module 12 can be the display screen positioned at meter panel of motor vehicle, or positioned at front windshield Come back display (head up display, HUD).
The output end of camera 11 is connected with display module 12, and the data such as picture, image are transferred to display module 12.Tool Body, it can be shown in the display screen of meter panel of motor vehicle, or front windshield is projected to by HUD.Image under normal conditions It is present in backstage, will not be shown on display module 12, not influence display screen and the use of HUD, driver will not be interfered Driving.When driver is in driving procedure, vehicle-mounted voice identification module 13 can identify the spy that back seat user issues Determine sound, --- the emotionality sound of such as children, laugh, crying, " father ", " mother " sound, the cry of pet.When When vehicle-mounted voice identification module 13 identifies these sound, display module 12 shows the back seat situation of the shooting of camera 11 simultaneously Corresponding sound is also played back, while suspending advertisement being played on, music etc..Driver can also be in driving procedure Active observation back seat situation, driver checks that instruction, such as driver are said to the sending of vehicle-mounted voice identification module 13 at this time: " I will see heel row video ".Correspondingly, display module 12 starts to show the back seat situation that camera 11 is shot.
Vehicle-carrying communication module 14 specifically can be the module with mobile communication function, such as gsm module.In automobile It sets the mobile terminal that SIM cards of mobile phones makes vehicle with driver --- such as mobile phone --- to be connected, while can also be with other families The mobile phone of front yard user is connected.Even if kinsfolk is not in the car, it can also be seen that may be used also when necessary the case where child, pet To phone automobile, start help function to help child.In addition, can also be photo and view by vehicle-carrying communication module 14 Frequency division is enjoyed to network social intercourse media, such as wechat, microblogging, Facebook etc..When driver leaves vehicle and children, pet leave In the case where in the car, vehicle-mounted voice identification module 13 can detecte identification their sound, such as crying, cry etc..When When recognizing these sound, vehicle-carrying communication module 14 can be warned with the mobile phone of active call driver or other kinsfolks It accuses, people is reminded to return as early as possible.
As shown in figure 4, in the integrated stereo set of seat in the car of microphone module 15.Such design method avoids It is individually for microphone and finds installation site, also avoid rewiring.When the passenger of back seat has demand, it can be passed through Microphone module 15 and driver beside seat are linked up.The volume of each region stereo set of the adjustable car of driver, keeps away Interruption-free other people.
Also, display module can also show the graphical interfaces of back seat, and to unlatching microphone in graphical interfaces The back seat of module 15 carries out prompt and shows, consequently facilitating driver's observation and operation.Interior interactive system can be received and be driven Confirmation operation of the person of sailing to the back seat for opening microphone module 15, hereafter interior interactive system, which is connected, opens microphone module The stereo set of 15 back seat and the microphone module 15 and stereo set for closing other back seats.
For example, for three-box car, there are six seat portions altogether.Display module 12 can show figure circle of seat Face, as shown in Figure 5.When the left seat microphone module 15 at third row seat is opened, display module 12 carries out prompt and shows, such as Loudspeaker icon shown in fig. 5.The diagram shows that the passenger on the left of third row seat just converses with driver.If display module 12 It is touching display screen, then driver can click in the region at the left seat that third arranges seat, to connect the region Stereo set, open and passenger call.In talkthrough, interior interactive system can close the wheat of other back seats Gram wind module and stereo set.In addition, driver can also activate this region and be conversed by vehicle-mounted voice identification module 13, Such as driver it could be said that " with third arrange left side call ", thus connect third row left side stereo set.
The embodiment of the invention provides a kind of interior interactive system, camera, display module, vehicle-mounted voice identification module, Vehicle-carrying communication module;Camera is for shooting back seat situation, and back seat uses vehicle-mounted voice identification module for identification The specific sound that person issues;Display module is for showing camera shooting in the case where vehicle-mounted voice identification module identifies specific sound The back seat situation of head shooting;Vehicle-carrying communication module is used to for the back seat situation that camera is shot being sent to mobile whole End.The technical solution of the embodiment of the present invention makes driver without later observing, and without display module is paid close attention to always, is only needing It wants Shi Caihui safely and conveniently to observe back seat situation by display module, improves traffic safety.Known by vehicle-mounted voice Not come the display for controlling interior heel row image, make driver in the case where not turning one's head it is easily observed that the case where heel row.This hair The technical solution of bright embodiment also provides vehicle-carrying communication module, when back seat user is by car locking or the sending sound that do not feel good When sound, call actively is carried out to driver, driver is reminded to return as early as possible, and can also be incited somebody to action by vehicle-carrying communication module Picture, video sharing to network social intercourse media.In addition, by the integrated stereo set existing in the car of microphone in the embodiment of the present invention In, link up back seat user with driver, driver can observe communication request, and root by display module According to the volume situation for the sound equipment for needing to adjust interior each region, there is conveniently interaction effect and control effect.
The embodiment of the invention provides a kind of interior exchange methods, as shown in fig. 6, this method comprises: step S601, S602, S603, S604 and S605.
In S601, back seat situation is shot;
In S602, the specific sound and driver that identification back seat user issues check instruction;
In S603, camera is shown in the case where vehicle-mounted voice identification module identifies specific sound or checks instruction The back seat situation of shooting, and the graphical interfaces of display back seat, and to unlatching microphone module in graphical interfaces Back seat prompted, wherein microphone module integrate seat each in the car stereo set in;
In S604, the back seat situation that camera is shot is sent to mobile terminal;And
In S605, in the case where receiving confirmation operation of the driver to the back seat for opening microphone module, It connects the stereo set for opening the back seat of microphone module and closes the microphone module of other back seats and sound equipment is set It is standby.
In a kind of optional embodiment, the specific sound that user issues includes: that the cry of animal, children cry and shout Sound, children voice.
Although the present invention and its advantage has been described in detail it should be appreciated that without departing from by the attached claims Defined by can carry out various changes, substitution and transformation in the case where the spirit and scope of the present invention.Moreover, the model of the application Enclose the specific embodiment for being not limited only to process, equipment described in specification, means, method and steps.In the art is common Technical staff is from the disclosure it will be readily understood that execution and corresponding reality described herein can be used according to the present invention Apply the essentially identical function of example or process that obtain the result essentially identical with it, that existing and future is to be developed, equipment, Means, method or step.Therefore, the attached claims are intended in the range of them include such process, equipment, hand Section, method or step.

Claims (6)

1. a kind of car interactive system characterized by comprising
Camera, display module, vehicle-mounted voice identification module, vehicle-carrying communication module and microphone module;
The camera is for shooting back seat situation;
The vehicle-mounted voice identification module back seat user issues for identification specific sound and driver check finger It enables;
The microphone module integrates in the stereo set of seat each in the car;The display module is used in the vehicle-mounted language Sound identification module identify the specific sound or it is described check instruction in the case where show the rear row seat of camera shooting Chair situation, and the graphical interfaces of display back seat, and to the rear row seat for opening microphone module in the graphical interfaces Chair is prompted;
The vehicle-carrying communication module is used to the back seat situation that the camera is shot being sent to mobile terminal;
Wherein the interior interactive system is also receiving the driver to the back seat for opening microphone module In the case where confirmation operation, connects the stereo set of the back seat for opening microphone module and close other back seats Microphone module and stereo set.
2. car interactive system according to claim 1, which is characterized in that the camera is located at front windshield top Or inside roof lining front end.
3. car interactive system according to claim 2, which is characterized in that the display module includes:
Display screen positioned at meter panel of motor vehicle, the new line positioned at front windshield show HUD.
4. car interactive system according to any one of claim 1-3, which is characterized in that the spy that the user issues Determining sound includes:
The cry of animal, the crying of children, children voice.
5. a kind of car exchange method, characterized by comprising:
Shoot back seat situation;
The specific sound and driver that identification back seat user issues check instruction;
Identify that the specific sound or described check are taken the photograph described in display in the case where instruction in the vehicle-mounted voice identification module As the back seat situation that head is shot, and the graphical interfaces of display back seat, and to unlatching wheat in the graphical interfaces The back seat of gram wind module is prompted, wherein the microphone module integrates in the stereo set of seat each in the car;
The back seat situation that the camera is shot is sent to mobile terminal;And
In the case where receiving confirmation operation of the driver to the back seat for opening microphone module, institute is connected State the microphone module and stereo set opened the stereo set of the back seat of microphone module and close other back seats.
6. car interactive system according to claim 5, which is characterized in that the specific sound packet that the user issues It includes:
The cry of animal, the crying of children, children voice.
CN201910359309.2A 2019-04-30 2019-04-30 A kind of car interactive system Pending CN110065439A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910359309.2A CN110065439A (en) 2019-04-30 2019-04-30 A kind of car interactive system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910359309.2A CN110065439A (en) 2019-04-30 2019-04-30 A kind of car interactive system

Publications (1)

Publication Number Publication Date
CN110065439A true CN110065439A (en) 2019-07-30

Family

ID=67369761

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910359309.2A Pending CN110065439A (en) 2019-04-30 2019-04-30 A kind of car interactive system

Country Status (1)

Country Link
CN (1) CN110065439A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111645613A (en) * 2020-05-20 2020-09-11 摩登汽车(盐城)有限公司 Automobile rear row monitoring device and control method thereof
CN112078517A (en) * 2020-09-02 2020-12-15 中国第一汽车股份有限公司 Safety monitoring method and device for safety seat, computer equipment and storage medium
CN112150786A (en) * 2020-09-25 2020-12-29 北京百度网讯科技有限公司 Method, apparatus, vehicle, electronic device, and medium for controlling vehicle
CN115473987A (en) * 2022-06-20 2022-12-13 北京罗克维尔斯科技有限公司 Interaction method, interaction device, electronic equipment and storage medium

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111645613A (en) * 2020-05-20 2020-09-11 摩登汽车(盐城)有限公司 Automobile rear row monitoring device and control method thereof
CN111645613B (en) * 2020-05-20 2021-08-31 摩登汽车(盐城)有限公司 Automobile rear row monitoring device and control method thereof
CN112078517A (en) * 2020-09-02 2020-12-15 中国第一汽车股份有限公司 Safety monitoring method and device for safety seat, computer equipment and storage medium
CN112150786A (en) * 2020-09-25 2020-12-29 北京百度网讯科技有限公司 Method, apparatus, vehicle, electronic device, and medium for controlling vehicle
CN112150786B (en) * 2020-09-25 2021-12-03 阿波罗智联(北京)科技有限公司 Method, apparatus, vehicle, electronic device, and medium for controlling vehicle
CN115473987A (en) * 2022-06-20 2022-12-13 北京罗克维尔斯科技有限公司 Interaction method, interaction device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN110065439A (en) A kind of car interactive system
CN104816694B (en) One kind is driven condition intelligent adjusting apparatus and method
US20200310528A1 (en) Vehicle system for providing driver feedback in response to an occupant's emotion
CN111163974B (en) Display system and method for vehicle
CN205720871U (en) A kind of intelligence head-up-display system
CN105527710A (en) Intelligent head-up display system
CN106251870A (en) The method identifying the linguistic context of Voice command, the method obtaining the audio controls of Voice command and the equipment of enforcement the method
CN106043150A (en) Vehicle-mounted projection system with speech recognition function
JP2014106329A (en) Text reading device
US10666901B1 (en) System for soothing an occupant in a vehicle
US20200108720A1 (en) Agent system, agent control method, and storage medium
CN111016824B (en) Communication support system, communication support method, and storage medium
CN108334871A (en) The exchange method and system of head-up display device based on intelligent cockpit platform
CN210047411U (en) Vehicle-mounted entertainment system based on age bracket
CN114422980A (en) Method and system for protecting user privacy on automobile
US11489954B2 (en) Vehicular electronic device and operation method thereof
CN108170056A (en) A kind of interaction drive robot and its control method
JP2004354930A (en) Speech recognition system
CN202615313U (en) Vehicle-mounted recognition control system
CN111813491B (en) Vehicle-mounted assistant anthropomorphic interaction method and device and automobile
CN206077427U (en) 360 degree of panoramas on a kind of automobile are taken pictures and preserve sharing apparatus
CN112437246B (en) Video conference method based on intelligent cabin and intelligent cabin
CN213199619U (en) Vehicle rear seat network interconnection device
JP2003054323A (en) On-vehicle visual telephone device
CN112738447B (en) Video conference method based on intelligent cabin and intelligent cabin

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20190730

WD01 Invention patent application deemed withdrawn after publication