CN115352361A - Partition window dialogue method and device for vehicle and vehicle - Google Patents
Partition window dialogue method and device for vehicle and vehicle Download PDFInfo
- Publication number
- CN115352361A CN115352361A CN202211017989.8A CN202211017989A CN115352361A CN 115352361 A CN115352361 A CN 115352361A CN 202211017989 A CN202211017989 A CN 202211017989A CN 115352361 A CN115352361 A CN 115352361A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- outside
- personnel
- window
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000005192 partition Methods 0.000 title claims abstract description 60
- 238000000034 method Methods 0.000 title claims abstract description 48
- 230000003993 interaction Effects 0.000 claims abstract description 127
- 108091006146 Channels Proteins 0.000 claims abstract description 126
- 238000000926 separation method Methods 0.000 claims abstract description 7
- 238000012216 screening Methods 0.000 claims description 13
- 230000007246 mechanism Effects 0.000 claims description 7
- 125000006850 spacer group Chemical group 0.000 claims description 5
- 238000001514 detection method Methods 0.000 claims description 4
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 claims description 4
- 230000011218 segmentation Effects 0.000 claims description 4
- 238000004364 calculation method Methods 0.000 claims description 3
- 238000004891 communication Methods 0.000 description 15
- 230000006870 function Effects 0.000 description 8
- 230000008569 process Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000002452 interceptive effect Effects 0.000 description 3
- 238000004590 computer program Methods 0.000 description 2
- 238000002955 isolation Methods 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 238000000638 solvent extraction Methods 0.000 description 2
- 208000027418 Wounds and injury Diseases 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000006378 damage Effects 0.000 description 1
- 208000014674 injury Diseases 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q5/00—Arrangement or adaptation of acoustic signal devices
- B60Q5/005—Arrangement or adaptation of acoustic signal devices automatically actuated
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
- B60R16/023—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/332—Query formulation
- G06F16/3329—Natural language query formulation or dialogue systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/3331—Query processing
- G06F16/334—Query execution
- G06F16/3343—Query execution using phonetics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/194—Calculation of difference between files
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/20—Natural language analysis
- G06F40/279—Recognition of textual entities
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- General Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Artificial Intelligence (AREA)
- General Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Health & Medical Sciences (AREA)
- Mathematical Physics (AREA)
- Multimedia (AREA)
- Databases & Information Systems (AREA)
- Acoustics & Sound (AREA)
- Data Mining & Analysis (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a vehicle partition window dialogue method and device and a vehicle. The vehicle partition window dialogue method includes: acquiring basic information of personnel outside the vehicle; acquiring basic information of personnel in a vehicle; and judging whether a conversation channel interaction signal needs to be generated or not according to the basic information of the personnel outside the vehicle and/or the basic information of the personnel inside the vehicle, if so, generating the conversation channel interaction signal and transmitting the conversation channel interaction signal to a window separation interaction component inside the vehicle, so that the personnel outside the vehicle and the personnel inside the vehicle can interact through the window separation interaction component. By the vehicle partition window conversation method, people inside the vehicle and people outside the vehicle can have a conversation under the condition that the vehicle window is not opened, and voices are transmitted through the partition window clearly and accurately, so that the people inside the vehicle and the people outside the vehicle can communicate effectively.
Description
Technical Field
The present application relates to the field of vehicle window partition dialogue technologies, and in particular, to a vehicle window partition dialogue method, a vehicle window partition dialogue device, and a vehicle.
Background
In the process of vehicle driving, there are many scenes that need the communication between the vehicle interior and the vehicle exterior, for example, the communication with the toll collector (including paying parking fee, high-speed fee, etc.) is needed when the vehicle pays, the communication with the vehicle exterior is needed under certain conditions (for example, taking a car, asking for a way, asking for a price, etc.), if the vehicle interior needs to communicate with the vehicle exterior, the vehicle interior and the vehicle exterior usually adopt a window opening mode to realize the communication between the vehicle interior and the vehicle exterior, and this mode has some dangerous situations unsuitable for window opening conversation, for example, the situation that the vehicle and the vehicle conflict with each other or the vehicle and the pedestrian conflict with each other or the situation that the woman driver needs to ask for a way by driving alone at night is unsuitable for adopting the window opening conversation.
Disclosure of Invention
The present invention aims to solve at least one of the above problems by providing a vehicle window partition dialogue method.
The invention provides the following scheme:
according to one aspect of the present invention, there is provided a vehicle window spacer dialog method comprising:
acquiring basic information of personnel outside the vehicle;
acquiring basic information of personnel in the vehicle;
judging whether a conversation channel interaction signal needs to be generated or not according to the basic information of the personnel outside the vehicle and/or the basic information of the personnel inside the vehicle, if so, judging whether a conversation channel interaction signal needs to be generated or not, and if so, judging whether the conversation channel interaction signal needs to be generated or not
And generating a conversation channel interaction signal and transmitting the conversation channel interaction signal to a partition window interaction component in the vehicle, so that personnel outside the vehicle and personnel in the vehicle can interact through the partition window interaction component.
Optionally, the dialog channel interaction signal includes an outer channel signal, an inner channel signal, and an outer channel signal;
the generating a dialogue channel interaction signal and transmitting the dialogue channel interaction signal to a partition window interaction component in the vehicle so that people outside the vehicle and people in the vehicle can interact through the partition window interaction component comprises:
when the conversation channel interaction signal is an outer channel signal and an inner channel signal, the personnel in the vehicle can acquire the voice information of the personnel outside the vehicle through the partition window interaction assembly; and/or the presence of a gas in the atmosphere,
when the conversation channel interaction signal is an internal channel signal and an external channel signal, the personnel outside the vehicle can acquire the voice information of the personnel inside the vehicle through the partition window interaction assembly.
Optionally, the basic information of the person outside the vehicle includes:
voice information of a person outside the vehicle, position information of the person outside the vehicle, and sight line direction information of the person outside the vehicle;
the basic information of the person in the vehicle includes:
voice information of a person in the vehicle, and line-of-sight direction information of a person in the vehicle.
Optionally, the determining whether the dialog channel interaction signal needs to be generated according to the basic information of the person outside the vehicle and/or the basic information of the person inside the vehicle includes:
judging whether the position information of the personnel outside the vehicle is in a preset range, if so, judging that the position information of the personnel outside the vehicle is in the preset range
Judging whether the sight line direction of the personnel outside the vehicle faces towards the personnel inside the vehicle, if so, judging that a conversation channel interaction signal needs to be generated;
the generating and transmitting the conversation channel interaction signal to a partition window interaction assembly in the vehicle so that people outside the vehicle and people in the vehicle can interact through the partition window interaction assembly comprises:
and generating an outer channel signal and an inner channel signal, so that personnel in the vehicle can acquire the voice information of the personnel outside the vehicle through the partition window interaction assembly.
Optionally, the generating a dialogue channel interaction signal according to the basic information of the person outside the vehicle and/or the basic information of the person inside the vehicle includes:
judging whether the sight line direction of the personnel in the vehicle faces the position of the personnel outside the vehicle, if so, judging that a conversation channel interaction signal needs to be generated;
the generating and transmitting the conversation channel interaction signal to a partition window interaction assembly in the vehicle so that people outside the vehicle and people in the vehicle can interact through the partition window interaction assembly comprises:
and generating inner and outer channel signals, so that personnel outside the vehicle can acquire the voice information of the personnel inside the vehicle through the partition window interaction assembly.
Optionally, the vehicle window partitioning conversation method further includes:
acquiring vehicle speed information;
generating a conversation channel interaction signal according to the basic information of the person outside the vehicle and/or the basic information of the person inside the vehicle further comprises:
judging whether the vehicle moves according to the vehicle speed information, if not, judging whether the vehicle moves
And judging whether the sight line direction of the person in the vehicle faces to the position of the person outside the vehicle.
Optionally, after determining whether the sight line direction of the person outside the vehicle is directed toward the person inside the vehicle, the determining whether the dialog channel interaction signal needs to be generated according to the basic information of the person outside the vehicle and/or the basic information of the person inside the vehicle further includes:
acquiring a preset dangerous word database, wherein the preset dangerous word database comprises at least one preset phrase;
identifying the acquired voice information of the person outside the vehicle, thereby acquiring text information;
performing word segmentation on the acquired text information to acquire text words;
respectively carrying out similarity calculation on the text words and each preset phrase so as to obtain similarity values;
judging whether one similarity value is larger than a threshold value, if so, judging whether the similarity value is larger than the threshold value
And judging that a conversation channel interaction signal does not need to be generated and storing the voice information of the personnel outside the vehicle.
Optionally, after determining that generation of a dialogue channel interaction signal is not required and storing voice information of a person outside the vehicle, the vehicle window screening dialogue method further includes:
and generating a door lock falling signal, and transmitting the door lock falling signal to the lock control mechanism so that the lock control mechanism carries out locking operation according to the door lock falling signal.
The application also provides a vehicle is with separating window dialogue device, includes:
the system comprises an outside-vehicle personnel basic information acquisition module, a remote personnel basic information acquisition module and a remote personnel basic information acquisition module, wherein the outside-vehicle personnel basic information acquisition module is used for acquiring basic information of outside-vehicle personnel;
the system comprises a vehicle personnel basic information acquisition module, a vehicle personnel basic information acquisition module and a vehicle personnel basic information acquisition module, wherein the vehicle personnel basic information acquisition module is used for acquiring basic information of personnel in a vehicle;
and the conversation channel interaction signal judgment module judges whether a conversation channel interaction signal needs to be generated or not according to the basic information of the personnel outside the vehicle and/or the basic information of the personnel inside the vehicle.
And the dialogue channel interaction signal generation module is used for generating a dialogue channel interaction signal when the dialogue channel interaction signal judgment module judges that the dialogue channel interaction signal is positive.
The present application also provides a partition window dialogue system for a vehicle, including:
a vehicle bulkhead dialog device;
the sight line recognition instrument is arranged on the vehicle, is connected with the vehicle partition window dialogue device, and is used for shooting images of people in the vehicle and images of people outside the vehicle, acquiring sight line direction information of the people in the vehicle according to the acquired images of the people in the vehicle, acquiring sight line direction information of the people outside the vehicle according to the acquired images of the people outside the vehicle, and transmitting the acquired sight line direction information of the people in the vehicle and the sight line direction information of the people outside the vehicle to the vehicle partition window dialogue device;
a position detection device mounted on a vehicle and connected to the vehicle bulkhead dialog device, the position detection device being configured to detect position information of a person outside the vehicle and transmit the detected position information of the person outside the vehicle to the vehicle bulkhead dialog device;
the window partition interaction assembly is connected with the window partition device for the vehicle and comprises an in-vehicle microphone, an out-vehicle microphone, an in-vehicle loudspeaker and an out-vehicle loudspeaker; when the vehicle window separating device sends an outer channel signal and an inner channel signal to the window separating interaction assembly, the outer microphone and the inner loudspeaker work in a matched mode, so that personnel in the vehicle can obtain voice information of the personnel outside the vehicle through the window separating interaction assembly; when the vehicle window separating device is used for sending an inner channel signal and an outer channel signal to the window separating interaction assembly, the microphone in the vehicle and the loudspeaker outside the vehicle work in a matched mode, and people outside the vehicle can acquire voice information of people in the vehicle through the window separating interaction assembly.
The vehicle partition window dialogue method has the following advantages:
under the condition of not opening the vehicle window, the manual control of a driver is not needed, the window isolating conversation device is automatically opened by identifying the sight direction information of the person in the vehicle and the person outside the vehicle, and by adopting the mode, the person in the vehicle does not directly contact the person outside the vehicle in a close distance in the same plane, so that the conversation and the communication between the person in the vehicle and the person outside the vehicle are realized; the personal safety of people in the vehicle can be guaranteed under certain specific conditions, for example, when a conflict occurs between vehicles or between vehicles and pedestrians, or when the girl driver drives alone to ask for a way at night, window isolation communication can be carried out in the mode to prevent certain dangerous conditions from occurring.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
FIG. 1 is a schematic flow chart diagram illustrating a vehicle window screening dialogue method according to an embodiment of the present application;
FIG. 2 is a schematic view of a vehicle window screening dialog method according to another embodiment of the present application;
FIG. 3 is a schematic view of a vehicle window screening dialog method according to another embodiment of the present application;
FIG. 4 is a schematic view of a vehicle window screening dialog system according to another embodiment of the present application;
FIG. 5 is a system architecture diagram of an electronic device;
fig. 6 is a schematic view of a vehicle window screening dialogue method according to another embodiment of the present application.
Detailed Description
The technical solutions of the present invention will be described clearly and completely with reference to the accompanying drawings, and it should be understood that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, belong to the protection scope of the present invention.
Fig. 1 is a schematic flow chart of a vehicle window partition dialogue method according to an embodiment of the present application.
The vehicle window partition dialogue method shown in fig. 1 includes:
step 1: acquiring basic information of personnel outside the vehicle;
and 2, step: acquiring basic information of personnel in the vehicle;
and step 3: judging whether a dialogue channel interaction signal needs to be generated or not according to the basic information of the personnel outside the vehicle and/or the basic information of the personnel inside the vehicle;
and 4, step 4: and generating a conversation channel interaction signal and transmitting the conversation channel interaction signal to a partition window interaction component in the vehicle, so that personnel outside the vehicle and personnel in the vehicle can interact through the partition window interaction component.
The vehicle partition window dialogue method has the following advantages:
under the condition of not opening the vehicle window, the manual control of a driver is not needed, the isolating window conversation device is automatically opened by identifying the sight direction information of the person in the vehicle and the person outside the vehicle, and by adopting the mode, the person in the vehicle does not directly contact the person outside the vehicle in a close distance on the surface, so that the conversation and the communication between the person in the vehicle and the person outside the vehicle are realized; the personal safety of people in the vehicle can be guaranteed under certain specific conditions, for example, when a conflict occurs between vehicles or between vehicles and pedestrians, or a woman driver drives alone at night and needs to ask for a way, the window isolation communication can be carried out in the mode, and certain dangerous conditions are prevented.
In this embodiment, the interactive dialog channel signals include an outer channel signal, an inner channel signal, and an outer channel signal;
when the conversation channel interaction signal is an outer channel signal and an inner channel signal, personnel in the vehicle can acquire voice information of personnel outside the vehicle through the partition window interaction assembly; and/or the presence of a gas in the atmosphere,
when the conversation channel interaction signal is an internal channel signal and an external channel signal, personnel outside the vehicle can acquire the voice information of the personnel inside the vehicle through the partition window interaction assembly.
For example, if only a person outside the vehicle is motivated to communicate with a person inside the vehicle, only the inside-outside channel signal may be generated; if a person in the vehicle is motivated to communicate with a person outside the vehicle, only the inner and outer channel signals may be generated.
In this embodiment, the basic information of the person outside the vehicle includes:
voice information of a person outside the vehicle, position information of the person outside the vehicle, and sight line direction information of the person outside the vehicle.
In this embodiment, the voice information of the person outside the vehicle includes the voice transmitted to the person inside the vehicle by the method of the present application, and may also include other voice information picked up by the sound pickup device of the present application.
The basic information of the person in the vehicle includes:
voice information of a person in the vehicle, and line-of-sight direction information of a person in the vehicle.
In this embodiment, the voice information of the person inside the vehicle includes the voice transmitted to the person outside the vehicle by the method of the present application, and may also include other voice information picked up by the sound pickup device of the present application.
In this embodiment, determining whether the dialog channel interaction signal needs to be generated according to the basic information of the person outside the vehicle and/or the basic information of the person inside the vehicle includes:
judging whether the position information of the personnel outside the vehicle is in a preset range, if so, judging whether the position information of the personnel outside the vehicle is in the preset range
Judging whether the sight line direction of the personnel outside the vehicle faces towards the personnel inside the vehicle, if so, judging that a conversation channel interaction signal needs to be generated;
and generating an outer channel interaction signal and an inner channel interaction signal, and transmitting the outer channel interaction signal and the inner channel interaction signal to a window interaction assembly in the vehicle, so that personnel in the vehicle can acquire the voice information of the personnel outside the vehicle through the window interaction assembly.
In this embodiment, generating the dialogue channel interaction signal according to the basic information of the person outside the vehicle and/or the basic information of the person inside the vehicle includes:
judging whether the sight line direction of the personnel in the vehicle faces the position of the personnel outside the vehicle, if so, judging that a conversation channel interaction signal needs to be generated;
and generating an internal and external channel interaction signal, and transmitting the internal and external channel interaction signal to a window separation interaction assembly in the vehicle, so that personnel outside the vehicle can acquire the voice information of the personnel in the vehicle through the window separation interaction assembly.
In this embodiment, generating the conversation channel interaction signal according to the basic information of the person outside the vehicle and/or the basic information of the person inside the vehicle further includes:
acquiring vehicle speed information;
judging whether the vehicle moves according to the vehicle speed information, if not, judging whether the vehicle moves
It is determined whether the line of sight direction of the person in the vehicle is directed toward the position of the person outside the vehicle.
In this embodiment, after determining whether the sight line direction of the person outside the vehicle is directed toward the person inside the vehicle, determining whether the dialog channel interaction signal needs to be generated according to the basic information of the person outside the vehicle and/or the basic information of the person inside the vehicle further includes:
acquiring a preset dangerous word database, wherein the preset dangerous word database comprises at least one preset phrase;
identifying the acquired voice information of the person outside the vehicle, thereby acquiring text information;
performing word segmentation on the acquired text information to acquire text words;
respectively carrying out similarity calculation on the text words and each preset phrase so as to obtain similarity values;
judging whether one similarity value is larger than a threshold value, if so, judging whether the similarity value is larger than the threshold value
And judging that the generation of a conversation channel interaction signal is not needed and storing the voice information of the personnel outside the vehicle.
In this embodiment, after determining that it is not necessary to generate a dialogue channel interaction signal and store voice information of a person outside the vehicle, the vehicle window partition dialogue method further includes:
and generating a door lock falling signal, and transmitting the door lock falling signal to the lock control mechanism so that the lock control mechanism performs a lock operation according to the door lock falling signal.
The present embodiment also provides a partition dialog device for a vehicle, including:
the basic information acquisition module of the personnel outside the vehicle is used for acquiring the basic information of the personnel outside the vehicle;
the vehicle personnel basic information acquisition module is used for acquiring basic information of personnel in the vehicle;
the conversation channel interactive signal judging module is used for judging whether a conversation channel interactive signal needs to be generated or not according to the basic information of the personnel outside the vehicle and/or the basic information of the personnel inside the vehicle.
And the conversation channel interaction signal generation module is used for generating a conversation channel interaction signal according to the judgment result of the conversation channel interaction signal judgment module.
It should be noted that, although the system only discloses basic function modules such as the vehicle external personnel basic information acquisition module, the vehicle internal personnel basic information acquisition module, the dialogue channel interaction signal judgment module, the dialogue channel interaction signal generation module, etc., the device is not limited to the above basic function modules, and the invention is to be expressed in that, on the basis of the above basic function modules, one or more function modules may be arbitrarily added by those skilled in the art to form an infinite number of embodiments or technical solutions, that is, the system is open rather than closed, and the protection scope of the invention claims is not considered to be limited to the above disclosed basic function modules because the present embodiment only discloses individual basic function modules.
The present application is described in further detail below by way of examples, it being understood that the examples do not constitute any limitation to the present application.
Referring to fig. 2, fig. 2 shows a schematic view of a vehicle window partition dialogue method according to another embodiment of the present application, which may specifically include the following steps:
step 1: acquiring voice information of personnel outside a vehicle, specifically, in the embodiment, acquiring position information of the personnel outside the vehicle in a sound source positioning mode, referring to fig. 2, it can be seen from fig. 2 that the personnel may appear at different positions of the vehicle, but the interaction between the personnel in front of the vehicle and the personnel inside the vehicle is mainly considered in the present application, in the embodiment, the voice information of the personnel outside the vehicle is acquired simultaneously through a plurality of microphones of a microphone array installed outside the vehicle, and the sending position of a sound source signal of the personnel outside the vehicle is acquired by utilizing signal phase differences among the plurality of microphones;
step 2: judging whether the sound source position information of personnel outside the vehicle is within a preset distance range, wherein the preset distance range comprises that the sound source needs to be within 3 meters from the vehicle, and the angle needs to be between +15 degrees and +165 degrees;
and 3, step 3: capturing image information of personnel outside the vehicle through a camera inside the vehicle according to voice information and position information of the personnel within a preset range, and extracting sight line direction information of the personnel outside the vehicle from the image information;
and 4, step 4: based on a sight line identification technology, acquiring a sight point of the person outside the vehicle, judging whether the position of the sight point extending to a preset range along a sight line direction is in the same range as the position of the person inside the vehicle, and if so, determining that the sight line watching direction of the person outside the vehicle faces the person inside the vehicle;
and 5: if the sight line viewing direction of the person outside the vehicle faces the person inside the vehicle, the person outside the vehicle is judged to need to generate an outer channel signal and an inner channel signal, and therefore the person inside the vehicle can obtain the voice information of the person outside the vehicle.
In another embodiment, the vehicle window screening dialogue method of the present application further includes:
step 1: after voice information of a person outside the vehicle is acquired, generating text information from the voice information, and performing word segmentation processing on the text information to acquire text words, for example, the voice information of the person outside the vehicle is that whether you are looking for X, and the text information is segmented into four text words of "you", "whether you are, looking for and" X ", wherein" X "is a non-civilized term;
and 2, step: judging whether the text words contain words with similarity larger than a threshold value with preset words in a preset dangerous word database, if so, not generating a conversation channel interaction signal, and the preset words in the preset dangerous word database comprise non-civilized words or other sensitive words; if the similarity between the X in the example text words and the preset words in the preset dangerous word database exceeds a threshold value and the comparison result is a sensitive word, judging that a conversation channel interaction signal is not generated, and storing voice information of personnel outside the vehicle so as to leave evidence for subsequent needs;
and 3, step 3: when the voice information of the person outside the vehicle is judged to contain dangerous words, the person outside the vehicle is considered to have an overstimulation behavior, personal injury to the person inside the vehicle is possibly caused, in order to prevent dangerous situations, a vehicle door lock-falling signal is generated and sent to a vehicle lock control mechanism, and the vehicle is controlled to lock the vehicle so as to guarantee the safety of the person inside the vehicle;
it will be appreciated that this locking operation may be overridden by an occupant of the vehicle.
Referring to fig. 3, fig. 3 shows a schematic view of a vehicle partition dialog method according to another embodiment of the present application, which may specifically include the following steps:
step 1: the method comprises the steps that sight line direction information of people in the vehicle is obtained through a camera in the vehicle;
step 2: based on a sight line recognition technology, acquiring a sight point of a person in the vehicle, judging whether the position of the sight point extending to a preset range along a sight line direction is in the same range as the position of the person out of the vehicle for sending out voice information, and if so, determining the position of the person out of the vehicle for sending out the voice information along the sight line viewing direction of the person in the vehicle; for example, referring to fig. 6, assuming that the angle between the sight line of the person inside the vehicle and the vertical line of the vehicle body is α, and the angle between the connecting line of the person outside the vehicle and the person inside the vehicle and the vertical line of the vehicle body is β, if-5 ° (other values are possible) < β - α < -5 ° (other values are possible), it represents that the sight line of the user inside the vehicle is toward the user outside the vehicle. And 3, step 3: if the sight viewing direction of the person in the vehicle faces the position of the person out of the vehicle for sending the voice information, the person in the vehicle is considered to have the intention of voice conversation to the person out of the vehicle, and an inner channel signal and an outer channel signal are generated, so that the person out of the vehicle can obtain the voice information of the person in the vehicle through the separation window interaction assembly.
Referring to fig. 4, fig. 4 is a schematic structural diagram of a vehicle window partition dialog system according to another embodiment of the present application, which may specifically include:
in the embodiment, after receiving the signals of the internal and external channels, the isolating window conversation device controls the microphone in the vehicle to collect the voice information of the personnel in the vehicle, and carries out audio noise reduction, echo cancellation, human voice enhancement and other processing on the collected voice information, and then sends the voice information to the loudspeaker outside the vehicle, the loudspeaker outside the vehicle controls the volume, and the voice information of the personnel in the vehicle is played by adopting proper volume, so that the personnel outside the vehicle can clearly hear the content of the speech of the personnel in the vehicle, and the external playing of the voice information in the vehicle is completed;
in this embodiment, after the window isolating conversation device receives the outer and inner channel signals, in order to realize that a person outside the vehicle speaks to a person inside the vehicle, and the person inside the vehicle can hear the voice information of the person outside the vehicle, the window isolating conversation device controls a microphone outside the vehicle to collect the voice information of the person outside the vehicle, and carries out audio noise reduction, echo cancellation, voice enhancement and other processing on the collected voice information, and sends the voice information to a loudspeaker inside the vehicle again, wherein the loudspeaker inside the vehicle controls the volume, and the voice information of the person outside the vehicle is played by adopting a proper volume, so that the person inside the vehicle can clearly hear the speaking content of the person outside the vehicle, and the voice information inside the vehicle outside the vehicle is played.
Referring to fig. 5, the present application further provides an electronic device, including: the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus; the memory has stored therein a computer program which, when executed by the processor, causes the processor to carry out the steps of the vehicle window screening dialog method.
The present application further provides a computer-readable storage medium storing a computer program executable by an electronic device, which, when run on the electronic device, causes the electronic device to perform the steps of the vehicle window screening dialog method.
The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The electronic device includes a hardware layer, an operating system layer running on top of the hardware layer, and an application layer running on top of the operating system. The hardware layer includes hardware such as a Central Processing Unit (CPU), a Memory Management Unit (MMU), and a Memory. The operating system may be any one or more computer operating systems that implement control of the electronic device through a Process (Process), such as a Linux operating system, a Unix operating system, an Android operating system, an iOS operating system, or a windows operating system. In the embodiment of the present invention, the electronic device may be a handheld device such as a smart phone and a tablet computer, or an electronic device such as a desktop computer and a portable computer, which is not particularly limited in the embodiment of the present invention.
The execution main body of the electronic device control in the embodiment of the present invention may be an electronic device, or a functional module capable of calling a program and executing the program in the electronic device. The electronic device may acquire the firmware corresponding to the storage medium, the firmware corresponding to the storage medium is provided by a vendor, and the firmware corresponding to different storage media may be the same or different, which is not limited herein. After the electronic device acquires the firmware corresponding to the storage medium, the firmware corresponding to the storage medium may be written into the storage medium, specifically, the firmware corresponding to the storage medium is burned into the storage medium. The process of burning the firmware into the storage medium can be implemented by adopting the prior art, and is not described in the embodiment of the present invention.
The electronic device may further acquire a reset command corresponding to the storage medium, where the reset command corresponding to the storage medium is provided by a vendor, and the reset commands corresponding to different storage media may be the same or different, which is not limited herein.
At this time, the storage medium of the electronic device is a storage medium in which the corresponding firmware is written, and the electronic device may respond to the reset command corresponding to the storage medium in which the corresponding firmware is written, so that the electronic device resets the storage medium in which the corresponding firmware is written according to the reset command corresponding to the storage medium. The process of resetting the storage medium according to the reset command can be implemented by the prior art, and is not described in detail in the embodiment of the present invention.
For convenience of description, the above devices are described as being divided into various units and modules by functions, respectively. Of course, the functions of the units and modules may be implemented in one or more software and/or hardware when the present application is implemented.
It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
For simplicity of explanation, the method embodiments are described as a series of acts or combinations, but those skilled in the art will appreciate that the embodiments are not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments. Further, those of skill in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the embodiments of the invention.
From the above description of the embodiments, it is clear to those skilled in the art that the present application can be implemented by software plus necessary general hardware platform. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, or the like, and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the method according to the embodiments or some parts of the embodiments.
The invention discloses a vehicle of a vehicle partition window dialogue system on the basis of electronic equipment and a storage medium corresponding to the vehicle partition window dialogue method and system, and the vehicle specifically comprises the following components:
an electronic device for implementing a window partition dialogue method for a vehicle;
a processor for executing a program, and executing a vehicle window partitioning dialogue method by data output from the electronic device when the program is executed;
a storage medium for storing a program that executes, when running, steps of the vehicle window dialogue method for data output from the electronic device.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (10)
1. A vehicle window partition dialogue method, characterized by comprising:
acquiring basic information of personnel outside the vehicle;
acquiring basic information of personnel in the vehicle;
judging whether a conversation channel interaction signal needs to be generated or not according to the basic information of the personnel outside the vehicle and/or the basic information of the personnel inside the vehicle, if so, judging whether a conversation channel interaction signal needs to be generated or not, and if so, judging whether the conversation channel interaction signal needs to be generated or not
And generating a conversation channel interaction signal and transmitting the conversation channel interaction signal to a separation window interaction assembly in the vehicle, so that personnel outside the vehicle and personnel in the vehicle can interact through the separation window interaction assembly.
2. The window partition dialogue method for a vehicle of claim 1, wherein the dialogue channel interaction signal comprises an outside-inside channel signal and an inside-outside channel signal;
the generating and transmitting the conversation channel interaction signal to a partition window interaction assembly in the vehicle so that people outside the vehicle and people in the vehicle can interact through the partition window interaction assembly comprises:
when the conversation channel interaction signal is an outer channel signal and an inner channel signal, the personnel in the vehicle can acquire the voice information of the personnel outside the vehicle through the partition window interaction assembly; and/or the presence of a gas in the gas,
when the conversation channel interaction signal is an internal channel signal and an external channel signal, the personnel outside the vehicle can acquire the voice information of the personnel inside the vehicle through the partition window interaction assembly.
3. The window dialogue method for a vehicle according to claim 2, wherein the basic information of the person outside the vehicle includes:
voice information of a person outside the vehicle, position information of the person outside the vehicle, and sight line direction information of the person outside the vehicle;
the basic information of the person in the vehicle includes:
voice information of a person in the vehicle, and line-of-sight direction information of a person in the vehicle.
4. The vehicle window screening conversation method according to claim 3, wherein the determining whether the conversation channel interaction signal needs to be generated based on the basic information of the person outside the vehicle and/or the basic information of the person inside the vehicle includes:
judging whether the position information of the personnel outside the vehicle is in a preset range, if so, judging that the position information of the personnel outside the vehicle is in the preset range
Judging whether the sight line direction of the personnel outside the vehicle faces towards the personnel inside the vehicle, if so, judging that a conversation channel interaction signal needs to be generated;
the generating a dialogue channel interaction signal and transmitting the dialogue channel interaction signal to a partition window interaction component in the vehicle so that people outside the vehicle and people in the vehicle can interact through the partition window interaction component comprises:
and generating an outer channel signal and an inner channel signal, so that personnel in the vehicle can acquire the voice information of the personnel outside the vehicle through the partition window interaction assembly.
5. The vehicle window screening dialogue method according to claim 4, wherein the generating of the dialogue channel interaction signal according to the basic information of the person outside the vehicle and/or the basic information of the person inside the vehicle comprises:
judging whether the sight line direction of the personnel in the vehicle faces the position of the personnel outside the vehicle, if so, judging that a conversation channel interaction signal needs to be generated;
the generating and transmitting the conversation channel interaction signal to a partition window interaction assembly in the vehicle so that people outside the vehicle and people in the vehicle can interact through the partition window interaction assembly comprises:
and generating inner and outer channel signals, so that personnel outside the vehicle can acquire the voice information of the personnel inside the vehicle through the partition window interaction assembly.
6. The vehicular window spacer dialog method according to claim 5, characterized in that the vehicular window spacer dialog method further comprises:
acquiring vehicle speed information;
generating a conversation channel interaction signal according to the basic information of the person outside the vehicle and/or the basic information of the person inside the vehicle further comprises:
judging whether the vehicle moves according to the vehicle speed information, if not, judging whether the vehicle moves
And judging whether the sight line direction of the person in the vehicle faces the position of the person outside the vehicle.
7. The vehicle window screen conversation method according to any one of claims 1 to 6, wherein, after the determining whether the line of sight direction of the person outside the vehicle is directed toward the person inside the vehicle, the determining whether the conversation channel interaction signal needs to be generated based on the basic information of the person outside the vehicle and/or the basic information of the person inside the vehicle further comprises:
acquiring a preset dangerous word database, wherein the preset dangerous word database comprises at least one preset phrase;
identifying the acquired voice information of the person outside the vehicle, so as to acquire text information;
performing word segmentation on the acquired text information to acquire text words;
respectively carrying out similarity calculation on the text words and each preset phrase so as to obtain similarity values;
judging whether one similarity value is larger than a threshold value, if so, judging whether the similarity value is larger than the threshold value
And judging that a dialogue channel interaction signal does not need to be generated and storing the voice information of the personnel outside the vehicle.
8. The vehicle window screening dialogue method according to claim 7, wherein after determining that generation of a dialogue channel interaction signal is not required and storing voice information of a person outside the vehicle, the vehicle window screening dialogue method further comprises:
and generating a door lock falling signal, and transmitting the door lock falling signal to the lock control mechanism so that the lock control mechanism carries out locking operation according to the door lock falling signal.
9. A vehicle window spacer dialog device, comprising:
the system comprises an outside-vehicle personnel basic information acquisition module, a remote personnel basic information acquisition module and a remote personnel basic information acquisition module, wherein the outside-vehicle personnel basic information acquisition module is used for acquiring basic information of outside-vehicle personnel;
the system comprises a vehicle personnel basic information acquisition module, a vehicle personnel basic information acquisition module and a vehicle personnel basic information acquisition module, wherein the vehicle personnel basic information acquisition module is used for acquiring basic information of personnel in a vehicle;
the conversation channel interaction signal judgment module judges whether a conversation channel interaction signal needs to be generated or not according to the basic information of the personnel outside the vehicle and/or the basic information of the personnel inside the vehicle;
and the dialogue channel interaction signal generation module is used for generating a dialogue channel interaction signal when the dialogue channel interaction signal judgment module judges that the dialogue channel interaction signal is positive.
10. A vehicle window partition dialogue system, comprising:
a vehicle window spacer dialog device according to claim 9;
the sight line recognition instrument is arranged on the vehicle, connected with the vehicle partition window dialogue device and used for shooting images of people in the vehicle and images of people outside the vehicle, acquiring sight line direction information of the people in the vehicle according to the acquired images of the people in the vehicle, acquiring sight line direction information of the people outside the vehicle according to the acquired images of the people outside the vehicle, and transmitting the acquired sight line direction information of the people in the vehicle and the sight line direction information of the people outside the vehicle to the vehicle partition window dialogue device;
a position detection device mounted on a vehicle and connected to the vehicle bulkhead dialog device, the position detection device being configured to detect position information of a person outside the vehicle and transmit the detected position information of the person outside the vehicle to the vehicle bulkhead dialog device;
the window partition interaction assembly is connected with the window partition device for the vehicle and comprises an in-vehicle microphone, an out-vehicle microphone, an in-vehicle loudspeaker and an out-vehicle loudspeaker; when the vehicle window separating device sends an outer channel signal and an inner channel signal to the window separating interaction assembly, the outer microphone and the inner loudspeaker work in a matched mode, so that personnel in the vehicle can obtain voice information of the personnel outside the vehicle through the window separating interaction assembly; when the vehicle window separating device sends an inner channel signal and an outer channel signal to the window separating interaction assembly, the microphone in the vehicle and the loudspeaker outside the vehicle work in a matched mode, and people outside the vehicle can acquire voice information of people in the vehicle through the window separating interaction assembly.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211017989.8A CN115352361A (en) | 2022-08-24 | 2022-08-24 | Partition window dialogue method and device for vehicle and vehicle |
| PCT/CN2023/088941 WO2024040998A1 (en) | 2022-08-24 | 2023-04-18 | Through-the-window dialog method and apparatus for vehicle, and vehicle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211017989.8A CN115352361A (en) | 2022-08-24 | 2022-08-24 | Partition window dialogue method and device for vehicle and vehicle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115352361A true CN115352361A (en) | 2022-11-18 |
Family
ID=84002894
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211017989.8A Pending CN115352361A (en) | 2022-08-24 | 2022-08-24 | Partition window dialogue method and device for vehicle and vehicle |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN115352361A (en) |
| WO (1) | WO2024040998A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024040998A1 (en) * | 2022-08-24 | 2024-02-29 | 中国第一汽车股份有限公司 | Through-the-window dialog method and apparatus for vehicle, and vehicle |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006189394A (en) * | 2005-01-07 | 2006-07-20 | Toyota Motor Corp | Vehicle agent device |
| CN107193930A (en) * | 2017-05-17 | 2017-09-22 | 东莞市华睿电子科技有限公司 | A kind of website sensitive word screen method |
| JP2021051172A (en) * | 2019-09-24 | 2021-04-01 | 学校法人早稲田大学 | Dialogue system and program |
| CN113539260A (en) * | 2021-06-29 | 2021-10-22 | 广州小鹏汽车科技有限公司 | Voice communication method and device based on vehicle |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6202041B2 (en) * | 2015-04-24 | 2017-09-27 | マツダ株式会社 | Spoken dialogue system for vehicles |
| CN113844360A (en) * | 2021-09-03 | 2021-12-28 | 上海博泰悦臻电子设备制造有限公司 | Vehicle-mounted human-computer interaction system |
| CN115352361A (en) * | 2022-08-24 | 2022-11-18 | 中国第一汽车股份有限公司 | Partition window dialogue method and device for vehicle and vehicle |
-
2022
- 2022-08-24 CN CN202211017989.8A patent/CN115352361A/en active Pending
-
2023
- 2023-04-18 WO PCT/CN2023/088941 patent/WO2024040998A1/en unknown
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006189394A (en) * | 2005-01-07 | 2006-07-20 | Toyota Motor Corp | Vehicle agent device |
| CN107193930A (en) * | 2017-05-17 | 2017-09-22 | 东莞市华睿电子科技有限公司 | A kind of website sensitive word screen method |
| JP2021051172A (en) * | 2019-09-24 | 2021-04-01 | 学校法人早稲田大学 | Dialogue system and program |
| CN113539260A (en) * | 2021-06-29 | 2021-10-22 | 广州小鹏汽车科技有限公司 | Voice communication method and device based on vehicle |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024040998A1 (en) * | 2022-08-24 | 2024-02-29 | 中国第一汽车股份有限公司 | Through-the-window dialog method and apparatus for vehicle, and vehicle |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2024040998A1 (en) | 2024-02-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12046237B2 (en) | Speech interaction method and apparatus, computer readable storage medium and electronic device | |
| US9311930B2 (en) | Audio based system and method for in-vehicle context classification | |
| CN112509584B (en) | Sound source position determining method and device and electronic equipment | |
| EP3955245A1 (en) | Apparatus, method and program for parsing an utterance using a speaker feature vector | |
| US20230129816A1 (en) | Speech instruction control method in vehicle cabin and related device | |
| CN108463369B (en) | Vehicle infotainment and connectivity system | |
| CN111883135A (en) | Voice transcription method and device and electronic equipment | |
| CN110619897A (en) | Conference summary generation method and vehicle-mounted recording system | |
| CN115352361A (en) | Partition window dialogue method and device for vehicle and vehicle | |
| DE112018007847B4 (en) | INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD AND PROGRAM | |
| CN114187637A (en) | Vehicle control method, device, electronic device and storage medium | |
| CN114103944B (en) | Workshop time interval adjusting method, device and equipment | |
| CN113535308A (en) | Language adjusting method, language adjusting device, electronic equipment and medium | |
| CN110428838A (en) | A kind of voice information identification method, device and equipment | |
| CN112927688B (en) | Voice interaction method and system for vehicle | |
| CN113393643B (en) | Abnormal behavior early warning method and device, vehicle-mounted terminal and medium | |
| CN114550720A (en) | Voice interaction method and device, electronic equipment and storage medium | |
| CN111933174B (en) | Voice processing method, device, equipment and system | |
| CN114898524A (en) | Control system and method for voice interaction between vehicle owner and pedestrian | |
| CN112216269A (en) | Standard voice recognition device for locomotive driver operation and voice recognition method thereof | |
| CN116884413A (en) | Vehicle-mounted voice error-wake-up prevention system | |
| JP2019174757A (en) | Speech recognition apparatus | |
| CN110738995B (en) | Sound signal acquisition method and device | |
| US20240071384A1 (en) | Techniques for authorizing and prioritizing commands directed towards a virtual private assistant device from multiple sources | |
| CN116016747A (en) | Control method and device of Bluetooth communication system of vehicle, electronic equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |