CN117622186A - Autonomous interaction control method for vehicle and vehicle - Google Patents

Autonomous interaction control method for vehicle and vehicle Download PDF

Info

Publication number
CN117622186A
CN117622186A CN202311639907.8A CN202311639907A CN117622186A CN 117622186 A CN117622186 A CN 117622186A CN 202311639907 A CN202311639907 A CN 202311639907A CN 117622186 A CN117622186 A CN 117622186A
Authority
CN
China
Prior art keywords
vehicle
interaction
preset
image
control method
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311639907.8A
Other languages
Chinese (zh)
Inventor
杜凯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Human Horizons Shanghai Internet Technology Co Ltd
Original Assignee
Human Horizons Shanghai Internet Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Human Horizons Shanghai Internet Technology Co Ltd filed Critical Human Horizons Shanghai Internet Technology Co Ltd
Priority to CN202311639907.8A priority Critical patent/CN117622186A/en
Publication of CN117622186A publication Critical patent/CN117622186A/en
Pending legal-status Critical Current

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • B60W40/04—Traffic conditions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/143—Alarm means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146—Display means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/54—Audio sensitive means, e.g. ultrasound
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00—Input parameters relating to occupants
    • B60W2540/223—Posture, e.g. hand, foot, or seat position, turned or inclined

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Human Computer Interaction (AREA)
  • Traffic Control Systems (AREA)

Abstract

The invention discloses a vehicle autonomous interaction control method and a vehicle, wherein environmental data around the vehicle are acquired through a sensor module configured by the vehicle; detecting interaction characteristic data of a person approaching the vehicle when the presence of the person is detected by the environment data; detecting whether the personnel have communication intention according to the interaction characteristic data; and outputting different interaction information correspondingly matched according to the detection result. The intelligent vehicle interactive application method and the intelligent vehicle interactive application system can expand interactive application scenes of intelligent vehicles, and facilitate vehicle owners to manage the vehicles.

Description

Autonomous interaction control method for vehicle and vehicle
Technical Field
The invention relates to the technical field of vehicle control, in particular to a vehicle autonomous interactive control method and a vehicle.
Background
With the development of intelligent car and machine technology and car networking technology, the man-machine interaction function of the car is receiving attention of users. Man-machine interaction refers to the process of information exchange between a person and a computer for completing a determined task in a certain interaction mode by using a certain dialogue language between the person and the computer. When the vehicle is in a parking state, the vehicle and the vehicle owner are in a disconnection state. However, when other people may have a need for communication and interaction with the vehicle owner, for example, the vehicle owner is required to move the vehicle, and other people cannot bring out the need due to the fact that the other people cannot contact, so that the vehicle owner is inconvenient to manage the vehicle.
Disclosure of Invention
In order to solve the problems, the invention provides a vehicle autonomous interactive control method and a vehicle, which can expand the interactive use scene of intelligent vehicles and facilitate vehicle management of vehicle owners.
The embodiment of the invention provides a vehicle autonomous interaction control method, which comprises the following steps:
acquiring environmental data around a vehicle through a sensor module configured by the vehicle;
detecting interaction characteristic data of a person approaching the vehicle when the presence of the person is detected by the environment data;
detecting whether the personnel have communication intention according to the interaction characteristic data;
and outputting different interaction information correspondingly matched according to the detection result.
Preferably, the outputting of the interaction information according to the detection result corresponding to the matching difference specifically includes:
when the detection result shows that the communication intention does not exist, outputting a preset first image through the interaction equipment configured by the vehicle;
and when the detection result shows that the communication intention exists, outputting a preset second image through the interaction equipment, and playing a preset interaction voice.
Further, the first image and the second image are holographic projection images;
the interaction device comprises a holographic projection device, wherein the holographic projection device outputs light waves to generate diffraction, and a holographic projection image is formed on a main driving position of the vehicle;
the first image is an action image of a vehicle owner for observing the gesture of the mobile phone; the second image is an action image of the communication gesture of the vehicle owner.
As a preferred solution, after correspondingly matching different interaction information outputs according to the detection result, the method further includes:
performing voice recognition on voice data input by the personnel;
recognizing the current demand of the personnel according to the voice;
inquiring a corresponding feedback instruction in a preset feedback instruction library according to the current demand, and executing the feedback instruction.
Further, the querying, according to the current requirement, a corresponding feedback instruction in a preset feedback instruction library, and executing the feedback instruction includes:
when the current requirement of the person is identified as the vehicle moving requirement, sending a vehicle moving request to a preset terminal device, and outputting a vehicle moving request feedback according to response information fed back by the terminal device.
Preferably, the method further comprises:
when the current requirement of the person cannot be identified or the current requirement does not exist in the feedback instruction library, sending a call request to preset terminal equipment, and when receiving the consent feedback of the terminal equipment, establishing a call with the terminal equipment.
As a preferred embodiment, the method further comprises:
when a pedestrian exists in a preset range of the vehicle through the environment data, monitoring a real-time distance between the pedestrian and the vehicle;
and when the monitored real-time distance is continuously reduced and the monitored real-time distance is not more than a preset distance threshold value, judging that a person approaching the vehicle is detected.
Preferably, the method further comprises:
when the detection result shows that communication intention exists, appearance characteristic data in the personnel are obtained;
and when the appearance characteristic data accords with the preset traffic police identity characteristics, outputting preset interaction information, and feeding back warning information to preset terminal equipment.
As a preferred solution, the detecting whether the person has a communication intention according to the interaction characteristic data includes:
detecting whether voice data input by the personnel data exist in the interaction characteristic data;
if not, judging that the communication intention does not exist;
if yes, judging that the communication intention exists.
The embodiment of the invention also provides a vehicle for executing the vehicle autonomous interactive control method in any one of the above embodiments.
The invention provides a vehicle autonomous interaction control method and a vehicle, wherein environmental data around the vehicle are acquired through a sensor module configured by the vehicle; detecting interaction characteristic data of a person approaching the vehicle when the presence of the person is detected by the environment data; detecting whether the personnel have communication intention according to the interaction characteristic data; and outputting different interaction information correspondingly matched according to the detection result. The intelligent vehicle interactive application method and the intelligent vehicle interactive application system can expand interactive application scenes of intelligent vehicles, and facilitate vehicle owners to manage the vehicles.
Drawings
Fig. 1 is a schematic flow chart of a vehicle autonomous interactive control method according to an embodiment of the present invention;
fig. 2 is a schematic structural view of a vehicle provided by the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Example 1
Referring to fig. 1, a flow chart of a vehicle autonomous interactive control method provided by an embodiment of the present invention is shown, where the method includes steps S1 to S4:
s1, acquiring environmental data around a vehicle through a sensor module configured by the vehicle;
s2, detecting interaction characteristic data of a person approaching the vehicle when the person is detected to exist through the environment data;
s3, detecting whether the personnel have communication intention according to the interaction characteristic data;
s4, correspondingly matching different interaction information according to the detection result and outputting.
In the implementation of this embodiment, as vehicles become popular, and particularly intelligent vehicles gradually move into people's lives, intelligent interactions begin to be slowly recognized by people. In some scenes, after the car owner locks the car and leaves, the car owner needs to be contacted with the outside world in time to solve some problems, but under the condition that the outside world cannot acquire the contact way of the car owner in time, the problem caused by the violent solution of external factors is usually solved, so that the car owner is damaged. A typical scenario is that when the owner leaves the lock, another vehicle may be blocked from driving away, and the blocked vehicle wants to contact the owner to move the vehicle, but cannot acquire any effective contact information of the owner. In extreme cases, blocked owners may drive away after crashing the vehicle, resulting in loss of the owner's property. Another typical scenario is rescue alarms, such as when the owner leaves the baby lock in the car, when the baby is found by others to be life threatening, if any effective contact is not available to the owner, in many cases only the window is broken to rescue the baby, resulting in loss of the owner's property.
The application provides a vehicle autonomous interaction control method which is applicable to the situation that an external object of a vehicle carries out remote interaction with an associated vehicle user through the vehicle, and can be executed by a vehicle-based interaction device which can be realized in a software and/or hardware mode and can be generally integrated in electronic equipment. The electronic device may be a vehicle-mounted terminal device.
When the method is implemented, the controller at the vehicle end executes the method, the vehicle is used for acquiring the environmental data around the vehicle by configuring the sensor module, personnel detection is carried out according to the acquired environmental data, and corresponding interaction control is carried out by triggering when the personnel is detected.
The sensor module of the vehicle configuration includes a laser radar, a vision sensor and a voice sensor. Lidar is used to identify the exact distance of objects around a vehicle from the vehicle. The vision sensor is used for detecting image information around the vehicle, and is used for performing action feature recognition and appearance feature recognition. The voice sensor is used to recognize ambient sounds in the surroundings, as well as sounds of surrounding personnel interacting with the vehicle.
In the present embodiment, the acquired environmental data includes data acquired by a laser radar, and a radar image acquired by the laser radar can identify objects around the vehicle and can distinguish whether or not the surrounding objects are pedestrians.
In addition, the acquired environmental data can also comprise image data acquired through the vision sensor, and image analysis can be carried out through the image data, so that objects around the vehicle can be more accurately identified, and pedestrians existing around the vehicle can be further distinguished.
By analyzing the acquired environmental data, whether people approaching the vehicle exist around the vehicle can be determined, and the specific recognition scheme can be used for recognizing objects in a preset range around the vehicle, judging whether the objects around the vehicle are pedestrians, and further recognizing the approaching pedestrians.
When a pedestrian around a vehicle is identified, the interactive feature data of the pedestrian, that is, the motion feature data of the pedestrian is identified, is detected.
It should be noted that, the interactive feature data includes behavioral characteristics and/or voice data of the user, through which it can be determined whether the pedestrian has a communication intention, and the determination of the communication intention may be performed through semantic recognition analysis of voice recognition or through voice recognition of the voice data of the pedestrian, and in combination with the action feature determination, when a preset communication intention determination condition is met, it is determined that the pedestrian has a communication intention.
And correspondingly matching different interactive information data according to the detection result of the communication intention.
According to whether the surrounding pedestrians have interaction intention or not, different interaction information is actively fed back to the pedestrians, the pedestrians outside the vehicle interact with the pedestrians, the requirements of the pedestrians outside the vehicle can be responded in time, and the trouble caused by the fact that the pedestrians outside the vehicle are not contacted when the pedestrians have the requirements is avoided.
In still another embodiment of the present invention, the outputting of the interaction information according to the detection result matching the difference includes:
when the detection result shows that the communication intention does not exist, outputting a preset first image through the interaction equipment configured by the vehicle;
and when the detection result shows that the communication intention exists, outputting a preset second image through the interaction equipment, and playing a preset interaction voice.
When the embodiment is implemented, outputting the interactive information according to the detection result, wherein the interactive information is matched with the detection result, specifically comprises the following steps:
and when the detection result shows that the person does not have communication intention, the pedestrian outside the vehicle is approaching the vehicle, but does not have communication or contact meaning with the person in the vehicle, at the moment, the first image is output through the interaction equipment in the vehicle, and at the moment, the feeling of the person in the vehicle is indicated to the pedestrian outside the vehicle only by outputting the first image. The aim of the operation is to avoid some lawbreakers, the approach vehicles attempt to steal or deliberately damage the vehicles, and the preset first image is projected on the main driving position in the vehicles to indicate that the vehicles are someone, thereby playing a role of deterrence to the lawbreakers and avoiding the vehicles from being damaged.
When the detection result shows that the person has communication intention, the person outside the vehicle is shown to be close to the vehicle, and the person in the vehicle is shown to talk or touch, at the moment, the user is likely to want to perform vehicle moving operation, or the user is expected to obtain the help of the vehicle owner, at the moment, the vehicle outputs a second image through the interaction equipment, and a preset interaction voice, for example, please ask what you can help. The method can remind the personnel outside the vehicle to interact, so that the personnel outside the vehicle can avoid the interaction with the vehicle owner because no person is perceived in the vehicle and no contact way is provided. Through the interior image of feedback car to the demand of the outside personnel of output interactive voice inquiry car can in time communicate with the outside personnel of car, in time knows its demand, is convenient for feed back for the car owner, in time manages the vehicle.
It should be noted that, referring to fig. 2, a schematic structural diagram of a vehicle provided by the present invention is shown. The vehicle comprises a vehicle-mounted laser radar, a visual sensor and a voice sensor, wherein the vehicle-mounted laser radar, the visual sensor and the voice sensor are used for recognizing environment data, the configured controller is used for controlling according to the environment data, when interaction is needed, signals are transmitted to a vehicle control module of the vehicle, the vehicle control module of the vehicle is used for controlling display equipment and playing equipment of the vehicle, and corresponding interaction instructions are executed. For example, the display device of the vehicle specifically includes a display device or a projection device, which can be used to output a preset image to alert an off-vehicle user. The playback device specifically includes a speaker capable of outputting interactive voice asking for the user's needs.
Through the analysis of the communication intention of the personnel close to the vehicle, corresponding to different interactive controls, the safety of the vehicle can be protected, the personnel with requirements can be interacted, the requirements can be actively acquired, the timely follow-up processing of the vehicle owner is facilitated, and the vehicle management is facilitated.
In yet another embodiment of the present invention, the first image and the second image are holographic projection images;
the interaction device comprises a holographic projection device, wherein the holographic projection device outputs light waves to generate diffraction, and a holographic projection image is formed on a main driving position of the vehicle;
the first image is an action image of a vehicle owner for observing the gesture of the mobile phone;
the second image is an action image of the communication gesture of the vehicle owner.
When the embodiment is implemented, the holographic projection device is configured in the vehicle to perform interaction, and the output first image and the output second image are holographic projection images.
When no communication intention exists among people outside the vehicle, the output first image is an action image of the vehicle owner for observing the gesture of the mobile phone, light waves are output through the holographic projection equipment to generate diffraction, a holographic projection image of the vehicle owner for observing the gesture of the mobile phone is formed on the main driving position of the vehicle, and the situation of the vehicle owner in the vehicle can be simulated more truly;
when communication intention exists among the personnel outside the vehicle, the second image output at the moment is an action image of the communication posture of the vehicle owner, light waves are output through the holographic projection equipment to generate diffraction, the action image of the communication posture of the vehicle owner is formed on the main driving position of the vehicle, and a real interaction scene is created by matching with the output interaction voice, so that the reality of interaction can be improved.
The holographic image is projected by the projection equipment, so that the action image of the vehicle owner can be more truly constructed, the illusion that people outside the vehicle have people in the vehicle is provided, people with bad intention can be frightened, and the loss of the vehicle owner is avoided. Through interactive action images and interactive voice, the vehicle exterior personnel can be inquired, the requirements of the vehicle exterior personnel can be timely acquired, the vehicle owner can manage the vehicle conveniently, and inconvenience brought to other people by the vehicle is avoided.
In yet another embodiment provided by the present invention, after step S4, the method further includes:
performing voice recognition on voice data input by the personnel;
recognizing the current demand of the personnel according to the voice;
inquiring a corresponding feedback instruction in a preset feedback instruction library according to the current demand, and executing the feedback instruction.
When the embodiment is implemented, after corresponding interaction information is fed back according to the communication intention of the personnel outside the vehicle, the response to the demand information fed back by the personnel outside the vehicle is required, which specifically includes:
the voice data input by the personnel are detected through the sensing equipment, namely, the voice data input by the personnel are collected through the microphone, after the vehicle is subjected to interactive control, the personnel outside the vehicle interact with the vehicle through voice, the voice data are collected for voice recognition, and the current requirements of the personnel outside the vehicle can be determined.
The voice input by the personnel outside the vehicle is recognized through the voice, the voice is converted into characters, the keyword is extracted, namely the semantics of the personnel outside the vehicle are recognized, and the current requirement is correspondingly analyzed.
The current requirement of the user can also be directly queried through keyword matching, for example, keywords such as 'moving vehicle', 'moving vehicle' or 'blocking road' input by personnel outside the vehicle are identified, and the vehicle moving requirement can be correspondingly matched.
According to the identified current demand, inquiring a corresponding feedback instruction in a preset feedback instruction library, namely, according to the demand outside the vehicle, correspondingly matching an interactive feedback process, for example, when the demand for seeking help by the personnel outside the vehicle is identified, sending a call request of the vehicle to a preset terminal device, and when receiving the consent feedback of the terminal device, establishing a call with the terminal device. When the requirement that the personnel outside the vehicle requests to move the vehicle is identified, the contact telephone of the vehicle owner is correspondingly fed back, so that the personnel outside the vehicle can conveniently contact the vehicle owner.
The requirements of the users are detected through voice recognition, interactive feedback is carried out according to the matched control instructions, and the requirements of personnel outside the vehicle are responded.
In another embodiment of the present invention, a process for performing interactive feedback includes querying a preset feedback instruction library for a corresponding feedback instruction according to a current requirement:
when the current requirement of the person outside the vehicle is recognized as vehicle moving, a vehicle moving request is sent to terminal equipment of the vehicle owner, the vehicle owner is reminded of vehicle moving, feedback of the request information is received by the user, and vehicle moving request feedback is output according to the feedback information of the user.
For example, at the terminal device, the user may choose to feed back directly, move the car within 5 minutes, or move the car within 10 minutes or not move the car at this moment, the car end feeds back the information to the personnel outside the car, and the interaction between the personnel outside the car and the car owner is completed, and the feedback thereof.
It should be noted that, the terminal device of the vehicle owner may be a mobile phone, a tablet computer or other intelligent devices, so as to display corresponding prompt information. Before use, the vehicle owner needs to bind the vehicle with the vehicle, and the following vehicle can directly communicate with the terminal equipment.
In yet another embodiment provided by the present invention, the method further comprises:
when the current requirement of the person cannot be identified or the current requirement does not exist in the feedback instruction library, sending a call request to preset terminal equipment, and when receiving the consent feedback of the terminal equipment, establishing a call with the terminal equipment.
When the embodiment is implemented, the voice data input by the personnel outside the vehicle are acquired to perform semantic recognition when the personnel outside the vehicle interact with the vehicle, so that the current demands of the personnel outside the vehicle are recognized.
Under ideal conditions, the requirements of the personnel outside the vehicle can be identified, and the current requirements of the personnel outside the vehicle are fed back through the feedback instruction library corresponding to the matched feedback instruction.
However, due to the limitation of the input language of the personnel outside the vehicle and the limitation of the intelligent voice recognition function, the current requirement of the personnel outside the vehicle may not be recognized, or although the current requirement of the personnel outside the vehicle is recognized, no feedback instruction for the current requirement exists in the feedback instruction library. Under the two conditions, the vehicle end cannot actively feed back the requirements of the personnel outside the vehicle, the personnel outside the vehicle and the vehicle end are in invalid communication, unnecessary troubles are brought to the personnel outside the vehicle and the vehicle owner in order to avoid the requirement that the personnel outside the vehicle cannot be identified, and therefore the vehicle sends a call request to the terminal equipment of the vehicle owner, namely the vehicle actively dials the telephone of the vehicle owner, or sends the call request to the mobile phone of the vehicle owner. When the owner receives the call request, the owner can selectively accept the call request or reject the call request, so as to avoid disturbing the owner.
After the vehicle owner receives the call request, the vehicle end establishes a call with the terminal equipment, namely, remote communication between the personnel outside the vehicle and the vehicle owner is realized, and the personnel outside the vehicle can directly communicate with the vehicle owner at the moment, so that the vehicle owner can acquire the requirements of the personnel outside the vehicle and process the requirements in time.
In yet another embodiment provided by the present invention, the method further comprises:
when a pedestrian exists in a preset range of the vehicle through the environment data, monitoring a real-time distance between the pedestrian and the vehicle;
and when the monitored real-time distance is continuously reduced and the monitored real-time distance is not more than a preset distance threshold value, judging that a person approaching the vehicle is detected.
When the embodiment is implemented, when detecting a person approaching the vehicle, it is first required to determine whether a pedestrian exists in a preset range of the vehicle according to surrounding environment data, that is, the distance between the object around the vehicle and the vehicle is identified by the lidar, and the pedestrian can be identified by combining with the image sensor.
When a pedestrian exists in a preset range of the vehicle through the environment data, monitoring a real-time distance between the pedestrian and the vehicle; for example, when recognizing that a pedestrian exists in a range of 2m from the vehicle to the surrounding of the vehicle, actively detecting the real-time distance between the pedestrian and the vehicle.
And continuously detecting the real-time distance when the detected real-time distance is continuously reduced, namely, the real-time distance between the detected pedestrian and the vehicle is continuously reduced, and judging that the person approaching the vehicle exists when the detected real-time distance is smaller than 0.5 m.
Through the monitoring of pedestrians in the preset range of the vehicle, when the pedestrians continuously approach the vehicle and the distance from the vehicle is in the range of 0.5m, the condition that the pedestrians approach the vehicle at the moment is indicated, accurate detection of the pedestrians is realized, and false triggering is avoided.
In yet another embodiment provided by the present invention, the method further comprises:
when the detection result shows that communication intention exists, appearance characteristic data in the personnel are obtained;
and when the appearance characteristic data accords with the preset traffic police identity characteristics, outputting preset interaction information, and feeding back warning information to preset terminal equipment.
In the implementation of this embodiment, when the vehicle end performs interaction, it is necessary to analyze the communication intention of the pedestrian, identify the identity of the pedestrian, and pay attention to the pedestrian with a specific identity, such as a traffic police.
When the detection result shows that the communication intention exists, namely, when the pedestrian is identified to have the communication intention, appearance characteristic data in the pedestrian are obtained; the appearance image data of the person is identified through the configured image sensor and is used as appearance characteristic data, wherein the appearance characteristic data comprises appearance characteristics of the pedestrian and is used for identification.
The appearance characteristics in the appearance characteristic data are extracted through image processing and are compared with preset traffic police identity characteristics, when the appearance characteristics in the appearance characteristic data accord with the preset traffic police identity characteristics, pedestrians are judged to be traffic police, when a vehicle is outside a vehicle and is a traffic police, the vehicle is parked at the moment possibly violating related traffic rules, traffic jam is possibly caused, at the moment, the vehicle owner needs to be additionally reminded, the vehicle owner is prevented from being parked illegally for a long time to cause more serious consequences, therefore preset interaction information, such as outputting preset interaction voice please, etc., the vehicle is moved within 3 minutes, and traffic violation warning information is fed back to terminal equipment of the vehicle owner, so that the vehicle owner is reminded of moving the vehicle as soon as possible, and traffic is prevented from being influenced.
In still another embodiment of the present invention, the detecting whether the person has a communication intention according to the interaction characteristic data includes:
detecting whether voice data input by the personnel data exist in the interaction characteristic data;
if not, judging that the communication intention does not exist;
if yes, judging that the communication intention exists.
In the implementation of the present embodiment, when detecting whether the person has a communication intention, it is necessary to perform the communication based on the detection of the person approaching the vehicle. That is, a pedestrian approaching 0.5m of the vehicle is detected, and the inputted voice data of the pedestrian is acquired by a sound sensor provided to the vehicle.
And denoising voice data input by the pedestrians, carrying out voice recognition, and judging whether the pedestrians are subjected to voice recognition or not by recognizing whether the pedestrians input text data through the voice, namely, whether the pedestrians are subjected to voice recognition or not, wherein the process filters noise.
When the voice data input by the person is recognized, the semantic meaning of the input voice is not required to be recognized, and at this time, the existence of the communication intention is judged.
When the person is recognized not to input voice data, namely, the close person does not output voice data, the communication intention is judged not to exist.
By identifying the input voice data, the method does not need to identify the semantics, avoids the situation that the vehicle cannot identify the communication intention due to the confusing text or the tentative text of the pedestrian, and can accurately detect the communication intention of the pedestrian.
In a further embodiment of the present invention, a vehicle is provided for performing the vehicle autonomous interactive control method according to any one of the above embodiments.
It should be noted that, when the vehicle is updated to perform autonomous interactive control, the scheme adopted in any of the embodiments may be adopted, and specific execution steps are the same as those in the embodiments, and are not repeated herein.
It should be noted that modifications and adaptations to the invention may occur to one skilled in the art without departing from the principles of the present invention and are intended to be within the scope of the present invention.

Claims (10)

1. A vehicle autonomous interactive control method, the method comprising:
acquiring environmental data around a vehicle through a sensor module configured by the vehicle;
detecting interaction characteristic data of a person approaching the vehicle when the presence of the person is detected by the environment data;
detecting whether the personnel have communication intention according to the interaction characteristic data;
and outputting different interaction information correspondingly matched according to the detection result.
2. The vehicle autonomous interactive control method according to claim 1, wherein the outputting of the interactive information corresponding to the matching of the difference according to the detection result specifically comprises:
when the detection result shows that the communication intention does not exist, outputting a preset first image through the interaction equipment configured by the vehicle;
and when the detection result shows that the communication intention exists, outputting a preset second image through the interaction equipment, and playing a preset interaction voice.
3. The vehicle autonomous interactive control method of claim 2, wherein the first image and the second image are holographic projection images;
the interaction device comprises a holographic projection device, wherein the holographic projection device outputs light waves to generate diffraction, and a holographic projection image is formed on a main driving position of the vehicle;
the first image is an action image of a vehicle owner for observing the gesture of the mobile phone; the second image is an action image of the communication gesture of the vehicle owner.
4. The vehicular autonomous interactive control method according to claim 1, wherein after correspondingly matching different interactive information outputs according to the detection result, the method further comprises:
performing voice recognition on voice data input by the personnel;
recognizing the current demand of the personnel according to the voice;
inquiring a corresponding feedback instruction in a preset feedback instruction library according to the current demand, and executing the feedback instruction.
5. The vehicle autonomous interactive control method according to claim 4, wherein the querying a corresponding feedback instruction in a preset feedback instruction library according to the current demand, and executing the feedback instruction, includes:
when the current requirement of the person is identified as the vehicle moving requirement, sending a vehicle moving request to a preset terminal device, and outputting a vehicle moving request feedback according to response information fed back by the terminal device.
6. The vehicle autonomous interactive control method of claim 4, wherein the method further comprises:
when the current requirement of the person cannot be identified or the current requirement does not exist in the feedback instruction library, sending a call request to preset terminal equipment, and when receiving the consent feedback of the terminal equipment, establishing a call with the terminal equipment.
7. The vehicle autonomous interactive control method of claim 1, wherein the method further comprises:
when a pedestrian exists in a preset range of the vehicle through the environment data, monitoring a real-time distance between the pedestrian and the vehicle;
and when the monitored real-time distance is continuously reduced and the monitored real-time distance is not more than a preset distance threshold value, judging that a person approaching the vehicle is detected.
8. The vehicle autonomous interactive control method of claim 2, wherein the method further comprises:
when the detection result shows that communication intention exists, appearance characteristic data in the personnel are obtained;
and when the appearance characteristic data accords with the preset traffic police identity characteristics, outputting preset interaction information, and feeding back warning information to preset terminal equipment.
9. The vehicle autonomous interactive control method according to claim 1, wherein the detecting whether the person has a communication intention based on the interactive feature data comprises:
detecting whether voice data input by the personnel data exist in the interaction characteristic data;
if not, judging that the communication intention does not exist;
if yes, judging that the communication intention exists.
10. A vehicle for performing the vehicle autonomous interactive control method according to any of the preceding claims 1-8.
CN202311639907.8A 2023-12-01 2023-12-01 Autonomous interaction control method for vehicle and vehicle Pending CN117622186A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311639907.8A CN117622186A (en) 2023-12-01 2023-12-01 Autonomous interaction control method for vehicle and vehicle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311639907.8A CN117622186A (en) 2023-12-01 2023-12-01 Autonomous interaction control method for vehicle and vehicle

Publications (1)

Publication Number Publication Date
CN117622186A true CN117622186A (en) 2024-03-01

Family

ID=90028423

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311639907.8A Pending CN117622186A (en) 2023-12-01 2023-12-01 Autonomous interaction control method for vehicle and vehicle

Country Status (1)

Country Link
CN (1) CN117622186A (en)

Similar Documents

Publication Publication Date Title
WO2022062659A1 (en) Intelligent driving control method and apparatus, vehicle, electronic device, and storage medium
US10991181B1 (en) Systems and method for providing awareness of emergency vehicles
US11354907B1 (en) Sonic sensing
US10017156B2 (en) Vehicle security system
US10810866B2 (en) Perimeter breach warning system
US11567509B2 (en) Control system, control method, and non-transitory storage medium
CN106650603A (en) Vehicle surrounding monitoring method, apparatus and the vehicle
US20210213909A1 (en) Confirmed automated access to portions of vehicles
US11546734B2 (en) Providing security via vehicle-based surveillance of neighboring vehicles
Visconti et al. Arduino-based solution for in-carabandoned infants' controlling remotely managed by smartphone application
CN108346310A (en) A kind of intelligent parking garage system and control method based on Internet of Things
CN114407832A (en) Monitoring method for preventing vehicle body from being scratched and stolen, vehicle body controller and vehicle
CN113561983A (en) Intelligent security detection system for personnel in vehicle and detection method thereof
CN117104130A (en) Method and device for displaying vehicle moving information, electronic equipment and readable storage medium
EP4246460A2 (en) Vehicle identification system
CN116872840A (en) Vehicle anti-collision early warning method and device, vehicle and storage medium
CN117622186A (en) Autonomous interaction control method for vehicle and vehicle
CN111862529A (en) Alarm method and equipment
US11518345B2 (en) Vehicle and method of controlling the same
US11724693B2 (en) Systems and methods to prevent vehicular mishaps
CN112758028B (en) Number display method, system, vehicle and computer readable storage medium
KR102132058B1 (en) Interactive voice communication system embedded in a car
CN110139205B (en) Method and device for auxiliary information presentation
CN114809833B (en) Control method for opening vehicle door, vehicle door control device and vehicle door control system
JP7301715B2 (en) State Prediction Server and Alert Device Applied to Vehicle System Using Surveillance Camera

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination