CN116142226A

CN116142226A - Vehicle-mounted entertainment intelligent sensing method and system based on intelligent cabin of automobile

Info

Publication number: CN116142226A
Application number: CN202310156642.XA
Authority: CN
Inventors: 宋航
Original assignee: Beijing Hummingbird Interactive Technology Co ltd
Current assignee: Beijing Hummingbird Interactive Technology Co ltd
Priority date: 2023-02-23
Filing date: 2023-02-23
Publication date: 2023-05-23

Abstract

The invention provides a vehicle-mounted entertainment intelligent perception method and device based on an intelligent cabin of an automobile, which further fuses a vehicle perception qualitative result from an ECU (electronic control unit) of the cabin as another decision input by configuring an adapter between a cabin safety system and a vehicle-mounted information entertainment navigation (IVI) system, thereby realizing multi-system information fusion within the range of the automobile cabin; when the IVI system detects that the preset safety decision condition is met according to the perception information, an active safety control signal is sent to the cabin safety system, the cabin safety system can be controlled to execute safety operation indicated by the active safety control signal, for example, the electric safety belt is driven to tighten, and the active safety protection effect of the electric safety belt on a driver in a non-emergency driving event can be achieved, so that the cabin is more intelligent, safer and more humanized, the execution force of the IVI system on the active safety function is enhanced, the application scene of the cabin safety system is expanded, and the use efficiency of safety equipment is improved.

Description

Vehicle-mounted entertainment intelligent sensing method and system based on intelligent cabin of automobile

Technical Field

The invention relates to the technical field of intelligent vehicles, in particular to a vehicle-mounted entertainment intelligent perception method and system based on an intelligent cabin of an automobile.

Background

With technological progress, the safety performance of automobiles is continuously refined, the traditional automobile safety concept is gradually changed, and the active safety concept is gradually formed and is continuously perfected. Currently, it is common for an electronic control unit (Electronic Control Unit, ECU) to follow substantially the decision of an advanced assisted driving system (Advanced Driver Assistant System, ADAS) after receiving a dangerous driving signal of the vehicle, i.e. by controlling safety devices in an emergency situation, to assist the occupants to adjust to a relatively safe sitting position, and thereby to avoid or reduce injuries to the occupants as much as possible when a danger occurs. However, the above mechanism only allows for passive safety control in emergency situations, and potential safety risks in non-emergency situations cannot be avoided.

Disclosure of Invention

The invention provides a vehicle-mounted entertainment intelligent perception method and system based on an intelligent cabin of an automobile.

Therefore, a first object of the present invention is to provide a vehicle-mounted entertainment intelligent sensing method based on an intelligent cabin of an automobile, comprising:

acquiring first perception information, wherein the first perception information comprises at least one of audio and video input information, V2X information, contact input information and navigation information;

receiving second perception information sent by a cabin safety system, wherein the second perception information comprises at least one of body acceleration information of a driver, hand-held steering wheel information of the driver and ADAS vehicle state information;

detecting whether a preset safety decision condition is met or not according to the first perception information and the second perception information;

generating an active safety control signal corresponding to a safety decision condition in response to detecting that a preset safety decision condition is met;

transmitting the active safety control signal to a cabin safety system to cause the cabin safety system to perform a safety operation indicated by the active safety control signal;

wherein the detecting whether the preset security decision condition is satisfied according to the first sensing information and the second sensing information includes at least one of the following situations: if the first perception information comprises audio and video input information, the audio and video input information comprises driver sitting posture state information acquired by a DMS infrared camera, and when the second perception information indicates that the vehicle is in a non-emergency driving state but the driver sitting posture state information indicates that the driving sitting posture change amplitude of the driver exceeds a preset safe driving posture range, the preset safe decision condition is determined to be met;

if the first perception information comprises audio and video input information, the audio and video input information comprises driver sitting posture state information acquired by a DMS infrared camera, the second perception information comprises ADAS vehicle state information, and when the ADAS vehicle state information and/or the driver sitting posture state information indicate that the vehicle is in a non-emergency driving state, but the hand-held steering wheel information of the driver indicates that the duration of holding the steering wheel by one hand of the driver exceeds a preset duration, the preset safety decision condition is determined to be met;

and if the first perception information comprises V2X information, and when the second perception information indicates that the vehicle is in a non-emergency driving state, but the V2X information indicates that the driving state of a front vehicle of the vehicle is abnormal and/or the driving state of the front vehicle is abnormal, generating the active safety control signal.

Wherein prior to said sending said active safety control signal to the cabin safety system, said method further comprises: an adapter is configured between the vehicle-mounted infotainment navigation system and the cabin safety system, and the adapter is used for processing the active safety control signal so that the cabin safety system can recognize and receive the active safety control signal;

the sending the active safety control signal to a cabin safety system comprises:

the active safety control signal is sent to the cabin safety system via the adapter.

The active safety control signal is specifically generated by the vehicle-mounted module; the adapter is configured to be connected adjacent to the vehicle module.

Wherein, receiving the second perception information sent by the cabin safety system comprises: receiving second perception information sent by the cabin safety system through the adapter;

the adapter is further configured to process the second perceived information so that the in-vehicle infotainment navigation system can identify and receive the second perceived information.

The method comprises the steps of receiving an active safety control signal sent by a vehicle-mounted information entertainment navigation system, wherein the active safety control signal is generated in response to the fact that a preset safety decision condition is met according to first perception information and second perception information, the first perception information comprises at least one of audio and video input information, V2X information, contact input information and navigation information, and the second perception information comprises at least one of driver body acceleration information, driver hand-held steering wheel information and ADAS vehicle state information; executing the safety operation indicated by the active safety control signal;

wherein prior to said performing the security operation indicated by the active security control signal, the method further comprises: judging whether other safety control instructions with higher priority than the active safety control signals exist at present;

if not, executing the safety operation indicated by the active safety control signal;

wherein the determining whether there are other safety control instructions with priority higher than the active safety control signal currently includes: determining a safety device to which the active safety control signal is directed;

judging whether other safety control instructions point to the safety equipment or not;

if no other safety control instruction points to the safety equipment, determining that no other safety control instruction with higher priority than the active safety control signal exists.

Before receiving the active safety control signal sent by the vehicle-mounted infotainment navigation system, the method further comprises the following steps: an adapter is configured between the vehicle-mounted infotainment navigation system and the cabin safety system, and the adapter is used for processing the active safety control signal so that the cabin safety system can recognize and receive the active safety control signal;

the receiving the active safety control signal sent by the vehicle-mounted information entertainment navigation system comprises the following steps:

and receiving the active safety control signal sent by the vehicle-mounted infotainment navigation system through the adapter.

A second object of the present invention is to provide a vehicle-mounted entertainment intelligent sensing system based on an intelligent cabin of an automobile, comprising:

the vehicle-mounted information entertainment navigation system and the cabin safety system are used for executing the method according to the technical scheme.

Compared with the prior art, the vehicle-mounted entertainment intelligent perception method based on the intelligent cabin of the automobile provided by the invention has the advantages that the adapter is configured between the cabin safety system and the vehicle-mounted information entertainment navigation (IVI) system, the channel for transmitting the active safety control signal and other related information between the cabin safety system and the vehicle-mounted information entertainment navigation (IVI) system is opened, the multi-channel perception channel of the IVI system is fully utilized by the vehicle-mounted module in the IVI system, the vehicle perception qualitative result from the ECU of the cabin safety system is further fused to be used as another decision input of the vehicle perception qualitative result, and the multi-system information fusion in the range of the automobile cabin is realized; when the IVI system detects that the preset safety decision condition is met according to the perception information, an active safety control signal is sent to the cabin safety system, the cabin safety system can be controlled to execute safety operation indicated by the active safety control signal, for example, the electric safety belt is driven to tighten, and the active safety protection effect of the electric safety belt on a driver in a non-emergency driving event can be achieved, so that the cabin is more intelligent, safer and more humanized, the execution force of the IVI system on the active safety function is enhanced, the application scene of the cabin safety system is expanded, and the use efficiency of safety equipment is improved.

Drawings

The invention and/or additional aspects and advantages will be apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings, in which:

fig. 1 is a schematic flow chart of a vehicle-mounted entertainment intelligent perception method based on an intelligent cabin of an automobile.

Detailed Description

Embodiments of the present invention are described in detail below, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to like or similar elements or elements having like or similar functions throughout. The embodiments described below by referring to the drawings are illustrative and intended to explain the present invention and should not be construed as limiting the invention.

As shown in fig. 1, an embodiment of the present invention provides a vehicle-mounted entertainment intelligent sensing method based on an intelligent cabin of an automobile, including:

The invention also provides a vehicle-mounted entertainment intelligent sensing system based on the intelligent cabin of the automobile, which comprises the following steps:

In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the terms are not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, the different embodiments or examples described in this specification and the features of the different embodiments or examples may be combined and combined by those skilled in the art without contradiction.

Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature. In the description of the present invention, the meaning of "plurality" means at least two, for example, two, three, etc., unless specifically defined otherwise.

Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and additional implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order from that shown or discussed, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiments of the present invention.

Logic and/or steps represented in the flowcharts or otherwise described herein, e.g., a ordered listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). In addition, the computer readable medium may even be paper or other suitable medium on which the program is printed, as the program may be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory.

It is to be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In such embodiments, the various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. As with the other embodiments, if implemented in hardware, may be implemented using any one or combination of the following techniques, as is well known in the art: discrete logic circuits having logic gates for implementing logic functions on data signals, application specific integrated circuits having suitable combinational logic gates, programmable Gate Arrays (PGAs), field Programmable Gate Arrays (FPGAs), and the like.

Those of ordinary skill in the art will appreciate that all or a portion of the steps carried out in the method of the described embodiments may be implemented by a program that instructs associated hardware to perform, and that the program may be stored on a computer readable storage medium that when executed includes one or a combination of the steps of the method embodiments.

In addition, each functional unit in the embodiments of the present invention may be integrated in one processing module, or each unit may exist alone physically, or two or more units may be integrated in one module. The integrated modules may be implemented in hardware or in software functional modules. The integrated modules may also be stored in a computer readable storage medium if implemented in the form of software functional modules and sold or used as a stand-alone product.

The mentioned storage medium may be a read-only memory, a magnetic or optical disk or the like. Although embodiments of the present invention have been shown and described above, it will be understood that the embodiments are illustrative and not to be construed as limiting the invention, and that variations, modifications, alternatives and variations may be made to the embodiments by one of ordinary skill in the art within the scope of the invention.

Claims

1. The intelligent vehicle-mounted entertainment sensing method based on the intelligent cabin of the automobile is characterized by comprising the following steps of:

2. The method of claim 1, wherein prior to the sending the active safety control signal to a cabin safety system, the method further comprises: an adapter is configured between the vehicle-mounted infotainment navigation system and the cabin safety system, and the adapter is used for processing the active safety control signal so that the cabin safety system can recognize and receive the active safety control signal;

3. The method according to claim 2, wherein the in-vehicle infotainment navigation system comprises a vehicle-to-vehicle module, wherein the active safety control signal is generated in particular by the vehicle-to-vehicle module; the adapter is configured to be connected adjacent to the vehicle module.

4. A method according to claim 2 or 3, wherein the receiving second perception information sent by the cabin safety system comprises: receiving second perception information sent by the cabin safety system through the adapter;

5. The method of claim 1, wherein receiving an active safety control signal sent by a vehicle infotainment navigation system, the active safety control signal being generated in response to detecting that a preset safety decision condition is met based on first and second sensory information, wherein the first sensory information comprises at least one of audio-visual input information, V2X information, touch input information, and navigation information, and the second sensory information comprises at least one of driver body acceleration information, driver hand-held steering wheel information, and ADAS vehicle status information; executing the safety operation indicated by the active safety control signal;

6. The method of claim 5, wherein prior to receiving the active safety control signal sent by the in-vehicle infotainment navigation system, the method further comprises: an adapter is configured between the vehicle-mounted infotainment navigation system and the cabin safety system, and the adapter is used for processing the active safety control signal so that the cabin safety system can recognize and receive the active safety control signal;

7. An in-vehicle entertainment intelligent awareness system based on an automotive intelligent cockpit, characterized by comprising an in-vehicle infotainment navigation system and a cockpit safety system for performing the method of any of claims 1 to 6.