CN117915023A - Reversing auxiliary image fusion method and system and vehicle - Google Patents
Reversing auxiliary image fusion method and system and vehicle Download PDFInfo
- Publication number
- CN117915023A CN117915023A CN202211237079.0A CN202211237079A CN117915023A CN 117915023 A CN117915023 A CN 117915023A CN 202211237079 A CN202211237079 A CN 202211237079A CN 117915023 A CN117915023 A CN 117915023A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- auxiliary image
- central control
- mounted central
- reversing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007500 overflow downdraw method Methods 0.000 title claims abstract description 8
- 238000000034 method Methods 0.000 claims abstract description 16
- 230000009977 dual effect Effects 0.000 claims abstract description 5
- 239000010410 layer Substances 0.000 claims description 137
- 230000004927 fusion Effects 0.000 claims description 36
- 238000007499 fusion processing Methods 0.000 claims description 14
- 239000002346 layers by function Substances 0.000 claims description 13
- 238000012545 processing Methods 0.000 claims description 6
- 238000003384 imaging method Methods 0.000 claims 1
- 238000005192 partition Methods 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 18
- 238000004590 computer program Methods 0.000 description 5
- 239000000446 fuel Substances 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000295 fuel oil Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Instrument Panels (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
Abstract
The invention discloses a reversing auxiliary image fusion method, which is used in a vehicle-mounted central control host of a dual system and comprises the following steps: the vehicle-mounted instrument domain system receives the reversing auxiliary image acquired by the reversing auxiliary image system; judging whether the vehicle-mounted central control entertainment system is started completely or not; if the vehicle-mounted central control entertainment system is started, overlapping a reversing auxiliary image layer in the vehicle-mounted instrument domain system with a vehicle-mounted central control entertainment system function layer in a cross-system manner, so that the reversing auxiliary image is displayed in a control area of the vehicle-mounted central control entertainment system; and if the vehicle-mounted central control entertainment system is not started, enabling the reversing auxiliary image and the related setting items in the reversing auxiliary image layer to be paved on the vehicle-mounted central control display screen. The present invention does not provide a corresponding system and vehicle. By implementing the method and the device, the requirement of a user for fast reversing can be met, the problem that the resolution of the auxiliary image is not matched with that of the screen due to the fact that the screen is overturned can be effectively solved, and user experience is improved.
Description
Technical Field
The invention relates to the technical field of vehicle machines, in particular to a reversing auxiliary image fusion method and system and a vehicle.
Background
Along with the development of vehicle-mounted intelligent driving systems and cabin systems, reversing auxiliary image systems become standard, and the common reversing auxiliary image systems in the market today are as follows: a reverse rearview system (REAR VIEW CAMERA, RVC), a reverse panoramic system (Surround View Monitor, SVM), an automatic parking system (full auto PARKING ASSIST, FAPA), and the like. Meanwhile, in order to pursue better driving safety, the above reversing auxiliary image is gradually expanded into a driving auxiliary image, for example: when a user turns on a turn signal or a car body approaches an obstacle, the auxiliary image is automatically displayed on a car-mounted central control desktop, whether the turning direction of the user has the distance between the obstacle and the car is informed by the camera image at the corresponding car side, and an interface schematic diagram for displaying the full-screen scheme of the auxiliary image in the sound host can be shown by referring to fig. 1. The method does improve the driving safety of the user, but because the traditional reversing auxiliary image system is designed for the reverse gear working condition, the interaction mode with the sound host is full-center screen switching, and obviously, the design is not suitable for the driving auxiliary working condition.
Existing such schemes tend to result in poor user experience in the following scenarios:
Scene one: the vehicle runs on the expressway, the central control display screen displays a navigation picture, a user is about to drive out of the expressway, turn-on lamps are turned on in advance, and the navigation picture is covered by the auxiliary image;
Scene II: the vehicle runs on a narrow road, and when the radar detects that the surrounding obstacle is close to the vehicle, the auxiliary image frequently jumps out.
In addition to the above-mentioned display problem, this auxiliary image display mode also has a resolution matching problem. With the development of intelligent cabins, the central control display screen is bigger and bigger, 14.6 and 15.6 inch screens are more common, even bigger sizes are gradually appeared on the market, and the increase of the screen size is accompanied with the increase of the resolution ratio. The resolution of the auxiliary image is determined by the reversing camera, and the increase of the resolution is difficult to match with the increase of the resolution of the central control screen. The original mode of switching display of the full central control screen easily exposes the defect of insufficient resolution of the camera, and users feel that: the reversing image has poor quality and poor experience. Aiming at the problem of resolution matching, some domestic OEMs adopt a pseudo-split screen scheme, namely, auxiliary pictures are reduced, and then, setting items related to the auxiliary pictures are added in a blank area, so that an interface schematic diagram for displaying the auxiliary image full-screen reduction scheme in an audio host can be shown by referring to FIG. 2. This approach, while capable of optimizing the resolution matching problem, still suffers from the screen-up problem. Thus, there are some OEMs that propose a split-screen scheme for merging the auxiliary image into the audio entertainment system, that is, consider the auxiliary image display when designing each module of the audio entertainment system, and an interface schematic diagram for displaying the auxiliary image merging scheme in the audio host is shown in fig. 3. The scheme has good experience and strong overall sense, and can gradually replace other schemes, thereby becoming the main stream of the industry.
The scheme in the market is mainly applied to a sound host of a single Android system, and is simple to develop due to the fact that the auxiliary image fusion scheme of the single Android system is simple. But is limited by the characteristic of slow starting of a single Android system, the requirement of a user for fast reversing can not be met, namely, as soon as a vehicle is started, an auxiliary image is displayed in reverse gear. In view of the above, the solution is mostly used by pure electric vehicles, and the pure electric vehicles can realize that the sound host is not dormant due to the large battery capacity, and is in a semi-dormant state after the client locks the vehicle, so that the user can quickly reverse the vehicle, the Android system does not need to be restarted, and auxiliary images can be quickly displayed. This causes the disadvantage that the auxiliary image fusion scheme cannot be adapted to the pure fuel automobile.
In summary, in the prior art solution, there are the following disadvantages:
The traditional auxiliary image display scheme has the problems of screen blockage and unmatched resolution, and influences the user experience;
the single Android system auxiliary shadow fusion scheme is limited by the slow starting characteristic of the Android system, is only suitable for pure electric vehicles and is not suitable for pure fuel vehicles in order to meet the requirement of fast reversing of users;
Mature auxiliary image fusion schemes designed for fuel vehicles are lacking in the market.
Disclosure of Invention
The invention aims to solve the technical problem of providing a reversing auxiliary image split screen fusion method, a reversing auxiliary image split screen fusion system and a vehicle, which can be applied to a vehicle-mounted sound host of a double system of a fuel oil vehicle, can meet the requirement of a user for rapid reversing, can also effectively solve the problem of mismatching of auxiliary images and screen resolution, and improves user experience.
In order to solve the above technical problems, as one aspect of the present invention, a method for fusing a reversing auxiliary image is provided, which is used in a dual-system vehicle central control host, and at least comprises the following steps:
The vehicle-mounted instrument domain system receives the reversing auxiliary image acquired by the reversing auxiliary image system;
Judging whether the vehicle-mounted central control entertainment system is started completely or not;
If the vehicle-mounted central control entertainment system is started, overlapping a reversing auxiliary image layer in the vehicle-mounted instrument domain system and a vehicle-mounted central control entertainment system function layer in a cross-system manner, and displaying the reversing auxiliary image layer and the vehicle-mounted central control entertainment system function layer on a vehicle-mounted central control display screen in a first fusion manner so as to display the reversing auxiliary image and the vehicle-mounted central control entertainment system control area;
And if the vehicle-mounted central control entertainment system is not started, displaying the reversing auxiliary image layer in the vehicle-mounted instrument domain system on the vehicle-mounted central control display screen in a second fusion mode, so that the reversing auxiliary image and related setting items in the reversing auxiliary image layer are paved on the vehicle-mounted central control display screen.
The step of overlapping the reversing auxiliary image layer in the vehicle-mounted instrument domain system and the vehicle-mounted central control entertainment system functional layer across systems and displaying the reversing auxiliary image layer and the vehicle-mounted central control entertainment system functional layer on a vehicle-mounted sound host display screen in a first fusion mode so that the reversing auxiliary image and the vehicle-mounted central control entertainment system control area are displayed in a partitioning mode specifically comprises the following steps:
the reversing auxiliary image layer in the vehicle-mounted instrument domain system is arranged on the top layer, and the vehicle-mounted central control entertainment system functional layer is arranged on the next layer;
Setting a reversing auxiliary image layer to comprise a reversing auxiliary image, related setting items and a transparent area; the vehicle-mounted central control entertainment system functional layer is arranged to comprise a vehicle-mounted central control entertainment system control area, and the setting position of the vehicle-mounted central control entertainment system control area corresponds to the transparent area of the reversing auxiliary image layer;
And superposing the reversing auxiliary image layer and the vehicle-mounted central control entertainment system functional layer, displaying on a vehicle-mounted sound host display screen, displaying the reversing auxiliary image and the vehicle-mounted central control entertainment system control area in a region in the auxiliary image, displaying the reversing auxiliary image and related setting items in a region outside the auxiliary image, and displaying the vehicle-mounted central control entertainment system control area in a region outside the auxiliary image.
The step of displaying the reversing auxiliary image layer in the vehicle-mounted instrument domain system on the vehicle-mounted central control display screen in a second fusion mode specifically comprises the following steps:
a reversing auxiliary image layer in the vehicle-mounted instrument domain system is arranged on the top layer;
setting the reversing auxiliary image layer to comprise reversing auxiliary images and related setting items;
and displaying the reversing auxiliary image layer on a vehicle-mounted central control display screen in a whole screen manner.
Wherein, further include:
receiving touch operation of a user on the fused vehicle-mounted central control interface;
Judging whether the touch area belongs to an inner area or an outer area of the reversing auxiliary image according to the coordinates corresponding to the touch operation;
If the touch area is judged to be positioned in the reversing auxiliary image, analyzing a control request signal corresponding to the touch area, and sending the control request signal to a reversing auxiliary image system;
And if the touch area is judged to be positioned in the inner and outer areas of the reversing auxiliary image, analyzing a control request signal corresponding to the touch area, and sending the control request signal to the vehicle-mounted central control entertainment system.
The reversing auxiliary image system comprises a reversing rearview system (RVC), a reversing panoramic System (SVM) and automatic parking (FAPA).
Correspondingly, in another aspect of the present invention, a reversing auxiliary image fusion system is provided, which is used in a vehicle-mounted audio host of a dual system, and at least includes:
the reversing auxiliary image receiving unit is used for receiving reversing auxiliary images acquired by the reversing auxiliary image system through the vehicle-mounted instrument domain system;
The vehicle-mounted central control entertainment system starting judging unit is used for judging whether the vehicle-mounted central control entertainment system in the vehicle-mounted central control host is started;
The first fusion processing unit is used for overlapping a reversing auxiliary image layer in the vehicle instrument domain system and a vehicle central control entertainment system function layer in a cross-system mode when the judging result of the vehicle central control entertainment system starting judging unit is that the vehicle central control entertainment system is started, and displaying the reversing auxiliary image layer and the vehicle central control entertainment system function layer on a vehicle central control display screen in a first fusion mode, so that the reversing auxiliary image and the vehicle central control entertainment system control area are displayed;
And the second fusion processing unit is used for displaying on the vehicle-mounted central control display screen in a second fusion mode when the judging result of the vehicle-mounted central control entertainment system starting judging unit is that the vehicle-mounted central control entertainment system is not started, so that the vehicle-mounted central control display screen is fully paved with the vehicle-mounted auxiliary image and related setting items in the vehicle-mounted auxiliary image layer.
Wherein the first fusion processing unit includes:
The map layer position setting unit is used for setting a reversing auxiliary image map layer in the vehicle-mounted instrument domain system at the top layer and setting a vehicle-mounted central control entertainment system function map layer at the next layer;
The image layer content display position setting unit is used for setting the reversing auxiliary image layer to contain reversing auxiliary images, related setting items and transparent areas; the vehicle-mounted central control entertainment system functional layer is arranged to comprise a vehicle-mounted central control entertainment system control area, and the setting position of the vehicle-mounted central control entertainment system control area corresponds to the transparent area of the reversing auxiliary image layer;
and the superposition display unit is used for superposing the reversing auxiliary image layer and the vehicle-mounted central control entertainment system functional layer, displaying on a vehicle-mounted sound host display screen, enabling the reversing auxiliary image to be displayed in a region of the reversing auxiliary image and the vehicle-mounted central control entertainment system control region, displaying the reversing auxiliary image and related setting items in the auxiliary image inner region, and displaying the vehicle-mounted central control entertainment system control region in the auxiliary image outer region.
Wherein the second fusion processing unit includes:
The image layer content setting unit is used for placing a reversing auxiliary image layer in the vehicle-mounted instrument domain system on the top layer and setting the reversing auxiliary image layer to contain reversing auxiliary images and related setting items;
And the whole screen display unit is used for displaying the reversing auxiliary image layer on a vehicle-mounted central control display screen in a whole screen manner.
Wherein, further include:
the touch operation receiving unit is used for receiving the touch operation of the user on the fused vehicle-mounted central control interface;
The touch position judging unit is used for judging whether the touch area belongs to an inner area or an outer area of the auxiliary image of the reversing according to the coordinates corresponding to the touch operation;
The analysis processing unit is used for analyzing a control request signal corresponding to the touch area and sending the control request signal to the reversing auxiliary image system when the touch position judging unit judges that the touch area is positioned in the reversing auxiliary image; and the touch position judging unit judges that the touch area is positioned in the inner and outer areas of the auxiliary image, analyzes a control request signal corresponding to the touch area and sends the control request signal to the vehicle-mounted central control entertainment system.
Correspondingly, in still another aspect of the present invention, a vehicle is further provided, on which an on-board central control host is disposed, and the vehicle further includes the aforementioned reversing auxiliary image fusion system.
The embodiment of the invention has the following beneficial effects:
The invention provides a reversing auxiliary image fusion method, a reversing auxiliary image fusion system and a vehicle. When the vehicle has the requirement of reversing the image, judging whether the vehicle-mounted central control entertainment system is started, and overlapping the reversing image layer and the vehicle-mounted central control entertainment system function layer in a cross-system mode if the vehicle-mounted central control entertainment system is started, so that the operation of the vehicle-mounted central control entertainment system is not influenced when the reversing image is displayed on a screen; and if the vehicle-mounted central control entertainment system is not started, the reversing image and the setting item are paved on the screen, so that the black screen background is prevented from appearing, and the user experience is improved. When the prior art does not disclose the reverse image work, whether the vehicle-mounted central control entertainment system is successfully started or not is judged, and different picture superposition and layout display schemes are adopted for successful starting and unsuccessful starting.
The scheme provided by the invention can bring the high-quality verification of the auxiliary image fusion scheme to the client, can meet the requirement of the user for quick reversing, can effectively solve the problem of screen rejection and the problem of mismatching of the auxiliary image and the screen resolution, and improves the user experience.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions of the prior art, the drawings which are required in the description of the embodiments or the prior art will be briefly described, it being obvious that the drawings in the description below are only some embodiments of the invention, and that it is within the scope of the invention to one skilled in the art to obtain other drawings from these drawings without inventive faculty.
FIG. 1 is a schematic diagram of an interface for displaying an auxiliary image full screen in a central host;
FIG. 2 is a schematic diagram of an interface for displaying an auxiliary image full-screen zoom-out scheme in a central control host;
FIG. 3 is a schematic diagram of an interface for displaying an auxiliary image fusion scheme in a central control host;
FIG. 4 is a schematic diagram illustrating a main flow of an embodiment of a method for fusing a reverse auxiliary image according to the present invention;
FIG. 5 is a flowchart of a method for fusing the panoramic auxiliary image with the built-in panoramic auxiliary image in step S12 in FIG. 4;
FIG. 6 is a schematic view of the corresponding display layer in FIG. 5; ;
Fig. 7 is a flowchart of a built-in panoramic auxiliary image fusion scheme according to step S13 in fig. 4;
FIG. 8 is a schematic diagram of a layer corresponding to the display layer shown in FIG. 7;
FIG. 9 is a flowchart of an external automatic parking assist image fusion scheme according to step S14 in FIG. 4;
FIG. 10 is a schematic diagram illustrating a configuration of an embodiment of a reversing auxiliary image fusion system according to the present invention;
FIG. 11 is a schematic diagram illustrating a structure of the first fusion processing unit in FIG. 10;
FIG. 12 is a schematic diagram of a second fusion processing unit in FIG. 10;
fig. 13 is a schematic diagram illustrating a more detailed structure of an embodiment of a reversing auxiliary image fusion system according to the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings, for the purpose of making the objects, technical solutions and advantages of the present invention more apparent.
In the embodiment, an instrument field QNX system of a vehicle-mounted sound host represents a vehicle-mounted instrument field system, an Android system represents a vehicle-mounted central control entertainment system, and a vehicle-mounted sound host display screen represents a vehicle-mounted central control display screen. The above description of a preferred embodiment of the present invention is not intended to limit the scope of the claims, but rather to cover all equivalent variations or alternatives of the present invention.
Fig. 4 is a schematic diagram illustrating a main flow of an embodiment of a reverse auxiliary image fusion method according to the present invention; referring to fig. 5 to fig. 9 together, in this embodiment, the method for fusing reverse auxiliary images in a split screen is used in a vehicle-mounted audio host of a dual system, and at least includes the following steps:
step S10, an instrument domain QNX system of the vehicle-mounted sound host receives the reversing auxiliary image acquired by the reversing auxiliary image system: the reversing auxiliary image system is one of a reversing rearview system (RVC), a reversing panoramic System (SVM) and automatic parking (FAPA);
Step S11, judging whether an Android system in the vehicle-mounted sound host is started;
step S12, if the Android system is started, overlapping a reversing auxiliary image layer and an Android system function layer in a cross-system manner, and displaying the reversing auxiliary image layer and the Android system function layer on a vehicle-mounted audio host display screen in a first fusion mode, so that the reversing auxiliary image and the Android system control area are displayed in a distinguishing mode;
In a specific example, the step S12 specifically includes:
the method comprises the steps of controlling a reversing auxiliary image layer to be arranged on a top layer and an Android system function layer to be arranged on a next layer;
Setting a reversing auxiliary image layer to comprise a reversing auxiliary image, related setting items and a transparent area; setting the Android system function layer to comprise an Android system control area, wherein the setting position of the Android system control area corresponds to a transparent area of the reversing auxiliary image layer;
And superposing the reversing auxiliary image layer and the Android system function layer, displaying on a vehicle-mounted sound host display screen, displaying the reversing auxiliary image and the Android system control area in a region in the auxiliary image, displaying the reversing auxiliary image and related setting items in a region outside the auxiliary image, and displaying the Android system control area in a region outside the auxiliary image.
And step S13, if the Android system is not started, displaying the reversing auxiliary image layer on the display screen of the vehicle-mounted audio host in a second fusion mode, and enabling the reversing auxiliary image and related setting items in the reversing auxiliary image layer to be paved on the display screen of the vehicle-mounted audio host.
In a specific example, the step S13 specifically includes:
Placing the reversing auxiliary image layer on the top layer;
setting the reversing auxiliary image layer to comprise reversing auxiliary images and related setting items;
And displaying the reversing auxiliary image layer on a display screen of the vehicle-mounted sound host machine in a whole screen manner.
Further, the method further comprises:
Step S14, receiving touch operation of a user on the fused central control interface of the vehicle-mounted sound host;
step S15, judging whether the touch area belongs to an auxiliary image inner area or an auxiliary image outer area according to the coordinates corresponding to the touch control operation;
Step S16, if the touch area is judged to be located in the auxiliary image area, analyzing a control request signal corresponding to the touch area, and sending the control request signal to a reversing auxiliary image system;
in step S17, if it is determined that the touch area is located in the inner and outer areas of the auxiliary image, a control request signal corresponding to the touch area is parsed and sent to the APP corresponding to the touch area.
For a further understanding of the principles of the present invention, reference will now be made in detail to implementations of the methods of the present invention and more fully hereinafter described in connection with specific examples.
With the improvement of the performance of the audio host, in some embodiments, the reversing panoramic (SVM) function can be integrated in the audio host, that is, the image data of the four paths of SVM cameras outside the automobile are accessed into the audio host, the SVM related algorithm is integrated inside the audio host, and the screen display is controlled in the audio host after the image splicing is completed. However, the automatic parking module (FAPA) is still an external ECU, so this patent will separately discuss implementation of the auxiliary image fusion scheme according to these two functional configurations. The following scheme of integrating the SVM with the sound separately and the scheme of the external FAPA module will be described.
(One), stereo host integrated SVM scheme
Step 1: as shown in fig. 5, a control panel (auxiliary image display screen), a radar (detecting that an obstacle is approaching the vehicle, automatically displaying an auxiliary image corresponding to the vehicle side), a turn signal (turning on the turn signal, automatically displaying an auxiliary image corresponding to the vehicle side), and related signals are transmitted to a sound host through a CAN bus of the whole vehicle, and are transmitted to an automobile service (VEHICLE SERVICE) module of a HAL layer inside a QNX system through an automobile open system architecture (AutoSar) interface module inside an MCU of the sound host, and the signals are transmitted to an internal SVM module (Inner SVM) according to a path 2 through a high-speed distributed bus (FDBus), and the SVM module receives the signals to display the auxiliary image on an auxiliary image layer placed on the top layer. There are two situations:
Firstly, if the Android system is started, the SVM module displays the auxiliary image layer as shown in FIG. 6, at the moment, the auxiliary image layer is a transparent area except for an auxiliary image part, and the content of the functional layer related to the Android system can be transmitted in the transparent areas, so that the effect of FIG. 3 is presented to a user. Under the condition that the Android system is started, if a user triggers a reversing image function through a soft key on a central control screen, related signals are directly transmitted to an Inner SVM module through a channel 1 by a touch key (mTouch) module in QNX, and auxiliary image display work is completed;
Secondly, it can be understood that, generally, the Android system is started for about 16-20 seconds, the QNX system is started for about 2-3 seconds, and the MCU is started in millisecond level. Therefore, the QNX system is started, and the Android system is not started. If the Android system is not started, the SVM module displays the auxiliary image layer as shown in fig. 8, and if the auxiliary image layer is still displayed according to the auxiliary image fusion scheme, the auxiliary image area is normally displayed, and other areas are black (upper right pattern). Therefore, the modification scheme is an auxiliary image full-screen reduction scheme, namely the whole image layer of the auxiliary image layer displays the reversing image, but the setting items of the reversing image are paved below the reversing image (lower right pattern), so that the problem of mismatching of the resolution of the camera and the central control screen can be avoided.
Its corresponding flow diagram is shown in fig. 7. In this case, the android system is not started, and the user cannot trigger the reverse image function through the soft key of the central control screen, that is, the mTouch device only has the function of controlling the SVM setting, that is, "set 1", "set 2", "set 3" … … in fig. 2, and the related signals are transmitted from the mTouch module to the inner SVM module through the channels 3, FDBus and 2.
Step 2: when the user touches the fused central control interface, related signals are transmitted to an Android system through FDBus from a QNX system according to a channel 3 and are transmitted to an SVM service module (SVM SERVICE) through a vehicle-mounted hardware abstraction layer (VHAL) according to a channel 5;
step 3: and SVM SERVICE module judges whether the touch area belongs to the auxiliary image inner area or the auxiliary image outer area according to the coordinates of the touch event of the user.
If the region is in the auxiliary image, SVM SERVICE identifies the user's touch intention, for example, the "set 1" function in fig. 3, the information is transmitted back to VHAL layer through channel 5, and then transmitted back to the QNX system through FDBus through channel 4. Transmitting the data to the Inner SVM module through the channel 2, and correspondingly operating the Inner SVM module to realize the function of setting 1;
If the auxiliary image is an external area, the SVM SERVICE module identifies the touch intention of the user, for example, "other function 1" in fig. 3, and then gives the relevant information to other APPs through the path 6, and the other APPs implement the relevant functions.
In this scheme, the flow direction and the signal content of each channel object signal in step 1 to step 3 are shown in the following table 1:
TABLE 1 flow control of signals for each channel
It CAN be understood that in the scheme, the control panel, the radar and the turn signal lamp transmit related signals to the sound host through the CAN bus, or a user opens the reversing auxiliary image through the soft key of the central control display screen, the signals are transmitted to the SVM module integrated in the QNX, and the SVM module judges whether the Android system is started, and displays different reversing image pictures.
For issuing touch, a SVM SERVICE module is integrated in the Android system and used for judging whether the touch operation of a user aims at a reversing auxiliary image or other APP functions, and issuing relevant signals to the SVM module or other APP.
(II) external FAPA ECU scheme
The auto park FAPA ECU scheme is somewhat different in architecture from the integrated SVM scheme. As shown, the auxiliary image of FAPA is transmitted to the audio host QNX system through a Low Voltage Differential Signaling (LVDS) chip and a cable, and the audio host QNX is not integrated with an SVM module, but an SVM packaging module (SVM WRAPPER) for managing the display of the auxiliary image for reversing, and the image transmission of FAPA is always performed, and the display and the non-display of the central control screen are switched by SVM WRAPPER.
Step 1 is basically identical to step 1 in the "head unit integrated SVM" scheme, except that the two auxiliary pictures for completing the display according to whether the Android system is started are not produced by the SVM WRAPPER module, but generated by the FAPA.
In order to ensure that two auxiliary image displays generated by the FAPA are matched with the condition that whether the Android system is started or not, the VEHICLE SERVICE module needs to transmit state information of whether the Android system is started or not back to the AutoSar interface module of the MCU through the channel 9, and the state information is transmitted back to the FAPA through the channel 8, the CAN bus and the channel 7, and the FAPA displays a corresponding picture according to the transmitted Android state.
When the Android system is not started, the function keys in the reversing auxiliary image are touched, namely, the 'set 1', 'set 2', 'set 3' and the like in fig. 2, and at the moment, the mTouch module transmits a touch event to the FAPA through the channels 10, VEHICLE SERVICE module, the channels 9, autoSar interface module, the channel 8, the CAN bus and the channel 7, so that the FAPA realizes related functions.
After the Android system is started, the mTouch module can also open the reversing image, the client clicks the corresponding soft key, and the mTouch module enables SVM WRAPPER to display the reversing image through the channel 1.
Step 2: consistent with step 2 in the "stereo host integrated SVM" scheme;
Step 3: the SVM SERVICE module judges that the touch of the user is an area outside the reversing auxiliary image, and the processing scheme is consistent with the relevant steps in the step 3 in the 'sound host integrated SVM' scheme; when it is determined that the user touch is the area in the reverse image, the SVM SERVICE module identifies the user touch intention, for example, the function of "set 1" in fig. 3, the information is transmitted back to VHAL layers through the channel 5, and then transmitted back to the QNX system through the channel 4 through FDBus. The data are transmitted to the FAPA through the paths 11, VEHICLE SERVICE module, the paths 9, autoSar interface module, the path 8, the CAN bus and the path 7, and the FAPA realizes related functions.
In this scheme, the flow direction and the signal content of each channel object signal in step 1 to step 3 are shown in the following table 2:
TABLE 2 flow control of signals for each channel
It CAN be understood that in this scheme, control panel, radar, turn signal are passed to the host computer through the CAN bus, or the user opens the image of backing a car through the soft button of well accuse display screen, above signal transmission is given the SVM WRAPPER module of integrating in QNX, compare the Inner SVM module in the host computer integrated SVM scheme, SVM WRAPPER module is equivalent to a switch that controls FAPA to pass to whether host computer LVDS influence signal shows, SVM WRAPPER module judges whether the Android system finishes starting, display different image pictures of backing a car.
For the related touch control of the reversing image, the control is controlled by the FAPA ECU outside the host, so related signals are required to be given to the FAPA ECU through a AutoSar interface module inside the host MCU through a CAN bus.
Correspondingly, in another aspect of the present invention, a reverse auxiliary image split screen fusion system 1 is provided, which is used in a dual-system vehicle-mounted audio host, and at least includes:
The reversing auxiliary image receiving unit 10 is configured to receive the reversing auxiliary image acquired by the reversing auxiliary image system through an instrument domain QNX system of the vehicle-mounted audio host machine:
The Android system starting judging unit 11 is used for judging whether the Android system in the vehicle-mounted audio host is started;
The first fusion processing unit 12 is configured to, when the Android system start-up judging unit judges that the Android system is started up, cross-system superimpose a reversing auxiliary image layer and an Android system function layer, display the reversing auxiliary image layer and the Android system function layer on a vehicle-mounted audio host display screen in a first fusion manner, and display the reversing auxiliary image and the Android system control area;
And the second fusion processing unit 13 is configured to display the reverse auxiliary image and related setting items in the reverse auxiliary image layer on the vehicle-mounted audio host display screen in a second fusion manner when the Android system is not started up as a result of the judgment by the Android system start judging unit.
Wherein the first fusion processing unit 12 includes:
The map layer position setting unit 120 is configured to control to place the reversing auxiliary image map layer on the top layer and place the Android system function map layer on the next layer;
A layer content display position setting unit 121, configured to set the reverse auxiliary image layer to include a reverse auxiliary image, a related setting item, and a transparent region; setting the Android system function layer to comprise an Android system control area, wherein the setting position of the Android system control area corresponds to a transparent area of the reversing auxiliary image layer;
The superposition display unit 122 is configured to superimpose the backup image layer and the Android system function layer, display the backup image layer and the Android system function layer on the display screen of the vehicle-mounted audio host, display the backup image layer and the Android system control area in a region where the backup image layer and the Android system control area are located, and display the backup image layer and the Android system control area in a region where the backup image layer and the Android system control area are located.
Wherein the second fusion processing unit 13 includes:
the image layer setting unit 130 is configured to set a reverse auxiliary image layer on a top layer, and set the reverse auxiliary image layer to include a reverse auxiliary image and related setting items;
and the whole screen display unit 131 is used for displaying the reversing auxiliary image layer on a vehicle-mounted sound host display screen in a whole screen manner.
Wherein, further include:
The touch operation receiving unit 14 is configured to receive a touch operation of the user on the fused central control interface of the vehicle-mounted audio host;
The touch position judging unit 15 is configured to judge whether the touch area belongs to an auxiliary image inner area or an auxiliary image outer area according to coordinates corresponding to the touch control operation;
The analysis processing unit 16 is configured to analyze a control request signal corresponding to the touch area and send the control request signal to a reversing auxiliary image system when the touch position determining unit determines that the touch area is located in an auxiliary image area; and the touch position judging unit judges that the touch area is positioned in the inner and outer areas of the auxiliary image, analyzes a control request signal corresponding to the touch area and sends the control request signal to the pre-corresponding APP.
The reversing auxiliary image system is one of a reversing rearview system (RVC), a reversing panoramic System (SVM) and automatic parking (FAPA).
Correspondingly, in still another aspect of the present invention, a vehicle is further provided, on which a vehicle-mounted audio host and a reversing auxiliary image system are disposed, the vehicle-mounted audio is integrated with an instrument domain QNX system and an Android system, and the vehicle-mounted audio further includes the reversing auxiliary image split screen fusion system 1.
For more details, reference is made to and the description of fig. 4 to 13 is incorporated in the foregoing, and no further description is given here.
The embodiment of the invention has the following beneficial effects:
The invention provides a method, a system and a vehicle for fusing split screens of reversing auxiliary images. When the vehicle has a reversing image demand, judging whether the Android system is started, and overlapping a reversing image layer and an Android system function layer in a cross-system mode if the Android system is started, so that the operation of the Android system is not affected when the reversing image is displayed on a screen; and if Android is not started, the reversing image and the setting item are paved on the screen, so that black screen background is prevented from appearing, and user experience is improved. When the prior art does not disclose the reverse image work, whether Android is successfully started or not is judged, and different picture superposition and layout display schemes are adopted for successful starting and unsuccessful starting.
The scheme provided by the invention can bring the high-quality verification of the auxiliary image fusion scheme to the client, can meet the requirement of the user for quick reversing, can effectively solve the problem of screen rejection and the problem of mismatching of the auxiliary image and the screen resolution, and improves the user experience.
It will be apparent to those skilled in the art that embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above disclosure is only a preferred embodiment of the present invention, and it is needless to say that the scope of the invention is not limited thereto, and therefore, the equivalent changes according to the claims of the present invention still fall within the scope of the present invention.
Claims (10)
1. A reversing auxiliary image fusion method is used in a vehicle-mounted central control host of a dual system and is characterized by at least comprising the following steps:
The vehicle-mounted instrument domain system receives the reversing auxiliary image acquired by the reversing auxiliary image system;
Judging whether the vehicle-mounted central control entertainment system is started completely or not;
If the vehicle-mounted central control entertainment system is started, displaying a reversing auxiliary image layer in the vehicle-mounted instrument domain system and a vehicle-mounted central control entertainment system function layer on a vehicle-mounted central control display screen in a first fusion mode, so that the reversing auxiliary image and the vehicle-mounted central control entertainment system control area are displayed;
And if the vehicle-mounted central control entertainment system is not started, displaying the reversing auxiliary image layer in the vehicle-mounted instrument domain system on the vehicle-mounted central control display screen in a second fusion mode, so that the reversing auxiliary image and related setting items in the reversing auxiliary image layer are paved on the vehicle-mounted central control display screen.
2. The method of claim 1, wherein the step of displaying the backup image layer in the vehicle-mounted instrument domain system and the function layer of the vehicle-mounted central control entertainment system on the vehicle-mounted central control display screen in a first fusion manner to partition the backup image and the control area of the vehicle-mounted central control entertainment system specifically comprises:
the reversing auxiliary image layer in the vehicle-mounted instrument domain system is arranged on the top layer, and the vehicle-mounted central control entertainment system functional layer is arranged on the next layer;
Setting a reversing auxiliary image layer to comprise a reversing auxiliary image, related setting items and a transparent area; the vehicle-mounted central control entertainment system functional layer is arranged to comprise a vehicle-mounted central control entertainment system control area, and the setting position of the vehicle-mounted central control entertainment system control area corresponds to the transparent area of the reversing auxiliary image layer;
And superposing the reversing auxiliary image layer and the vehicle-mounted central control entertainment system functional layer, displaying on a vehicle-mounted sound host display screen, displaying the reversing auxiliary image and the vehicle-mounted central control entertainment system control area in a region in the auxiliary image, displaying the reversing auxiliary image and related setting items in a region outside the auxiliary image, and displaying the vehicle-mounted central control entertainment system control area in a region outside the auxiliary image.
3. The method of claim 1, wherein the step of displaying the reverse auxiliary image layer in the vehicle-mounted instrument domain system on the vehicle-mounted central control display screen in the second fusion manner specifically comprises:
a reversing auxiliary image layer in the vehicle-mounted instrument domain system is arranged on the top layer;
setting the reversing auxiliary image layer to comprise reversing auxiliary images and related setting items;
and displaying the reversing auxiliary image layer on a vehicle-mounted central control display screen in a whole screen manner.
4. A method as claimed in any one of claims 1 to 3, further comprising:
receiving touch operation of a user on the fused vehicle-mounted central control interface;
Judging whether the touch area belongs to an inner area or an outer area of the reversing auxiliary image according to the coordinates corresponding to the touch operation;
If the touch area is judged to be positioned in the reversing auxiliary image, analyzing a control request signal corresponding to the touch area, and sending the control request signal to a reversing auxiliary image system;
And if the touch area is judged to be positioned in the inner and outer areas of the reversing auxiliary image, analyzing a control request signal corresponding to the touch area, and sending the control request signal to the vehicle-mounted central control entertainment system.
5. The method of claim 4, wherein the reverse aid imaging system comprises a reverse rearview system (RVC), a reverse panoramic System (SVM), and auto park (FAPA).
6. The utility model provides a supplementary image fusion system backs a car for in on-vehicle stereo set host computer of dual system, its characterized in that includes at least:
the reversing auxiliary image receiving unit is used for receiving reversing auxiliary images acquired by the reversing auxiliary image system through the vehicle-mounted instrument domain system;
The vehicle-mounted central control entertainment system starting judging unit is used for judging whether the vehicle-mounted central control entertainment system in the vehicle-mounted central control host is started;
the first fusion processing unit is used for displaying a reversing auxiliary image layer in the vehicle-mounted instrument domain system and a vehicle-mounted central control entertainment system function layer on a vehicle-mounted central control display screen in a first fusion mode when the judging result of the vehicle-mounted central control entertainment system starting judging unit is that the vehicle-mounted central control entertainment system is started, so that the reversing auxiliary image and the vehicle-mounted central control entertainment system are displayed in a control area;
And the second fusion processing unit is used for displaying on the vehicle-mounted central control display screen in a second fusion mode when the judging result of the vehicle-mounted central control entertainment system starting judging unit is that the vehicle-mounted central control entertainment system is not started, so that the vehicle-mounted central control display screen is fully paved with the vehicle-mounted auxiliary image and related setting items in the vehicle-mounted auxiliary image layer.
7. The system of claim 6, wherein the first fusion processing unit comprises:
The map layer position setting unit is used for setting a reversing auxiliary image map layer in the vehicle-mounted instrument domain system at the top layer and setting a vehicle-mounted central control entertainment system function map layer at the next layer;
The image layer content display position setting unit is used for setting the reversing auxiliary image layer to contain reversing auxiliary images, related setting items and transparent areas; the vehicle-mounted central control entertainment system functional layer is arranged to comprise a vehicle-mounted central control entertainment system control area, and the setting position of the vehicle-mounted central control entertainment system control area corresponds to the transparent area of the reversing auxiliary image layer;
and the superposition display unit is used for superposing the reversing auxiliary image layer and the vehicle-mounted central control entertainment system functional layer, displaying on a vehicle-mounted sound host display screen, enabling the reversing auxiliary image to be displayed in a region of the reversing auxiliary image and the vehicle-mounted central control entertainment system control region, displaying the reversing auxiliary image and related setting items in the auxiliary image inner region, and displaying the vehicle-mounted central control entertainment system control region in the auxiliary image outer region.
8. The system of claim 6, wherein the second fusion processing unit comprises:
The image layer content setting unit is used for placing a reversing auxiliary image layer in the vehicle-mounted instrument domain system on the top layer and setting the reversing auxiliary image layer to contain reversing auxiliary images and related setting items;
And the whole screen display unit is used for displaying the reversing auxiliary image layer on a vehicle-mounted central control display screen in a whole screen manner.
9. The system according to any one of claims 6 to 8, further comprising:
the touch operation receiving unit is used for receiving the touch operation of the user on the fused vehicle-mounted central control interface;
The touch position judging unit is used for judging whether the touch area belongs to an inner area or an outer area of the auxiliary image of the reversing according to the coordinates corresponding to the touch operation;
The analysis processing unit is used for analyzing a control request signal corresponding to the touch area and sending the control request signal to the reversing auxiliary image system when the touch position judging unit judges that the touch area is positioned in the reversing auxiliary image; and the touch position judging unit judges that the touch area is positioned in the inner and outer areas of the auxiliary image, analyzes a control request signal corresponding to the touch area and sends the control request signal to the vehicle-mounted central control entertainment system.
10. A vehicle having a vehicle-mounted central host provided thereon, comprising a reverse-image-fusion-assist system according to any one of claims 6 to 9.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211237079.0A CN117915023A (en) | 2022-10-10 | 2022-10-10 | Reversing auxiliary image fusion method and system and vehicle |
| PCT/CN2023/115339 WO2024078161A1 (en) | 2022-10-10 | 2023-08-28 | Back-up auxiliary image fusion method and system, and vehicle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211237079.0A CN117915023A (en) | 2022-10-10 | 2022-10-10 | Reversing auxiliary image fusion method and system and vehicle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117915023A true CN117915023A (en) | 2024-04-19 |
Family
ID=90668685
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211237079.0A Pending CN117915023A (en) | 2022-10-10 | 2022-10-10 | Reversing auxiliary image fusion method and system and vehicle |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN117915023A (en) |
| WO (1) | WO2024078161A1 (en) |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110979234A (en) * | 2019-12-25 | 2020-04-10 | 宜宾凯翼汽车有限公司 | Auxiliary reversing reminding system and method |
| CN111708587A (en) * | 2020-08-24 | 2020-09-25 | 广州汽车集团股份有限公司 | Device and method for realizing multimode application of vehicle-mounted air conditioner screen display |
| CN114416231A (en) * | 2021-12-21 | 2022-04-29 | 南京市德赛西威汽车电子有限公司 | Virtual split screen display method and virtual split screen and screen combination switching method for vehicle-mounted entertainment system |
| CN114416243A (en) * | 2021-12-31 | 2022-04-29 | 上海洛轲智能科技有限公司 | Interface display method and device of vehicle-mounted terminal and electronic equipment |
| CN115009016A (en) * | 2022-07-01 | 2022-09-06 | 浙江吉利控股集团有限公司 | Solution method, system, equipment and storage medium for automobile vehicle heater screen display |
-
2022
- 2022-10-10 CN CN202211237079.0A patent/CN117915023A/en active Pending
-
2023
- 2023-08-28 WO PCT/CN2023/115339 patent/WO2024078161A1/en unknown
Also Published As
| Publication number | Publication date |
|---|---|
| WO2024078161A1 (en) | 2024-04-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR100877895B1 (en) | Display article | |
| KR102204250B1 (en) | Method for calculating an augmented reality-overlaying for displaying a navigation route on ar-display unit, device for carrying out the method, as well as motor vehicle and computer program | |
| WO2014118943A1 (en) | Display control system | |
| JP2000127869A (en) | Automatic control system for automobile auxiliary device | |
| US20190210462A1 (en) | Vehicle display device | |
| KR20190088133A (en) | Input output device and vehicle comprising the same | |
| CN110109453B (en) | Automatic driving interface display method and device and vehicle | |
| CN218257742U (en) | All-terrain vehicle | |
| JP4725259B2 (en) | Vehicle information display device | |
| JP2018154245A (en) | Drive support device, drive support method, and program | |
| KR20050033818A (en) | In-car video system | |
| CN113386562B (en) | Intelligent cabin based vehicle-mounted machine AI screen-throwing method, control equipment and vehicle | |
| JP2007076383A (en) | Information display unit for vehicle | |
| WO2007122763A1 (en) | Display system, display system display control method, data display program, and recording medium | |
| JP2019073280A (en) | Drive support apparatus, drive support method, and program | |
| KR20170041418A (en) | Display apparatus for vehicle and control method for the same | |
| CN117915023A (en) | Reversing auxiliary image fusion method and system and vehicle | |
| JP2009090927A (en) | Information management server, parking assist device, navigation system equipped with parking assist device, information management method, parking assist method, information management program, parking assist program, and record medium | |
| CN113071417A (en) | Intelligent cabin with multi-screen interaction, control method thereof and vehicle | |
| JP3907683B2 (en) | In-vehicle display device | |
| KR101807788B1 (en) | Display apparatus for vehicle and control method for the same | |
| KR20170011300A (en) | Input apparatus and vehicle comprising the same | |
| JP2010000843A (en) | Periphery display device | |
| US11977809B2 (en) | Console display interlocking method and vehicle system using the same | |
| CN214689315U (en) | Vehicle-mounted cabin system and vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |