CN114627449A

CN114627449A - Vehicle appearance real-time rendering method and device based on v2x and vehicle

Info

Publication number: CN114627449A
Application number: CN202210257756.9A
Authority: CN
Inventors: 刘磊
Original assignee: FAW Group Corp
Current assignee: FAW Group Corp
Priority date: 2022-03-16
Filing date: 2022-03-16
Publication date: 2022-06-14

Abstract

The application provides a vehicle appearance real-time rendering method and device based on v2x and a vehicle. The real-time rendering method based on the v2x vehicle appearance comprises the following steps: acquiring image information transmitted from the outside; and rendering the vehicle appearance image in the image information, so that the rendered vehicle appearance image is displayed on a vehicle instrument and/or a central control screen. According to the vehicle appearance real-time rendering method based on the v2x, during driving, rendering processing can be performed through image information (such as a camera on a road, a camera device of a vehicle driving on the same road and the like) transmitted from the outside, and image data is processed and a three-dimensional image is synthesized and then rendered on a screen of a central control of an instrument in the vehicle and the like.

Description

Vehicle appearance real-time rendering method and device based on v2x and vehicle

Technical Field

The application belongs to the technical field of vehicle-mounted screen display, and particularly relates to a vehicle appearance real-time rendering method based on v2x, a vehicle appearance real-time rendering device based on v2x and a vehicle.

Background

At present, screens such as a central control screen of an instrument in a vehicle mostly show a preset static two-dimensional or three-dimensional image of the vehicle, and the appearance of the vehicle cannot be rendered in real time.

Or screens such as an in-vehicle instrument central control screen of some vehicles can show appearance diagrams of different colors for the vehicles, but cannot show the real-time appearance diagram of the current vehicle.

Accordingly, a technical solution is desired to overcome or at least alleviate at least one of the above-mentioned drawbacks of the prior art.

Disclosure of Invention

The present application is directed to providing a method for rendering a vehicle appearance in real time based on v2x to solve at least one of the above problems.

In a first aspect of the present application, there is provided a v2 x-based vehicle appearance real-time rendering method, the v2 x-based vehicle appearance real-time rendering method comprising:

acquiring image information transmitted from the outside;

and rendering the vehicle appearance image in the image information, so that the rendered vehicle appearance image is displayed on a vehicle instrument and/or a central control screen.

Optionally, before the obtaining the externally transmitted image information, the rendering in real time based on the v2x vehicle appearance further comprises:

acquiring communication information of each camera device capable of communicating with a vehicle;

sending an image acquisition request to one or more camera devices capable of communicating with the vehicle according to the communication information;

the acquiring externally transmitted image information includes:

and acquiring the image information sent by the image pickup device responding to the image acquisition request.

Alternatively, the camera device comprises a camera device for other vehicles,

when the camera device is a camera device for other vehicles, the sending an image acquisition request to one or more camera devices capable of communicating with the vehicle according to the communication information comprises:

acquiring current vehicle position information and current vehicle running speed information;

acquiring vehicle position information of each vehicle provided with the other vehicle camera device and running speed information of each vehicle provided with the other vehicle camera device, wherein the current vehicle position information, the current vehicle running speed information, the vehicle position information of the vehicle of the other vehicle camera device and the running speed information of the vehicle of the other vehicle camera device form a vehicle image selection factor;

an image acquisition request is sent to one or more other vehicle image capturing devices in accordance with the vehicle image selection factor selectivity.

Optionally, the selectively sending an image acquisition request to one or more other vehicle cameras according to the vehicle image selection factor includes:

acquiring the distance difference between the current vehicle and other vehicles according to the current vehicle position information and the vehicle position information of the vehicle of other vehicle cameras;

acquiring the running speed information of the vehicle of the current vehicle and other vehicle cameras within preset time according to the running speed information of the current vehicle and the running speed information of the vehicle of other vehicle cameras, judging whether the distance difference between the current vehicle and other vehicles is reduced to be within a preset threshold value or not, and if not, judging whether the distance difference between the current vehicle and other vehicles is reduced to be within the preset threshold value

And sending an image acquisition request to the other vehicle camera device when the distance difference between the current vehicle and the other vehicle is not reduced to be within a preset threshold value.

Optionally, the camera device comprises a fixed camera device for a road;

when the camera device is a fixed camera device for a road, the sending an image acquisition request to one or more camera devices capable of communicating with a vehicle according to the communication information comprises:

acquiring position information of fixed camera devices of the fixed camera devices for the roads;

and selectively sending an image acquisition request to one or more other vehicle camera devices according to the current vehicle position information, the current vehicle running speed information and the fixed camera device position information.

Optionally, the selectively sending an image acquisition request to one or more other vehicle cameras according to the current vehicle position information, the current vehicle driving speed information, and the fixed camera position information includes:

acquiring the distance difference between the current vehicle and a fixed camera device for the road according to the current vehicle position information and the fixed camera device position information;

judging whether the distance difference between the current vehicle and other vehicles is reduced to be within a preset threshold value within preset time according to the running speed of the current vehicle, and if not, judging whether the distance difference between the current vehicle and other vehicles is reduced to be within a preset threshold value

And sending an image acquisition request to the road fixed camera device, wherein the distance difference between the current vehicle and the road fixed camera device is not reduced to be within a preset threshold value.

Optionally, the rendering the vehicle appearance image in the image information so that the rendered vehicle appearance image is displayed on a vehicle instrument and/or a central control screen includes:

identifying the image information, judging whether the image information comprises a vehicle image, if so, judging that the image information comprises the vehicle image

And comparing the similarity of the vehicle image with a preset vehicle image, and if the similarity is greater than a preset similarity threshold value, taking the vehicle image as a vehicle appearance image.

Optionally, the communication with each camera device is performed by a v2x protocol.

The application also provides a vehicle appearance real-time rendering device based on v2x, the vehicle appearance real-time rendering device based on v2x includes:

the acquisition module is used for acquiring image information transmitted from the outside;

and the rendering processing module is used for rendering the vehicle appearance image in the image information, so that the rendered vehicle appearance image is displayed on a vehicle instrument and/or a central control screen.

The application also provides a vehicle comprising the real-time rendering device based on the v2x vehicle appearance.

The application has at least the following beneficial technical effects:

according to the vehicle appearance real-time rendering method based on the v2x, during driving, rendering processing can be performed through image information (such as a camera on a road, a camera device of a vehicle driving on the same road and the like) transmitted from the outside, and image data is processed and a three-dimensional image is synthesized and then rendered on a screen of a central control of an instrument in the vehicle and the like.

Drawings

Fig. 1 is a schematic flowchart of a method for rendering a vehicle appearance in real time based on v2x according to an embodiment of the present disclosure.

Fig. 2 is an exemplary block diagram of an electronic device capable of implementing a v2 x-based vehicle appearance real-time rendering method according to an embodiment of the present application.

Detailed Description

In order to make the implementation objects, technical solutions and advantages of the present application clearer, the technical solutions in the embodiments of the present application will be described in more detail below with reference to the drawings in the embodiments of the present application. In the drawings, the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The described embodiments are a subset of the embodiments in the present application and not all embodiments in the present application. The embodiments described below with reference to the drawings are exemplary and intended to be used for explaining the present application and should not be construed as limiting the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application. Embodiments of the present application will be described in detail below with reference to the accompanying drawings.

It should be noted that the terms "first" and "second" in the description of the present invention are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.

Fig. 1 is a schematic flowchart of a method for rendering a vehicle in real time based on a v2x appearance according to an embodiment of the present application.

The real-time rendering method based on the v2x vehicle appearance as shown in FIG. 1 comprises the following steps:

step 1: acquiring image information transmitted from the outside;

step 2: and rendering the vehicle appearance image in the image information, so that the rendered vehicle appearance image is displayed on a vehicle instrument and/or a central control screen.

In the embodiment, the v2 x-based vehicle appearance real-time rendering method of the present application can be used in a road driving process, and the external part of the present application refers to a device which is not directly connected with the vehicle through a connecting line, for example, a camera device at two sides of a road, a camera device of an automobile which is driven in one area simultaneously with the vehicle of the present application, and the like.

In the present embodiment, the image information transferred from the outside is transferred by the v2x protocol.

In the present embodiment, before acquiring the externally transmitted image information, the rendering in real time based on the vehicle appearance of v2x further includes:

acquiring externally transmitted image information includes:

When image information transmitted from the outside needs to be acquired, a plurality of image pickup devices capable of providing image information for the vehicle may be arranged around the vehicle, and in this case, an image acquisition request may be selectively sent to one or more of the image pickup devices, so that the image information is selectively acquired.

In one embodiment, the imaging device includes an imaging device for another vehicle, that is, an imaging device on another non-own vehicle, and for example, an imaging device for a vehicle that runs on a highway and runs in the same direction as the vehicle of the present application is an imaging device for another vehicle.

In this embodiment, when the camera device is a camera device for another vehicle, the sending of the image acquisition request to one or more camera devices that can communicate with the vehicle according to the communication information includes:

By selecting in this way, on the one hand, resources can be saved, and image acquisition requests do not need to be sent to unnecessary camera devices for other vehicles, for example, when the vehicle of the present application is running, a vehicle is in front of the vehicle of the present application, and the vehicle is not provided with a rear-view camera device, the vehicle of the present application cannot be photographed in appearance, and at this time, the image acquisition requests do not need to be sent to the vehicle, and for example, when some vehicles are far away from the vehicle of the present application, the vehicle of the present application may not be photographed, and therefore, the image acquisition requests do not need to be sent to the vehicle.

In this embodiment, selectively transmitting an image acquisition request to one or more other vehicle-use image capturing apparatuses in accordance with a vehicle-use image selection factor includes:

By adopting the mode, whether the camera device of the other vehicle can shoot the appearance of the vehicle of the application can be judged according to the position and the distance of the vehicle, so that the acquired image information has the appearance image of the vehicle of the application as much as possible.

In other embodiments, the relative position relationship between the other vehicle and the vehicle may also be determined by the vehicle position, for example, by means of GPS positioning or the like, it may be known whether the other vehicle is on the left side, the right side, the front side, or the rear side of the application, so that it is possible to further select the vehicle that is mainly located on the left side, the right side, and the rear side of the application to send the image acquisition request.

In this embodiment, in a manner that the distance difference between the current vehicle and another vehicle is not reduced to the preset threshold, it is also possible to prevent the vehicle that is to send the image acquisition request from being too close to the vehicle of the present application, which may result in a problem that relatively complete image information cannot be captured.

For example, when one other vehicle a is 10 meters away from the vehicle of the present application, it may completely take a complete picture of the vehicle of the present application at a certain angle (for example, a tail appearance, a left side appearance or a right side appearance), and if the vehicle a is only 1 meter away from the present application, it may only take a partial picture of the vehicle at a certain angle, and at this time, the picture is less valuable, so that this situation can be avoided.

In one embodiment, the camera comprises a fixed camera for the roadway. In the present embodiment, the fixed image pickup device for roads generally refers to those image pickup devices that are fixed, such as image pickup devices under bridges, image pickup devices on street lamps, and the like.

In this embodiment, when the image pickup apparatus is a fixed image pickup apparatus for a road, transmitting an image acquisition request to one or more image pickup apparatuses capable of communicating with the vehicle based on the communication information includes:

Since the fixed camera itself does not move, it is only necessary to selectively transmit an image acquisition request to one or more other vehicle cameras based on the current vehicle position information, the current vehicle travel speed information, and the fixed camera position information.

In the present embodiment, selectively transmitting an image acquisition request to one or more other vehicle-use imaging devices based on the current vehicle position information, the current vehicle travel speed information, and the fixed imaging device position information includes:

It can be understood that, in the present application, each of the image capturing devices may capture a local image, and at this time, the image information captured by each of the image capturing devices may be combined to form the vehicle appearance image required by the present application, for example, first, image data is obtained, the image data is subjected to the deformation correction, the target vehicle is obtained according to the vehicle characteristic value and the position angle information, and the target vehicle image is sliced. And extracting depth features of the slices based on the convolutional neural network, performing depth retrieval according to a built-in three-dimensional model of the target vehicle, finding a position matched with the feature value of the slices, updating the three-dimensional model, and rendering an image to a screen. The vehicle appearance image of the application can also be made, and the part which can be acquired through the image information is subjected to mapping processing, so that a complete vehicle appearance image is formed.

In the present embodiment, rendering the vehicle appearance image in the image information so that the rendered vehicle appearance image is displayed on the vehicle appearance and/or the center screen includes:

identifying image information, judging whether the image information comprises a vehicle image, if so, judging whether the image information comprises the vehicle image

In this embodiment, the vehicle image may be a partial vehicle image, and the preset vehicle image may also be a partial image, for example, an image of a certain portion (for example, a rear bumper, a front hood, a door, etc.), or an image of a certain area (for example, a side view of a left front door, a left rear door, a left wheel, etc.).

In the present embodiment, the communication with each image pickup device is performed by the v2x protocol.

The application also provides a vehicle appearance real-time rendering device based on v2x, wherein the vehicle appearance real-time rendering device based on v2x comprises an acquisition module and a rendering processing module, and the acquisition module is used for acquiring image information transmitted from the outside; the rendering processing module is used for rendering the vehicle appearance image in the image information, so that the rendered vehicle appearance image is displayed on a vehicle instrument and/or a central control screen.

The application also provides a vehicle comprising the v2 x-based vehicle appearance real-time rendering device.

The application also provides an electronic device, which comprises a memory, a processor and a computer program which is stored in the memory and can run on the processor, wherein the vehicle-mounted internet access method based on the Portal authentication network is realized when the processor executes the computer program. It will be appreciated that the electronic device may be the general controller described above.

The application also provides a computer readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the vehicle-mounted internet access method based on the Portal authentication network can be realized.

Fig. 2 is an exemplary structural diagram of an electronic device capable of implementing a vehicle-mounted internet access method based on a Portal authentication network according to an embodiment of the present application.

As shown in fig. 2, the electronic device includes an input device 501, an input interface 502, a central processor 503, a memory 504, an output interface 505, and an output device 506. The input interface 502, the central processing unit 503, the memory 504 and the output interface 505 are connected to each other through a bus 507, and the input device 501 and the output device 506 are connected to the bus 507 through the input interface 502 and the output interface 505, respectively, and further connected to other components of the electronic device. Specifically, the input device 504 receives input information from the outside and transmits the input information to the central processor 503 through the input interface 502; the central processor 503 processes input information based on computer-executable instructions stored in the memory 504 to generate output information, temporarily or permanently stores the output information in the memory 504, and then transmits the output information to the output device 506 through the output interface 505; the output device 506 outputs the output information to the outside of the electronic device for use by the user.

That is, the electronic device shown in fig. 2 may also be implemented to include: a memory storing computer-executable instructions; and one or more processors that when executing computer executable instructions may implement the Portal authentication network based in-vehicle internet access method described in connection with fig. 1.

In one embodiment, the electronic device shown in fig. 2 may be implemented to include: a memory 504 configured to store executable program code; one or more processors 503 configured to execute the executable program code stored in the memory 504 to perform the onboard internet access method based on the Portal authentication network in the above-described embodiments.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

Computer-readable media include both non-transitory and non-transitory, removable and non-removable media that implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Furthermore, it will be obvious that the term "comprising" does not exclude other elements or steps. A plurality of units, modules or devices recited in the device claims may also be implemented by one unit or overall device by software or hardware.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks identified in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The Processor in this embodiment may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, a discrete hardware component, and so on. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The memory may be used to store computer programs and/or modules, and the processor may implement various functions of the apparatus/terminal device by running or executing the computer programs and/or modules stored in the memory, as well as by invoking data stored in the memory. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, etc. In addition, the memory may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device.

In this embodiment, the module/unit integrated with the apparatus/terminal device may be stored in a computer-readable storage medium if it is implemented in the form of a software functional unit and sold or used as a separate product. Based on such understanding, all or part of the flow in the method according to the embodiments of the present invention may also be implemented by a computer program to instruct related hardware, where the computer program may be stored in a computer readable storage medium, and when the computer program is executed by a processor, the computer program may implement the steps of the embodiments of the method. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying computer program code, recording medium, U.S. disk, removable hard disk, magnetic diskette, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signal, telecommunications signal, software distribution medium, etc. It should be noted that the computer readable medium may contain content that is appropriately increased or decreased as required by legislation and patent practice in the jurisdiction. Although the present application has been described with reference to the preferred embodiments, it is not intended to limit the present application, and those skilled in the art can make variations and modifications without departing from the spirit and scope of the present application.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and so forth) having computer-usable program code embodied therein.

Finally, it should be pointed out that: the above examples are only for illustrating the technical solutions of the present invention, and are not limited thereto. Although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims

1. A v2 x-based vehicle appearance real-time rendering method is characterized in that the v2 x-based vehicle appearance real-time rendering method comprises the following steps:

acquiring image information transmitted from the outside;

2. The v2 x-based vehicle appearance real-time rendering method of claim 1, wherein prior to the obtaining externally communicated image information, the v2 x-based vehicle appearance real-time rendering further comprises:

the acquiring of the externally transferred image information includes:

3. The real-time rendering method based on v2x vehicle appearance according to claim 2, wherein the camera includes a camera for other vehicles,

4. The v2 x-based vehicle appearance real-time rendering method of claim 3,

the transmitting an image acquisition request to one or more other vehicle imaging devices in accordance with vehicle image selection factor selectivity includes:

5. The v2 x-based vehicle appearance real-time rendering method of claim 2, wherein the camera comprises a road-use stationary camera; it is characterized in that the preparation method is characterized in that,

acquiring position information of a fixed camera device of each fixed camera device for roads;

6. The v2 x-based vehicle appearance real-time rendering method of claim 5, wherein the selectively sending image acquisition requests to one or more cameras for other vehicles according to the current vehicle position information, current vehicle travel speed information, and fixed camera position information comprises:

And sending an image acquisition request to the road fixed camera device when the distance difference between the current vehicle and the road fixed camera device is not reduced to be within a preset threshold value.

7. The v2 x-based real-time vehicle appearance rendering method as claimed in any one of claims 1 to 6, wherein the rendering of the vehicle appearance image in the image information so that the rendered vehicle appearance image is displayed on a vehicle instrument and/or a central control screen comprises:

8. The v2 x-based vehicle appearance real-time rendering method of claim 7, wherein the communication with each camera is via a v2x protocol.

9. A v2 x-based vehicle appearance real-time rendering device, wherein the v2 x-based vehicle appearance real-time rendering device comprises:

10. A vehicle comprising the v2 x-based vehicle appearance real-time rendering apparatus of claim 9.