Multi-card link video transmission method
Technical Field
The invention relates to the technical field of video image transmission, in particular to a multi-card link video transmission method.
Background
With the development of transportation and information industries, various video applications based on vehicle networks are receiving wide attention.
The vehicle-mounted real-time voice video communication, the vehicle safety auxiliary driving, the vehicle automatic driving, the multimedia entertainment and the like have important significance in the aspects of guaranteeing the real-time communication, improving the traffic efficiency, enriching the life of people and the like.
However, vehicle network communication is not stable. The reflection of the object to the signal, the high-speed moving characteristics of the vehicle network, the complexity of the road structure and the roadside environment, etc., make the communication performance of the vehicle not reach the communication effect in the daily static state. Therefore, how to provide higher-quality video transmission under the condition of the existing resources is a hot spot of current vehicle-mounted wireless network research.
Disclosure of Invention
In view of this, the present invention aims to provide a multi-card link video transmission method, which has the characteristics of higher speed and stronger robustness than the existing transmission mode, and also has the acquisition capability beyond the visual range when being applied to the vehicle-exterior information acquisition.
The invention provides a multi-card link video transmission method, which comprises the following steps:
s1, collecting image information through a vehicle-mounted camera, outputting the image information to a controller, carrying out focus extraction on the image information, and reducing the size of an image in a mode of reducing the quality of an image outside a focus;
the focus refers to the most concerned part in the video image, generally the middle of the image; specifically, when the camera is applied to vehicle-mounted real-time voice video communication, the main focus is the facial expression and corresponding gestures of a speaker, and the implementation method is face recognition or directly selecting the camera with an automatic face tracking function; when the camera is applied to automatic driving and auxiliary driving, the main focus of attention is a pixel part on a road;
s2, acquiring satellite time service through a satellite observation module, and calculating the specific time for the vehicle-mounted camera to acquire image information in the step S1;
s3, dividing the image information collected in the step S1 into a plurality of low-quality sub-images, wherein the number of the divided sub-images is matched with the number of 5G communication modules in the multi-card link transmission module;
s4, marking a plurality of sub-images generated in the step S3 with time stamps, wherein the time stamps are specific time calculated in the step S2;
the sub-image marked with the timestamp carries the vehicle position information during the acquisition of the original image;
and S5, respectively transmitting the plurality of sub-images marked with the time stamps through different 5G communication modules in the multi-card link transmission module, and restoring the images.
Further, when the bicycle is operated, the step of S5 is followed by the following steps:
s6a, when the video transmission method is applied to a real-time scene, the sub-images arriving through different links are acquired, then the information of the first arriving sub-image is utilized firstly according to the timestamp information and the principle of first arrival and first acquisition, the vehicle safety is guaranteed, and when the subsequent sub-images arrive, the original image is restored;
s7a, when partial sub-images are not transmitted successfully, abandoning the partial sub-images which are not transmitted successfully, recovering the original images from the acquired sub-images, and/or feeding back the vehicle-mounted control module, and transmitting the deficient sub-images by other 5G communication modules;
the missing pixels in the original image pixels are supplemented with pixel points in a mean value or gradual change mode according to the nearby pixels, and/or the missing pixels are fed back to the vehicle-mounted control module, and other 5G modules transmit the missing sub-images;
and S8a, when the image needs to be transmitted to the vehicle-mounted display module, the vehicle-mounted control module realizes the final restoration of the image by adopting the processing logic of S6a-S7 a.
Further, in the step S7a, the original image is restored from the acquired sub-images, and pixels are supplemented to missing pixels in the original image in a mean value or gradient manner according to nearby pixels.
Further, when the multi-vehicle ad hoc network is operated cooperatively, the step of S5 is followed by the following steps:
s6b, acquiring information of other nearby vehicles through the near field wireless communication module, and networking;
s7b, acquiring satellite observation information through a satellite observation module, and acquiring current vehicle position information through the service of the existing RTK base station;
s8b, applying for obtaining video information of other vehicles according to the requirements of an operator according to the position relation of the current vehicle and other vehicles;
s9b, sending the video information of the other vehicles obtained by the application through the near field wireless communication module to obtain permission, and transmitting the video information back through the near field wireless communication module.
Further, when the multi-vehicle server is cooperatively operated, the step of S5 further includes the following steps:
s6c, after image information from different vehicles is obtained through the server, image splicing is carried out according to the timestamp information and the vehicle position information, and a spliced image with richer information is generated;
and S7c, applying to a server to obtain real-time data outside the sight distance of the periphery of the vehicle.
The invention also provides a multi-card link video transmission system, comprising: the system comprises a multi-card link transmission module, a satellite observation module, a near field wireless communication module, a vehicle-mounted display module, a vehicle-mounted control module and a server;
multi-card link transmission module: preferably, the mobile communication system comprises a plurality of 5G communication modules, which are respectively connected with the control module, and each 5G communication module is used for accessing to an operator mobile communication network;
a satellite observation module: the system comprises a satellite receiving module, a time module, a carrier phase module and a time module, wherein the satellite receiving module is used for receiving satellite signals and generating time information for time service and carrier phase information for positioning;
a near field wireless communication module: WIFI and/or Bluetooth and/or UWB, and is used for communication among different vehicles in a short distance;
a vehicle-mounted display module: the device comprises a liquid crystal display and a loudspeaker, wherein the liquid crystal display is used for outputting and displaying voice and video information, and comprises a touch screen for inputting operation information;
a server: the remote server is used for receiving, storing, processing and forwarding the information;
a vehicle-mounted control module: the system comprises a vehicle-mounted part, a multi-card link transmission module, a server and a control module, wherein the vehicle-mounted part is used for controlling the vehicle-mounted part, receiving data of a vehicle-mounted camera, carrying out image processing and encoding operation and transmitting the data to the server through the multi-card link transmission module; and receiving the data of the server through the multi-card link transmission module and outputting the data to the vehicle-mounted display module.
Furthermore, the video transmission system also comprises a vehicle-mounted camera, and the vehicle-mounted camera comprises a vehicle-mounted in-vehicle video image acquisition module with a real-time voice video communication function and/or a vehicle-mounted out-vehicle video image acquisition module with an automatic driving and auxiliary driving function so as to transmit acquired data to the control module.
Further, the vehicle-mounted control module communicates with other nearby vehicles through the near field wireless communication module.
Further, the vehicle-mounted control module receives satellite observation data from the satellite observation module.
Further, the vehicle-mounted display module is used for displaying the position relation between the current vehicle and other vehicles.
Compared with the prior art, the invention has the beneficial effects that:
the invention is based on 5G communication and multi-card link video transmission, has the characteristics of higher transmission rate and stronger robustness, and also has the acquisition capability beyond the visual range when being applied to the acquisition of information outside a vehicle.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention.
In the drawings:
FIG. 1 is a flow chart of a multi-card link video transmission method of the present invention;
FIG. 2 is a schematic diagram of the principles of the present invention;
FIG. 3 is a schematic diagram of the image segmentation principle for segmenting 4 images;
FIG. 4 is a flow chart further included in the operation of a bicycle in accordance with an embodiment of the present invention;
FIG. 5 is a flow chart further included in a multi-vehicle ad hoc network collaborative operation according to an embodiment of the present invention;
FIG. 6 is a flow chart further included in the multi-vehicle server cooperation of an embodiment of the present invention.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
The terminology used in the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used in this disclosure and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present disclosure. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
The invention provides a multi-card link video transmission method, which is shown in figure 1 and comprises the following steps:
s1, collecting image information through a vehicle-mounted camera, outputting the image information to a controller, carrying out focus extraction on the image information, and reducing the size of an image in a mode of reducing the quality of an image outside a focus;
the focus refers to the most concerned part in the video image, generally the middle of the image; specifically, when the camera is applied to vehicle-mounted real-time voice video communication, the main focus is the facial expression and corresponding gestures of a speaker, and the implementation method is face recognition or directly selecting the camera with an automatic face tracking function; when the camera is applied to automatic driving and auxiliary driving, the main focus of attention is a pixel part on a road;
s2, acquiring satellite time service through a satellite observation module, and calculating the specific time for the vehicle-mounted camera to acquire image information in the step S1;
s3, referring to fig. 3, the image information collected in step S1 is divided into a plurality of sub-images of low quality, and the number of the divided sub-images matches the number of 5G communication modules in the multi-card link transmission module;
s4, marking a plurality of sub-images generated in the step S3 with time stamps, wherein the time stamps are specific time calculated in the step S2;
the sub-image marked with the timestamp carries the vehicle position information during the acquisition of the original image;
and S5, respectively transmitting the plurality of sub-images marked with the time stamps through different 5G communication modules in the multi-card link transmission module, and restoring the images.
When the bicycle is operated, referring to fig. 4, the step S5 further includes the following steps:
s6a, when the video transmission method is applied to a real-time scene, the sub-images arriving through different links are acquired, then the information of the first arriving sub-image is utilized firstly according to the timestamp information and the principle of first arrival and first acquisition, the vehicle safety is guaranteed, and when the subsequent sub-images arrive, the original image is restored;
s7a, when partial sub-images are not transmitted successfully, abandoning the partial sub-images which are not transmitted successfully, recovering the original images from the acquired sub-images, and/or feeding back the vehicle-mounted control module, and transmitting the deficient sub-images by other 5G communication modules;
the missing pixels in the original image pixels are supplemented with pixel points in a mean value or gradual change mode according to the nearby pixels, and/or the missing pixels are fed back to the vehicle-mounted control module, and other 5G modules transmit the missing sub-images;
and S8a, when the image needs to be transmitted to the vehicle-mounted display module, the vehicle-mounted control module realizes the final restoration of the image by adopting the processing logic of S6a-S7 a.
In the step S7a, the original image is restored from the acquired sub-images, and pixels are supplemented to missing pixels in the pixels of the original image in a mean value or gradient manner according to nearby pixels.
When the ad hoc network is a multi-vehicle ad hoc network, referring to fig. 5, the step S5 further includes the following steps:
s6b, acquiring information of other nearby vehicles through the near field wireless communication module, and networking;
s7b, acquiring satellite observation information through a satellite observation module, and acquiring current vehicle position information through the service of the existing RTK base station;
s8b, applying for obtaining video information of other vehicles according to the requirements of an operator according to the position relation of the current vehicle and other vehicles;
s9b, sending the video information of the other vehicles obtained by the application through the near field wireless communication module to obtain permission, and transmitting the video information back through the near field wireless communication module.
When the multi-vehicle server is operated cooperatively, referring to fig. 6, the step S5 further includes the following steps:
s6c, after image information from different vehicles is obtained through the server, image splicing is carried out according to the timestamp information and the vehicle position information, and a spliced image with richer information is generated;
and S7c, applying to a server to obtain real-time data outside the sight distance of the periphery of the vehicle.
The present invention also provides a multi-card link video transmission system, as shown in fig. 2, including: the system comprises a multi-card link transmission module, a satellite observation module, a near field wireless communication module, a vehicle-mounted display module, a vehicle-mounted control module and a server;
multi-card link transmission module: preferably, the mobile communication system comprises a plurality of 5G communication modules, which are respectively connected with the control module, and each 5G communication module is used for accessing to an operator mobile communication network;
a satellite observation module: the system comprises a satellite receiving module, a time module, a carrier phase module and a time module, wherein the satellite receiving module is used for receiving satellite signals and generating time information for time service and carrier phase information for positioning;
a near field wireless communication module: WIFI and/or Bluetooth and/or UWB, and is used for communication among different vehicles in a short distance;
a vehicle-mounted display module: the device comprises a liquid crystal display and a loudspeaker, wherein the liquid crystal display is used for outputting and displaying voice and video information, and comprises a touch screen for inputting operation information;
a server: the remote server is used for receiving, storing, processing and forwarding the information;
a vehicle-mounted control module: the system comprises a vehicle-mounted part, a multi-card link transmission module, a server and a control module, wherein the vehicle-mounted part is used for controlling the vehicle-mounted part, receiving data of a vehicle-mounted camera, carrying out image processing and encoding operation and transmitting the data to the server through the multi-card link transmission module; and receiving the data of the server through the multi-card link transmission module and outputting the data to the vehicle-mounted display module.
The video transmission system also comprises a vehicle-mounted camera, wherein the vehicle-mounted camera comprises a vehicle-mounted in-vehicle video image acquisition module with a real-time voice video communication function and/or a vehicle-mounted out-vehicle video image acquisition module with an automatic driving and auxiliary driving function so as to transmit acquired data to the control module;
preferably, the vehicle-mounted camera comprises a microphone function, collects sound information and transmits the sound information and video image information at the same time; in addition, the video image information according to the present invention includes corresponding audio information, unless otherwise specified.
And the vehicle-mounted control module is communicated with other nearby vehicles through the near field wireless communication module.
And the vehicle-mounted control module receives satellite observation data from the satellite observation module.
And the vehicle-mounted display module is used for displaying the position relation between the current vehicle and other vehicles.
Compared with the prior art, the invention has the beneficial effects that:
the invention is based on 5G communication and multi-card link video transmission, has the characteristics of higher transmission rate and stronger robustness, and also has the acquisition capability beyond the visual range when being applied to the acquisition of information outside a vehicle.
So far, the technical solutions of the present invention have been described in connection with the preferred embodiments shown in the drawings, but it is easily understood by those skilled in the art that the scope of the present invention is obviously not limited to these specific embodiments. Equivalent changes or substitutions of related technical features can be made by those skilled in the art without departing from the principle of the invention, and the technical scheme after the changes or substitutions can fall into the protection scope of the invention.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention; various modifications and alterations to this invention will become apparent to those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.