CN116828262A - Video signal splitting method and device - Google Patents

Abstract

The embodiment of the invention provides a video signal splitting method and device. The video signal splitting method is applied to image acquisition equipment, and the image acquisition equipment is established with a first communication link and a second communication link. In the method, when the image acquisition equipment senses that the network delay exists in the first communication link, video detail data in the real-time video signal data stream can be extracted when the video transmission is possibly unstable, the video detail data is sent to a video receiving end, namely the rear end, through the second communication link, and the extracted real-time video signal data stream occupies smaller bandwidth when being transmitted, has higher transmission speed and can be smoothly transmitted through the first communication link. Therefore, even if the network has delay, the image acquisition equipment can adapt to the network delay and transmit real-time video data to the rear end, so that the stability of video signal data transmission can be ensured when the network delay is higher, and the rear end can have good perception experience.

Description

A video signal branching method and device

Technical field

The present invention relates to the field of data processing, and specifically to a video signal branching method and device.

Background technique

With the development of 5G, big data, cloud platforms and autonomous driving technology, autonomous driving technology has become mature. At present, many cities have laid out autonomous driving demonstration operation routes and launched point-to-point autonomous driving online ride-hailing services. With the continuous development of artificial intelligence technology, big data and other technologies, the technical barriers to driverless driving are constantly being broken through, and driverless driving has gradually begun to be applied. In order to ensure the safety of driverless driving, the video stream collected during the driverless driving process needs to be transmitted to the backend in real time, so that the backend can perceive the driving status of the vehicle in real time and control the vehicle when necessary to ensure safety. .

However, the current video transmission technology is not reliable enough, causing the back-end video stream to be unstable when receiving, and the back-end perception experience is not very good.

Contents of the invention

In view of this, the purpose of the present invention is to provide a video signal offloading method and device that can ensure the stability of video signal data transmission and ensure a good perceptual experience at the back end even when the network delay is high.

In order to achieve the above objects, the technical solutions adopted in the embodiments of the present invention are as follows:

In a first aspect, the present invention provides a video signal shunting method, which is applied to an image acquisition device. The image acquisition device establishes a first communication link and a second communication link. Wherein, the video signal offloading method described in the first aspect includes: obtaining the network delay of the first communication link and the real-time video signal data stream; when the network delay of the first communication link is greater than the first preset value , extract the video detail data in the real-time video signal data stream to obtain the real-time video signal data stream after the details are extracted; send the real-time video signal data stream after the details are extracted to the video receiving end through the first communication link ;Sending the video detail data to the video receiving end through the second communication link; sending video merging instruction information to the video receiving end through the second communication link; the video merging instruction information is used to Instruction: restore and play the real-time video signal data stream after extracting details according to the video detail data.

In an optional embodiment of the present invention, when the network delay of the first communication link is greater than a first preset value, the step of extracting the video detail data in the real-time video signal data stream includes: When the network delay of the first communication link is greater than the first preset value, N pieces of pixel information are extracted from the key frames of the real-time video signal data stream; where N is an integer greater than 1; The N pieces of pixel information are determined as the video detail data.

In an optional embodiment of the present invention, N is positively related to the network delay of the first communication link.

In an optional embodiment of the present invention, N is determined by the following formula: ; Where, k is a constant, and PING is the network delay of the first communication link.

In an optional embodiment of the present invention, the step of extracting N pixel information from the key frames of the real-time video signal data stream includes: detecting the type of real-time video according to the real-time video signal data stream; when the When the type of the real-time video is a person video, N pixel information other than the person is extracted from the key frames of the real-time video signal data stream; when the type of the real-time video is an item video, the real-time video signal data is extracted from the key frames of the real-time video signal data stream. The N pixel information other than the item in the center of the screen is extracted from the key frame of the stream.

In an optional embodiment of the present invention, the video signal offloading method described in the first aspect further includes: when the type of the real-time video is a type other than the person video and the item video, in the real-time video N pixel information is evenly extracted from the key frames of the signal data stream.

In an optional embodiment of the present invention, the video signal offloading method described in the first aspect further includes: obtaining the network delay of the second communication link; when the network delay of the second communication link is greater than the second predetermined When the value is set, low-quality playback information is sent to the video receiving end through the first communication link; wherein the low-quality playback information is used to indicate: according to the real-time video signal data stream after extracting details to play.

In an optional embodiment of the present invention, the image acquisition device is installed on an autonomous vehicle, and the image acquisition device establishes the second communication link with a router on the autonomous vehicle that provides Wi-Fi signals. path, the router is also connected to the user's terminal equipment; wherein, the video signal offloading method described in the first aspect further includes: when the network delay of the second communication link is greater than the second preset value, The router sends speed limit indication information; the speed limit indication information is used to instruct: reduce the communication rate with the user's terminal device.

In a second aspect, the present invention provides a video signal shunting device, which is applied to an image acquisition device. The image acquisition device establishes a first communication link and a second communication link. The video signal branching device described in the second aspect includes a transceiver module and a processing module. Wherein, the transceiver module is used to obtain the network delay of the first communication link and the real-time video signal data stream; the processing module is used to obtain the network delay of the first communication link when the network delay is greater than the first preset When the value is reached, extract the video detail data in the real-time video signal data stream to obtain the real-time video signal data stream after the details are extracted; the transceiver module is also used to send all the video details to the video receiving end through the first communication link. The real-time video signal data stream after extracting details; the transceiver module is also used to send the video detail data to the video receiving end through the second communication link; the transceiver module is also used to transmit the video detail data to the video receiving end through the second communication link; The second communication link sends video merging instruction information to the video receiving end; the video merging instruction information is used to instruct: to restore and play the detailed real-time video signal data stream according to the video detail data. .

In an optional embodiment of the present invention, the processing module is further configured to: when the network delay of the first communication link is greater than the first preset value, the real-time video signal data stream is N pieces of pixel information are extracted from the key frame; where N is an integer greater than 1; the processing module is also used to determine the N pieces of pixel information as the video detail data.

In an optional embodiment of the present invention, N is positively related to the network delay of the first communication link.

In an optional embodiment of the present invention, N is determined by the following formula: ; Where, k is a constant, and PING is the network delay of the first communication link.

In an optional embodiment of the present invention, the processing module is also used to detect the type of real-time video according to the real-time video signal data stream; the processing module is also used to detect the type of real-time video when the type of real-time video is a person video. When the type of the real-time video is an item video, extract N pixel information other than the person in the key frame of the real-time video signal data stream; the processing module is also used to extract the real-time video signal data The N pixel information other than the item in the center of the screen is extracted from the key frame of the stream.

In an optional embodiment of the present invention, the processing module is also configured to: when the type of the real-time video is a type other than the person video and the item video, at the key point of the real-time video signal data stream N pixel information is evenly extracted from the frame.

In an optional embodiment of the present invention, the processing module is also used to obtain the network delay of the second communication link; the transceiver module is also used to obtain the network delay of the second communication link when the network delay of the second communication link is greater than At the second preset value, low-quality playback information is sent to the video receiving end through the first communication link; wherein the low-quality playback information is used to indicate: according to the real-time video after extracting details Signal data stream for playback.

In an optional embodiment of the present invention, the image acquisition device is installed on an autonomous vehicle, and the image acquisition device establishes the second communication link with a router on the autonomous vehicle that provides Wi-Fi signals. The router is also connected to the user's terminal device; wherein the transceiver module is also used to send a speed limit indication to the router when the network delay of the second communication link is greater than the second preset value. Information; the rate limit indication information is used to instruct: reduce the communication rate with the user's terminal device.

In a third aspect, the present invention provides an image acquisition device, including a processor and a memory. The memory stores machine-readable instructions, and the processor is used to execute the machine-readable instructions to implement the first aspect. The video signal splitting method described in any optional embodiment.

In a fourth aspect, the present invention provides a computer-readable storage medium, including a computer program. When the computer program is run on a computer, the video signal splitting method described in any optional embodiment of the first aspect is implemented. .

It can be understood that based on the embodiments provided in the above aspects, the image acquisition device establishes a first communication link and a second communication link, and then the image acquisition device obtains the network delay and real-time video signal data of the first communication link by: stream; when the network delay of the first communication link is greater than the first preset value, extract the video detail data in the real-time video signal data stream to obtain the real-time video signal data stream after the details are extracted; send the video signal to the video through the first communication link The receiving end sends the real-time video signal data stream after the details are extracted; sends the video detail data to the video receiving end through the second communication link; sends video merging instruction information to the video receiving end through the second communication link; the video merging instruction information is used to Instructions: Restore and play the real-time video signal data stream after extracting details according to the video detail data. In other words, in the solution provided by the embodiment of the present application, when the image acquisition device senses that there is a network delay in the first communication link, which may cause unstable video transmission, it can extract the video detail data in the real-time video signal data stream, The video detail data is sent to the video receiving end, that is, the backend, through the second communication link. The real-time video signal data stream after extracting the details occupies less bandwidth during transmission and has a faster transmission speed, so it can pass through smoothly. The first communication link carries out the transmission. In this way, even if there is a delay in the network, the image acquisition device can adapt to the network delay and transmit real-time video data to the video receiving end. Therefore, the embodiment of the present invention can also ensure the stability of video signal data transmission when the network delay is high. , ensuring that the backend can have a good perceptual experience. Moreover, since the video receiving end can restore and play the real-time video signal data stream after extracting the details according to the video detail data, the solution provided by the present invention can also ensure the clarity of the real-time video while improving the smoothness of the real-time video transmission. degree.

In order to make the above-mentioned objects, features and advantages of the present invention more obvious and understandable, embodiments of the present invention are given below and described in detail with reference to the accompanying drawings.

Description of the drawings

In order to explain the technical solutions of the embodiments of the present invention more clearly, the drawings needed to be used in the embodiments of the present invention will be briefly introduced below. It should be understood that the following drawings only show some embodiments of the present invention, so This should not be regarded as limiting the scope. For those of ordinary skill in the art, other relevant drawings can be obtained based on these drawings without exerting creative efforts.

Figure 1 is a structural block diagram of an image acquisition device provided by an embodiment of the present invention;

Figure 2 is a schematic flow chart of a video signal splitting method provided by an embodiment of the present invention;

Figure 3 is a schematic diagram of an application scenario of the video signal splitting method provided by the embodiment of the present invention;

FIG. 4 is a functional module diagram of a video signal splitting device provided by an embodiment of the present invention.

Detailed ways

In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments These are some embodiments of the present invention, rather than all embodiments. The components of the embodiments of the invention generally described and illustrated in the figures herein may be arranged and designed in a variety of different configurations.

Therefore, the following detailed description of the embodiments of the invention provided in the appended drawings is not intended to limit the scope of the claimed invention, but rather to represent selected embodiments of the invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without making creative efforts fall within the scope of protection of the present invention.

It should be noted that similar reference numerals and letters represent similar items in the following figures, therefore, once an item is defined in one figure, it does not need further definition and explanation in subsequent figures.

In addition, if the terms "first", "second", etc. appear, they are only used to differentiate the description and shall not be understood as indicating or implying relative importance.

It should be noted that, as long as there is no conflict, the features in the embodiments of the present invention can be combined with each other.

In order to solve the problems in the prior art, embodiments of the present invention propose a technical solution, including a video signal splitting method and device. In this solution, the image acquisition device establishes a first communication link and a second communication link. When the image acquisition device senses that there is a network delay in the first communication link, which may cause unstable video transmission, it can extract the video detail data in the real-time video signal data stream and send the video detail data to the video through the second communication link. At the receiving end, that is, the backend, the real-time video signal data stream after the details are extracted takes up less bandwidth during transmission and has a faster transmission speed, so it can be transmitted smoothly through the first communication link. In this way, even if there is a delay in the network, the image acquisition device can adapt to the network delay and transmit real-time video data to the video receiving end. Therefore, the embodiment of the present invention can also ensure the stability of video signal data transmission when the network delay is high. , ensuring that the backend can have a good perceptual experience. Moreover, since the video receiving end can restore and play the real-time video signal data stream after extracting the details according to the video detail data, the solution provided by the present invention can also ensure the clarity of the real-time video while improving the smoothness of the real-time video transmission. degree.

First, an embodiment of the present invention provides an image acquisition device. Please refer to FIG. 1 , which is a structural block diagram of an image acquisition device provided by an embodiment of the present invention. The image acquisition device 100 includes: a memory 110 and a processor 120. The memory 110 and the processor 120 can be directly or indirectly electrically connected to the communication interface 130 to realize data transmission and interaction. For example, these components may be electrically connected to each other through buses and/or signal lines.

In one embodiment, the image capture device 100 is a camera installed with a mobile network communication chip (eg, 4G communication chip/5G communication chip) and a Wi-Fi communication chip. The image acquisition device 100 can be installed on an autonomous vehicle, used to collect real-time video around the autonomous vehicle, and transmit the real-time video signal data stream including the real-time video to the video receiving end through the network, that is, the backend. end. The backend (also called a backend server) can be used to collect data from driverless vehicles. For example, the real-time video signal data stream in this solution.

The processor 120 may process information and/or data related to the video signal offloading method to perform one or more functions described herein. For example, the processor 120 can: obtain the network delay of the first communication link and the real-time video signal data stream; when the network delay of the first communication link is greater than the first preset value, extract the video details in the real-time video signal data stream. data to obtain a real-time video signal data stream after extracting details; sending the real-time video signal data stream after extracting details to the video receiving end through the first communication link; sending video detail data to the video receiving end through the second communication link; The second communication link sends video merging instruction information to the video receiving end; the video merging instruction information is used to instruct: to restore and play the real-time video signal data stream after extracting details according to the video detail data. In this way, the image capture device 100 can ensure the stability of video signal data transmission even when the network delay is high, ensuring that the backend can have a good perception experience.

Among them, the above-mentioned memory 110 may include but is not limited to: solid state disk (Solid State Disk, SSD), mechanical hard disk (Hard Disk Drive, HDD), read only memory (Read Only Memory, ROM), programmable read only memory (Programmable memory). Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), Random Access Memory (RAM), Electric Erasable Programmable Read-Only Memory ,EEPROM) etc.

The above-mentioned processor 120 may include, but is not limited to: a central processing unit (CPU), a network processor (Network Processor, NP), etc.; it may also be, but is not limited to: an application specific integrated circuit (Application Specific Integrated Circuit, ASIC). ), digital signal processor (DigitalSignalProcessing, DSP), field-programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. Therefore, the above-mentioned processor 120 may be an integrated circuit chip with signal processing capabilities.

It can be understood that the structure of the image acquisition device 100 shown in FIG. 1 is only a schematic structure, and the image acquisition device 100 may also include more or fewer components or modules than the structure shown in FIG. 1 , or Have a different configuration or construction than that shown in Figure 1 . Moreover, each component shown in Figure 1 can be implemented by hardware, software, or a combination of both.

In addition, it should be understood that the image capture device 100 provided by the present invention can adopt different configurations or structures according to different requirements in actual applications. For example, the image acquisition device 100 provided by the present invention can be an electronic device with communication, computing and storage functions, such as a mobile phone, a portable smart device, etc.

When the image acquisition device 100 provided by the present invention is an electronic device with communication, computing and storage functions, these electronic devices can also: obtain the network delay of the first communication link and the real-time video signal data stream; When the network delay of the channel is greater than the first preset value, extract the video detail data in the real-time video signal data stream to obtain the real-time video signal data stream after the details are extracted; send the extracted details to the video receiving end through the first communication link Real-time video signal data stream; sending video detail data to the video receiving end through the second communication link; sending video merging instruction information to the video receiving end through the second communication link; the video merging instruction information is used to instruct extraction according to the video detail data Details of the real-time video signal stream are restored and played back. Therefore, the image capture device 100 can ensure the stability of video signal data transmission even when the network delay is high, ensuring that the backend can have a good perception experience.

Now, in order to facilitate understanding, the following embodiments of the present invention will take the image acquisition device 100 shown in FIG. 1 as an example, and illustrate the video signal branching method provided by the embodiments of the present invention in conjunction with the accompanying drawings.

Please refer to FIG. 2 , which shows a flow chart of a video signal splitting method provided by an embodiment of the present invention. This video signal splitting method can be applied to the above-mentioned image capture device 100, wherein the image capture device 100 can establish a first communication link and a second communication link. Through the first communication link and the second communication link, The image capture device 100 may send real-time video signals to one or more video receiving terminals. Among them, the video receiving end can be a background server, that is, a backend.

The above video signal splitting method may include the following steps S110 to S150, which are described separately below.

S110. Obtain the network delay of the first communication link and the real-time video signal data stream.

S120: When the network delay of the first communication link is greater than the first preset value, extract the video detail data in the real-time video signal data stream to obtain a real-time video signal data stream after the details are extracted.

S130. Send the real-time video signal data stream after extracting details to the video receiving end through the first communication link.

S140. Send video detail data to the video receiving end through the second communication link.

S150. Send video merging instruction information to the video receiving end through the second communication link. Among them, the video merging instruction information is used to instruct: to restore and play the real-time video signal data stream after extracting details according to the video detail data.

The expressions in each of the above steps are described below.

The above-mentioned first communication link and second communication link may be communication links established between the image collection device 100 and network devices (including base stations, routers, switches, network servers, etc.).

For example, please refer to the application scenario shown in Figure 3. The image collection device 100 can establish a first communication link with the base station. Specifically, the image collection device 100 can use fourth generation mobile communication technology (4G) or fifth generation mobile communication. Technology (5G) communicates with the base station to establish the first communication link. After establishing the first communication link, the image capture device 100 can transmit real-time data (eg, real-time video signal data stream) to the video receiving end through the first communication link, so that the video receiving end can obtain the real-time video signal data stream. The video receiving end can access the network and connect to the network server to receive real-time data transmitted by the image acquisition device 100 to the network. In addition, the image collection device 100 can also communicate with the router through Wi-Fi to establish a second communication link. Similarly, after establishing the second communication link, the image capture device 100 can transmit real-time data (eg, real-time video signal data stream) to the video receiving end through the second communication link.

In one embodiment, the first communication link is a 4G or 5G communication link. The second communication link is a Wi-Fi communication link.

In the above S110, the method of obtaining the network delay of the first communication link may be: the real-time application installed on the image acquisition device 100 detects the first communication link and the second communication through an Internet packet explorer (Packet Internet Groper, PING) The PING value of the link. The PING value here indicates whether the communication link is connected normally and the network delay of the communication link. The smaller the PING value, the smaller the network delay of the communication link.

The above-mentioned real-time video signal data stream includes real-time video.

The above-mentioned first preset value may be an experience value, which may be configured in advance and modified midway. Optionally, the first preset value may be 150-200. It can be understood that if the network delay of the first communication link is greater than the first preset value, it means that the network delay of the first communication link is high, which may cause packet drops or loss in the real-time video signal data stream transmitted through the first communication link. situation, causing real-time video to freeze, buffer, or even interrupt.

In an optional embodiment, the above-mentioned real-time video signal data stream refers to audio and video data recorded through the camera of the image acquisition device 100, that is, including real-time video. The real-time video signal data stream can be transmitted through the network after video encoding, and played after video decoding at the video receiving end. The encoding method of the real-time video signal data stream may include H.261, H.263, H.264 or H265, etc., which is not limited.

Taking the real-time video signal data stream through H.264 encoding technology as an example, in the above-mentioned S120, when the network delay of the first communication link is greater than the first preset value, the video detail data in the real-time video signal data stream is extracted. It may include: extracting key frames (that is, I frames) in the real-time video signal data stream. Specifically, some pixel information in the key frames may be extracted, for example, some pixels in the key frames may be extracted. Modify the value to be consistent with the value of the surrounding pixels, or modify the values of some pixels in the key frame until the difference between the values of the surrounding pixels is less than the preset threshold. In this way, the amount of information included in the key frame can be reduced, thereby reducing the amount of data occupied by the predicted frames (P frames) and bidirectional predicted frames (B frames) generated during video encoding. In other words, in the above S120, the real-time video signal data stream after the details are extracted occupies less bandwidth and has a faster transmission speed. Even when the network delay of the first communication link increases due to network fluctuations, The real-time video signal data stream after the details are extracted can also be transmitted smoothly through the first communication link. In addition, compared with the method of changing network lines and re-establishing new communication links to transmit video data when network fluctuations cause real-time video data transmission to be interrupted, the technical solution provided by the embodiment of the present invention can also be used when there is a delay in the network. This can avoid switching communication links, which may cause obvious interruptions in back-end operation and maintenance when watching real-time video, thus improving user experience.

Continuing to use the real-time video signal data stream through H.264 encoding technology as an example, the above S150 can also include: when the video receiving end receives the real-time video signal data stream after extracting details, video detail data and video merging instruction information, it can pass When H.264 encoding technology decodes the real-time video signal data stream after extracting details, the video detail data is used to restore the extracted pixels in the key frames obtained by decoding, and the restored real-time video signal data stream is obtained, and Play. In this way, the solution provided by the present invention can also ensure the clarity of real-time video while improving real-time fluency.

It can be understood that according to the above method embodiments, when the image acquisition device 100 senses that there is a network delay in the first communication link, which may cause unstable video transmission, it can extract the video detail data in the real-time video signal data stream, and convert the video into The detailed data is sent to the video receiving end, that is, the backend, through the second communication link. The real-time video signal data stream after the details are extracted takes up less bandwidth during transmission and has a faster transmission speed, so it can smoothly pass through the first communication link for transmission. In this way, even if there is a delay in the network, the image capture device 100 can adapt to the network delay and transmit real-time video data to the video receiving end. Therefore, the embodiment of the present invention can also ensure the stability of video signal data transmission when the network delay is high. sex to ensure that the backend can have a good perceptual experience. Moreover, since the video receiving end can restore and play the real-time video signal data stream after extracting the details according to the video detail data, the solution provided by the present invention can also ensure the clarity of the real-time video while improving the smoothness of the real-time video transmission. degree.

In an optional embodiment, the above-mentioned S120, when the network delay of the first communication link is greater than the first preset value, extracts the video detail data in the real-time video signal data stream, including the following steps 1.1 and 1.2:

Step 1.1: When the network delay of the first communication link is greater than the first preset value, extract N pixel information from the key frame of the real-time video signal data stream. Among them, N is an integer greater than 1. In specific implementation, N pixel information in all key frames or some key frames may be extracted. The pixel information here can refer to the pixels in the key frame.

Step 1.2, determine N pixel information as video detail data.

In an alternative embodiment, N is positively related to the network delay of the first communication link. That is to say, when the network delay of the first communication link is larger, N is larger, so that more pixel information is extracted in the key frame, and the real-time video signal data stream after the details are extracted takes up less bandwidth. , the transmission speed is faster. In other words, the image acquisition device 100 can adaptively adjust the size of the real-time video signal data stream after the details are extracted according to the size of the network delay to adapt to transmission under different network delays, so that the real-time video signal data stream after the details are extracted can be Smooth transmission under various network environments.

In an optional embodiment of the present invention, N is determined by the following formula: . Among them, k is a constant, and PING is the network delay of the first communication link. It can be understood that in the above formula, as PING increases, N becomes larger and larger, showing an S-shaped growth. In this way, when the video receiving end fails to receive the video detail data and directly plays based on the real-time video signal data stream after extracting the details, the extraction degree of the real-time video signal data stream can be increased with the network delay, which can ensure real-time The video signal data stream can be transmitted smoothly under various network environments, and the real-time video signal data stream after extracting details can be as clear as possible, thus improving the user experience.

In an optional embodiment of the present invention, the above step 1.1, the step of extracting N pixel information from the key frames of the real-time video signal data stream, includes the following steps 1.11, 1.12 and 1.13:

Step 1.11: Detect the type of real-time video included in the real-time video signal data stream according to the real-time video signal data stream. For example, the image capture device 100 can utilize a trained neural network model to identify whether people and objects exist in key frames of the real-time video signal data stream. When there are people in the key frames of the real-time video signal data stream, it can be determined that the type of the real-time video is a person video. When there are no people and items in the key frames of the real-time video signal data stream, the type of the real-time video can be determined to be an item video, which can also be called a video that does not include people.

Step 1.12: When the type of real-time video is a human video, extract N pixel information other than the human character from the key frames of the real-time video signal data stream. For example, N pixel information in the pixel area other than the pixel area occupied by the character in the key frame is extracted.

Step 1.13, when the type of real-time video is an item video, extract N pixel information other than the item in the center of the picture from the key frame of the real-time video signal data stream. For example, N pixel information in the pixel area other than the pixel area occupied by the item located at the center of the screen is extracted in the key frame.

It can be understood that in the above steps 1.11 to 1.13, by identifying the type of real-time video, real-time video signal data streams of different real-time video types are extracted in a targeted manner, and the pixel information of the operation and maintenance area of concern is retained as much as possible (for example, , when the video of a person extracts pixel information other than the person and retains the pixel information of the person), it can be played when the video receiving end fails to successfully receive the video detail data and directly plays based on the real-time video signal data stream after the extracted details, so that after the details are extracted The real-time video signal data stream is as clear as possible, thereby enhancing the user experience.

In an optional embodiment of the present invention, the video signal offloading method shown in Figure 2 further includes the step of: when the type of real-time video is a type other than person video and item video, evenly distribute the data in the key frames of the real-time video signal data stream. Extract N pixel information.

In an optional embodiment of the present invention, the video signal offloading method shown in Figure 2 also includes the following steps 2.1-step 2.2:

Step 2.1, obtain the network delay of the second communication link;

Step 2.2: When the network delay of the second communication link is greater than the second preset value, send low-quality playback information to the video receiving end through the first communication link. Wherein, the low-quality playback information is used to indicate: playback according to the real-time video signal data stream after extracting details.

It can be understood that in steps 2.1 and 2.2, when the network delay of the second communication link used to transmit the video detail data is also very large, it may cause the video receiving end to be unable to receive the video detail data and to be unable to clearly restore the real-time video. When signal data is streaming, the image acquisition device 100 can also instruct the video receiving end to directly play based on the real-time video signal data stream after extracting details through low-quality playback information. Although this will cause a certain loss of image quality, it can ensure the quality of the video. Smooth playback ensures user experience.

In an optional embodiment of the present invention, the image acquisition device 100 is installed on an autonomous vehicle, and the image acquisition device 100 establishes the second communication link with a router on the autonomous vehicle that provides Wi-Fi signals, The router is also connected to the user's terminal device (e.g., mobile phone, laptop, etc.). Wherein, the video signal offloading method shown in Figure 2 also includes: when the network delay of the second communication link is greater than the second preset value, sending speed limit indication information to the router. Wherein, the rate limit indication information is used to instruct: reduce the communication rate with the user's terminal device.

It can be understood that when the image collection device 100 is used to collect real-time video, there are often user terminal devices connected to the router around the image collection device 100 to implement network communication. In other words, the image capture device 100 may have a network competition relationship with surrounding user terminal devices. By sending speed limit indication information to the router to instruct the router to reduce the communication rate with the user's terminal device, more transmission bandwidth can be left for the second communication link (ie, Wi-Fi link) of the image acquisition device 100, This can further ensure the smoothness of video transmission.

In order to perform the corresponding steps in the above embodiments and various possible ways, an implementation method of a video signal splitting device is given below. Please refer to Figure 4. Figure 4 shows a video signal splitting device provided by an embodiment of the present invention. 300 functional module diagram. The video signal branching device 300 can be applied to the image acquisition device 100 shown in FIG. 1, and can be used to perform the steps that the image acquisition device 100 in the above method embodiment can perform. It should be noted that the basic principles and technical effects of the video signal splitting device 300 provided in this embodiment are the same as those in the above-mentioned embodiment. For the sake of brief description, the parts not mentioned in this embodiment can be as described above. The corresponding content in the embodiment. The video signal distribution device 300 may include: a transceiver module 310 and a processing module 320.

Optionally, the above-mentioned modules can be stored in the memory in the form of software or firmware or solidified in the operating system (Operating System, OS) of the image acquisition device 100 shown in Figure 1 provided by the present invention, and can be used as shown in Figure 1 The processor in image capture device 100 is shown executing. At the same time, the data required to execute the above modules, the code of the program, etc. can be stored in the memory.

It can be understood that the transceiver module 310 and the processing module 320 can be used to support the image acquisition device 100 shown in Figure 1 to perform relevant steps in the above method embodiments, and/or other processes used for the technology described herein, such as The method embodiment shown in FIG. 2 and each method embodiment described above are not limited thereto.

Among them, the transceiver module 310 is used to obtain the network delay of the first communication link and the real-time video signal data stream; the processing module 320 is used to extract the real-time video when the network delay of the first communication link is greater than the first preset value. The video detail data in the signal data stream is used to obtain a real-time video signal data stream after the details are extracted; the transceiver module 310 is also used to send the real-time video signal data stream after the details are extracted to the video receiving end through the first communication link; the transceiver module 310 is also used to send video detail data to the video receiving end through the second communication link; the transceiver module 310 is also used to send video merging instruction information to the video receiving end through the second communication link; the video merging instruction information is used to indicate : Based on the video detail data, the real-time video signal data stream after the details are extracted is restored and played.

In an optional embodiment of the present invention, the processing module 320 is also configured to extract N pixels from the key frames of the real-time video signal data stream when the network delay of the first communication link is greater than the first preset value. information; where N is an integer greater than 1; the processing module 320 is also used to determine N pieces of pixel information as video detail data.

In an optional embodiment of the present invention, N is positively related to the network delay of the first communication link.

In an optional embodiment of the present invention, N is determined by the following formula: ; Among them, k is a constant, and PING is the network delay of the first communication link.

In an optional embodiment of the present invention, the processing module 320 is also used to detect the type of the real-time video according to the real-time video signal data stream; the processing module 320 is also used to detect the type of the real-time video in the real-time video signal when the type of the real-time video is a person video. Extract N pixel information other than the person from the key frame of the data stream; the processing module 320 is also used to extract N pixel information other than the item in the center of the picture from the key frame of the real-time video signal data stream when the type of the real-time video is an item video. pixel information.

In an optional embodiment of the present invention, the processing module 320 is also configured to evenly extract N pieces of pixel information from the key frames of the real-time video signal data stream when the type of real-time video is other than people video and object video.

In an optional embodiment of the present invention, the processing module 320 is also used to obtain the network delay of the second communication link; the transceiver module 310 is also used to obtain the network delay of the second communication link when the network delay of the second communication link is greater than the second preset value. , sending low-quality playback information to the video receiving end through the first communication link; wherein the low-quality playback information is used to instruct: play according to the real-time video signal data stream after extracting details.

In an optional embodiment of the present invention, the image acquisition device 100 is installed on an autonomous vehicle, and the image acquisition device 100 establishes a second communication link with a router on the autonomous vehicle that provides Wi-Fi signals, and the router also Connected to the user's terminal device; wherein, the transceiver module 310 is also used to send speed limit indication information to the router when the network delay of the second communication link is greater than the second preset value; the speed limit indication information is used to indicate: reduce The communication rate with the user's terminal device.

Based on the above method embodiments, embodiments of the present invention also provide a computer-readable storage medium. The computer-readable storage medium stores a computer program. The computer program executes the above video signal splitting method when run by a processor.

Specifically, the storage medium can be a general storage medium, such as a removable disk, a hard disk, etc. When the computer program on the storage medium is run, it can execute the video signal splitting method in the above embodiment, thereby solving the "current video transmission problem". The technology is not reliable enough, causing the back-end video stream to be unstable when receiving, and the back-end perception experience is not very good." It can also ensure the stability of video signal data transmission when the network delay is high, ensuring that the back-end can Have a good perceptual experience.

In the embodiments provided by the present invention, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the coupling or direct coupling or communication connection between each other shown or discussed may be through some communication interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical, mechanical or other forms.

In addition, units described as separate components may or may not be physically separated, and components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

Furthermore, each functional module in various embodiments of the present invention can be integrated together to form an independent part, each module can exist alone, or two or more modules can be integrated to form an independent part.

In this document, relational terms such as first, second, etc. are used merely to distinguish one entity or operation from another entity or operation and do not necessarily require or imply the existence of any such entity or operation between these entities or operations. Actual relationship or sequence.

The above descriptions are only examples of the present invention and are not intended to limit the scope of the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention shall be included in the protection scope of the present invention.

Claims (10)

1. A video signal shunting method, characterized in that it is applied to an image acquisition device, and the image acquisition device has a first communication link and a second communication link. The video signal shunting method includes: Obtain the network delay and real-time video signal data stream of the first communication link; When the network delay of the first communication link is greater than the first preset value, extract the video detail data in the real-time video signal data stream to obtain a real-time video signal data stream after the details are extracted; Send the real-time video signal data stream after extracting details to the video receiving end through the first communication link; Send the video detail data to the video receiving end through the second communication link; Video merging instruction information is sent to the video receiving end through the second communication link; the video merging instruction information is used to instruct: restore the real-time video signal data stream after extracting details according to the video detail data Play later. 2. The video signal offloading method according to claim 1, characterized in that when the network delay of the first communication link is greater than a first preset value, extracting the video in the real-time video signal data stream Detailed data steps include: When the network delay of the first communication link is greater than the first preset value, extract N pieces of pixel information from the key frames of the real-time video signal data stream; where N is an integer greater than 1; The N pieces of pixel information are determined as the video detail data. 3. The video signal offloading method according to claim 2, wherein N is positively related to the network delay of the first communication link. 4. The video signal branching method according to claim 3, characterized in that, N is determined by the following formula: ; Where, k is a constant, and PING is the network delay of the first communication link. 5. The video signal branching method according to claim 2, characterized in that the step of extracting N pixel information from the key frames of the real-time video signal data stream includes: Detecting the type of real-time video according to the real-time video signal data stream; When the type of the real-time video is a human video, extract N pixel information other than the human character from the key frames of the real-time video signal data stream; When the type of the real-time video is an item video, N pixel information other than the item in the center of the picture is extracted from the key frame of the real-time video signal data stream. 6. The video signal branching method according to claim 5, characterized in that the method further includes: When the type of the real-time video is other than the person video and the item video, N pieces of pixel information are evenly extracted from the key frames of the real-time video signal data stream. 7. The video signal branching method according to claim 1, characterized in that the method further includes: Obtain the network delay of the second communication link; When the network delay of the second communication link is greater than the second preset value, low-quality playback information is sent to the video receiving end through the first communication link; wherein the low-quality playback information is Instruction: Play according to the real-time video signal data stream after the details are extracted. 8. The video signal shunting method according to claim 7, characterized in that the image acquisition device is installed on an autonomous vehicle, and the image acquisition device is connected to a device that provides Wi-Fi signals on the autonomous vehicle. The router establishes the second communication link, and the router is also connected to the user's terminal device; Wherein, the method also includes: When the network delay of the second communication link is greater than the second preset value, speed limit indication information is sent to the router; the speed limit indication information is used to instruct: reduce the communication speed with the user's terminal device. Communication rate. 9. A video signal shunt device, characterized in that it is used in image acquisition equipment, and the image acquisition equipment has a first communication link and a second communication link; the video signal shunt device includes a transceiver module and a processing module ;in, The transceiver module is used to obtain the network delay of the first communication link and the real-time video signal data stream; The processing module is configured to extract video detail data in the real-time video signal data stream when the network delay of the first communication link is greater than a first preset value, and obtain a real-time video signal data stream after the details are extracted. ; The transceiver module is also configured to send the real-time video signal data stream after extracting details to the video receiving end through the first communication link; The transceiver module is also configured to send the video detail data to the video receiving end through the second communication link; The transceiver module is also configured to send video merging instruction information to the video receiving end through the second communication link; the video merging instruction information is used to indicate: according to the video detail data, the extracted details are The real-time video signal data stream is restored and played back. 10. The video signal splitting device according to claim 9, wherein the processing module is further configured to: when the network delay of the first communication link is greater than the first preset value, Extract N pieces of pixel information from the key frames of the real-time video signal data stream; where N is an integer greater than 1; The processing module is also used to determine the N pieces of pixel information as the video detail data.