WO2021119968A1 - Video fusion method and apparatus, and storage medium - Google Patents

Abstract

A video fusion method and apparatus, and a storage medium. The method comprises: acquiring a video signal to be fused and a video; carrying out brightness and chromaticity processing on the video signal to obtain processed video data; carrying out fusion processing on the video data to obtain video fusion data; fusing the video fusion data and the video, processing the brightness and the chromaticity of a YC422-format video in the video signal, and by utilizing the characteristic that data is not lost by the brightness during an RGB-YC conversion process, separating, by means of brightness data, video data needing to be fused; chrominance components losing data during the RGB-YC conversion process, and performing special processing on odd and even points; and YCbCr processing the chromaticity and brightness, such that the signal quality of the fused content is effectively improved. The method can solve the problem of an edge abnormality caused by a color format change in a fused video under relatively-low bandwidth YC422 video format transmission and processing, thereby effectively improving the quality of the fused video.

Description

Video fusion method, device and storage medium Technical field

The present invention relates to the technical field of image processing, in particular to a video fusion method, device and storage medium.

Background technique

FPGA (Field Programmable Gate Array) is a product of further development on the basis of programmable devices such as PAL and GAL. It appears as a semi-custom circuit in the field of application-specific integrated circuits (ASIC), which not only solves the problem of custom circuits It overcomes the shortcomings of the limited number of gate circuits of the original programmable device.

Video fusion technology is a branch of virtual reality technology, and it can also be said to be a development stage of virtual reality. Video fusion technology refers to the fusion of one or more image sequence videos about a certain scene or model collected by a video acquisition device with a virtual scene related to it to generate a new virtual scene or model about this scene.

With the advancement of electronic computer technology, computer image processing has been developed by leaps and bounds in recent years. It has been successfully applied to almost all imaging-related fields and is playing a very important role. 70% of the information transmitted by humans is visual information, and image information is an important medium and means for transmitting information.

In consumer electronics, municipal, transportation, military and other environments that require video display, the scale of the signals required to be processed is getting larger and larger, and the requirements for functions and image quality are also getting higher and higher, which undoubtedly increases the processing of video images. The FPGA for signal processing puts forward higher and higher requirements, such as bandwidth, signal quality, and the complexity of logic processing is also accompanied by further improvement. Therefore, in order to better display the information displayed by the video, it is extremely necessary to improve the fusion problem of the FPGA processing video images and improve the quality of the fusion video under the premise of ensuring the picture quality and real-time performance.

Therefore, in view of the above situation, how to avoid the poor quality of the fused video caused by the loss of data chrominance in the video fusion process has become an important technical problem to be solved urgently by those skilled in the art.

Summary of the invention

The embodiments of the present invention provide a video fusion method, device, and storage medium, which are used to solve the technical problem that the edge abnormality caused by the color format change in the existing processing video fusion process, which leads to the poor quality of the fusion video.

In order to achieve the foregoing objectives, the embodiments of the present invention provide the following technical solutions:

A video fusion method includes the following steps:

S1. Obtain the video signal and video to be fused;

S2. Perform brightness and chroma processing on the video signal to obtain processed video data;

S3. Perform fusion processing on the video data to obtain video fusion data;

S4. Fusion of the video fusion data and the video.

Preferably, the video signal is an RGB video signal, and in the step S2, the processing step of obtaining the video data includes:

S21. Perform signal conversion on the RGB video signal and convert it into a YC444 signal;

S22. Perform luminance Y component processing on the luminance in the YC444 signal, and perform processing on the chrominance in the YC444 signal, and output the Y component and the C component;

S23. After processing, the YC444 signal having the Y component and the C component is converted into a YC422 video signal, and the data in the YC422 video signal is the processed video data.

Preferably, in the step S22, the three components of R, G, and B in the RGB video signal are within a preset value range of the controller, and the Y component of the video signal is processed by the luminance Y component. The component value is set to 0;

If the Y component value of the YC444 signal is 0, the lowest bit is set to 1, otherwise the Y component value of the YC444 signal remains the original value and output;

If the value of the Y component in the RGB video signal is 0, the controller controls the converted YC444 signal to output the Y component;

If the Y component value in the RGB video signal is 1, the controller controls the converted YC444 signal to process the luminance Y component to output the Y component;

The YC444 signal is provided with an odd point and an even point. If the Y component of the YC444 signal of the odd point is 0, the C component of the YC444 signal takes the C component of the next point as the two number points. The average of the C component. If the Y component of the YC444 signal at an even point is 0, the C component of the YC444 signal takes the C component of the previous point as the average of the C components of the two points. When the Y component When it is not 0, no odd and even points are distinguished, and the C component of the YC444 signal takes the C component of the next number point as the average of the number points C component.

Preferably, in the step S3, the processing step of obtaining the video fusion data includes:

S31. Perform signal conversion on the YC422 video signal in the video data, and convert it into an RGB signal;

S32. If the Y component value of the YC422 video signal is 0 and the control signal sent by the controller is 0, remove the YC422 video signal data whose Y component value is 0 to obtain the YC422 whose Y component is not 0 The video signal data is the processed YC422 video signal data; if the Y component value in the YC422 video signal is 0 and the control signal sent by the controller is 1, remove the Y component value that is not 0 The YC422 video signal data obtains the YC422 video signal data whose Y component is 0, which is the processed YC422 video signal data.

Preferably, in the step S3, fusion processing is performed according to the YC422 video signal data and the RGB signal data after the controller control and processing, to obtain the video fusion data.

The present invention also provides a video fusion device, which includes a controller and a video signal processing module to be fused and a video fusion processing module connected to the controller respectively;

The to-be-fused video signal processing module is used to perform brightness and chroma processing on the to-be-fused video signal to obtain video data;

The video fusion processing module is used to perform fusion processing on the video data to obtain video fusion data;

The controller is used to control whether the video fusion data is fused with the video.

Preferably, the to-be-fused video signal processing module includes a video signal acquisition unit, a first signal conversion unit, a brightness processing unit, a first selection unit, a second signal conversion unit, and a first output unit;

The video signal to be fused obtained by the video signal acquisition unit is an RGB video signal, the video signal acquisition unit is respectively connected to the first signal conversion unit and the brightness processing unit, and the first signal conversion unit is connected to the first signal conversion unit and the brightness processing unit respectively. The first selection unit is connected to the brightness processing unit, the brightness processing unit is further connected to the first selection unit, the first selection unit is further connected to the second signal conversion unit, and the second signal The conversion unit is connected to the first output unit, the controller is respectively connected to the brightness processing unit and the first selection unit, and the first output unit is connected to the video fusion processing module.

Preferably, the first signal conversion unit is used to convert the RGB video signal into a YC444 signal, the brightness processing unit uses the brightness Y component for signal processing, and the controller controls the first selection unit to output a YC444 signal. YC444 signal of component and C component, the second signal conversion unit is used to convert the YC444 signal with Y component and C component into YC422 video signal, and the YC422 video signal is sent from the first output unit to the video Fusion processing module.

Preferably, the video fusion processing module includes a third signal conversion unit, a video fusion processing unit, a second selection unit, and a second output unit;

The first output unit is respectively connected to the third signal conversion unit and the video fusion processing unit, the third signal conversion unit is also connected to the second selection unit, and the video fusion processing unit is also connected to the The second selection unit is connected, the second selection unit is also connected to the second output unit, and the controller is also connected to the video fusion processing unit and the second selection unit respectively;

The third signal conversion unit converts the YC422 video signal into an RGB signal, and the video fusion processing unit removes or retains the YC422 video signal data whose value is 0 when the Y component value in the YC422 signal is 0 To obtain the processed YC422 video signal data, the controller controls whether the second selection unit selects the processed YC422 video signal data and the RGB signal for fusion processing to obtain the video fusion data, the first The second output unit outputs the RGB signal after video fusion.

The present invention also provides a storage medium, including a processor and a memory;

The memory is used to store program code and transmit the program code to the processor;

The processor is configured to execute the aforementioned video fusion method according to the instructions in the program code.

It can be seen from the above technical solutions that the embodiments of the present invention have the following advantages:

1. The video fusion method obtains the video signal and video to be fused; processes the brightness and chrominance of the video signal to obtain the processed video data; performs fusion processing on the video data to obtain the video fusion data; combines the video fusion data with The video is fused, the YC422 format video brightness and chroma in the video signal are processed, and the brightness data is used to separate the required fused video data through the brightness data. The chroma component is in the RGB, YC conversion process. Data loss will occur during the YC conversion process, special processing is performed on the odd and even points; and based on the YCbCr chrominance and brightness processing, the quality of the fusion content signal is effectively improved. This method can solve the fusion under the lower bandwidth YC422 video format transmission and processing. The abnormal edge problem caused by the change of video color format effectively improves the quality of the fusion video, and solves the technical problem of the abnormal edge caused by the color format change in the existing processing video fusion process, which leads to the poor quality of the fusion video;

2. The to-be-fused video signal processing module of the video fusion device utilizes the characteristics of no loss of data during the conversion of RGB signals into YC by brightness, and separates the required fusion data through brightness Y data; chrominance components are also converted into YC from RGB signals In the process of performing special processing on the odd and even points, data loss will occur in the signal in the video signal, and the video signal of the video data will be output. The video signal of the output video data is input to the video fusion processing module. The video fusion processing module is in the process of converting the YC signal to the RGB signal, when the three components of the converted RGB signal, R, G, and B, are set in the controller. Inside, set the Y component value in the YC422 video signal to 0, and remove or retain the YC422 video signal data with a value of 0 when the Y component value in the YC422 video signal is 0, so as to obtain the video fusion data, which will be obtained by the controller The video fusion data is fused with other videos to obtain a high-quality video after fusion, which improves the quality of the fusion video, and solves the technical problem of the abnormal edge caused by the color format change in the existing processing video fusion process, which leads to the poor quality of the fusion video .

Description of the drawings

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative labor.

FIG. 1 is a flowchart of steps of a video fusion method according to an embodiment of the present invention;

2 is a flowchart of steps of video data processing in a video fusion method according to an embodiment of the present invention;

FIG. 3 is a flowchart of steps of video fusion data processing in a video fusion method according to an embodiment of the present invention;

Fig. 4 is a frame diagram of a video fusion device according to an embodiment of the present invention.

Detailed ways

In order to make the objectives, features, and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the following The described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

In the specific embodiment of the present invention, the described RGB video signal is a video signal in the RGB format, the YC422 video signal is a video signal in the YC422 format, the RGB signal is a video signal in the RGB format, and the YC444 signal is a video signal in the YC444 format. Among them, the Y letter represents the brightness signal, the C letter represents the color difference signal, and the YC letter represents the composite signal of brightness and color difference.

The embodiments of the present application provide a video fusion method, device, and storage medium, which are used to solve the technical problem that the edge abnormality caused by the color format change in the existing processing video fusion process, which leads to the poor quality of the fusion video.

The embodiment of the present invention provides a video fusion method. FIG. 1 is a flowchart of the steps of the video fusion method according to the embodiment of the present invention.

As shown in Figure 1, an embodiment of the present invention provides a video fusion method, which includes the following steps:

S1. Obtain the video signal and video to be fused;

S2. Perform brightness and chroma processing on the video signal to obtain processed video data;

S3. Perform fusion processing on the video data to obtain video fusion data;

S4. Fusion of video fusion data and video.

It should be noted that the video signal to be fused is an RGB video signal.

In step S2 in the embodiment of the present invention, the RGB video signal is converted into YC444 signal, YCbCr performs luminance and chrominance processing on YC444 signal to obtain processed video data, and converts the processed video data of YC444 signal into YC422 video Signal output.

It should be noted that using the feature of no loss of data during the conversion of RGB and YC of brightness, the required fusion video data is separated through brightness data; data loss will occur during the conversion of RGB and YC for chrominance components, and special parity points are applied. Processing, effectively improve the quality of the fusion video signal.

In step S3 in the embodiment of the present invention, the YC422 video signal is converted into an RGB signal. When the three components of R, G, and B in the RGB signal are within the controller setting range, the YC422 video signal is changed to The component value is set to 0, and the YC422 video signal data with the value of 0 is removed or retained when the Y component value in the YC422 video signal is 0, to obtain the processed YC422 video signal data, and the processed YC422 video signal data and RGB signal The data is fused to obtain video fusion data.

In step S4 in the embodiment of the present invention, the controller controls the video fusion data to be fused with other videos to obtain a fused video.

The video fusion method provided by the present invention obtains the video signal and video to be fused; processes the brightness and chroma of the video signal to obtain the processed video data; performs fusion processing on the video data to obtain the video fusion data; The fusion data is fused with the video, the brightness and chroma of the YC422 format video in the video signal are processed, and the brightness data is used to separate the required fusion video data through the brightness data without data loss during the RGB and YC conversion process; In the RGB, YC conversion process, data loss will occur for the degree component. Special processing is performed on the odd and even points; and based on the YCbCr chrominance and brightness processing, the quality of the fusion content signal is effectively improved. This method can transmit and transmit in the lower bandwidth YC422 video format. Under processing, it solves the problem of edge abnormality caused by the color format change of the fusion video, effectively improves the quality of the fusion video, and solves the technical problem of the poor quality of the fusion video caused by the edge abnormality caused by the color format change in the existing processing video fusion process.

Fig. 2 is a flowchart of steps of video data processing in a video fusion method according to an embodiment of the present invention.

As shown in FIG. 2, in an embodiment of the present invention, the video signal is an RGB video signal. In step S2, the processing steps for obtaining video data include:

S21. Carry out signal conversion on RGB video signal and convert it into YC444 signal;

S22. Process the luminance Y component of the luminance in the YC444 signal, process the chrominance in the YC444 signal, and output the Y component and the C component;

S23. After processing, the YC444 signal with the Y component and the C component is converted into a YC422 video signal, and the data in the YC422 video signal is the processed video data.

It should be noted that in step S21, the RGB video signal is converted into a YC444 signal, and in step S22, the three components of R, G, and B in the RGB video signal are within the preset value range of the controller. After the Y component is processed, the Y component value of the video signal is set to 0. If the Y component value of the YC444 signal is 0, the lowest bit is set to 1, and the Y component value of the YC444 signal remains the original value in other cases. Example: The Y component has 8 bits of data, and the lowest bit is the 0th bit of the Y component. If the Y component has 8-bit data and the value of the 8-bit data is 8'b00000000, the lowest bit is set to 1, and its value is 8'b00000001. If the Y component of the RGB video signal is 0, the controller controls the converted YC444 signal to output the Y component. If the Y component value in the RGB video signal is 1, the controller controls the converted YC444 signal to process the luminance Y component to output the Y component. YC444 signal outputs C component. There are odd and even points on the YC444 signal. If the Y component of the YC444 signal of the odd point is 0, the C component of the YC444 signal takes the C component of the next point as the average of the C components of the two points. When the Y component of the even-numbered YC444 signal is 0, the C component of the YC444 signal takes the C component of the previous number as the average of the two C components. When the Y component is not 0, the odd and even points are not distinguished. , The C component in the YC444 signal takes the C component of the next number point as the average of the number point C component. For example: YC444 signal is 1920*1080@60HZ signal resolution. Among them, the number of pixels in a row is 1920, the first pixel is odd, the second pixel is even, the third is odd, and the fourth is odd. Points are even-numbered points, and so on; when the Y component of the second pixel is 0, the C component of the second pixel is the average of the C component of the first pixel and the C component of the second pixel When the Y component of the third pixel is 0, the C component of the third pixel is the average of the C component of the third pixel and the C component of the fourth pixel. When the Y component is not 0, the odd and even points are not distinguished, and the C component of the next point is taken as the average of the C components of the points.

Therefore, in step S2 in the embodiment of the present invention, the data is not lost during the conversion process of the RGB video signal to the YC signal by using the brightness, and the required fused video data is separated by the brightness Y data; for the YC444 signal Special processing of the parity points causes data loss in the conversion process of the chrominance components. Based on the above-mentioned brightness and chrominance processing of the video signal, the quality of the fused video signal is effectively improved, thereby improving the quality of the fused video. In step S2, the video In the process of signal processing, it also solves the problem of fusion video quality caused by the chrominance loss of the processed video signal.

Fig. 3 is a flowchart of steps of video fusion data processing in the video fusion method according to an embodiment of the present invention.

As shown in FIG. 3, in an embodiment of the present invention, in the step S3, the processing step of obtaining video fusion data includes:

S31. Perform signal conversion on the YC422 video signal in the video data and convert it into an RGB signal;

S32. If the Y component value of the YC422 video signal is 0 and the control signal sent by the controller is 0, remove the YC422 video signal data whose Y component value is 0 to obtain YC422 video signal data whose Y component is not 0, which is The processed YC422 video signal data; if the Y component of the YC422 video signal is 0 and the control signal sent by the controller is 1, remove the YC422 video signal data whose Y component value is not 0, and obtain YC422 with a Y component of 0 The video signal data is the processed YC422 video signal data.

It should be noted that the fusion processing is performed according to the YC422 video signal data and the RGB signal data processed by the controller to obtain the video fusion data. In step S3, there is a YC signal in the process of obtaining video fusion data. In the process of converting RGB signals, when the three components of R, G, and B of the converted RGB signal are within the controller setting range value, the YC422 video signal The Y component value in the YC422 video signal is set to 0, and the YC422 video signal data whose value is 0 is removed or retained when the Y component value in the YC422 video signal is 0, to obtain the processed YC422 video signal data.

In step S4 in the embodiment of the present invention, the obtained video fusion data is fused with other videos to obtain a video with high quality after fusion.

Embodiment two:

Fig. 4 is a frame diagram of a video fusion device according to an embodiment of the present invention.

As shown in FIG. 4, an embodiment of the present invention provides a video fusion device, including a controller 10, and a video signal processing module 20 and a video fusion processing module 30 to be fused that are respectively connected to the controller 10;

The to-be-fused video signal processing module 20 is used to perform brightness and chroma processing on the to-be-fused video signal to obtain video data;

The video fusion processing module 30 is configured to perform fusion processing on video data to obtain video fusion data;

The controller 10 is used to control whether the video fusion data is fused with the video.

It should be noted that the to-be-fused video signal processing module 20 utilizes the feature of no loss of data during the conversion of RGB signals into YC by brightness, and separates the required fused data through brightness Y data; chrominance components are also converted into YC from RGB signals In the process of performing special processing on the odd and even points, data loss will occur in the signal in the video signal, and the video signal of the video data will be output. The video signal of the output video data is input to the video fusion processing module 30. The video fusion processing module 30 is in the process of converting the YC signal to the RGB signal. When the three components of the converted RGB signal, R, G, and B, are set in the controller Within the range value, set the Y component value in the YC422 video signal to 0, and remove or retain the YC422 video signal data with a value of 0 when the Y component value in the YC422 video signal is 0, to obtain the processed YC422 video signal data, The processed YC422 video signal data and RGB signal data are fused to obtain video fusion data; the video fusion data is fused with other videos through the controller to obtain a high-quality video after fusion, which improves the quality of the fusion video. It solves the technical problem that the edge abnormality caused by the color format change in the existing processing video fusion process, which causes the poor quality of the fusion video.

The to-be-fused video signal processing module 20 in the embodiment of the present invention includes a video signal acquisition unit 21, a first signal conversion unit 22, a brightness processing unit 23, a first selection unit 24, a second signal conversion unit 25, and a first output unit 26;

The video signal acquisition unit 21 acquires the video signal to be fused as an RGB video signal. The video signal acquisition unit 21 is respectively connected to the first signal conversion unit 22 and the brightness processing unit 23, and the first signal conversion unit 22 is respectively connected to the first selection unit 24. Connected to the brightness processing unit 23, the brightness processing unit 23 is also connected to the first selection unit 24, the first selection unit 24 is also connected to the second signal conversion unit 25, the second signal conversion unit 25 is connected to the first output unit 26, the controller 10 is respectively connected to the brightness processing unit 23 and the first selection unit 24, and the first output unit 26 is connected to the video fusion processing module 30.

It should be noted that the video signal acquisition unit 21 is mainly used to acquire the RGB video signal of the video, the first signal conversion unit 22 is used to convert the RGB video signal into a YC444 signal, and the brightness processing unit 23 uses the brightness Y component for signal processing and control The device 10 controls the first selection unit 22 to output YC444 signals with Y and C components, and the second signal conversion unit 25 is used to convert the YC444 signals with Y and C components into YC422 video signals, and the YC422 video signals are output from the first The unit 26 is delivered to the video fusion processing module 30. Specifically, when the R, G, and B components of the video signal acquisition unit 21 are within the setting range of the controller 10, the Y component value of the video signal in the brightness processing unit 23 is set to 0, and when the first signal conversion unit 22. When the Y component value of the output YC444 signal is 0, set its lowest bit to 1. In other cases, the Y component value of the YC444 signal is maintained and output as the first signal conversion unit 22; the first selection unit 24 is the Y component of the YC444 signal The output selection is controlled by the controller 10. When the Y component of the YC444 signal is 0, the first signal conversion unit 22 outputs the Y component of the YC444 signal, and when the Y component of the RGB video signal is 1, it is processed by the brightness processing unit 23. After outputting the Y component value in the RGB video signal, the first selection unit 24 outputs the chrominance component CbCr (C component) which is output by the YC444 signal in the first signal conversion unit 22; the second signal conversion unit 25 converts the YC444 signal into YC422 Signal, when the Y component of the odd point in the YC444 signal is 0, the chrominance component CbCr (C component) takes the C component of the next point as the average of the two C components, when the even point Y in the YC444 signal When the component is 0, the chrominance component CbCr (C component) takes the C component of the previous number point as the average of the two number points C components. When the Y component in the YC444 signal is not 0, the chrominance component CbCr (C component) is taken regardless of the odd and even points. The C component of the next number of points is taken as the average of the number of C components; the signal output by the first output unit 26 is the YC422 signal output, and the YC422 signal output by the first output unit 26 is used as the input signal of the video fusion processing module 30.

The video fusion processing module 30 in the embodiment of the present invention includes a third signal conversion unit 31, a video fusion processing unit 32, a second selection unit 33, and a second output unit 34; the first output unit 26 and the third signal conversion unit respectively 31 is connected to the video fusion processing unit 32, the third signal conversion unit 31 is also connected to the second selection unit 33, the video fusion processing unit 32 is also connected to the second selection unit 33, and the second selection unit 33 is also connected to the second output unit 34 In connection, the controller 10 is also connected to the video fusion processing unit 32 and the second selection unit 33 respectively. The third signal conversion unit 31 converts the YC422 video signal into an RGB signal, and the video fusion processing unit 32 removes or retains the YC422 video signal data whose value is 0 when the Y component value in the YC422 signal is 0, to obtain a processed YC422 video signal According to the data, the controller 10 controls the second selection unit 33 whether to select the processed YC422 video signal data and the RGB signal for fusion processing to obtain the video fusion data, and the second output unit 34 outputs the video fusion RGB signal.

It should be noted that the YC422 signal output by the first output unit 26 is transmitted to the signal input end of the video fusion processing module 30 and then enters the video fusion processing module 30, and the third signal conversion unit 31 transfers the output signal to the signal input end of the video fusion processing module 30. The YC422 signal is converted to RGB video signal, and the video fusion processing unit 32 performs fusion data processing. When the Y component of the signal input terminal of the video fusion processing module 30 is 0 and the control signal of the controller 10 is 0, the Y component of the YC422 signal is removed. The 0 data keeps the Y component data in the YC422 signal that is not 0. When the control signal of the controller 10 is 1, the Y component in the YC422 signal is kept as 0 data and the Y component data in the YC422 signal is saved unless the 0YC422 signal is saved; the second selection unit 33 is The selector selects whether to perform fusion processing, and is controlled by the controller 10, 0 does not perform fusion processing, and 1 performs fusion processing; the second output unit 34 outputs RGB fusion signals. Among them, when the three components of R, G, and B are in the setting range of the controller 10, the setting range is determined by the video data to be fused in actual application.

Example three:

The embodiment of the present invention provides a storage medium including a processor and a memory;

The memory is used to store the program code and transmit the program code to the processor;

The processor is configured to execute the aforementioned video fusion method according to the instructions in the program code.

It should be noted that the processor is configured to execute the steps in the foregoing embodiment of the video fusion method according to the instructions in the program code, such as steps S1 to S4 shown in FIG. 1. Or, when the processor executes the computer program, the functions of the modules/units in the foregoing device embodiments, such as the functions of the units 101 to 103 shown in FIG. 4, are realized.

Exemplarily, the computer program may be divided into one or more modules/units, and the one or more modules/units are stored in the memory and executed by the processor to complete the application. One or more modules/units may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program in the terminal device. For example, the computer program can be divided to include the controller 10 and the to-be-fused video signal processing module 20 and the video fusion processing module 30 respectively connected to the controller 10:

The to-be-fused video signal processing module 20 is used to perform brightness and chroma processing on the to-be-fused video signal to obtain video data;

The video fusion processing module 30 is used to perform fusion processing on video data to obtain video fusion data;

The controller 10 is used to control whether the video fusion data is fused with the video.

The terminal device can be a computing device such as a desktop computer, a notebook, a palmtop computer, and a cloud server. The terminal device may include, but is not limited to, a processor and a memory. Those skilled in the art can understand that it does not constitute a limitation on the terminal device. It may include more or fewer components than shown in the figure, or combine certain components, or different components. For example, the terminal device may also include input and output devices, Network access equipment, bus, etc.

The so-called processor can be a central processing unit (Central Processing Unit, CPU), other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.

The memory may be an internal storage unit of the terminal device, such as the hard disk or memory of the terminal device. The memory can also be an external storage device of the terminal device, such as a plug-in hard disk equipped on the terminal device, a smart memory card (Smart Media Card, SMC), a Secure Digital (SD) card, a flash memory card (Flash Card), etc. . Further, the memory may also include both an internal storage unit of the terminal device and an external storage device. The memory is used to store computer programs and other programs and data required by the terminal device. The memory can also be used to temporarily store data that has been output or will be output.

Those skilled in the art can clearly understand that, for the convenience and conciseness of the description, the specific working process of the above-described system, device, and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, device, and method can be implemented in other ways. For example, the device embodiments described above are merely illustrative, for example, the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined or It can be integrated into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

In addition, the functional units in the various embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solution of the present invention essentially or the part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium. , Including several instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disks or optical disks and other media that can store program codes. .

As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present invention, but not to limit them. Although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: The technical solutions recorded in the embodiments are modified, or some of the technical features are equivalently replaced; these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (10)

1. A video fusion method is characterized in that it comprises the following steps:

   S1. Obtain the video signal and video to be fused;

   S2. Perform brightness and chroma processing on the video signal to obtain processed video data;

   S3. Perform fusion processing on the video data to obtain video fusion data;

   S4. Fusion of the video fusion data and the video.
2. The video fusion method according to claim 1, wherein the video signal is an RGB video signal, and in the step S2, the processing step of obtaining the video data comprises:

   S21. Perform signal conversion on the RGB video signal and convert it into a YC444 signal;

   S22. Perform luminance Y component processing on the luminance in the YC444 signal, and perform processing on the chrominance in the YC444 signal, and output the Y component and the C component;

   S23. After processing, the YC444 signal having the Y component and the C component is converted into a YC422 video signal, and the data in the YC422 video signal is the processed video data.
3. The video fusion method according to claim 2, characterized in that, in the step S22, the three components of R, G, and B in the RGB video signal are within the preset value range of the controller and pass through After the luminance Y component is processed, the Y component value of the video signal is set to 0;

   If the Y component value of the YC444 signal is 0, the lowest bit is set to 1, otherwise the Y component value of the YC444 signal remains the original value and output;

   If the value of the Y component in the RGB video signal is 0, the controller controls the converted YC444 signal to output the Y component;

   If the Y component value in the RGB video signal is 1, the controller controls the converted YC444 signal to process the luminance Y component to output the Y component;

   The YC444 signal is provided with an odd point and an even point. If the Y component of the YC444 signal of the odd point is 0, the C component of the YC444 signal takes the C component of the next point as the two number points. The average of the C component. If the Y component of the YC444 signal at the even-numbered point is 0, the C component of the YC444 signal takes the C component of the previous point as the average of the C-components of the two points. When the Y component When it is not 0, no odd and even points are distinguished, and the C component of the YC444 signal takes the C component of the next number point as the average of the number points C component.
4. The video fusion method according to claim 1, wherein in the step S3, the processing step of obtaining the video fusion data comprises:

   S31. Perform signal conversion on the YC422 video signal in the video data, and convert it into an RGB signal;

   S32. If the Y component value of the YC422 video signal is 0 and the control signal sent by the controller is 0, remove the YC422 video signal data whose Y component value is 0 to obtain the YC422 whose Y component is not 0 The video signal data is the processed YC422 video signal data; if the Y component value in the YC422 video signal is 0 and the control signal sent by the controller is 1, remove the Y component value that is not 0 The YC422 video signal data obtains the YC422 video signal data whose Y component is 0, which is the processed YC422 video signal data.
5. The video fusion method according to claim 4, wherein in the step S3, fusion processing is performed according to the YC422 video signal data and the RGB signal data processed by the controller to obtain the The video fusion data.
6. A video fusion device, characterized by comprising a controller and a video signal processing module to be fused and a video fusion processing module connected to the controller respectively;

   The to-be-fused video signal processing module is used to perform brightness and chroma processing on the to-be-fused video signal to obtain video data;

   The video fusion processing module is used to perform fusion processing on the video data to obtain video fusion data;

   The controller is used to control whether the video fusion data is fused with the video.
7. The video fusion device according to claim 6, wherein the to-be-fused video signal processing module includes a video signal acquisition unit, a first signal conversion unit, a brightness processing unit, a first selection unit, a second signal conversion unit, and First output unit

   The video signal to be fused obtained by the video signal acquisition unit is an RGB video signal, the video signal acquisition unit is respectively connected to the first signal conversion unit and the brightness processing unit, and the first signal conversion unit is connected to the first signal conversion unit and the brightness processing unit respectively. The first selection unit is connected to the brightness processing unit, the brightness processing unit is also connected to the first selection unit, the first selection unit is further connected to the second signal conversion unit, and the second signal The conversion unit is connected to the first output unit, the controller is respectively connected to the brightness processing unit and the first selection unit, and the first output unit is connected to the video fusion processing module.
8. The video fusion device according to claim 7, wherein the first signal conversion unit is used to convert the RGB video signal into a YC444 signal, the brightness processing unit uses the brightness Y component for signal processing, and the The controller controls the first selection unit to output a YC444 signal having a Y component and a C component, and the second signal conversion unit is used to convert the YC444 signal having a Y component and a C component into a YC422 video signal, the YC422 video signal From the first output unit to the video fusion processing module.
9. The video fusion device according to claim 8, wherein the video fusion processing module comprises a third signal conversion unit, a video fusion processing unit, a second selection unit, and a second output unit;

   The first output unit is respectively connected to the third signal conversion unit and the video fusion processing unit, the third signal conversion unit is also connected to the second selection unit, and the video fusion processing unit is also connected to the The second selection unit is connected, the second selection unit is also connected to the second output unit, and the controller is also connected to the video fusion processing unit and the second selection unit respectively;

   The third signal conversion unit converts the YC422 video signal into an RGB signal, and the video fusion processing unit removes or retains the YC422 video signal data whose value is 0 when the Y component value in the YC422 signal is 0 , The processed YC422 video signal data is obtained; the controller controls whether the second selection unit selects the processed YC422 video signal data and the RGB signal for fusion processing to obtain video fusion data; The second output unit outputs the RGB signal after video fusion.
10. A storage medium, characterized by comprising a processor and a memory;

    The memory is used to store program code and transmit the program code to the processor;

    The processor is configured to execute the video fusion method according to any one of claims 1 to 5 according to instructions in the program code.

Images