CN114666517A - Video fusion display method and device and display screen control system - Google Patents
Video fusion display method and device and display screen control system Download PDFInfo
- Publication number
- CN114666517A CN114666517A CN202210335824.9A CN202210335824A CN114666517A CN 114666517 A CN114666517 A CN 114666517A CN 202210335824 A CN202210335824 A CN 202210335824A CN 114666517 A CN114666517 A CN 114666517A
- Authority
- CN
- China
- Prior art keywords
- image
- display
- fused
- frame
- videos
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000004927 fusion Effects 0.000 title claims abstract description 61
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000004891 communication Methods 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 6
- 238000012163 sequencing technique Methods 0.000 claims description 2
- 238000005516 engineering process Methods 0.000 abstract description 6
- 230000004044 response Effects 0.000 description 17
- 238000010586 diagram Methods 0.000 description 6
- 241001270131 Agaricus moelleri Species 0.000 description 4
- 238000013507 mapping Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000002688 persistence Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000003068 static effect Effects 0.000 description 3
- 238000007499 fusion processing Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000012769 display material Substances 0.000 description 1
- 208000002173 dizziness Diseases 0.000 description 1
- 238000009432 framing Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 208000018997 giddiness Diseases 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The application discloses a video fusion display method and device and a display screen control system. Wherein, the method comprises the following steps: acquiring a plurality of videos to be fused; adjusting display attribute information of each frame of image in a plurality of videos to be fused, wherein the display attribute information at least comprises one of the following information: image display frequency, image display duration, image display sequence, image output phase and image display brightness; and fusing each frame of image in the plurality of videos to be fused based on the display attribute information to obtain a fused video, and displaying the fused video. The method and the device solve the technical problems that in the related technology, due to the fact that multiple pictures are displayed alternately and content difference is large, the pictures flicker, and human eyes cannot watch the pictures directly during video fusion.
Description
Technical Field
The application relates to the technical field of display screen display control, in particular to a video fusion display method and device and a display screen control system.
Background
In recent years, because some shooting cannot be carried out for outdoor framing, logistics, manpower and time cost are increased along with the shooting of many waves, and the post-production cost of background green curtain shooting is high, an indoor shooting technology is gradually derived, people and scenes are shot in one step, and a lot of post-production cost can be reduced. However, the requirement of camera shooting on display materials is high, after comprehensive comparison, the LED display screen is found to be more advantageous, the brightness is high, the color gamut is wide, the content of a display picture is basically close to a natural scene seen by human eyes, the LED display screen is formed by splicing box bodies, the LED display screen can be flexibly spliced into a large display screen to form a complete display background wall, and 360-degree dead-angle-free shooting is realized.
However, in the related art, when the LED display screen performs video fusion display, due to the fact that multiple pictures are displayed alternately and the content difference is large, the pictures flicker, and discomfort such as giddiness and the like can occur when people directly watch the LED display screen, and at this time, shooting can only be performed through a camera.
In view of the above problems, no effective solution has been proposed.
Disclosure of Invention
The embodiment of the application provides a video fusion display method and device and a display screen control system, and aims to at least solve the technical problems that in the related technology, due to the fact that multiple pictures are displayed alternately and content difference is large, the pictures flicker, and human eyes cannot watch the pictures directly during video fusion.
According to an aspect of an embodiment of the present application, there is provided a video fusion display method applied to a display screen control system, the method including: acquiring a plurality of videos to be fused; adjusting display attribute information of each frame of image in the videos to be fused, wherein the display attribute information at least comprises one of the following information: image display frequency, image display duration, image display sequence, image output phase and image display brightness; and fusing each frame of image in the plurality of videos to be fused based on the display attribute information to obtain a fused video, and displaying the fused video.
Optionally, the adjusting the display attribute information of each frame of image in the multiple videos to be fused includes: responding to a frequency adjusting instruction, and adjusting the output frame frequency of sending equipment in the display screen control system to a target frequency; and adjusting the image display frequency of one or more videos to be fused in the plurality of videos to be fused based on the target frequency.
Optionally, the determining the display attribute information of each frame of image in the multiple videos to be fused, where the display attribute information is the image display duration, includes: and responding to a time length adjusting instruction, adjusting the display time length of each frame of image in the videos to be fused based on the output frame frequency of the sending equipment in the display screen control system, and determining the image display time length of each frame of image.
Optionally, the adjusting the display attribute information of each frame of image in the multiple videos to be fused includes: and responding to a sequence adjustment instruction, sequencing the display sequence of each frame of image in the videos to be fused, and determining the image display sequence of each frame of image, wherein the display sequence of each frame of image in the same video to be fused is unchanged.
Optionally, the adjusting the display attribute information of each frame of image in the multiple videos to be fused, where the display attribute information is the image output phase, includes: and responding to a phase adjustment instruction, adjusting the output phase of each frame of image in the plurality of videos to be fused, and determining the image output phase of each frame of image.
Optionally, the adjusting the display attribute information of each frame of image in the multiple videos to be fused includes: responding to a brightness adjusting instruction, and determining a first image with brightness to be adjusted and a second image without brightness adjustment in the plurality of videos to be fused; adjusting the gray value of each pixel in the first image to adjust the image display brightness of the first image; the image display brightness of the second image is kept unchanged.
Optionally, a communication connection is established with a shooting device for shooting the fusion video, wherein the shooting device is used for shooting a target frame image in the fusion video; and sending the display attribute information corresponding to the target frame image to the shooting equipment, wherein the display attribute information corresponding to the target frame image is used for the shooting equipment to adjust the shooting phase and the exposure time.
According to another aspect of the embodiments of the present application, there is also provided a video fusion display apparatus, including: the acquisition module is used for acquiring a plurality of videos to be fused; the adjusting module is configured to adjust display attribute information of each frame of image in the multiple videos to be fused, where the display attribute information at least includes one of the following information: image display frequency, image display duration, image display sequence, image output phase and image display brightness; and the fusion display module is used for fusing each frame of image in the plurality of videos to be fused based on the display attribute information to obtain a fusion video and displaying the fusion video.
According to another aspect of the embodiments of the present application, there is also provided a display screen control system, including: the sending device is used for acquiring a plurality of videos to be fused and determining display attribute information of each frame of image in the videos to be fused, wherein the display attribute information at least comprises one of the following information: image display frequency, image display duration, image display sequence, image output phase and image display brightness; fusing each frame image in the videos to be fused based on the display attribute information to obtain a fused video; the receiving equipment is used for controlling a display screen to display each frame of image in the fusion video based on the display attribute information; and the display screen is used for displaying the fusion video.
According to another aspect of the embodiments of the present application, there is also provided an electronic device, including: the video fusion display system comprises a memory and a processor, wherein the memory stores a computer program, and the processor is configured to execute the video fusion display method through the computer program.
In the embodiment of the present application, after a plurality of videos to be fused are obtained, display attribute information of each frame of image in the plurality of videos to be fused is first adjusted, where the display attribute information at least includes one of the following information: image display frequency, image display duration, image display sequence, image output phase and image display brightness; and then fusing each frame of image in the plurality of videos to be fused based on the display attribute information to obtain a fused video, and displaying the fused video. The method comprises the steps of adjusting the display frequency, the display duration, the display sequence, the output phase, the display brightness and the like of frame images in a video to be fused, and enabling the video to be suitable for human eyes to watch while meeting the shooting condition of a camera, so that the technical problems that in the related technology, due to the fact that multiple pictures are displayed alternately and content difference is large, the pictures flicker, and human eyes cannot watch directly during video fusion are solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a schematic flowchart of a video fusion display method according to an embodiment of the present application;
FIG. 2 is a schematic illustration of a video fusion display according to the related art;
FIG. 3 is a schematic diagram of adjusting image display frequency according to an embodiment of the present application;
FIG. 4 is a diagram illustrating an adjustment of a display duration of an image according to an embodiment of the present application;
FIG. 5 is a schematic diagram of adjusting an image display sequence according to an embodiment of the present application;
FIG. 6 is a diagram illustrating adjusting a display phase of an image according to an embodiment of the present application;
FIG. 7 is a schematic diagram of adjusting the duration and sequence of image display according to an embodiment of the present application;
FIG. 8 is a scene schematic of a video fusion display according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of a video fusion display device according to an embodiment of the present application.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example 1
In accordance with an embodiment of the present application, there is provided a video fusion display method applied to a display screen control system, it should be noted that the steps shown in the flowchart of the drawings may be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in an order different from that here.
Fig. 1 is a schematic flowchart of an alternative video fusion display method according to an embodiment of the present application, and as shown in fig. 1, the method at least includes steps S102-S106, where:
step S102, a plurality of videos to be fused are obtained;
step S104, adjusting display attribute information of each frame of image in a plurality of videos to be fused, wherein the display attribute information at least comprises one of the following information: image display frequency, image display duration, image display sequence, image output phase and image display brightness;
and S106, fusing each frame of image in the plurality of videos to be fused based on the display attribute information to obtain a fused video, and displaying the fused video.
In some optional embodiments of the present application, a sending device in a display screen control system may receive videos to be fused from a plurality of video input sources, perform fusion processing on the videos, send the videos to a receiving device, and control a display screen to display the videos by the receiving device. The sending device mainly refers to a sending card, the receiving device mainly refers to a receiving card, and the video to be fused can be a conventional video stream or a static frame image.
In the related art, when video fusion is performed, frame images in several videos are often displayed in an intersecting manner. Taking fig. 2 as an example, it is assumed that the frame frequency of the input A, B two videos to be fused is 60Hz, and the output frame frequency is usually 120Hz, wherein the frame images a1, B1, a2, B2, A3, and B3 are displayed alternately, so as to facilitate 2 cameras to capture different angles of content respectively. However, in some scenes, the content of A, B video may be very different, and there may be a flickering picture, which is not suitable for human eyes to watch, although the camera can shoot normally.
In order to solve the above problem, the embodiment of the present application provides a method for adjusting display attribute information, such as display frequency, display duration, display order, output phase, display brightness, and the like, of a frame image in a video to be fused, so that a finally displayed video is suitable for being watched by human eyes while meeting a camera shooting condition.
First, considering that the persistence of vision of the human eye for image contents whose display time is long is longer, if the display time of an important image is extended and the display time of an unimportant image is compressed, the human eye does not easily perceive the unimportant image, and thus viewing discomfort is not caused. The scheme can be realized by adjusting the display frequency or the display time length of the frame image.
When the image display frequency is determined, the output frame frequency of the sending equipment in the display screen control system can be adjusted to the target frequency in response to the frequency adjusting instruction; and adjusting the image display frequency of one or more videos to be fused in the plurality of videos to be fused based on the target frequency. Wherein the target frequency does not exceed the maximum output frame rate of the transmitting device.
Taking fig. 3 as an example, when fusing A, B two videos, the sending device may adjust the output frame frequency to 7 times of the original output frame frequency, wherein the image display frequency of the a video is adjusted to 6 times of the original one, and the image display frequency of the B video remains unchanged, so that the final display effect is that the a1 image continuously displays 6 frames and then the B1 image displays 1 frame, so as to display alternately, because the frame image in the B video has a shorter display time and is not easy to be perceived by human eyes, the frame image in the a video is mainly seen, so that viewing discomfort is not caused, and the camera can still shoot normally only by adjusting the shooting phase and the exposure time correspondingly.
When the image display duration is determined, the display duration of each frame of image in the videos to be fused can be adjusted based on the output frame frequency of the sending equipment in the display screen control system in response to the duration adjustment instruction, and the image display duration of each frame of image is determined. The subsequent receiving device can control the driving IC to adjust the display of each frame of image and the black field time by recognizing the display attribute information to adjust the image refresh time.
Taking fig. 4 as an example, when A, B two videos are fused, the sending device outputs a frame frequency of 120Hz, that is, two frame images in A, B videos are displayed within 16.66ms, normally a1 displays 8.33ms, and B1 displays 8.33ms, so that the two frames are alternately displayed, at this time, the display time of the frame images in A, B two videos can be respectively adjusted, for example, the display time of the frame image in the a video is adjusted to 16ms, and the display time of the frame image in the B video is adjusted to 0.66ms, so that the display time of the frame image in the B video is shorter and human eyes are not easy to perceive, and the frame image in the a video is mainly seen, so that viewing discomfort is not caused, and the camera can still normally shoot only by correspondingly adjusting the shooting phase and the exposure time.
Optionally, the display order of each frame of image in the multiple videos to be fused may also be sequenced in response to the order adjustment instruction, and the image display order of each frame of image is determined, where the display order of each frame of image in the same video to be fused is not changed.
The frame images with small difference are arranged together by adjusting the display sequence of each frame image, so that serious flicker of video pictures can be avoided. Taking fig. 5 as an example, when fusing A, B two videos, considering that frame images a2 and B1 have a large difference and frame images A3 and B2 have a large difference, but frame images a2 and B2 have a small difference, the order of a2 and B2 may be exchanged, so that the final display order is a1, B1, B2, a2, A3, and B3, and the display effect is better. It should be noted that, when the display order of each frame image is adjusted, in order to ensure that the original video content is not changed, the display order of each frame image in the same video to be fused is not changed.
Optionally, the output phase of each frame of image in the multiple videos to be fused may also be adjusted in response to the phase adjustment instruction, so as to determine the image output phase of each frame of image.
In the above description, the display frequency, the display duration, the display order, and the output phase of the frame image in the video to be fused are respectively adjusted singly, and in practical application, a user can simultaneously adjust one or more of the display frequency, the display duration, the display order, and the output phase of the frame image according to the actual video to be fused.
Taking fig. 6 as an example, when two videos A, B are fused, the display duration and the display order of the frame images in the A, B video are adjusted at the same time, for example, the display duration of the frame images in the a video is adjusted to 16ms, the display duration of the frame images in the B video is adjusted to 0.66ms, and the order of a2 and B2 is switched, so that finally, a1 displays 16ms, B1 displays 0.66ms, B2 displays 0.66ms, a2 displays 16ms, A3 displays 16ms, and B3 displays 0.66ms, and the display effect is better.
In some optional embodiments of the present application, in order to facilitate shooting, a communication connection may be further established with a shooting device for shooting the fusion video, where the shooting device is configured to shoot a target frame image in the fusion video; and sending the display attribute information corresponding to the target frame image to the shooting equipment, wherein the display attribute information corresponding to the target frame image is used for adjusting the shooting phase and the exposure time by the shooting equipment.
For example, multiple shooting devices may exist in a shooting site for shooting, the shooting of the target frame image means that each shooting device only needs to shoot a partial picture in the fusion video, and the shooting device can accurately shoot a required picture by adjusting the shooting phase and exposure time of the shooting device according to display attribute information corresponding to the picture to be shot, such as the output phase, display duration and the like of the picture. Among them, the photographing apparatus is generally a high definition camera.
Considering that human eyes are sensitive to high brightness when low brightness and high brightness are crossed, the embodiment of the application also provides that the brightness of the frame image in the video to be fused is changed so that the final video is suitable for being watched by the human eyes. Specifically, a first image with brightness to be adjusted and a second image without brightness adjustment in the plurality of videos to be fused may be determined in response to a brightness adjustment instruction; adjusting the gray value of each pixel in the first image to adjust the image display brightness of the first image; the image display luminance of the second image is kept unchanged.
When the image display brightness is adjusted, the image can be adjusted to the target brightness in response to the brightness parameter input by the user; the image display brightness can also be directly adjusted according to the gray scale mapping relation stored in the system in advance. For example, the received video to be fused is generally displayed with 8-bit brightness and corresponds to 0-255 gray scales, the display driving IC of the LED display screen is generally displayed with 16-bit brightness and corresponds to 0-65535 gray scales, and the receiving device can map the frame image of 0-255 gray scales in the video to be fused to 0-65535 gray scales through a preset gray scale mapping relationship curve, so as to adjust the display brightness of the image.
The common means of gray mapping is GAMMA transformation, which is to perform nonlinear transformation on the gray value of an input image, so that the gray value of the output image and the gray value of the input image have an exponential relationship:
wherein A is a constant, VinFor inputting gray values, VoutThe index GAMMA is the GAMMA. When GAMMA is larger than 1, the gray scale of a brighter area in the image is stretched, the gray scale of a darker area is compressed to be darker, and the overall brightness of the image becomes dark; when GAMMA is less than 1, the gray scale of the lighter area in the image is compressed, the gray scale of the darker area is stretched to be brighter, and the overall brightness of the image is darkened. Generally, the display screen control system stores corresponding high-brightness GAMMA tables and low-brightness GAMMA tables, and the corresponding GAMMA tables can be selected as required to perform gray scale conversion on the gray scale value of the image so as to adjust the display brightness of the image.
Taking fig. 7 as an example, when A, B two videos are fused, assuming that the a video is a white image with 255-level gray scale and the B video is a gray image with 127-level gray scale, in response to a brightness adjustment instruction, the sending device determines to perform brightness adjustment on all the images, and the receiving device may map the curve of the white image with 255-level gray scale into a white image with 65535-level gray scale through a preset GAMMA table, so that the brightness of the white image is the highest, and human eyes can easily recognize the white image; and mapping the gray image curve with 127-level gray scale to a gray image with 255-level gray scale, so that the brightness of the gray image is the lowest and cannot be perceived by human eyes.
In the shooting process, as the shooting equipment is usually a high-definition camera, each gray-scale fall can be shot basically, when a shot image is manufactured in the later stage, histogram pull-up can be directly performed to adjust the brightness of the image, meanwhile, local brightness protection can be performed on part of objects in the later stage, and the edge difference of the objects is properly adjusted; it is also possible to adjust only the background color brightness.
Fig. 8 is a schematic view of an application scenario of the video fusion display method, where a video to be fused is A, B, C, D, and a sending device 81 in a display screen control system performs frequency doubling, time length adjustment, phase modulation, output sorting and other processing on the video and sends the video to a receiving device 82, and the receiving device 82 identifies image display attribute information, adjusts brightness of an image through a GAMMA table, and then controls a display screen 83 to display the processed image through a driving IC; the cameras 1, 2 and 3 adjust the shooting phase and the exposure time of the cameras according to the display attribute information of each frame of image in the video A, C, D so as to respectively shoot the image of the video A, C, D; the viewer can clearly see video B without interference from other videos.
In the embodiment of the present application, after a plurality of videos to be fused are obtained, display attribute information of each frame of image in the plurality of videos to be fused is first adjusted, where the display attribute information at least includes one of the following information: image display frequency, image display duration, image display sequence, image output phase and image display brightness; and then fusing each frame of image in the plurality of videos to be fused based on the display attribute information to obtain a fused video, and displaying the fused video. The method comprises the steps of adjusting the display frequency, the display duration, the display sequence, the output phase, the display brightness and the like of frame images in a video to be fused, and enabling the video to be suitable for human eyes to watch while meeting the shooting condition of a camera, so that the technical problems that in the related technology, due to the fact that multiple pictures are displayed alternately and content difference is large, the pictures flicker, and human eyes cannot watch directly during video fusion are solved.
Example 2
According to an embodiment of the present application, there is further provided a display screen control system for implementing the video fusion display method in embodiment 1, as shown in fig. 8, the system at least includes a sending device 81, a receiving device 82, and a display screen 83, where:
the sending device 81 is configured to acquire a plurality of videos to be fused, and determine display attribute information of each frame of image in the plurality of videos to be fused, where the display attribute information at least includes one of the following information: image display frequency, image display duration, image display sequence, image output phase and image display brightness; fusing each frame of image in the videos to be fused based on the display attribute information to obtain a fused video;
the receiving device 82 is used for controlling the display screen to display each frame of image in the fusion video based on the display attribute information;
and the display screen 83 is used for displaying the fused video.
In some optional embodiments of the present application, a sending device in a display screen control system may receive videos to be fused from a plurality of video input sources, perform fusion processing on the videos, send the videos to a receiving device, and control a display screen to display the videos by the receiving device. The sending device mainly refers to a sending card, the receiving device mainly refers to a receiving card, and the video to be fused can be a conventional video stream or a static frame image.
Considering that the persistence of vision of the human eye for image contents whose display time is long is longer, if the display time of important images is extended and the display time of unimportant images is compressed, the human eye does not easily perceive the unimportant images, and thus, viewing discomfort is not caused. The scheme can be realized by adjusting the display frequency or the display time length of the frame image.
When the image display frequency is determined, the output frame frequency of the sending equipment in the display screen control system can be adjusted to the target frequency in response to the frequency adjusting instruction; and adjusting the image display frequency of one or more videos to be fused in the plurality of videos to be fused based on the target frequency. Wherein the target frequency does not exceed the maximum output frame frequency of the transmitting device.
When the image display duration is determined, the display duration of each frame of image in the videos to be fused can be adjusted based on the output frame frequency of the sending equipment in the display screen control system in response to the duration adjustment instruction, and the image display duration of each frame of image is determined.
Optionally, the display order of each frame of image in the multiple videos to be fused may also be sequenced in response to the order adjustment instruction, and the image display order of each frame of image is determined, where the display order of each frame of image in the same video to be fused is not changed.
Optionally, the output phase of each frame of image in the multiple videos to be fused may also be adjusted in response to the phase adjustment instruction, so as to determine the image output phase of each frame of image.
In practical application, a user can simultaneously adjust one or more of the display frequency, the display duration, the display sequence and the output phase of the frame image according to the actual video to be fused.
In some optional embodiments of the present application, in order to facilitate shooting, a communication connection may be further established with a shooting device that shoots the fusion video, where the shooting device is configured to shoot a target frame image in the fusion video; and sending the display attribute information corresponding to the target frame image to the shooting equipment, wherein the display attribute information corresponding to the target frame image is used for adjusting the shooting phase and the exposure time of the shooting equipment.
Considering that human eyes are sensitive to high brightness when low brightness and high brightness are crossed, the embodiment of the application also provides that the brightness of the frame image in the video to be fused is changed so that the final video is suitable for being watched by the human eyes. Specifically, a first image with brightness to be adjusted and a second image without brightness adjustment in the plurality of videos to be fused may be determined in response to a brightness adjustment instruction; adjusting the gray value of each pixel in the first image to adjust the image display brightness of the first image; the image display luminance of the second image is kept unchanged.
The sending equipment can fuse each frame of image in the videos to be fused according to the determined display attribute information to obtain a fused video; the receiving device can control the display screen to display the processed image through the drive IC according to the display attribute information of each frame of image in the fusion video.
In the embodiment of the application, the display screen control system adjusts the display frequency, the display duration, the display sequence, the output phase, the display brightness and the like of the frame images in the video to be fused through the devices, meets the shooting condition of the camera and is suitable for human eyes to watch, and therefore the technical problems that in the related technology, due to the fact that multiple pictures are displayed alternately and the content difference is large, the pictures flicker, and human eyes cannot watch directly during video fusion are solved.
Example 3
According to an embodiment of the present application, there is further provided a video fusion display apparatus for implementing the video fusion display method in embodiment 1, as shown in fig. 9, the apparatus at least includes an obtaining module 91, a determining module 92 and a fusion display module 93, where:
an obtaining module 91, configured to obtain multiple videos to be fused;
the adjusting module 92 is configured to adjust display attribute information of each frame of image in multiple videos to be fused, where the display attribute information at least includes one of the following information: image display frequency, image display duration, image display sequence, image output phase and image display brightness;
and the fusion display module 93 is configured to fuse each frame of image in the multiple videos to be fused based on the display attribute information to obtain a fusion video, and display the fusion video.
Specifically, the acquisition module receives videos to be fused from a plurality of video input sources, and sends the videos to the receiving device after the videos are fused, and the receiving device controls the display screen to display the videos. The sending device mainly refers to a sending card, the receiving device mainly refers to a receiving card, and the video to be fused can be a conventional video stream or a static frame image.
Considering that the persistence of vision of the human eye for image contents whose display time is long is longer, if the display time of an important image is extended and the display time of an unimportant image is compressed, the human eye does not easily perceive the unimportant image, and thus viewing discomfort is not caused. The scheme can be realized by adjusting the display frequency or the display time length of the frame image.
When the image display frequency is determined, the output frame frequency of the sending equipment in the display screen control system can be adjusted to the target frequency in response to the frequency adjusting instruction; and adjusting the image display frequency of one or more videos to be fused in the plurality of videos to be fused based on the target frequency. Wherein the target frequency does not exceed the maximum output frame rate of the transmitting device.
When the image display duration is determined, the display duration of each frame of image in the videos to be fused can be adjusted based on the output frame frequency of the sending equipment in the display screen control system in response to the duration adjustment instruction, and the image display duration of each frame of image is determined.
Optionally, the display order of each frame of image in the multiple videos to be fused may also be sequenced in response to the order adjustment instruction, and the image display order of each frame of image is determined, where the display order of each frame of image in the same video to be fused is not changed.
Optionally, the output phase of each frame of image in the multiple videos to be fused may also be adjusted in response to the phase adjustment instruction, so as to determine the image output phase of each frame of image.
In practical application, a user can simultaneously adjust one or more of the display frequency, the display duration, the display sequence and the output phase of the frame image according to the actual video to be fused.
In some optional embodiments of the present application, in order to facilitate shooting, a communication connection may be further established with a shooting device that shoots the fusion video, where the shooting device is configured to shoot a target frame image in the fusion video; and sending the display attribute information corresponding to the target frame image to the shooting equipment, wherein the display attribute information corresponding to the target frame image is used for adjusting the shooting phase and the exposure time by the shooting equipment.
Considering that human eyes are sensitive to high brightness when low brightness and high brightness are crossed, the embodiment of the application also provides that the brightness of the frame image in the video to be fused is changed so that the final video is suitable for being watched by the human eyes. Specifically, a first image with brightness to be adjusted and a second image without brightness adjustment in the plurality of videos to be fused may be determined in response to a brightness adjustment instruction; adjusting the gray value of each pixel in the first image to adjust the image display brightness of the first image; the image display luminance of the second image is kept constant.
It should be noted that, in the embodiment of the present application, each module in the video fusion display device corresponds to each implementation step of the video fusion display method in embodiment 1 one to one, and since the detailed description is already performed in embodiment 1, some details that are not shown in this embodiment may refer to embodiment 1, and are not described herein again.
Example 4
According to an embodiment of the present application, there is also provided a non-volatile storage medium including a stored program, wherein, when the program runs, a device in which the non-volatile storage medium is located is controlled to execute the video fusion display method in embodiment 1.
According to an embodiment of the present application, there is also provided a processor configured to execute a program, where the program executes the video fusion display method in embodiment 1.
According to an embodiment of the present application, there is also provided an electronic device, including: a memory in which a computer program is stored, and a processor configured to execute the video fusion display method in embodiment 1 by the computer program.
Optionally, implementing the following steps may be performed when the program is running: acquiring a plurality of videos to be fused; adjusting display attribute information of each frame of image in a plurality of videos to be fused, wherein the display attribute information at least comprises one of the following information: image display frequency, image display duration, image display sequence, image output phase and image display brightness; and fusing each frame of image in the plurality of videos to be fused based on the display attribute information to obtain a fused video, and displaying the fused video.
The above-mentioned serial numbers of the embodiments of the present application are merely for description, and do not represent the advantages and disadvantages of the embodiments.
In the above embodiments of the present application, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed technical content can be implemented in other manners. The above-described embodiments of the apparatus are merely illustrative, and for example, a division of a unit may be a division of a logic function, and an actual implementation may have another division, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or may not be executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application, or portions or all or portions of the technical solutions that contribute to the prior art, may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The foregoing is only a preferred embodiment of the present application and it should be noted that those skilled in the art can make several improvements and modifications without departing from the principle of the present application, and these improvements and modifications should also be considered as the protection scope of the present application.
Claims (10)
1. A video fusion display method is applied to a display screen control system and is characterized by comprising the following steps:
acquiring a plurality of videos to be fused;
adjusting display attribute information of each frame of image in the videos to be fused, wherein the display attribute information at least comprises one of the following information: image display frequency, image display duration, image display sequence, image output phase and image display brightness;
fusing each frame image in the videos to be fused based on the display attribute information to obtain a fused video, and displaying the fused video.
2. The method according to claim 1, wherein the display attribute information is the image display frequency, and adjusting the display attribute information of each frame of image in the plurality of videos to be fused comprises:
responding to a frequency adjusting instruction, and adjusting the output frame frequency of sending equipment in the display screen control system to a target frequency;
and adjusting the image display frequency of one or more videos to be fused in the plurality of videos to be fused based on the target frequency.
3. The method according to claim 1, wherein the determining the display attribute information of each frame of image in the videos to be fused is performed by taking the display attribute information as the image display duration, and comprises:
and responding to a time length adjusting instruction, adjusting the display time length of each frame of image in the videos to be fused based on the output frame frequency of sending equipment in the display screen control system, and determining the image display time length of each frame of image.
4. The method according to claim 1, wherein the adjusting the display attribute information of each frame of image in the plurality of videos to be fused for the image display order comprises:
and responding to a sequence adjustment instruction, sequencing the display sequence of each frame of image in the videos to be fused, and determining the image display sequence of each frame of image, wherein the display sequence of each frame of image in the same video to be fused is unchanged.
5. The method according to claim 1, wherein the adjusting the display attribute information of each frame of image in the plurality of videos to be fused for the image output phase comprises:
and responding to a phase adjustment instruction, adjusting the output phase of each frame of image in the plurality of videos to be fused, and determining the image output phase of each frame of image.
6. The method according to claim 1, wherein the adjusting the display attribute information of each frame of image in the plurality of videos to be fused is performed by adjusting the display attribute information of each frame of image in the plurality of videos to be fused, including:
responding to a brightness adjusting instruction, and determining a first image with brightness to be adjusted and a second image without brightness adjustment in the plurality of videos to be fused;
adjusting the gray value of each pixel in the first image to adjust the image display brightness of the first image;
the image display brightness of the second image is kept unchanged.
7. The method according to any one of claims 2 to 5, further comprising:
establishing communication connection with shooting equipment for shooting the fusion video, wherein the shooting equipment is used for shooting a target frame image in the fusion video;
and sending the display attribute information corresponding to the target frame image to the shooting equipment, wherein the display attribute information corresponding to the target frame image is used for the shooting equipment to adjust the shooting phase and the exposure time.
8. A video fusion display apparatus, comprising:
the acquisition module is used for acquiring a plurality of videos to be fused;
the adjusting module is configured to adjust display attribute information of each frame of image in the multiple videos to be fused, where the display attribute information at least includes one of the following information: image display frequency, image display duration, image display sequence, image output phase and image display brightness;
and the fusion display module is used for fusing each frame of image in the plurality of videos to be fused based on the display attribute information to obtain a fusion video and displaying the fusion video.
9. A display screen control system, comprising:
the sending device is used for acquiring a plurality of videos to be fused and determining display attribute information of each frame of image in the videos to be fused, wherein the display attribute information at least comprises one of the following information: image display frequency, image display duration, image display sequence, image output phase and image display brightness; fusing each frame image in the videos to be fused based on the display attribute information to obtain a fused video;
the receiving equipment is used for controlling a display screen to display each frame of image in the fusion video based on the display attribute information;
and the display screen is used for displaying the fusion video.
10. An electronic device, comprising: a memory in which a computer program is stored, and a processor configured to execute the video fusion display method according to any one of claims 1 to 7 by the computer program.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210335824.9A CN114666517A (en) | 2022-03-31 | 2022-03-31 | Video fusion display method and device and display screen control system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210335824.9A CN114666517A (en) | 2022-03-31 | 2022-03-31 | Video fusion display method and device and display screen control system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN114666517A true CN114666517A (en) | 2022-06-24 |
Family
ID=82033671
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210335824.9A Pending CN114666517A (en) | 2022-03-31 | 2022-03-31 | Video fusion display method and device and display screen control system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN114666517A (en) |
-
2022
- 2022-03-31 CN CN202210335824.9A patent/CN114666517A/en active Pending
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11375128B2 (en) | Method for obtaining exposure compensation values of high dynamic range image, terminal device and non-transitory computer-readable storage medium | |
CN101061704B (en) | Color adjusting device and method | |
JP2002262303A (en) | Video processing unit, video display device and video processing method used for the same, and its program | |
CN108717691B (en) | Image fusion method and device, electronic equipment and medium | |
CN107077830B (en) | Screen brightness adjusting method suitable for unmanned aerial vehicle control end and unmanned aerial vehicle control end | |
US8559529B2 (en) | Display system, image output device and image display device | |
CN108923853A (en) | Display methods and device, visible light communication transmission method and device | |
CN107888839A (en) | High-dynamic-range image acquisition method, device and equipment | |
US20190082138A1 (en) | Inverse tone-mapping to a virtual display | |
JP2013122662A (en) | Display system, calibration method, computer program, and recording medium | |
US20170280090A1 (en) | Binocular display and method for displaying images | |
US10810970B1 (en) | Display device | |
CN114339173A (en) | Projection image correction method, laser projection system and readable storage medium | |
CN114302064B (en) | Video processing method, device and system based on receiving card | |
JP4029316B2 (en) | Image type identification method and apparatus and image processing program | |
US8502882B2 (en) | Image pick-up apparatus, white balance setting method and recording medium | |
CN110446021A (en) | A kind of implementation method of mobile phone and its dual camera | |
US8164650B2 (en) | Image processing apparatus and method thereof | |
CN113450703A (en) | Display screen compensation method and device, computer readable storage medium and electronic equipment | |
CN114666517A (en) | Video fusion display method and device and display screen control system | |
CN116013184A (en) | Display screen processing method, device, equipment and medium | |
CN112738425A (en) | Real-time video splicing system with multiple cameras for acquisition | |
CN105976343B (en) | Picture exposure correction method and device and intelligent equipment | |
CN113810677A (en) | Screen brightness adjusting method, terminal and readable storage medium | |
CN110521212A (en) | Video record and processing system and method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |