WO2017211250A1 - 图像的叠加显示方法和系统 - Google Patents

图像的叠加显示方法和系统 Download PDF

Info

Publication number
WO2017211250A1
WO2017211250A1 PCT/CN2017/087143 CN2017087143W WO2017211250A1 WO 2017211250 A1 WO2017211250 A1 WO 2017211250A1 CN 2017087143 W CN2017087143 W CN 2017087143W WO 2017211250 A1 WO2017211250 A1 WO 2017211250A1
Authority
WO
WIPO (PCT)
Prior art keywords
area
video frames
window size
video
content
Prior art date
Application number
PCT/CN2017/087143
Other languages
English (en)
French (fr)
Inventor
田超
Original Assignee
深圳创维数字技术有限公司
深圳市创维软件有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳创维数字技术有限公司, 深圳市创维软件有限公司 filed Critical 深圳创维数字技术有限公司
Publication of WO2017211250A1 publication Critical patent/WO2017211250A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/14—Display of multiple viewports
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/37—Details of the operation on graphic patterns
    • G09G5/377—Details of the operation on graphic patterns for mixing or overlaying two or more graphic patterns
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/39—Control of the bit-mapped memory
    • G09G5/395—Arrangements specially adapted for transferring the contents of the bit-mapped memory to the screen
    • G09G5/397—Arrangements specially adapted for transferring the contents of two or more bit-mapped memories to the screen simultaneously, e.g. for mixing or overlay
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/482—End-user interface for program selection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows

Definitions

  • the present disclosure relates to the field of video playback technology, for example, to a superimposed display method and system for an image.
  • the large-size giant screen TV provides good conditions for the expansion of the digital TV service.
  • some specific positions in the video image can provide a comparison to the user by presenting static pictures or moving images.
  • Good viewing mode and new experience effects, such as in the process of TV playback the photo can be presented to the user in real time through the form of a picture, the user can view the comment information of the program, and can also select an area during the video playing process.
  • the user simultaneously plays the program content being played by other program channels, or plays the program source from other devices, and the like.
  • the present disclosure provides an overlay display method and system for images, which can superimpose and display an auxiliary image in an area where the dynamic change of the anchor video content of the full screen output is minimal, and present an auxiliary image without affecting the visual effect of the anchor video, thereby improving the user experience.
  • the present disclosure provides an overlay display method for an image, including:
  • the target area an area having the largest number of pixels in which the content is unchanged when the plurality of video frames are displayed, according to a window size at the time of outputting the auxiliary image
  • the auxiliary image is superimposed and displayed in the target area.
  • the size of the target area is greater than or equal to the window size and less than 2 times the window size.
  • the window size when the auxiliary image is output the area with the largest number of pixels that does not change the content when the plurality of video frames are displayed is obtained from the area where the plurality of video frames are full-screen output.
  • the target area including:
  • the iterative segmentation comprises:
  • the selected area is taken as the target area
  • the selected area is used as the divided object of the next iteration
  • the object that is divided for the first time is an area when the plurality of video frames are full screen output.
  • the number of pixels in which the content is unchanged when the plurality of video frames are displayed in each area obtained by the statistical segmentation includes:
  • the preset pixel point is unchanged as the content of the multiple video frames Pixels.
  • the acquiring multiple video frames of the anchor video output full screen includes:
  • multiple video frames of the anchor video currently outputted from the full screen are read from the video buffer according to the preset sampling period.
  • an overlay display system for images including:
  • a video frame obtaining module configured to obtain a plurality of video frames of the anchor video outputted by the full screen
  • the target area acquiring module is configured to obtain, according to the window size at the time of outputting the auxiliary image, the number of pixels having the same content when the plurality of video frames are displayed, from the area of the full screen output of the plurality of video frames The area as the target area; and,
  • the target area obtaining module includes:
  • a window size obtaining module configured to obtain a window size when the auxiliary image is output; and an iterative segmentation module configured to iteratively divide the area when the plurality of video frames are full-screen output until the area of the obtained divided area is greater than or equal to The window size is less than 2 times the window size, and the divided area is used as a target area;
  • the iterative segmentation module includes:
  • the equalization segmentation module is configured to equally divide the segmentation objects to obtain two regions of equal area
  • a pixel number counting module configured to count the number of pixels in which the content is unchanged when the plurality of video frames are displayed in each region obtained by the segmentation;
  • the target region determining module is configured to select the content including the content unchanged An area having a large number of pixels, when the area of the selected area is greater than or equal to the window size and less than 2 times the window size, the selected area is used as the target area;
  • the segmentation area determining module is configured to select an area having a larger number of pixels including the content, and when the area of the selected area is greater than 2 times the window size, the selected area is used as the next iteration Segmented segmentation area;
  • the object that is divided for the first time is an area when the plurality of video frames are full screen output.
  • the pixel number statistics module includes:
  • the ARGB value obtaining module is configured to respectively select a plurality of preset pixel points in each region obtained by the segmentation, and calculate a plurality of transparency red green blue ARGB values corresponding to each preset pixel point when displaying the plurality of video frames;
  • An average calculation module configured to calculate an average value of the plurality of ARGB values corresponding to each preset pixel point
  • a pixel point determining module configured to set the preset pixel point as the plurality of pixels if a difference between a plurality of ARGB values of the preset pixel point and the average value is within a preset difference value range
  • the pixel of the video frame has the same content
  • the number statistics module is set to count the number of pixels in which the content is unchanged.
  • the video frame obtaining module is configured to: after the preset time period, read a plurality of video frames of the anchor video output by the current full screen from the video buffer according to the preset sampling period.
  • the superimposed display system of the image further includes:
  • a preset duration setting module set to set the preset duration
  • a sampling period setting module is configured to set the preset sampling period.
  • the present disclosure also provides a computer readable storage medium storing computer executable instructions for performing a superimposed display method of the above images.
  • the present disclosure also provides an electronic device comprising at least one processor, a memory communicatively coupled to the at least one processor, and a display screen communicatively coupled to the at least one processor;
  • the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to perform an overlay display method of the image.
  • the disclosure superimposes and displays the auxiliary image in the area where the dynamic change of the anchor video content of the full screen output is minimal, and presents the auxiliary image while not affecting the visual effect of the anchor video, thereby improving the user experience, and the calculation method is simple and the calculation program is small.
  • FIG. 1 is a flowchart of a superimposed display method of an image provided in the first embodiment
  • FIG. 2 is a flowchart of a superimposed display method of an image provided in the second embodiment
  • FIG. 3 is a block diagram showing the structure of a superimposed display system for images provided in the third embodiment
  • FIG. 4 is a block diagram showing the structure of a superimposed display system for images provided in the fourth embodiment
  • FIG. 5 is a schematic structural diagram of hardware of an electronic device according to Embodiment 5 of the present disclosure.
  • FIG. 1 is a flowchart of a method for superimposing an image provided by the first embodiment.
  • the method can be applied to terminals such as digital televisions and computers.
  • the superimposed display method of the image may include the following steps.
  • step 110 a plurality of video frames of the anchor video output full screen are acquired.
  • the preset duration During the preset duration, according to the preset sampling period, multiple video frames of the current full-screen output of the anchor video are read in real time from the video buffer area, such as reading the current video buffer from the anchor video every 1 second.
  • the video frame of the played anchor video is cached, and 5 video frames of the anchor video can be read in 5 seconds.
  • the preset duration and the preset sampling period are adjustable, and may be default options, or may be customized by the customer and adjusted according to the needs of the customer.
  • step 120 according to the small window size (ie, the window size) at the time of outputting the auxiliary image, the pixels of the plurality of video frames that are displayed in the full screen output are obtained from the regions in which the plurality of video frames are displayed.
  • the area with the largest number is the target area.
  • the auxiliary image may be the program content being played by other program channels, or the program source from other devices, etc., and when the anchor video is being played, the auxiliary image is played in the form of a small window, which can provide the user with more choices. Users won't miss a lot of exciting content.
  • the size of the small window is smaller than the size of the window displayed in full screen.
  • Obtaining a small window size when the auxiliary image is output in the form of a small window according to the small window size, finding an area with the smallest dynamic change of the content of the video frame from the area space outputted by the full screen of the five video frames by using an iterative algorithm,
  • the area serves as a target area for the auxiliary image output display, the area of the target area being greater than or equal to the small window size and less than 2 times the small window size.
  • the area in which the content dynamic change of the video frame is the smallest is the area where the number of the pixels of the five video frames does not change.
  • step 130 the auxiliary image is superimposed and displayed within the target area.
  • the auxiliary image is superimposed and displayed in the target area.
  • the auxiliary image is presented in the area where the content of the anchor video content changes minimally, and is not displayed in a fixed position, so as not to block
  • the important content currently played by the anchor video affects the visual effect.
  • the superimposed display method of the image obtains the video frame of the anchor video output by the full screen, and acquires the area from the full screen output of the video frame according to the small window size when the auxiliary image is output.
  • An area in which the content of the video frame dynamically changes is the smallest, and the area is used as a target area, and the auxiliary image is superimposed and displayed in the target area; and the full screen is found according to the video frame of the anchor video and the small window size when the auxiliary image is output.
  • the area where the content of the output anchor video dynamically changes is minimal, and the auxiliary image is superimposed and displayed in the area, and the auxiliary image can be presented without affecting the visual effect of the anchor video, thereby improving the user experience, and the calculation method is simple and the calculation program is small.
  • FIG. 2 is a flowchart of a method for superimposing an image provided by the second embodiment.
  • the superimposed display method of the image may include the following steps.
  • step 200 a plurality of video frames of the anchor video currently outputted by the full screen are read from the video buffer area according to a preset sampling period within a preset time period.
  • 5 video frames of the current full-screen output of the main video are read from the video buffer in 5 seconds at a frequency of 1/sec.
  • step 210 the small window size at the time of outputting the auxiliary image is acquired.
  • step 220 the area of the plurality of video frames when the full screen is output is equally divided to obtain two areas of equal area.
  • the region with the smallest dynamic change of the video frame content that is, the region with the smallest dynamic change of the pixel point, is found by using an iterative algorithm from the regional space outputted by the above five video frames.
  • the area of the five video frames full screen output is equally divided to obtain two areas of equal area, for example, the area of the full screen output can be divided into two areas of equal area, left and right, respectively. The left and right areas.
  • step 230 a plurality of preset pixel points in two equal-area regions are respectively selected, and a plurality of ARGB values corresponding to each preset pixel point when displaying a plurality of video frames are calculated, and each preset pixel is obtained.
  • ARGB Alpha, Red, Green, Blue, Transparency, Red, Green, Blue
  • step 240 if the difference between the plurality of ARGB values of the preset pixel point and the average value is within a preset difference range, the preset pixel point is used as the multiple video frames. The content of the pixel is unchanged.
  • step 250 the number of pixels in which the content is unchanged is counted.
  • step 260 an area including a larger number of pixel points in which the content is unchanged is used as the divided area divided by the next iteration.
  • the left area is used as the divided area divided by the next iteration, and the left area is equalized
  • Dividing for example, the left area can be divided into upper and lower areas of equal area, and the number of pixels with the same content in the upper and lower areas of the same area is compared in the same way, and the content including the content is unchanged.
  • the area with a larger number of pixels is used as the divided area separated by the next iteration.
  • step 270 it is determined whether the area of the divided area is greater than or equal to the small window size and less than 2 times the small window size. If yes, the process proceeds to step 290; if not, the process proceeds to step 280.
  • step 280 the divided regions are equally divided to obtain two regions of equal area, and the process proceeds to step 230.
  • the divided area is further iteratively divided, that is, the divided area is equally divided to obtain two areas of equal area, and the process returns to step 230 to repeat the content dynamics.
  • the process of comparison of changes that is, the comparison process of the number of pixels with constant content.
  • step 290 the segmented area is taken as a target area.
  • step 300 the auxiliary image is superimposed and displayed within the target area.
  • the area of the divided area is greater than or equal to the small window size and less than 2 times the small window size, ending the iterative calculation process, using the divided area as a target area, and superimposing the auxiliary image on the target area .
  • the superimposed display method of the image acquires a plurality of video frames of the currently playing anchor video and a small window size when the auxiliary image is output, and the plurality of video frames are determined by an iterative algorithm.
  • the area of the full-screen output is equally divided to obtain two areas of equal area, and the number of pixels in which the content of the two areas is equal is obtained, and the area containing the number of the pixels is used as the area.
  • the segmentation region is divided by the next iteration, and the segmentation region is iteratively divided until the area of the segmentation region is greater than or equal to the small window size and less than 2 times the small window size, and the segmentation region is used as the target region.
  • auxiliary image in a superimposed manner on the target area; according to the video frame of the anchor video and the small window size when the auxiliary image is output, finding an area where the dynamic change of the content of the anchor video outputted by the full screen is the smallest, and displaying the auxiliary image in the area
  • the auxiliary image can be presented without affecting the visual effect of the anchor video, which improves the user experience, and the calculation method is simple and the calculation program is small.
  • FIG. 3 is a structural block diagram of a superimposed display system for images provided in the third embodiment. Part of the system embodiment is not described in detail.
  • the superimposed display system of the image includes a video frame obtaining module 1000, a target area acquiring module 2000, and a superimposed display module 3000.
  • the video frame obtaining module 1000 is configured to acquire a video frame of the anchor video outputted by the full screen.
  • the video frame is obtained from the set top box terminal in the buffer area of the anchor video and cached.
  • the target area obtaining module 2000 is configured to acquire, according to the small window size when the auxiliary image is output, the area with the smallest dynamic change of the content of the video frame from the area space output by the full frame of the video frame, and use the area as the target area. .
  • the superimposed display module 3000 is arranged to superimpose and display the auxiliary image in the target area.
  • the above-mentioned iterative algorithm is used to find out the region where the main video content currently being played has the smallest change, and the region is used as the target region, and the target region may be located in the upper left corner region of the digital television.
  • the auxiliary image is presented in the upper left corner area, and other algorithms can be used to find out the area where the anchor video content currently being played has the smallest change.
  • the superimposed display system of the image of the embodiment obtains the video frame of the anchor video outputted by the full screen, and acquires the video frame from the regional space output by the full screen of the video frame according to the small window size when the auxiliary image is output.
  • the area with the smallest content dynamic change, the area is used as the target area, and the auxiliary image is superimposedly displayed in the target area; the anchor of the full screen output is found according to the video frame of the anchor video and the small window size when the auxiliary image is outputted.
  • the area where the content of the video dynamically changes is the smallest, and the auxiliary image is superimposed and displayed in the area, and the auxiliary image can be presented without affecting the visual effect of the anchor video, thereby improving the user experience.
  • FIG. 4 is a structural block diagram of a superimposed display system for images provided in the fourth embodiment.
  • the superimposed display system of the image may further include the following modules.
  • the preset duration setting module 4000 is set to set the preset duration.
  • the sampling period setting module 5000 is configured to set the preset sampling period.
  • the preset duration and the preset sampling period values can be adjusted according to the accuracy requirements of the real-time display.
  • the video frame obtaining module 1000 is configured to read, according to a preset sampling period, a plurality of video frames of the anchor video output by the current full screen from the video buffer area within a preset time period.
  • the target area obtaining module 2000 may include the following modules.
  • the window size acquisition module 2100 is configured to acquire a small window size when the auxiliary image is output.
  • the iterative segmentation module 2200 is configured to iteratively divide the region when the plurality of video frames are full-screen output until the area of the obtained segmentation region is greater than or equal to the window size and less than 2 times the window size. The divided area is taken as a target area.
  • the iterative segmentation module 2200 includes an equalization segmentation module 2210, a pixel point number statistics module 2220, a target region determination module 2230, and a segmentation region determination module 2240.
  • the equalization segmentation module 2210 is configured to equally divide the region space when the video frame is full screen output Get two areas of equal area.
  • the pixel number counting module 2220 is configured to count the number of pixels in which the content of the video frame is unchanged in the area where the area is equal.
  • the target area determining module 2230 is configured to select an area having a larger number of pixels including the content, when the area of the selected area is greater than or equal to the window size and less than 2 times the window size , the selected area is taken as the target area.
  • the segmentation region determining module 2240 is configured to set a region having a larger number of pixel points including the content as the segmentation region divided by the next iteration.
  • the object that is divided for the first time is an area when the plurality of video frames are full screen output.
  • the pixel number counting module 2220 may include an ARGB value obtaining module 2221, an average value calculating module 2222, a pixel point determining module 2223, and a number counting module 2224.
  • the ARGB value obtaining module 2221 is configured to respectively select a plurality of preset pixel points in each region obtained by the segmentation, and calculate a plurality of transparency red green blue ARGB values corresponding to each preset pixel point when displaying multiple video frames. .
  • the average calculation module 2222 is configured to calculate an average of the plurality of ARGB values corresponding to each of the preset pixel points.
  • the pixel point determining module 2223 is configured to set the preset pixel point as the plurality if the difference between the plurality of ARGB values of the preset pixel point and the average value is within a preset difference value range.
  • the pixel of the video frame has the same content. as well as,
  • the number statistics module 2224 is configured to count the number of pixels in which the content is unchanged.
  • the superimposed display system of the image of the embodiment obtains the size of the small window when the plurality of video frames of the anchor video currently being played and the auxiliary image are output, and the regional space when the plurality of video frames are full screen output through an iterative algorithm.
  • the number of pixels in which the content is unchanged in the region, the region containing the number of pixels having the same content is used as the segmentation region divided by the next iteration until the area of the segmentation region is greater than or equal to the small
  • the window size is less than 2 times the size of the small window, and the divided area is used as a target area, and the auxiliary image is superimposed and displayed in the target area; according to the video frame of the anchor video and the small window size when the auxiliary image is output, Find the area with the least dynamic change of the content of the main video output, and display the auxiliary image in the area, which can display the auxiliary image without affecting the visual effect of the anchor video, improve the user experience, and the calculation method is simple, and the calculation is simple. Less procedures.
  • the embodiment further provides a computer readable storage medium storing computer executable instructions for performing a superimposed display method of the above image.
  • FIG. 5 is a schematic diagram showing the hardware structure of an electronic device according to Embodiment 5. As shown in FIG. 5, the electronic device includes: one or more processors 410 and a memory 420. One processor 410 is taken as an example in FIG.
  • the electronic device may further include an input device 430 and a display screen 440.
  • the processor 410, the memory 420, the input device 430, and the display screen 440 in the electronic device may be connected by a bus or other means, as exemplified by a bus connection in FIG.
  • the input device 430 can receive input digital or character information
  • the display screen 440 can include a display device such as a display screen.
  • the memory 420 is a computer readable storage medium that can be used to store software programs, computer executable programs, and modules.
  • the processor 410 executes various functional applications and data processing by executing software programs, instructions, and modules stored in the memory 420 to implement any of the above-described embodiments.
  • the memory 420 may include a storage program area and an storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to usage of the electronic device, and the like.
  • the memory may include random access memory (Random Access) Volatile memory, such as Memory, RAM, may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device.
  • Memory 420 can be a non-transitory computer storage medium or a transitory computer storage medium.
  • the non-transitory computer storage medium such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device.
  • memory 420 can optionally include memory remotely located relative to processor 410, which can be connected to the electronic device over a network. Examples of the above networks may include the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
  • Input device 430 can be used to receive input digital or character information and to generate key signal inputs related to user settings and function control of the electronic device.
  • Display 440 can display video content.
  • a person skilled in the art can understand that all or part of the process of implementing the above embodiment method can be completed by executing related hardware by a computer program, and the program can be stored in a non-transitory computer readable storage medium.
  • the program when executed, may include the flow of an embodiment of the method as described above, wherein the non-transitory computer readable storage medium may be a magnetic disk, an optical disk, a read only memory (ROM), or a random access memory (RAM). Wait.
  • the disclosure superimposes and displays the auxiliary image in the area where the dynamic change of the anchor video content of the full screen output is minimal, and the auxiliary image can be presented without affecting the visual effect of the anchor video, thereby improving the user experience, and the calculation method is simple and the calculation program is small.

Abstract

一种图像的叠加显示方法和系统，该方法包括：获取满屏输出的主播视频的多个视频帧，根据辅助图像输出时的窗口尺寸，从所述多个视频帧满屏输出的区域中，获取显示所述多个视频帧时内容不变的像素点的个数最多的区域作为目标区域，在所述目标区域内叠加显示所述辅助图像。

Description

图像的叠加显示方法和系统 技术领域
本公开涉及视频播放技术领域，例如涉及一种图像的叠加显示方法和系统。
背景技术
随着数字电视技术的日益发展，传统的电视收看方式正在发生改变，数字电视业务呈现多样化。大尺寸的巨屏电视给数字电视业务的扩展提供了良好的条件，节目视频播放的过程中，在视频图像中的一些特定位置通过呈现静态图片或者动态图像的方式，可以给用户提供一种较好的收看方式和新的体验效果，比如在电视播放过程中，可以通过图片的形式实时地向用户呈现相片，可以呈现用户收看节目的评论信息，还可以在视频播放过程中，选择一个区域向用户同时播放其他节目频道正在播放的节目内容，或者播放来自于其他设备的节目片源等。
电视视频中呈现其他图片或者图像的方法有以下两种。其一，将视频层主播对象缩小，预留出空间以呈现其他图片或者图像；其二，在保持主播对象满屏输出的情况下，将其他图片或者图像直接叠加在主播对象的固定位置空间进行呈现，而这个位置空间很可能是主播对象内容动态变化的最关键部分，这样用户所观看的精彩视频内容就会被遮挡。这两种呈现方式都会影响主播对象的视觉效果。
发明内容
本公开提出一种图像的叠加显示方法和系统，可以在满屏输出的主播视频内容动态变化最小的区域叠加显示辅助图像，在不影响主播视频视觉效果的同时呈现辅助图像，提升用户的体验感。
一方面，本公开提出一种图像的叠加显示方法，包括：
获取满屏输出的主播视频的多个视频帧；
根据辅助图像输出时的窗口尺寸，从所述多个视频帧满屏输出的区域中，获取显示所述多个视频帧时内容不变的像素点的个数最多的区域作为目标区域；以及，
在所述目标区域内叠加显示所述辅助图像。
可选地，所述目标区域的尺寸大于或等于所述窗口尺寸，且小于2倍的所述窗口尺寸。
可选地，所述根据辅助图像输出时的窗口尺寸，从所述多个视频帧满屏输出的区域中，获取显示所述多个视频帧时内容不变的像素点的个数最多的区域作为目标区域，包括：
获取辅助图像输出时的窗口尺寸；
对所述多个视频帧满屏输出时的区域进行迭代分割，直至得到的分割区域的面积大于或等于所述窗口尺寸，且小于2倍的所述窗口尺寸为止，将所述分割区域作为目标区域；
其中，所述迭代分割包括：
将分割的对象均等分割得到面积相等的两个区域；
统计分割得到的每个区域中显示所述多个视频帧时内容不变的像素点的个数；
选择包括所述内容不变的像素点的个数较多的区域；
当所选择的区域的面积大于或等于所述窗口尺寸，且小于2倍的所述窗口尺寸时，将所选择的区域作为目标区域；
当所选择的区域的面积大于2倍的所述窗口尺寸时，将所选择的区域作为下一次迭代分割的分割对象；
其中，第一次分割的对象为所述多个视频帧满屏输出时的区域。
可选地，所述统计分割得到的每个区域中显示所述多个视频帧时内容不变的像素点的个数，包括：
分别选取分割得到的每个区域中的多个预设像素点，计算每个预设像素点在显示多个视频帧时对应的多个透明度红色绿色蓝色ARGB值，求取每个预设像素点对应的多个ARBG值的平均值；
若所述预设像素点的多个ARGB值与所述平均值之间的差值在预设差值范围内，则将所述预设像素点作为所述多个视频帧的内容不变的像素点；以及，
统计所述内容不变的像素点的个数。
可选地，所述获取满屏输出的主播视频的多个视频帧，包括：
在预设时长内，按照预设采样周期，从视频缓存区读取当前满屏输出的主播视频的多个视频帧。
另一方面，本公开还提出一种图像的叠加显示系统，包括：
视频帧获取模块，设置为获取满屏输出的主播视频的多个视频帧；
目标区域获取模块，设置为根据辅助图像输出时的窗口尺寸，从所述多个视频帧满屏输出的区域中，获取显示所述多个视频帧时内容不变的像素点的个数最多的区域作为目标区域；以及，
叠加显示模块，设置为在所述目标区域内叠加显示所述辅助图像。
可选地，所述目标区域获取模块包括：
窗口尺寸获取模块，设置为获取辅助图像输出时的窗口尺寸；迭代分割模块，设置为对所述多个视频帧满屏输出时的区域进行迭代分割，直至得到的分割区域的面积大于或等于所述窗口尺寸，且小于2倍的所述窗口尺寸为止，将所述分割区域作为目标区域；其中，
所述迭代分割模块包括：
均等分割模块，设置为将分割对象均等分割得到面积相等的两个区域；
像素点个数统计模块，设置为统计分割得到的每个区域中显示所述多个视频帧时内容不变的像素点的个数；目标区域确定模块，设置为选择包括所述内容不变的像素点的个数较多的区域，当所选择的区域的面积大于或等于所述窗口尺寸，且小于2倍的所述窗口尺寸时，将所选择的区域作为目标区域；
分割区域确定模块，设置为选择包括所述内容不变的像素点的个数较多的区域，当所选择的区域的面积大于2倍的所述窗口尺寸时，将所选择的区域作为下一次迭代分割的分割区域；
其中，第一次分割的对象为所述多个视频帧满屏输出时的区域。
可选地，所述像素点个数统计模块包括：
ARGB值获取模块，设置为分别选取分割得到的每个区域中的多个预设像素点，计算每个预设像素点在显示多个视频帧时对应的多个透明度红色绿色蓝色ARGB值；
平均值计算模块，设置为计算每个预设像素点对应的多个ARGB值的平均值；
像素点确定模块，设置为若所述预设像素点的多个ARGB值与所述平均值之间的差值在预设差值范围内，则将所述预设像素点作为所述多个视频帧的内容不变的像素点；以及，
个数统计模块，设置为统计所述内容不变的像素点的个数。
可选地，所述视频帧获取模块是设置为，在预设时长内，按照预设采样周期，从视频缓存区读取当前满屏输出的主播视频的多个视频帧。
可选地，该图像的叠加显示系统还包括：
预设时长设置模块，设置为设置所述预设时长；以及
采样周期设置模块，设置为设置所述预设采样周期。
本公开还提供一种计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令用于执行上述图像的叠加显示方法。
本公开还提供一种电子设备，包括至少一个处理器，与所述至少一个处理器通信连接的存储器，以及与所述至少一个处理器通信连接的显示屏；
其中，所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行时，执行上述图像的叠加显示方法。
本公开在满屏输出的主播视频内容动态变化最小的区域叠加显示辅助图像，在不影响主播视频视觉效果的同时呈现辅助图像，提升了用户的体验感，且计算方法简单，计算程序少。
附图说明
图1是本实施例一提供的图像的叠加显示方法的流程图；
图2是本实施例二提供的图像的叠加显示方法的流程图；
图3是本实施例三提供的图像的叠加显示系统的结构方框图；
图4是本实施例四提供的图像的叠加显示系统的结构方框图；以及
图5是本实施例五提供的一种电子设备的硬件结构示意图。
具体实施方式
下面结合附图并通过具体实施方式来说明本公开的技术方案。并且在不冲突的情况下，本公开中的实施例及实施例中的特征可以相互组合。
实施例一
参见图1，图1是本实施例一提供的图像的叠加显示方法的流程图。该方法可以是应用于数字电视、计算机等终端。
在实施例一中，该图像的叠加显示方法可以包括以下步骤。
在步骤110中，获取满屏输出的主播视频的多个视频帧。
在预设时长内，按照预设采样周期，从视频缓存区实时读取当前满屏输出的主播视频的多个视频帧，如每隔1秒从主播视频的视频缓存区中读取一个当前正在播放的主播视频的视频帧，并进行缓存，在5秒内可以读取到5个该主播视频的视频帧。其中，预设时长和预设采样周期是可以进行调整的，可以是默认选项，也可以客户自定义，依据客户的需求进行调整。
在步骤120中，根据辅助图像输出时的小窗尺寸(即窗口尺寸)，从所述多个视频帧满屏输出的区域中获取显示所述多个视频帧时内容不变的像素点的个数最多的区域作为目标区域。
该辅助图像可以为其他节目频道正在播放的节目内容，或者来自于其他设备的节目片源等，在主播视频正在播放时，以小窗口的形式播放辅助图像，可以给用户提供更多选择，使用户不会错过很多精彩内容。可选的，所述小窗的尺寸小于全屏显示的窗口的尺寸。
获取辅助图像以小窗口的形式输出时的小窗尺寸，根据该小窗尺寸，通过迭代算法从上述5个视频帧满屏输出的区域空间中找出视频帧内容动态变化最小的区域，将该区域作为辅助图像输出显示的目标区域，该目标区域的面积大于或等于所述小窗尺寸，且小于2倍的所述小窗尺寸。
上述视频帧的内容动态变化最小的区域为这5个视频帧的内容不变的像素点的个数较多的区域。
在步骤130中，在所述目标区域内叠加显示所述辅助图像。
在满屏输出的主播视频中，在上述目标区域内叠加显示该辅助图像，随着主播视频内容的变化，辅助图像在该主播视频内容变化最小的区域呈现，不会在固定位置显示，以免挡住主播视频当前播放的重要内容，影响视觉效果。
综上，本实施例提供的图像的叠加显示方法，通过获取满屏输出的主播视频的视频帧，根据辅助图像输出时的小窗尺寸，从所述视频帧满屏输出的区域空间中获取所述视频帧的内容动态变化最小的区域，将所述区域作为目标区域，在所述目标区域叠加显示所述辅助图像；根据主播视频的视频帧和辅助图像输出时的小窗尺寸，找到满屏输出的主播视频的内容动态变化最小的区域，在该区域叠加显示辅助图像，可以在不影响主播视频视觉效果的同时呈现辅助图像，提升了用户的体验感，且计算方法简单，计算程序少。
实施例二
参见图2，图2是本实施例二提供的图像的叠加显示方法的流程图。
在实施例二中，该图像的叠加显示方法可以包括以下步骤。
在步骤200中，在预设时长内，按照预设采样周期，从视频缓存区读取当前满屏输出的主播视频的多个视频帧。
延续上述例程，在5秒内，按照1个/秒的频率，从视频缓存区读取当前满屏输出的主播视频的5个视频帧。
在步骤210中，获取辅助图像输出时的小窗尺寸。
在步骤220中，将所述多个视频帧满屏输出时的区域空间均等分割得到两个面积相等的区域。
根据该小窗尺寸，通过迭代算法从上述5个视频帧满屏输出的区域空间中找出视频帧内容动态变化最小的区域，即像素点动态变化最小的区域。
可选地，将这5个视频帧满屏输出的区域空间进行均等分割，得到两个面积相等的区域，如可以将满屏输出的区域空间分割为左、右两个面积相等的区域，分别为左边区域和右边区域。
在步骤230中，分别选取两个面积相等的区域中的多个预设像素点，计算每个预设像素点在显示多个视频帧时对应的多个ARGB值，求取每个预设像素点对应的多个ARBG值的平均值。
对上述左边区域和右边区域进行内容动态变化的检测：获取5个视频帧在左边区域中的同一位置的5个像素点的ARGB(Alpha，Red，Green，Blue，透明度，红色，绿色，蓝色)值，计算5个像素点的ARGB值的平均值。同样，获取5个视频帧在右边区域中同一位置的5个像素点的ARGB值，计算5个像素点的ARGB值的平均值。
在步骤240中，若所述预设像素点的多个ARGB值与所述平均值之间的差值在预设差值范围内，则将所述预设像素点作为所述多个视频帧的内容不变的像素点。
计算左边区域中5个像素点的ARGB值与该平均值的差值，在该差值位于预设差值范围内的情况下，将该像素点作为这5个视频帧在左边区域的内容不变的像素点。同样，计算右边区域中5个像素点的ARGB值与该平均值的差值，在该差值位于预设差值范围内的情况下，将该像素点作为这5个视频帧在左边区域的内容不变的像素点。
在步骤250中，统计所述内容不变的像素点的个数。
分别统计左边区域内容不变的像素点的个数和右边区域内容不变的像素点 的个数。
在步骤260中，将包括所述内容不变的像素点的个数较多的区域作为下一次迭代分割的分割区域。
在左边区域包括的内容不变的像素点的个数大于右边区域包括的内容不变的像素点的个数的情况下，将左边区域作为下一次迭代分割的分割区域，并对左边区域进行均等分割，如可以将左边区域分割成上、下两个面积相等的区域，用同样的方法比较上、下两个面积相等的区域中内容不变的像素点的个数，将包括内容不变的像素点的个数较多的区域作为下一次迭代分隔的分割区域。
在步骤270中，判断所述分割区域的面积是否大于或等于所述小窗尺寸，且小于2倍的所述小窗尺寸，若是，进入步骤290；若否，进入步骤280。
在步骤280中，将所述分割区域均等分割得到两个面积相等的区域，并跳转至步骤230。
若上述分割区域的面积大于或等于2倍的所述小窗尺寸，将该分割区域继续进行迭代分割，即将该分割区域均等分割得到两个面积相等的区域，回到步骤230，重复上述内容动态变化的比较过程，即内容不变的像素点个数的比较过程。
在步骤290中，将所述分割区域作为目标区域。
在步骤300中，在所述目标区域内叠加显示所述辅助图像。
若上述分割区域的面积大于或等于所述小窗尺寸，且小于2倍的所述小窗尺寸，结束迭代计算过程，将该分割区域作为目标区域，并在该目标区域叠加显示所述辅助图像。
综上，本实施例提供的图像的叠加显示方法，获取当前正在播放的主播视频的多个视频帧和辅助图像输出时的小窗尺寸，通过迭代算法对该多个视频帧 满屏输出时的区域空间进行均等分割得到两个面积相等的区域，获取这两个面积相等的区域中内容不变的像素点的个数，将包含该像素点的个数较多的区域作为下一次迭代分割的分割区域，对分割区域进行迭代分割，直至该分割区域的面积大于或等于所述小窗尺寸，且小于2倍的所述小窗尺寸为止，将该分割区域作为目标区域，并在该目标区域叠加显示所述辅助图像；根据主播视频的视频帧和辅助图像输出时的小窗尺寸，找到满屏输出的主播视频的内容动态变化最小的区域，在该区域叠加显示辅助图像，可以在不影响主播视频视觉效果的同时呈现辅助图像，提升了用户的体验感，且计算方法简单，计算程序少。
实施例三
参见图3，图3是本实施例三提供的图像的叠加显示系统的结构方框图，在系统实施例中未详尽描述的部分参照方法实施例。
在实施例三中，该图像的叠加显示系统包括视频帧获取模块1000、目标区域获取模块2000以及叠加显示模块3000。
视频帧获取模块1000，设置为获取满屏输出的主播视频的视频帧。
从机顶盒终端，该主播视频的缓存区中获取上述视频帧，并缓存。
目标区域获取模块2000，设置为根据辅助图像输出时的小窗尺寸，从所述视频帧满屏输出的区域空间中获取所述视频帧的内容动态变化最小的区域，将所述区域作为目标区域。
叠加显示模块3000，设置为在所述目标区域内叠加显示所述辅助图像。
例如，接收到辅助图像的输出请求后，通过上述迭代算法找出当前正在播放的主播视频内容变化最小的区域，将该区域作为目标区域，该目标区域可以位于数字电视的左上角区域，则在该左上角区域呈现该辅助图像，也可以通过其他算法找出当前正在播放的主播视频内容变化最小的区域。
综上，本实施例图像的叠加显示系统，获取满屏输出的主播视频的视频帧，根据辅助图像输出时的小窗尺寸，从所述视频帧满屏输出的区域空间中获取所述视频帧的内容动态变化最小的区域，将所述区域作为目标区域，在所述目标区域叠加显示所述辅助图像；根据主播视频的视频帧和辅助图像输出时的小窗尺寸，找到满屏输出的主播视频的内容动态变化最小的区域，在该区域叠加显示辅助图像，可以在不影响主播视频视觉效果的同时呈现辅助图像，提升了用户的体验感。
实施例四
参见图4，图4是本实施例四提供的图像的叠加显示系统的结构方框图。
在上述实施例的基础上，该图像的叠加显示系统还可以包括以下模块。
预设时长设置模块4000，设置为设置所述预设时长。
采样周期设置模块5000，设置为设置所述预设采样周期。
可以根据实时显示的精度需求，调整该预设时长和预设采样周期的值。
所述视频帧获取模块1000是设置为，在预设时长内，按照预设采样周期，从视频缓存区读取当前满屏输出的主播视频的多个视频帧。
在上述实施例的基础上，所述目标区域获取模块2000可以包括以下模块。
窗口尺寸获取模块2100，设置为获取辅助图像输出时的小窗尺寸。
迭代分割模块2200，设置为对所述多个视频帧满屏输出时的区域进行迭代分割，直至得到的分割区域的面积大于或等于所述窗口尺寸，且小于2倍的所述窗口尺寸为止，将所述分割区域作为目标区域。
其中，所述迭代分割模块2200包括均等分割模块2210、像素点个数统计模块2220、目标区域确定模块2230以及分割区域确定模块2240。
均等分割模块2210，设置为将所述视频帧满屏输出时的区域空间均等分割 得到两个面积相等的区域。
像素点个数统计模块2220，设置为统计所述面积相等的区域中所述视频帧的内容不变的像素点的个数。
目标区域确定模块2230，设置为选择包括所述内容不变的像素点的个数较多的区域，当所选择的区域的面积大于或等于所述窗口尺寸，且小于2倍的所述窗口尺寸时，将所选择的区域作为目标区域。
分割区域确定模块2240，设置为将包括所述内容不变的像素点的个数较多的区域作为下一次迭代分割的分割区域。
其中，第一次分割的对象为所述多个视频帧满屏输出时的区域。
所述像素点个数统计模块2220可以包括ARGB值获取模块2221、平均值计算模块2222、像素点确定模块2223以及个数统计模块2224。
ARGB值获取模块2221，设置为分别选取分割得到的每个区域中的多个预设像素点，计算每个预设像素点在显示多个视频帧时对应的多个透明度红色绿色蓝色ARGB值。
平均值计算模块2222，设置为计算每个预设像素点对应的多个ARGB值的平均值。
像素点确定模块2223，设置为若所述预设像素点的多个ARGB值与所述平均值之间的差值在预设差值范围内，则将所述预设像素点作为所述多个视频帧的内容不变的像素点。以及，
个数统计模块2224，设置为统计所述内容不变的像素点的个数。
综上，本实施例图像的叠加显示系统，获取当前正在播放的主播视频的多个视频帧和辅助图像输出时的小窗尺寸，通过迭代算法对该多个视频帧满屏输出时的区域空间进行均等分割得到两个面积相等的区域，获取这两个面积相等 的区域中内容不变的像素点的个数，将包含该内容不变的像素点的个数较多的区域作为下一次迭代分割的分割区域，直至该分割区域的面积大于或等于所述小窗尺寸，且小于2倍的所述小窗尺寸为止，将该分割区域作为目标区域，在该目标区域叠加显示所述辅助图像；根据主播视频的视频帧和辅助图像输出时的小窗尺寸，找到满屏输出的主播视频的内容动态变化最小的区域，在该区域叠加显示辅助图像，可以在不影响主播视频视觉效果的同时呈现辅助图像，提升了用户的体验感，且计算方法简单，计算程序少。
本实施例还提供一种计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令用于执行上述图像的叠加显示方法。
实施例五
图5是本实施例五提供的一种电子设备的硬件结构示意图，如图5所示，该电子设备包括：一个或多个处理器410和存储器420。图5中以一个处理器410为例。
所述电子设备还可以包括：输入装置430和显示屏440。
所述电子设备中的处理器410、存储器420、输入装置430和显示屏440可以通过总线或者其他方式连接，图5中以通过总线连接为例。
输入装置430可以接收输入的数字或字符信息，显示屏440可以包括显示屏等显示设备。
存储器420作为一种计算机可读存储介质，可用于存储软件程序、计算机可执行程序以及模块。处理器410通过运行存储在存储器420中的软件程序、指令以及模块，从而执行多种功能应用以及数据处理，以实现上述实施例中的任意一种方法。
存储器420可以包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需要的应用程序；存储数据区可存储根据电子设备的使用所创建的数据等。此外，存储器可以包括随机存取存储器(Random Access  Memory，RAM)等易失性存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件或者其他非暂态固态存储器件。
存储器420可以是非暂态计算机存储介质或暂态计算机存储介质。该非暂态计算机存储介质，例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实施例中，存储器420可选包括相对于处理器410远程设置的存储器，这些远程存储器可以通过网络连接至电子设备。上述网络的实例可以包括互联网、企业内部网、局域网、移动通信网及其组合。
输入装置430可用于接收输入的数字或字符信息，以及产生与电子设备的用户设置以及功能控制有关的键信号输入。显示屏440可以显示视频内容。
本领域普通技术人员可理解实现上述实施例方法中的全部或部分流程，是可以通过计算机程序来执行相关的硬件来完成的，该程序可存储于一个非暂态计算机可读存储介质中，该程序在执行时，可包括如上述方法的实施例的流程，其中，该非暂态计算机可读存储介质可以为磁碟、光盘、只读存储记忆体(ROM)或随机存储记忆体(RAM)等。
工业实用性
本公开在满屏输出的主播视频内容动态变化最小的区域叠加显示辅助图像，可以在不影响主播视频视觉效果的同时呈现辅助图像，提升了用户的体验感，且计算方法简单，计算程序少。

Claims (12)

  1. 一种图像的叠加显示方法，包括：
    获取满屏输出的主播视频的多个视频帧；
    根据辅助图像输出时的窗口尺寸，从所述多个视频帧满屏输出的区域中，获取显示所述多个视频帧时内容不变的像素点的个数最多的区域作为目标区域；以及，
    在所述目标区域内叠加显示所述辅助图像。
  2. 根据权利要求1所述的方法，其中，所述目标区域的尺寸大于或等于所述窗口尺寸，且小于2倍的所述窗口尺寸。
  3. 根据权利要求2所述的方法，其中，所述根据辅助图像输出时的窗口尺寸，从所述多个视频帧满屏输出的区域中，获取显示所述多个视频帧时内容不变的像素点的个数最多的区域作为目标区域，包括：
    获取辅助图像输出时的窗口尺寸；
    对所述多个视频帧满屏输出时的区域进行迭代分割，直至得到的分割区域的面积大于或等于所述窗口尺寸，且小于2倍的所述窗口尺寸为止，将所述分割区域作为目标区域；
    其中，所述迭代分割包括：
    将分割对象均等分割得到面积相等的两个区域；
    统计分割得到的每个区域中显示所述多个视频帧时内容不变的像素点的个数；
    选择包括所述内容不变的像素点的个数较多的区域；
    当所选择的区域的面积大于或等于所述窗口尺寸，且小于2倍的所述窗口尺寸时，将所选择的区域作为目标区域；
    当所选择的区域的面积大于2倍的所述窗口尺寸时，将所选择的区域作为 下一次迭代分割的分割对象；
    其中，第一次分割的分割对象为所述多个视频帧满屏输出时的区域。
  4. 根据权利要求3所述的方法，其中，所述统计分割得到的每个区域中显示所述多个视频帧时内容不变的像素点的个数，包括：
    分别选取分割得到的每个区域中的多个预设像素点，计算每个预设像素点在显示多个视频帧时对应的多个透明度红色绿色蓝色ARGB值，求取每个预设像素点对应的多个ARBG值的平均值；
    若所述预设像素点的多个ARGB值与所述平均值之间的差值在预设差值范围内，则将所述预设像素点作为所述多个视频帧的内容不变的像素点；
    统计所述内容不变的像素点的个数。
  5. 根据权利要求1所述的方法，其中，所述获取满屏输出的主播视频的多个视频帧，包括：
    在预设时长内，按照预设采样周期，从视频缓存区读取当前满屏输出的主播视频的多个视频帧。
  6. 一种图像的叠加显示系统，包括：
    视频帧获取模块，设置为获取满屏输出的主播视频的多个视频帧；
    目标区域获取模块，设置为根据辅助图像输出时的窗口尺寸，从所述多个视频帧满屏输出的区域中，获取显示所述多个视频帧时，内容不变的像素点的个数最多的区域作为目标区域；以及
    叠加显示模块，设置为在所述目标区域内叠加显示所述辅助图像。
  7. 根据权利要求6所述的系统，其中，所述目标区域获取模块包括：
    窗口尺寸获取模块，设置为获取辅助图像输出时的窗口尺寸；
    迭代分割模块，设置为对所述多个视频帧满屏输出时的区域进行迭代分割， 直至得到的分割区域的面积大于或等于所述窗口尺寸，且小于2倍的所述窗口尺寸为止，将所述分割区域作为目标区域；其中，
    所述迭代分割模块包括：
    均等分割模块，设置为将分割对象均等分割得到面积相等的两个区域；
    像素点个数统计模块，设置为统计分割得到的每个区域中显示所述多个视频帧时内容不变的像素点的个数；
    目标区域确定模块，设置为选择包括所述内容不变的像素点的个数较多的区域，当所选择的区域的面积大于或等于所述窗口尺寸，且小于2倍的所述窗口尺寸时，将所选择的区域作为目标区域；
    分割区域确定模块，设置为选择包括所述内容不变的像素点的个数较多的区域，当所选择的区域的面积大于2倍的所述窗口尺寸时，将所选择的区域作为下一次迭代分割的分割区域；
    其中，第一次分割的对象为所述多个视频帧满屏输出时的区域。
  8. 根据权利要求7所述的系统，其中，所述像素点个数统计模块包括：
    ARGB值获取模块，设置为分别选取分割得到的每个区域中的多个预设像素点，计算每个预设像素点在显示多个视频帧时对应的多个透明度红色绿色蓝色ARGB值；
    平均值计算模块，设置为计算每个预设像素点对应的多个ARGB值的平均值；
    像素点确定模块，设置为若所述预设像素点的多个ARGB值与所述平均值之间的差值在预设差值范围内，则将所述预设像素点作为所述多个视频帧的内容不变的像素点；以及，
    个数统计模块，设置为统计所述内容不变的像素点的个数。
  9. 根据权利要求6所述的系统，其中，所述视频帧获取模块是设置为，在 预设时长内，按照预设采样周期，从视频缓存区读取当前满屏输出的主播视频的多个视频帧。
  10. 根据权利要求9所述的系统，还包括：
    预设时长设置模块，设置为设置所述预设时长；以及，
    采样周期设置模块，设置为设置所述预设采样周期。
  11. 一种计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令用于执行权利要求1-5任一项的方法。
  12. 一种电子设备，包括至少一个处理器，与所述至少一个处理器通信连接的存储器，以及与所述至少一个处理器通信连接的显示屏；
    其中，所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行时，执行如权利要求1-5任一项所述的方法。
PCT/CN2017/087143 2016-06-08 2017-06-05 图像的叠加显示方法和系统 WO2017211250A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610402811.3A CN105916004B (zh) 2016-06-08 2016-06-08 一种图像的叠加显示方法和系统
CN201610402811.3 2016-06-08

Publications (1)

Publication Number Publication Date
WO2017211250A1 true WO2017211250A1 (zh) 2017-12-14

Family

ID=56750586

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/087143 WO2017211250A1 (zh) 2016-06-08 2017-06-05 图像的叠加显示方法和系统

Country Status (2)

Country Link
CN (1) CN105916004B (zh)
WO (1) WO2017211250A1 (zh)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111601140A (zh) * 2020-04-28 2020-08-28 西安万像电子科技有限公司 远程播放视频的方法及装置
CN111953924A (zh) * 2020-08-21 2020-11-17 杨文龙 基于图像处理的视频窗口调整方法、装置、介质及系统
CN112788425A (zh) * 2020-12-28 2021-05-11 深圳Tcl新技术有限公司 动态区域显示方法、装置、设备及计算机可读存储介质
CN112911381A (zh) * 2021-01-18 2021-06-04 海信视像科技股份有限公司 一种显示设备、模式调整方法、设备及介质
CN113343031A (zh) * 2021-06-10 2021-09-03 浙江大华技术股份有限公司 数据添加方法及装置、存储介质、电子装置
CN114500871A (zh) * 2021-12-15 2022-05-13 山东信通电子股份有限公司 一种多路视频分析方法、设备及介质
WO2023071631A1 (zh) * 2021-10-25 2023-05-04 北京字节跳动网络技术有限公司 一种视频处理方法、装置及设备
CN116095400A (zh) * 2022-11-21 2023-05-09 南京芯传汇电子科技有限公司 视频数据处理方法、装置、设备及存储介质

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105916004B (zh) * 2016-06-08 2019-03-01 深圳创维数字技术有限公司 一种图像的叠加显示方法和系统
CN106412643B (zh) * 2016-09-09 2020-03-13 上海掌门科技有限公司 一种互动视频广告植入方法和系统
CN106954080B (zh) * 2017-03-17 2020-07-31 武汉斗鱼网络科技有限公司 视频直播方法、装置及用户终端
CN107135419A (zh) * 2017-06-14 2017-09-05 北京奇虎科技有限公司 一种编辑视频的方法和装置
WO2020107375A1 (zh) * 2018-11-30 2020-06-04 深圳市大疆创新科技有限公司 图像处理的方法、装置、设备及存储介质
CN111314626B (zh) * 2020-02-24 2021-12-07 北京字节跳动网络技术有限公司 用于处理视频的方法和装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1423896A (zh) * 2000-12-15 2003-06-11 皇家菲利浦电子有限公司 基于视频内容分析的画中画重新定位和/或大小调整
US20070229706A1 (en) * 2006-03-28 2007-10-04 Junichiro Watanabe Information reading apparatus
CN102135852A (zh) * 2010-01-25 2011-07-27 精工爱普生株式会社 图像显示装置以及图像显示方法
CN102763068A (zh) * 2010-02-12 2012-10-31 诺基亚公司 用于提供基于对象的媒体混合的方法和装置
CN105916004A (zh) * 2016-06-08 2016-08-31 深圳创维数字技术有限公司 一种图像的叠加显示方法和系统

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105430471B (zh) * 2015-11-26 2018-07-24 无锡天脉聚源传媒科技有限公司 一种视频中弹幕的显示方法及装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1423896A (zh) * 2000-12-15 2003-06-11 皇家菲利浦电子有限公司 基于视频内容分析的画中画重新定位和/或大小调整
US20070229706A1 (en) * 2006-03-28 2007-10-04 Junichiro Watanabe Information reading apparatus
CN102135852A (zh) * 2010-01-25 2011-07-27 精工爱普生株式会社 图像显示装置以及图像显示方法
CN102763068A (zh) * 2010-02-12 2012-10-31 诺基亚公司 用于提供基于对象的媒体混合的方法和装置
CN105916004A (zh) * 2016-06-08 2016-08-31 深圳创维数字技术有限公司 一种图像的叠加显示方法和系统

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111601140A (zh) * 2020-04-28 2020-08-28 西安万像电子科技有限公司 远程播放视频的方法及装置
CN111953924A (zh) * 2020-08-21 2020-11-17 杨文龙 基于图像处理的视频窗口调整方法、装置、介质及系统
CN111953924B (zh) * 2020-08-21 2022-03-25 杨文龙 基于图像处理的视频窗口调整方法、装置、介质及系统
CN112788425A (zh) * 2020-12-28 2021-05-11 深圳Tcl新技术有限公司 动态区域显示方法、装置、设备及计算机可读存储介质
CN112911381A (zh) * 2021-01-18 2021-06-04 海信视像科技股份有限公司 一种显示设备、模式调整方法、设备及介质
CN113343031A (zh) * 2021-06-10 2021-09-03 浙江大华技术股份有限公司 数据添加方法及装置、存储介质、电子装置
WO2023071631A1 (zh) * 2021-10-25 2023-05-04 北京字节跳动网络技术有限公司 一种视频处理方法、装置及设备
CN114500871A (zh) * 2021-12-15 2022-05-13 山东信通电子股份有限公司 一种多路视频分析方法、设备及介质
CN114500871B (zh) * 2021-12-15 2023-11-14 山东信通电子股份有限公司 一种多路视频分析方法、设备及介质
CN116095400A (zh) * 2022-11-21 2023-05-09 南京芯传汇电子科技有限公司 视频数据处理方法、装置、设备及存储介质

Also Published As

Publication number Publication date
CN105916004B (zh) 2019-03-01
CN105916004A (zh) 2016-08-31

Similar Documents

Publication Publication Date Title
WO2017211250A1 (zh) 图像的叠加显示方法和系统
US10893320B2 (en) Dynamic video overlays
US11830161B2 (en) Dynamically cropping digital content for display in any aspect ratio
US8446422B2 (en) Image display apparatus, image display method, program, and record medium
US8953048B2 (en) Information processing apparatus and control method thereof
WO2016095384A1 (zh) 一种弹幕显示方法及系统
WO2019153723A1 (zh) 视频画面显示方法、装置、电视机及存储介质
US8116593B2 (en) Image processing apparatus, image processing method, and program for determining a zoom area for a displayed zoom image
CN107371062B (zh) 视频画面自动缩放的方法
CN107948733B (zh) 视频图像处理方法及装置、电子设备
JP2013125270A (ja) 電子ディスプレイ設定を自動的に調整するためのシステム及び方法
WO2022033485A1 (zh) 视频处理方法及电子设备
US20180013931A1 (en) Method for detecting terminal static layer information, terminal and television
WO2022048424A1 (zh) 屏幕画面自适应调整方法、装置、设备和存储介质
WO2014030405A1 (ja) 表示装置、表示方法、テレビジョン受信機及び表示制御装置
CN112954443A (zh) 全景视频的播放方法、装置、计算机设备和存储介质
WO2021173224A1 (en) Systems and methods for adaptively modifying presentation of media content
US10951816B2 (en) Method and apparatus for processing image, electronic device and storage medium
US20150172705A1 (en) Window detection device and method on multi-media system
US9875521B2 (en) Image output apparatus, image output method, and program
TW200818911A (en) Video window detector
US10861420B2 (en) Image output apparatus, image output method, for simultaneous output of multiple images
WO2017113593A1 (zh) 基于智能电视的动画菜单的处理方法及装置
JP2009281830A (ja) 複数ディスプレイ設置設定装置、方法、プログラム、及びシステム
TWI593286B (zh) 電視系統與多媒體播放方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17809689

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17809689

Country of ref document: EP

Kind code of ref document: A1