CN115379153A - Video display method, device, equipment and medium - Google Patents

Video display method, device, equipment and medium Download PDF

Info

Publication number
CN115379153A
CN115379153A CN202210987070.5A CN202210987070A CN115379153A CN 115379153 A CN115379153 A CN 115379153A CN 202210987070 A CN202210987070 A CN 202210987070A CN 115379153 A CN115379153 A CN 115379153A
Authority
CN
China
Prior art keywords
sub
picture
pictures
sprite
shape
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210987070.5A
Other languages
Chinese (zh)
Inventor
秦永红
付贤会
张强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Rongxun Technology Co ltd
Original Assignee
Beijing Rongxun Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Rongxun Technology Co ltd filed Critical Beijing Rongxun Technology Co ltd
Priority to CN202210987070.5A priority Critical patent/CN115379153A/en
Publication of CN115379153A publication Critical patent/CN115379153A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2624—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of whole input images, e.g. splitscreen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H04N7/152—Multipoint control units therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The embodiment of the application discloses a video display method, a video display device, video display equipment and a video display medium. The method comprises the following steps: determining each sprite shape and sprite distribution in the composite picture in response to a sprite setting operation; zooming the video frames corresponding to the sub-pictures according to the shapes of the sub-pictures to obtain corresponding target video frames; and synthesizing the target video frames corresponding to the sub-pictures according to the distribution of the sub-pictures to obtain synthesized video frames, and displaying the synthesized video frames in the synthesized pictures. By adopting the technical scheme, the flexible configuration of the shape and the distribution of the sub-pictures in the composite picture can be realized, the flexibility of multi-picture video display and the diversity of display pictures are improved, and the personalized video picture display requirement can be met.

Description

Video display method, device, equipment and medium
Technical Field
The embodiment of the application relates to the technical field of computers, in particular to a video display method, device, equipment and medium.
Background
In a video conference, there is usually a demand for displaying multiple video pictures so that any participant can see video scenes from video terminals of other participants at the same time, and the video scenes are realized by combining video pictures corresponding to different video participants into multiple pictures.
However, in the current multi-picture synthesis technology, only a fixed multi-picture distribution mode is provided to perform the synthesis and display of different pictures, and the flexibility is poor.
Disclosure of Invention
The application provides a video display method, a video display device, video display equipment and a video display medium, which are used for improving the flexibility and diversity of video multi-picture display.
In a first aspect, an embodiment of the present invention provides a video display method, including:
determining each sprite shape and sprite distribution in the composite picture in response to a sprite setting operation;
zooming the video frames corresponding to the sub-pictures according to the shapes of the sub-pictures to obtain corresponding target video frames;
and synthesizing the target video frames corresponding to the sub-pictures according to the distribution of the sub-pictures to obtain synthesized video frames, and displaying the synthesized video frames in the synthesized pictures.
In a second aspect, an embodiment of the present application further provides a video display apparatus, where the apparatus includes:
a shape distribution determination module: for determining each sprite shape and sprite distribution in the composite picture in response to a sprite setting operation;
a video frame acquisition module: the video frame scaling module is used for scaling the video frame corresponding to each sub-picture according to the shape of the sub-picture to obtain a corresponding target video frame;
a video frame synthesis module: and the video frame display module is used for synthesizing the target video frames corresponding to the sub-pictures according to the distribution of the sub-pictures to obtain synthesized video frames, and displaying the synthesized video frames in the synthesized pictures.
In a third aspect, an embodiment of the present application further provides an electronic device, including:
one or more processors;
storage means for storing one or more programs;
the one or more programs are executed by the one or more processors, so that the one or more processors implement the video presentation method provided by the embodiment of the first aspect.
In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a video presentation method as provided in the embodiment of the first aspect.
The method and the device for setting the sub-pictures determine the shapes and the distribution of the sub-pictures in the composite picture by responding to the setting operation of the sub-pictures; zooming the video frames corresponding to the sub-pictures according to the shapes of the sub-pictures to obtain corresponding target video frames; and synthesizing the target video frames corresponding to the sub-pictures according to the distribution of the sub-pictures to obtain synthesized video frames, and displaying the synthesized video frames in the synthesized pictures. By adopting the technical scheme, the flexible configuration of the shape and the distribution of the sub-pictures in the composite picture can be realized, the flexibility of multi-picture video display and the diversity of display pictures are improved, and the personalized video picture display requirement can be met.
Drawings
Fig. 1 is a flowchart of a video presentation method according to a first embodiment of the present application;
fig. 2 is a flowchart of a video display method according to a second embodiment of the present application;
fig. 3 is a flowchart of a video presentation method in the third embodiment of the present application;
FIG. 4 is a block diagram of a video display apparatus according to a fourth embodiment of the present application;
fig. 5 is a block diagram of an electronic device in a fifth embodiment of the present application.
Detailed Description
The present application will be described in further detail with reference to the following drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be further noted that, for the convenience of description, only some of the structures related to the present application are shown in the drawings, not all of the structures.
Example one
Fig. 1 is a flowchart of a video display method according to an embodiment of the present application, where the embodiment of the present application is applicable to a case where different videos are compositely displayed through multiple sub-pictures, and the method may be executed by a video display apparatus, which is implemented by software and/or hardware and is specifically configured in an electronic device.
The video presentation method shown in fig. 1 includes:
s101, responding to the sub-picture setting operation, determining the shape and distribution of each sub-picture in the composite picture.
Wherein the sprite setting operation may be used to set a sprite shape and/or a sprite distribution.
The composite picture can be formed by combining different sub-pictures, and the shapes of the different sub-pictures can be the same or different; the sub-pictures can be arranged according to a preset distribution mode or a user-defined distribution mode.
Wherein, the sprite shape can be a regular geometric shape, such as a rectangle, a circle, an ellipse, etc.; irregular shapes are also possible, such as user-defined drawing shapes.
The sprite distribution may be a regular distribution or an irregular distribution. Regular distribution is understood to mean the arrangement of the sub-pictures in the composite picture in a matrix distribution of the same rows and columns, for example an "m × n composite picture" formed by m × n sub-pictures. Wherein m and n are natural numbers greater than 0, and they may be the same or different. Irregular distribution is understood to mean an arrangement which is not a matrix distribution.
In an alternative embodiment, the sprite distribution may be determined by setting an operation in response to the sprite layout; and determining the shape of each sprite in the composite picture according to the sprite distribution.
Illustratively, the number of subpicture rows and the number of subpicture columns are determined in the subpicture setting operation. Dividing the width of the synthesized picture by the number of the sub-picture columns to obtain the width of one sub-picture; dividing the height of the synthesized picture by the line number of the sub-picture to obtain the height of one sub-picture; the rectangular shape of a sprite is determined by the width and height of a sprite.
By adopting the scheme to determine the shape and distribution of the sub-pictures, the operation is convenient and quick, the early preparation time of video display is reduced, and the improvement of the video display efficiency is facilitated. Meanwhile, the scheme can set multiple pictures in a multi-distribution manner according to the requirements of users, so that the diversity of the synthesized pictures is improved.
In another optional embodiment, each sprite in the composite picture may also be acquired by responding to a sprite drawing operation; determining the shape of the sub-picture of the corresponding sub-picture according to the drawing shape of each sub-picture; and determining the distribution of the sub-pictures according to the position information of the drawing area of each sub-picture.
Illustratively, track data generated when a user manually draws each sub-picture in a drawing area corresponding to the composite picture can be captured; determining a sprite shape of the corresponding sprite based on the captured trajectory data; and determining the relative position relation of each sub-picture in the synthesized picture according to the position of each sub-picture drawing area in the synthesized picture to obtain the distribution of the sub-pictures.
By adopting the scheme to determine the shape and the distribution of the sub-picture, the personalized setting of the shape and the distribution of the sub-picture can be realized, the diversity and the flexibility of the synthesized picture are improved, and the personalized requirements of different users can be met.
S102, zooming the video frame corresponding to each sub-picture according to the shape of the sub-picture to obtain a corresponding target video frame.
The video frame corresponding to the sub-picture may be an image of the sub-picture corresponding to a time stamp in the original video. The time stamp may be used to characterize the generation time of the corresponding video frame, thereby distinguishing different video frames in the original video.
The target video frame can be a video frame which meets the requirement of the display size of a corresponding sub-picture and is obtained after the scaling processing is carried out on the original video frame corresponding to the sub-picture.
Optionally, the height and/or width of the video frame in the original video may be scaled according to the shape of the sub-picture to obtain the target video frame.
S103, synthesizing the target video frames corresponding to the sub-pictures according to the distribution of the sub-pictures to obtain synthesized video frames, and displaying the synthesized video frames in the synthesized pictures.
The synthesized video frame can be a synthesized result of the target video frame corresponding to each sub-picture in the same timestamp, so that the video frames corresponding to different sub-pictures are synchronously displayed in each sub-picture of the synthesized picture.
The synthesized video frame may be obtained by splicing the target video frames corresponding to the sub-pictures, or obtained by superimposing the target video frames corresponding to the sub-pictures, or obtained by other methods.
Because some sub-pictures corresponding to the original video may be obtained from different angles of the same scene, and a repeat region exists in the composite picture, the content of the overlap region is repeatedly displayed in different sub-pictures, which causes waste of display resources and affects the viewing experience of the user. Therefore, a better video display effect can be obtained by removing the repeated area, and display resources are saved.
Optionally, the synthesized picture is updated according to the distribution of the sub-pictures and the coincidence condition of the image areas in the target video frames corresponding to different sub-pictures.
If the adjacent sub-pictures correspond to the target video frames with the same timestamp and have pixel points with the same pixel value, and the pixel points with the same pixel value are continuously distributed, combining the pixel points with the same pixel value to obtain a superposition area between the adjacent sub-pictures; and if the adjacent sub-pictures do not have pixel points with the same pixel value corresponding to the target video frames with the same timestamp, or the pixel points with the same pixel value are distributed discretely, determining that no overlapping area exists between the adjacent sub-pictures.
Optionally, the positions of the adjacent overlapping sub-pictures are adjusted according to the width or height of the overlapping area, and the synthesized picture is updated.
In an alternative embodiment, if there is a coincidence between the left area of one sub-frame and the right area of the other sub-frame, the two sub-frames are adjusted to be horizontally adjacent.
In another alternative embodiment, if the upper area of one sub-frame coincides with the lower area of another sub-frame, the two sub-frames are adjusted to be vertically adjacent.
Optionally, overlapping regions of the sprites, where the image regions overlap, corresponding to the target video frame may be overlaid to generate a composite video frame.
Wherein the superimposing can be over the width of the corresponding video frame and/or over the height to eliminate overlapping areas in different sprites. It should be noted that the superposition method can be implemented by at least one manner in the prior art, and the present application is not limited thereto.
Optionally, the composite video frame is displayed in the updated composite picture, that is, the composite video frame is displayed in the composite picture according to the corresponding time stamp sequence.
According to the technical scheme of the embodiment, the shape and the distribution of each sub-picture in the composite picture are determined by responding to the setting operation of the sub-pictures; zooming the video frames corresponding to the sub-pictures according to the shapes of the sub-pictures to obtain corresponding target video frames; and synthesizing the target video frames corresponding to the sub-pictures according to the distribution of the sub-pictures to obtain synthesized video frames, and displaying the synthesized video frames in the synthesized pictures. By adopting the technical scheme, the flexible configuration of the shape and the distribution of the sub-pictures in the composite picture can be realized, the flexibility of multi-picture video display and the diversity of display pictures are improved, and the personalized video picture display requirement can be met.
Example two
Fig. 2 is a flowchart of a video display method according to a second embodiment of the present application, and in this embodiment, based on the foregoing embodiments, optimization and improvement are performed on an obtaining operation of a sub-picture target video frame.
Further, the operation of zooming the video frames corresponding to the sub-pictures according to the shapes of the sub-pictures to obtain corresponding target video frames is refined into a zoom rectangle for determining the corresponding sub-pictures according to the shapes of the sub-pictures; and zooming the video frame of the corresponding sub-picture according to the zooming rectangle to obtain a target video frame' so as to perfect the determination mechanism of the target video frame.
The video display method shown in fig. 2 includes:
s201, responding to the setting operation of the sub-pictures, and determining the shapes and the distribution of the sub-pictures in the composite picture.
S202, determining a scaling rectangle of the corresponding sub-picture according to the shape of the sub-picture.
Wherein the scaling rectangle may be a rectangle completely containing the shape of the corresponding sprite.
In an alternative embodiment, if the sprite shape is rectangular, the sprite shape is taken as the scaled rectangle of the corresponding sprite.
In another alternative embodiment, if the sprite is non-rectangular, the circumscribed rectangle of the sprite shape may be used as the scaled rectangle of the corresponding sprite. The width of the circumscribed rectangle is the horizontal maximum distance of the sub-picture shape, and the height of the circumscribed rectangle is the vertical maximum distance of the sub-picture shape. The horizontal maximum distance may be a horizontal distance between a leftmost pixel point and a rightmost pixel point in the sub-picture. The vertical maximum distance may be a vertical distance between the uppermost pixel point and the lowermost pixel point in the sprite.
And S203, zooming the video frame of the corresponding sub-picture according to the zooming rectangle to obtain a target video frame.
In an alternative embodiment, if the sub-picture is rectangular, the ratio of the height value of the sub-picture to the height value of the corresponding target video frame is used as a first scaling ratio; taking the ratio of the width value of the sub-picture to the width value of the corresponding target video frame as a second scaling ratio; and zooming the video frame in the original video according to the first zoom ratio and/or the second zoom ratio to obtain a target video frame.
Optionally, the height of the video frame in the original video is scaled according to the first scaling ratio, the width of the video frame in the original video is scaled according to the second scaling ratio, and the scaled video frame is used as the target video frame. By adopting the scheme, the picture areas of different sub-pictures can be filled in the synthetic picture, and the viewing effect of the synthetic picture comprising the outer frame can be improved.
Or optionally, scaling the video frame in the original video according to the first scaling ratio and/or the second scaling ratio to obtain the target video frame, where the scaling may be: taking the larger value of the first scaling ratio and the second scaling ratio as the final scaling ratio; and zooming the width and the height of the video frame corresponding to the sub-picture according to the final zoom ratio to obtain the target video frame. By adopting the scheme, the situation that the video frame has scaling distortion due to mismatching of the first scaling ratio and the second scaling ratio can be avoided, the image proportion of the video frame in the original video can be kept, and the picture quality of the target video frame is improved.
By adopting the scheme, the scaling of the video corresponding to the sub-picture in the regular shape can be realized, so that the scaled video frame picture can be filled in the sub-picture in the regular shape, or the corresponding sub-picture can be filled according to the proportion of the original image, and the video display effect in the regular sub-picture is improved.
In another optional embodiment, if the sub-frame is non-rectangular, the ratio of the height value of the scaling rectangle corresponding to the sub-frame to the height value of the corresponding target video frame is used as a third scaling ratio; calculating the ratio of the width value of the scaling rectangle corresponding to the sub-picture to the width value of the corresponding target video frame as a fourth scaling ratio; and zooming the video frame in the original video according to the third zoom ratio and/or the fourth zoom ratio to obtain a target video frame.
Optionally, the height of the video frame in the original video is scaled according to a third scaling ratio, the width of the video frame in the original video is scaled according to a fourth scaling ratio, and the scaled video frame is used as the target video frame. By adopting the scheme, the picture areas of different sub-pictures can be filled to the maximum degree in the composite picture formed by the irregular sub-pictures, and the viewing effect of the composite picture comprising the outer frame can be improved.
Or optionally, scaling the video frame in the original video according to the third scaling ratio and/or the fourth scaling ratio to obtain the target video frame, where the scaling may be: taking the larger value of the third scaling ratio and the fourth scaling ratio as the final scaling ratio; and zooming the width and the height of the video frame corresponding to the sub-picture according to the final zoom ratio to obtain the target video frame. By adopting the scheme, the situation that the video frame has scaling distortion due to mismatching of the third scaling ratio and the fourth scaling ratio can be avoided, the image proportion of the video frame in the original video can be kept, and the picture quality of the target video frame is improved.
By adopting the scheme, the zooming of the video corresponding to the sub-picture with the irregular shape can be realized, so that the zoomed video frame picture can be filled in the sub-picture with the irregular shape to the maximum extent, or the corresponding sub-picture can be filled according to the proportion of the original image, and the video display effect in the sub-picture with the irregular shape is improved.
And S204, synthesizing the target video frames corresponding to the sub-pictures according to the distribution of the sub-pictures to obtain synthesized video frames, and displaying the synthesized video frames in the synthesized pictures.
According to the method and the device, the determination process of the target video frame is refined into the zoom rectangle of the corresponding sub-picture according to the shape of the sub-picture, and the video frame of the corresponding sub-picture is zoomed according to the zoom rectangle to obtain the target video frame. According to the scheme, the zooming rectangle determined based on the shape of the sub-picture is introduced to zoom the video frame of the corresponding sub-picture, so that the zoomed target video frame can be matched with the shape of the sub-picture of the corresponding sub-picture, the fit degree of the target video frame and the corresponding sub-picture is improved, the video display effect is improved, and the watching experience of a user on the video in the composite picture is enhanced.
EXAMPLE III
The embodiment of the application also provides a preferred embodiment on the basis of the technical solutions of the above embodiments. Referring to a video presentation method as shown in fig. 3, performed by a video presentation apparatus, comprising:
s301, displaying a sub-picture setting window, and receiving a setting operation of a user on the sub-picture setting window;
S302A, responding to the setting operation of the regular sub-picture, acquiring the number of rows and columns of the sub-picture input by a user, and determining the sub-picture distribution of each sub-picture in the synthesized picture according to the number of rows and columns of the sub-picture.
Wherein, the sprite distribution is obtained by defining a start row, an end row, a start column and an end column.
And S303A, determining the rectangular width and the rectangular height of each sub-picture in the synthesized picture according to the row number and the column number of the sub-pictures.
S304A, according to the width and the height of the rectangle, zooming processing is carried out on the video frame of the original video corresponding to each sub-picture, and a target video frame is obtained. Execution continues with S305.
S302B, responding to the setting operation of the irregular sprites, and acquiring the drawing tracks of the sprites drawn by the user.
S303B, determining the sub-picture distribution of each sub-picture in the synthesized picture according to the relative position information of the drawing track of each sub-picture, and determining the shape of the sub-picture of the corresponding sub-picture according to the drawing shape of the sub-picture.
S304B, determining a circumscribed rectangle of the corresponding sub-picture according to the shape of the sub-picture, and carrying out zooming processing on the video frame of the original video of the corresponding sub-picture according to the width and the height of the circumscribed rectangle to obtain a target video frame. Execution continues with S305.
S305, synthesizing the target video frames corresponding to different sub-pictures under the same timestamp according to the distribution of the sub-pictures to obtain a synthesized video frame.
And S306, displaying the synthesized video frames in the synthesized picture according to the time stamp sequence so as to realize the synthesized display of the original video corresponding to different sub-pictures.
By the technical scheme, the flexible configuration of the shapes and the distribution of the sub-pictures in the synthesized picture is realized, the flexibility and the diversity of the synthesized picture are improved, the personalized display requirements of users can be met, and the flexibility of video display is improved.
Example four
Fig. 4 is a schematic structural diagram of a video display apparatus according to a fourth embodiment of the present application, where the fourth embodiment of the present application is applicable to a case where different videos are synthesized by multiple sub-pictures, and the apparatus is implemented by software and/or hardware and is specifically configured in an electronic device. The video display apparatus as shown in fig. 4 comprises: a shape distribution determination module 401, a video frame acquisition module 402, and a video frame composition module 403.
Wherein, the shape distribution determining module 401 is configured to determine the shape and the distribution of the sprites in the composite picture in response to the sprite setting operation.
The video frame obtaining module 402 is configured to scale the video frame corresponding to each sub-picture according to the shape of the sub-picture to obtain a corresponding target video frame.
The video frame synthesizing module 403 is configured to synthesize target video frames corresponding to the sub-pictures according to the sub-picture distribution to obtain synthesized video frames, and display the synthesized video frames in the synthesized pictures.
According to the method and the device, the shape distribution determining module responds to the setting operation of the sub-pictures, and determines the shape and the distribution of the sub-pictures in the synthesized picture; zooming the video frames corresponding to the sub-pictures through a video frame acquisition module according to the shapes of the sub-pictures to obtain corresponding target video frames; and synthesizing the target video frames corresponding to the sub-pictures according to the distribution of the sub-pictures by a video frame synthesis module to obtain synthesized video frames, and displaying the synthesized video frames in the synthesized pictures. The video display device obtained by adopting the technical scheme can realize flexible configuration of the shape and distribution of the sub-pictures in the composite picture, improve the flexibility of multi-picture video display and the diversity of display pictures, and can meet the requirement of personalized video picture display.
Further, the video frame acquiring module 402 includes:
a scaling rectangle determining unit, configured to determine a scaling rectangle of a corresponding sub-picture according to the shape of the sub-picture;
and the video frame obtaining unit is used for zooming the video frame of the corresponding sub-picture according to the zooming rectangle to obtain the target video frame.
Further, the video frame obtaining unit includes:
and the first scaling rectangle determining subunit is used for taking the shape of the sub-picture as the scaling rectangle of the corresponding sub-picture if the shape of the sub-picture is a rectangle.
Further, the video frame obtaining unit includes:
and the second scaling rectangle determining subunit is used for taking the shape of the sub-picture as the scaling rectangle of the corresponding sub-picture if the shape of the sub-picture is a rectangle.
Further, the shape distribution determining module 401 includes:
a picture distribution determining unit for determining a sprite distribution in response to a sprite layout setting operation;
and the first picture shape determining unit is used for determining the shape of each sub-picture in the composite picture according to the distribution of the sub-pictures.
Further, the shape distribution determining module 401 includes:
a picture acquisition unit configured to acquire each of the sprites in the composite picture in response to the sprite drawing operation.
And a second picture shape determining unit for determining the shape of the sub-picture of the corresponding sub-picture according to the drawing shape of each sub-picture.
And the second picture distribution determining unit is used for determining the distribution of the sub-pictures according to the position information of the drawing area of each sub-picture.
Further, the video frame composition module 403 includes:
and the picture updating unit is used for updating the synthesized picture according to the distribution of the sub-pictures and the superposition condition of the image areas in the target video frames corresponding to the different sub-pictures.
And the video frame synthesis unit is used for overlapping the overlapped area of the sub-picture corresponding to the target video frame with the overlapped image area to generate a synthesized video frame.
And the video frame display unit is used for displaying the composite video frame in the updated composite picture.
The video display device can execute the video display method provided by any embodiment of the application, and has the corresponding functional modules and beneficial effects of executing each video display method.
EXAMPLE five
Fig. 5 is a block diagram of an electronic device in a fifth embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 5, the apparatus 500 comprises a computing unit 501 which may perform various appropriate actions and processes in accordance with a computer program stored in a Read Only Memory (ROM) 502 or a computer program loaded from a storage unit 508 into a Random Access Memory (RAM) 503. In the RAM503, various programs and data required for the operation of the device 500 can also be stored. The calculation unit 501, the ROM502, and the RAM503 are connected to each other by a bus 504. An input/output (I/O) interface 505 is also connected to bus 504.
A number of components in the device 500 are connected to the I/O interface 505, including: an input unit 506 such as a keyboard, a mouse, or the like; an output unit 507 such as various types of displays, speakers, and the like; a storage unit 508, such as a magnetic disk, optical disk, or the like; and a communication unit 509 such as a network card, modem, wireless communication transceiver, etc. The communication unit 509 allows the device 500 to exchange information/data with other devices through a computer network such as the internet and/or various telecommunication networks.
The computing unit 501 may be a variety of general-purpose and/or special-purpose processing components having processing and computing capabilities. Some examples of the computing unit 501 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The computing unit 501 performs the methods and processes described above, such as the video presentation methods. For example, in some embodiments, the video presentation method may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as storage unit 508. In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 500 via the ROM502 and/or the communication unit 509. When the computer program is loaded into the RAM503 and executed by the computing unit 501, one or more steps of the video presentation method described above may be performed. Alternatively, in other embodiments, the computing unit 501 may be configured to perform the video presentation method by any other suitable means (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user may provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the Internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical host and VPS service are overcome. The server may also be a server of a distributed system, or a server incorporating a blockchain.
It should be understood that various forms of the flows shown above, reordering, adding or deleting steps, may be used. For example, the steps described in this disclosure may be performed in parallel or sequentially or in a different order, as long as the desired results of the technical solutions provided by this disclosure can be achieved, and are not limited herein.
The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made, depending on design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.

Claims (10)

1. A method for video presentation, comprising:
determining each sprite shape and sprite distribution in the composite picture in response to a sprite setting operation;
zooming the video frame corresponding to each sub-picture according to the shape of the sub-picture to obtain a corresponding target video frame;
and synthesizing the target video frames corresponding to the sub-pictures according to the distribution of the sub-pictures to obtain synthesized video frames, and displaying the synthesized video frames in the synthesized pictures.
2. The method according to claim 1, wherein the scaling the video frame corresponding to each sprite according to the sprite shape to obtain the corresponding target video frame comprises:
determining a scaling rectangle of the corresponding sub-picture according to the shape of the sub-picture;
and zooming the video frame of the corresponding sub-picture according to the zooming rectangle to obtain a target video frame.
3. The method of claim 2, wherein determining a scaling rectangle for a respective sprite based on the sprite shape comprises:
and if the sub-picture shape is a rectangle, taking the sub-picture shape as a scaling rectangle of the corresponding sub-picture.
4. The method of claim 2, wherein determining a scaling rectangle for a respective sprite based on the sprite shape comprises:
and if the shape of the sub-picture is non-rectangular, taking the circumscribed rectangle of the shape of the sub-picture as the scaling rectangle of the corresponding sub-picture.
5. The method of claim 1, wherein determining the shape and distribution of each sprite in the composite picture in response to a sprite placement operation comprises:
determining the sprite distribution in response to a sprite layout setting operation;
and determining the shape of each sub-picture in the synthesized picture according to the distribution of the sub-pictures.
6. The method of claim 1, wherein determining the shape and distribution of each sprite in the composite picture in response to a sprite setting operation comprises:
responding to the drawing operation of the sub-pictures, and acquiring each sub-picture in the synthesized picture;
determining the shape of the sub-picture of the corresponding sub-picture according to the drawing shape of each sub-picture;
and determining the distribution of the sub-pictures according to the position information of the drawing area of each sub-picture.
7. The method according to any one of claims 1 to 6, wherein the synthesizing, according to the sprite distribution, the target video frames corresponding to the sprites to obtain a synthesized video frame, and displaying the synthesized video frame in the synthesized frame, comprises:
updating the synthesized picture according to the distribution of the sub-pictures and the superposition condition of image areas in the target video frames corresponding to different sub-pictures;
overlapping the overlapping area of the target video frame corresponding to the sub-picture with the overlapped image area to generate the composite video frame;
the composite video frame is presented in the updated composite picture.
8. A video presentation apparatus, comprising:
a shape distribution determination module for determining the shape and distribution of each sprite in the composite picture in response to the sprite setting operation;
the video frame acquisition module is used for zooming the video frames corresponding to the sub-pictures according to the shapes of the sub-pictures to obtain corresponding target video frames;
and the video frame synthesis module is used for synthesizing the target video frames corresponding to the sub-pictures according to the sub-picture distribution to obtain synthesized video frames, and displaying the synthesized video frames in the synthesized pictures.
9. An electronic device, comprising:
one or more processors;
a memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement a video presentation method as claimed in any one of claims 1-7.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out a method for video presentation according to any one of claims 1 to 7.
CN202210987070.5A 2022-08-17 2022-08-17 Video display method, device, equipment and medium Pending CN115379153A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210987070.5A CN115379153A (en) 2022-08-17 2022-08-17 Video display method, device, equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210987070.5A CN115379153A (en) 2022-08-17 2022-08-17 Video display method, device, equipment and medium

Publications (1)

Publication Number Publication Date
CN115379153A true CN115379153A (en) 2022-11-22

Family

ID=84066126

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210987070.5A Pending CN115379153A (en) 2022-08-17 2022-08-17 Video display method, device, equipment and medium

Country Status (1)

Country Link
CN (1) CN115379153A (en)

Similar Documents

Publication Publication Date Title
US11900614B2 (en) Video data processing method and related apparatus
CN112954450B (en) Video processing method and device, electronic equipment and storage medium
US11481872B2 (en) Method and device for loading image
CN103795961A (en) Video conference telepresence system and image processing method thereof
CN114531553B (en) Method, device, electronic equipment and storage medium for generating special effect video
CN114928718A (en) Video monitoring method and device, electronic equipment and storage medium
CN113315927B (en) Video processing method and device, electronic equipment and storage medium
US20180018398A1 (en) Positioning content in computer-generated displays based on available display space
CN105915972A (en) Virtual reality 4K video optimization method and device
CN111083368A (en) Simulation physics cloud platform panoramic video display system based on high in clouds
CN111726666A (en) Video display control method and device
CN115379153A (en) Video display method, device, equipment and medium
US9445052B2 (en) Defining a layout for displaying images
CN113810755B (en) Panoramic video preview method and device, electronic equipment and storage medium
CN115002442B (en) Image display method and device, electronic equipment and storage medium
CN116248889A (en) Image encoding and decoding method and device and electronic equipment
CN115834930A (en) Video frame transmission method and device, electronic equipment and storage medium
CN112822418B (en) Video processing method and device, storage medium and electronic equipment
CN111427448B (en) Portrait marking method and device and computer readable storage medium
CN114302211B (en) Video playing method and device and electronic equipment
CN113873327A (en) Video stream presentation method, device, equipment and storage medium
CN116665004B (en) Augmented reality image processing method, system, equipment and storage medium
CN110290360B (en) Image stitching method and terminal equipment for panoramic video image
WO2023103672A1 (en) Method, apparatus and device for displaying shared content, and computer program product
CN113784189B (en) Round table video conference generation method and device, medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination