CN112272270B - Video data processing method - Google Patents

Video data processing method Download PDF

Info

Publication number
CN112272270B
CN112272270B CN202011038108.1A CN202011038108A CN112272270B CN 112272270 B CN112272270 B CN 112272270B CN 202011038108 A CN202011038108 A CN 202011038108A CN 112272270 B CN112272270 B CN 112272270B
Authority
CN
China
Prior art keywords
resolution
video
main
determining
player
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011038108.1A
Other languages
Chinese (zh)
Other versions
CN112272270A (en
Inventor
李剑
钟学伟
孙长海
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beihai Tianxia Weixing Technology Co ltd
Original Assignee
Beihai Tianxia Weixing Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beihai Tianxia Weixing Technology Co ltd filed Critical Beihai Tianxia Weixing Technology Co ltd
Priority to CN202011038108.1A priority Critical patent/CN112272270B/en
Publication of CN112272270A publication Critical patent/CN112272270A/en
Application granted granted Critical
Publication of CN112272270B publication Critical patent/CN112272270B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
    • H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/633—Control signals issued by server directed to the network components or client
    • H04N21/6332—Control signals issued by server directed to the network components or client directed to client
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources

Abstract

The invention provides a video data processing method, which comprises the following steps: determining the number of screens to be split and the split screen resolution of each split screen according to user input; determining corresponding video resolution according to each determined split-screen resolution; acquiring a corresponding video according to the determined video resolution; and displaying the acquired video. The invention also provides a video data processing system. The invention can save network bandwidth and improve user experience.

Description

Video data processing method
Technical Field
The present invention relates to a video data processing system, and more particularly, to a video data processing method and system for simultaneously displaying a plurality of videos.
Background
The split screen display belongs to one of video displays. Split screen displays generally include two scenes. In one case, say, a television station simultaneously connects a plurality (e.g., 9) viewers, so that all 9 viewers are imaged on a large screen on site at the station. In the second case, live webcasting may also occur, where multiple live scenes are presented on a single display device at the same time.
For both scenes, since the resolution of the final image is not necessarily the original resolution, since the size of the image is only the original size, e.g., 1/9, even if the original resolution is not used, the resolution and viewing effect are not affected when the image is compressed to 1/9 even if the resolution is lower. Therefore, there is a need to compress real-time video signals of multiple viewers or live scenes to reduce the bandwidth requirements of network transmissions.
Disclosure of Invention
Embodiments of the present invention provide a video data processing method and system, which can reduce the bandwidth requirement of network transmission.
The technical scheme adopted by the invention is as follows:
the embodiment of the invention provides a video data processing method, which comprises the following steps:
according to the input of a user, determining the number N of the screens to be split and the split screen resolution W of each split screeni0×Hi0，i＝1，2，...N；
According to the determined resolution W of each split screeni0×Hi0Determining the corresponding video resolution;
acquiring a corresponding video according to the determined video resolution;
and displaying the acquired video.
Another embodiment of the present invention provides a video data processing system, including: the system comprises a video presenting device, a video processing device and K video terminals which are in communication connection, wherein K is more than or equal to 2;
the video processing device is used for determining the number N of the screens to be split and the split screen resolution W of each split screen according to user inputi0×Hi0And sending the video data to a corresponding video terminal, wherein i is 1, 2.
The video terminal is used for: according to the determined resolution W of each split screeni0×Hi0Determining the corresponding video resolution; and according to the determined video resolution Wij×HijAcquiring a corresponding video and sending the video to the video processing device;
the video processing device is also used for displaying the received video on the video presenting device.
According to the video data processing method and system provided by the embodiment of the invention, each video terminal shoots the video according to the split screen resolution sent by the video presentation device, so that on one hand, the network broadband can be saved, on the other hand, the display definition of the whole picture of the video presentation device can be ensured to be basically the same, and the visual angle experience is improved.
Drawings
Fig. 1 is a flowchart illustrating a video data processing method according to an embodiment of the invention;
fig. 2 is a flowchart illustrating a video data processing method according to another embodiment of the invention;
FIG. 3 is a schematic structural diagram of a main video playing interface with active points;
FIG. 4 is a block diagram of a video data processing system according to an embodiment of the present invention;
FIG. 5 is a block diagram of a video data processing system according to another embodiment of the present invention;
fig. 6 is another schematic structural diagram of the main video playing interface with an active point.
Detailed Description
In order to make the technical problems, technical solutions and advantages of the present invention more apparent, the following detailed description is given with reference to the accompanying drawings and specific embodiments.
Fig. 1 is a video data processing method according to an embodiment of the present invention. As shown in fig. 1, a video data processing method according to an embodiment of the present invention may include:
s100, determining the number K of screens to be split and the split screen resolution R of each split screen according to user input1，R2，...，RK；
S110, determining corresponding video resolution according to each determined split-screen resolution;
s120, acquiring a corresponding video according to the determined video resolution;
and S130, displaying the acquired video.
In the embodiment of the present invention, the provided video data processing method can be applied to two scenarios, the first scenario is that a plurality of videos are displayed on only one display device, for example, a plurality of videos are displayed on a large screen of a CCTV scene; the second scenario is where multiple videos are displayed on multiple display devices simultaneously, for example, on a live broadcast, on the display devices of a main broadcast and multiple sub-broadcasts connected to the main broadcast simultaneously. These two scenarios are described in detail below.
(first embodiment)
In the case of the first scenario, the hardware may include: and the K video terminals are in communication connection with the video presentation device. The video terminal can comprise a video sensor (such as a camera, a shooting device and the like) and a processor which are connected through a bus, wherein the video sensor is used for acquiring video data according to the video resolution transmitted by the processor; and the processor is used for acquiring the split-screen resolution of the video presentation device from the video presentation device and determining the video resolution according to the split-screen resolution. And the video processing device is used for presenting the acquired K paths of video data on the video presenting device. Wherein the content of the first and second substances,
in step S100, the split resolution R of each split screen1，R2，...，RKThe determination may be based on: (1) evenly distributing; (2) manually selecting resolution; (3) from a custom configuration list, etc. Step S100 may be executed by a video processing apparatus connected to the video presenting apparatus, and the determined split screen resolution may be transmitted to a corresponding video terminal.
In step S110, the video terminal determines a video resolution according to the received split-screen resolution. For example, a video terminal i obtains a split screen resolution of Ri＝Wi0×Hi0Then the processor of the video terminal performs the following processing steps:
determining corresponding video resolution according to each determined split-screen resolution and a preset resolution list, wherein the preset resolution list is set by a user in a self-defined way, is stored in the video terminal and stores m resolutions (W)j1，Hj1) Wherein W isj1≥Hj1，j＝1，2，...m。
The processor may specifically perform the following steps:
s111, according to the split screen resolution Wi0×Hi0Determining a corresponding video display mode; for example, if Wi0≥Hi0The video terminal is set to a default landscape mode if Wi0≤Hi0The video terminal is set to the default portrait mode.
S112, judging whether the preset resolution list has Wi0×Hi0Or Hi0×Wi0Same resolution (W)j1，Hj1) And if so, the resolution is adjusted(Wj1，Hj1) Determining the resolution of the video as the corresponding resolution; otherwise, go to step S113;
step S112 can select a video resolution completely matching the split-screen resolution, so that the resolution of the video shot by the video terminal is the same as that of the video presentation device, and it can be ensured that the video presented by the video presentation device has substantially the same definition.
S113, judging whether the preset resolution list has the resolution (W) meeting the first preset conditionj1，Hj1) If so, determining the resolution as the video resolution; otherwise, go to step S114;
the first preset condition is as follows:
Argmin(|Wj1/Hj1-max(Wi0，Hi0)/min(Wi0，Hi0) And | and)
Wj1≥max(Wi0，Hi0) And is and
Argmin(Wj1-max(Wi0，Hi0))。
step S113 determines the video resolution according to three conditions, wherein the first condition is that the aspect ratio of the aspect ratio is as close as possible to the split-screen resolution, and the second condition is that the resolution is slightly larger than or the same as the split-screen resolution as far as possible, so as to ensure that the determined video resolution is as close as possible to the split-screen resolution, and to ensure that the video definitions presented by the video presentation device are substantially consistent as far as possible.
S114, judging whether the preset resolution list has the resolution (W) meeting a second preset conditionj1，Hj1) If so, determining the resolution as the video resolution;
the second preset condition is as follows:
Argmin(|Wj1/Hj1-max(Wi0，Hi0)/min(Wi0，Hi0) And | and)
Argmax(|Wj1-max(Wi0，Hi0)|)。
In step S114, the aspect ratio is selected to be close to the aspect ratio of the split screen resolution and the pixels are closest to ensure that the sharpness of the video presented by the video presentation device is substantially consistent as much as possible.
In step S120, the video sensor of each video terminal obtains a corresponding video according to the determined video resolution, and the video sensor is sent to the video processing device by the processor;
in step S130, the video processing apparatus sends the acquired video to the video presenting apparatus for displaying.
In the embodiment, each video terminal shoots the video according to the split-screen resolution sent by the video presenting device, so that on one hand, the network broadband can be saved, on the other hand, the display definition of the whole picture of the video presenting device can be ensured to be basically the same, and the viewing angle experience is improved.
(second embodiment)
In a second scenario, the hardware may include: the main video terminal is provided with a main video playing interface, and when the main video playing interface forms a main player and a plurality of (more than or equal to two) slave players in a split screen mode, an active point can be formed at the position of a common connection point of adjacent split screen areas, and as shown in fig. 3, the active point can be set to be black. Fig. 3 shows an interface including 4 grids, one grid is used as a master player, and the other 3 grids are used as slave players connected to the microphone, where the 4 grids are provided with an active point at a common connection point, and by operating the active point, the size of each split screen area of the master video playing interface can be changed, i.e. the resolution of the players in the video playing interface is dynamically adjustable. The lattice number, namely the split screen number of the main video playing interface can be set by the user according to the input of the user.
When multiple persons are connected to the wheat, if the screen division areas are not equally divided, as shown in fig. 2, the steps shown in fig. 1 may be replaced by:
s200, dividing a main video playing interface into a main player and M slave players to be accessed according to the input of a user, and determining the main playerWidth X0And height Y0；
S210, main video resolution (W) based on the main video playing interface0，H0) And width X of main player0And height Y0To obtain a first ratio W0/H0And a second ratio X0/Y0And make the first ratio W0/H0And a second ratio X0/Y0Simultaneously is more than or equal to 1 or simultaneously is less than or equal to 1;
s220, based on the main video resolution (W)0，H0) Width X of main player0And height Y0Determining a cropping resolution (W, H) of the main video terminal after using a main player;
s230, obtaining a width Xi and a height Yi, i being 1, 2.. times.m of an ith slave player accessed in a video playing interface;
s240, determining the split screen resolution W of the ith slave player according to the clipping resolution, the width and the height of the master player and the width and the height of the ith slave playeri×Hi；
S250, according to the determined split screen resolution Wi×HiDetermining a corresponding slave video resolution;
s260, acquiring a corresponding video according to the determined slave video resolution;
and S270, synthesizing and displaying the video acquired according to the slave video resolution and the video acquired according to the main video resolution.
The above steps S200 to S240 are further defined for the above step S100, and can be completed by a processor on the main video terminal.
Further, in step S200, the user may set the corresponding number of split screens according to the number M (M is greater than or equal to 1) of people who need to access, and then drag the active point on the main playing interface to determine the width and height of the playing area occupied by the main player.
Further, in step S210, if min (W)0/H0，X0/Y0)＜1＜max(W0/H0，X0/Y0) Then, the landscape and portrait shooting settings of the terminal in the main video are adjusted so that W is0/H0，X0/Y0While being greater than 1 or while being less than 1.
Further, step S220 may include:
s222, if W0/H0＝[(1-k)*X0/Y0，(1+k)*X0/Y0]Then (W, H) ═ W0， H0)；
S224, if W0/H0＞(1+k)*X0/Y0Then (W, H) ═ H0*X0/Y0，H0)；
S226, if W0/H0＜(1-k)*X0/Y0Then (W, H) ═ W0，W0*Y0/X0)；
Wherein k is a preset anti-jitter coefficient, and the value of k is preferably within 3%, such as 3%, 2%, and the like. The arrangement prevents that in the main video terminal, if the user misoperates that active point, then there is a certain redundancy, which does not alter the resolution of the individual players.
Further, before step S222, the method further includes:
s221, if W0/X0Is > alpha, and H0/Y0If > alpha, then W is0Is set as W0A, is0Is set to H0The/alpha, alpha is a preset ratio coefficient, and preferably can be 1.5. By so setting, the resolution can be saved.
Further, in step S240, the split-screen resolution W of the ith slave playeri×HiIs (W)i， Hi)＝(W*Xi/X0，H*Yi/Y0)。
In step S250, the slave video terminal determines a video resolution according to the received split screen resolution. For example, some split screen resolution obtained from video terminal i is Ri＝Wi0×Hi0Then this slave videoThe processor of the terminal performs the following processing steps:
determining corresponding video resolution according to each determined split-screen resolution and a preset resolution list, wherein the preset resolution list is stored in the video terminal and stores m resolutions (W)j，Hj) Wherein W isj≥Hj，j＝1，2，...m。
The processor may specifically perform the following steps:
s251, according to the split screen resolution Wi×HiDetermining a corresponding video display mode; for example, if Wi≥HiThe video terminal is set to a default landscape mode if Wi≤HiThe video terminal is set to the default portrait mode.
S252, judging whether the preset resolution list has Wi×HiOr Hi×WiSame resolution (W)j，Hj) If so, the resolution (W)j，Hj) Determining the resolution of the video as the corresponding resolution; otherwise, go to step S253;
step S252 can select a video resolution that is completely matched with the split-screen resolution, and can make the resolution of the video shot by the video terminal the same as that of the video presentation device, so that the definition of the video presented by the video presentation device is substantially the same.
S253, judging whether the preset resolution list has the resolution (W) meeting a first preset conditionj，Hj) If so, determining the resolution as the video resolution; otherwise, go to step S254;
the first preset condition is as follows:
Argmin(|Wj/Hj-max(Wi，Hi)/min(Wi，Hi) And | and)
Wj1≥max(Wi，Hi) And is and
Argmin(Wj1-max(Wi，Hi))。
step S253 determines the video resolution according to three conditions, wherein the first condition is that the aspect ratio of the aspect ratio is as close as possible to the aspect ratio of the split-screen resolution, and the second condition is that the resolution is slightly larger than or the same as the split-screen resolution as far as possible, so as to ensure that the determined video resolution is as close as possible to the split-screen resolution, and to ensure that the definitions of the videos presented by the video presentation device are substantially consistent as far as possible.
S254, judging whether the preset resolution list has the resolution (W) meeting a second preset conditionj，Hj) If so, determining the resolution as the video resolution;
the second preset condition is as follows:
Argmin(|Wj/Hj-max(Wi，Hi)/min(Wi，Hi) And | and)
Argmax(|Wj-max(Wi，Hi)|)。
In step S254, the aspect ratio is selected to be close to the aspect ratio of the split screen resolution and the pixels are closest to ensure that the sharpness of the video presented by the video presentation device is substantially consistent as much as possible.
In step S260, each slave video terminal acquires a corresponding video according to the determined video resolution, and sends the corresponding video to the master video terminal;
in step S270, the master video terminal combines the split access video streams into the same video according to the resolution, and then displays the video on the master video playing interface and sends the video to the corresponding slave video terminal, so as to provide the user with a view, i.e. a view on demand or a view on a live line. The specific technique for merging video streams may be, for example, the technique in CN109729379A, or any other merging technique that can be instantly suggested in the prior art.
In this embodiment, since the split-screen resolution of the slave player is corrected according to the master player, the display effect presented to the user is substantially the same in definition, and the user experience is good. In addition, since the video of the slave player is acquired according to the split screen resolution determined by the master video terminal, the network broadband can be saved. In addition, because the resolution ratio of each player can be dynamically adjusted, the resolution ratio of a main player can be adjusted according to the selection of a user in the live broadcasting process, and the interactivity is strong.
Another embodiment of the present invention further provides a video data processing system for implementing the steps shown in fig. 1. As shown in fig. 4, a video data processing system according to an embodiment of the present invention includes: the system comprises a video presenting device 101, a video processing device 102 and K video terminals 103 which are in communication connection, wherein K is more than or equal to 2; the video processing device is used for determining the number N of the screens to be split and the split screen resolution W of each split screen according to user inputi0×Hi0And sending the video data to a corresponding video terminal, wherein i is 1, 2. The video terminal is used for: according to the determined resolution W of each split screeni0×Hi0Determining the corresponding video resolution; and according to the determined video resolution Wij×HijAcquiring a corresponding video and sending the video to the video processing device; the video processing device is also used for displaying the received video on the video presenting device.
Further, the video terminal 103 is specifically configured to:
according to the determined resolution W of each split screeni0×Hi0And a preset resolution list for determining a corresponding video resolution, the preset resolution list having m resolutions (W) stored thereinj1，Hj1) Wherein W isj1≥Hj1，j＝1，2，...m。
Further, the video terminal 103 is further configured to:
according to the split screen resolution Wi0×Hi0Determining a corresponding video display mode;
if the preset resolution list has the split screen resolution Wi0×Hi0Or Hi0×Wi0Same resolution (W)j1，Hj1) Then the resolution (W) is setj1，Hj1) The video resolution is determined.
Further, the video terminal 103 is further configured to:
if the preset resolution list does not have the split screen resolution Wi0×Hi0Or Hi0×Wi0Same resolution (W)j1，Hj1) Then, the resolution (W) meeting the first preset condition in the preset resolution list is selectedj1，Hj1) Determining as the video resolution; the first preset condition is as follows:
Argmin(|Wj1/Hj1-max(Wi0，Hi0)/min(Wi0，Hi0) And | and)
Wj1≥max(Wi0，Hi0) And is and
Argmin(Wj1-max(Wi0，Hi0))。
further, the video terminal 103 is further configured to:
if there is no resolution satisfying the first preset condition in the preset resolution list, a resolution (W) satisfying a second preset conditionj1，Hj1) Determining as the video resolution;
the second preset condition is as follows:
Argmin(|Wj1/Hj1-max(Wi0，Hi0)/min(Wi0，Hi0) And | and)
Argmax(|Wj1-max(Wi0，Hi0)|)。
The functions of the video data processing system of this embodiment may correspond to the corresponding processing steps in the flow shown in fig. 1, and are not described herein again.
Another embodiment of the present invention further provides a video data processing system for implementing the steps shown in fig. 2. As shown in fig. 5, may include a master video terminal 201 including a processor and video sensors and M slave video terminals 202. In addition, a master video playing interface 203 is arranged on the master video terminal 201, and when a master player and a plurality of (greater than or equal to two) slave players are formed by split-screen display, an active point 204 is formed on the master video playing interface 203 at the position of a common connection point of adjacent split-screen areas, as shown in fig. 6, the active point may be set to be black. In the interface shown in fig. 6, compared with fig. 3, 2 more grids are provided, that is, 6 grids are included, one grid is used as a master player, and the other 5 grids are used as slave players of the continuous microphone, and the 6 grids are respectively provided with one active point at the joint point common to the adjacent 4 grids for two active points. By operating the active point, the size of each split screen area of the main video playing interface can be changed, i.e. the resolution of the player in the video playing interface can be dynamically adjusted. When a plurality of persons are connected with the wheat, under the condition that each split screen area is not equally split, the processor is used for executing the following steps:
s300, dividing a main video playing interface of the main video terminal into a main player and M slave players to be accessed according to the input of a user, and determining the width X of the main player0And height Y0；
S310, based on the main video resolution (W) of the main video playing interface0，H0) And width X of main player0And height Y0To obtain a first ratio W0/H0And a second ratio X0/Y0And make the first ratio W0/H0And a second ratio X0/Y0Simultaneously is more than or equal to 1 or simultaneously is less than or equal to 1;
s320, based on main video resolution (W)0，H0) Width X of main player0And height Y0Determining a cropping resolution (W, H) of the main video terminal after using a main player;
s330, obtaining a width Xi and a height Yi, i being 1, 2.. times.m of an ith slave player accessed in a video playing interface;
s340, determining the split screen resolution W of the ith slave player according to the clipping resolution, the width and the height of the master player and the width and the height of the ith slave playeri×Hi；
S350, according to the determined split screen resolution Wi×HiDetermining the resolution of the corresponding slave video and sending the resolution to the corresponding slave video terminal;
the slave video terminal is used for acquiring a corresponding video according to the corresponding slave video resolution and sending the video to the main processor;
the main processor is further configured to:
and S360, synthesizing the video acquired from the slave video terminal and the video acquired from the master video terminal, and respectively sending the synthesized video to the master video terminal and the slave video terminal for displaying.
Further, step S320 includes:
s322, if W0/H0＝[(1-k)*X0/Y0，(1+k)*X0/Y0]Then (W, H) ═ W0， H0)；
S324, if W0/H0＞(1+k)*X0/Y0Then (W, H) ═ H0*X0/Y0，H0)；
S326, if W0/H0＜(1-k)*X0/Y0Then (W, H) ═ W0，W0*Y0/X0)；
Wherein k is a preset anti-jitter coefficient.
Further, before step S322, the method further includes:
s321, if W0/X0Is > alpha, and H0/Y0If > alpha, then W is0Is set as W0A, is0Is set to H0And the alpha is a preset ratio coefficient.
Further, in step S340, the screen splitting resolution W of the ith slave playeri×HiIs (W)i，Hi)＝(W*Xi/X0，H*Yi/Y0)。
Further, step S350 may include:
according to the determined split screen resolution Wi×HiAnd a preset resolution list determining a corresponding slave video resolution, the preset resolution list having m resolutions (W) stored thereinj，Hj) Wherein W isj≥Hj， j＝1，2，...m。
Further, according to the determined split screen resolution Wi×HiAnd a preset resolution list, determining a corresponding slave video resolution, comprising:
according to the split screen resolution Wi×HiDetermining a corresponding video display mode;
if W is present in the preset resolution listi×HiOr with Hi×WiSame resolution (W)j，Hj) Then the resolution (W) is setj，Hj) Determined as the corresponding slave video resolution.
Further, still include:
if the preset resolution list does not exist and Wi×HiOr with Hi×WiSame resolution (W)j，Hj) Then, the resolution (W) meeting the first preset condition in the preset resolution list is selectedj， Hj) Determining as the video resolution;
the first preset condition is as follows:
Argmin(|Wj/Hj-max(Wi，Hi)/min(Wi，Hi) And | and)
Wj1≥max(Wi，Hi) And is and
Argmin(Wj-max(Wi，Hi))。
further, still include:
if there is no resolution satisfying the first preset condition in the preset resolution list, a resolution (W) satisfying a second preset conditionj，Hj) Determining as the video resolution;
the second preset condition is as follows:
Argmin(|Wj/Hj-max(Wi，Hi)/min(Wi，Hi) And | and)
Argmax(|Wj-max(Wi，Hi)|)。
The functions of the video data processing system of this embodiment may correspond to the corresponding processing steps in the flow shown in fig. 2, and are not described herein again.
The above-mentioned embodiments are only specific embodiments of the present invention, which are used for illustrating the technical solutions of the present invention and not for limiting the same, and the protection scope of the present invention is not limited thereto, although the present invention is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present invention, and they should be construed as being included therein. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (1)

1. A video data processing system, comprising a master video terminal and M slave video terminals, wherein the master video terminal comprises a processor and a video sensor; when the main video playing interface forms a main player and a plurality of slave players in a split screen manner, an active point is formed at the common connection point position of adjacent split screen areas, so that the resolution of the players in the video playing interface can be dynamically adjusted; wherein the processor is configured to:
s300, dividing a main video playing interface of the main video terminal into a main player and M slave players to be accessed according to the input of a user, and determining the width X of the main player0And height Y0；
S310, based on the main video resolution (W) of the main video playing interface0，H0) And width X of main player0And height Y0To obtain a first ratio W0/H0And a second ratio X0/Y0And adjusting the shooting setting of the transverse screen or the vertical screen of the terminal in the main video to enable the first ratio W0/H0And a second ratio X0/Y0Simultaneously is more than or equal to 1 or simultaneously is less than or equal to 1;
s320, based on main video resolution (W)0，H0) Width X of main player0And height Y0Determining a cropping resolution (W, H) of the main video terminal after using a main player;
s330, obtaining a width Xi and a height Yi of an ith slave player accessed in the video playing interface, where i is 1, 2, …, M;
s340, determining the split screen resolution W of the ith slave player according to the clipping resolution, the width and the height of the master player and the width and the height of the ith slave playeri×Hi；
S350, according to the determined split screen resolution Wi×HiDetermining the resolution of the corresponding slave video and sending the resolution to the corresponding slave video terminal;
the slave video terminal is used for acquiring a corresponding video according to the corresponding slave video resolution and sending the corresponding video to the processor;
the video sensor is used for acquiring a video played in the main player;
the processor is further configured to:
s360, synthesizing and displaying the video acquired from the video terminal and the video acquired by the video sensor;
step S320 includes:
s322, if W0/H0＝[(1-k)*X0/Y0，(1+k)*X0/Y0]Then (W, H) ═ W0，H0)；
S324, if W0/H0＞(1+k)*X0/Y0Then (W, H) ═ H0*X0/Y0，H0)；
S326, if W0/H0＜(1-k)*X0/Y0Then (W, H) ═ W0，W0*Y0/X0)；
Wherein k is a preset anti-jitter coefficient;
in step S340, the split-screen resolution W of the ith slave playeri×HiIs (W)i，Hi)＝(W*Xi/X0，H*Yi/Y0)；
Step S350 includes:
according to the determined resolution W of each split screeni×HiAnd a preset resolution list for determining a corresponding video resolution, the preset resolution list having m resolutions (W) stored thereinj，Hj) Wherein W isj≥Hj，j＝1，2，…m；
The resolution W of each split screen is determinedi×HiAnd a preset resolution list, determining a corresponding video resolution, comprising:
according to the split screen resolution Wi×HiDetermining a corresponding video display mode;
if the preset resolution list has the split screen resolution Wi×HiOr Hi×WiSame resolution (W)j，Hj) Then the resolution (W) is setj，Hj) Determining as the video resolution;
if the preset resolution list does not have the split screen resolution Wi×HiOr Hi×WiSame resolution (W)j，Hj) Then, the resolution (W) meeting the first preset condition in the preset resolution list is selectedj，Hj) Determining as the video resolution;
the first preset condition is as follows:
Argmin(|Wj/Hj-max(Wi，Hi)/min(Wi，Hi) And | and)
Wj≥max(Wi，Hi) And is and
Argmin(Wj-max(Wi，Hi))；
if there is no resolution satisfying the first preset condition in the preset resolution list, a resolution (W) satisfying a second preset conditionj，Hj) Determining as the video resolution;
the second preset condition is as follows:
Argmin(|Wj/Hj-max(Wi，Hi)/min(Wi，Hi) And | and)
Argmax(|Wj-max(Wi，Hi)|)。
CN202011038108.1A 2020-09-28 2020-09-28 Video data processing method Active CN112272270B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011038108.1A CN112272270B (en) 2020-09-28 2020-09-28 Video data processing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011038108.1A CN112272270B (en) 2020-09-28 2020-09-28 Video data processing method

Publications (2)

Publication Number Publication Date
CN112272270A CN112272270A (en) 2021-01-26
CN112272270B true CN112272270B (en) 2022-03-01

Family

ID=74349735

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011038108.1A Active CN112272270B (en) 2020-09-28 2020-09-28 Video data processing method

Country Status (1)

Country Link
CN (1) CN112272270B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114125539B (en) * 2022-01-28 2022-05-03 广州长嘉电子有限公司 Intelligent large-screen device high-definition playing control method and system based on wireless transmission

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070077381A (en) * 2006-01-23 2007-07-26 (주)컴아트시스템 High resolution apparatus for multi-screen display
CN101365117A (en) * 2008-09-18 2009-02-11 中兴通讯股份有限公司 Method for customized screen splitting mode
CN101377920A (en) * 2007-08-30 2009-03-04 三星电子株式会社 Display control method, and display apparatus and display system using the same
CN101848382A (en) * 2010-05-31 2010-09-29 深圳市景阳科技股份有限公司 Method and system for adjusting video streaming image resolution ratio and code stream
WO2012171459A1 (en) * 2011-06-13 2012-12-20 华为技术有限公司 Method and device for mcu multi-picture optimized configuration
CN202799004U (en) * 2012-06-04 2013-03-13 深圳市景阳科技股份有限公司 Video playback terminal and video playback system
CN103517137A (en) * 2013-09-30 2014-01-15 广州华多网络科技有限公司 Network video transmission method and system, sending/receiving end processing method and device
CN104281427A (en) * 2014-03-10 2015-01-14 深圳深讯和科技有限公司 Video data processing method and system in interactive application
CN106303573A (en) * 2016-08-30 2017-01-04 上海乐欢软件有限公司 A kind of 3D method of video image processing and server and client side
CN106791551A (en) * 2016-12-12 2017-05-31 广东威创视讯科技股份有限公司 A kind of method of automatic regulating signal source resolution ratio, mosaic screen and system
CN107333165A (en) * 2017-06-29 2017-11-07 徐文波 The control method and device of many picture position adjustment
CN107888964A (en) * 2016-09-30 2018-04-06 杭州海康威视数字技术股份有限公司 The code stream type switching method and device of a kind of video playback
CN108184094A (en) * 2017-12-29 2018-06-19 北京视觉世界科技有限公司 Video picture displaying method and device
CN111314624A (en) * 2018-12-11 2020-06-19 杭州海康威视数字技术股份有限公司 Preview picture generation method, device, hard disk video recorder and storage medium

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10764494B2 (en) * 2018-05-25 2020-09-01 Microsoft Technology Licensing, Llc Adaptive panoramic video streaming using composite pictures

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070077381A (en) * 2006-01-23 2007-07-26 (주)컴아트시스템 High resolution apparatus for multi-screen display
CN101377920A (en) * 2007-08-30 2009-03-04 三星电子株式会社 Display control method, and display apparatus and display system using the same
CN101365117A (en) * 2008-09-18 2009-02-11 中兴通讯股份有限公司 Method for customized screen splitting mode
CN101848382A (en) * 2010-05-31 2010-09-29 深圳市景阳科技股份有限公司 Method and system for adjusting video streaming image resolution ratio and code stream
WO2012171459A1 (en) * 2011-06-13 2012-12-20 华为技术有限公司 Method and device for mcu multi-picture optimized configuration
CN202799004U (en) * 2012-06-04 2013-03-13 深圳市景阳科技股份有限公司 Video playback terminal and video playback system
CN103517137A (en) * 2013-09-30 2014-01-15 广州华多网络科技有限公司 Network video transmission method and system, sending/receiving end processing method and device
CN104281427A (en) * 2014-03-10 2015-01-14 深圳深讯和科技有限公司 Video data processing method and system in interactive application
CN106303573A (en) * 2016-08-30 2017-01-04 上海乐欢软件有限公司 A kind of 3D method of video image processing and server and client side
CN107888964A (en) * 2016-09-30 2018-04-06 杭州海康威视数字技术股份有限公司 The code stream type switching method and device of a kind of video playback
CN106791551A (en) * 2016-12-12 2017-05-31 广东威创视讯科技股份有限公司 A kind of method of automatic regulating signal source resolution ratio, mosaic screen and system
CN107333165A (en) * 2017-06-29 2017-11-07 徐文波 The control method and device of many picture position adjustment
CN108184094A (en) * 2017-12-29 2018-06-19 北京视觉世界科技有限公司 Video picture displaying method and device
CN111314624A (en) * 2018-12-11 2020-06-19 杭州海康威视数字技术股份有限公司 Preview picture generation method, device, hard disk video recorder and storage medium

Also Published As

Publication number Publication date
CN112272270A (en) 2021-01-26

Similar Documents

Publication Publication Date Title
AU2012269508B2 (en) Method and device for MCU multi-picture optimized configuration
US8542948B2 (en) Image processing apparatus and method
US20110304772A1 (en) Screen zoom feature for cable system subscribers
US20120127261A1 (en) Teleconferencing device and image display processing method
US20180338093A1 (en) Eye-tracking-based image transmission method, device and system
CN103002349A (en) Adaptive adjustment method and device for video playing
CN112272270B (en) Video data processing method
CN112135057B (en) Video image processing method and system
CN113542841A (en) Screen projection method and screen projection system
JP2008244917A (en) Receiver control system
CN114651448A (en) Information processing system, information processing method, and program
CN111147883A (en) Live broadcast method and device, head-mounted display equipment and readable storage medium
CN114449303A (en) Live broadcast picture generation method and device, storage medium and electronic device
CN113613030A (en) Live broadcast control method and system and computer readable storage medium
CN106792084B (en) Television signal display parameter adjusting method and device and television signal display method
JP2019149785A (en) Video conversion device and program
EP2744209A1 (en) Content processing device, content processing method, and recording medium
US11935157B2 (en) Image processing system, image processing method, and storage medium
JP4901981B2 (en) Image processing apparatus, image processing method, and program
JP6755701B2 (en) Imaging device, display device and image processing device
JP2007134798A (en) Output control system and method, output controller and method, and program
CN105872750A (en) Self-adaptive volume adjustment television based on keywords
JP2007013848A (en) Digital video display system
CN106961622B (en) Display processing method and device
JP5004680B2 (en) Image processing apparatus, image processing method, video conference system, video conference method, program, and recording medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant