CN114302211A

CN114302211A - Video playing method and device and electronic equipment

Info

Publication number: CN114302211A
Application number: CN202111639676.1A
Authority: CN
Inventors: 孟晨
Original assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Current assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Priority date: 2021-12-29
Filing date: 2021-12-29
Publication date: 2022-04-08
Anticipated expiration: 2041-12-29
Also published as: CN114302211B

Abstract

The disclosure provides a video playing method and device and electronic equipment, and relates to the field of image processing, in particular to the field of image display. The specific implementation scheme is as follows: the video playing method comprises the following steps: acquiring a composite video stream and target coordinate information, wherein the composite video stream comprises a video stream formed by synthesizing a first video stream and a second video stream, and the target coordinate information comprises: coordinate information of a first playing window when the composite video stream is in a playing state, and coordinate information of a target area in the first playing window; determining a target alignment mode between the composite video stream and a screen of the electronic device based on the target coordinate information and screen size information of the electronic device; and playing the composite video stream in the electronic equipment according to the target alignment mode, wherein the target area for playing the second video stream is in a screen display area of the electronic equipment. The present disclosure can improve the playing effect of the composite video stream.

Description

Video playing method and device and electronic equipment

Technical Field

The present disclosure relates to the field of image processing, and in particular, to the field of image display, and in particular, to a video playing method and apparatus, and an electronic device.

Background

Currently, in a live broadcast scenario, when a main broadcast connects with other users, clients of all members in a live broadcast room generally need to display a video stream of the main broadcast end and a video stream of the connecting end respectively. In order to save bandwidth cost, the prior art proposes that after a video stream of a main broadcasting end and a video stream of a connecting microphone end are synthesized, one path of video stream is sent to a corresponding client side for display. Since the display size of the composite video stream may not match the screen size of the client, scaling of the composite video stream is typically required when the display size of the composite video stream does not match the screen size of the client, and in the prior art, the composite video stream is typically centered on the screen and then scaled so that the composite video stream fills the entire screen display area.

Disclosure of Invention

The disclosure provides a video playing method and device and electronic equipment.

According to a first aspect of the present disclosure, there is provided a video playing method, including:

acquiring a composite video stream and target coordinate information, wherein the composite video stream comprises a video stream formed by synthesizing a first video stream and a second video stream, and the target coordinate information comprises: coordinate information of a first playing window when the composite video stream is in a playing state, and coordinate information of a target area in the first playing window, wherein the first playing window is used for playing the first video stream, and the target area is used for playing the second video stream;

determining a target alignment mode between the composite video stream and a screen of the electronic device based on the target coordinate information and screen size information of the electronic device;

and playing the composite video stream in the electronic equipment according to the target alignment mode, wherein the target area for playing the second video stream is in a screen display area of the electronic equipment.

According to a second aspect of the present disclosure, there is provided a video playback apparatus including:

an obtaining module, configured to obtain a composite video stream and target coordinate information, where the composite video stream includes a video stream formed by compositing a first video stream and a second video stream, and the target coordinate information includes: coordinate information of a first playing window when the composite video stream is in a playing state, and coordinate information of a target area in the first playing window, wherein the first playing window is used for playing the first video stream, and the target area is used for playing the second video stream;

a determining module, configured to determine a target alignment manner between the composite video stream and a screen of an electronic device based on the target coordinate information and screen size information of the electronic device;

and the playing module is used for playing the composite video stream in the electronic equipment according to the target alignment mode, wherein the target area for playing the second video stream is in a screen display area of the electronic equipment.

According to a third aspect of the present disclosure, there is provided an electronic device comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of the first aspect.

According to a fourth aspect of the present disclosure, there is provided a non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method according to the first aspect.

According to a fifth aspect of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements the method according to the first aspect.

In the embodiment of the present disclosure, the display position of the target area in the composite video stream when the composite video stream is in the playing state can be determined according to the target coordinate information. Therefore, the corresponding target alignment mode can be determined according to the display position of the target area in the composite video stream and the screen size information of the electronic equipment, and because the target area for playing the second video stream is positioned in the screen when the composite video stream is played according to the target alignment mode, the problem that the second video stream displayed in the composite video stream is cut in the alignment process of the composite video stream and the screen can be avoided, and the playing effect of the composite video stream is improved.

Drawings

The drawings are included to provide a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:

fig. 1 is a flowchart of a video playing method provided by an embodiment of the present disclosure;

FIG. 2 is a schematic diagram of a second playback window centered on the screen in an embodiment of the disclosure;

FIG. 3 is a diagram illustrating a second playback window left-aligned with the screen in an embodiment of the disclosure;

FIG. 4 is a diagram illustrating a second playback window aligned to the right of the screen in an embodiment of the present disclosure;

FIG. 5 is a schematic diagram of a third playback window centered on the screen in an embodiment of the disclosure;

FIG. 6 is a diagram illustrating alignment of a third playback window with the top of the screen in an embodiment of the present disclosure;

FIG. 7 is a diagram illustrating alignment of a third playback window with the lower end of the screen in an embodiment of the present disclosure;

FIG. 8 is a schematic diagram of a zoomed first playback window aligned centrally with the screen in an embodiment of the disclosure;

fig. 9 is a schematic structural diagram of a video playing apparatus according to an embodiment of the present disclosure;

fig. 10 is a block diagram of an electronic device for implementing a video playing method according to an embodiment of the present disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

The present disclosure provides a video playing method.

Referring to fig. 1, fig. 1 is a flowchart illustrating a video playing method according to an embodiment of the disclosure. As shown in fig. 1, the method comprises the steps of:

step S101, acquiring a composite video stream and target coordinate information, wherein the composite video stream comprises a video stream formed by synthesizing a first video stream and a second video stream, and the target coordinate information comprises: coordinate information of a first playing window when the composite video stream is in a playing state, and coordinate information of a target area in the first playing window, wherein the first playing window is used for playing the first video stream, and the target area is used for playing the second video stream;

step S102, determining a target alignment mode between the synthesized video stream and a screen of the electronic equipment based on the target coordinate information and the screen size information of the electronic equipment;

step S103, playing the composite video stream in the electronic device according to the target alignment manner, wherein the target area for playing the second video stream is in a screen display area of the electronic device.

Specifically, the composite video stream may be a composite video stream in various scenes, for example, a composite video stream in a live-broadcast wheat-connected scene, or a composite video stream in a video call scene. The following takes the composite video stream as a composite video stream in a live-broadcast wheat-connecting scene as an example, and further explains the video playing method provided by the embodiment of the disclosure.

The first video stream may be a video stream of a main broadcasting end, the second video stream may be a video stream of a microphone end, and the microphone end may be another main broadcasting end or a viewer end in a live broadcasting room. The stream pushing server can receive the first video stream and the second video stream respectively in two paths, and after the stream pushing server obtains the first video stream of the anchor terminal and the second video stream of the connecting terminal, in order to save the broadband cost for watching live broadcast by members in a live broadcast room, the two paths of video streams can be synthesized to form a synthesized video stream, and one path of the synthesized video stream is sent to the client of each member for playing.

In the related art, when the client plays the composite video stream, if the display size of the composite video stream does not match the screen size of the client, the client generally aligns the composite video stream with the screen in a center, and then scales the composite video stream so that the composite video stream covers the entire screen display area. However, in playing the composite video stream, the video stream at the connecting end is usually displayed in the form of a small window in the edge area of the composite video stream, and therefore, in the process of scaling the composite video stream, the display area of the video stream at the connecting end is easily scaled to be outside the screen display area of the client. In the synthesized video stream, the part outside the screen display area is clipped by the client, which may cause the problem that the video stream of the connected client cannot be displayed or cannot be completely displayed.

Based on this, the embodiment of the present disclosure determines a target alignment manner between the composite video stream and the screen of the electronic device based on the target coordinate information and the screen size information of the electronic device, and plays the composite video stream in the electronic device according to the target alignment manner, so that when the composite video stream is played by the electronic device, the video stream at the microphone end can be completely displayed.

Specifically, the target coordinate information may be display position information of the first video stream and the second video stream recorded by the plug flow server in the process of synthesizing the first video stream and the second video stream. In the process of synthesizing the first video stream and the second video stream, the stream pushing server can display the first video stream in a first playing window, and make the display area of the first video stream aligned with the first playing window; meanwhile, the second video stream is displayed in the target area in the first playing window, and the display area of the second video stream is aligned with the target area, so that the composite video stream is obtained. And then, respectively acquiring the coordinate information of the first playing window and the coordinate information of the target area, thereby obtaining the target coordinate information. And then the synthesized video stream and the target coordinate information are sent to the electronic equipment corresponding to each member in the live broadcast room. After each electronic device receives the composite video stream and the target coordinate information, corresponding target alignment modes can be respectively determined according to the screen size information of the electronic device and the target coordinate information, and the composite video stream can be played according to the determined target alignment modes.

It can be understood that the coordinate information of the first playing window and the coordinate information of the target area in the first playing window may be preset and stored in the push streaming server in advance. The screen size information may include a length size and a width size of a screen of the electronic device. The screen size information may be information calculated by the electronic device according to its own resolution, or may be configuration information pre-configured in the electronic device. Since the types of electronic devices of different members in a live room are often different, the screen size information of the electronic devices of different members may also be different. Correspondingly, when the same composite video stream is delivered to different electronic devices, the corresponding target alignment modes may be different.

Specifically, after the electronic device acquires the target coordinate information, the relative positions of the first video stream and the second video stream displayed when the composite video stream is played at the plug flow server can be restored according to the target coordinate information, so that a proper alignment mode can be further determined according to the size information of the screen of the electronic device, and the video stream of the microphone connecting end can be completely displayed in the screen display area of the electronic device.

In an embodiment of the present disclosure, the first playing window may be a playing window of a video player inside the electronic device, after the electronic device receives the composite video stream and the target coordinate information, the player may be started to display the first playing window, then, based on the target coordinate information and the screen size information of the electronic device, a target alignment manner between the composite video stream and the screen of the electronic device may be determined, the first playing window may be aligned with the screen according to the target alignment manner, and then, the composite video stream may be played in the electronic device.

In this embodiment, the display position of the target area in the composite video stream when the composite video stream is in the playing state can be determined according to the target coordinate information. Therefore, the corresponding target alignment mode can be determined according to the display position of the target area in the composite video stream and the screen size information of the electronic equipment, and because the target area for playing the second video stream is positioned in the screen when the composite video stream is played according to the target alignment mode, the problem that the second video stream displayed in the composite video stream is cut in the alignment process of the composite video stream and the screen can be avoided, and the playing effect of the composite video stream is improved.

Optionally, the screen size information includes a first ratio of a size of the screen in a first direction to a size of the screen in a second direction, and the determining the target alignment manner between the composite video stream and the screen of the electronic device based on the target coordinate information and the screen size information of the electronic device includes:

calculating a second ratio of the first playing window based on the target coordinate information, wherein the second ratio is a ratio of the size of the first playing window in the first direction to the size of the first playing window in the second direction;

and determining the target alignment mode based on the first ratio and the second ratio.

One of the first direction and the second direction may be a width direction, and the other may be a height direction. For convenience of understanding, the following text takes the first direction as a height direction and the second direction as a width direction as an example, and further explains the video playing method provided by the embodiment of the present disclosure.

Specifically, when the first direction is a height direction and the second direction is a width direction, the first ratio is an aspect ratio of a screen of the electronic device, for example, the first ratio may be 16:9, and the second ratio is an aspect ratio of the first playing window. Since the target coordinate information includes the coordinate information of the first playing window, the size of the first playing window in the first direction and the size of the first playing window in the second direction can be determined according to the coordinate information of the first playing window.

It is understood that, when the composite video stream is in a playing state, the first video stream is displayed in the first playing window, and the first video stream may fill up the entire display area of the first playing window, and the second video stream is displayed in the target area inside the first playing window. I.e. the first playback window actually forms the playback window of the composite video stream. Therefore, the target alignment mode can be determined by comparing the size of the first playing window with the screen size of the electronic device.

In an embodiment of the present disclosure, multiple alignment manners may be configured in the electronic device in advance, and a correspondence between different "first ratio and second ratio" and different "alignment manners" may be established in advance, where the alignment manners may include: center alignment, left alignment, right alignment, top alignment, bottom alignment, etc. Therefore, after the electronic device obtains the first ratio and the second ratio, the target alignment mode can be determined according to the corresponding relationship.

In this embodiment, the first ratio and the second ratio, that is, the aspect ratio of the screen and the aspect ratio of the first playing window, are obtained, so that the corresponding target alignment mode can be determined according to the relationship between the aspect ratio of the screen and the aspect ratio of the first playing window.

Optionally, the determining the target alignment manner based on the first ratio and the second ratio includes:

under the condition that the first ratio is larger than the second ratio, zooming the first playing window until the size of the first playing window in the first direction is matched with the size of the screen in the first direction to obtain a zoomed second playing window;

under the condition that the second playing window is aligned with the screen in the middle, if the target area in the second playing window is located in the screen, determining that the target alignment mode is the center alignment mode; or, in a case that the second playing window is aligned with the screen in the middle, if the first edge of the target region is located outside the screen, determining that the target alignment mode is a mode of aligning according to a first target edge of the second playing window, where the first edge is one edge of the target region along the second direction, and the first target edge is one edge of two parallel edges of the second playing window and the first edge, which is closest to the first edge.

When the first ratio is greater than the second ratio, that is, the aspect ratio of the screen is greater than the aspect ratio of the first playing window, in the process of scaling the first playing window, when the size of the first playing window in the width direction is scaled to be the same as the size of the screen in the width direction, the size of the first playing window in the height direction is smaller than the size of the screen in the height direction. At this time, the zoomed first playing window cannot fill the display area of the screen in the height direction. Therefore, the first playing window can be further enlarged, so that the size of the enlarged second playing window in the height direction is matched with the size of the screen in the height direction. At this time, the size of the second playing window in the height direction is matched with the size of the screen in the height direction, and the size of the second playing window in the width direction is larger than the size of the screen in the width direction, so that the second playing window can be ensured to be capable of fully covering the display area of the screen, that is, the composite video stream can be ensured to be capable of fully covering the display area of the screen.

The size of the second playing window in the height direction is matched with the size of the screen in the height direction, and may be: the difference between the height direction size of the second playing window and the height direction size of the screen is within a preset range, for example, the height direction size of the second playing window may be the same as the height direction size of the screen.

After the first playing window is zoomed to obtain a second playing window, the second playing window may be aligned with the screen in a centered alignment manner, at this time, two sides of the second playing window in the height direction (i.e., the first direction) are aligned with two sides of the screen in the height direction, two sides of the second playing window in the width direction (i.e., the second direction) are located outside the display area of the screen, that is, two sides of the second playing window respectively have partial areas extending to the outside of the screen display area. And the target area is located inside the second playing window, therefore, the display position of the target area needs to be further determined based on the target coordinate information to determine whether the screen can completely display the target area.

Specifically, whether two sides of the target area in the width direction are located within the screen display area may be determined according to the target coordinate information, and if two sides of the target area in the width direction are located within the screen display area, it may be determined that the target area is located within the display area of the screen. At this time, it may be determined that when the target area is aligned in the center alignment manner, the target area is not zoomed out of the screen display area, that is, when the composite video stream is played in the center alignment manner, the screen of the electronic device may completely display the second video stream of the microphone end, and therefore, the target alignment manner may be determined as the center alignment manner. For example, referring to fig. 2, when both sides of the second playing window have partial areas cut, because the target area is still located in the screen display area, the target alignment mode may be determined as a center alignment mode, where the shaded area in fig. 2 is the cut area, and the shaded area in fig. 2 and the screen display area together form the second playing window.

Correspondingly, after the second playing window is aligned with the screen in the center alignment manner, if the first edge of the target area is located outside the display area of the screen, it indicates that when the second playing window is aligned in the center alignment manner, at least a partial area of the target area is zoomed out of the display area of the screen, that is, when the composite video stream is played in the center alignment manner, the electronic device cannot completely display the second video stream. At this time, since both sides of the second playing window parallel to the first side are located outside the screen display region, and the first side is also located outside the screen display region, a first target side located on the same side of the screen display region as the first side may be determined in both sides of the second playing window parallel to the first side. Since the first edge and the first target edge are located on the same side of the screen display area, the target area is close to the first target edge, and in this case, the target area can be located in the screen display area by aligning the second playing window with the screen according to the first target edge.

Specifically, two parallel sides of the second playing window and the first side are respectively located at two opposite sides of the screen display area, so that one of the two parallel sides of the second playing window and the first side is necessarily located at the same side of the screen display area as the first side. In this case, distances between two sides of the second window parallel to the first side and the first side may be calculated, respectively, and since one of the two sides of the second window parallel to the first side that is located on the same side as the first side is closer to the first side, the side closest to the first side may be determined as the first target side among the two sides of the second window parallel to the first side.

The aligning the second playing window and the screen according to the first target edge is as follows: and aligning one edge of the screen, which is positioned on the same side as the first target edge, with the first target edge. For example, referring to fig. 3, when the first target edge is the left edge of the second playing window, the left edge of the screen may be aligned with the left edge of the second playing window, that is, the target alignment mode is a left alignment mode, at this time, the left side of the second playing window is not cut, only the right area of the second playing window is cut, and the target area is close to the left area of the second playing window, so that the problem that the target area is cut may be avoided. Thereby enabling the screen to display the target area completely. The shaded area in fig. 3 is a clipped area, and the shaded area in fig. 3 and the screen display area together form the second playing window.

Correspondingly, referring to fig. 4, when the first target edge is the right side edge of the second playing window, the right side edge of the screen may be aligned with the right side edge of the second playing window, that is, the target alignment mode is a right alignment mode, at this time, the right side of the second playing window is not cut, only the left area of the second playing window is cut, and the target area is close to the right area of the second playing window, so that the problem that the target area is cut may be avoided. Thereby enabling the screen to display the target area completely. The shaded area in fig. 4 is a clipped area, and the shaded area in fig. 4 and the screen display area together form the second play window.

In this embodiment, when the first ratio is greater than the second ratio, the first playing window is scaled to obtain a second playing window, and then, when the second playing window is aligned with the screen in the middle, whether the target region is located outside the screen display region is determined, and when the target region is located inside the screen display region and located outside the screen display region, two different alignment modes are adopted to align the second playing window with the screen, so that it is ensured that the screen display region can completely display the second video stream when the first ratio is greater than the second ratio.

Optionally, when the target alignment manner is a manner of aligning according to the first target edge, playing the composite video stream in the electronic device according to the target alignment manner includes:

aligning the second playing window with the screen in a centered alignment manner in the first direction, and aligning the second playing window with the screen in an aligned manner in the second direction according to the first target edge;

and playing the composite video stream in the second playing window.

Specifically, since the size of the second playing window in the first direction is matched with the size of the screen in the first direction, the second playing window may be aligned with the screen in the first direction in a centered alignment manner, so that two sides of the second playing window in the first direction may be ensured to be aligned with two sides of the screen in the first direction, respectively, and any one side of the second playing window in the first direction is prevented from extending out of the screen display area.

Meanwhile, the second playing window can be aligned with the screen in the second direction in a manner that the first target edge is aligned, so that the target area can be ensured to be located in the screen display area. Then, the composite video stream is played in the second playing window, and at this time, the electronic device can completely display the second video stream because the target area is located within the screen display area.

Correspondingly, when the target alignment mode is a centered alignment mode, playing the composite video stream in the electronic device according to the target alignment mode includes: aligning the second playing window with the screen in a centered alignment mode; and playing the composite video stream in the second playing window. Since the target area is located within the screen display area in this case, the electronic device can completely display the second video stream.

In this embodiment, in a case that the target alignment manner is a manner of aligning the first target edge, the second playing window is aligned with the screen in a centered alignment manner in the first direction, and the second playing window is aligned with the screen in a second direction in a manner of aligning the first target edge; and then, the composite video stream is played in the second playing window, so that the problem that the second video stream of the connecting terminal is cut in the playing process of the composite video stream in the electronic equipment can be avoided.

under the condition that the first ratio is smaller than the second ratio, zooming the first playing window until the size of the first playing window in the second direction is matched with the size of the screen in the second direction to obtain a zoomed third playing window;

under the condition that the third playing window is aligned with the screen in the middle, if the target area in the third playing window is located in the screen, determining that the target alignment mode is the center alignment mode; or, under the condition that the third playing window is aligned with the screen in the middle, if a second edge of the target region is located outside the screen, determining that the target alignment mode is a mode according to alignment of a second target edge of the third playing window, where the second edge is one edge of the target region along the first direction, and the second target edge is one edge of two parallel edges of the third playing window and the second edge, the edge being closest to the second edge.

When the first ratio is smaller than the second ratio, that is, the aspect ratio of the screen is smaller than the aspect ratio of the first playing window, in the process of scaling the first playing window, when the size of the first playing window in the height direction is scaled to be the same as the size of the screen in the height direction, the size of the first playing window in the width direction is smaller than the size of the screen in the width direction. At this time, the zoomed first playing window cannot fully cover the display area of the screen in the width direction. Therefore, the first playing window can be further enlarged, so that the size of the enlarged third playing window in the width direction matches with the size of the screen in the width direction. At this time, the size of the third playing window in the width direction is matched with the size of the screen in the width direction, and the size of the third playing window in the height direction is larger than the size of the screen in the height direction, so that the third playing window can be ensured to be capable of fully covering the display area of the screen, that is, the composite video stream can be ensured to be capable of fully covering the display area of the screen.

The above-mentioned size of the third playing window in the width direction matches with the size of the screen in the width direction, which may refer to: the difference between the width-directional size of the third playing window and the width-directional size of the screen is within a preset range, for example, the width-directional size of the third playing window may be the same as the width-directional size of the screen.

After the first playing window is zoomed to obtain a third playing window, the third playing window may be aligned with the screen in a centering alignment manner, at this time, two sides of the third playing window in the width direction (i.e., the second direction) are aligned with two sides of the screen in the width direction, and two sides of the third playing window in the height direction (i.e., the first direction) are located outside the display area of the screen. And the target area is located inside the third playing window, therefore, the display position of the target area needs to be further determined based on the target coordinate information to determine whether the screen can completely display the target area.

Specifically, whether two edges of the target area in the height direction are located within the screen display area may be determined according to the target coordinate information, and if two edges of the target area in the height direction are located within the screen display area, it may be determined that the target area is located within the display area of the screen. At this time, it may be determined that when the target area is aligned in the center alignment manner, the target area is not zoomed out of the screen display area, that is, when the composite video stream is played in the center alignment manner, the screen of the electronic device may completely display the second video stream of the microphone end, and therefore, the target alignment manner may be determined as the center alignment manner. For example, referring to fig. 5, when partial areas are cut at both the upper and lower ends of the third playing window, because the target area is still located in the screen display area, the target alignment mode may be determined as a center alignment mode, where the shaded area in fig. 5 is the cut area, and the shaded area in fig. 5 and the screen display area together form the third playing window.

Correspondingly, after the third playing window is aligned with the screen in the center alignment manner, if the second edge of the target area is located outside the display area of the screen, it indicates that when the third playing window is aligned in the center alignment manner, at least a partial area of the target area is zoomed out of the display area of the screen, that is, when the composite video stream is played in the center alignment manner, the electronic device cannot completely display the second video stream. At this time, since both sides of the third playing window parallel to the second side are located outside the screen display region, and the second side is also located outside the screen display region, a second target side located on the same side of the screen display region as the second side may be determined in both sides of the third playing window parallel to the second side. Since the second edge and the second target edge are located on the same side of the screen display area, the target area is close to the second target edge, and in this case, the target area can be located in the screen display area by aligning the third playing window with the screen according to the second target edge.

Specifically, two parallel sides of the third playing window and the second side are respectively located at two opposite sides of the screen display area, so that one of the two parallel sides of the third playing window and the second side is inevitably located at the same side of the screen display area as the second side. In this case, distances between two sides of the third playing window parallel to the second side and the second side may be calculated, respectively, and since one of the two sides of the third playing window parallel to the second side, which is located on the same side as the second side, is closer to the second side, the side closest to the second side of the two sides of the third playing window parallel to the second side may be determined as the second target side.

The aligning the third playing window and the screen according to the second target edge is as follows: and aligning one edge of the screen, which is positioned at the same side as the second target edge, with the second target edge. For example, referring to fig. 6, when the second target edge is the upper side of the third playing window, the upper side of the screen may be aligned with the upper side of the third playing window, that is, the target alignment manner is an upper end alignment manner, at this time, the upper side of the third playing window is not cut, only the lower side area of the third playing window is cut, and the target area is close to the upper side area of the third playing window, so that the problem that the target area is cut may be avoided. Thereby enabling the screen to display the target area completely. The shaded area in fig. 6 is a clipped area, and the shaded area in fig. 6 and the screen display area together form the third playback window.

Accordingly, referring to fig. 7, when the second target edge is the lower side edge of the third playing window, the lower side edge of the screen may be aligned with the lower side edge of the third playing window, that is, the target alignment mode is a lower end alignment mode, at this time, the lower side of the third playing window is not cut, only the upper side area of the third playing window is cut, and the target area is close to the lower side area of the third playing window, so that the problem that the target area is cut may be avoided. Thereby enabling the screen to display the target area completely. The shaded area in fig. 7 is a clipped area, and the shaded area in fig. 7 and the screen display area together form the third playback window.

In this embodiment, the first playing window is scaled to obtain a third playing window when the first ratio is smaller than the second ratio, and then, when the third playing window is aligned with the screen in the middle, whether the target area is located outside the screen display area is determined, and when the target area is located inside the screen display area and located outside the screen display area, two different alignment modes are adopted to align the third playing window with the screen, so that the second video stream can be completely displayed in the screen display area when the first ratio is smaller than the second ratio.

Optionally, when the target alignment manner is a manner of aligning according to the second target edge, playing the composite video stream in the electronic device according to the target alignment manner includes:

aligning the third playing window with the screen in the first direction according to the alignment mode of the second target edge, and aligning the third playing window with the screen in the second direction according to the alignment mode of the third playing window in the middle;

and playing the composite video stream in the third playing window.

Specifically, since the size of the third playing window in the second direction is matched with the size of the screen in the second direction, the third playing window may be aligned with the screen in the second direction in a centered alignment manner, so that two sides of the third playing window in the second direction may be ensured to be aligned with two sides of the screen in the second direction, respectively, and it is avoided that any one side of the third playing window in the second direction extends out of the screen display area.

Meanwhile, the third playing window can be aligned with the screen in the first direction in a manner that the second target edge is aligned, so that the target area can be ensured to be located within the screen display area. Then, the composite video stream is played in the third playing window, and at this time, the electronic device can completely display the second video stream because the target area is located within the screen display area.

Correspondingly, when the target alignment mode is a centered alignment mode, playing the composite video stream in the electronic device according to the target alignment mode includes: aligning the third playing window with the screen in a centered alignment mode; and playing the composite video stream in the third playing window. Since the target area is located within the screen display area in this case, the electronic device can completely display the second video stream.

In this embodiment, in a case that the target alignment manner is a manner of aligning according to the second target edge, the third playing window is aligned with the screen in the first direction in a manner of aligning according to the second target edge, and the third playing window is aligned with the screen in the second direction in a manner of aligning in the middle; and then, playing the composite video stream in the third playing window, so that the problem that the second video stream of the connecting terminal is cut in the playing process of the composite video stream in the electronic equipment can be avoided.

and determining that the target alignment mode is a centered alignment mode under the condition that the first ratio is equal to the second ratio.

Specifically, when the first ratio is equal to the second ratio, that is, when the aspect ratio of the screen is equal to the aspect ratio of the first playing window, in the process of scaling the first playing window, as shown in fig. 8, the first playing window can be scaled to be completely aligned with the screen display area by only aligning the first playing window with the screen in the center, and at this time, because the first playing window is completely aligned with the screen display area, the target area located inside the first playing window is necessarily located in the screen display area, so that the electronic device can be ensured to be able to completely display the second video stream of the microphone connecting terminal.

In this embodiment, in the case that the first ratio is equal to the second ratio, the electronic device can be ensured to completely display the second video stream of the microphone connecting end by aligning the composite video stream with the screen of the electronic device in a center alignment manner.

Optionally, after the composite video stream is played in the electronic device according to the target-aligned manner, the method further includes:

determining a display position of the target area in the screen based on the target coordinate information;

displaying target information at a preset position of the target area based on the display position of the target area in the screen, wherein the target information comprises at least one of the following information: target controls and target text information.

Specifically, in the embodiment of the present disclosure, the display position of the target area in the screen may be determined according to the target coordinate information, that is, the display position of the second video stream at the microphone end in the screen may be determined. Therefore, after the display position of the second video stream in the screen is determined, text information related to the microphone connecting end may be further displayed at a preset position of the target area, for example, target text information related to a nickname of a user of the microphone connecting end, whether the microphone connecting degree is a main broadcast focused by the user, a current popularity of a live broadcast room of the microphone connecting end, and the like may be displayed.

In addition, after the display position of the second video stream in the screen is determined, a target control for facilitating the user to operate the second video stream may be further displayed at a preset position of the target area, wherein the target control includes at least one of the following controls: closing a control, moving the control, amplifying the control, zooming out the control, hiding the control, displaying the control, capturing the screen control and the like. The closing control is used for closing the second video stream, the moving control is used for moving the display position of the target area in the screen, the amplifying control is used for amplifying and displaying the second video stream, the reducing control is used for reducing and displaying the second video stream, the hiding control is used for switching the second video stream from the display state to the hiding state, the display control is used for switching the second video stream from the hiding state to the display state, and the screen capture control is used for capturing the image of the second video stream displayed in the target area.

It can be understood that, when the target text information and the target control are displayed simultaneously, the target text information and the target control are displayed at different preset positions of the target area.

In this embodiment, the target text information is displayed at the preset position of the target area, which is beneficial for a user to determine the identity of the microphone connecting end based on the target text information, and meanwhile, the user can conveniently know the dynamic state of the live broadcast room of the microphone connecting end based on the target text information. In addition, the target control is displayed at the preset position of the target area, so that the user can conveniently operate the second video stream.

Referring to fig. 9, a schematic structural diagram of a video playing apparatus 900 according to an embodiment of the present disclosure is shown, where the video playing apparatus 900 includes:

an obtaining module 901, configured to obtain a composite video stream and target coordinate information, where the composite video stream includes a video stream formed by compositing a first video stream and a second video stream, and the target coordinate information includes: coordinate information of a first playing window when the composite video stream is in a playing state, and coordinate information of a target area in the first playing window, wherein the first playing window is used for playing the first video stream, and the target area is used for playing the second video stream;

a determining module 902, configured to determine a target alignment manner between the composite video stream and a screen of the electronic device based on the target coordinate information and screen size information of the electronic device;

a playing module 903, configured to play the composite video stream in the electronic device according to the target alignment manner, where the target area for playing the second video stream is in a screen display area of the electronic device.

Optionally, the screen size information includes a first ratio of a size of the screen in a first direction to a size of the screen in a second direction, and the determining module 902 includes:

a calculating submodule, configured to calculate a second ratio of the first playing window based on the target coordinate information, where the second ratio is a ratio of a size of the first playing window in the first direction to a size of the first playing window in the second direction;

a determining submodule, configured to determine the target alignment manner based on the first ratio and the second ratio.

Optionally, the determining sub-module includes:

a first scaling unit, configured to scale the first play window when the first ratio is greater than the second ratio until a size of the first play window in the first direction matches a size of the screen in the first direction, so as to obtain a scaled second play window;

a first determining unit, configured to determine, when the second playing window is aligned with the screen in the middle, that the target alignment mode is the center alignment mode if the target area in the second playing window is located within the screen; or, in a case that the second playing window is aligned with the screen in the middle, if the first edge of the target region is located outside the screen, determining that the target alignment mode is a mode of aligning according to a first target edge of the second playing window, where the first edge is one edge of the target region along the second direction, and the first target edge is one edge of two parallel edges of the second playing window and the first edge, which is closest to the first edge.

Optionally, the playing module 903 includes:

a first alignment sub-module, configured to align the second playing window with the screen in a centered alignment manner in the first direction, and align the second playing window with the screen in a first target edge alignment manner in the second direction;

and the first playing submodule is used for playing the composite video stream in the second playing window.

Optionally, the determining sub-module includes:

a second scaling unit, configured to scale the first play window when the first ratio is smaller than the second ratio until a size of the first play window in the second direction matches a size of the screen in the second direction, so as to obtain a scaled third play window;

a second determining unit, configured to determine, when the third playing window is aligned with the screen in the middle, that the target alignment mode is the middle alignment mode if the target area in the third playing window is located within the screen; or, under the condition that the third playing window is aligned with the screen in the middle, if a second edge of the target region is located outside the screen, determining that the target alignment mode is a mode according to alignment of a second target edge of the third playing window, where the second edge is one edge of the target region along the first direction, and the second target edge is one edge of two parallel edges of the third playing window and the second edge, the edge being closest to the second edge.

Optionally, the playing module 903 includes:

a second alignment sub-module, configured to align the third playing window with the screen in the first direction in a manner that the second target edge is aligned, and align the third playing window with the screen in the second direction in a manner that the third playing window is aligned in a centered manner;

and the second playing submodule is used for playing the composite video stream in the third playing window.

Optionally, the determining module 902 is configured to determine that the target alignment manner is a center alignment manner when the first ratio is equal to the second ratio.

Optionally, the apparatus further comprises:

a display module, configured to display target information at a preset position of the target area based on a display position of the target area in the screen, where the target information includes at least one of the following information: target controls and target text information.

It should be noted that the video playing apparatus 900 provided in this embodiment can implement all technical solutions of the video playing method embodiments, so that at least all technical effects can be implemented, and details are not described here.

In the technical scheme of the disclosure, the acquisition, storage, application and the like of the personal information of the related user all accord with the regulations of related laws and regulations, and do not violate the good customs of the public order.

The present disclosure also provides an electronic device, a readable storage medium, and a computer program product according to embodiments of the present disclosure.

FIG. 10 illustrates a schematic block diagram of an example electronic device 1000 that can be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 10, the electronic device 1000 includes a computing unit 1001 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM)1002 or a computer program loaded from a storage unit 1008 into a Random Access Memory (RAM) 1003. In the RAM 1003, various programs and data necessary for the operation of the device 1000 can also be stored. The calculation unit 1001, the ROM1002, and the RAM 1003 are connected to each other by a bus 1004. An input/output (I/O) interface 1005 is also connected to bus 1004.

A number of components in the electronic device 1000 are connected to the I/O interface 1005, including: an input unit 1006 such as a keyboard, a mouse, and the like; an output unit 1007 such as various types of displays, speakers, and the like; a storage unit 1008 such as a magnetic disk, an optical disk, or the like; and a communication unit 1009 such as a network card, a modem, a wireless communication transceiver, or the like. The communication unit 1009 allows the device 1000 to exchange information/data with other devices through a computer network such as the internet and/or various telecommunication networks.

Computing unit 1001 may be a variety of general and/or special purpose processing components with processing and computing capabilities. Some examples of the computing unit 1001 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The calculation unit 1001 executes the respective methods and processes described above, such as a video playback method. For example, in some embodiments, the video playback method may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as storage unit 1008. In some embodiments, part or all of the computer program may be loaded and/or installed onto device 1000 via ROM1002 and/or communications unit 1009. When the computer program is loaded into the RAM 1003 and executed by the computing unit 1001, one or more steps of the video playback method described above are performed. Alternatively, in other embodiments, the computing unit 1001 may be configured to perform the video playback method in any other suitable manner (e.g., by means of firmware).

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.

The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server with a combined blockchain.

It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel or sequentially or in different orders, and are not limited herein as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved.

The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.

Claims

1. A video playback method, comprising:

2. The method of claim 1, wherein the screen size information includes a first ratio of a size of the screen in a first direction to a size of the screen in a second direction, and wherein determining the target alignment between the composite video stream and the screen of the electronic device based on the target coordinate information and screen size information of the electronic device comprises:

3. The method of claim 2, wherein the determining the target alignment based on the first ratio and the second ratio comprises:

4. The method of claim 3, wherein, in the case that the target alignment mode is a mode aligned according to the first target edge, playing the composite video stream in the electronic device according to the target alignment mode comprises:

and playing the composite video stream in the second playing window.

5. The method of claim 2, wherein the determining the target alignment based on the first ratio and the second ratio comprises:

6. The method of claim 5, wherein, in the case that the target alignment mode is a mode of edge alignment according to the second target, playing the composite video stream in the electronic device according to the target alignment mode comprises:

and playing the composite video stream in the third playing window.

7. The method of claim 2, wherein the determining the target alignment based on the first ratio and the second ratio comprises:

8. The method of any of claims 1-7, wherein after playing the composite video stream in the electronic device in the target-aligned manner, the method further comprises:

9. A video playback apparatus comprising:

10. The apparatus of claim 9, wherein the screen size information includes a first ratio of a size of the screen in a first direction to a size of the screen in a second direction, the determining module comprising:

11. The apparatus of claim 10, wherein the determination submodule comprises:

12. The apparatus of claim 11, wherein the playback module comprises:

13. The apparatus of claim 10, wherein the determination submodule comprises:

14. The apparatus of claim 13, wherein the playback module comprises:

15. The apparatus of claim 10, wherein the determining module is configured to determine that the target alignment is a centered alignment if the first ratio is equal to the second ratio.

16. The apparatus of any of claims 9 to 15, wherein the apparatus further comprises:

17. An electronic device, comprising:

at least one processor; and

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-8.

18. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-8.

19. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-8.