WO2023185129A1

WO2023185129A1 - Display device, server, media resource continuous playback method, and screen mirroring method

Info

Publication number: WO2023185129A1
Application number: PCT/CN2022/141210
Authority: WO
Inventors: 赖园园; 陈效总; 佘祥顺; 薛梅; 庞秀娟
Original assignee: 聚好看科技股份有限公司
Priority date: 2022-03-30
Filing date: 2022-12-23
Publication date: 2023-10-05

Abstract

The present application provides a display device, a server, a media resource continuous playback method, and a screen mirroring method. The display device comprises a display and a controller connected to the display. The controller is configured such that: the display displays an exercise follow-along interface, wherein the exercise follow-along interface comprises a first window and a second window, the first window is used for playing a first video, and the second window is used for playing a third video obtained from the server.

Description

Display device, server, media asset streaming method and screencasting method

This application claims priority from Chinese patent applications with application number 202210334121.4 filed on March 30, 2022 and application number 202210743842.0 filed on June 27, 2022, the entire contents of which are incorporated into this disclosure by reference.

Technical field

The present application relates to the technical field of display devices, and in particular, to a display device, a server, a media asset streaming method, and a screen projection method.

Background technique

Smart TV is an important display device for people to watch TV series. In related technology, the video player on the smart TV has a continuous broadcast function and a function of skipping the beginning and end of the video. When the continuous broadcast function is turned on, the video player will automatically play the next episode of the TV series after playing one episode; when the skip opening and ending function is turned on, the video player will not play the opening and ending of each episode of the TV series. The video player has the continuous broadcast function and the skip opening and ending functions enabled by default. However, since people usually sit and stand when watching TV series, people tend to feel tired after watching multiple episodes of TV series continuously, which is not good for people's health.

Contents of the invention

Some embodiments of the present application provide a display device. The display device includes: a display; and a controller connected to the display. The controller is configured to: the display displays a follow-up training interface, wherein the follow-up training interface The interface includes a first window and a second window, the first window is used to play the first video, and the second window is used to play the third video obtained from the server.

Some embodiments of the present application provide a server, which is configured to: receive a query request sent by the display device when playing the first video, where the query request includes a user identification and playable duration; in response to the query request, Obtain the third video corresponding to the user identification from the follow-up video library; calculate the playback start time point and playback end time point of the third video according to the playable duration; send the third video containing the playback time to the display device. The media asset identification of the three videos, the playback start time point, and the media asset information of the third video at the playback end time point enable the display device to play the second video from the first time before the end of the first video. The video clip of the third video between the playback start time point and the playback end time point is also played within the second time, wherein the second video is the first video clip in the playback index table of the display device. The video corresponds to the video corresponding to the next item of the item, and the third video is a video that prompts the user to exercise.

Some embodiments of the present application provide a method for broadcasting media assets. The method includes: in response to the first window playing to the first time before the end of the first video, based on the existence of the corresponding item of the first video in the play index table. The next item is to start a second window on the layer above the first window to play the third video, where the first window is a full-screen window and the second window is a non-full-screen window. The next item Corresponding to the second video, the third video is a fitness video that prompts the user to exercise; in response to receiving a window switching instruction before the second window plays for a preset duration, the first video is removed from the Adjust the current progress of the first video to the second window to continue playing, adjust the current progress of the third video to the first window to continue playing, and play to the second window. At the second time of the second video, cancel the second window and adjust the first window to continue playing from the current progress of the second video; in response to playing the preset duration in the second window When the window switching instruction is not received, the second window is cancelled.

Some embodiments of this application provide a screencasting method, which includes:

In response to the received trigger instruction, a follow-up training interface is displayed, wherein the follow-up training interface includes a first window and a second window, the second window is used to play the fitness video obtained from the server; and receives the third training video sent by the terminal device. A video stream, wherein the first video stream is a video stream collected by the video recording device of the terminal device, and carries a symbol used to identify the posture of the terminal device when recording the video corresponding to the first video stream. Identification information; obtaining a scaling ratio according to the identification information, video playback parameters and the size of the first video stream, scaling the first video stream according to the scaling ratio to obtain a second video stream, and obtaining a second video stream according to the video Playback parameters and the size of the second video stream are used to obtain a layout offset parameter. The video playback parameters include the size of the first window and/or the preset video stream size; and the layout offset parameter is obtained based on the layout offset parameter. The two video streams are offset, and the offset second video stream is played in the first window.

Description of drawings

Figure 1 is a schematic diagram of an operation scenario between a display device and a control device according to some embodiments;

Figure 2 is a hardware configuration block diagram of the control device 100 according to some embodiments;

Figure 3 is a hardware configuration block diagram of the display device 200 according to some embodiments;

Figure 4 is a schematic diagram of software configuration in the display device 200 according to some embodiments;

Figure 5 is a schematic diagram of a home page of a display device according to some embodiments;

Figure 6 is a schematic flowchart of a method for broadcasting media assets according to some embodiments;

Figure 7 is a schematic flowchart of a method for broadcasting media assets according to some embodiments;

Figure 8 is a timing diagram of a media asset broadcast method according to some embodiments;

Figure 9 is a schematic interface diagram of a media asset details page according to some embodiments;

Figure 10 is a schematic diagram of the playback interface of the first episode according to some embodiments;

Figure 11 is a timing diagram after the display device receives the query result according to some embodiments;

Figure 12 is a schematic diagram of the playback interface of the first episode according to some embodiments;

Figure 13 is a schematic diagram of the playback interface of the follow-up video according to some embodiments;

Figure 14 is a schematic diagram of the playback interface of the second episode according to some embodiments;

Figure 15 is a timing diagram after the display device receives the query result according to some embodiments;

Figure 16 is a step flow chart of a screencasting method according to some embodiments;

Figure 17 is a step flow chart of a screen projection method according to other embodiments;

Figure 18 is a schematic diagram of the scene of the screen projection method shown in Figure 17;

Figure 19 is a schematic diagram of the screen projection method shown in Figure 17;

Figure 20 is a step flow chart of a screen projection method according to other embodiments;

Figure 21 is a schematic diagram of the screen projection method shown in Figure 20;

Figure 22 is a step flow chart of a screen projection method according to other embodiments;

Figure 23 is a schematic diagram of the scene of the screen projection method shown in Figure 22;

Figure 24 is a schematic diagram of the screen projection method shown in Figure 22;

Figure 25 is a step flow chart of a screen projection method according to other embodiments;

Figure 26 is a schematic diagram of the screen projection method shown in Figure 25;

Figure 27 is a step flow chart of a screen projection method according to other embodiments;

Figure 28 is a schematic diagram of the scene of the screen projection method shown in Figure 27;

Figure 29 is a schematic diagram of the screen projection method shown in Figure 27;

Figure 30 is a scene architecture diagram of a screen casting method according to some embodiments.

Detailed ways

Exemplary embodiments of the present application will be described below with reference to the accompanying drawings in some embodiments of the present application. Obviously, some of the described embodiments are only some of the embodiments of the present application, rather than all of the embodiments.

The display device provided by the embodiment of the present application can have a variety of implementation forms, for example, it can be a TV, a smart TV, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc. Figures 1 and 2 illustrate a specific implementation of the display device of the present application.

Figure 1 is a schematic diagram of an operation scenario between a display device and a control device according to some embodiments. As shown in FIG. 1 , the user can operate the display device 200 through the terminal device 300 or the control device 100 .

In some embodiments, the control device 100 may be a remote controller. The communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods to control the display device 200 through wireless or wired methods. The user can control the display device 200 by inputting user instructions through buttons on the remote control, voice input, control panel input, etc.

In some embodiments, a terminal device 300 (such as a mobile terminal, a tablet, a computer, a laptop, etc.) may also be used to control the display device 200 . For example, the display device 200 is controlled using an application program running on the terminal device.

In some embodiments, the display device may not use the above-mentioned terminal device or control device to receive instructions, but may receive user control through touch or gestures.

In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the terminal device 300. For example, the display device 200 can directly receive the user's voice command control through a module configured inside the display device 200 to obtain voice commands. , the user's voice command control can also be received through a voice control device provided outside the display device 200 .

In some embodiments, display device 200 also communicates data with server 400. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 can provide various content and interactions to the display device 200.

FIG. 2 is a configuration block diagram of the control device 100 according to some embodiments. As shown in Figure 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control device 100 can receive input operation instructions from the user, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, thereby mediating the interaction between the user and the display device 200 .

As shown in Figure 3, the display device 200 includes a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 285, a memory, a power supply, and a user input interface 280. At least one.

In some embodiments the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, first to nth interfaces for input/output.

The display 260 includes a display screen component for presenting images, a driving component for driving image display, a component for receiving image signals output from the controller, displaying video content, image content, menu control interface components, and a user control UI interface. .

The display 260 can be a liquid crystal display, an OLED display, a projection display, or a projection device and a projection screen.

The communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220 .

The user input interface 280 can be used to receive control signals from the control device 100 (such as an infrared remote control, etc.).

The detector 230 is used to collect signals from the external environment or interactions with the outside. For example, the detector 230 includes a light receiver, a sensor used to collect ambient light intensity; or the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures, or , the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

The external device interface 240 may include, but is not limited to, any of the following: high-definition multimedia interface (HDMI), analog or data high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. or multiple interfaces. It can also be a composite input/output interface formed by the above-mentioned multiple interfaces.

The tuner-demodulator 210 receives broadcast television signals through wired or wireless reception methods, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals.

In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. wait.

The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on display 260, controller 250 may perform operations related to the object selected by the user command.

Referring to Figure 4, in some embodiments, the system is divided into four layers. From top to bottom, they are the Applications layer (referred to as the "Application layer") and the Application Framework layer (referred to as the "Framework layer"). "), Android runtime and system library layer (referred to as "system runtime library layer"), and kernel layer.

In some embodiments, after the display device is started, the interface of the preset video on demand program can be directly entered. The interface of the video on demand program can be as shown in Figure 5, including at least a navigation bar 510 and a content display area located below the navigation bar 510. 520. The content displayed in the content display area 520 will change as the selected control in the navigation bar changes. Programs in the application layer can be integrated into the video on demand program and displayed through a control in the navigation bar, or can be further displayed after the application control in the navigation bar is selected. In Figure 5, the content display area 520 includes 12 media asset controls, corresponding to media asset 1-media asset 12 respectively.

In some embodiments, after the display device is started, it can directly enter the display interface of the last selected signal source, or the signal source selection interface, where the signal source can be a preset video on demand program, an HDMI interface, or a live TV interface. At least one of the following: after the user selects different signal sources, the display can display content obtained from different signal sources.

In some embodiments, the player of the video on demand program has a continuous broadcast function. After the continuous broadcast function is enabled, the player can automatically play the next episode of a media asset after playing one episode of the media asset. For example, for a TV series that contains multiple episodes, the player can automatically play the next episode after playing one of the episodes.

In some embodiments, the player of the video on demand program can not only broadcast multiple episodes of a single media asset, but also broadcast a media asset set containing multiple media assets. For example, for a media collection containing multiple videos, the video on demand program can automatically play the next video in the media collection after playing one video.

In some embodiments, the player of the video-on-demand program can also perform continuous playback of any number of videos. After playing one video, other videos recommended for the user can be played.

In some embodiments, the player of the video on demand program can enable the continuous broadcast function by default. Users may easily feel tired after watching multiple long videos continuously, such as multiple episodes of TV series, which is not good for people's health.

In order to solve the problem that people's continuous viewing of media assets is not good for their health, embodiments of the present application provide a media asset serial broadcast method. The media asset serial broadcast method is used for prompts by playing during the ending and opening times of two adjacent media assets. Videos of users exercising allow users to exercise between watching two media assets, thereby reducing the fatigue caused by sitting for long periods of time and improving the viewing experience.

In some embodiments, a video prompting the user to exercise may be delivered by the server.

In some embodiments, the video that prompts the user to perform exercise may be a follow-up video, and the follow-up video may be a video that the user has followed that day or a video in which the number of follow-up exercises by the user reaches a preset threshold within a preset period, for example, Videos that users have followed more than three times in the past week. If the user does not have a follow-up training record on the display device, the server can deliver popular follow-up training videos, such as the video with the largest number of follow-up training users that day.

In order to illustrate the media asset serial broadcasting method provided by the embodiment of the present application, this application takes the user to continuously watch multiple episodes of the same TV series as an example. Since the sum of the time between the end and the beginning of the two episodes of the TV series is usually 3 ~5 minutes, and people exercising within these 3 to 5 minutes can usually relieve the fatigue caused by sitting for a long time. It should be understood that this media asset cascading method can also be modified to adapt to other media asset cascading scenarios. For example, when multiple movies are broadcast in a row, since the opening or ending of one movie can be as long as 5 to 10 minutes or even longer, the total time of the opening and ending of two movies in a row can be as long as 10 to 20 minutes or even longer. If the user exercises for 10 to 20 minutes for a long time, the user may feel more tired. Therefore, in this scenario, a video to prompt the user to exercise can only be played at the beginning or end of a movie.

In some embodiments, some players have a function of automatically skipping the opening and ending credits. When playing to the end of a TV series, it will automatically jump to the main movie after the opening of the next episode of the TV series. If this function is turned on, it cannot be used. A video prompting the user to exercise is played at the beginning and end of the film. In addition, if the continuous broadcast function is not turned on, the player will not continue to play after playing an episode of TV series. At this time, the user may not have the need to exercise. If a video is played that prompts the user to exercise, it may give the user a bad impression. experience. Therefore, in order to ensure the smooth implementation of the embodiments of this application, for players that can turn off the function of skipping the opening and ending credits and enable the continuous broadcast function, the user can manually set to turn off the function of skipping the opening and ending credits and enable the continuous broadcast function, or the player can also The default setting is to turn off the skipping of opening and ending credits and enable the continuous broadcast function.

In some embodiments, the player of the video on demand program is configured to be able to turn off the function of skipping the opening and ending credits and enable the continuous broadcast function.

In some embodiments, some versions of the video on demand program may not support the media asset cascading method provided by the embodiments of this application. After the version is upgraded, the video on demand program will support the media asset cascading method provided by the embodiments of this application. In order to prompt the user to experience the media asset cascading method of the embodiment of the present application, when the user enters the video on demand program for the first time after the version upgrade, the video on demand program may prompt the user to turn on the cascading function to experience the beginning and end of the media asset cascade. Physical exercise.

The following takes a user watching two episodes of a TV series as an example to introduce the media asset serial broadcast method provided by the embodiment of the present application. Referring to Figure 6, the media asset broadcast method provided by the embodiment of the present application includes the following steps:

Step S101: When the first window is played to the first time before the end of the first video, according to the next item corresponding to the first video in the play index table, start the layer above the first window The second window is used to play the third video, wherein the first window is a full-screen window, the second window is a non-full-screen window, the next item corresponds to the second video, and the third video prompts the user Video of doing exercise.

In some embodiments, an episode of a TV series that the user is watching may be called a first video, the next episode may be called a second video, and a video that prompts the user to exercise may be called a third video. The details page data of the TV series may be set with a play index table. The play index table is set with multiple items, each item corresponding to an episode. The video on demand program is configured to continuously play the episodes of the TV series according to the play index table.

In some embodiments, the main thread of the video on demand program may be configured to start multiple players and control each player independently. The player used to play episodes of the TV series may be called a first player, and the player used to play the third video may be called a second player.

In some embodiments, the main thread of the video on demand program may be configured to start multiple windows and control the content displayed in each window respectively. One of the windows may be a full-screen window, and the full-screen window may be called the first window. The other window may be a non-full-screen window, and the non-full-screen window may be called the second window. The second window may be located in a layer above the first window. , thus occluding the first window.

In some embodiments, one player can launch multiple playback windows and control each player independently.

In some embodiments, when the user enters an episode of a TV series, the main thread of the video on demand program can start the first window and the first player, and play the content of the first player in the first window, that is, play the first window. Divide the episodes and monitor the playback progress in real time. For example, after the user clicks on the first episode, the video on demand program can play the first episode in the first window.

When the playback progress of the episode is detected to be the preset progress of the episode, such as playing to 50%, or there are 10 seconds left before the end of the video, the main thread of the video on demand program can request information about the third video from the server. The video on demand program can calculate the playable duration of the third video based on the ending duration of the first video and the opening duration of the second video, and send the playable duration and the user ID logged in to the video on demand program to the server, where the first The ending length of the video and the opening length of the second video can be obtained from the data on the media asset details page of the TV series issued by the server. The server can determine a third video based on the playable duration and the user identification, and return the media asset information of the third video to the video on demand program on the display device. The media asset information may include the playback address of the third video, so that the main thread can obtain the video stream of the third video from the playback address. Alternatively, the media asset information may include the media asset identifier of the third video, so that the main thread may request the video stream corresponding to the media asset identifier from the server.

When it is detected that the playback progress of the first window is the first time before the end of the first video, such as 3 seconds before the end of the first video, the main thread can generate a layer containing the second window and start the second player. , and then obtain the code stream of the third video from the server. After obtaining the code stream, play the content of the second player in the second window, that is, play the decoded image of the third video. The second window can be located at the top of the first window. A small window window is formed to form a picture-in-picture playback mode. The volume of the second window can be smaller than the volume of the first window and greater than 0, so that the user can pay attention to the second window.

In some embodiments, the first window and the second window may not form a picture-in-picture. For example, the first window may be adjusted to occupy the left half of the display screen, and the second window may be set to occupy the right half of the display screen. .

Step S102: If a window switching instruction is received before the second window is played for the preset duration, adjust the first video from the current progress of the first video to the second window to continue playing, and the The third video is adjusted from the current progress of the third video to the first window to continue playing. When the second window is played to the second time of the second video, the second window is cancelled, and all The first window is adjusted to continue playing from the current progress of the second video.

In some embodiments, after the second window has been played for a preset time, such as 20 seconds, if the user presses the menu key on the remote control, a window switching instruction can be issued to the video on demand program, and the main thread of the video on demand program can switch according to the window The switching instruction switches the playback content of the second window to the playback content of the first window, switches the playback content of the first window to the playback content of the second window, and causes the first player to change the current content of the first video. The progressed image is played in the second window, and the second player plays the currently progressed image of the third video in the first window, achieving the visual effect of switching the content of the two windows, wherein, The second window continues to play the ending of the first video. After the ending of the first video is played, the second window automatically starts playing the opening of the second video. To ensure the effectiveness of follow-up training, the main thread can mute the second window.

Before receiving the window switching instruction, the video on demand program may control the volume of the second window to be smaller than the volume of the first window, for example, set the volume of the second window to be equal to the volume of the first window. Related, the user can notice that the third video is playing in the second window; after receiving the window switching instruction, the video on demand program can mute the second window so that the user can concentrate on practicing.

When it is detected that the playback progress of the second window is the second time before the end of the title of the second video, such as 3 seconds before the end of the title, the main thread of the video on demand program can cancel the second window and change the playback of the first window. The content is switched to the content of the first player, so that the second video resumes playing in the first window.

When it is detected that the playback progress of the first window is the second time before the end of the title of the second video, for example, 3 seconds before the end of the title, the main thread of the video on demand program can cancel the second window and close the second player.

If the user wants to stop practicing while following the third video, he can issue a window switching instruction to the video on demand program again. The main thread of the video on demand program can cancel the second window and close the second player according to the window switching instruction. , and switches the playback content of the first window to the playback content of the first player.

In some embodiments, according to the window switching instruction, the main thread of the video on demand program does not exchange the contents of the second window with the first window, but enlarges the second window and shrinks the first window. For example, displaying the second window in full screen, reducing the first window to a small window that is not full screen, and setting the small window at the top of the second window can also achieve the visual effect of switching the contents of the two windows. To ensure the effect of follow-up training, the main thread can increase the volume of the second window and mute the first window.

When it is detected that the playback progress of the first window is the second time before the end of the title of the second video, for example, 3 seconds before the end of the title, the main thread of the video on demand program can close the second window and close the second player. And restore the first window to a full-screen window, and restore the volume of the first window to the volume before the second window was started.

If the user wants to stop practicing while following the third video, he can issue a window switching instruction to the video on demand program again. The main thread of the video on demand program can close the second window and the second player according to the window switching instruction. , and restore the first window to a full-screen window, and restore the volume of the first window to the volume before the second window was started.

Step S103: If the window switching instruction is not received when the second window is played for a preset duration, cancel the second window.

In some embodiments, if the user is not interested in the third video played in the second window and does not press the menu button of the controller within the preset playing time of the second window, such as 20 seconds, the video on demand program The main thread can cancel the second window and close the second player so that the first window is no longer blocked by the second window, thereby no longer disturbing the user's viewing of the video in the first window.

It can be seen from the above embodiments that the media asset serial broadcast method provided by the embodiment of the present application can promote users to actively exercise by playing videos prompting users to exercise during the ending and opening periods of two serial videos, and can reduce the symptoms caused by sitting for long periods of time. Symptoms of physical discomfort and make viewing the display more interesting and enhance the viewing experience.

Figure 7 also shows a schematic flow chart of a method for broadcasting media assets. As shown in Figure 7, the method includes the following steps:

Step S201: Receive the triggering instruction of the media asset control and enter the media asset details page.

In some embodiments, the user can click a media asset control on the media asset recommendation page, and the main thread of the video on demand program on the display device can generate a trigger instruction for the media asset control, and request the media asset details page from the server according to the trigger instruction. The interface data, and the media asset details page is displayed based on the interface data.

Step S202: Receive the diversity on-demand instruction and start the first window to play the diversity.

In some embodiments, if the media asset corresponding to the media asset control clicked by the user on the media asset recommendation page contains multiple episodes, the media asset details page may display the episode controls corresponding to the multiple episodes. The user clicks an episode control, and the video The main thread of the on-demand program can generate an episode-on-demand instruction, start the first window and the first player according to the episode-on-demand instruction, and play the video code stream of the episode through the first window. The episode being played can be called the first video. The next episode of the episode may be called the second video.

Step S203: Calculate the playable duration of the third video.

In some embodiments, the main thread of the video on demand program can calculate the playable duration of the third video before the first player plays to the end of the first video, for example, 50 seconds after the first player plays to the end of the first video. %, calculate the playable duration of the third video.

Step S204: Query the media asset data of the third video.

In some embodiments, after calculating the playable duration, the main thread of the video on demand program can send a query request containing the playable duration and the user ID of the video on demand program login account to the server to query the media asset data of the third video. , the media asset data may include the playback address or media asset identification of the third video.

In some embodiments, the third video is a video that the user has followed. If the server queries for a follow-up video whose video duration is less than or equal to the playable duration, it can send the media asset data of one of the follow-up videos to the display device. If it does not find a follow-up video whose video duration is less than or equal to the playable duration, it can , the media asset data of the follow-up video will not be returned to the display device.

In some embodiments, the server obtains a follow-up video whose video duration is greater than or equal to the playable duration from all follow-up videos corresponding to the user ID, and then calculates the playback start time point startTime and the playback start time point of the follow-up video based on the playable duration. The playback end time point endTime of the follow-up video enables the display device to play the video clips between the playback start time point startTime and the playback end time point endTime of the follow-up video.

In some embodiments, the server obtains a video that the user has practiced on that day or a video that the user has practiced with for a number of times reaching a preset threshold within a preset period from all the training videos corresponding to the user ID.

Step S205: When the end of the video is about to be played, determine whether the media asset data of the third video has been received.

In some embodiments, when the first video is about to play to the end, for example, when the third second of the end of the video is played, the main thread of the video on demand program may determine whether the media asset data of the third video has been received.

Step S206: If the media asset data of the third video is received, start the second window to play the third video.

In some embodiments, if the media asset data of the third video has been received at the 3rd second of the end credits, the main thread of the video on demand program can start the second window and the second player, and start the second window from the third video. Extract the playback address from the media asset data, access the playback address to obtain the code stream data of the third video, and play the third video through the second window. The second window is a small window that can be overlaid on the first window.

Step S207: Determine whether a window switching instruction is received within a preset time.

In some embodiments, after the second window is started, the main thread of the video on demand program can set a timeout task, and the timeout period of the timeout task can be set to 20 seconds. At some point within these 20 seconds, if the window If the window switching instruction is received, the timeout task will end at that moment. If the window switching instruction is not received, the timeout task will end after 20 seconds.

Step S208: If the window switching instruction is received within the preset time, switch the playback content in the second window to the first window for display.

In some embodiments, if a window switching instruction is received within 20 seconds, the main thread of the video on demand program adjusts the first window to display the playback content of the second player.

Step S209: Switch the playback content in the first window to the second window for display.

In some embodiments, if a window switching instruction is received within 20 seconds, the main thread of the video on demand program will also adjust the second window to display the playback content of the first player. In order to ensure the playback effect of the first window, the main thread of the video on demand program can lower the volume of the second window, or directly adjust the volume of the second window to mute.

Step S210: When the title is about to be played, switch the playback content in the second window to the first window for display.

In some embodiments, when the first window is about to finish playing the title of the second video, for example, when there are 3 seconds left until the end of playing the title, the main thread of the video on demand program switches the playback content of the second window to the first window for display. .

In some embodiments, since the duration of the third video is less than the sum of the ending duration of the first video and the opening duration of the second video, after the third video is played, the playback content of the second window can be switched to the first Window display.

Step S211: Cancel the second window.

In some embodiments, after the first window is displayed in full screen again, the second window can be dismissed.

Step S212: When the timeout expires, cancel the second window.

In some embodiments, if the user's window switching instruction is not received within 20 seconds of playing the second window, the second window can be cancelled.

In some embodiments, if a return instruction or exit instruction is received while the first window is playing the third video, the playback content in the second window can be switched to the first window for display, and the second window can be cancelled.

The following will introduce the method of media asset cascading starting from the user ordering a media asset in Figure 5.

Referring to Figure 8, a schematic sequence diagram of a media asset broadcasting method according to some embodiments is shown. As shown in Figure 8, the server can be provided with a terminal-oriented module, a film and television database, and a follow-up video library.

In some embodiments, the terminal-oriented module is used to interact with the display device and other modules of the server (such as the film and television database and the training video library). The terminal-oriented module can be provided with multiple interfaces with different functions, so that the display device can obtain different data through different interfaces.

In some embodiments, the film and television database is provided with media asset data of a large number of film and television media assets such as TV series and movies. The media asset data of each media asset may include media asset identification, detail page data and title and ending data, where the media asset identification It is a media asset ID. The details page data can include media asset name, media asset duration, playback index table and playback address. The title and tail data can include headLength (title duration), tailLength (end duration), media asset duration, title Duration and ending duration are both in seconds.

In some embodiments, the film and television database and the training video database may also be collectively referred to as the media asset information database.

Steps S3001 and S3002: After the user clicks on a media asset control in Figure 5, the display device can obtain the media asset ID corresponding to the media asset control, generate a media asset details request including the media asset ID, and then send a request to the terminal. The module's "video details query interface" /vod/media/detail sends the media asset details request. Among them, the media asset corresponding to the media asset control clicked by the user can be called the target media asset. The target media asset can be a media asset set including multiple episodes. The media asset details request includes the media asset identification of the target media asset. The media asset The identifier may be a media asset ID.

Step S3003 to step S3005: After receiving the media asset details request through the video details query interface, the terminal-oriented module can query the media asset information database for the media asset details data corresponding to the media asset ID and the title and ending data, and combine the media asset details data with The title and ending data is returned to the display device.

Step S3006: After receiving the media asset detail data and the title and ending data, the display device can display the media asset details page according to the media asset detail data. Referring to Figure 9, the media asset details page can display multiple episode controls, and each episode control corresponds to one episode.

Steps S3007 and S3008: After the user clicks a diversity control on the media asset details page, the display device can generate an on-demand request corresponding to the diversity control and send the on-demand request to the terminal-oriented module. For convenience of description, the episode requested by the user can be called the first episode. The first episode can be any episode except the last episode of the target media asset. The first episode can also be called the first video. The first episode can also be called the first video. The next episode of one episode is the second episode, and the second episode can also be called the second video. The on-demand request for the first episode may include a media asset identifier of the target media asset and a diversity identifier of the first episode, and the diversity identifier may be a diversity sequence number.

Steps S3009 to S3011: After the terminal-oriented module receives the on-demand request for the first episode, the media asset information library can obtain the video stream data of the first episode based on the media asset identifier and the episode identifier, and return the video of the first episode to the terminal-oriented module. stream data, and then the terminal-facing module returns the video stream data of the first episode to the display device.

Step S3012: The display device can start the first player to parse the video stream data of the first episode, and then play the first episode through the first window. Referring to FIG. 10 , a schematic diagram of the playback interface of the first episode according to some embodiments is shown. As shown in FIG. 10 , for example, the playback duration of the first episode is 46 minutes.

Step S3013: After starting the first window, the display device monitors the playback progress of the first window in real time. When the playback progress is the preset progress, for example, when the playback progress is 50%, that is, when the 23rd minute has been played, or there are 10 seconds left before the end of the first episode, the recommendation process of the follow-up video is started. The recommendation process of following training videos can be used to obtain information about following training videos from the server. The main thread of the video on demand program can synchronize the playback progress of the first window with the recommendation process of the follow-up video in real time, so that the recommendation process of the follow-up video can start and cancel the second window and the first window according to the playback progress of the first window. Actions such as switching the content played in the second window.

In some embodiments, the recommendation process of the follow-up video may not be set, and the main thread of the display device obtains the information about the follow-up video from the server and performs the startup and cancellation of the second window, and the playback of the content in the first window and the second window. switch.

Step S3014: After the recommendation process of the follow-up video is started, the playback duration of the first episode can be obtained from the details page data of the target media asset. If the playback duration is less than the threshold duration, such as 5 minutes, the recommendation process of the follow-up video will automatically End, to avoid playing the follow-up video when the first episode's playback time is short, which would have a negative impact on the user's continuous viewing of the first and second episodes. If the playback time is longer than 5 minutes, you can calculate the ending duration of the first episode and the opening duration of the second episode, calculate the sum of the ending duration and the opening duration, and then subtract an offset of 5 seconds to get the length of the follow-up video timeLength (playable duration). If the playable duration is greater than 0, the subsequent logic of the follow-up video recommendation process will continue to be executed. If the playable duration is less than or equal to 0, the follow-up video recommendation process will automatically end.

Step S3015: If the playable duration is greater than 0, the recommendation process of the follow-up video can generate a query request for the follow-up video. The query request for the follow-up video includes a user ID and a playable duration, where the user ID can be customerId. After generating the query request for the follow-up video, the recommendation process of the follow-up video can send the query request for the follow-up video to the "Fitness Follow-Up Recommended Clips" query interface /vod/media/gym/recom in the follow-up video library to obtain Follow the training video information.

Steps S3016 to S3018: The terminal-oriented module can query the playback record of the follow-up video corresponding to the user ID, obtain the follow-up video that the user has practiced the most in the recent period based on the playback record, and calculate the playback time based on the display device to play the video. Follow the starting point and end point of the media asset, and then send the query results containing the media asset data of the follow-up video to the display device. Among them, the difference between the starting point and the end point is the same as the playable duration. The starting point can be called the playback start time point startTime, which can be the 0th second of the follow-up video. The end point can be called the playback end time point endTime. The end point can be based on The sum of the starting point and playable duration is obtained. The most recent period can be the last week or the current day. The media asset data of the follow-up video includes the media asset identifier gymVideoId, playback start time point startTime, and playback end time point endTime of the follow-up video.

In some embodiments, the terminal-oriented module can query the playback records of the follow-up videos corresponding to all users, thereby obtaining the most popular follow-up videos in the recent period, and calculate the starting point for the display device to play the follow-up media assets based on the playable duration. and the end point, and the query results containing the media asset data of the training video are sent to the display device, where the latest period of time can be the last week or the current day.

In some embodiments, the terminal-oriented module can query follow-up videos whose duration and playable duration are within a preset difference range, and filter out a follow-up video to be issued from the queried follow-up videos based on user interest tags. video, calculate the starting point and end point of the display device playing the follow-up media assets to be distributed based on the playable duration, and deliver the query results containing the media asset data of the follow-up videos to be distributed to the display device, where the user Interest tags can be generated based on videos that users have followed.

In some embodiments, if the terminal-oriented module cannot query the follow-up video, it will return the query result of the media asset data that does not include the follow-up video to the display device.

In some embodiments, after receiving the query result, the recommendation process of the follow-up video will end the recommendation process of the follow-up video if the query result does not contain the media asset data of the follow-up video.

In some embodiments, after receiving the query result, the recommendation process of the follow-up video continues to execute the recommendation process of the follow-up video if the query result contains the media asset data of the follow-up video.

Refer to Figure 11, which is a timing diagram after the display device receives the query result according to some embodiments. As shown in Figure 11, step S4001 and step S4002: the user inputs a window switching instruction. If the query result contains the media asset data of the follow-up video, the recommendation process of the follow-up video will be directed to the terminal when the end of the first episode is about to be played. The module sends an on-demand request for the training video. For example, when the playback reaches 3 seconds before the end of the first episode, an on-demand request for the follow-up video is generated and sent to the terminal-oriented module. The on-demand request for a follow-up video includes the gymVideoId, the media asset identifier of the follow-up video, the playback start time point startTime, and the playback end time point endTime.

Steps S4003 and S4004: After receiving the on-demand request for the follow-up video, the terminal-oriented module queries the video stream data between the playback start time point startTime and the playback end time point endTime corresponding to the media asset identifier gymVideoId from the follow-up video library, and This video stream data is returned to the display device.

Steps S4005 and S4006: After receiving the video stream data of the follow-up video, the recommendation process of the follow-up video starts the second window to play the follow-up video based on the video stream data. Referring to Figure 12, the second window may be a small window located in the upper right corner of the first window, blocking part of the display screen of the first window. The volume of the second window may be smaller than the volume of the first window to reduce interference with the playback effect of the first window.

In some embodiments, the second window in Figure 12 displays a prompt to press the menu key to follow the practice in full screen, so as to prompt the user to press the menu key to display the second window in full screen.

In some embodiments, the volume of the second window may be positively correlated with the volume of the first window to prevent the user from ignoring the sound of the second window due to the excessive volume of the first window.

Step S4007: When starting the second window of the recommendation process of following the training video, a timeout task can be started. The timeout period corresponding to the timeout task can be 20 seconds. During the timeout period, user operations are monitored. Monitored user operations may include inputting a window switching instruction. If within the timeout period, it is detected that the user operation is to enter a window switching command, the system will respond to the command and end the timeout task.

In some embodiments, the user inputs the window switching instruction by pressing the confirmation key or the menu key of the remote control.

Steps S4008 and S4009: The response of the recommendation process of the follow-up video to the switching window instruction is: adjust the first window to display the playback content of the second player, and adjust the second window to display the playback content of the first player. . The above two steps can be executed at the same time or in sequence. When executed in sequence, the above two steps are not in any order. Adjusting the first window to display the playback content of the second player, and adjusting the second window to display the playback content of the first player realizes the visual exchange of the playback content of the two windows. After the volume of the second window is turned down, the audio of the second window becomes the background music of the first window. Alternatively, the volume of the first window can be turned down to mute to reduce the playback effect on the second window. interference.

Referring to Figure 13, when the user inputs a window switching instruction, the playback content of the second window and the playback content of the first window are interchanged.

In some embodiments, when the first window plays the third video, the user can follow along according to the playing content of the first window.

In some embodiments, the second window in FIG. 13 displays a prompt to press the menu key to continue watching the video, so as to prompt the user to press the menu key to exchange the playing content of the second window with the playing content of the first window. For example, the menu key can also be replaced by a return key or other keys.

In some embodiments, if the user does not want to continue practicing after practicing for a period of time, he or she can press the return key on the remote control to input an exit command to the display device. Upon receiving the exit instruction, the display device switches the playback content of the first window to the playback content of the second player, cancels the second window, and ends the recommendation process of the follow-up video.

Step S4010: When the second window plays the first episode, and after playing the end of the first episode, the main thread of the display device can send an on-demand request for the second episode to the terminal-oriented module, or the display device can also send an on-demand request for the second episode to the terminal-oriented module. When the episode begins to play the end of the episode or when the end of the episode is about to be played, an on-demand request for the second episode is sent to the terminal-oriented module. The on-demand request for the second episode may include the media asset identifier of the target media asset and the episode sequence number corresponding to the second episode.

Steps S4011 and S4012: After receiving the on-demand request for the second episode, the terminal-oriented module may obtain the video stream data of the second episode from the media asset information library and return the video stream data of the second episode to the display device.

Steps S4013 and S4014: After receiving the video stream data of the second episode, the main thread of the display device can play the video stream data of the second episode after the end of the first episode is played.

Step S4015: When the title of the second episode is about to be played, the playback content of the second window and the first window can be exchanged.

In some embodiments, since the playable duration of the follow-up video is less than the sum of the ending duration of the first episode and the opening duration of the second episode, after the follow-up video is played, the opening of the second episode may not be played. Finished, at this time, the playback content of the second window and the first window can be exchanged, and the second window can be cancelled.

Step S4016: When playing the feature film of the second episode, the second window is canceled and no longer blocks the display content of the first window. See the window shown in Figure 14.

Refer to Figure 15, which is a timing diagram after the display device receives the query result according to some embodiments. As shown in Figure 15, if the query result contains the media asset data of the follow-up video, after the display device starts the timeout task to monitor the user operation, step S40071 is executed: if no user operation is received within the timeout period, the second window is cancelled.

After step S4013 returns the video stream data of the second episode, step S4017 is executed: playing the second episode in the first window.

It can be seen from the above embodiments that the embodiment of the present application starts playing the third video prompting the user to exercise through the second window when the first window plays the end of the first video, which is beneficial to promoting the user to perform physical exercise, and the third video can be sustainable Playing until the end of the second video's title is helpful to ensure the user's exercise time; the user can use the window switching command to switch the third video in the second window to the first window for display, or do not perform the operation to make the second window display in the first window. Automatically exiting after playing for a period of time can meet the different needs of users for physical exercise and improve the user experience of watching continuous media resources.

In addition to generally watching videos on TV, people can also watch videos on mobile phones, tablets, computers, laptops and other such terminal devices with display screens. According to some embodiments, the above media asset streaming method is also applicable on the above terminal equipment. In addition, according to some embodiments, people can also cast the video on the above terminal device to a display device such as a television for viewing.

However, the aspect ratios of TV and mobile phone screens are generally very different, and mobile phones can capture videos in various postures such as horizontal screen recording and vertical screen recording. Therefore, the projected videos sent by mobile phones are often different from those used for playing projections on TVs. The video playback window of the screen video does not match, which leads to problems such as incomplete video images and imbalanced proportions, seriously affecting the user experience. Therefore, when the TV receives the screen projection video stream sent by the mobile phone, how to adjust the screen projection video stream so that the screen projection video stream can adapt to the video playback window is an urgent problem to be solved.

In some embodiments, the controller 250 displays a follow-up interface on the display 260 in response to the received trigger instruction, wherein the follow-up interface includes a first video playback window and a second video playback window (also called (as a first window and a second window), the second video window is used to play the fitness video obtained from the server;

In some embodiments, when the controller 250 receives the first video stream generated by the terminal device based on its video recording device sent by the terminal device through the communicator 220, the controller 250 uses the identification information, video playback parameters and The size of the first video stream is used to obtain a scaling ratio, the first video stream is scaled according to the scaling ratio to obtain a second video stream, and the layout is obtained according to the video playback parameters and the size of the second video stream. Offset parameter: offset the second video stream based on the layout offset parameter, and control the display 260 to play the offset second video stream in the first video window.

In some embodiments, the identification information includes: a first gesture identification or a second gesture identification; when the identification information includes a first gesture identification, the identification information is used to identify the terminal device to record the first gesture. The posture when recording the video corresponding to the video stream is the portrait posture; when the identification information includes a second posture identification, the identification information is used to identify the posture when the terminal device records the video corresponding to the first video stream. Horizontal posture. Wherein, the video playback parameters corresponding to the first gesture identification and the video playback parameters corresponding to the second gesture identification are different.

In some embodiments, when the identification information is used to identify that the posture of the terminal device when recording the video corresponding to the first video stream is a portrait posture, the controller 250 adjusts the posture of the terminal device according to the scaling ratio. The first video stream is scaled to obtain the second video stream, and the layout offset parameter is obtained according to the video playback parameter and the size of the second video stream, including: the controller 250 according to the width of the first video stream. and the target width to obtain the first scaling ratio; the target width is the width of the first video playback window or the width of the preset video stream size;

Scale the first video stream using the first scaling ratio to obtain the second video stream; obtain a first layout offset according to the height of the second video stream and the height of the first video playback window parameter;

The controller 250 offsets the second video stream based on the layout offset parameter, including the controller offsets the second video stream in a height direction based on the first layout offset parameter. shift.

Wherein, the first scaling ratio is the ratio of the target width to the width of the first video stream; the first layout offset parameter is the height of the second video stream to the first video playback window. half the difference in height.

In some embodiments, when the identification information is used to identify that the posture of the terminal device when recording the video corresponding to the first video stream is a horizontal screen posture,

The controller 250 obtains a scaling ratio according to the identification information, video playback parameters and the size of the first video stream, and scales the first video stream according to the scaling ratio to obtain a second video stream, including:

The controller 250 obtains the second scaling ratio according to the height of the first video stream and the target height; the target height is the height of the first video playback window or the height in the preset video stream size; using the The second scaling ratio scales the first video stream to obtain the second video stream;

The controller 250 obtains the layout offset parameter according to the video playback parameter and the size of the second video stream, including: the controller 250 obtains the layout offset parameter according to the width of the second video stream and the width of the first video playback window. , obtain a second layout offset parameter; and offset the second video stream in the width direction based on the second layout offset parameter. Wherein, the second scaling ratio is the ratio of the target height to the height of the first video stream; the second layout offset parameter is the width of the second video stream and the first video play window half the difference in width.

In some embodiments, the communicator 250 offsets the second video stream based on the layout offset parameter, and controls the display to play the offset second video in the first video window. After streaming, the controller 250 is also configured to:

In response to the received trimming and playback instruction, a third zoom ratio is obtained according to the size of the selected area and the size of the first video playback window; the trimming and playback instruction carries the size of the selected area and the size of the selected area. The position information of a certain area is used to indicate video playback based on the video content of the first video stream in the selected area; the third scaling ratio is the smaller of the first ratio and the second ratio, The first ratio is the ratio of the height of the first video playback window to the height of the selected area, and the second ratio is the ratio of the width of the first video playback window to the width of the selected area. ratio;

Use the third zoom ratio to zoom the first video stream to obtain a third video stream; according to the third zoom ratio, the width of the first video playback window, the position information of the selected area and the Obtain the third layout offset parameter based on the width of the selected area; obtain the third layout offset parameter according to the third scaling ratio, the height of the first video playback window, the position information of the selected area, and the height of the selected area. Four layout offset parameters;

Video playback is performed in the first video playback window based on the third video stream, and the third video stream is offset in the width direction based on the third layout offset parameter. Based on the fourth The layout offset parameter offsets the third video stream in the height direction, and controls the display to play the offset third video stream in the first video window.

In some embodiments, the controller 250 obtains a third layout bias according to the third zoom ratio, the width of the first video playback window, the position information of the selected area, and the width of the selected area. Shift parameters, including:

The controller 250 calculates the third layout offset parameter through the following formula 1:

The first formula is: CLIP ₃ = (X+select_w/2)*R3-WL/2;

The controller 250 obtains a fourth layout offset parameter according to the third zoom ratio, the height of the first video playback window, the position information of the selected area, and the height of the selected area, including: The controller 250 calculates the third layout offset parameter through the following formula 2:

The second formula is: CLIP ₄ = (Y+select_h/2)*R3-HL/2;

Wherein, CLIP ₃ is the third layout offset parameter, CLIP ₄ is the fourth layout offset parameter, and X is the distance from the left edge of the selected area to the left edge of the first video stream. , Y is the distance from the top edge of the selected area to the top edge of the first video stream, select_w/2 and select_h/2 are the width and height of the selected area respectively, and R3 is the Three scaling ratios, WL and HL are the width and height of the first video playback window respectively.

Figure 16 is a schematic flowchart of a screen casting method provided according to some embodiments of the present application. As shown in Figure 16, the screen casting method provided by embodiments of the present application includes the following steps:

S51. Receive the first video stream sent by the terminal device.

Wherein, the first video stream is a video stream obtained through video collection by a video recording device of the terminal device, and carries an identifier used to identify the posture of the terminal device when recording the video corresponding to the first video stream. information.

In some embodiments, the first video stream may be a video stream that is recorded in real time by the terminal device through a video recording device and sent to the display device. In other embodiments, the first video stream may also be a video stream sent to the display device when the terminal device displays the pre-recorded video on the screen.

In some embodiments, the terminal device in the embodiment of the present application may be a mobile phone, and the video recording device of the terminal device may be a front/rear camera of the mobile phone.

It should be noted that before receiving the first video stream sent by the terminal device, the trigger instruction can be received first, and the monitor displays a follow-up training interface, where the follow-up training interface includes a first video playback window and a second video playback window. The window is used to play fitness videos obtained from the server.

The triggering instruction may be triggered after the user performs an operation on the terminal device to trigger the display of the follow-up training interface.

Optionally, the triggering instruction may also be an instruction received by the display device from another control device to trigger the display of the follow-up training interface.

S52. Obtain the scaling ratio according to the identification information, video playback parameters and the size of the first video stream.

Wherein, the video playback parameters include the size of the first video playback window used to play the first video stream and/or the preset video stream size.

In some embodiments, the scaling ratio may be obtained only based on the identification information, the size of the first video playback window, and the size of the first video stream, so that the size of the scaled first video stream is the same as that of the first video playback window. Adapt to the size of the window.

In some embodiments, the scaling ratio may be obtained only based on the identification information, the preset video stream size, and the size of the first video stream, thereby scaling the first video stream to a video stream of the preset video stream size.

In some embodiments, the scaling ratio can be obtained according to the identification information, the size of the first video playback window, the preset video stream size, and the size of the first video stream, so that the size of the scaled first video stream While adapting to the size of the first video playback window, it is more consistent with the aspect ratio of the original video. For example: the size of the first video playback window is 629×629. In order to make the aspect ratio of the projected video more consistent with the aspect ratio of the mobile phone in portrait mode, the default video stream size can be set to 450×629. Another example: the size of the first video playback window is 629×629. In order to make the aspect ratio of the screencast video more consistent with the aspect ratio of the mobile phone in landscape mode, the default video stream size can be set to 629×450. .

In some embodiments, the identification information includes: a first posture identification or a second posture identification.

When the identification information includes a first posture identification, the identification information is used to identify that the posture of the terminal device when recording the video corresponding to the first video stream is a portrait posture;

When the identification information includes a second posture identification, the identification information is used to identify that the posture of the terminal device when recording the video corresponding to the first video stream is a horizontal screen posture.

The video playback parameters corresponding to the first gesture identification and the video playback parameters corresponding to the second gesture identification are different.

The video playback parameters include the size of the first video playback window for playing the first video stream and/or the preset video stream size. In some embodiments of the present disclosure, different video playback parameters can be set for different gesture identifiers, That is to say, different gestures of the terminal device when recording the video corresponding to the first video stream may correspond to different sizes of the first video playback window and/or preset video stream sizes.

In some embodiments, when the identification information includes a first posture identification, it indicates that the posture of the terminal device when recording the video corresponding to the first video stream is a horizontal screen posture. In this case, the corresponding video playback parameters may be: The size of the first video stream is 1920×1080, and the size of the first video playback window is 626×629.

In some embodiments, when the identification information includes a second posture identification, it indicates that the posture of the terminal device when recording the video corresponding to the first video stream is a portrait posture. In this case, the corresponding video playback parameters may be: The size of the first video stream is 1080×1920, and the size of the first video playback window is 626×629.

S53. Scale the first video stream according to the scaling ratio to obtain the second video stream.

In some embodiments, the size of the first video stream is 1080×1920, and the scaling ratio is R, then the size of the second video stream is 1080*R×1920*R.

Through the scaling operation in step S53, the length or width of the first video stream can be adapted to the video playback parameters.

S54. Obtain a layout offset parameter according to the video playback parameter and the size of the second video stream.

Through the above step S53, the length or width of the second video stream can be adapted to the video playback parameters, but the other of the length and width of the second video stream needs to be adjusted to adjust the length and width of the second video stream. All are compatible with video playback parameters. In the embodiment of the present application, a way to adapt the other one of the length and width of the second video stream to the video playback parameters is to adjust the second video stream between the length and the width when playing the video according to the second video stream. The other one of the widths is offset in the direction. Therefore, in the embodiment of the present application, it is necessary to first obtain the layout offset parameter according to the video playback parameters and the size of the second video stream, so that subsequent playback can be based on the second video stream. Layout offset during video playback.

S55. Offset the second video stream based on the layout offset parameter, and play the offset second video stream in the first video playback window.

In some embodiments, offsetting the second video stream based on the layout offset parameter may include: adjusting the origin of the coordinate system of the second video stream based on the layout parameter to offset the second video stream. offset. In other embodiments, offsetting the second video stream based on the layout offset parameter may also include: calculating each edge (top edge, bottom edge, left edge, etc.) of the second video stream based on layout parameter adjustment. edge and right edge) of the first video playback window, and then offset the second video stream according to the distance between the edges of the first video playback window corresponding to each edge of the second video stream.

The screen projection method provided by the embodiment of the present application, when receiving the first video stream generated by the video recording device of the terminal device and sent by the receiving terminal device, will first play the video according to the identification information carried by the first video stream. parameters and the size of the first video stream to obtain the scaling ratio, then scale the first video stream according to the scaling ratio to obtain the second video stream, and obtain the second video stream according to the video playback parameters and the size of the second video stream. The size obtains the layout offset parameter, and finally performs video playback in the first video playback window based on the second video stream, and offsets the second video stream based on the layout offset parameter. Because the identification information is used to identify the posture of the terminal device when recording the video corresponding to the first video stream, and the video playback parameters include the size of the first video playback window used to play the first video stream. and/or the video stream size is preset. Therefore, the embodiment of the present application can zoom the first video stream according to the posture of the terminal device when recording the video corresponding to the first video stream, so that the obtained second video stream is in It is adapted to the video playback parameters in the horizontal or vertical direction; because the embodiment of the present application will also obtain the layout offset parameter according to the video playback parameters and the size of the second video stream, and based on the layout when playing the video The offset parameter offsets the second video stream, so this embodiment of the present application can make the second video stream adapt to the video playback parameters in another direction. In summary, the example of this application can adapt the size of the screen projection video stream to the video playback window and/or the preset video stream size for playing the screen projection video stream in both horizontal and vertical directions.

As an expansion and refinement of the above embodiment, as shown in Figure 17, another screen projection method provided by the embodiment of the present application includes:

S601. Receive the first video stream sent by the terminal device.

Wherein, the first video stream is a video stream obtained by video recording by a video recording device of the terminal device, and carries a message indicating that the posture of the terminal device when recording the video corresponding to the first video stream is vertical. Identification information of screen posture;

Referring to FIG. 18 , in FIG. 18 , the display device 71 is a television and the terminal device 72 is a mobile phone. The posture of the terminal device 72 when recording the video corresponding to the first video stream is a portrait posture.

S602. Obtain the first scaling ratio according to the width of the first video stream and the width of the first video playback window.

In the embodiment of this application, the width refers to the number of pixels included in the pixel row (horizontally), and the height refers to the number of pixels included in the pixel column (vertical).

Since the first video stream in the embodiment of the present application is a video stream generated based on the video recording device of the terminal device, the size of the first video stream is the same as the resolution of the screen of the terminal device, for example: the screen of the terminal device The resolution is 1080×1920, and the size of the first video stream is 1080×1920.

In some embodiments, the first scaling ratio is a ratio of a width of the first video playback window to a width of the first video stream.

Assume: the first scaling ratio is R1, the size of the first video stream is W1×H1, and the size of the first video playback window is WL×HL, then there is:

R1＝WL/W1

In some embodiments, when the size of the first video stream is 1080×1920 and the size of the first video playback window is 626×629, the first scaling ratio R1=629/1080.

S603. Use the first scaling ratio to scale the first video stream to obtain the second video stream.

As mentioned in the above example, the size of the first video stream is 1080×1920, the size of the first video playback window is 626×629, and the first scaling ratio R1=629/1080, then the first scaling ratio R1 is used. The size of the second video stream obtained by scaling the first video stream by a scaling ratio is 629×1118.

At this point, the width of the second video stream has adapted to the first video playback window.

S604. Obtain the first layout offset parameter according to the height of the second video stream and the height of the first video playback window.

In some embodiments, the first layout offset parameter is half of the difference between the height of the second video stream and the height of the first video playback window.

Suppose: the first layout offset parameter is CLIP ₁ , the size of the second video stream is W2×H2, and the size of the first video playback window is WL×HL, then there is:

CLIP ₁ ＝1/2(H2-HL)

In some embodiments, when the size of the second video stream is 629×1118 and the size of the first video playback window is 629×629, the first layout offset parameter CLIP ₁ =1/2 ( 1118-629).

S605. Offset the second video stream in the height direction based on the first layout offset parameter, and play the offset second video stream in the first video playback window.

Referring to FIG. 19 , in FIG. 19 , the screen projection method provided by the above embodiment is explained by taking the size of the first video stream as 1080×1920 and the size of the first video playback window 800 as 629×629 as an example. . Referring to FIG. 19 , a first scaling ratio 629/1080 is obtained according to the width 1080 of the first video stream 81 and the width 629 of the first video playback window, and then the first video is scaled according to the first scaling ratio 629/1080. The stream 81 is zoomed to obtain the second video stream 82. The size of the second video stream 82 is 629×1118. Then, according to the height 1118 of the second video stream 82 and the height of the first video playback window 800, the first video stream 82 is obtained. Layout offset parameter 1/2 (1118-629) ≈ 244; finally, video playback is performed in the first video playback window 800 based on the second video stream 82, and the second video stream is offset upward by the second video stream. A layout offset parameter 244 to achieve the display effect shown in Figure 19.

As an expansion and refinement of the above embodiment, as shown in Figure 20, another screen projection method provided by the embodiment of the present application includes:

S901. Receive the first video stream sent by the terminal device.

S902. Obtain the first scaling ratio according to the width of the first video stream and the width of the preset video stream size.

In some embodiments, the first scaling ratio is a ratio of a width in the preset video stream size to a width of the first video stream.

Assume: the first scaling ratio is R1, the size of the first video stream is W1×H1, and the preset video stream size is WS×HS, then there is:

R1＝WS/W1

In some embodiments, when the size of the first video stream is 1080×1920 and the preset video stream size is 450×629, the first scaling ratio R1=450/1080.

S903. Use the first scaling ratio to scale the first video stream to obtain the second video stream.

As mentioned in the above example, the size of the first video stream is 1080×1920, the default video stream size is 450×629, and the first scaling ratio R1=450/1080, then the first scaling is used The size of the second video stream obtained by scaling the first video stream is 450×800.

At this point, the width of the second video stream is the same as the width of the preset video playback stream.

S904. Obtain the first layout offset parameter according to the height of the second video stream and the height of the first video playback window.

CLIP ₁ ＝1/2(H2-HL)

In some embodiments, when the size of the second video stream is 629×800 and the size of the first video playback window is 629×629, the first layout offset parameter CLIP ₁ =1/2 ( 800-629).

S905. Offset the second video stream in the height direction based on the first layout offset parameter, and play the offset second video stream in the first video playback window.

Referring to Figure 21, in Figure 21, the size of the first video stream is 1080×1920, the size of the first video playback window 1000 is 629×629, and the preset video stream size is 450×629. An example is provided to illustrate the screen projection method provided in the above embodiment. Referring to Figure 21, a first scaling ratio 450/1080 is obtained according to the width 1080 of the first video stream 101 and the width 450 of the first video playback window, and then the first video is scaled according to the first scaling ratio 450/1080. The stream 101 is zoomed to obtain the second video stream 102. The size of the second video stream 102 is 450×800. Then, according to the height 800 of the second video stream 102 and the height of the first video playback window 1000, the first video stream 102 is obtained. Layout offset parameter 1/2 (800-629) ≈ 85; finally, video playback is performed in the first video playback window 1000 based on the second video stream 102, and the second video stream is offset upward by the second video stream 102. A layout offset parameter of 85 is used to achieve the display effect shown in Figure 21.

The aspect ratio of the video finally displayed in the screen projection method shown in Figure 20 is closer to the aspect ratio of the screen of the terminal device in the portrait mode, so the screen projection image of the terminal device can be better displayed.

As an expansion and refinement of the above embodiment, as shown in Figure 22, another screen projection method provided by the embodiment of the present application includes:

S111. Receive the first video stream sent by the terminal device.

Wherein, the first video stream is a video stream obtained by video recording by a video recording device of the terminal device, and carries a message indicating that the posture of the terminal device when recording the video corresponding to the first video stream is horizontal. Identification information of screen posture;

Referring to FIG. 23 , in FIG. 23 , the display device 121 is a television and the terminal device 122 is a mobile phone. The posture of the terminal device 122 when recording the video corresponding to the first video stream is a horizontal screen posture.

S112. Obtain the second scaling ratio according to the height of the first video stream and the height of the first video playback window.

Similarly, the width here refers to the number of pixels contained in the pixel row (horizontally), and the height refers to the number of pixels contained in the pixel column (vertical).

In some embodiments, the first scaling ratio is a ratio of a height of the first video playback window to a height of the first video stream.

Assume: the second scaling ratio is R2, the size of the first video stream is W1×H1, and the size of the first video playback window is WL×HL, then:

R2＝HL/H1

In some embodiments, when the size of the first video stream is 1920×1080 and the size of the first video playback window is 626×629, the first scaling ratio R2=629/1080.

S113. Use the first scaling ratio to scale the first video stream to obtain the second video stream.

As mentioned in the above example, the size of the first video stream is 1920×1080, the size of the first video playback window is 626×629, and the second scaling ratio R2=629/1080, then use the third The size of the second video stream obtained by scaling the first video stream by a scaling ratio is 1118×629.

At this point, the height of the second video stream has adapted to the first video playback window.

S114. Obtain a second layout offset parameter according to the width of the second video stream and the width of the first video playback window.

In some embodiments, the second layout offset parameter is half of the difference between the width of the second video stream and the width of the first video playback window.

Assume: the second layout offset parameter is CLIP ₂ , the size of the second video stream is W2×H2, and the size of the first video playback window is WL×HL, then there is:

CLIP ₂ ＝1/2(W2-WL)

In some embodiments, when the size of the second video stream is 1118×629 and the size of the first video playback window is 629×629, the second layout offset parameter CLIP ₂ =1/2 ( 1118-629).

S115. Offset the second video stream in the width direction based on the first layout offset parameter, and play the offset second video stream in the first video playback window.

Referring to FIG. 24 , in FIG. 24 , the screen projection method provided by the above embodiment is explained by taking the size of the first video stream as 1920×1080 and the size of the first video playback window 1300 as 629×629 as an example. . Referring to Figure 24, a first scaling ratio 629/1080 is obtained according to the height 1080 of the first video stream 131 and the width 629 of the first video playback window, and then the first video is scaled according to the first scaling ratio 629/1080. The stream 131 is zoomed to obtain the second video stream 132. The size of the second video stream 132 is 1118×629. Then, according to the width 1118 of the second video stream 132 and the height of the first video playback window 800, the second video stream 132 is obtained. Layout offset parameter 1/2 (1118-629) ≈ 244; finally, video playback is performed in the first video playback window 1300 based on the second video stream 132, and the second video stream is offset to the left. A layout offset parameter 244 to achieve the display effect shown in Figure 24.

As an expansion and refinement of the above embodiment, as shown in Figure 25, another screencasting method provided by the embodiment of the present application includes:

S141. Receive the first video stream sent by the terminal device.

S142. Obtain the second scaling ratio according to the height of the first video stream and the height in the preset video stream size.

In some embodiments, the second scaling ratio is a ratio of a height in the preset video stream size to a height of the first video stream.

Assume: the second scaling ratio is R2, the size of the first video stream is W1×H1, and the preset video stream size is WS×HS, then there is:

R1＝HS/H1

In some embodiments, when the size of the first video stream is 1920×1080 and the preset video stream size is 450×629, the first scaling ratio R1=450/1080.

S143. Use the first scaling ratio to scale the first video stream to obtain the second video stream.

As mentioned in the above example, the size of the first video stream is 1920×1080, the default video stream size is 450×629, and the second scaling ratio R2=450/1080, then the second scaling is used The size of the second video stream obtained by scaling the first video stream is 800×450.

At this point, the height of the second video stream is the same as the height of the preset video playback stream.

S144. Obtain a second layout offset parameter according to the width of the second video stream and the width of the first video playback window.

CLIP ₂ ＝1/2(W2-WL)

In some embodiments, when the size of the second video stream is 800×629 and the size of the first video playback window is 629×629, the second layout offset parameter CLIP ₂ =1/2 ( 800-629).

S145. Offset the second video stream in the width direction based on the first layout offset parameter, and play the offset second video stream in the first video playback window.

Referring to Figure 26, in Figure 26, the size of the first video stream is 1920×1080, the size of the first video playback window 1500 is 629×629, and the preset video stream size is 450×629. An example is provided to illustrate the screen projection method provided in the above embodiment. Referring to Figure 26, a first scaling ratio 450/1080 is obtained according to the height 1080 of the first video stream 151 and the height 450 of the first video playback window, and then the first video is scaled according to the first scaling ratio 450/1080. The stream 151 is zoomed to obtain the second video stream 152. The size of the second video stream 152 is 800×450. Then, according to the width 800 of the second video stream 152 and the width of the first video playback window 1500, the second video stream 152 is obtained. Layout offset parameter 1/2 (800-629) ≈ 85; finally, video playback is performed in the first video playback window 1500 based on the second video stream 152, and the second video stream is offset to the left by the second video stream. A layout offset parameter of 85 is used to achieve the display effect shown in Figure 26.

The aspect ratio of the video finally displayed in the screen projection method shown in Figure 27 is closer to the aspect ratio of the screen of the terminal device in the horizontal screen state, so the projection screen of the terminal device can be better displayed.

Referring to Figure 27, a screen projection method provided by another embodiment of the present application includes:

S161. Receive the first video stream sent by the terminal device.

Wherein, the first video stream is a video stream obtained by video recording by a video recording device of the terminal device, and carries an identifier used to identify the posture of the terminal device when recording the video corresponding to the first video stream. information.

It should be noted that after any of the screen casting methods in Figure 16, Figure 17, Figure 20, Figure 22, and Figure 25, the first video stream sent by the subsequently received terminal device can also be as shown in Figure 27 method for processing and display.

S162. Receive the trimming and playback instruction.

Wherein, the trimming and playback instruction carries the size of the selected area and the position information of the selected area, and is used to instruct video playback based on the video content of the first video stream in the selected area.

Referring to FIG. 28 , in FIG. 28 , the display device 171 is a television and the terminal device 172 is a mobile phone. The terminal device 172 determines the selected area 1700 in response to the user operation, and sends a trimming playback instruction to the display device 171 for instructing video playback based on the video content of the first video stream in the selected area.

In some embodiments, the size of the selected area and the selected area can be characterized by the position coordinates (x1, y1) of the upper right vertex of the selected area and the position coordinates (x2, y2) of the lower left vertex of the selected area. Location information for the region.

S163. In response to the trimming playback instruction, obtain a third zoom ratio according to the size of the selected area and the size of the first video playback window.

Wherein, the third scaling ratio is the smaller of the first ratio and the second ratio, and the first ratio is the ratio of the height of the first video playback window to the height of the selected area, so The second ratio is the ratio of the width of the first video playback window to the width of the selected area.

Assume: the size of the selected area is select_w×select_h, the size of the first video playback window is 629×629, and the third scaling ratio is R3, then there is:

R3＝min(629/select_w,692/select_h)

In some embodiments, when the size of the selected area is 265×360 and the size of the first video playback window is 629×629, the third scaling ratio R3=629/360.

In some embodiments, when the size of the selected area is 256×128 and the size of the first video playback window is 629×629, the third scaling ratio R3=629/256.

S164. Scale the first video stream using the third scaling ratio to obtain a third video stream.

In some embodiments, the size of the first video stream is 1920×1080, the size of the first video playback window is 629×629, and the size of the selected area is 480×270, then the size of the third The scaling ratio R3=629/480, and the size of the third video stream obtained by scaling the first video stream using the third scaling ratio is 2516×1415.

S165. Obtain a third layout offset parameter according to the third zoom ratio, the width of the first video playback window, the position information of the selected area, and the width of the selected area.

In some embodiments, the controller is specifically configured to calculate the third layout offset parameter through the following formula 1, where the formula 1 is:

CLIP ₃ =(X+select_w/2)*R3-WL/2

Wherein, CLIP ₃ is the third layout offset parameter, X is the distance from the left edge of the selected area to the left edge of the first video stream, and select_w/2 is the width of the selected area. , R3 is the third scaling ratio, and WL is the width of the first video playback window.

In some embodiments, when the size of the first video playback window is 629×629, the distance from the left edge of the selected area to the left edge of the first video stream is 1000, and the selected When the size of the area is 480×270, the third layout offset parameter CLIP ₃ =1310.

S166. Obtain a fourth layout offset parameter according to the third zoom ratio, the height of the first video playback window, the position information of the selected area, and the height of the selected area.

In some embodiments, the controller is specifically configured to calculate the fourth layout offset parameter through the following formula 2:

Assume that the fourth layout offset parameter is CLIP ₄ , the size of the third video stream is W3×H3, and the size of the first video playback window is WL×HL, then the second formula is:

CLIP ₄ =(Y+select_h/2)*R3-HL/2

Wherein, CLIP ₄ is the fourth layout offset parameter, Y is the distance from the top edge of the selected area to the top edge of the first video stream, select_h/2 is the height of the selected area , R3 is the third scaling ratio, and HL is the height of the first video playback window.

In some embodiments, when the size of the first video playback window is 629×629, the distance from the left edge of the selected area to the left edge of the first video stream is 400, and the selected When the size of the area is 480×270, the fourth layout offset parameter CLIP ₄ =386.

S167. Offset the third video stream in the width direction based on the third layout offset parameter, offset the third video stream in the height direction based on the fourth layout offset parameter, and playing the offset third video stream in the first video window.

In some embodiments, the second video stream is offset in the width direction based on the third layout offset parameter, and the third video stream is offset in the height direction based on the fourth layout offset parameter. Offsetting may include: adjusting a coordinate system origin of the third video stream based on a third layout offset parameter and the fourth layout offset parameter to offset the third video stream. In other embodiments, offsetting the second video stream based on the layout offset parameter may also include: calculating each edge (top edge, bottom edge, left edge, etc.) of the third video stream based on layout parameter adjustment. edge and right edge) of the first video playback window, and then offset the third video stream according to the distance between the edges of the first video playback window corresponding to each edge of the second video stream.

Referring to Figure 29, in Figure 29, the size of the first video stream is 1920×1080, the size of the first video playback window is 629×629, and the size of the selected area is 480×270. The distance from the left edge of the selected area to the left edge of the first video stream is 1000, and the distance from the top edge of the selected area to the top edge of the first video stream is 400. For example, The screen projection method provided by the above embodiment will be described. Referring to FIG. 29 , first, since 629/480<629/270, the third scaling ratio is determined to be 629/480. Secondly, the first video stream 181 is scaled according to the third scaling ratio to obtain the third video stream 182. The size of the third video stream is 2516×1415, and then the first video is played according to the third scaling ratio. The width of the window, the position information of the selected area, and the width of the selected area are used to obtain the third layout offset parameter 1310, and according to the third scaling ratio, the height of the first video playback window, the The position information of the selected area and the height of the selected area are obtained to obtain the fourth layout offset parameter 386. Finally, video playback is performed in the first video playback window 1800 based on the third video stream 182, and the The third video stream is offset to the left by the third layout offset parameter 1310 and upward by the fourth layout offset parameter 386 to achieve the display effect shown in FIG. 29 .

Based on any of the above embodiments, the screen casting method provided by the embodiment of the present application further includes: receiving a second video stream sent by the server; and performing video playback in the second video playback window based on the second video stream.

In some embodiments, the above embodiment will be described below by taking a video fitness scene as an example. As shown in Figure 30 , the scene construction includes a fitness video server 191, a display device 192 and a terminal device 193. The display device 192 can obtain the fitness video from the fitness video server 191 and play it in the second video playback window 1922; the user can watch the fitness video played by the display device 192 and follow the fitness video for fitness training; the terminal device 193 can record through the video The device performs video recording to obtain the first video stream, and sends the first video stream to the display device 192. After the display device receives the first video stream sent by the terminal device 193, the screen projection method provided by the embodiment of the present application is used. A video playback window 1921 is used to play the screencast video.

In some embodiments, embodiments of the present application also provide an electronic device, including: a memory and a processor, the memory is used to store a computer program; the processor is used to cause the electronic device to Implement the screen projection method described in any of the above embodiments.

In some embodiments, embodiments of the present application provide a computer-readable storage medium. A computer program is stored on the computer-readable storage medium. When the computer program is executed by a computing device, the computing device implements The screen projection method described in any of the above embodiments.

In some embodiments, embodiments of the present application provide a computer program product. When the computer program product is run on a computer, the computer implements the investment described in the second aspect or any embodiment of the second aspect. screen method.

For convenience of explanation, the above description has been made in conjunction with specific implementation modes. However, the above illustrative discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed. Various modifications and variations are possible in light of the above teachings. The above embodiments are selected and described to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various modified embodiments suitable for specific use considerations.

Claims

A display device including:

monitor;

A controller, connected to the display, and the controller is configured to:

The display displays a follow-up training interface, wherein the follow-up training interface includes a first window and a second window. The first window is used to play the first video, and the second window is used to play the third video obtained from the server. video.
The display device of claim 1, wherein the controller is configured to:

In response to the first window playing to the first time before the end of the first video, according to the presence of the next item corresponding to the first video in the play index table, the second window is launched in the layer above the first window to play a third video, wherein the first window is a full-screen window, the second window is a non-full-screen window, the next item corresponds to the second video, and the third video prompts the user to exercise Fitness videos.
The display device of claim 2, wherein the controller is configured to:

In response to receiving a window switching instruction before the second window plays to the preset duration, the first video is adjusted from the current progress of the first video to the second window to continue playing, and the third window is The video is adjusted from the current progress of the third video to the first window to continue playing. When the second window is played to the second time of the second video, the second window is canceled and the third window is played. A window is adjusted to continue playing from the current progress of the second video;

In response to not receiving the window switching instruction when the second window is played for a preset duration, the second window is canceled.
The display device of claim 1, wherein the controller is configured to:

In response to receiving a window switching instruction before the second window plays to the preset duration, the first video is adjusted from the current progress of the first video to the second window to continue playing, and the third window is The video continues to play from the current progress of the third video to the first window. When the second window plays to the second time of the second video, the second window is cancelled, and the first window is Adjust to continue playing from the current progress of the second video, wherein the second video corresponds to the next item in the play index table where the corresponding item of the first video exists;

In response to not receiving the window switching instruction when the second window is played for a preset duration, the second window is canceled.
The display device according to claim 3, wherein adjusting the first video from the current progress of the first video to the second window to continue playing includes:

The window content of the first window is adjusted to a second player, wherein the second player is used to play the third video, so that the second player changes the current progress of the third video to The image is played in the first window;

Adjust the window content of the second window to a first player, wherein the first player is used to play the first video, so that the first player changes the current progress of the first video to The image plays in the second window.
The display device according to claim 3, wherein starting a second window in a layer above the first window to play a third video includes:

Generate a layer containing the second window above the layer of the first window;

Start the second player, control the second player to decode the third video, and obtain the decoded image;

Adjust the window content of the second window to the second player, so that the second player plays the decoded image in the second window.
The display device according to claim 3, wherein canceling the second window and adjusting the first window to continue playing from the current progress of the second video includes:

Undo the layer of the second window;

Adjust the window content of the first window to a first player, wherein the first player is used to play the second video, so that the first player displays the image after the current progress of the second video in The second window plays.
The display device of claim 3, wherein the controller is configured to:

Before receiving the window switching instruction, control the volume of the second window to be smaller than the volume of the first window;

After receiving the window switching instruction, the second window is muted.
The display device of claim 3, wherein the controller is configured to set the volume of the second window to be positively correlated with the volume of the first window before receiving the window switching instruction. .
The display device of claim 3, wherein the controller is further configured to:

Before the first time, send a query request for the third video to the server, where the query request includes a user identification and the playable duration, and the playable duration is based on the ending of the first video. The duration and the opening duration of the second video are calculated, causing the server to query and return the media asset information of the third video based on the user identification and playable duration;

Obtain the code stream of the third video from the server according to the media asset information of the third video.
The display device of claim 3, wherein the controller is further configured to:

In response to receiving an exit instruction before the second window plays for a preset duration, canceling the layer of the second window.
The display device according to claim 1 or 4, wherein

The controller is further configured as:

In response to the received trigger instruction, the display displays a follow-up interface and receives the first video stream sent by the terminal device, where the first video stream is a video stream collected by the video recording device of the terminal device, and Carrying identification information used to identify the gesture of the terminal device when collecting the video corresponding to the first video stream;

Obtain the scaling ratio according to the identification information, video playback parameters and the size of the first video stream, scale the first video stream according to the scaling ratio to obtain the second video stream, and obtain the second video stream according to the video playback parameters and The size of the second video stream obtains layout offset parameters; the video playback parameters include the size of the first window and/or the preset video stream size;

Offset the second video stream based on the layout offset parameter, and control the display to play the offset second video stream as the first video in the first window.
The display device according to claim 12, wherein the identification information includes: a first posture identification or a second posture identification;

The first posture identifier is used to identify that the posture of the terminal device when recording the video corresponding to the first video stream is a portrait posture;

The second posture identifier is used to identify that the posture of the terminal device when recording the video corresponding to the first video stream is a horizontal screen posture;

Wherein, the video playback parameters corresponding to the first gesture identification and the video playback parameters corresponding to the second gesture identification are different.
The display device of claim 13, wherein in response to the identification information including the first gesture identification,

The controller scales the first video stream according to the scaling ratio to obtain a second video stream, and obtains layout offset parameters according to the video playback parameters and the size of the second video stream, including:

The controller obtains a first scaling ratio according to the width of the first video stream and a target width, where the target width is the width of the first window or the width in the preset video stream size; using the first Scale the first video stream by a scaling ratio to obtain the second video stream; obtain a first layout offset parameter according to the height of the second video stream and the height of the first window;

The controller offsets the second video stream based on the layout offset parameter including: the controller offsets the second video stream in a height direction based on the first layout offset parameter. .
The display device according to claim 14, wherein

The first scaling ratio is the ratio of the target width to the width of the first video stream;

The first layout offset parameter is half the difference between the height of the second video stream and the height of the first window.
The display device of claim 13, wherein in response to the identification information including the second gesture identification,

The controller obtains the scaling ratio according to the identification information, video playback parameters and the size of the first video stream, and scales the first video stream according to the scaling ratio to obtain the second video stream including:

The controller obtains a second scaling ratio based on the height of the first video stream and a target height, where the target height is the height of the first window or the height in the preset video stream size; using the Scale the first video stream with a second scaling ratio to obtain the second video stream;

The controller obtaining the layout offset parameter according to the video playback parameter and the size of the second video stream includes: the controller obtaining the layout offset parameter according to the width of the second video stream and the width of the first window. 2. Layout offset parameters;

The controller offsets the second video stream based on the layout offset parameter including:

The controller offsets the second video stream in a width direction based on the second layout offset parameter.
The display device according to claim 16, wherein

The second scaling ratio is the ratio of the target height to the height of the first video stream;

The second layout offset parameter is one-half of the difference between the width of the second video stream and the width of the first window.
The display device according to any one of claims 12 to 17, wherein the controller is further configured to offset the second video stream based on the layout offset parameter and control After the display plays the offset second video stream in the first window,

In response to the received trimming playback instruction, a third zoom ratio is obtained according to the size of the selected area and the size of the first window, wherein the trimming playback instruction carries the size of the selected area and the size of the selected window. The location information of the area is used to indicate video playback based on the video content of the first video stream in the selected area, wherein the third scaling ratio is the smaller of the first ratio and the second ratio, The first ratio is the ratio of the height of the first window to the height of the selected area, and the second ratio is the ratio of the width of the first window to the width of the selected area;

Use the third zoom ratio to zoom the first video stream to obtain a third video stream; according to the third zoom ratio, the width of the first window, the position information of the selected area and the selected Obtain the third layout offset parameter based on the width of a certain area; obtain the fourth layout offset according to the third scaling ratio, the height of the first window, the position information of the selected area, and the height of the selected area. parameter;

Perform video playback in the first window based on the third video stream, offset the third video stream in the width direction based on the third layout offset parameter, and offset the third video stream based on the fourth layout offset parameter. The shift parameter offsets the third video stream in the height direction, and controls the display to play the offset third video stream in the first window.
The display device of claim 18, wherein the controller obtains a third zoom ratio, a width of the first window, position information of the selected area, and a width of the selected area. Three layout offset parameters include:

The controller calculates the third layout offset parameter through the following formula 1:

The first formula is: CLIP 3 = (X+select_w/2)*R3-WL/2;

The controller obtaining the fourth layout offset parameter according to the third scaling ratio, the height of the first window, the position information of the selected area, and the height of the selected area includes: the controller passes The third layout offset parameter is calculated using the following formula 2:

The second formula is: CLIP 4 = (Y+select_h/2)*R3-HL/2;

Wherein, CLIP 3 is the third layout offset parameter, CLIP 4 is the fourth layout offset parameter, and X is the distance from the left edge of the selected area to the left edge of the first video stream. , Y is the distance from the top edge of the selected area to the top edge of the first video stream, select_w/2 and select_h/2 are the width and height of the selected area respectively, and R3 is the Three scaling ratios, WL and HL are the width and height of the first window respectively.
A server, wherein the server is configured to:

Receive a query request sent by the display device when playing the first video, where the query request includes a user identification and playable duration;

In response to the query request, obtain the third video corresponding to the user identification from the follow-up video library;

Calculate the playback start time point and playback end time point of the third video based on the playable duration;

Send the media asset information of the third video including the media asset identifier, the playback start time point and the playback end time point of the third video to the display device, so that the display device is within 10 seconds before the end of the first video. The video clips of the third video between the playback start time point and the playback end time point are also played during the second time period from the beginning of the first time to the playback of the second video, wherein the second video is the display The video corresponding to the next item of the corresponding item of the first video in the playback index table of the device, and the third video is a video that prompts the user to exercise.
A method for broadcasting media assets, including:

In response to the first window playing to the first time before the end of the first video, according to the presence of the next item corresponding to the first video in the play index table, the second window is launched in the layer above the first window to play a third video, wherein the first window is a full-screen window, the second window is a non-full-screen window, the next item corresponds to the second video, and the third video prompts the user to exercise fitness videos;

In response to receiving a window switching instruction before the second window plays to the preset duration, the first video is adjusted from the current progress of the first video to the second window to continue playing, and the third window is The video is adjusted from the current progress of the third video to the first window to continue playing. When the second window is played to the second time of the second video, the second window is canceled and the third window is A window is adjusted to continue playing from the current progress of the second video;

In response to not receiving the window switching instruction when the second window is played for a preset duration, the second window is canceled.
A screencasting method, which includes:

In response to the received trigger instruction, display the follow-up training interface, wherein the follow-up training interface includes a first window and a second window, and the second window is used to play the fitness video obtained from the server;

Receive a first video stream sent by a terminal device, where the first video stream is a video stream collected by a video recording device of the terminal device, and carries a corresponding message used to identify the terminal device for recording the first video stream. The identification information of the posture in the video;

Obtain the scaling ratio according to the identification information, video playback parameters and the size of the first video stream, scale the first video stream according to the scaling ratio to obtain the second video stream, and obtain the second video stream according to the video playback parameters and The size of the second video stream obtains layout offset parameters, and the video playback parameters include the size of the first window and/or the preset video stream size;

The second video stream is offset based on the layout offset parameter, and the offset second video stream is played in the first window.
The method according to claim 22, wherein the identification information includes: a first posture identification or a second posture identification;

The first posture identifier is used to identify that the posture of the terminal device when recording the video corresponding to the first video stream is a portrait posture;

The second posture identifier is used to identify that the posture of the terminal device when recording the video corresponding to the first video stream is a horizontal screen posture;

Wherein, the video playback parameters corresponding to the first gesture identification and the video playback parameters corresponding to the second gesture identification are different.