WO2022188475A1

WO2022188475A1 - Dual-screen synchronous playback method for video file, and display device

Info

Publication number: WO2022188475A1
Application number: PCT/CN2021/134383
Authority: WO
Inventors: 王光强; 刘金刚; 吴超; 宁静
Original assignee: 聚好看科技股份有限公司
Priority date: 2021-03-10
Filing date: 2021-11-30
Publication date: 2022-09-15
Also published as: CN116965039A

Abstract

Disclosed in the present application are a dual-screen synchronous playback method for a video file, and a display device. A video file is displayed on a first display for playback; a progress bar page comprising a video progress bar is generated on the basis of the playback progress and the total duration of the video file; the progress bar page is continuously displayed on a second display, wherein the playback progress corresponding to the video progress bar is the same as the playback progress of the video file presented on the first display. Thus, according to the method and the display device, dual-screen display can be achieved for a video file, so that the user can conveniently watch the video file and the video progress bar at the same time, and excessive interaction is avoided. In the playback process, the progress and the status of the video progress bar on the second display can be synchronously updated according to the playback status and the playback progress of the video file on the first display; thus, time difference between the playback progress on the two screens is avoided, it can be ensured that, in different playback scenarios, the playback progress on the large and small screens can be synchronized according to synchronization of playback statuses, and the user experience is good.

Description

A dual-screen synchronous playback method and display device for video files

This application claims the priority of the Chinese patent application with the application number 202110259606.7 filed with the China Patent Office on March 10, 2021 and the Chinese patent application with the application number 202110336425.X filed with the China Patent Office on March 29, 2021, The entire contents of which are incorporated herein by reference.

technical field

The present application relates to the technical field of dual-screen smart TV display, and in particular, to a dual-screen synchronous playback method and display device for video files.

Background technique

With the rapid development of display devices, the functions of display devices will become more and more abundant, and the performance of display devices will become more and more powerful. At present, display devices include smart TVs and other products with smart display screens. In order to provide users with different functional services, different applications are configured in the display device.

When using a display device to watch a video file, for the convenience of the user, the video file is usually played in full screen. In order not to block the main viewing content, the video progress bar is usually displayed when it starts to play, and will be automatically hidden if there is no operation in 5s. However, during the viewing process, if the user cannot watch the video progress bar all the time, he cannot know the real-time playback progress of the video file, and if the user wants to view it, the display of the video progress bar needs to be triggered, which is cumbersome and affects the user experience.

SUMMARY OF THE INVENTION

In a first aspect, the present application provides a display device, including:

a first display configured to present a first user interface;

a second display configured to present a second user interface;

a controller connected to the first display and the second display, the controller configured to:

In response to an operation that triggers the playback of the video file, the video file is displayed on the first display for playback;

During the playback of the video file, a progress bar page including a video progress bar is generated based on the playback progress and total duration of the video file;

The progress bar page including the video progress bar is displayed on the second display, and the playing progress corresponding to the video progress bar is the same as the playing progress of the video file presented on the first display.

In a second aspect, the present application also provides a display device, including:

a first display configured to present a first user interface;

a second display configured to present a second user interface;

a first controller connected to the first display, the first controller configured to:

sending the playback progress and total duration of the video file to the second controller;

a second controller connected to the second display, the second controller configured to:

During the playback of the video file, receive the playback progress and the total duration of the video file sent by the first controller;

Generate a progress bar page including a video progress bar based on the playback progress and total duration of the video file;

In a third aspect, the present application also provides a dual-screen playback synchronization method for video files, the method comprising:

In a fourth aspect, the present application also provides a dual-screen playback synchronization method for video files, the method comprising:

During the playback of the video file, receiving the playback progress and total duration of the video file sent by the first controller;

In a fifth aspect, the present application also provides a storage medium, the computer storage medium can store a program, and when the program is executed, it can realize parts or all steps.

Description of drawings

1 illustrates a usage scenario of a display device according to some embodiments;

FIG. 2 shows a display diagram of an icon control interface of an application in a display device 200 according to some embodiments;

3 shows a structural block diagram of a dual-screen dual-system display device according to some embodiments;

FIG. 4 shows a structural diagram of a dual-screen display device according to some embodiments;

Fig. 5 shows a kind of flow chart of the dual-screen synchronous playback method of video file according to some embodiments;

Fig. 6 shows the data flow diagram of the dual-screen synchronous playback method of the video file according to some embodiments;

7 shows a schematic diagram of presenting a video list in a first user interface according to some embodiments;

8 shows a schematic diagram of the effect of a video bar in a countdown form according to some embodiments;

9 shows a schematic diagram of the effect of a video bar in a timing form according to some embodiments;

10 shows a schematic diagram of the effect of a progress bar page including a state UI diagram according to some embodiments;

11 shows a schematic diagram of the effect of playing a video file on dual screens according to some embodiments;

12 shows a schematic diagram of the effect of starting to play an advertisement file according to some embodiments;

FIG. 13 shows a schematic diagram of the effect of displaying media asset recommendation information in a second display according to some embodiments;

14 shows a service sequence diagram of a method for synchronously playing a video file on two screens according to some embodiments;

Figure 15 shows another flowchart of a method for synchronizing the progress of a video file on a dual-screen playback according to some embodiments;

16 shows a message presentation interaction diagram of a dual-screen dual-system display device according to some embodiments;

FIG. 17 shows a flowchart of a method for displaying content on a secondary screen according to some embodiments;

FIG. 18 shows a data flow diagram of a method for displaying content on a secondary screen according to some embodiments;

Figure 19 shows a schematic diagram of a dual-screen display device presenting a video file according to some embodiments;

FIG. 20 shows a schematic diagram of presenting a media asset recommendation message on a secondary screen according to some embodiments;

FIG. 21 shows another schematic diagram of presenting a media asset recommendation message on a secondary screen according to some embodiments;

Figure 22 shows a schematic diagram of a secondary screen presentation system parameter according to some embodiments;

23 shows a schematic diagram of a display with a jump function in a fusion mode according to some embodiments;

Figure 24 shows another schematic diagram of a display with a jump function in a fusion mode according to some embodiments;

FIG. 25 shows another flowchart of a method for displaying content on a secondary screen according to some embodiments.

Detailed ways

The concepts involved in the present application are first described below with reference to the accompanying drawings. It should be pointed out here that the following descriptions of various concepts are only for the purpose of making the content of the present application easier to understand, and do not limit the protection scope of the present application.

The term "module" used in the various embodiments of the present application may refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware or/and software codes capable of executing the execution associated with the element function.

The term "remote control" used in various embodiments of the present application refers to a component of an electronic device (such as the display device disclosed in the present application), which can usually wirelessly control the electronic device within a short distance range. The component can generally use infrared and/or radio frequency (RF) signals and/or Bluetooth to connect with electronic devices, and may also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors. For example, a hand-held touch remote control replaces most of the physical built-in hard keys in a general remote control device with a user interface in a touch screen.

The term "gesture" used in various embodiments of the present application refers to a user behavior that is used by a user to express an expected idea, action, purpose/or result through an action such as a change of hand shape or hand movement.

The term "hardware system" used in the various embodiments of this application may refer to a computer system composed of mechanical, optical, electrical, and magnetic devices such as an integrated circuit (IC) and a printed circuit board (PCB). , physical components that control, store, input, and output functions. In various embodiments of the present application, the hardware system is also generally referred to as a motherboard or a chip.

FIG. 1 illustrates a usage scenario of a display device according to some embodiments. As shown in FIG. 1 , a user can operate the display apparatus 200 through the control apparatus 100 .

Wherein, the control device 100 may be a remote controller 100A, which can communicate with the display device 200 through infrared protocol communication, Bluetooth protocol communication, ZigBee protocol communication or other short-distance communication methods, for wireless or other communication The display device 200 is controlled in a wired manner. The user can control the display device 200 by inputting user instructions through keys on the remote controller 100A, voice input, control panel input, or the like. For example, the user can control the display device by inputting corresponding control commands through the volume plus and minus keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, and power-on/off keys on the remote control 100A. 200 functions.

The control device 100 can also be a smart device, such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, etc., which can use a local network (LAN, Local Area Network), a wide area network (WAN, Wide Area Network), a wireless local area network (WLAN, Wireless Local Area Network) or other networks communicate with the display device 200, and control the display device 200 through an application program corresponding to the display device 200. For example, the display device 200 is controlled using an application running on the smart device. The application can provide users with various controls through an intuitive user interface (UI, User Interface) on the screen associated with the smart device.

For example, software applications can be installed on both the mobile terminal 100B and the display device 200, so that the connection and communication between the two can be realized through a network communication protocol, thereby realizing the purpose of one-to-one control operation and data communication. For example, the mobile terminal 100B and the display device 200 can be made to establish a control instruction protocol, the remote control keyboard can be synchronized to the mobile terminal 100B, and the function of controlling the display device 200 can be realized by controlling the user interface on the mobile terminal 100B; The audio and video content displayed on the display device 200 is transmitted to the display device 200 to realize the synchronous display function.

As shown in FIG. 1 , the display device 200 can also perform data communication with the server 300 through various communication methods. In various embodiments of the present application, the display device 200 may be allowed to perform wired communication connection or wireless communication connection with the server 300 through a local area network, a wireless local area network, or other networks. The server 300 may provide various contents and interactions to the display device 200 .

For example, the display device 200 interacts with an Electronic Program Guide (EPG) by sending and receiving information, receiving software program updates, or accessing a remotely stored digital media library. The server 300 may be one group or multiple groups, and may be one or more types of servers. Other network service contents such as video-on-demand and advertising services are provided through the server 300 .

The display device 200 includes a first display 201 and a second display 202, wherein the first display 201 and the second display 202 are independent of each other, and the first display 201 and the second display 202 are controlled by different hardware systems respectively.

The first display 201 and the second display 202 may be used to display different screen contents. For example, the first display 201 may be used for screen display of traditional TV programs, and the second display 202 may be used for screen display of auxiliary information such as notification messages and voice assistants.

In an exemplary implementation, the content displayed on the first display 201 and the content displayed on the second display 202 may be independent of each other and not affect each other. For example, when the first display 201 is playing a TV program, the second display 202 may display information such as time, weather, temperature, and reminder messages that are not related to the TV program.

In an exemplary implementation, there may also be an association relationship between the content displayed on the first display 201 and the content displayed on the second display 202 . For example, when the first display 201 plays the main screen of the video chat, the second display 202 may display information such as the avatar and the chat duration of the user currently accessing the video chat.

In an exemplary implementation, part or all of the content displayed on the second display 202 can be adjusted to be displayed on the first display 201 . For example, information such as time, weather, temperature, and reminder message displayed on the first display 201 may be adjusted to be displayed on the first display 201 , and other information may be displayed on the second display 202 .

In addition, the first display 201 also displays a multi-party interactive screen while displaying the traditional TV program screen, and the multi-party interactive screen will not block the traditional TV program screen. Wherein, the present application does not limit the display modes of traditional TV program pictures and multi-party interactive pictures. For example, the present application can set the position and size of the traditional TV program picture and the multi-party interactive picture according to the priority of the traditional TV program picture and the multi-party interactive picture.

For example, the priority of traditional TV program screen is higher than that of multi-party interactive screen. The area of traditional TV program screen is larger than the area of multi-party interactive screen, and the multi-party interactive screen can be located on one side of traditional TV program screen, or can be set by floating. In the corner of the multi-party interactive screen.

The display device 200, on the one hand, can be a liquid crystal display, an OLED (Organic Light Emitting Diode) display, a projection display device; on the other hand, can be a smart TV or a display system composed of a monitor and a set-top box. The specific type, size and resolution of the display device 200 are not limited, and those skilled in the art can understand that the display device 200 may have some changes in its performance and configuration as required.

The display device 200 may additionally provide an intelligent network television function that provides a computer-supported function in addition to the function of broadcasting and receiving television. Such as Internet TV, Smart TV, Internet Protocol TV (IPTV), etc. In some embodiments, the display device may not have broadcast reception television capabilities.

As shown in FIG. 1 , a camera may be connected or set on the display device 200 for presenting the picture captured by the camera on the display screen of the display device or other display devices, so as to realize interactive chat between users. Specifically, the picture captured by the camera may be displayed on the display device in full screen, half screen, or in any optional area.

As an optional connection method, the camera is connected to the rear shell of the display device through a connecting plate, and is fixedly installed in the upper middle of the rear shell of the display device. Any position can be ensured that the image acquisition area is not blocked by the back cover. For example, the image acquisition area and the display device have the same display orientation.

As another optional connection method, the camera can be connected to the rear shell of the display device through a connecting plate or other conceivable connectors in a liftable manner. A lift motor is installed on the connector. When the user wants to use the camera or has an application program to use When the camera is installed, it is raised above the display device, and when the camera is not needed, it can be embedded behind the rear case to protect the camera from damage and protect the user's privacy.

FIG. 2 shows a display diagram of an icon control interface of an application in the display device 200 according to some embodiments. In some embodiments, the display device can directly enter a preset VOD program interface after startup. The VOD program interface can be as shown in FIG. 2 , at least including a navigation bar 510 and a content display area below the navigation bar 510 , the content displayed in the content display area will change with the selected control in the navigation bar. The program in the application layer can be integrated in the video-on-demand program to be displayed through a control in the navigation bar, or it can be further displayed after the application control in the navigation bar is selected.

In some embodiments, after the display device is started, it can directly enter the display interface of the last selected signal source, or the signal source selection interface, where the signal source can be a preset video-on-demand program, and can also be an HDMI interface, a live TV interface At least one of etc., after the user selects different signal sources, the display can display the content obtained from the different signal sources.

In some embodiments, when a video file is played by a display device, the video file includes video content and video information, and the video information is brief information of the video content, including video name, progress bar, episode number, and the like. Since the existing display device is only configured with one display, in order for the user to be able to view the video information synchronously when viewing the video content, the video content and the video information need to be displayed at the same time.

During the playback of the video file, in order not to block the main viewing content, the video progress bar is usually displayed at the beginning of playback, and will be automatically hidden if there is no operation within 5s. It can be seen that the user cannot view the video progress bar all the time, so that the user cannot know the real-time playback progress of the video file, and if the user wants to view it, the display of the video progress bar needs to be triggered, which is cumbersome and affects the user experience.

Therefore, in order to improve user experience, when using a display device to display a video file, the video content and video information of the video file can be displayed on a split screen. In this case, two monitors need to be configured for the display device to form a dual-screen display device. The video content is displayed on one display, and the video information is displayed on the other display, so as to avoid mutual occlusion between the video content to be displayed and the video information, and the video progress bar can be displayed on the other display all the time.

In some embodiments, in order to improve the user experience, the display device may be configured with two displays, namely a first display and a second display. The first display is used as the main screen (large screen) to display the display content of the corresponding application, such as Video content; the second display is used as a secondary screen (small screen) to display content such as social skills and information prompts to the user, such as video information, and during the video playback process, the video information is always displayed on the second display.

In some embodiments, the two displays can be controlled by a general controller. In this case, one controller is configured in the display device to form a dual-screen single-system display device. The controller communicates with the first display and the second display respectively, so as to realize the content display of the two displays.

In some embodiments, the two displays can be controlled by corresponding controllers respectively. In this case, two controllers are configured in the display device, which are the first controller and the second controller respectively, forming a dual-screen dual-system display. equipment. The first controller is configured with a first hardware system, which is a main chip; the second controller is configured with a second hardware system, which is a secondary chip.

FIG. 3 shows a structural block diagram of a dual-screen dual-system display device according to some embodiments. Referring to FIG. 3 , the first controller 210 is connected to the first display 201 , and the second controller 310 is connected to the second display 202 . The first controller controls the display of each content in the first display, and sends a broadcast to the second controller to inform the second controller to control the second display to display the content.

When the user operates the display device to generate a message or the device itself generates a message, the first controller sends the message that needs to be displayed on the second display to the second controller, so that the second controller displays the message on the second display middle.

In some embodiments, when the video content of the video file is played on the first display, the video information of the video file is sent to the second display for continuous display.

It can be seen that, by using the dual-screen display device to display the video file on a split screen, when the video content is displayed on the first display, the video information can be continuously displayed on the second display. For example, in a dual-screen display device, when a video file is played on a large screen, the small screen displays the playback progress of the video file, and a constant display function is configured for the playback progress, so that the user can see the current video in real time when viewing the video file. The playback progress of the file improves the user experience.

In some embodiments, in the display device provided by some embodiments of the present application, when playing a video file, in order to facilitate the user to watch the video file and the video progress bar at the same time and avoid excessive interaction, the video can be displayed synchronously in a split-screen manner File and video progress bar. And according to the playback status of the video file in the first display, the progress of the video progress bar in the second display is updated synchronously, so as to avoid the time difference between the playback progress of the two screens. Realize the synchronization of the playback progress of the large and small screens, and the user experience is good.

FIG. 4 shows a block diagram of a dual-screen display device according to some embodiments. In order to realize dual-screen synchronous playback of video files and improve user experience, some embodiments of the present application provide a display device, which is applied to a display device of a dual-screen single system. Referring to FIG. 4 , the display device 200 includes: a first display 201, is configured to present a first user interface, in which the content of each application, message or video file is presented; the second display 202 is configured to present a second user interface, in which system messages, notifications or Video information, etc.; a controller connected to the first display and the second display.

Fig. 5 shows a flowchart of a dual-screen synchronous playback method of a video file according to some embodiments, including steps S11, S12, and S13; Fig. 6 shows a dual-screen synchronous playback method of a video file according to some embodiments data flow diagram. Some embodiments of the present application provide a display device, which can be a dual-screen single-system display device. When performing the dual-screen synchronous playback method of a video file shown in FIG. 5 and FIG. 6 , the controller is configured to perform the following steps:

S11. In response to an operation that triggers playback of the video file, display the video file on the first display for playback.

When the user needs to use the display device to play a video file, different video files are presented in the first user interface of the display device, and the user can click a specified video file to play through a remote control or voice. The video file may be a video file provided in a video client, or a locally stored video file; the video client is an application configured in the display device.

Figure 7 shows a schematic diagram of presenting a video list in a first user interface according to some embodiments. After the user turns on the display device, the home page of the display device presents a user interface, and the user interface includes different types of applications such as my, recommendation, list, topic, video, and game. If the user wants to view the resources of the movie and TV class, the "movie movie" is triggered, and the video list is presented in the user interface. Referring to Figure 7, the video list includes a number of different video files, such as the TV series "Little Dad", "Everything is Good", "You Fei", etc. The user triggers "Everything is OK" in the list through the remote control or voice video file, the controller obtains the video content and video information of the video file from the server.

In order to improve the user experience, the dual-screen display device can realize the split-screen display of video files. Since the visible area of the first display is larger than that of the second display, the video content is displayed on the first display, and the video information is displayed on the second display.

Therefore, after the video file is acquired from the server or locally, the video content of the video file can be displayed on the first display for playback, and the video information of the video file can be displayed on the second display.

The video information includes information such as a progress bar, a video name, and the number of video episodes, and the video content is a video image of a video file. In order to avoid occlusion of the video screen, and the user can view the video progress bar synchronously when watching the video file, the video information also includes the playback progress information, the video information can be sent to the second display for display, and the video content can be sent. to the first display for display.

S12. During the playback of the video file, based on the playback progress and total duration of the video file, a progress bar page including a video progress bar is generated.

The video files are displayed in a split screen, and it is very easy for the playback progress of the video content in the first display to be out of sync with the playback progress corresponding to the video progress bar in the second display due to network problems or abnormal data transmission problems. Therefore, when the video progress bar is displayed on the second display, the video progress bar in the second display can be updated in real time according to the playback progress information of the video file played in the first display, so as to ensure synchronous playback on the dual screens. The playback progress information includes the playback progress and total duration of the video file.

In some embodiments, in order to realize dual-screen synchronous playback, a video progress bar that needs to be displayed on the second display can be determined in real time according to the playback progress and total duration of the video file during the playback process of the video file, and a video progress bar including a video progress bar can be generated. The progress bar page is displayed in the second display.

The display form of the video progress bar can be in the form of countdown or timing, and in addition to displaying the video progress bar, the progress bar page can also display the playback status of the current video file. The playback status shown in the monitor is consistent. The playback status includes pause, start, fast forward, fast reverse, advertisement start, advertisement end, etc.

In some embodiments, when the video progress bar adopts the countdown form, the controller is further configured as:

Step 1211: During the playback of the video file, obtain the total duration of the video file and the played duration corresponding to the current playback progress.

Step 1212: Calculate the remaining duration based on the total duration and the broadcast duration.

Step 1213 , based on the remaining time, generate a progress bar page including a video progress bar, the video progress bar adopts a countdown form, and the time length corresponding to the countdown form is the remaining time length.

During the process of playing the video file on the first display, from the initial playing, the video information including the playing progress information is sent to the second display in real time for display, so as to realize synchronous playing.

The playback progress information includes the total duration of the video file and the played duration corresponding to the current playback progress. At the initial playback moment, the played duration can be zero, or it can be the duration corresponding to the last time the video file was viewed and exited from playing. For example, if it is a brand new video file that the user has not watched before, the elapsed time is zero; if the video file has been watched by the user before and exits at 20:05, the elapsed time 20 minutes and 5 seconds. The total duration of the video file is the duration corresponding to the complete playback of the video file.

When the countdown form is adopted, the countdown duration is the duration of the part of the video file that has not been played, and the displayed duration gradually decreases as the playback progresses. Therefore, the difference between the total duration and the broadcast duration is calculated to obtain the remaining duration. For example, if the total duration T=42 minutes, and the broadcast duration t1=20 minutes and 5 seconds, the remaining duration t2=T-t1=21 minutes and 55 seconds.

FIG. 8 shows a schematic diagram of the effect of a video bar in the form of a countdown according to some embodiments. A video progress bar in the form of countdown is determined according to the remaining duration, see (a) in FIG. 8 , and the remaining duration of 21 minutes and 55 seconds is displayed on the right side of the UI diagram of the video progress bar. And as the playback progresses, an automatic countdown starts, see (b) and (c) in Figure 8, and displays 21 minutes and 54 seconds, 21 minutes and 53 seconds, . . .

The progress bar page is generated according to the video progress bar in the form of countdown to be displayed on the second display, so that the video progress bar in the second display dynamically adjusts the time in the form of countdown as the video file in the first display is playing. , to ensure that the dual-screen playback is synchronized.

In some embodiments, when the video progress bar adopts the timing form, the controller is further configured as:

Step 1221: During the playback of the video file, obtain the total duration of the video file and the current playback time corresponding to the current playback progress;

Step 1222, based on the total duration and the current playback moment, generate a progress bar page including a video progress bar, the video progress bar adopts a timing form, and the time corresponding to the timing form is the current playback moment.

When the timing form is used, the playback progress information includes the total duration of the video file and the current playback time corresponding to the current playback progress. The current playing time refers to the time point corresponding to the total playing time of the video file. At the initial playing time, the current playing time can be zero minutes and zero seconds, or it can be the time corresponding to the last time the video file was viewed and exited from playing. . For example, if it is a brand new video file that the user has not watched before, the current playback time is zero minutes and zero seconds; if the video file has been watched by the user before, or the user has performed operations such as pause, fast forward or rewind , if you exit the playback when the playback reaches 20:05, or perform operations such as pause, fast-forward, or fast-rewind when the playback reaches 20:05, the current playback time is 20:05 during playback.

When the timing form is adopted, the timing time is the time when the video file is being played, and the displayed time gradually increases as the playback progresses. Therefore, when generating a progress bar page, a video progress bar UI diagram is generated based on the total duration, an identification point is generated in the video progress bar UI diagram based on the current playback time, and a progress bar page is generated based on the identification point and the video progress bar UI diagram. The current playback time is displayed above the marker point, and as the playback progresses, the marker point moves to the right along the UI diagram of the video progress bar, and the current playback moment above it gradually increases.

FIG. 9 shows a schematic diagram of the effect of a video bar in a timing form according to some embodiments. Referring to (a) in Figure 9, when the total duration is 42 minutes and the current playback time is 20:05, a video progress bar UI diagram is generated based on the total duration 42:00, and the total duration 42 is displayed on the right side of the video progress bar UI diagram :00. On the video progress bar UI diagram, a marker point is displayed at a position corresponding to the current playback time 20:05, and the current playback time 20:05 is displayed above the marker point. As the playback progresses, see (b) and (c) in FIG. 9 , the marker point moves to the right, and the current playback time displayed above it sequentially displays 20:06, 20:07 . . .

The progress bar page is generated according to the video progress bar in the timing form to be displayed on the second display, so that the video progress bar in the second display dynamically adjusts the time in the timing form as the video file in the first display is playing. , to ensure that the dual-screen playback is synchronized.

In some embodiments, during the playing process of the video file, the user can perform operations such as pause, fast forward or fast rewind on the video file, so as to change the playing state of the video file. Then, when the video file in the first display performs the above operation, in order to facilitate the user to watch the playback status of the video file in time, the playback status can also be displayed on the second display. At this time, the generated progress bar page is displayed synchronously. The UI diagram corresponding to the playback state.

In some embodiments, when displaying the playing state, the controller is further configured to:

Step 1231: During the playback of the video file, obtain the total duration of the video file, the current playback state, and the current playback time corresponding to the current playback progress.

Step 1232, based on the total duration, the current playing state and the current playing time, generate a progress bar page including a video progress bar and a state UI diagram, the display form of the video progress bar includes a countdown form and a timing form, and the state UI diagram is used to represent the current playback. Status, the display status of the video progress bar is consistent with the current playback status.

When the second display needs to display the playback status of the video file synchronously, if the video file is paused, played, fast-forward, or fast-rewinded, the playback progress information includes the total duration of the video file, the current playback status, and the corresponding playback progress. the current playback time. The current play state is used to represent the type of operation performed by the user on the video file, such as a pause state, a play state, a fast-forward state, or a fast-rewind state.

A video progress bar is generated based on the total duration and the current playback time. The display form of the video progress bar includes a countdown form and a timing form. When generating, one can be selected for generation. For the generation process of the video progress bar in the countdown form and the video progress bar in the timed form, reference may be made to the content of the foregoing embodiments, which will not be repeated here.

Based on the current playback state, the corresponding state UI diagram is obtained, and the progress bar page is generated based on the video progress bar and the state UI diagram. The status UI diagram can be displayed on one side of the video progress bar, and the playback status displayed by the status UI diagram (display status of the video progress bar) is consistent with the playback status generated by performing a certain operation on the video file.

FIG. 10 shows a schematic diagram of the effect of a progress bar page including a state UI diagram according to some embodiments. Referring to (a) in Figure 10, under the scenario of generating a video progress bar in the form of a countdown, if the user performs a pause operation on the video file at the remaining 21 minutes and 55 seconds, the state UI diagram representing the pause state is obtained and displayed in the video. The left side of the progress bar. Referring to (b) in FIG. 10 , when the broadcast starts with 21 minutes and 42 seconds remaining, the state UI diagram of the playback state is obtained, and the state UI diagram of the playback state is replaced by the state UI diagram of the pause state for display.

S13. Display a progress bar page including a video progress bar on the second display, and the playback progress corresponding to the video progress bar is the same as the playback progress of the video file presented on the first display.

After the progress bar page including the video progress bar is generated based on the aforementioned method and according to the video information of the video file, the progress bar page including the video progress bar is displayed on the second display.

In some embodiments, a constant display function is configured for the progress bar page, and the video progress bar can be continuously displayed on the second display, so that the user can see the corresponding playback progress in real time when viewing the video file on the first display. Moreover, with the progress of the playing process, the playing progress corresponding to the video progress bar is the same as the playing progress of the video file presented on the first display, so as to realize dual-screen synchronous playing and improve user experience.

In some embodiments, during the playback of the video file, the user can perform different types of operations on the video file, thereby generating different playback states. Therefore, in order to enable the video progress bar presented in the second display to change synchronously with the playback state when the playback state is changed, the controller is further configured to:

Step 141: During the playback of the video file, in response to a state change instruction that triggers the video file to change the playback state, generate a new progress bar page based on the playback progress corresponding to the current playback state after the playback state is changed.

Step 142, displaying the new progress bar page on the second display, the playback status presented in the new progress bar page is the same as the current playback status after the video file playback status is changed, and the playback progress presented in the new progress bar page is the same as the current playback status. The corresponding playback progress is the same.

During the playback of the video file in the first display, according to the actual application scenario, if the user needs to perform operations such as pausing, starting, fast-forwarding or fast-rewinding on the video file, the playback state of the video file will be changed. In order to make when the playing state of the video file changes, the corresponding playing progress needs to be displayed on the second display synchronously.

Therefore, when the user triggers the video file to change the playback state, a state change instruction is generated, and the controller responds to the state change instruction. The video information obtained at this time includes the playback progress corresponding to the current playback state after the playback state is changed, and based on the state change The current playback time corresponding to the playback progress and the total duration of the video file are regenerated, and a new progress bar page including the video progress bar is regenerated.

The time displayed on the regenerated video progress bar is the current playback time corresponding to the state change. The display form of the regenerated video progress bar includes a countdown form and a timing form. When generating, one can be selected to generate. The video progress bar in the countdown form and the generation process of the video progress bar in the timer form can refer to the content of the foregoing embodiments, and will not be repeated here.

In some embodiments, when a new progress bar page is generated, a state UI diagram can also be displayed synchronously, and the state UI diagram is used to represent the playback state corresponding to the user performing a certain operation on the video file. For the generation process of the state UI diagram, reference may be made to the content of the foregoing embodiments, and details are not described herein again.

The new progress bar page is displayed on the second display to update the video progress bar displayed on the second display, so that the playback state presented in the new progress bar page is the same as the current playback state after the video file playback state is changed, and the new progress bar The playback progress presented on the page is the same as the playback progress corresponding to the current playback state, thereby ensuring synchronous playback on the dual screens.

For example, in order to ensure the synchronization of dual-screen playback, when the video file in the first display is paused, the video progress bar in the second display stops adjusting the time, and when the playback starts again, the video progress bar in the second display stops. bar restarts to adjust the time.

When the playback starts again, the controller regenerates the progress bar page according to the video information corresponding to the current playback, thereby ensuring that after a pause/start operation is performed, the playback progress corresponding to the video progress bar in the second display is the same as that of the first playback. The playback progress of the video files in the monitor is consistent.

When the video file in the first display performs a fast-forward or fast-rewind operation, based on the time adjustment interval of the fast-forward or fast-rewind, a progress bar page is regenerated according to the video information corresponding to the time adjusted by the fast-forward or fast-rewind operation. The video progress bar is updated in the second display, and the time corresponding to the video progress bar is consistent with the time when the video file is adjusted by the fast-forward or fast-rewind operation, thereby ensuring that the playback progress corresponding to the video progress bar in the second display is the same as that of the first display. The playback progress of the video files is consistent.

That is to say, every time an operation that affects the playback progress occurs, a new progress bar page will be generated in real time to adjust and correct the playback progress of the dual-screen, so as to prevent the time difference between the playback progress of the dual-screen and the second screen. The changed playback status is displayed on the monitor to ensure synchronous playback on both screens.

In some embodiments, related information such as the progress bar of the video file can be displayed only on the second display, and only the video content can be displayed on the first display. At this time, based on the user's operation on the video content in the first display, the progress of the progress bar in the second display is synchronized in real time, so as to realize dual-screen synchronous playback.

In some embodiments, while the related information such as the progress bar of the video file is displayed on the second display, the playback progress bar of the player can also be normally displayed on the first display.

In some embodiments, after the system receives the video data, it will call the player control to play the video data. The player control is generally configured with a playback progress bar that displays the playback progress of the video data. When there is no operation, it can be hidden, and after the user triggers the operation, the playback interface of the player is displayed to improve the user's viewing experience. In some embodiments, the playback progress bar can be displayed all the time. The playing progress bar of the player is displayed on the playing interface of the player control, and the playing interface of the player is displayed on the first display.

In some embodiments, when the video file is being played on the first display, when the user pauses or performs other operations on the video content in the first display, a progress bar will appear in the first display, and at this time, the large screen (the first display ) progress bar and small screen (second display) progress bar coexist. For example, when the user pauses, the progress bar in the large screen is paused according to the traditional logic, and the small screen is synchronously notified to pause the independent progress bar, so that the progress of the progress bar in the large and small screens is synchronized and the dual-screen synchronous playback is realized.

In some embodiments, the progress bar of the second display is a thread in parallel with the video player.

In some embodiments, the progress bar of the second display can trigger the thread when the playback interface of the player control is displayed on the first display, and can also trigger the thread when the full-screen playback of the player control is displayed on the first display.

In some embodiments, the control calls the player to play the video data and displays the player interface on the first display, and simultaneously starts the progress bar thread of the second display, and the second progress bar thread executes the progress bar based on the playback progress of the player. The playback progress is displayed.

In some embodiments, during video playback, when the playback progress bar of the first display is hidden, the second progress bar of the second display is still displayed, so that the user can intuitively understand the playback progress without affecting the viewing of the video .

In some embodiments, the display interface of the second display includes at least two areas, one area is used to display a progress bar, and the other area is used to display prompt information.

In some embodiments, the display of the progress bar on the second display may be interrupted by a higher priority message, but the thread controlling the progress bar is still running in the background, so that the progress bar resumed after the display of the message ends is still guaranteed Accurate progress display.

In some embodiments, when using the dual screen of the display device to play the video file, the second progress bar thread does not actively acquire the playback progress of the player, but will obtain the video duration and playback progress last time based on the current clock and the previous The clock at the time of the second acquisition controls the progress display of the progress bar on the second display. Using the local clock to control the progress bar of the second display, there is no need for frequent communication with the player or the module that manages the player, which improves the operating efficiency of the system. If the user does not perform corresponding operations on the video content in the first display, such as pause, play, fast-forward, fast-rewind, etc., that is, during no operation on the large screen, the progress bar in the second display will advance the progress bar according to the local clock. progress. At this time, the small screen does not depend on the playback progress of the large screen.

In some embodiments, since the progress bar displayed in the second display is independent, its progress advancement is based on the local clock, so that when the user operates the video content in the first display to pause, fast forward or rewind, the second display If the progress bar in the screen still advances the progress according to its own logic, it is very likely that the playback progress of the video content in the first display is inconsistent with the progress of the video content in the first display, that is, the progress of the large and small screens is out of synchronization. At this time, the method of the present application can be used to adjust the progress bar in the second display according to the playback progress of the video content in the first display in real time based on the user's operation on the first display, so that the progress bar can be played synchronously with the video content.

In some embodiments, since the user's operation of the video playback is based on the control of the video player, since the thread/module controlling the second progress bar does not frequently obtain the real-time progress of the player, the second display may appear The playback progress is inconsistent with the playback progress of the player. For example, the user performs operations such as fast-forward, fast-rewind, and pause in the player of the first display, or the first display performs advertisement insertion, which causes the video data playback terminal to play again. Or the network jam or codec jam causes the player to play not smooth enough. To solve this problem, the controller will display the playback progress when the player's progress is paused, started, dragged, stepped or other non-real-time playback situations. Synchronized to the management thread/module that controls the progress bar of the second display, so as to synchronously adjust the progress bar of the second display.

In some embodiments, a long-period progress synchronization can also be set, for example, the period is greater than or equal to 2 seconds, or even a minute-level synchronization period can be set for synchronization. Combined with using the local clock to control the progress bar of the second display, it can also accurately display While playing the progress, solve the unnecessary loss caused by real-time synchronization.

In some embodiments, performing pause and start operations on video files can be triggered automatically by the system in addition to manual operations by the user. For example, if there is an advertisement file in the video file, normally, when the advertisement is played, the video file is in a paused state, and after the advertisement is played, the video file starts to play again and is in a playing state.

Therefore, when the advertisement is played, the video progress bar in the second display needs to be adjusted synchronously. Specifically, in this process, the controller is further configured to:

Step 151: If there is an advertisement file in the video file, in the process of playing the video file including the advertisement file, obtain the initial playing time and the ending playing time of the advertisement file corresponding to the total duration.

Step 152, in response to the pause playback instruction generated when the playback progress reaches the initial playback time, stop playing the video file, and generate a new progress bar page based on the playback progress corresponding to the stopped playback state, and display it on the second display, the new progress bar page. The playback status displayed in the new progress bar page is the same as the playback progress corresponding to the initial playback moment.

Step 153, start playing the video file in response to the start playing instruction generated when the playback progress reaches the end of the playback time, and generate a new progress bar page based on the playback progress corresponding to the start playing state, and display it on the second display, the new progress bar page. The playback status displayed in the new progress bar page is the same as the playback progress corresponding to the end playback time.

When an advertisement file exists in the video file, the initial playing time and the ending playing time of the advertisement file are determined based on the time in the total duration.

FIG. 11 shows a schematic diagram of the effect of playing a video file on two screens according to some embodiments. Referring to FIG. 11 , if the user selects a video file of "everything is fine" to play, the video content of "everything is fine" is displayed on the first display, and the video information is displayed on the second display. Video information includes video name, video episode number, and video progress bar. The video progress bar shown in Figure 15 is in the form of a countdown, and the remaining time is 25 minutes and 15 seconds.

In the process of continuously playing the video file, if the time corresponding to the playing progress of the video file reaches the initial playing time, the advertisement needs to be played at this time, and the playing of the video file is paused, and a play pause instruction is generated. If the time corresponding to the playback progress of the video file reaches the end playback time, it means that the advertisement has been played and the video file can be played again, and a start playback instruction is generated.

In some embodiments, when the controller responds to the pause instruction, the first display starts to play the advertisement file, and stops playing the video file in the background. At this point, the video file is in a stopped state.

In order to synchronize the display content in the second display, a new progress bar page is generated based on the playback progress corresponding to the stopped playback state, and displayed on the second display. The playback progress corresponding to the initial playback time is the same. For the implementation process of generating a new progress bar page, reference may be made to the content of the foregoing embodiments, and details are not described herein again.

FIG. 12 shows a schematic diagram of the effect of starting to play an advertisement file according to some embodiments. Referring to Figure 12, if the total duration of the video file is 42 minutes, and there is an advertisement file between the 20th minute and the 20th minute and 15 seconds, the initial playback time of the advertisement file is 20:00, and the corresponding remaining duration is 22 minutes. seconds; the end playback time is 20:15, corresponding to the remaining time of 21 minutes and 45 seconds. Therefore, when the initial playback time corresponding to the playback progress of the video file is 20:00, the advertisement file starts to be played in the first display, and the video file is stopped in the background. The time corresponding to the state is 20:00, and the corresponding remaining time is 22 minutes and 0 seconds.

In some embodiments, when the playback progress of the video file reaches the end playback time at 20:15, the start playback instruction is generated. When the controller responds to the play start instruction, the advertisement file in the first display is finished playing and exits the display, and meanwhile, the first display continues to display the video file and restarts the playback. At this time, the video file is in the start playing state, and the remaining duration of the corresponding display is 21 minutes and 45 seconds, which is not shown in the figure.

In order to synchronize the display content in the second display, a new progress bar page is generated based on the playback progress corresponding to the start playback state, and displayed on the second display. The new progress bar page presents the start playback state, and the playback progress presented in the new progress bar page It is the same as the playback progress corresponding to the end playback time. For the implementation process of generating a new progress bar page, reference may be made to the content of the foregoing embodiments, and details are not described herein again.

It can be seen that when there is an advertisement file in the video file, the operations of playing the advertisement and stopping the playing of the advertisement are also operations that affect the playing progress and the playing state of the video file to change. Therefore, when the advertisement is played or the advertisement is finished, it is necessary to synchronize the playback progress and playback status of the corresponding video file to the second display, and the second display will display it according to the newly generated new progress bar page to realize dual-screen synchronous playback. .

In some embodiments, when the user performs operations such as pausing/playing/fast-forwarding/rewinding on the video file, the controller changes the playback state of the video file in the first display after sensing the corresponding user instruction, and at the same time, performs Assembling the data, generating a progress bar page and sending it to the second display for display, so as to refresh the display content of the second display based on the current playback progress of the video file. For example, if it is a pause command, the refresh of the playback progress of the second display will be stopped; if it is a start command, the playback progress will be refreshed based on the new progress bar page, and then the playback timing will be restarted.

In some embodiments, because the video information of the video file is all low-priority information display, during the display process of the second display, if the controller sends other messages, the display of the video progress bar will be covered. The priority of the message is higher than or equal to the priority of the video information, and the message may be a recommendation of related electronic media resources, a system notification, or the like. The message is a short-lived message and only needs to be displayed briefly. Therefore, when the display time of the message reaches a preset duration (eg, 15 seconds), the display of the message is canceled, and the video progress bar is displayed again.

FIG. 13 is a schematic diagram illustrating the effect of displaying media asset recommendation information in the second display according to some embodiments. When the video file played by the user is "all good", the dual-screen display effect is shown in Figure 11. Referring to FIG. 13 , if the controller generates media asset recommendation information, it is sent to the second display. The priority of the media asset recommendation information is higher than the video information, so it can be displayed on the second display, for example, "The Hidden Corner will be played below". After the media asset recommendation information is displayed for more than 15 seconds, the display of the media asset recommendation information is canceled, and the video progress bar is displayed again to restore the state shown in FIG. 11 .

In some embodiments, when the user quits playing the video file, the large screen is controlled to be released on the player, and the data notification is organized to the small screen at the same time. After receiving the exit play instruction, the small screen will cancel the display of the progress bar, and then display the default home page of the small screen.

Therefore, when the video file in the first display exits playback, the controller is further configured to:

Step 161, in the video file playing process, in response to the exit play instruction that triggers the video file to quit playing, cancel the display of the video file in the first display, and the display of the progress bar page in the second display.

Step 162: Obtain the default home page of the second display, and display the default home page on the second display.

If the user wants to exit the playing of the video file during the playing process of the video file, the exiting of the video file is triggered by pressing a button on the remote control, and an exit play instruction is generated. At this time, the controller responds to the quit playing instruction and controls the first display to no longer display the video file, and at the same time, the second display no longer displays the progress bar page.

In order to restore the normal operation state of the display device, the default home page of the second display is acquired, and the default home page is displayed on the second display. The default home page is used to display information such as date, time, volume, number of messages, etc.

It can be seen that the display device provided by some embodiments of the present application can display video files on a split screen, that is, display the video content of the video file on the first display, and continuously display the video information of the video file on the second display, which is convenient for users. Watch the video file and the video progress bar at the same time to avoid too much interaction. When the video information is displayed on the second display, the progress and state of the video progress bar in the second display can be updated synchronously according to the playback status and playback progress of the video file in the first display, so as to avoid a time difference between the playback progress of the two screens, In this way, it can be ensured that in different playback scenarios, the playback progress of the large and small screens can be synchronized according to the synchronization of the playback status, and the user experience is good.

When the display device provided by the foregoing embodiment executes the dual-screen synchronous playback method of video files, it is applied to a display device of a dual-screen single-system, and both displays are controlled by a general controller, that is, the first display and the second display are controlled. The process of displaying the content on the two displays is controlled by the overall controller.

In other embodiments, the display device may also be a dual-screen dual-system display device, that is, the first controller controls the display of each content in the first display, and sends a broadcast to the second controller to inform the second controller Control the second display to display content. In a dual-screen dual-system display device, the first controller is the main controller, and the second controller is the auxiliary controller. The message that needs to be displayed on the second display is generated in the first controller, and the first controller will The message is sent to the second controller, and the second controller controls the second display to display.

FIG. 14 shows a service sequence diagram of a method for synchronously playing a video file on two screens according to some embodiments. Referring to FIG. 14 , the video file to be displayed is triggered by the application (large-screen application) configured in the first controller, and the large-screen application obtains the specified video file from the server and generates playback progress information of the video file.

In the scenario of dual-screen display, the first controller needs to send the playback progress information of the video file to the second controller, so that the second controller refreshes the video progress displayed on the second display according to the playback progress information of the video file. progress of the bar.

In some embodiments, when sending the playback progress information of the video file, a HIRPC (dual-screen information transfer channel) is configured in the first controller, and the first controller forwards the playback progress information of the video file to the second controller through HIRPC .

In some embodiments, if the user wants to watch the video file, a start instruction is generated, and the first controller displays the video content of the video file on the first display; at the same time, the playback progress information of the video file is forwarded to the first display through HIRPC. Two controllers. The second controller generates a progress bar page according to the playback progress information of the video file, and displays the progress bar page on the second display. The playback progress information includes the playback progress and the total duration.

In some embodiments, if the user wants to fast-forward or rewind the viewing video file, a fast-forward or fast-rewind instruction is generated. The first controller, in response to the fast-forward instruction or the fast-rewind instruction, plays the video content of the video file forward or backward and displays it on the first display; at the same time, the current playback of the video file corresponding to the fast-forward or fast-rewind operation is displayed. The progress information is forwarded to the second controller via HIRPC. The second controller generates a progress bar page according to the playback progress information of the video file, and displays the progress bar page on the second display, so as to refresh the video progress bar displayed on the second display.

In some embodiments, an exit play instruction is generated if the user wants to exit viewing the video file. The first controller cancels the display of the video content in the first display in response to the exit play instruction; at the same time, forwards the exit play instruction to the second controller through HIRPC. The second controller acquires the default home page of the second display, and displays the default home page on the second display.

In some embodiments, some embodiments of the present application provide a display device, comprising: a first display configured to present a first user interface, in which content of each application, message or video is presented; a second display , configured to present a second user interface in which system messages, notifications or video information, etc. are presented; a first controller connected to the first display, the first controller being configured to: in response to triggering a video In the file playing operation, the video file is displayed on the first display for playing; the playing progress and total duration of the video file are sent to the second controller. A second controller connected to the second display, the second controller is configured to execute a method for synchronizing the progress of the video file in dual-screen playback.

FIG. 15 shows another flowchart of a method for synchronizing the progress of a video file on a dual-screen playback according to some embodiments. A display device provided by some embodiments of the present application may be a dual-screen dual-system display device. When executing the method for synchronizing the progress of the dual-screen playback of a video file shown in FIG. 15 , the second controller is configured to perform the following steps :

S21. During the playback of the video file, receive the playback progress and total duration of the video file sent by the first controller.

S22. Generate a progress bar page including a video progress bar based on the playback progress and total duration of the video file.

S23. Display the progress bar page including the video progress bar on the second display, where the playback progress corresponding to the video progress bar is the same as the playback progress of the video file presented on the first display.

In the dual-screen dual-system display device, since the first controller is the main controller, the messages that need to be displayed on the first display and the messages displayed on the second display are both generated in the first controller.

When implementing split-screen display, the first controller displays the video content of the video file on the first display, and at the same time, the first controller sends the playback progress and total duration of the generated video file to the second controller, and the second controller sends the video file to the second controller. After receiving the playback progress and total duration of the video file, the controller generates a progress bar page including a video progress bar.

The second controller displays a progress bar page including a video progress bar on the second display, and the playback progress corresponding to the video progress bar is the same as the playback progress of the video file presented on the first display.

For the specific execution process of the first controller and the second controller, reference can be made to the execution process of the dual-screen single-system display device in the foregoing embodiment, which will not be repeated here.

In some embodiments, when the user performs operations such as pausing/playing/fast-forwarding/rewinding on the video file, the first controller changes the playback state of the video file in the first display after sensing the user's instruction, and at the same time, performs The data is assembled, and the playback progress information corresponding to the current playback state and the playback progress is sent to the second controller. After receiving the playback progress message, the second controller will regenerate a new progress bar page to refresh the current playback progress. For example, after receiving the command sent by the first controller, the second controller will first judge the type of the command, and if it is a pause command, it will stop the refresh of the playback progress of the small screen; if it is a start command, it will be based on the new progress bar page. A refresh of the playback progress, and then restarts the timing for playback.

In some embodiments, during the process of displaying the video progress bar on the second display, if the first controller sends another message to the second controller, the second controller determines that the priority of the message is higher than the priority of the video progress bar , therefore, the message will be displayed on the second display over the playback progress bar. When the display duration of the message reaches a preset duration (for example, 15 seconds), the display of the message is canceled, and the video progress bar is displayed again.

In some embodiments, when the user quits playing the video file, the first controller controls the player to release and cancels the display of the video content on the first display; at the same time, the quit playing instruction is forwarded to the second controller, and the second controller receives After exiting the playback command, the display of the progress bar will be cancelled, and then the default home page of the small screen will be displayed.

It can be seen that when using a dual-screen display device, the user selects a video file for display through the content displayed on the first display (large screen) after powering on, and displays the video content of the video file on the first display; at the same time, the playback progress information of the video file is displayed. sent to the second controller. The second controller receives the progress information, generates a progress bar page including a video progress bar, and displays the progress bar page on the second display. Moreover, when the playing state of the video file in the first display changes, the video progress bar displayed in the second display is refreshed synchronously, so as to avoid a time difference between the two screens and realize the simultaneous playback of the two screens. The above process can be applied to a dual system or a single system, and the only dependent scenario is a display device that requires split-screen display of content, that is, a dual-screen display device.

It can be seen from the above technical solutions that a display device provided by some embodiments of the present application displays the video file on the first display for playback when executing the dual-screen synchronous playback method of the video file; The playback progress and total duration of the video file are generated, and a progress bar page including the video progress bar is generated; the progress bar page including the video progress bar is displayed on the second display, and the playback progress corresponding to the video progress bar is the same as the video presented in the first display. The playback progress of the file is the same. It can be seen that the display device can display the video file on a split screen, so as to continuously display the video progress bar on the second display, so that the user can watch the video file and the video progress bar at the same time and avoid excessive interaction. During the playback process, the progress and status of the video progress bar in the second display can be updated synchronously according to the playback status and playback progress of the video file in the first display, so as to avoid the time difference between the playback progress of the two screens, thereby ensuring that different In the playback scenario, the playback progress of the large and small screens is synchronized according to the synchronization of the playback status, and the user experience is good.

FIG. 16 shows a message display interaction diagram of a dual-screen dual-system display device according to some embodiments. Referring to FIG. 3 and FIG. 16 , in some embodiments, when the display device uses dual-screen to display content, due to the existing The display mode of the secondary screen when displaying messages is a fixed mode, resulting in a relatively single content displayed on the secondary screen, unable to display more content, and poor user experience. Therefore, in order to enable the display device to automatically switch the display mode of the content on the secondary screen according to the application scenario of the information display, some embodiments of the present application provide a method for displaying the content on the secondary screen, which The secondary screen (second display) automatically switches the information display mode.

In order to improve the user experience, when the secondary screen displays message content, in some scenarios, the secondary screen needs to obtain the control focus of the remote control. For example, if the message to be displayed on the second display is a media asset recommended to the user, at this time, if the user is interested, it can be switched to watch, that is, the media asset content can be switched and displayed on the first display. At this time, after the user triggers the menu key on the remote control, the second display responds to the operation to trigger the media asset information displayed on the second display, so that the content of the recommended media asset is displayed on the first display.

Under normal circumstances, the user triggers an operation generated by a button on the remote control, and the first display responds. Therefore, in order to ensure that the second display can preferentially respond to the buttons of the remote control when the content of the message needs to be displayed by jumping, it is necessary to register a focus monitoring thread for the second display, that is, to preempt the button information of the remote control first (the implementation method can be the response of preempting the button) value).

FIG. 17 shows a flowchart of a method for displaying content on a secondary screen according to some embodiments; FIG. 18 shows a data flow diagram of a method for displaying content on a secondary screen according to some embodiments. Some embodiments of the present application provide a display device, which can be a dual-screen single-system display device. When performing the method for displaying content on the secondary screen shown in FIG. 17 and FIG. 18 , the controller is configured to perform the following steps:

S11A, when generating a message that needs to be displayed on the second display, determine whether there is a jump identifier used to represent a jump play function in the message, and the jump play function is used to receive a confirmation operation for the message, The content corresponding to the message is displayed on the first display.

The messages generated during the use of the display device include messages generated when a user triggers an operation, messages generated when system parameters are adjusted, and the like. The user-triggered operation includes an operation that the user triggers a video file to play, such as clicking a video resource in a video client or clicking a locally stored video file.

When a video file is clicked by the remote control or voice, the video content of the video file is displayed on the first display, while other video information can be displayed on the second display, avoiding the need to perform any editing on the content in the first display. occlude. At this time, the message generated when the user clicks on a certain video file is the video information that needs to be displayed on the second display.

In some embodiments, when the video file is played, the controller is further configured to:

Step 1111: Acquire video content and video information of the video file in response to the operation triggering the playback of the video file.

Step 1112: Display the video content on the first display, and generate a message that needs to be displayed on the second display based on the video information, where the message represents the video information of the currently playing video file.

When a display device needs to be used for video playback, a video list including different video files is presented in the first user interface of the first display, and the user can trigger a video file in the list to play through a remote control or voice.

Continuing to refer to Figure 19, the "all good" episode content is presented on the first display, and the video information is presented on the second display. The video information includes information such as progress bar, video name, number of video episodes, etc. The video content is a video image of a video file. In order to avoid blocking the video image, the video information is sent to the second display for display. At this time, a message that needs to be displayed on the second display can be generated based on the video information, and in the current scenario, the generated message is used to represent the video information corresponding to the currently playing video file.

In some embodiments, after the adjacent playback of a certain video file is completed, a file similar to the video file may also be generated to be pushed to the user. Therefore, when a message that needs to be displayed on the second display is generated by pushing media assets during the playing of the video file, the controller is further configured to perform the following steps:

Step 1113: When playing the video file, if the playing duration of the video file satisfies the push time condition, generate post-simulcast information based on the video file.

Step 1114, adding a jump sign for the post-simulcast information, and, based on the post-simulcast information added with the jump sign, generate a message that needs to be displayed on the second display, and the post-simulcast information refers to the video recommended to the user to be played at the current time. Media assets to be displayed after the file finishes playing.

When using a dual-screen display device to play a video file, if the video file is near the time when the playback is completed, for example, the playback duration of the video file satisfies the push time condition, post-simulcast information can be generated based on the video file. The push time condition refers to the time condition under which the video resource can be pushed. In some embodiments, the push time condition can be set to be the first 30 seconds of the overall duration of the video file, that is, the first 30 seconds after the video file is played. Post-simulcast information can be generated according to the currently playing video file.

FIG. 20 shows a schematic diagram of presenting a media asset recommendation message on a secondary screen according to some embodiments. Referring to FIG. 20 , if the recommended media asset is "Summer Health and Wellness Tips" after the adjacent playback of a certain video file is completed, the generated post-simulcast information is "Summer Health and Health Tips Tips".

Post-simulcast information refers to media assets recommended to users for display after the currently playing video file finishes playing. Since the post-simulcast information is a video resource pushed to the user, in order for the user to be able to click on the pushed video resource to play it, when a message that needs to be displayed on the second display is generated, a jump identifier can be added to the post-simulcast information, The jump identifier is used to represent that a certain message has a jump play function, and the jump play function is used to display the content corresponding to the message displayed on the second display on the first display. When there is a jumping mark, an operation prompt can be popped up synchronously on the second display to inform the user to perform a corresponding operation, and the prompt content can be "click the menu key to view".

Based on the post-simulcast information added with the jump identifier, a message that needs to be displayed on the second display can be generated. Displaying the post-simulcast information on the second display can prevent the information from obscuring the video picture of the video file being watched, and improve user experience.

FIG. 21 shows another schematic diagram of presenting a media asset recommendation message on a secondary screen according to some embodiments. Referring to FIG. 21 , in some embodiments, when a certain video file is played by a display device, when a certain actor's face appears in the video picture presented in the first display, the actor's face may be generated based on the actor's face. Other video resources to push to users. For example, if the image of "Yao Chen" appears on the video screen when playing the "Everything is good" video file, you can search for resources based on the image of "Yao Chen", and push video resources related to "Yao Chen" to the user.

At this time, the generated push resource is the message that needs to be displayed on the second display currently, and the message displayed on the second display can be in the form of "Yao Chen's highlights, enjoy the idol lens".

The above-mentioned files or video resources that can be recommended to users are post-simulcast information (as shown in Figure 20 or Figure 21). Post-simulcast information refers to the files that can be played subsequently based on the user's selection after the current video file is played. . The post-simulcast information is notification type information and can be displayed on the second display. At this time, a message to be displayed on the second display can be generated based on the post-simulcast information.

Since the post-simulcast information is displayed on the second display, and the first display is used to present the video content of the currently playing video file, in order to facilitate the user to know that the information currently presented on the second display is clickable information, based on When the post-simulcast information is played by jumping, a jumping mark can be added to the post-simulcast information, and an operation prompt can be displayed on the second display synchronously, and the prompt content can be "click the menu button to view".

In some embodiments, the messages generated during use of the display device, in addition to messages generated by user-triggered operations, may also be generated when system parameters are adjusted. System parameters include but are not limited to volume, number of notifications, number of messages, WiFi signal, etc.

Therefore, when the system parameters are adjusted, the controller is further configured to perform the following steps when executing a message that needs to be displayed on the second display:

Step 1121: Acquire the adjusted system parameters in response to the operation triggering the adjustment of the system parameters.

Step 1122 , based on the adjusted system parameters, generate a message that needs to be displayed on the second display, where the message represents the adjusted system parameters.

When the user adjusts the system volume, or when the system receives a notification or information, the corresponding system parameters are changed, that is, 1 is added to the original value. The system parameters are usually displayed on the second display. Therefore, based on the adjusted system parameters, a message that needs to be displayed on the second display can be generated. In the current scenario, the generated message is used to indicate that the system automatically or the user manually Adjusted system parameters.

FIG. 22 is a schematic diagram showing parameters of a secondary screen presentation system according to some embodiments. Referring to FIG. 22 , if the user adjusts the system parameters of the display device during the process of playing the video file "Everything is fine", the adjusted system parameters can be displayed on the second display.

For example, if the system volume value currently displayed on the second display is 28, and the user increases the volume value by triggering the volume key on the remote control, the information of the increased volume value is sent to the second display for display. If two volume values are increased , the system volume value currently displayed on the second display is 30. At this time, the current system volume value 30 is the message that needs to be displayed on the second display.

In some embodiments, the messages that can be displayed in the second display may also include messages generated by user-defined alarm reminders, schedule reminders, and the like. When the current time reaches the user-defined reminder time, the corresponding alarm clock information or schedule information can be displayed on the second display.

It can be seen that based on the foregoing content, the main screen will send a broadcast when it needs to trigger the secondary screen to display messages. Common scenarios include, but are not limited to, one type of status display messages, for example, volume increases, decreases, WiFi strength occurs Changes, such as notifications or messages; the other type is information display messages. For example, when playing a movie, if there is a recommended movie based on a certain actor, a message will be sent to the secondary screen, or it will be pushed to the secondary screen when the playback is completed. Post-show hookup information.

In some embodiments, in order to facilitate the user to play the post-simulcast information presented in the second display by jumping, after the message is generated, it can be determined whether there is a jump identifier in the message. When there is a jumping mark, an operation prompt can be popped up synchronously on the second display to inform the user to perform a corresponding operation, and the prompt content can be "click the menu key to view".

S12A. If there is a jump identifier in the message, register a focus monitoring thread for the second display, and display the message on the second display, where the focus monitoring thread is used to implement the first pre-prediction after the message is displayed on the second display. Within the set time period, the second display responds preferentially to the received operation control command.

If it is determined that there is a jump identifier in the message, it indicates that the current message is a media asset recommendation message, and the user can click to play. Usually, when the user triggers a button on the remote control, the first display will respond first, which will cause the message displayed on the second display to be unable to be triggered and skip playback to be performed.

Therefore, in order to enable a focus monitoring thread to be registered for the second display when skip playback is required, the focus monitoring thread is used to enable the second display to preferentially respond to the operation control instruction generated based on the message. At the same time, the message is displayed in the second display.

When the message is displayed on the second display, if there is a jump identifier in the message, the second display will register a monitor after receiving the message, and after the registration is completed, the second display can preferentially respond to the registered remote control keys. For example, when the user triggers a menu key on the remote control, the second display responds preferentially to the key value to trigger a media asset recommendation message.

At this time, the video content of the recommended media asset is displayed on the first display, and the video information is displayed on the second display. In this process, the content presented on the first display is switched from the video content of the original video file to the video content of the recommended media asset, and the content presented on the second display is switched from the video information of the original video file to the recommended media. video information.

S13A. If there is no jump identifier in the message, do not register the focus monitoring thread for the second display, and display the message on the second display, wherein, when the second display does not register the focus monitoring thread, the first display does not register the focus monitoring thread for the second display. The received operation control command responds.

If it is judged that there is no jump sign in the message, it means that the message is not a media asset recommendation message, and the user cannot perform a click operation. on the display. Moreover, when the user triggers a button on the remote control when the second display does not register the focus monitoring thread, the first display responds to the received operation control instruction.

In some embodiments, if the message displayed by the second display carries a jump identifier, it means that the second display has registered the focus monitoring thread. At this time, the user can decide whether to perform skip playback according to the pop-up notification on the second display.

To this end, when the second display registers the focus listening thread, the controller is further configured to perform the following steps:

Step 141: Under the condition that the second display registers the focus monitoring thread, receive an operation control instruction generated based on the message displayed by the second display, and obtain the current display duration of the corresponding second display display message when the operation control instruction is generated;

Step 142, if the current display duration of the message is within the first preset duration, control the second display to respond to the operation control instruction, and obtain the display content of the message, and display the display content corresponding to the message on the first display;

Step 143: If the current display duration of the message exceeds the first preset duration, control the first display to respond to the operation control instruction, and cancel the registration of the focus monitoring thread of the second display.

In the case where the second display registers the focus monitoring thread, the second display synchronously displays the notification when displaying the message, so as to inform the user that the message can be triggered for skip playback by triggering the menu key of the remote control.

Referring again to the content shown in FIG. 20 and FIG. 21 , which are schematic diagrams of the second display with the skip play function. If the received message is a recommended message for media resources such as "Summer Health Tips" or "Yao Chen's Highlights, Enjoy Idol Lens", and when the message is displayed on the second display, it is detected that there is a jump sign in the message , indicating that the message is a media asset recommendation message, and an operation prompt pops up on the second display to inform the user that a jump operation can be performed, and the prompt content can be "click the menu button to view".

If the user is interested in the message displayed on the second display, a corresponding operation may be performed according to the notification content, such as triggering a menu key on the remote control to generate an operation control instruction.

In some embodiments, when the dual-screen display device is running, the first display usually preempts the key value of the remote control first, and to implement the jump play function, a focus monitoring thread is configured for the second display. However, this function is not always configured on the second display. If the user does not perform the jump play operation based on the media resource recommendation message, and the second display is always in the focus preemption state, the user will be affected. other operations.

Therefore, in order to avoid affecting the normal operation of the display device, the registration of the focus monitoring thread for the second display is time-sensitive, that is, the first preset duration is set. If the user generates a jump playback operation within the first preset time period, the jump playback process is executed; if the user does not generate a jump playback operation after the first preset time period, the focus monitoring thread of the second display is released.

In some embodiments, the first preset duration may be set to 15 seconds, or may be other values, which are not specifically limited here.

Therefore, when the controller receives the operation control instruction generated based on the message displayed by the second display, the controller acquires the current display duration of the message displayed on the second display corresponding to the generation of the operation control instruction, and determines whether the current display duration satisfies the first preset duration time conditions.

In some embodiments, if the current display duration of the message is within the first preset duration when the operation control instruction is generated, it means that the user is interested in the message displayed on the second display, and in this case, the message is generated within the first preset duration The jump play operation is to control the second display to respond to the operation control instruction.

Since a focus monitoring thread is registered on the second display, the operation control instruction can be preferentially responded to, and the operation control instruction can trigger the content display of the message. Usually, the content of the message is displayed on the first user interface. Therefore, when the second display preferentially responds to the operation control command, the controller obtains the display content of the message, and displays the display content corresponding to the message on the first display. At this time, The video information of the message, such as a progress bar, video name, etc., is switched and displayed in the second display.

In some embodiments, if the current display duration of the message exceeds the first preset duration, it means that the user's trigger operation has timed out, and the jump play operation cannot be performed based on the message in the second display. In this case, the first display is controlled to respond The operation control instruction, and the cancellation of the registration of the focus monitoring thread of the second display.

That is to say, if the user generates a jump playback operation within the first preset time period, the jump playback process is executed; if the user does not generate a jump playback operation after the first preset time period, the second display is released. Focus listener thread.

From the moment when the message is displayed, the display time is counted. If the operation of triggering the menu button of the remote control occurs when the display time is within 15 seconds, the jump playback process is performed, that is, the content corresponding to the message is obtained and the message is displayed. The corresponding content is presented in the first display.

If the user's operation of triggering the menu key of the remote control is not received when the display time reaches 15 seconds, the registration of the focus monitoring thread of the second display is cancelled, and at this time, the key of the remote control is returned to the first display for priority response.

It can be seen that, when the display device provided by some embodiments of the present application generates a message that needs to be displayed on the second display, if the message carries a jump identifier, the second display registers the focus that preferentially responds to the menu key value of the remote control monitor thread. At this time, the user triggers the menu key of the remote control within the first preset time period, and the second display responds preferentially to the key value to realize the operation of triggering the displayed message. Then, the content and information of the message are acquired, and the content is displayed on the first display. The first display is switched from displaying the original content to displaying the content of the message, and the information of the message is displayed on the second display to realize skip playback. .

In some embodiments, the second display usually adopts a fixed mode when displaying a message, and the user experience is not good. Therefore, in order to improve user experience, the dual-screen display device can automatically switch the display mode on the secondary screen according to different display demand scenarios when displaying messages on the secondary screen.

Accordingly, the controller, in performing the presenting of the message in the second display, is further configured to perform the following steps:

Step 151: Determine the message type of the message according to the type identifier in the message.

Step 152, if the message type of the message is the information display type, then control the second display to display the message according to the current display mode of the second display, the information display type is used to represent the media asset information, and the current display mode includes a fusion mode and a simple mode. The mode refers to the mode in which the media asset information display area and the system status display area are presented in the viewport of the second display; the simple mode refers to the mode in which the media asset information display area is presented in the viewport of the second display; The system state display area is used for displaying messages of the information display type corresponding to the content presented in the first display, and the system state display area is used to display the messages of the state display type generated when the system parameters are changed.

Step 153: If the message type of the message is the state display type, control the second display to display the message in the fusion mode, and the state display type is used to represent the system parameters.

Since the message generated by the display device includes a message generated by a user triggering an operation and a message generated when a system parameter is adjusted, the message will carry a type identifier when it is generated, and the type identifier is used to identify the type of the message. Therefore, the type of the currently transmitted message can be determined according to the type identifier carried in the message. The possible message types are information display type and status display type. The information display type is used to represent media asset information, such as video information when playing a video file, recommended videos, post-simulcast information pushed after completion of adjacent playback, and so on. The status display type is the message generated when the system parameters are changed, such as time, date, volume increase, decrease, WiFi strength change, notification and session messages, etc.

Different message types correspond to different display demand scenarios, so different display modes can be used. In some embodiments, the presentation modes of the second display include a blended mode and a simple mode. The fusion mode can display information display type messages and status display type messages at the same time. The fusion mode includes a system status display area (status bar on the left) and a media asset information display area (content display area on the right). The simple mode is a mode that only displays information display type messages, without a status bar, all of which are media asset information display areas.

It can be seen that the fusion mode is adopted on the second display, and the media information display area and the system status display area are generated in all areas where the viewport of the second display is located. The fusion mode refers to the presentation of the media information display area in the viewport of the second display. and the mode of the system status display area. The second display adopts the simple mode, and only the media information display area is generated in the entire area where the viewport of the second display is located. The simple mode refers to the mode in which the media information display area is presented in the viewport of the second display. The media asset information display area is used to display messages of an information display type corresponding to the content presented in the first display, and the system status display area is used to display messages of a state display type generated when system parameters change.

The media asset information display area and the system status display area in the fusion mode are two independent display areas. Usually, each display area is only responsible for displaying messages of the corresponding type. When generating a message that needs to be displayed on the second display, the controller first determines the message type of the message. If the message type of the message is the status display type, it means that parameter adjustment occurs in the current system, and the parameter needs to be displayed in the left status bar (system status display area). The media asset display area on the right will always display the playback status of the media asset currently played on the first display, or the corresponding media asset introduction in the push message. At this time, the second display is controlled to display the message in a fusion mode.

Since the fusion mode refers to the mode in which the second display includes the media asset information display area and the system status display area, when the second display adopts the fusion mode to display the message, the controller determines the message type of the message, and the message type of the message is When the information display type is the message display type, the message is displayed in the media asset information display area of the second display; when the message type of the message is the status display type, the message is displayed in the system status display area of the second display.

Referring to FIG. 22 again, if the current display device is playing the "everything is fine" video file, the second display needs to display video information, such as a progress bar, video name, and the like. At this time, when the user adjusts the system parameters or the system automatically triggers a reminder preset by the user, a new message that needs to be displayed on the second display will be generated. The second display will switch to the fusion mode to display video information and new messages at the same time, that is, present new messages in the system status display area, and present the original video information in the media information display area. Since the message in the current media asset information display area cannot be triggered and cannot be played with a jump, there is no need to add a jump flag to the message, that is, the content shown in FIG. 22 is a schematic diagram of the second display in the fusion mode without the jump function.

FIG. 23 shows a schematic diagram of a display of a fusion mode with a jump function according to some embodiments. Referring to Figure 23, when the second display needs to present post-simulcast information and system parameters, the system parameters are presented in the system status display area, and post-simulcast information, such as "Summer Health Tips", is presented in the media asset information display area. Since the post-simulcast information is a triggerable message and can be played with a jump, a jump sign can be added to the message based on the foregoing content, that is, the content shown in FIG. 23 is a schematic diagram of a second display with a jump function in fusion mode.

FIG. 24 shows another schematic diagram of displaying the fusion mode with jump function according to some embodiments. Referring to FIG. 24 , if the current display device is playing the "Everything is fine" video file, if it is detected that the image of "Yao Chen" appears in the first display, a media asset push message related to "Yao Chen" is generated. Then the second display needs to display the media resources push news, such as "Yao Chen highlights, enjoy the idol lens". At this time, when the user adjusts the system parameters or the system automatically triggers a reminder preset by the user, a new message that needs to be displayed on the second display will be generated. The second display will switch to the fusion mode to display video information and new messages at the same time, that is, present new messages in the system status display area, and present the original video information in the media information display area.

Since the media asset push message is a triggerable message and can be played with a jump, a jump sign can be added to the message based on the foregoing content, that is, the content shown in FIG. 24 is a schematic diagram of a second display with a jump function in fusion mode .

It can be seen that since only the fusion mode can display messages of the state display type, when the message type of the message is the state display type, no matter whether the previous display mode of the second display is the simple mode or the fusion mode, it will switch to the fusion mode for display. .

In some embodiments, if it is determined that the message type of the message is the information display type, it means that there is no need to display the status at present, and it is only required for independent content display. Therefore, the second display is controlled to display the message according to the current display mode of the second display. .

Normally, when no system state change occurs, only the corresponding media asset information is displayed on the second display. For example, when playing a video file, if the system parameters are not adjusted, only the video information is displayed on the second display, and at this time, the display can be performed in a simple mode. If a system state change occurs, the changed parameters and video information need to be displayed at the same time, which needs to be displayed in a fusion mode.

When the display device displays information of the information display type, the display modes that can be selected include the fusion mode and the simple mode. In order to accurately determine which mode the second display should display in, it is necessary to first determine the current display mode of the second display. to determine if a mode switch is required.

Specifically, when the current presentation mode is the simple mode, the controller controls the second display to present the message according to the current presentation mode of the second display if the message type of the message is the information presentation type, and is further configured to perform the following steps : when the message type of the message is the information display type, and when the current display mode of the second display is the simple mode, the second display is controlled to display the message in the simple mode.

When the message type of the message is the information display type, if the current display mode of the second display is the simple mode, since the simple mode refers to the mode in which only the media asset information display area is included in the second display, there is no need to switch the mode. The message display is directly performed, that is, the second display is controlled to display the message in a simple mode, and the message is displayed in the media asset information display area of the second display.

Referring again to Figure 19, Figure 20 and Figure 21, all simple modes. The content presented in the media asset information display area of the secondary screen in FIG. 19 is only video information, so it is displayed in a simple mode and cannot be triggered, which is a schematic diagram of a secondary screen in a simple mode without a jump function. The content presented in the media information display area of the secondary screen in Figures 20 and 21 is video information and operation prompts, so it is displayed in a simple mode, and the video information can be triggered, which is a secondary screen with a jump function in a simple mode Schematic.

In some embodiments, when the current presentation mode is the fusion mode, the controller is further configured to execute, if the message type of the message is the information presentation type, control the second display to present the message according to the current presentation mode of the second display, and is further configured to execute The following steps:

Step 15221: When the message type of the message is the information display type, and when the current display mode of the second display is the fusion mode, obtain the current display duration of the fusion mode.

Step 15222: If the current display duration exceeds the second preset duration, switch the current display mode of the second display to the simple mode, and control the second display to display the message in the simple mode.

Step 15223: If the current display duration does not exceed the second preset duration, control the second display to display the message in a fusion mode.

When the message type of the message is the information display type, if the current display mode of the second display is the fusion mode, it is necessary to first determine whether the current display state of the second display satisfies the mode switching condition.

Since the fusion mode can be equivalent to adding a state display area on the basis of the simple mode, the second display usually displays the message in the simple mode first. For example, when playing a video file, the second display will always display video information in a simple mode. If the system parameters are adjusted at this time, the message generated based on the system parameter adjustment needs to be displayed synchronously. At this time, the simple mode is switched to the fusion mode, and the video information and the adjusted system coefficients are displayed simultaneously.

The message of the system parameter is a real-time prompt message, which is usually only displayed for a period of time, and will not be displayed all the time. Therefore, when adopting the fusion mode display, if no message of the new status display type is received in the subsequent continuous display duration, the fusion mode is cancelled, and the message of the corresponding information display type is continued to be displayed in the simple mode. Therefore, the mode switching condition of the second display is to determine whether the display duration in which the current display mode is the fusion mode satisfies the time condition. The time condition refers to whether a new state display type message is received within the second preset time period.

If the current display mode is the fusion mode, and the current display duration of the fusion mode reaches the second preset duration, and no messages of the new status display type are received, it means that there is no need to continue to display the messages of the status display type. Perform mode switching, that is, switch from the fusion mode to the simple mode to continue to display the information display type message. If the current display duration of the fusion mode reaches the second preset duration, and a message of a new status display type is received, it means that the message of the status display type needs to be displayed continuously. Information presentation type messages and status presentation type messages.

In some embodiments, the second preset duration may be set to 1 minute, or may be other values, which are not specifically limited here.

In the case that the current display mode of the second display is the fusion mode, the display duration of the fusion mode is obtained, and if no message of the new state display type is received within 1 minute, it is determined that the mode switching condition is satisfied. At this time, when the current display duration of the fusion mode exceeds the second preset duration, mode switching can be performed, that is, the current display mode of the second display is switched from the fusion mode to the simple mode, and the second display is controlled to display the message in the simple mode.

If a message of a new state display type is received within 1 minute, it is determined that the mode switching condition is not satisfied. At this time, the current display duration in the fusion mode does not exceed the second preset duration, and no mode switching is performed, that is, the second display is controlled to continue to display the message in the fusion mode.

The solution of judging whether the fusion mode satisfies the mode switching condition by setting the second preset duration is to prevent the mode switching from being too frequent and affecting the user experience. Since only the fusion mode can display the message of the status display type, when the message of the status display type was displayed in the fusion mode last time, if the message of the information display type is received within one minute, if the fusion mode is switched to In the simple mode, the display time of the status display type message will be too short, and the user may cancel the display before the status parameter is clearly seen, which affects the user experience.

Therefore, by setting the condition of the second preset duration, it can be ensured that the message of the status display type can be continuously displayed for at least 1 minute, which is convenient for the user to view. If messages of multiple status display types are continuously received within the one minute, it is also possible to avoid repeating the switching process between the simple mode and the fusion mode, so that the second display always maintains the fusion mode to continuously display messages of multiple display types. At this time, when judging whether the display duration of the fusion mode exceeds the second preset duration, it is determined by the time of the last received message of the display type.

In some embodiments, when the current display mode of the second display is the simple mode, if a message of the state display type that needs to be displayed on the second display is generated, the current display mode of the second display is switched from the simple mode to Convergence mode: the state display type messages are displayed in the system state display area of the fusion mode, and the previous messages displayed in the simple mode are displayed in the media information display area of the fusion mode.

The previous message refers to the message originally displayed in the media asset information display area of the second display in the simple mode. When the second display has been displaying messages in the simple mode, if a system parameter change occurs at this time, the display mode of the second display is switched to simultaneously display the media information of the information display type and the parameters of the status display type through the fusion mode. message, that is, the newly received message of the state display type is displayed in the system state display area of the fusion mode, and the previous message originally displayed in the simple mode is replaced and displayed in the media information display area of the fusion mode.

It can be seen that the display device provided by some embodiments of the present application can determine the application scenario of the message display requirement according to the message type, and then determine the display mode of the second display, so that when a message is received, it can automatically switch according to the message type. Display mode to dynamically present more content and improve user experience.

When the display device provided by the foregoing embodiment executes the method for displaying the contents of the secondary screen, it is applied to the display device of the dual-screen single-system, and both displays are controlled by a general controller, that is, the first display and the second display are controlled. The process of displaying the content and registering the focus listener thread for the second display is controlled by the general controller.

In some embodiments, a display device provided by some embodiments of the present application, applied to a dual-screen dual-system display device, includes: a first display, configured to present a first user interface, and each application is presented in the first user interface or the content of the message; a second display, configured to present a second user interface, in which system messages or notifications are presented; a first controller connected to the first display, the first controller is configured to: When a message that needs to be displayed on the second display is generated, the message is sent to the second controller, so that the second controller displays the message on the second display. A second controller connected to the second display, the second controller is configured to execute a method for displaying contents of the secondary screen.

FIG. 25 shows another flowchart of a method for displaying content on a secondary screen according to some embodiments. Some embodiments of the present application provide a display device, which can be a dual-screen dual-system display device. When performing the method for displaying content on the secondary screen shown in FIG. 25 , the second controller is configured to perform the following steps:

S21A: Receive a message sent by the first controller, and determine whether there is a jump identifier used to represent a jump play function in the message, and the jump play function is used to associate the message with the message after receiving a confirmation operation for the message The content is displayed in the first display.

S22A. If there is a jump identifier in the message, register a focus monitoring thread for the second display, and display the message on the second display, where the focus monitoring thread is used to realize that after the second display displays the message The second display preferentially responds to the received operation control instruction within the first preset time period.

S23A. If there is no jump identifier in the message, do not register the focus monitoring thread for the second display, and display the message on the second display, wherein when the second display does not register the focus monitoring thread, the first display A display responds to the received operation control command.

In the dual-screen dual-system display device, since the first controller is the main controller, the messages that need to be displayed on the second display are all generated in the first controller.

When implementing skip play, the first controller sends the generated message to the second controller, and after receiving the message, the second controller determines whether there is a skip mark in the message, and when there is a skip mark, the second controller is the second controller. The display registers the focus monitoring thread; when there is no jump identifier, the focus monitoring thread is not registered for the second display. At the same time, the message is presented in the second display by the second controller.

When the message is presented in the second display, the presentation mode of the second display may be determined according to different message types of the message.

In some embodiments, the judgment of the message type is performed by the first controller, and the judgment of the current presentation mode of the second display is performed by the second controller. The first controller first judges the message type of the message before generating the message, and if it is a state display type message, it sends it to the second controller, and informs the second controller to display it in a fusion mode. At this time, the second controller controls the second display to directly switch to the fusion mode to display the message.

If it is an information presentation type message, it is sent to the second controller and notified to the second controller. The second controller determines the display mode before the second display. If it is a simple mode, it will be displayed directly in the simple mode; if it is a fusion mode, and the fusion mode has been displayed for more than the second preset duration (1 minute), then Switch to simple mode; if it is fusion mode, but the display does not exceed the second preset duration (1 minute), it will still be displayed in fusion mode.

The first controller performs the process of judging the message type, and the second controller performs the process of configuring the focus monitoring thread for the second display and the process of determining the specified display mode, all of which can refer to the dual-screen single-system display in the foregoing embodiment. The execution process of the device will not be repeated here.

In some embodiments, the judgment of the message type and the judgment of the current presentation mode of the second display are both performed by the second controller. After the first display generates a message, it sends it to the second controller. The second controller first determines the type of the message, and if it is a status display message, it directly switches to the fusion mode to display the message. If it is an information display type message, first judge the previous sub-screen display mode. If it was a simple mode before, display it directly in the simple mode; if it is a fusion mode, and the fusion mode has been displayed for more than the second preset duration (1 minute ), switch to the simple mode; if the display in the fusion mode does not exceed the second preset duration (1 minute), the display is still performed in the fusion mode.

When the second controller executes the process of judging the message type, the process of configuring the focus monitoring thread for the second display, and the process of determining the specified display mode, reference can be made to the execution process of the dual-screen single-system display device in the foregoing embodiment, which is not used here. Repeat.

It can be seen that when a dual-screen display device is used, after the user turns on the first display (large screen), the first display (large screen) sends a message of the display content to the second display (small screen) according to different scenarios that require dual-screen display, and the second display receives the large screen. After the message, the corresponding display mode is displayed according to the current state of the small screen (fusion/simple) and the type of the message. The presentation process is automated and requires no user intervention. The above process can be applied to a dual system or a single system, and the only dependent scenario is a display device that requires split-screen display of content, that is, a dual-screen display device.

It can be seen from the above technical solutions that, in a display device provided by some embodiments of the present application, when a method for displaying content on a secondary screen is performed, if a message that needs to be displayed on the second display is generated, it is judged whether there is a message in the message that is used to represent a jump. Jump identifier of the replay function. If there is a jump identifier in the message, register a focus monitoring thread for the second display to display the content corresponding to the message displayed on the second display on the first display; if there is no jump identifier in the message, it is not the first display The second monitor registers the focus listener thread. At the same time, the message is displayed on the second display adopting the corresponding display mode according to different message types. It can be seen that the display device provided by some embodiments of the present application can automatically switch the display mode of the content of the secondary screen according to the application scenario of the information display, so as to display more content, and can perform the focus monitoring thread according to the content of the displayed message, and the user experience it is good.

In some embodiments, the present application further provides a computer storage medium, wherein the computer storage medium may store a program, and when the program is executed, the program may include any of the embodiments of the dual-screen synchronous playback method of a video file provided by the present application some or all of the steps. The storage medium may be a magnetic disk, an optical disk, a read-only memory (English: read-only memory, abbreviated as: ROM) or a random access memory (English: random access memory, abbreviated as: RAM) and the like.

Those skilled in the art can clearly understand that the technology in some embodiments of the present application can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solutions in some embodiments of the present application can be embodied in the form of software products in essence or in the parts that make contributions to the prior art, and the computer software products can be stored in storage media, such as ROM/ RAM, magnetic disk, optical disk, etc., including several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments of the present application.

It is sufficient to refer to each other for the same and similar parts among the various embodiments in this specification. In particular, for the embodiment of the method for synchronously playing a video file on two screens, since it is basically similar to the embodiment of the display device, the description is relatively simple, and for relevant details, please refer to the description in the embodiment of the display device.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: The technical solutions described in the foregoing embodiments can still be modified, or some or all of the technical features thereof can be equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the embodiments of the present application. scope.

For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussions are not intended to be exhaustive or to limit implementations to the specific forms disclosed above. Numerous modifications and variations are possible in light of the above teachings. The above embodiments are chosen and described to better explain the principles and practical applications, so as to enable those skilled in the art to better utilize the described embodiments and various modified embodiments suitable for specific use considerations.

Claims

A display device, comprising:

a first display configured to present a first user interface;

a second display configured to present a second user interface;

a controller connected to the first display and the second display, the controller configured to:

In response to an operation that triggers the playback of the video file, the video file is displayed on the first display for playback;

During the playback of the video file, a progress bar page including a video progress bar is generated based on the playback progress and total duration of the video file;

The progress bar page including the video progress bar is displayed on the second display, and the playing progress corresponding to the video progress bar is the same as the playing progress of the video file presented on the first display.
The display device according to claim 1, wherein the controller is further configured to:

During the playback of the video file, obtain the total duration of the video file and the played duration corresponding to the current playback progress;

Calculate the remaining duration based on the total duration and the broadcast duration;

Based on the remaining time length, a progress bar page including a video progress bar is generated, and the video progress bar adopts a countdown form, and the time length corresponding to the countdown form is the remaining time length.
The display device according to claim 1, wherein the controller is further configured to:

During the playback of the video file, obtain the total duration of the video file and the current playback moment corresponding to the current playback progress;

Based on the total duration and the current playing time, a progress bar page including a video progress bar is generated, and the video progress bar adopts a timing form, and the time corresponding to the timing form is the current playing time.
The display device according to claim 1, wherein the controller is further configured to:

During the playback of the video file, obtain the total duration of the video file, the current playback state and the current playback time corresponding to the current playback progress;

Based on the total duration, the current playing state and the current playing time, a progress bar page including a video progress bar and a state UI diagram is generated, and the display forms of the video progress bar include a countdown form and a timing form, and the state UI diagram is used for Indicates the current play state, and the display state of the video progress bar is consistent with the current play state.
The display device of claim 1, wherein the controller is further configured to:

During the playback of the video file, in response to a state change instruction that triggers the video file to change the playback state, a new progress bar page is generated based on the playback progress corresponding to the current playback state after the playback state is changed;

Displaying the new progress bar page on the second display, the playback state presented in the new progress bar page is the same as the current playback state after the video file playback state is changed, and the playback state presented in the new progress bar page The progress is the same as the playback progress corresponding to the current playback state.
The display device of claim 1, wherein the controller is further configured to:

If there is an advertisement file in the video file, then during the playback of the video file including the advertisement file, obtain the initial playback time and end playback time of the advertisement file corresponding to the total duration;

In response to the pause playback instruction generated when the playback progress reaches the initial playback moment, the video file is stopped from playing, and a new progress bar page is generated based on the playback progress corresponding to the stopped playback state, and displayed on the second display. The new progress bar page presents a stop playing state, and the playing progress presented in the new progress bar page is the same as the playing progress corresponding to the initial playing moment;

In response to the start playback instruction generated when the playback progress reaches the end playback time, the video file is started to play, and a new progress bar page is generated based on the playback progress corresponding to the start playback state, and displayed on the second display. The new progress bar page presents a start playing state, and the playing progress presented in the new progress bar page is the same as the playing progress corresponding to the end playing time.
The display device of claim 1, wherein the controller is further configured to:

During the playback of the video file, in response to an exit play instruction that triggers the video file to quit playing, cancel the display of the video file in the first display, and the display of the progress bar page in the second display;

The default home page of the second display is acquired, and the default home page is displayed on the second display.
A display device, comprising:

a first display configured to present a first user interface;

a second display configured to present a second user interface;

a first controller connected to the first display, the first controller configured to:

In response to an operation that triggers the playback of the video file, the video file is displayed on the first display for playback;

sending the playback progress and total duration of the video file to the second controller;

a second controller connected to the second display, the second controller configured to:

During the playback of the video file, receiving the playback progress and total duration of the video file sent by the first controller;

Generate a progress bar page including a video progress bar based on the playback progress and total duration of the video file;

The progress bar page including the video progress bar is displayed on the second display, and the playing progress corresponding to the video progress bar is the same as the playing progress of the video file presented on the first display.
A dual-screen synchronous playback method for video files, characterized in that the method comprises:

In response to an operation that triggers the playback of the video file, the video file is displayed on the first display for playback;

During the playback of the video file, a progress bar page including a video progress bar is generated based on the playback progress and total duration of the video file;

The progress bar page including the video progress bar is displayed on the second display, and the playing progress corresponding to the video progress bar is the same as the playing progress of the video file presented on the first display.
A dual-screen synchronous playback method for video files, characterized in that the method comprises:

During the playback of the video file, receiving the playback progress and total duration of the video file sent by the first controller;

Generate a progress bar page including a video progress bar based on the playback progress and total duration of the video file;

The progress bar page including the video progress bar is displayed on the second display, and the playing progress corresponding to the video progress bar is the same as the playing progress of the video file presented on the first display.