WO2023093465A1 - 赛事直播的显示方法、装置、设备及存储介质 - Google Patents
赛事直播的显示方法、装置、设备及存储介质 Download PDFInfo
- Publication number
- WO2023093465A1 WO2023093465A1 PCT/CN2022/128699 CN2022128699W WO2023093465A1 WO 2023093465 A1 WO2023093465 A1 WO 2023093465A1 CN 2022128699 W CN2022128699 W CN 2022128699W WO 2023093465 A1 WO2023093465 A1 WO 2023093465A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- playback
- live
- split
- display
- highlights
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 101
- 230000001960 triggered effect Effects 0.000 claims abstract description 60
- 230000004044 response Effects 0.000 claims abstract description 58
- 238000010801 machine learning Methods 0.000 claims description 73
- 230000006399 behavior Effects 0.000 claims description 20
- 238000012549 training Methods 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 9
- 238000010586 diagram Methods 0.000 description 35
- 238000013461 design Methods 0.000 description 15
- 230000006870 function Effects 0.000 description 15
- 230000008569 process Effects 0.000 description 10
- 238000004364 calculation method Methods 0.000 description 9
- 238000012545 processing Methods 0.000 description 9
- 208000015041 syndromic microphthalmia 10 Diseases 0.000 description 9
- 230000000694 effects Effects 0.000 description 7
- 230000009183 running Effects 0.000 description 7
- 230000009286 beneficial effect Effects 0.000 description 6
- 238000001514 detection method Methods 0.000 description 5
- 238000004088 simulation Methods 0.000 description 5
- 238000013473 artificial intelligence Methods 0.000 description 4
- 239000008280 blood Substances 0.000 description 4
- 210000004369 blood Anatomy 0.000 description 4
- 230000002860 competitive effect Effects 0.000 description 4
- 238000007667 floating Methods 0.000 description 4
- 230000007935 neutral effect Effects 0.000 description 4
- 230000007123 defense Effects 0.000 description 3
- 239000012634 fragment Substances 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 238000013528 artificial neural network Methods 0.000 description 2
- 230000000903 blocking effect Effects 0.000 description 2
- 230000009193 crawling Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000009187 flying Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 230000009191 jumping Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000036544 posture Effects 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- 230000009184 walking Effects 0.000 description 2
- 230000004397 blinking Effects 0.000 description 1
- 238000005266 casting Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
Definitions
- the present application relates to the field of live broadcasting, and in particular to a display method, device, equipment and storage medium for live broadcasting of events.
- the server will broadcast the game of the e-sports event to the user.
- Clients that support the live broadcast function of e-sports events will obtain the live stream of the ongoing game of e-sports events from the server, and display the live stream of the live stream of the event on the live broadcast interface.
- a progress bar is displayed on the live broadcast interface, and the progress bar is used to reflect the current playing progress of the live event stream. According to the playback operation triggered by dragging the progress bar, the client will start to play back the live event stream from the playback progress selected by the playback operation, so as to realize the playback of highlights in the live event stream.
- the present application provides a method, device, device and storage medium for displaying a live broadcast of an event, which can simplify the user's operations when watching the live broadcast. Described technical scheme is as follows:
- a method for displaying a live event which is applied to a computer device, and the method includes:
- a live broadcast screen of a live event stream is displayed, and the live stream of the event is a live stream of an event in which virtual characters in a virtual environment compete;
- a playback control corresponding to a highlight segment is displayed in the live broadcast interface, and the highlight segment is a historical segment in the live stream of the event;
- the live image is displayed in the first split-screen area and the playback image of the highlights is displayed in the second split-screen area, the first split-screen area and the
- the second split-screen area is a different display area in the live broadcast interface, and there is no intersection between the first split-screen area and the second split-screen area.
- a display device for a live event comprising:
- the display module is used to display the live broadcast picture of the live stream of the event in the live broadcast interface, and the live stream of the event is the live stream of the event based on the virtual characters in the virtual environment for competition;
- the display module is also used to display a playback control corresponding to the highlight segment in the live broadcast interface, and the highlight segment is a historical segment in the live stream of the event;
- the display module is further configured to respond to the split-screen display operation triggered based on the playback control, display the live image in the first split-screen area and display the playback image of the highlights in the second split-screen area, so
- the first split-screen area and the second split-screen area are different display areas in the live broadcast interface, and there is no intersection between the first split-screen area and the second split-screen area.
- a computer device includes a processor and a memory, at least one instruction, at least one section of program, code set or instruction set are stored in the memory, the at least one instruction , the at least one program, the code set or instruction set is loaded and executed by the processor to implement the method for displaying live events as described above.
- a computer-readable storage medium wherein at least one instruction, at least one program, code set or instruction set is stored in the readable storage medium, the at least one instruction, the at least A program, the code set or instruction set is loaded and executed by the processor to realize the method for displaying live events as described above.
- a computer program product or computer program comprising computer instructions stored in a computer readable storage medium.
- the processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the method for displaying a live event provided in various optional implementation manners of the above aspect.
- the live screen of the live stream of the event and the playback screen of the highlight segment can be displayed in split screens, so that users can Simultaneously watch live events and replay highlights.
- the user replays the highlights in the above manner he can watch the live broadcast of the event without any operation, which simplifies the user's operation when returning to watch the live event during the playback of the highlights.
- Fig. 1 is a structural block diagram of a computer system provided by an exemplary embodiment of the present application
- Fig. 2 is a schematic diagram of a live broadcast interface provided by an exemplary embodiment of the present application
- FIG. 3 is a schematic flowchart of a method for displaying live events provided by an exemplary embodiment of the present application
- Fig. 4 is a schematic flowchart of a method for displaying live events provided by an exemplary embodiment of the present application
- Fig. 5 is a schematic diagram of a distance threshold provided by an exemplary embodiment of the present application.
- Fig. 6 is a schematic diagram of a playback control provided by an exemplary embodiment of the present application.
- Fig. 7 is a schematic diagram of a target virtual character provided by an exemplary embodiment of the present application.
- Fig. 8 is a schematic diagram of a playback list provided by an exemplary embodiment of the present application.
- Fig. 9 is a schematic diagram of a prompt barrage provided by an exemplary embodiment of the present application.
- Fig. 10 is a schematic diagram of a playback screen displayed in a small window provided by an exemplary embodiment of the present application.
- Fig. 11 is a schematic diagram of a playback control of a virtual character provided by an exemplary embodiment of the present application.
- Fig. 12 is a schematic diagram of the display ratio of the second split-screen area in the live interface provided by an exemplary embodiment of the present application.
- Fig. 13 is a schematic diagram of gesture operation provided by an exemplary embodiment of the present application.
- Fig. 14 is a schematic diagram of a switching operation provided by an exemplary embodiment of the present application.
- Fig. 15 is a schematic diagram of a second split-screen area provided by an exemplary embodiment of the present application.
- Fig. 16 is a schematic diagram of a second split-screen area provided by an exemplary embodiment of the present application.
- Fig. 17 is a schematic flowchart of a front-end interaction process provided by an exemplary embodiment of the present application.
- Fig. 18 is a schematic flow diagram for implementing split-screen display provided by an exemplary embodiment of the present application.
- Fig. 19 is a schematic flow diagram of obtaining related data displayed on a split screen provided by an exemplary embodiment of the present application.
- Fig. 20 is a schematic structural diagram of a display device for a live event provided by an exemplary embodiment of the present application.
- Fig. 21 is a schematic structural diagram of a display device for a live event provided by an exemplary embodiment of the present application.
- Fig. 22 is a schematic structural diagram of a terminal provided by an exemplary embodiment of the present application.
- Virtual Environment is the virtual environment displayed (or provided) by the application when it is run on the terminal.
- the virtual environment can be a simulation environment of the real world, a semi-simulation and semi-fictional environment, or a purely fictitious environment.
- the virtual environment may be any one of a two-dimensional virtual environment, a 2.5-dimensional virtual environment, and a three-dimensional virtual environment, which is not limited in this embodiment of the present application.
- Virtual character refers to at least one movable object controlled by the user in the virtual environment.
- the virtual character can be a virtual character, a virtual animal, an animation character, etc.
- the virtual character is a three-dimensional model created based on animation skeleton technology.
- Each virtual character has its own shape and volume in the virtual environment, occupying a part of the space in the virtual environment.
- FIG. 1 is a structural block diagram of a computer system provided by an exemplary embodiment of the present application.
- the computer system 100 includes: a first terminal 110 , a second terminal 120 , a first server 130 , a second server 140 and a third terminal 150 .
- the first terminal 110 has installed and runs a first application program, and the first application program is a client with a competitive game function of an electronic competition.
- the first application program supports a virtual environment, specifically, it may be a first-person shooter (First-Person Shooting, FPS) game, a third-person shooter (Third-Personal Shooting, TPS) game, MOBA game, tactical competitive game, strategy game ( Any one of Simulation Game, SLG).
- the first terminal 110 is the terminal used by the first user 111.
- the first user 111 uses the first terminal 110 to control the activities of the virtual character located in the virtual environment in the first application program.
- the virtual character can be called the virtual character of the first user 111 .
- the activities of the virtual character include but are not limited to: at least one of adjusting body posture, crawling, walking, running, riding, flying, jumping, driving, picking up, shooting, attacking, and throwing.
- the virtual character is a virtual character, such as a simulated character or an anime character.
- the second terminal 120 has a first application program installed and running, and the first application program is a client with a competitive match function for an e-sports event.
- the first application program supports a virtual environment, which may specifically be any one of FPS games, TPS games, MOBA games, tactical arena games, and SLG.
- the second terminal 120 is a terminal used by the second user 121.
- the second user 121 uses the second terminal 120 to control the virtual character in the virtual environment in the first application program to perform activities.
- the virtual character can be called the virtual character of the second user 121 .
- the activities of the virtual character include but are not limited to: at least one of adjusting body posture, crawling, walking, running, riding, flying, jumping, driving, picking up, shooting, attacking, and throwing.
- the virtual character is a virtual character, such as a simulated character or an anime character.
- the application programs installed on the first terminal 110 and the second terminal 120 are the same, or the application programs installed on the two terminals are the same type of application programs on different control system platforms.
- the first terminal 110 may generally refer to one of the multiple terminals
- the second terminal 120 may generally refer to one of the multiple terminals.
- the first terminal 110 includes terminals used by users in the first team participating in the e-sports event
- the second terminal 120 includes a terminal used by users in the second team participating in the e-sports event. This embodiment is only described by taking the first terminal 110 and the second terminal 120 as examples.
- the device types of the first terminal 110 and the second terminal 120 are the same or different, and the device types include: smart phones, tablet computers, e-book readers, MP3 players, MP4 players, laptop portable computers and desktop computers at least one.
- the following embodiments are described by taking a terminal including a smart phone as an example.
- the first terminal 110 and the second terminal 120 are connected to the first server 130 through a wireless network or a wired network.
- the first server 130 includes at least one of a server, multiple servers, a cloud computing platform, and a virtualization center.
- the first server 130 is used to provide background services for the first application program having the function of competitive game of electronic competition.
- the first server 130 undertakes the main calculation work, and the terminal undertakes the secondary calculation work; or, the first server 130 undertakes the secondary calculation work, and the terminal undertakes the main calculation work; or, the first server 130 and the terminal adopt distributed Computing architecture for collaborative computing.
- the first server 130 includes a processor 131 , a user account database 132 , a battle service module 133 , and a user-oriented input/output interface (Input/Output Interface, I/O interface) 134 .
- the processor 131 is used to load the instructions stored in the first server 130, and process the data in the user account database 132 and the battle service module 133;
- the user account database 132 is used to store the first terminal 110, the second terminal 120 and other terminal
- the data of the user account used such as the avatar of the user account, the nickname of the user account, the combat power index of the user account, and the service area where the user account is located;
- the battle service module 133 is used to provide multiple battle rooms for the user to fight, for example, The fighting room of the e-sports event is for users to fight;
- the user-facing I/O interface 134 is used to establish communication and exchange data with the first terminal 110 and the second terminal 120 through a wireless network or a wired network.
- the second server 140 is connected to the first server 130 through a wireless network or a wired network.
- the second server 140 includes at least one of a server, multiple servers, a cloud computing platform, and a virtualization center.
- the second server 140 is a server corresponding to the second application, and is used to provide background services for the second application with the function of live broadcasting of e-sports events.
- the second server 140 undertakes the main calculation work, and the terminal undertakes the secondary calculation work; or, the second server 140 undertakes the secondary calculation work, and the terminal undertakes the main calculation work; or, the second server 140 and the terminal adopt distributed Computing architecture for collaborative computing.
- the second server 140 is used to obtain in real time the audio and video data generated by the first server 130 during the process of realizing the match of the e-sports event.
- the signal collection device is used to collect the audio and video data of the e-sports events in real time through the first server 130, and import them into the broadcasting guide terminal. Afterwards, the broadcasting end uploads the audio and video data to the second server 140 through the network.
- the second server 140 may be called a live server. In some embodiments, the first server 130 and the second server 140 are the same server.
- the third terminal 150 is connected to the second server 140 through a wireless network or a wired network.
- the third terminal 150 has a second application program installed and running, and the second application program is a client with a live broadcast function of the electronic competition.
- the second application program is a live broadcast client, a game client, a game community client, a video-on-demand client, a short video client, and a social client.
- the second application obtains the audio and video data of the live broadcast of the e-sports event sent by the second server 140 through the third terminal 150, and displays it in the user interface, so as to realize the function of providing the live broadcast of the e-sports event.
- the device types of the third terminal 150, the first terminal 110 and the second terminal 120 are the same or different, and the device types include: smart phones, tablet computers, e-book readers, MP3 players, MP4 players, laptop portable computers and at least one of a desktop computer.
- the following embodiments are described by taking a terminal including a smart phone as an example.
- both the above-mentioned terminal and the server are computer equipment.
- the number of the foregoing terminals may be more or less. For example, there may be only one terminal, or there may be dozens or hundreds of terminals, or more.
- the embodiment of the present application does not limit the number of terminals and device types.
- Fig. 2 is a schematic diagram of a live broadcast interface provided by an exemplary embodiment of the present application.
- the client supporting the live broadcasting function of the e-sports event can display a live broadcast interface 201 .
- the live broadcast interface 201 displays a live broadcast screen 202 of a live event stream, which is a live stream of an event in which virtual characters in a virtual environment compete.
- the client determines that there is a highlight segment in the live stream of the game, it will display the playback control 204 on the live interface 201 through at least one of multiple display methods.
- the highlight segment is determined by the server, and the highlight segment is a historical segment in the live stream of the event.
- a progress bar 203 is displayed in the live broadcast interface 201 , and the client will display a playback control 204 at the target progress position of the progress bar 203 .
- the target progress position is used to indicate the corresponding playback progress of the highlight segment in the live stream of the event.
- the client will display multiple playback controls 204 in the progress bar 203 according to the above rules.
- the playback control 204 can directly trigger a split-screen display operation, or trigger a detailed display operation.
- the playback control 204 directly triggers the split-screen display operation, as shown in (c) of FIG. Playback screen of highlights.
- the playback control 204 triggers the detail display operation, as shown in (b) of FIG. , for example, the detail introduction control 205 is displayed above the playback control 204 .
- the detailed introduction control 205 displays information for introducing highlights.
- the detail introduction control 205 can trigger a split-screen display operation, and in response to the split-screen display operation triggered by the detail introduction control 205, the client will display the live image 202 and highlights in split-screen in the live broadcast interface playback screen.
- the client displays the live image 202 in the first split screen area 206 of the live broadcast interface 201 , and displays the playback image in the second split screen area 207 of the live broadcast interface 201 .
- the first display area and the second display area are different display areas in the live broadcast interface 201 .
- the client can cancel displaying the playback screen and restore only the live broadcast screen 202 to be displayed in the live broadcast interface 201 .
- the client will switch and display the playback screens of different highlight segments of the live event stream in chronological order.
- the live screen of the live stream of the event and the playback screen of the highlight segment can be displayed in split screens, so that users can Simultaneously watch live events and replay highlights.
- the user replays the highlights in the above manner he can watch the live broadcast of the event without any operation, which simplifies the user's operation when returning to watch the live event during the playback of the highlights.
- Fig. 3 is a schematic flowchart of a method for displaying a live event provided by an exemplary embodiment of the present application.
- the method is executed by a computer device.
- the method can be used for the third terminal or the client on the third terminal in the system shown in FIG. 1 .
- the method includes:
- Step 302 Display the live video of the live stream of the event in the live broadcast interface.
- the live broadcast interface is a user interface displayed when the client supporting the live event function provides the live event function.
- the event refers to an e-sports event
- an e-sports event is an event in which e-sports players compete by controlling virtual characters in a virtual environment. For example, compete through FPS games, TPS games, MOBA games, etc.
- an e-sports event there are at least two teams participating in the competition, and there is at least one e-sports player in each team, and each e-sports player controls at least one virtual character in a virtual environment. A virtual character controlled in a virtual environment competes.
- the above event can also refer to a game played by a client that supports the function of controlling virtual characters in a virtual environment to play a game.
- the game includes a plurality of players using the above-mentioned client that supports the function of controlling virtual characters in the virtual environment to play games online, and control their own virtual characters in the virtual environment to play games with virtual characters controlled by other players .
- the player controls his own virtual character to play against the man-machine character in the virtual environment by using the above client.
- the players include ordinary players and hosts in the client.
- the man-machine character is a virtual character controlled by the above-mentioned client or the server of the above-mentioned client.
- an event refers to a game played online by multiple game anchors using MOBA games.
- the virtual environment is the virtual environment displayed (or provided) when the MOBA game is running on the terminal.
- the virtual environment can be a simulation environment of the real world, a semi-simulation and semi-fictional environment, or a purely fictitious environment.
- a virtual character refers to at least one movable object controlled by a user in a virtual environment.
- the virtual character may be a virtual person, a virtual animal, an anime character, or the like.
- the event live stream is a live stream of an event based on virtual characters in a virtual environment, that is, the event live stream is a live stream generated by an e-sports event.
- the displayed live broadcast images include images of virtual characters competing in a virtual environment, images of commentators explaining e-sports events, and images of preparatory stages during a game, etc.
- the client obtains the live stream of the event from the server, so as to display the live screen of the live stream of the event on the live interface.
- Step 304 Display the playback controls corresponding to the highlights in the live broadcast interface.
- This highlight segment is a historical segment from the live stream of the event.
- the highlight segment is generated based on the behavior of the virtual character, that is, the highlight segment is generated based on the manipulation behavior of the virtual character controlled by the player. Users who watch the live broadcast of the game may be interested in some wonderful behaviors of players manipulating virtual characters, so there will be highlights.
- the highlight segment is a segment in which a virtual character controlled by a player in the first team participating in the competition continuously defeats virtual characters controlled by all the players in the second team participating in the competition.
- One or more highlight segments are included in the live event stream, or no highlight segments are included in the live event stream.
- the highlights are determined by the server or the client on the terminal, or manually determined in the live stream of the game and sent to the client via the server or directly to the client.
- the server determines the highlights as an example, when the server obtains the live stream of an event, it will obtain the operating parameters generated by the application of the event.
- the operating parameters are generated based on the operation behavior of the e-sports players using the application Generated by the behavior of the virtual character controlled by the contestants in the virtual environment, the operating parameters are used to reflect the progress of the e-sports event. For example, during a certain period of time, a virtual character controlled by a certain player defeats a virtual character controlled by another player by using the skills of the virtual character.
- the server can determine the highlight segment in the live event stream based on the highlight segment parameter conditions.
- the highlight segment parameter conditions are set for the operating parameters generated during the event corresponding to the event live stream.
- the highlight segment parameter conditions include operating parameters reflecting that a certain avatar continuously beats the other three avatars within a preset time period.
- the server will generate the running
- the segment of the parameter is determined to be a highlight segment.
- the server determines the highlights in the live stream of the event at regular intervals or determines the highlights in the live stream of the event in real time.
- the highlight segment parameter condition is manually determined.
- the server determines that there is a highlight segment in the live stream of the game, it will indicate the result of the determination to the client, or the client will request the result of the determination.
- the client can also determine the highlights in the live stream of the event through the above method. That is, after the client obtains the live event stream from the server, it judges whether there is a highlight segment in the live event stream through the above method and obtains the determined highlight segment.
- the client When the client determines that the live stream of the event includes highlights, it will display the playback controls corresponding to the highlights on the live broadcast interface.
- the client displays multiple playback controls on the live broadcast interface, and each playback control represents a highlight segment.
- the client displays a playback control on the live broadcast interface, and the playback control can represent multiple highlights in the live broadcast stream of the event.
- the client can display playback controls corresponding to highlights in the live broadcast interface through at least one of multiple display modes.
- multiple display methods include directly displaying playback controls in the live broadcast interface, specifically, displaying playback controls in the progress bar of the live broadcast interface (displaying one or more playback controls, representing one or more playback controls of the live event stream) highlights), playback controls are displayed around the target avatar (display one or more playback controls, representing one or more highlights corresponding to the target avatar), playback controls are displayed on the top or bottom of the live interface (display A playback control, representing one or more highlights of the live event stream), and a floating and movable playback control displayed in the live broadcast interface (displaying a playback control, representing one or more highlights of the event live stream) at least one.
- Various display methods also include indirect display of playback controls, which may specifically include displaying playback controls in the playback list displayed on the live interface based on the playback list display operation (displaying one or more playback controls, representing one or more playback controls of the live event stream) a plurality of highlights), when the control display operation is triggered by the target avatar, playback controls are displayed around the target avatar (one or more playback controls are displayed, representing one or more highlights corresponding to the target avatar), And displaying at least one of the playback controls (displaying one or more playback controls, representing one or more highlights of the live stream of the event) in the live broadcast interface in the case of the control display operation triggered by the gesture operation.
- the above-mentioned target virtual character is a virtual character whose behavior generates a highlight segment, and the highlight segment corresponding to the target virtual character, that is, the highlight segment is generated based on the behavior of the target virtual character.
- Playback controls will be displayed in the form of buttons, floating layers, pop-up windows, lists, icons, pictures, and dynamic graphics.
- the client displays the playback control in the progress bar of the live broadcast interface, and the playback control is displayed as a round button, and an icon is displayed in the button, and the icon is used to indicate the content type of the highlights.
- Step 306 In response to the split-screen display operation triggered based on the playback control, display the live image in the first split-screen area and display the playback image of the highlights in the second split-screen area.
- the first split-screen area and the second split-screen area are different display areas in the live broadcast interface, and there is no intersection between the first split-screen area and the second split-screen area.
- the first split screen area and the second split screen area belong to different views in the live broadcast interface.
- the live image is the image displayed by the client by playing the live event stream obtained in real time
- the playback image is the image displayed by the client by playing the video resource of the highlights.
- the video resource of the highlight segment is obtained by the client through the server or by intercepting the live stream of the event after the client determines the highlight segment by itself.
- the client will display a playback screen of the highlight segment corresponding to the playback control.
- the client will display the playback screen of the highlight clips of the live event stream in chronological order, or randomly select the currently playing highlight clips from the highlight clips of the live event stream, or according to the order
- the condition selects the currently playing highlight segment among the highlight segments of the live stream of the event.
- the sorting conditions include the number of likes, comments, plays, gifts, virtual characters controlled by the user's favorite players, etc. of different highlight clips.
- the display ratios of the second split-screen regions used by the client are also different when performing split-screen display.
- the content type of the highlight segment is that a certain avatar only defeats another avatar, then the required display range is relatively small, and a display ratio of 1:1 can be used.
- the content type of the highlights is that a certain virtual character beats five other virtual characters consecutively, so the required display range is relatively large, and a display ratio of 16:9 can be used.
- the playback control can directly trigger a split-screen display operation, for example, in response to the split-screen display operation triggered by the playback control, the client can directly display the live video and the playback video in split screens.
- the playback control can trigger a detail display operation.
- the client will display an introduction control for introducing the highlights, and then based on the split-screen display operation triggered by the introduction control, the client will display it in split screens. Live screen and playback screen.
- the client will display an introduction control for introducing the highlight segment corresponding to the playback control.
- the client may display an introduction control for introducing all the highlight segments.
- the introduction control will be displayed in the form of floating layer, pop-up window, list, etc.
- the introductory control is used to introduce multiple highlight segments
- the information introducing different highlight segments in the intro control may be displayed according to the sliding operation on the introductory control.
- the aforementioned operation triggered by the control refers to the operation triggered by clicking, double-clicking, multiple clicking, sliding, and long-pressing on the control.
- the method provided in this embodiment can realize split-screen display of the live broadcast of the live event stream by displaying the playback control corresponding to the highlight segment of the live event stream in the live broadcast interface, and according to the split-screen display operation triggered based on the playback control
- the screen and the playback screen of the highlights so that users can watch the live broadcast of the game and replay the highlights at the same time.
- the user replays the highlights in the above manner he can watch the live broadcast of the event without any operation, which simplifies the user's operation when returning to watch the live event during the playback of the highlights.
- Fig. 4 is a schematic flowchart of a method for displaying a live event provided by an exemplary embodiment of the present application.
- the method is executed by a computer device.
- the method can be used for the third terminal or the client on the third terminal in the system shown in FIG. 1 .
- the method includes:
- Step 402 Display the live video of the live stream of the event in the live broadcast interface.
- the live broadcast interface is a user interface displayed when the client supporting the live event function provides the live event function.
- the event refers to an e-sports event.
- the live stream of the event is a live stream of an event based on virtual characters in a virtual environment, and the live stream of an event is a live stream generated by an electronic competition.
- the client displays the live broadcast interface, it will obtain the live stream of the event from the server in real time.
- Step 404 Obtain the server's detection result of whether there is a highlight segment in the live event stream.
- Highlights are historical snippets from the live stream of an event.
- the highlight segment is a segment that may be of interest to users watching the live broadcast of the game.
- the highlight segment is determined by the server, or manually determined in the live stream of the event.
- the server obtains the live stream of the event, it will obtain the operating parameters generated by the application of the event.
- the operating parameters are generated by the behavior in the environment, and the operating parameters are used to reflect the progress of the e-sports event.
- the server can determine the highlight segment in the live event stream based on the parameter condition of the highlight segment.
- the parameter condition of the highlight segment is set according to the operating parameters generated during the progress of the event corresponding to the live event stream.
- the server determines that the operating parameters within a certain period of time meet the parameter conditions of the highlight segment, the server will determine the segment in the live stream of the game that generates the operating parameter as the highlight segment.
- the server regularly determines the highlight segment in the live event stream or determines the highlight segment in real time in the event live stream.
- the highlight segment parameter condition is manually determined.
- the client can also determine the highlights in the live stream of the event through the above method.
- the server determines that there is a highlight segment in the live event stream, it will indicate to the client the detection result of whether there is a highlight segment in the live event stream, or the client actively requests the detection result.
- Table 1 shows the introduction for the highlights in the live streaming of events based on MOBA games:
- the content in each row is an introduction for a highlight event (highlight segment), and the highlight event event in each row corresponds to a highlight parameter condition, and the corresponding highlight parameter condition is used to reflect the running The parameter indicates that the highlight event occurred.
- Each highlight event corresponds to a type, icon, name and detailed description.
- the types of content of the highlights in Table 1 may include that the avatar defeats at least one enemy avatar, the avatar releases skills to the enemy avatar, the avatar defeats a neutral creature in the virtual environment, and the avatar destroys an enemy building. at least one of .
- a more refined classification can also be performed according to the content in Table 1.
- first blood refers to the first time that the virtual character controlled by a player in one team defeated the virtual character controlled by a player in the other team in a game between two teams participating in the competition.
- Three-in-a-row victory refers to two teams participating in the competition in a round of competition. The players in one team control the avatars and defeat the avatars controlled by the three players in the other team in a short period of time.
- “Four-in-a-row Superman” refers to two teams participating in the competition. In a round of competition, the players in one team control the avatars and defeat the avatars controlled by the four players in the other team in a short period of time.
- “Five consecutive extraordinary” refers to two teams participating in the competition in a game, the players in one team control the avatars and defeat the avatars controlled by five players (all players) in the other team in a short period of time.
- Team battle refers to two teams participating in the competition in a game, and the players in the two teams control the virtual characters to start a battle.
- a hero refers to a virtual character controlled by a player.
- the virtual character has skills, and different virtual characters have the same or different skills.
- Using skills to control heroes means that players control virtual characters and cast control skills on enemy virtual characters.
- Control skills can achieve the effect of restricting the movement of enemy virtual characters.
- the output of the avatar refers to the value of the damage caused by the avatar to the enemy avatar through ordinary attacks or casting skills.
- the flash skill is a skill that makes the virtual character move a certain distance instantly.
- the life-saving equipment is among the virtual equipment that can be worn by the virtual character, which improves the survivability.
- Neutral creatures are resources that need to be robbed in the virtual environment.
- Virtual characters that rob neutral creatures can obtain beneficial effects, such as enhanced attack power and enhanced defense power. Different neutral creatures correspond to different buff effects.
- the camp of the virtual character includes multiple defensive towers. In the MOBA game, if the virtual character of a certain camp destroys all the defensive towers of the other camp, it is considered that the virtual character of this camp wins the game.
- the highland tower is a special defense tower in the camp where the avatar is located. When the highland tower of one's own side is destroyed, the enemy will gain a buff effect.
- Step 406 In the case that there is a highlight segment in the live stream of the game, display the playback control corresponding to the highlight segment in the live broadcast interface.
- the client When the client determines that the live stream of the event includes highlights, it will display the playback controls corresponding to the highlights on the live broadcast interface.
- the playback control is used to realize the playback of the highlights.
- the client displays multiple playback controls in the live broadcast interface, and each playback control represents a highlight segment.
- the client displays a playback control on the live broadcast interface, and the playback control represents that there are one or more highlights in the live broadcast stream of the event.
- the client displays the playback control in one or more of the following display manners.
- the first display method :
- the client After receiving the progress bar display operation, the client will display the progress bar in the live broadcast interface.
- the progress bar is used to reflect the playback progress of the live event stream.
- the progress bar display operation is triggered by a touch operation on an area in the live broadcast interface that only displays live images.
- the client when the progress bar is displayed, the client will also display relevant information about the live stream of the event and controls for controlling the playback of the live stream of the event, as well as controls for publishing barrage and for opening or Turn off the control of the barrage displayed in the live broadcast interface.
- the client When displaying the progress bar, the client will display the playback control at the target progress position of the progress bar, and the target progress position is used to indicate the corresponding playback progress of the highlights in the live event stream.
- the client when the live event stream includes multiple highlights, the client will display multiple playback controls in the progress bar, where each playback control represents a highlight segment in the live event stream.
- the target progress position is used to indicate the playback progress corresponding to the starting moment of the highlights in the live stream of the event
- the live stream of the event is currently played at 02:00:00
- the start moment of the highlights is 01:00: 00
- the target progress position is the middle position of the progress bar.
- the live broadcast of the event is played live, so the total playing time will be accumulated over time, and the target progress position will also be updated with the live broadcast of the event. For example, for the same highlight segment, its corresponding target progress position at the first moment is one-third of the progress bar, at the second moment its corresponding target progress position is one-sixth of the progress bar, and at the first moment it is at the second time before.
- the playback control corresponds to multiple display forms.
- at least one of the shape of the playback control, the icon (or text) displayed in the playback control, and the color of the playback control is different.
- the playback control is displayed as a circular button, but the icon (or text) displayed in the circular button is different.
- the icon (or text) displayed in the circular button is used to reflect the content type of the highlight segment corresponding to the display control.
- the client displays the playback control at the target progress position of the progress bar, it will display the playback control in the target form.
- the target form is the display form corresponding to the content type of the highlights among the display forms of the playback control.
- Table 1 shows 9 display forms of the playback control, and the corresponding relationship between each display form and the content type of the highlights.
- Each of the display forms is a circular button, but the icon (or text) in the circular button is different.
- the playback control is a round button with "three" in the middle
- the highlight segment is "Destroy the Highland Tower”
- the playback control is a round button with the icon of the defense tower in the middle.
- the client determines the content type of the highlights by using at least one of the first machine learning model, the second machine learning model, the third machine learning model and the fourth machine learning model.
- the above-mentioned first machine learning model, second machine learning model, third machine learning model and fourth machine learning model are models constructed based on a neural network (Neural Network, NN).
- the first machine learning model predicts the content type of the highlight segment by identifying the playback screen of the highlight segment, and the client can obtain the content type of the highlight segment predicted by the first machine learning model by inputting the highlight segment into the first machine learning model .
- the first machine learning model is obtained by training the playback picture of the sample segment and the type of the content of the sample segment (the type of the real content of the sample segment), for example, inputting the sample segment into the first machine learning model to obtain the predicted value of the sample segment The type of content, and then determine the error loss between the predicted content type of the sample segment and the actual content type of the sample segment, through which the first machine learning model can be trained.
- the sample clips used for training the model and the content types of the sample clips are manually determined based on the live streams of historical events.
- the second machine learning model predicts the content type of the highlight segment by identifying the audio of the highlight segment
- the client can obtain the content of the highlight segment predicted by the second machine learning model by inputting the audio of the highlight segment into the second machine learning model type.
- the second machine learning model is obtained by training the audio of the sample segment and the content type of the sample segment, for example, inputting the audio of the sample segment into the second machine learning model to obtain the predicted content type of the sample segment, and then determining the predicted sample segment
- the error loss between the content type of the real sample segment and the content type of the real sample segment, the second machine learning model can be trained through the error loss. Audio for highlights is captured in highlights and audio for sample clips is captured in sample clips.
- the third machine learning model predicts the content type of the highlight segment by identifying the commentary audio corresponding to the highlight segment.
- the client can obtain the highlight predicted by the third machine learning model by inputting the commentary audio corresponding to the highlight segment into the third machine learning model.
- the third machine learning model is obtained by training the commentary audio corresponding to the sample segment and the content type of the sample segment, for example, inputting the commentary audio corresponding to the sample segment into the third machine learning model to obtain the predicted content type of the sample segment, and then determine An error loss between the predicted content type of the sample segment and the actual content type of the sample segment, through which the third machine learning model can be trained.
- the commentary audio corresponding to the highlight segment is produced by the commentator of the game commenting on the highlight segment, and the commentary audio corresponding to the sample segment is produced by the commentator of the game commenting on the sample segment.
- the fourth machine learning model predicts the content type of the highlight segment by identifying the user operation data corresponding to the highlight segment.
- the client can obtain the prediction of the fourth machine learning model by inputting the user operation data corresponding to the highlight segment into the fourth machine learning model.
- the fourth machine learning model is obtained by training the user operation data corresponding to the sample segment and the content type of the sample segment, for example, inputting the user operation data corresponding to the sample segment into the fourth machine learning model to obtain the predicted content type of the sample segment, Then an error loss between the predicted content type of the sample segment and the actual content type of the sample segment is determined, by which the fourth machine learning model can be trained.
- the user operation data corresponding to the highlight segment is the operation data generated by the user manipulating the avatar in the highlight segment during the highlight segment
- the user operation data corresponding to the sample segment is the operation generated by the user manipulating the avatar in the sample segment during the sample segment data.
- the server can also determine the content type of the highlight segment through the above model, and send the determination result to the client, so as to relieve the calculation pressure on the client side.
- artificial intelligence Artificial Intelligence, AI
- the playback control displayed on the far left of the progress bar, the corresponding highlight segment is the highlight segment of "First Blood” in Table 1
- the second playback control displayed on the left side of the progress bar and the corresponding highlight segment is a highlight segment in "Wonderful Operation” in Table 1.
- the distance between two adjacent playback controls displayed in the progress bar is not less than the distance threshold. That is, the distance between two adjacent target progress positions is not less than the distance threshold.
- the distance threshold represents 2 minutes in the progress bar, and the longer the playing time of the live event stream, the shorter the distance threshold will be in the live broadcast interface.
- the client detects that the distance between the two target progress positions is less than the distance threshold, it will cancel one of the playback controls, or appropriately increase the distance between the two target progress positions so that it is greater than distance threshold.
- the number of playback controls displayed by the client in the progress bar is less than the number threshold. Exemplarily, the number threshold is 16. Alternatively, during the process of determining the highlights, the number of determined highlights does not exceed the aforementioned number threshold.
- FIG. 5 is a schematic diagram of a distance threshold provided by an exemplary embodiment of the present application.
- the progress bar of the live broadcast interface 501 seven playback controls are displayed, and the distance between every two playback controls is greater than the distance threshold 503 .
- the distance between the first playback control and the starting point of the progress bar is also greater than the distance threshold 503 .
- the second display method is a first display method
- a virtual environment is displayed on the live broadcast screen displayed by the client, and there is a target virtual character in the virtual environment, and the client will display playback controls of highlights corresponding to the target virtual character on the side of the target virtual character, for example, in the target virtual character.
- a playback control of the highlights corresponding to the target virtual character is displayed above the character.
- the highlights corresponding to the target virtual character are generated based on the behavior of the target virtual character.
- the highlights corresponding to the target virtual character include one or more.
- one or more playback controls are displayed, and when multiple playback controls are displayed, each playback control represents a highlight segment of the target virtual character. In the event that a highlight segment is generated based on the behavior of a certain avatar, that avatar becomes the target avatar. For example, if the behavior of a virtual character satisfies the "first blood" in Table 1, a highlight segment corresponding to the virtual character will be generated, and the virtual character will become the target virtual character.
- the display forms of the playback controls displayed by the client on the sides of different target virtual characters are the same or different.
- a round button with "back" displayed in the middle is used to display the playback control, so as to remind the user that there is a corresponding highlight segment for the virtual character.
- the client can also display playback controls around the target virtual character according to the content type of the highlights corresponding to the target virtual character.
- FIG. 6 is a schematic diagram of a playback control provided by an exemplary embodiment of the present application.
- a virtual environment is displayed on a live broadcast interface 601 , and a target virtual character 602 exists in the virtual environment.
- the client will display a playback control 603 above the target virtual character 602, and the playback control 603 is displayed as a circular button with "back" displayed in the middle, to remind the user that there is a corresponding highlight segment for the virtual character.
- the third display method is a first display method
- a virtual environment is displayed in the live broadcast screen, and a target virtual character exists in the virtual environment, and the client will display a highlight mark on the target virtual character.
- the client will display the playback control of the highlight segment corresponding to the target avatar on the side of the target avatar, for example, display the playback control of the highlight segment corresponding to the target avatar above the target avatar.
- Playback controls The highlights corresponding to the target virtual character are generated based on the behavior of the target virtual character.
- the highlights corresponding to the target virtual character include one or more.
- one or more playback controls are displayed, and when multiple playback controls are displayed, each playback control represents a highlight segment of the target virtual character. In the event that a highlight segment is generated based on the behavior of a certain avatar, that avatar becomes the target avatar.
- the highlight mark displayed on the target avatar is used to highlight the target avatar, that is, to prompt the user that the avatar has a corresponding highlight segment.
- the highlighted mark includes highlighting the name of the target avatar to be displayed, or displaying a frame for the target avatar, or displaying the target avatar in a blinking manner.
- the client when the client receives operations such as single-click, double-click, multiple-click, slide, and long-press on the target virtual character, it will determine that the above-mentioned control display operation is received.
- the display forms of the playback controls displayed by the client on the sides of different target virtual characters are the same or different.
- a circular button with "back" displayed in the middle is used to display the playback control.
- the client can also display playback controls around the target virtual character according to the content type of the highlights corresponding to the target virtual character. It should be noted that, if the display duration is greater than the duration threshold, the client will cancel the display of the above-mentioned highlighted mark and the above-mentioned playback control.
- the display duration is the duration between the start moment of the highlight segment corresponding to the target virtual character and the current moment. For example, the duration between the start moment of the latest highlights of the target avatar and the current moment.
- FIG. 7 is a schematic diagram of a target virtual character provided by an exemplary embodiment of the present application.
- a virtual environment is displayed on the live broadcast interface 701 , and a target virtual character 702 exists in the virtual environment.
- the client will display a dotted frame for the target avatar 702 .
- three playback controls 703 will be displayed above the target avatar 702, and each playback control 703 represents the target avatar 702 A corresponding highlight segment.
- the playback control 703 is displayed as a square button, and different texts are displayed in the middle of the square button to reflect different highlights corresponding to the target avatar 702 .
- the fourth display mode is the fourth display mode
- the client will display a replay list of highlights in the live broadcast interface, and then display playback controls in the replay list.
- the list display operation is triggered by a list display control, or the list display operation is triggered by a gesture operation in the live broadcast interface.
- the list display control is a button displayed above or below the live broadcast interface.
- the gesture operation is an inward sliding operation from the far left side of the live broadcast interface, or an inward sliding operation from the far right side of the live broadcast interface.
- the replay list is displayed as a rectangular box, displayed on the left or right side of the live broadcast interface, or displayed as a pop-up window or floating layer.
- the client when the live event stream includes multiple highlight segments, the client will display multiple playback controls in the playback list, and each playback control represents a highlight segment.
- the displayed content of each playback control includes the name of the highlight segment, the name of the player corresponding to the highlight segment, the avatar of the player corresponding to the highlight segment, and a screenshot of the highlight segment.
- the client can obtain the above information through the server.
- FIG. 8 is a schematic diagram of a playback list provided by an exemplary embodiment of the present application.
- a list display button 802 is displayed in the live broadcast interface 801 .
- the client will display a playback list 803 on the left side of the live broadcast interface 801 .
- Each playback control represents a highlight, and each playback control is a part of the rectangular area in the playback list, and the displayed content includes the name of the highlight, the name of the player corresponding to the highlight, and a screenshot of the highlight.
- the client can switch and display the playback controls in the playback list 803 through a sliding operation on the playback list 803 .
- the fifth display mode is the fifth display mode
- the live broadcast screen displayed by the client has a live bullet chat, for example, the live bullet chat is superimposed on the live broadcast screen and displayed in a moving manner.
- the client will display the prompt barrage corresponding to the highlight clip (which can be regarded as a playback control) in the live barrage.
- the prompt barrage is generated by the server and sent to the client, or generated by the client.
- the prompt barrage is used to prompt that there is a highlight segment in the live stream of the game. If there are multiple highlight segments, each highlight segment corresponds to a prompt barrage.
- the barrage in the live barrage except for the prompt barrage is sent by the users watching the live stream of the event.
- the content of the prompt barrage is generated according to the content of the highlight segment, including at least one of player information corresponding to the highlight segment, information of a virtual object, type of content of the highlight segment, and preset prompt information.
- the client when it acquires a highlight segment, it will display a prompt barrage corresponding to the highlight segment, and then periodically display the prompt barrage according to a preset period.
- the preset periods of different prompt barrages are the same or different, for example, the preset period of a highlight segment with more likes is shorter than that of a highlight segment with fewer likes.
- the client In response to the split-screen display operation triggered by the prompt barrage, the client displays the live broadcast image in the first split-screen area and the playback image of the highlights corresponding to the prompt barrage in the second split-screen area.
- the above split-screen display operation is triggered by a touch operation on the prompt barrage.
- it includes operations such as single-click, double-click, multiple-click, slide, and long-press on the prompt barrage. Trigger split-screen display of live images and playback images of highlights in the form of bullet screens, so as to significantly prompt users of highlights without affecting the user's viewing experience, which can improve user experience.
- FIG. 9 is a schematic diagram of a prompt barrage provided by an exemplary embodiment of the present application.
- a live screen of the live stream of the event is displayed, and a live barrage is displayed on the live screen, and the live barrage includes a barrage sent by a user watching the live stream of the event and a prompt barrage 902 ,
- Each prompt barrage 902 represents a highlight segment of the live stream of the event.
- the client will be triggered to display a live broadcast image in the first split-screen area and a playback image of a highlight segment corresponding to the prompt bullet chat in the second split-screen area.
- the prompt barrage is displayed differently from the barrage sent by the user, for example, including at least one of different fonts, different colors, and different thicknesses.
- the sixth display mode is the sixth display mode
- the client In response to obtaining the highlight segment, the client will display a playback image of the highlight segment (which can be regarded as a playback control) in the form of a small window on the edge of the live broadcast interface according to a preset duration.
- the preset duration is determined by the server or defined by the user. If there are multiple highlight clips, the client will sequentially display the playback images of the highlight clips in the small window according to the time when the highlight clips were acquired and the preset duration.
- the client terminal will also display the introduction information of the highlights near the small window.
- the small window is an area whose display size is smaller than the preset size in the live broadcast interface.
- the client In response to the split-screen display operation triggered by the playback screen, the client displays the live broadcast screen in the first split-screen area and the playback screen of the highlights in the second split-screen area.
- the above split-screen display operation is triggered by a touch operation on the playback image displayed in the small window.
- operations such as single-click, double-click, multiple-click, slide, and long-press on the playback screen are included.
- the playback screen is displayed with a preset duration in the form of a small window, which not only enables the user to preview the playback screen, but also avoids blocking the user to watch other content on the live broadcast interface. Users can trigger split screens to display clearer playback images on demand, which can improve user experience.
- FIG. 10 is a schematic diagram of a small window displaying a playback screen provided by an exemplary embodiment of the present application.
- the client when the client obtains the highlights of the live stream of the event, the client will display the playback screen 1002 of the highlights in a small window in the lower right corner of the live broadcast interface 1001, and cancel the display after 5 seconds. show.
- the client receives a click operation on the playback image 1002 displayed in the small window, the client will display the live broadcast image in the first split-screen area and the playback image of the highlights in the second split-screen area.
- the seventh display mode is the seventh display mode.
- the live screen displayed on the client side shows the avatars of the virtual characters controlled by the players participating in the event. For example, there are 2 teams participating in the game, each team has 5 players, and each player controls a virtual character, then the client will The avatars of 10 avatars are displayed on the live screen.
- the client In response to the list display operation triggered by the avatar of the target avatar, the client will display the playback list of the highlights corresponding to the target avatar.
- the playback list displays the playback controls of the highlights corresponding to the target avatar. If the highlights are multiple , a playback control is displayed for each highlight segment.
- the highlight segment is generated based on the behavior of the target virtual character.
- the above list display operation is triggered by a touch operation on the avatar of the target virtual character among the virtual characters. For example, it includes operations such as single-click, double-click, multiple-click, slide, and long-press on the avatar of the target virtual character.
- the client In response to the split-screen display operation triggered by the playback control corresponding to the target avatar, the client will display the live broadcast image in the first split-screen area and the playback image of the highlights corresponding to the target avatar (playback control) in the second split-screen area .
- the avatar's avatar triggers the display of the playback list of the avatar, thereby displaying the highlights of the avatar, which can realize the selection of the avatar to watch the highlights according to the needs of the user, which can improve the user experience.
- FIG. 11 is a schematic diagram of a playback control of an avatar provided by an exemplary embodiment of the present application.
- the client when the client receives a click operation on the avatar of the displayed virtual character B, the client will display the playback list 1102 of the highlights corresponding to the virtual character B in the live broadcast interface 1101, the playback list 1102 includes the playback controls of the two highlights corresponding to virtual character B.
- the client In response to the split-screen display operation triggered by the playback control corresponding to virtual character B, the client will display the live broadcast image in the first split-screen area and the playback image of the highlights corresponding to the playback control in the second split-screen area.
- the client can use any of the above display methods to display the playback control, or use multiple display methods in the above-mentioned methods to display the playback control at the same time, that is, the above-mentioned different display methods can be used in combination freely. No limit.
- the client can also display the playback control in other display manners, and the above display manner is only used as an example, and is not a limitation on the manner of displaying the playback control in the embodiment of the present application.
- Step 408 In response to the split-screen display operation triggered based on the playback control, display the live broadcast image in the first split-screen area and display the playback image of the highlights in the second split-screen area.
- the first split-screen area and the second split-screen area are different display areas in the live broadcast interface.
- the live broadcast image is displayed by the client by playing the live event stream obtained in real time
- the playback image is displayed by the client by playing the video resource of the highlights.
- the live stream of the event and the video resources of the highlights will be played simultaneously.
- the video resources of the highlights are acquired by the client through the server.
- the client when it is displaying live images and highlights in split screens, it will determine the display ratio of the second split-screen area in the live interface according to the content type of the highlights, and then display the live images and highlights according to the determined display ratio.
- Highlights For example, if the content type of the highlight segment is "first blood” in Table 1, the required display range is relatively small, and a display ratio of 1:1 may be used. If the content type of the highlight segment is "Five consecutive peerless worlds" in Table 1, the required display range is relatively large, and a display ratio of 16:9 can be used.
- FIG. 12 is a schematic diagram of a display ratio of the second split-screen area in the live broadcast interface provided by an exemplary embodiment of the present application.
- the client when split-screen display of live images and playback images is required, the client will determine the display ratio of the second split-screen area in the live interface according to the content type 1201 of the highlights. For example, in (a) of FIG. 12 , the display ratio of the second split screen area is 16:9. In (b) of FIG. 12 , the display ratio of the second split screen area is 4:3. In (c) of FIG. 12 , the display ratio of the second split screen area is 1:1. In (d) of FIG. 12 , the display ratio of the second split screen area is 3:4. When determining the display ratio of the second split-screen area, the client also determines the display positions and display areas of the second split-screen area and the first split-screen area.
- the client can also use more split-screen areas to display live images and playback images.
- the first split-screen area is used to display the live image
- the second split-screen area is used to display the first playback image
- the third split-screen area is used to display the second playback image.
- the first playback picture and the second playback picture are pictures obtained by playing different highlights.
- the playback control can directly trigger a split-screen display operation, for example, in response to the split-screen display operation triggered by the playback control, the client can directly display the live video and the playback video in split screens.
- the playback control can trigger a detail display operation, and in response to the detail display operation triggered by the playback control, the client will display a detail introduction control corresponding to the highlights in the live broadcast interface.
- the client In response to the split-screen display operation triggered by the detail introduction control, the client will display the live broadcast image in the first split-screen area and the playback image in the second split-screen area.
- the playback control can trigger the above detailed display operation.
- the detail introduction control is displayed as a rectangular pop-up window.
- the detailed introduction control displays information for introducing the highlight segment corresponding to the playback control.
- the information used to introduce the highlight segment includes the name of the highlight segment, the name of the player corresponding to the highlight segment, the avatar of the player corresponding to the highlight segment, and a screenshot of the highlight segment.
- the client can obtain the above information through the server.
- a detailed introduction button is displayed in the detailed introduction control, and the detailed introduction button is used to trigger a split-screen display operation. The above-mentioned triggering operation through the control to triggering the operation through clicking, double-clicking, multiple clicking, sliding, and long-pressing on the control.
- the client when the playback control corresponds to a highlight segment, that is, it represents a highlight segment, the client will display the playback screen of the highlight segment corresponding to the playback control.
- the playback control corresponds to multiple highlight segments, that is, it represents multiple highlight segments, the client will display the playback screen of the highlight segment closest to the current time, or display the playback screen of the highlight segment farthest from the current time, or Display the playback screen of the highlight segment with the most likes, or randomly select one of multiple highlight segments to display its playback screen.
- the client when the client receives a click operation on the playback control in the progress bar, it will receive a detail display operation, and display a detailed introduction control above the playback control.
- the split-screen display operation When receiving the click operation of "split-screen view" in the detail introduction control, the split-screen display operation will be received, so that the live broadcast image and the playback image will be displayed in split-screen.
- the client can also not display the playback control, and trigger the split-screen display operation in other ways.
- the client in response to the gesture operation in the live broadcast interface meeting the trajectory condition, the client will display the live broadcast image in the first split-screen area and display the playback image in the second split-screen area.
- the trajectory condition is set for the sliding trajectory of the gesture operation.
- the track condition includes that the sliding track forms a preset shape, and the sliding track is a track that slides from the outside to the inside of the live broadcast interface, such as a track that slides from the left side to the inside or a track that slides from the right side to the inside.
- FIG. 13 is a schematic diagram of gesture operations provided by an exemplary embodiment of the present application.
- the client displays the live broadcast interface 1301.
- the client receives the sliding operation 1302 from the left side inward on the live broadcast interface 1301, it will trigger the split-screen display operation, thereby displaying in the first split-screen area
- the live broadcast screen and the playback screen are displayed in the second split screen area.
- the client in response to the switching operation on the playback screen, can switch and display the playback images of the highlight segments of the live event stream in chronological order.
- the switching operation includes sliding operations on the displayed playback screen, such as sliding up, sliding down, sliding left, and sliding right. It should be noted that if the playback screen of the displayed highlights is realized through the playback control of the second display form or the third display form above, when switching highlights, the client only Toggle within the range of highlights of the .
- FIG. 14 is a schematic diagram of a switching operation provided by an exemplary embodiment of the present application.
- the client displays a replay picture 1401 of the highlights in the live broadcast interface.
- the client receives the slide-up operation 1402 on the playback screen 1401 , the client will switch to display a playback screen of a highlight segment that is behind the highlight segment in time sequence.
- the client can cancel the split-screen display and restore the full-screen display of the live broadcast according to the close operation of the playback screen. While displaying the playback image of the highlights in the second split-screen area, the client will also display interactive controls in the second split-screen area, so that the user can interact with the highlights. This interactive control appears as a button.
- FIG. 15 is a schematic diagram of a second split-screen area provided by an exemplary embodiment of the present application.
- a playback screen of a highlight segment as well as a like button 1502 and a share button 1503 are displayed.
- a like icon will be displayed in the center of the second split screen area 1501 .
- FIG. 16 is a schematic diagram of a second split-screen area provided by an exemplary embodiment of the present application.
- the client when the client receives the click operation for the share button 1503, the client will display a pop-up window 1504 in the second split-screen area 1501, and the pop-up window 1504 displays a link for downloading highlights.
- Fig. 17 is a schematic flowchart of a front-end interaction process provided by an exemplary embodiment of the present application.
- the client terminal displays the live broadcast interface according to the user's operation, and displays the live video of the live event stream on the live broadcast interface.
- the client displays a progress bar in the live broadcast interface according to the user's operation.
- the client terminal judges whether there are highlights in the live stream of the game.
- step S4 if there is no highlights in the live event stream, the user can play back the live event stream by dragging the progress bar.
- step S5 if there is a highlight segment in the live event stream, the client will display the playback control (highlight event label) in the progress bar, and receive the user's operation of clicking the playback control.
- step S6 the client displays a detailed introduction control on the live broadcast interface (split-screen viewing bubble).
- step S7 the client receives the user's click operation on the split-screen simultaneous viewing button in the detailed introduction control.
- step S8 the client splits the live screen of the match live stream and the playback screen of the highlights in the live broadcast interface.
- Fig. 18 is a schematic flowchart of implementing split-screen display provided by an exemplary embodiment of the present application.
- the client plays the live stream of the event through the live broadcast interface.
- the client detects whether there are highlights in the live stream of the game.
- the client will not display the playback control in the progress bar.
- the client if there is a highlight segment in the live event stream, the client will display a playback control (the icon of the highlight event) in the progress bar.
- the client receives the user's click operation on the playback control.
- step A6 the client displays a detailed introduction control (event bubble) in the live broadcast interface.
- step A7 the client acquires the information for introducing the highlight segment through the server, so as to display the information for introducing the highlight segment in the detail introduction control.
- step A8 the client receives the user's click operation on the split-screen view button displayed in the detailed introduction control.
- step A9 the client obtains the video resource of the highlights through the server.
- step A10 the client divides the live broadcast interface into two split-screen display areas, and displays the live video of the live stream of the event in the left area, and displays the playback screen of the highlights in the right area.
- FIG. 19 is a schematic flowchart of acquiring related data displayed on a split screen provided by an exemplary embodiment of the present application.
- the client receives an instruction from the user to view the live stream of the event, displays the live interface and plays the live stream of the event.
- the client requests the server for the detection result of whether there is a highlight segment in the live stream of the event.
- the client obtains the server's detection result of whether there is a highlight segment in the live event stream, and displays the playback control in the progress bar of the live broadcast interface.
- the client receives the user's click operation on the playback control.
- the client requests the server for information used to introduce the highlights corresponding to the playback control.
- step B6 the client obtains the information sent by the server for introducing the highlights corresponding to the playback control.
- step B7 the client displays a detailed introduction control in the live broadcast interface, and displays in the detailed introduction control the information for introducing the highlights corresponding to the playback control.
- the client receives the user's click operation on the split-screen view button in the detailed introduction control.
- step B8 the client requests the video resource of the highlight segment from the server.
- the client receives the video resource of the highlight segment sent by the server, and displays the live broadcast image of the event live stream and the playback image of the highlight segment in split screens in the live broadcast interface.
- the method provided in this embodiment can realize split-screen display of the live broadcast of the live event stream by displaying the playback control corresponding to the highlight segment of the live event stream in the live broadcast interface, and according to the split-screen display operation triggered based on the playback control
- the screen and the playback screen of the highlights so that users can watch the live broadcast of the game and replay the highlights at the same time.
- the user replays the highlights in the above manner he can watch the live broadcast of the event without any operation, which simplifies the user's operation when returning to watch the live event during the playback of the highlights.
- displaying the playback screen of the highlight segment corresponding to the playback control can be realized through the playback control, and the pre-edited highlight segment can be played according to the user's operation. It prevents the user from dragging the progress bar to repeatedly search for the highlights, which can improve the efficiency of the users in finding the highlights.
- the method provided in this embodiment also displays the playback control at the target progress position of the progress bar, realizes the intuitive display of the playback control, and at the same time indicates the playback progress of the highlights in the live stream of the event, which is beneficial for users to find highlights and improve the search for highlights. s efficiency.
- the method provided in this embodiment also displays the playback control in different display forms, thereby indicating the type of content of the highlight segment corresponding to the playback control through the display form of the playback control, so that the user can intuitively distinguish the difference between the content of different highlight segments, It is beneficial for users to search for highlights and improve the efficiency of searching for highlights.
- the distance between two adjacent playback controls displayed in the progress bar is not less than the distance threshold, so as to avoid misoperation when users with smaller terminal screens click on the playback control, and improve the user experience.
- the method provided in this embodiment also displays the playback control on the side of the target avatar to intuitively display the playback control and at the same time indicate the avatar corresponding to the highlights, which is beneficial for users to find highlights and improves the efficiency of finding highlights.
- the method provided by this embodiment also indicates the virtual character corresponding to the highlight segment by displaying a highlight mark on the target virtual character, so as to improve the efficiency of the user in finding the highlight segment.
- the playback control is displayed based on the control display operation triggered by the target virtual character, which can prevent the user's misoperation from causing the direct playback of highlights and improve the user experience.
- the method provided by this embodiment can also display the playback controls of multiple highlights by displaying the playback list and displaying the playback controls in the playback list, which is beneficial for users to select highlights for playback according to their preferences, and improves user experience.
- the method provided in this embodiment also triggers split-screen display of the live broadcast image and the replay image of the highlight clip in the form of a barrage, so as to significantly prompt the user of the highlight clip without affecting the user's viewing experience, which can improve user experience.
- the method provided in this embodiment also displays the playback image with a preset duration in the form of a small window, which not only enables the user to preview the playback image, but also avoids blocking the user to watch other content on the live broadcast interface. Users can trigger split screens to display clearer playback images on demand, which can improve user experience.
- the method provided in this embodiment also triggers the display of the playback list of the avatar through the avatar of the avatar, thereby displaying the highlights of the avatar, which can realize the selection of the avatar to watch the highlights according to the needs of the user, which can improve the user experience .
- the detailed introduction control is displayed based on the playback control, and the information used to introduce the highlights is displayed through the details introduction control, which is convenient for the user to quickly understand the content of the selected highlight, thereby facilitating the user to find the highlight and improving the user experience. Efficiency in finding highlights.
- the method provided in this embodiment also triggers split-screen display of highlights and live streams of events through gesture operations, providing an operation mode for quickly watching playback of highlights.
- the method provided by this embodiment also sets different display ratios of the second split-screen area for highlight clips of different content types, so that the highlight clips can be displayed using the best display ratio when they are displayed in split screens, improving the Improve the user experience of watching highlights.
- the method provided in this embodiment also supports switching of the playback screen of the displayed highlight segment based on the switching operation, so that the user can conveniently switch and view different highlight segments when watching the highlight segment.
- Fig. 20 is a schematic structural diagram of a display device for a live event provided by an exemplary embodiment of the present application. As shown in Figure 20, the device includes:
- the display module 2001 is used for displaying the live image of the live stream of the event in the live broadcast interface.
- the live stream of the event is the live stream of the event based on the virtual characters in the virtual environment.
- the display module 2001 is also used for displaying playback controls corresponding to highlights in the live broadcast interface. Highlights are historical fragments in the live broadcast stream of events.
- the display module 2001 is also configured to respond to the split-screen display operation triggered based on the playback control, to display the live broadcast picture in the first split-screen area and the playback picture of the highlights in the second split-screen area, the first split-screen area and the second split-screen area Split-screen areas are different display areas in the live broadcast interface, and there is no intersection between the first split-screen area and the second split-screen area.
- display module 2001 for:
- the playback control is displayed at the target progress position of the progress bar, and the target progress position is used to indicate the corresponding playback progress of the highlight segment in the live event stream.
- the playback control corresponds to multiple display forms; the display module 2001 is used for:
- the target form is the display form corresponding to the content type of the highlights among the display forms of the playback control.
- the device also includes:
- a determination module 2002 configured to determine the content type of the highlights by using at least one of the first machine learning model, the second machine learning model, the third machine learning model and the fourth machine learning model;
- the first machine learning model predicts the content type of the highlight segment by identifying the playback picture of the highlight segment, and the first machine learning model is obtained by training the playback picture of the sample segment and the content type of the sample segment;
- the second machine The learning model predicts the content type of the highlight segment by identifying the audio of the highlight segment;
- the second machine learning model is trained by the audio of the sample segment and the content type of the sample segment;
- the third machine learning model is obtained by identifying the highlight segment
- the corresponding commentary audio predicts the content type of the highlight segment, the third machine learning model is obtained by training the commentary audio corresponding to the sample segment and the content type of the sample segment;
- the fourth machine learning model is obtained by identifying the user corresponding to the highlight segment
- the operation data predicts the content type of the highlight segment, and the fourth machine learning model is obtained through training on the user operation data corresponding to the sample segment and the content type of the sample segment.
- the distance between two adjacent playback controls displayed in the progress bar is not less than a distance threshold.
- a virtual environment is displayed in the live broadcast screen, a target virtual character exists in the virtual environment, and highlights are generated based on the behavior of the target virtual character.
- a playback control of the highlights corresponding to the target virtual character is displayed on the side of the target virtual character.
- display module 2001 for:
- a highlight mark is displayed on the target avatar, and the highlight mark is used to highlight the target avatar.
- the playback control of the highlights corresponding to the target virtual character is displayed around the target virtual character.
- display module 2001 for:
- a replay list of highlights is displayed in the live broadcast interface. Show playback controls in the playback list.
- display module 2001 for:
- the live broadcast image is displayed in the first split-screen area and the playback image of the highlights corresponding to the prompt barrage is displayed in the second split-screen area.
- display module 2001 for:
- a playback screen of the highlights is displayed in a small window at the edge of the live broadcast interface according to the preset duration;
- the live image is displayed in the first split-screen area and the playback image of the highlights is displayed in the second split-screen area.
- the avatars of virtual characters controlled by players participating in the competition are displayed on the live broadcast screen; the display module 2001 is used for:
- the live image is displayed in the first split-screen area and the playback image of the highlights corresponding to the target avatar is displayed in the second split-screen area.
- display module 2001 for:
- a detail introduction control corresponding to the highlight segment is displayed on the live broadcast interface, and information for introducing the highlight segment is displayed in the detail introduction control.
- the live image is displayed in the first split-screen area and the playback image is displayed in the second split-screen area.
- display module 2001 for:
- the live broadcast image is displayed in the first split-screen area and the playback image is displayed in the second split-screen area.
- the trajectory condition is set for the sliding trajectory of the gesture operation.
- the device also includes:
- the determination module 2002 is configured to determine the display ratio of the second split-screen area in the live interface according to the type of the highlights.
- display module 2001 for:
- the playback images of the highlight segments of the live event stream are switched and displayed in chronological order.
- the display device for the live broadcast of the game provided by the above embodiment is only illustrated by the division of the above functional modules.
- the internal structure is divided into different functional modules to complete all or part of the functions described above.
- the display device for the live event provided by the above embodiment and the embodiment of the method for displaying the live event belong to the same concept, and its specific implementation process is detailed in the method embodiment, and will not be repeated here.
- the embodiment of the present application also provides a computer device, the computer device includes: a processor and a memory, at least one instruction, at least one section of program, code set or instruction set are stored in the memory, at least one instruction, at least one section of program, code The set or instruction set is loaded and executed by the processor to implement the display method for the live event provided by the above method embodiments.
- the computer device is a terminal.
- FIG. 22 is a schematic structural diagram of a terminal provided by an exemplary embodiment of the present application.
- the terminal 2200 includes: a processor 2201 and a memory 2202 .
- the processor 2201 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like.
- Processor 2201 can adopt at least one hardware form in DSP (Digital Signal Processing, digital signal processing), FPGA (Field-Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array, programmable logic array) accomplish.
- the processor 2201 can also include a main processor and a coprocessor, and the main processor is a processor for processing data in a wake-up state, also called a CPU (Central Processing Unit, central processing unit); the coprocessor is Low-power processor for processing data in standby state.
- CPU Central Processing Unit, central processing unit
- the coprocessor is Low-power processor for processing data in standby state.
- the processor 2201 may be integrated with a GPU (Graphics Processing Unit, image processor), and the GPU is used for rendering and drawing the content to be displayed on the display screen.
- the processor 2201 may also include an AI (Artificial Intelligence, artificial intelligence) processor, where the AI processor is used to process computing operations related to machine learning.
- AI Artificial Intelligence, artificial intelligence
- Memory 2202 may include one or more computer-readable storage media, which may be non-transitory.
- the memory 2202 may also include high-speed random access memory and non-volatile memory, such as one or more magnetic disk storage devices and flash memory storage devices.
- the non-transitory computer-readable storage medium in the memory 2202 is used to store at least one instruction, and the at least one instruction is used to be executed by the processor 2201 to realize the live broadcast of the event provided by the method embodiment in this application display method.
- the terminal 2200 may also optionally include a display screen 2203 .
- the display screen 2203 is used to display a UI (User Interface, user interface).
- the UI can include graphics, text, icons, video, and any combination thereof.
- the display screen 2203 is a touch display screen, the display screen 2203 also has the capability of collecting touch signals on or above the surface of the display screen 2203 .
- the touch signal can be input to the processor 2201 as a control signal for processing.
- the display screen 2203 can also be used to provide virtual buttons and/or virtual keyboards, also called soft buttons and/or soft keyboards.
- the display screen 2203 there may be one display screen 2203, which is provided on the front panel of the terminal 2200; in other embodiments, there may be at least two display screens 2203, which are respectively provided on different surfaces of the terminal 2200 or in a folding design; In some other embodiments, the display screen 2203 may be a flexible display screen, which is arranged on a curved surface or a folded surface of the terminal 2200 . Even, the display screen 2203 can also be set as a non-rectangular irregular figure, that is, a special-shaped screen.
- the display screen 2203 can be made of LCD (Liquid Crystal Display, liquid crystal display), OLED (Organic Light-Emitting Diode, organic light-emitting diode) and other materials.
- FIG. 22 does not constitute a limitation on the terminal 2200, and may include more or less components than shown in the figure, or combine some components, or adopt a different component arrangement.
- the embodiment of the present application also provides a computer-readable storage medium, at least one program code is stored in the computer-readable storage medium, and when the program code is loaded and executed by the processor of the computer device, the implementation of the above-mentioned methods can be realized.
- the display method of the live event provided by the example.
- the present application also provides a computer program product or computer program, the computer program product or computer program comprising computer instructions stored in a computer-readable storage medium.
- the processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method for displaying live events provided by the above method embodiments.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- User Interface Of Digital Computer (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
Description
Claims (33)
- 一种赛事直播的显示方法,其特征在于,应用于计算机设备中,所述方法包括:在直播界面中显示赛事直播流的直播画面,所述赛事直播流是基于虚拟环境中的虚拟角色进行竞技的赛事的直播流;在所述直播界面中显示精彩片段对应的回放控件,所述精彩片段是所述赛事直播流中的历史片段;响应于基于所述回放控件触发的分屏显示操作,在第一分屏区域显示所述直播画面以及在第二分屏区域显示所述精彩片段的回放画面,所述第一分屏区域与所述第二分屏区域是所述直播界面中不同的显示区域,所述第一分屏区域与所述第二分屏区域不存在交集。
- 根据权利要求1所述的方法,其特征在于,所述在所述直播界面中显示精彩片段对应的回放控件,包括:在所述直播界面中显示进度条;在所述进度条的目标进度位置显示所述回放控件,所述目标进度位置用于指示所述精彩片段在所述赛事直播流中对应的播放进度。
- 根据权利要求2所述的方法,其特征在于,所述回放控件对应有多个显示形态;所述在所述进度条的目标进度位置显示所述回放控件,包括:在所述进度条的目标进度位置,显示目标形态的回放控件;其中,所述目标形态是所述回放控件的所述显示形态中与所述精彩片段的内容的类型对应的显示形态。
- 根据权利要求3所述的方法,其特征在于,所述方法还包括:通过第一机器学习模型、第二机器学习模型、第三机器学习模型和第四机器学习模型中的至少一种模型,确定所述精彩片段的内容的类型;其中,所述第一机器学习模型是通过识别所述精彩片段的回放画面预测所述精彩片段的内容的类型的,所述第一机器学习模型是通过样本片段的回放画面以及所述样本片段的内容的类型训练得到的;所述第二机器学习模型是通过识别所述精彩片段的音频预测所述精彩片段的内容的类型的,所述第二机器学习模型是通过所述样本片段的音频以及所述样本片段的内容的类型训练得到的;所述第三机器学习模型是通过识别所述精彩片段对应的解说音频预测所述精彩片段的内容的类型的,所述第三机器学习模型是通过所述样本片段对应的解说音频以及所述样本片段的内容的类型训练得到的;所述第四机器学习模型是通过识别所述精彩片段对应的用户操作数据预测所述精彩片段的内容的类型的,所述第四机器学习模型是通过所述样本片段对应的用户操作数据以及所述样本片段的内容的类型训练得到的。
- 根据权利要求2所述的方法,其特征在于,所述进度条中显示的相邻两个回放控件之间的距离不小于距离阈值。
- 根据权利要求1所述的方法,其特征在于,所述直播画面中显示有所述虚拟环境,所述虚拟环境中存在目标虚拟角色,所述精彩片段是基于所述目标虚拟角色的行为产生的;所述在所述直播界面中显示精彩片段对应的回放控件,包括:在所述目标虚拟角色的周侧显示所述目标虚拟角色对应的精彩片段的回放控件。
- 根据权利要求6所述的方法,其特征在于,所述在所述目标虚拟角色的周侧显示所述目标虚拟角色对应的精彩片段的回放控件,包括:在所述目标虚拟角色上显示突出标记,所述突出标记用于突出显示所述目标虚拟角色;响应于基于所述目标虚拟角色触发的控件显示操作,在所述目标虚拟角色的周侧显示所述目标虚拟角色对应的精彩片段的回放控件。
- 根据权利要求1所述的方法,其特征在于,所述在所述直播界面中显示精彩片段对应的回放控件,包括:响应于回放列表显示操作,在所述直播界面中显示所述精彩片段的回放列表;在所述回放列表中显示所述回放控件。
- 根据权利要求1至8任一所述的方法,其特征在于,所述直播画面上显示有直播弹幕;所述方法还包括:在所述直播弹幕中显示所述精彩片段对应的提示弹幕;响应于所述提示弹幕触发的分屏显示操作,在所述第一分屏区域显示所述直播画面以及在所述第二分屏区域显示所述提示弹幕对应的精彩片段的回放画面。
- 根据权利要求1至8任一所述的方法,其特征在于,所述方法还包括:响应于获取到所述精彩片段,按照预设时长在所述直播界面的边缘采用小窗的方式显示所述精彩片段的回放画面;响应于所述回放画面触发的分屏显示操作,在所述第一分屏区域显示所述直播画面以及在所述第二分屏区域显示所述精彩片段的回放画面。
- 根据权利要求1至8任一所述的方法,其特征在于,所述直播画面中显示有参与所述赛事的选手控制的虚拟角色的头像;所述方法还包括:响应于目标虚拟角色的头像触发的列表显示操作,显示所述目标虚拟角色对应的精彩片段的回放列表,所述回放列表中显示有所述目标虚拟角色对应的精彩片段的回放控件,所述精彩片段是基于所述目标虚拟角色的行为产生的;响应于所述目标虚拟角色对应的回放控件触发的分屏显示操作,在所述第一分屏区域显示所述直播画面以及在所述第二分屏区域显示所述目标虚拟角色对应的精彩片段的回放画面。
- 根据权利要求1至8任一所述的方法,其特征在于,所述响应于基于所述回放控件触发的分屏显示操作,在第一分屏区域显示所述直播画面以及在第二分屏区域显示所述精彩片段的回放画面,包括:响应于所述回放控件触发的详情显示操作,在所述直播界面中显示所述精彩片段对应的详情介绍控件,所述详情介绍控件中显示有用于介绍所述精彩片段的信息;响应于所述详情介绍控件触发的分屏显示操作,在所述第一分屏区域显示所述直播画面以及在所述第二分屏区域显示所述回放画面。
- 根据权利要求1至8任一所述的方法,其特征在于,所述方法还包括:响应于所述直播界面中的手势操作满足轨迹条件,在所述第一分屏区域显示所述直播画面以及在所述第二分屏区域显示所述回放画面;其中,所述轨迹条件是针对所述手势操作的滑动轨迹设置的。
- 根据权利要求1至8所述的方法,其特征在于,所述方法还包括:根据所述精彩片段的内容的类型,确定所述第二分屏区域在所述直播界面中的显示比例。
- 根据权利要求1至8任一所述的方法,其特征在于,所述方法还包括:在所述赛事直播流包括多个精彩片段的情况下,响应于针对所述回放画面的切换操作,按照时间顺序切换显示所述赛事直播流的精彩片段的回放画面。
- 一种赛事直播的显示装置,其特征在于,所述装置包括:显示模块,用于在直播界面中显示赛事直播流的直播画面,所述赛事直播流是基于虚拟环境中的虚拟角色进行竞技的赛事的直播流;所述显示模块,还用于在所述直播界面中显示精彩片段对应的回放控件,所述精彩片段是所述赛事直播流中的历史片段;所述显示模块,还用于响应于基于所述回放控件触发的分屏显示操作,在第一分屏区域显示所述直播画面以及在第二分屏区域显示所述精彩片段的回放画面,所述第一分屏区域与所述第二分屏区域是所述直播界面中不同的显示区域,所述第一分屏区域与所述第二分屏区域不存在交集。
- 根据权利要求16所述的装置,其特征在于,所述显示模块,用于:在所述直播界面中显示进度条;在所述进度条的目标进度位置显示所述回放控件,所述目标进度位置用于指示所述精彩片段在所述赛事直播流中对应的播放进度。
- 根据权利要求17所述的装置,其特征在于,所述回放控件对应有多个显示形态;所述显示模块,用于:在所述进度条的目标进度位置,显示目标形态的回放控件;其中,所述目标形态是所述回放控件的所述显示形态中与所述精彩片段的内容的类型对应的显示形态。
- 根据权利要求18所述的装置,其特征在于,所述装置还包括:确定模块,用于通过第一机器学习模型、第二机器学习模型、第三机器学习模型和第四机器学习模型中的至少一种模型,确定所述精彩片段的内容的类型;其中,所述第一机器学习模型是通过识别所述精彩片段的回放画面预测所述精彩片段的内容的类型的,所述第一机器学习模型是通过样本片段的回放画面以及所述样本片段的内容的类型训练得到的;所述第二机器学习模型是通过识别所述精彩片段的音频预测所述精彩片段的内容的类型的,所述第二机器学习模型是通过所述样本片段的音频以及所述样本片段的内容的类型训练得到的;所述第三机器学习模型是通过识别所述精彩片段对应的解说音频预测所述精彩片段的内容的类型的,所述第三机器学习模型是通过所述样本片段对应的解说音频以及所述样本片段的内容的类型训练得到的;所述第四机器学习模型是通过识别所述精彩片段对应的用户操作数据预测所述精彩片段的内容的类型的,所述第四机器学习模型是通过所述样本片段对应的用户操作数据以及所述样本片段的内容的类型训练得到的。
- 根据权利要求17所述的装置,其特征在于,所述进度条中显示的相邻两个回放控件之间的距离不小于距离阈值。
- 根据权利要求16所述的装置,其特征在于,所述直播画面中显示有所述虚拟环境,所述虚拟环境中存在目标虚拟角色,所述精彩片段是基于所述目标虚拟角色的行为产生的;所述显示模块,用于:在所述目标虚拟角色的周侧显示所述目标虚拟角色对应的精彩片段的回放控件。
- 根据权利要求21所述的装置,其特征在于,所述显示模块,用于:在所述目标虚拟角色上显示突出标记,所述突出标记用于突出显示所述目标虚拟角色;响应于基于所述目标虚拟角色触发的控件显示操作,在所述目标虚拟角色的周侧显示所述目标虚拟角色对应的精彩片段的回放控件。
- 根据权利要求16所述的装置,其特征在于,所述显示模块,用于:响应于回放列表显示操作,在所述直播界面中显示所述精彩片段的回放列表;在所述回放列表中显示所述回放控件。
- 根据权利要求16至23任一所述的装置,其特征在于,所述直播画面上显示有直播弹幕;所述显示模块,用于:在所述直播弹幕中显示所述精彩片段对应的提示弹幕;响应于所述提示弹幕触发的分屏显示操作,在所述第一分屏区域显示所述直播画面以及在所述第二分屏区域显示所述提示弹幕对应的精彩片段的回放画面。
- 根据权利要求16至23任一所述的装置,其特征在于,所述显示模块,用于:响应于获取到所述精彩片段,按照预设时长在所述直播界面的边缘采用小窗的方式显示所述精彩片段的回放画面;响应于所述回放画面触发的分屏显示操作,在所述第一分屏区域显示所述直播画面以及在所述第二分屏区域显示所述精彩片段的回放画面。
- 根据权利要求16至23任一所述的装置,其特征在于,所述直播画面中显示有参与所 述赛事的选手控制的虚拟角色的头像;所述显示模块,用于:响应于目标虚拟角色的头像触发的列表显示操作,显示所述目标虚拟角色对应的精彩片段的回放列表,所述回放列表中显示有所述目标虚拟角色对应的精彩片段的回放控件,所述精彩片段是基于所述目标虚拟角色的行为产生的;响应于所述目标虚拟角色对应的回放控件触发的分屏显示操作,在所述第一分屏区域显示所述直播画面以及在所述第二分屏区域显示所述目标虚拟角色对应的精彩片段的回放画面。
- 根据权利要求16至23任一所述的装置,其特征在于,所述显示模块,用于:响应于所述回放控件触发的详情显示操作,在所述直播界面中显示所述精彩片段对应的详情介绍控件,所述详情介绍控件中显示有用于介绍所述精彩片段的信息;响应于所述详情介绍控件触发的分屏显示操作,在所述第一分屏区域显示所述直播画面以及在所述第二分屏区域显示所述回放画面。
- 根据权利要求16至23任一所述的装置,其特征在于,所述显示模块,用于:响应于所述直播界面中的手势操作满足轨迹条件,在所述第一分屏区域显示所述直播画面以及在所述第二分屏区域显示所述回放画面;其中,所述轨迹条件是针对所述手势操作的滑动轨迹设置的。
- 根据权利要求16至23所述的装置,其特征在于,所述装置还包括:确定模块,用于根据所述精彩片段的内容的类型,确定所述第二分屏区域在所述直播界面中的显示比例。
- 根据权利要求16至23任一所述的装置,其特征在于,所述显示模块,用于:在所述赛事直播流包括多个精彩片段的情况下,响应于针对所述回放画面的切换操作,按照时间顺序切换显示所述赛事直播流的精彩片段的回放画面。
- 一种计算机设备,其特征在于,所述计算机设备包括处理器和存储器,所述存储器中存储有至少一条指令、至少一段程序、代码集或指令集,所述至少一条指令、所述至少一段程序、所述代码集或所述指令集由所述处理器加载并执行以实现如权利要求1至15任一所述的赛事直播的显示方法。
- 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质中存储有至少一条指令、至少一段程序、代码集或指令集,所述至少一条指令、所述至少一段程序、所述代码集或指令集由处理器加载并执行以实现如权利要求1至15任一所述的赛事直播的显示方法。
- 一种计算机程序产品,其特征在于,所述计算机程序产品包括计算机指令,所述计算机指令存储在计算机可读存储介质中,计算机设备的处理器从所述计算机可读存储介质读取所述计算机指令,所述处理器执行所述计算机指令,使得所述计算机设备执行如权利要求1至15任一所述的赛事直播的显示方法。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
BR112023021686A BR112023021686A2 (pt) | 2021-11-24 | 2022-10-31 | Método de exibição e aparelho para transmissão ao vivo de eventos, dispositivo e meio de armazenamento |
US18/340,884 US20230336792A1 (en) | 2021-11-24 | 2023-06-25 | Display method and apparatus for event livestreaming, device and storage medium |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111402724.5 | 2021-11-24 | ||
CN202111402724 | 2021-11-24 | ||
CN202111643183.5 | 2021-12-29 | ||
CN202111643183.5A CN114339368B (zh) | 2021-11-24 | 2021-12-29 | 赛事直播的显示方法、装置、设备及存储介质 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/340,884 Continuation US20230336792A1 (en) | 2021-11-24 | 2023-06-25 | Display method and apparatus for event livestreaming, device and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023093465A1 true WO2023093465A1 (zh) | 2023-06-01 |
Family
ID=81017058
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2022/128699 WO2023093465A1 (zh) | 2021-11-24 | 2022-10-31 | 赛事直播的显示方法、装置、设备及存储介质 |
Country Status (4)
Country | Link |
---|---|
US (1) | US20230336792A1 (zh) |
CN (1) | CN114339368B (zh) |
BR (1) | BR112023021686A2 (zh) |
WO (1) | WO2023093465A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116781985A (zh) * | 2023-08-23 | 2023-09-19 | 北京盘腾科技有限公司 | 一种赛事直播画面的控制方法及装置 |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114339368B (zh) * | 2021-11-24 | 2023-04-14 | 腾讯科技(深圳)有限公司 | 赛事直播的显示方法、装置、设备及存储介质 |
CN114827735A (zh) * | 2022-04-21 | 2022-07-29 | 咪咕文化科技有限公司 | 视频回看方法、装置、设备及存储介质 |
CN117061779A (zh) * | 2022-05-06 | 2023-11-14 | 腾讯科技(深圳)有限公司 | 直播画面显示方法、装置、设备、存储介质及程序产品 |
CN115002529A (zh) * | 2022-05-07 | 2022-09-02 | 咪咕文化科技有限公司 | 视频拆条方法、装置、设备及存储介质 |
CN115079879A (zh) * | 2022-06-06 | 2022-09-20 | 北京字跳网络技术有限公司 | 直播页面的显示方法、装置、设备、存储介质和程序产品 |
CN115834946A (zh) * | 2022-11-09 | 2023-03-21 | 北京字跳网络技术有限公司 | 交互方法、装置、电子设备和存储介质 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20180369693A1 (en) * | 2017-06-26 | 2018-12-27 | Netease (Hangzhou) Network Co.,Ltd. | Virtual Character Control Method, Apparatus, Storage Medium and Electronic Device |
CN111836110A (zh) * | 2020-07-23 | 2020-10-27 | 腾讯科技(深圳)有限公司 | 比赛视频的展示方法、装置、电子设备及存储介质 |
CN113301421A (zh) * | 2021-05-19 | 2021-08-24 | 广州繁星互娱信息科技有限公司 | 直播片段展示方法和装置、存储介质及电子设备 |
CN113490010A (zh) * | 2021-07-06 | 2021-10-08 | 腾讯科技(深圳)有限公司 | 基于直播视频的互动方法、装置、设备及存储介质 |
CN113497946A (zh) * | 2020-03-20 | 2021-10-12 | 腾讯科技(深圳)有限公司 | 视频处理方法、装置、电子设备和存储介质 |
CN114339368A (zh) * | 2021-11-24 | 2022-04-12 | 腾讯科技(深圳)有限公司 | 赛事直播的显示方法、装置、设备及存储介质 |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10187666B2 (en) * | 2016-01-26 | 2019-01-22 | Twitter, Inc. | Live video streaming services using one or more external devices |
US10397620B2 (en) * | 2016-06-30 | 2019-08-27 | SnifferCat, Inc. | Systems and methods for dynamic stitching of advertisements in live stream content |
CN106851327A (zh) * | 2016-12-31 | 2017-06-13 | 天脉聚源(北京)科技有限公司 | 回看互动的方法和装置 |
CN108668163B (zh) * | 2018-05-03 | 2020-03-20 | 广州虎牙信息科技有限公司 | 直播播放方法、装置、计算机可读存储介质和计算机设备 |
CN112995687B (zh) * | 2021-02-08 | 2023-06-23 | 腾竞体育文化发展(上海)有限公司 | 基于互联网的互动方法、装置、设备及介质 |
CN113014957B (zh) * | 2021-02-25 | 2023-01-31 | 北京市商汤科技开发有限公司 | 视频镜头切分方法和装置、介质和计算机设备 |
-
2021
- 2021-12-29 CN CN202111643183.5A patent/CN114339368B/zh active Active
-
2022
- 2022-10-31 WO PCT/CN2022/128699 patent/WO2023093465A1/zh unknown
- 2022-10-31 BR BR112023021686A patent/BR112023021686A2/pt unknown
-
2023
- 2023-06-25 US US18/340,884 patent/US20230336792A1/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20180369693A1 (en) * | 2017-06-26 | 2018-12-27 | Netease (Hangzhou) Network Co.,Ltd. | Virtual Character Control Method, Apparatus, Storage Medium and Electronic Device |
CN113497946A (zh) * | 2020-03-20 | 2021-10-12 | 腾讯科技(深圳)有限公司 | 视频处理方法、装置、电子设备和存储介质 |
CN111836110A (zh) * | 2020-07-23 | 2020-10-27 | 腾讯科技(深圳)有限公司 | 比赛视频的展示方法、装置、电子设备及存储介质 |
CN113301421A (zh) * | 2021-05-19 | 2021-08-24 | 广州繁星互娱信息科技有限公司 | 直播片段展示方法和装置、存储介质及电子设备 |
CN113490010A (zh) * | 2021-07-06 | 2021-10-08 | 腾讯科技(深圳)有限公司 | 基于直播视频的互动方法、装置、设备及存储介质 |
CN114339368A (zh) * | 2021-11-24 | 2022-04-12 | 腾讯科技(深圳)有限公司 | 赛事直播的显示方法、装置、设备及存储介质 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116781985A (zh) * | 2023-08-23 | 2023-09-19 | 北京盘腾科技有限公司 | 一种赛事直播画面的控制方法及装置 |
CN116781985B (zh) * | 2023-08-23 | 2023-10-20 | 北京盘腾科技有限公司 | 一种赛事直播画面的控制方法及装置 |
Also Published As
Publication number | Publication date |
---|---|
CN114339368A (zh) | 2022-04-12 |
CN114339368B (zh) | 2023-04-14 |
BR112023021686A2 (pt) | 2023-12-19 |
US20230336792A1 (en) | 2023-10-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2023093465A1 (zh) | 赛事直播的显示方法、装置、设备及存储介质 | |
US10272336B2 (en) | Restoring gameplay by replaying past inputs | |
WO2022151946A1 (zh) | 虚拟角色的控制方法、装置、电子设备、计算机可读存储介质及计算机程序产品 | |
US9959008B2 (en) | Computer peripheral display and communication device providing an adjunct 3D user interface | |
CN114286161B (zh) | 赛事直播时物品推荐方法、装置、设备及存储介质 | |
CN112416196B (zh) | 虚拟对象的控制方法、装置、设备及计算机可读存储介质 | |
JP7447296B2 (ja) | 仮想道具のインタラクティブ処理方法、装置、電子機器及びコンピュータプログラム | |
WO2022222592A1 (zh) | 虚拟对象的信息显示方法、装置、电子设备及存储介质 | |
CN110801629B (zh) | 虚拟对象生命值提示图形的显示方法、装置、终端及介质 | |
WO2022257653A1 (zh) | 虚拟道具的显示方法、装置、电子设备及存储介质 | |
CN112691366B (zh) | 虚拟道具的显示方法、装置、设备及介质 | |
US20230398453A1 (en) | Virtual item processing method and apparatus, electronic device, computer-readable storage medium, and computer program product | |
WO2022121503A1 (zh) | 预购道具的显示方法、装置、设备、介质及产品 | |
CN112402959A (zh) | 虚拟对象的控制方法、装置、设备及计算机可读存储介质 | |
JP2024500929A (ja) | 仮想シーンに表情を表示する方法と装置及びコンピュータ機器とプログラム | |
JP7504287B2 (ja) | 画面表示方法、装置、機器及びコンピュータプログラム | |
CN114339438A (zh) | 基于直播画面的互动方法、装置、电子设备及存储介质 | |
WO2023024880A1 (zh) | 虚拟场景中的表情显示方法、装置、设备以及介质 | |
CN116531758A (zh) | 虚拟角色的控制方法、装置、存储介质以及电子装置 | |
CN115634449A (zh) | 虚拟场景中控制虚拟对象的方法、装置、设备及产品 | |
JP2024524734A (ja) | 試合生放送の表示方法と装置、コンピュータ機器及びコンピュータプログラム | |
WO2023231557A1 (zh) | 虚拟对象的互动方法、装置、设备、存储介质及程序产品 | |
WO2024060924A1 (zh) | 虚拟场景的互动处理方法、装置、电子设备及存储介质 | |
WO2024066936A1 (zh) | 游戏视频的播放方法、装置、设备及存储介质 | |
Zhou et al. | Data Feel: Exploring Visual Effects in Video Games to Support Sensemaking Tasks |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22897548 Country of ref document: EP Kind code of ref document: A1 |
|
REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112023021686 Country of ref document: BR |
|
ENP | Entry into the national phase |
Ref document number: 112023021686 Country of ref document: BR Kind code of ref document: A2 Effective date: 20231018 |
|
ENP | Entry into the national phase |
Ref document number: 2024502658 Country of ref document: JP Kind code of ref document: A |