TW202345606A - Video playback system and method for providing switch of view angle characterized in that there is no need to open other players to watch a sub-view angle film - Google Patents

Abstract

The present invention discloses a video playback system for providing the switch of view angle, which includes a playback module, a caption controlling module and a film view angle module. The playback module acquires a film file that has one or more view angle pictures; the caption controlling module reads and analyzes a caption file that has several time segments on a timeline; each time segment corresponds to the film identification of at least one of films; and the film view angle module receives the caption file and is based on at least one film identification corresponding to each time segment described by the caption file to determine the playback module to read at least one film file. Thereby, there is no need to open other players to watch a sub-view angle film.

Description

Video playback system and method providing perspective switching

The present invention provides an audio and video system and method, and in particular, relates to an audio and video playback system and method that provide a viewing angle switching function.

Generally, audio and video players can only display one screen at the same time, and users can only watch videos from a single screen. Some types of videos, such as concert recordings, are post-edited from different angles shot by different cameras at different locations. Other content that has not been edited into the video can only be included in the outtakes, or in other places. Save it as a video file. Therefore, to watch images from two different angles at the same time, viewers usually need to open multiple players to watch the images from different angles.

Therefore, it is necessary to develop an audio-visual system with a viewing angle switching function, so that viewers can switch to the picture they want to watch in certain circumstances without having to use multiple players at the same time, so that the video viewing experience can be more optimized.

One object of the present invention is to provide an audio-visual playback system that provides perspective switching, including: a playback module that reads multiple video files and plays one or more frames according to one or more of the multiple video files. ; A subtitle control module that reads and parses a subtitle file that describes multiple time segments on a timeline, and each time segment corresponds to a video identification of at least one of the multiple videos. ; and a video perspective module connected to the subtitle control module to receive the subtitle file and determine the playback based on each time segment described by the subtitle file and at least one video identification corresponding to each time segment. The module reads at least one video file.

In a specific embodiment, the one or more pictures include a main-view picture and at least a primary-view picture.

In a specific embodiment, the subtitle file does not describe text for presentation in the one or more frames.

In a specific embodiment, each time segment described by the subtitle file consists of a start time and an end time, and each video identification indicates one of the plurality of video files.

In a specific embodiment, the video identification also indicates a play node of one of the plurality of video files.

In a specific embodiment, the timeline is defined by a start time and an end time of a main video file among the plurality of video files.

In a specific embodiment, the video perspective module determines the playback time based on a starting time of each time segment and at least one video file indicated by the corresponding at least one video identification and a playback node of the at least one video file. The module reads the audio and video content after the playback node of the at least one video file at the starting time.

Another object of the present invention is to provide an audio-visual playback method for switching viewing angles, which includes: a playback module, obtaining, reading and playing a first video file; and a subtitle control module, in response to the content read by the playback module. The first video file reads and parses a subtitle file, the subtitle file describes a plurality of time segments on a timeline, and each time segment corresponds to a video identification of at least one video in the plurality of videos; And a video perspective module determines whether the playback module reads and plays a second video file based on each time segment described by the subtitle file and at least one video identification corresponding to each time segment; wherein, the The playback module presents the first video file in a main perspective screen, the playback module presents the second video file in a primary perspective screen, and the secondary perspective screen is superimposed on the main perspective screen, thereby forming a method for Multiple pictures of the perspective switching.

In order to allow the review committee to better understand the technical content of the present invention, preferred specific embodiments are described below.

As shown in Figure 1, the present invention provides an audio-visual playback system 1 that provides viewing angle switching, including a playback module 4, a subtitle control module 5 and a video perspective module 6 that are communicatively connected to the playback module 4. The audio and video playback of viewing angle switching means that the video viewing angle module 6 determines the playback module 4 to read and play multiple viewing angle images based on the subtitle file 3 analyzed by the subtitle control module 5 .

The playback module 4 is configured to read or download a video file 2 and a subtitle file 3 from a storage unit. The video file 2 and the subtitle file 3 can be downloaded to the playback module 4 through a URL. In a specific embodiment, the playback module 4 may be an audio and video playback module embedded in a web browser or an application. For example, a handheld device can access video files 2 and subtitle files 3 stored on a server in the network through a web browser or application, and process the video file 2 by browsing the web page or an audio and video player embedded in a specific application. . The playback module 4 is configured to present one or more images from different perspectives according to one or more of the video files 2 , as shown in FIG. 4 .

The playback module 4 is connected in communication with the subtitle control module 5, and the subtitle control module 5 reads and parses the subtitle file 3 from the playback module 4. The subtitle file 3 of the present invention can be a subtitle file format that can be read by existing audio and video players. However, the subtitle file 3 is not used to present text on the screen. Therefore, the subtitle file 3 of the present invention does not describe the use of the subtitle file in the above-mentioned video player. or text presented in multiple screens. Specifically, the subtitle file 3 describes a plurality of time segments on a timeline and at least one video identification (such as a video code or name) corresponding to each time segment. Each time segment described in the subtitle file 3 consists of a start time and an end time, and each time segment is different from another time segment. Each video identification indicates one of the plurality of video files 2, and different video identifications respectively correspond to different video files.

The video perspective module 6 determines the playback module 4 to read at least one video file 2 based on each time segment and each video identification described in the subtitle file 3 . For example, the video perspective module 6 can cause the playback module 4 to read the first video file from the video file 2 based on the described first time segment and a first video file corresponding to the first time segment. . Moreover, the video perspective module 6 can cause the playback module 4 to read the third video file from the video file 2 based on the described second time period and a first video file and a second video file corresponding to the second time period. A video file and the second video file. Accordingly, based on the different time segments described in the subtitle file 3 and the corresponding at least one video identification, the video perspective module 6 can cause the playback module 4 to present at least one frame for playing the video.

The playback module 4 is further configured to receive a switching input from the user, the switching input instructs the user to select one of the plurality of pictures. In one embodiment, the playback module 4 determines one of the plurality of pictures as a primary perspective picture and the other pictures as a secondary perspective picture based on the switching input. In another embodiment, the playback module 1 determines one of the plurality of pictures as the main perspective picture based on the switching input, and the pictures from other perspectives are hidden from the audience due to the switching input.

Please refer to FIG. 2 , the following is a flowchart of the steps of the method of the audio and video playback system according to the perspective switching. In this embodiment, the video playback method is based on the user operating the player to complete the viewing angle switching. The player may be at least embodied by the playback module 4, the subtitle control module 5 and the video perspective module 6 as shown in Figure 1, but the present invention is not limited thereto. The following steps are taken as an example to play concert audio and video content.

Step S101: When the user wants to use the player for video playback, the video playback system 1 downloads a video file 2 and a subtitle file 3, and the playback module 4 reads the video file 2, which includes a main video file. (such as performer content) and at least one video clip (such as audience or crew content). The length of the main video file is defined by a timeline, and the timeline covers the entirety of an audiovisual content (such as a concert). The length of the secondary video file is smaller than that of the primary video file and is between the endpoints of the primary video file's timeline.

Step S102: The aforementioned playback module 4 starts playing the content of a main perspective screen (such as performer content) based on the read main video file. The main view image refers to the image that is most visible to the audience, for example, it is the largest image or the most conspicuous image on the display. The playback module 4 can be configured to directly play the main video file in response to the reading of the main video file once it is determined that there is a main video file. Alternatively, the playback module 4 can read and play the main video file according to the description of the subtitle file 3 , which means that the playback module 4 cannot play the main video file if it does not read the subtitle file 3 .

Step S103: The subtitle control module 5 reads and parses the subtitle file 3. The subtitle file 3 describes a plurality of time segments, each of which is defined by a start time and an end time. In particular, the start time and end time of each time segment are consistent with the timeline of the main video file. corresponding to the time. Each time segment also corresponds to at least one video identification. The video identification indicates the primary video file or the secondary video file. The video identification also corresponds to a playback node. If a video identification indicates a main video file, a play node corresponding to the video identification indicates a play node of the main video file. Similarly, if a video identification indicates a video file, a play node corresponding to the video identification indicates a play node of the video file. The playback node indicates a start playback time node of a video file (such as a primary video file or a secondary video file). As a result, the subtitle control module 5 parses a plurality of time segments from the subtitle file 3, and each time segment corresponds to at least one video identification, and each video identification corresponds to a playback node. Specific embodiments of the subtitle file 3 will be described in the relevant paragraphs of Figure 3 .

Step S104: The video perspective module 6 determines that the playback module 4 reads at least one video file from the video file 2 based on the multiple time segments described by the subtitle file 3, the video identification and playback nodes corresponding to each time segment. For example, the video perspective module 6 allows the playback module 4 to read the main video file content (such as performer content) between a start time and an end time based on a time segment and a main video file identification description. Accordingly, when a time segment corresponds to a first video identification and a second video identification, and the first video identification and the second video identification respectively correspond to a first playback node and a second playback node, then The playback module 4 will accordingly read a first video file (such as the main video file) and a second video file (such as the secondary video file) at the starting time of the time segment, and from the first video file The first playback node and the second playback node of the second video file begin to read content. Then, the playback module 4 displays a first picture (such as a main perspective picture) and a second picture (such as a secondary perspective picture) according to the read content, wherein the first picture plays the first video file after the first playback node. Content (such as performer content), the second screen plays the second video file content (such as audience or staff content) after the second playback node.

It should be understood that the "main perspective picture" and "secondary perspective picture" mentioned in this article are intended to distinguish the importance or priority of the picture in visual presentation. The content of the main perspective picture can be a main video file or a secondary video according to subsequent operations. The contents of the file. In a possible embodiment, the multiple pictures presented by the player may have different arrangements, combinations and visual effects, such as equal-sized pictures or picture-in-picture pictures. When the player presents the main perspective picture and the sub-perspective picture at the same time, specific visual effects can be given to the audience to identify the difference between the two pictures, so as to facilitate the audience's subsequent selection and switching. Specific embodiments of main-view images and sub-perspective images will be described in Figure 4 and related paragraphs.

Step S105: The audio-visual playback system 1 for perspective switching determines whether the user or viewer selects one of the multiple perspective frames based on whether a switching input is received. For example, when the player presents multiple viewing angle images according to step S104, the user can select one of the images through an input interface (such as a cursor or a touch screen). When the player presents a main-view picture and multiple sub-view pictures, the user can select the main-view picture or one of the sub-view pictures through the input interface. If the user selects the main perspective screen, the switching input is not generated and step S106 is entered. If the user selects one of the viewing angle images, the switching input is generated and step S107 is entered.

Step S106: In response to the user selecting the main perspective screen, the playback module 4 continues to read and play the content of the main perspective screen (such as performer content) until the end time of the corresponding time segment. The implication is that the user chooses not to view the content of the secondary perspective screen (such as audience or staff content). The playback module 4 can hide the secondary perspective screen and continue to play the content of the main perspective screen (performer content). Alternatively, the playback module 4 can further reduce the sub-view picture and continue to play the content (performer content) of the main-view picture.

Step S107: In response to the switching input generated by the user's selection of the sub-perspective screen, the playback module 4 switches the content played in the selected sub-perspective screen (such as audience or staff content) to the content of the main perspective screen until the corresponding time period end time. The effect of the switching may be the effect of enlarging the picture. The content of the selected secondary perspective screen (audience or staff content) is maximized to become the main perspective screen, while the content played in the original main perspective screen that is not selected (performer content) is reduced to the extent of the secondary perspective screen, or Hidden from view by the audience. The implication is that the user chooses to watch images from other sub-perspectives when performing video playback with perspective switching. In response to the switching of the sub-perspective picture to the main perspective picture, the playback module 4 reads and plays the content of the selected sub-perspective picture (audience or staff content) according to the corresponding play node described in the subtitle file 3 .

Step S108: The playback module 4 closes the currently presented perspective image according to the corresponding time segment described in the subtitle file 3, and reads and plays the content of the original main perspective image (performer content) according to the next time segment.

Please refer to FIG. 3 , the following describes a specific embodiment of the subtitle file of the present invention. The subtitle file of the present invention may be a file described according to a "WebVTT" format, but the present invention is not limited to this. The subtitle file describes a plurality of time segments 300 on a timeline, where the timeline refers to a timeline defined by a start time and an end time of a main video file. As shown in Figure 3, the subtitle file description has five time segments. Each time segment is defined by a start time 301 and an end time 302. Each time segment is neither the same nor overlapping with the next or previous time segment. As shown in the figure, the end time of the first time segment is "00:24.999", and the start time of the second time segment is "00:25.000". More specifically, the first time segment starts from the 0 second (endpoint) of the timeline and ends at 24.999 seconds, and the second time segment starts from the 25th second of the timeline and ends at 29.999 seconds, two times. Paragraphs do not overlap.

Each time segment 300 is also correspondingly described with at least one movie identification 303, which can be described by a name or a code. As shown in the figure, the next line of the first time segment "00:00.000 --> 00:24.999" corresponds to a description of a video identification "main", which can indicate a main video file (such as content about performers); and the The next line of the two time periods "00:25.000 --> 00:29.999" describes two video identifications "main" and "1", among which "1" can indicate a video file (such as content about the audience or staff) .

Each video identification 303 is also followed by a playback node 304. The play node 304 indicates a play node of the video file identified by the previously described video. As shown in the figure, the second time period "00:25.000 --> 00:29.999" corresponds to the description of two video identifications "main" and "1", and the playback node of the "main" video file is "00:25.000" ", the playback node of "1" video file is "-00:00.000". The negative value "-" indicates the action of preloading the video. Accordingly, the description of the second time paragraph indicates that the 25th second time point on the timeline is the 25th second of the timeline of the "main" main video file, and the "1" video file is read at the same time but It is not played, and the duration of the "main" video file will be extended to the end of the second time segment, which is 29.999 seconds. It should be understood that the time segment 300 in the embodiment of Figure 3 is based on the timeline of the main video file (i.e., the "main" video file), so the starting time 301 of each time segment 300 is consistent with the playback node of the video identification "main" , but the present invention is not limited to this.

The video perspective module 6 in Figure 1 can cause the playback module 4 to present at least one picture on the player according to the description of the subtitle file in Figure 3 . For example, according to the corresponding description of the third time segment "00:30.000 --> 00:34.999", the video perspective module 6 has two video identifications "main" and "1", and the playback node of the "main" video file is "00:30.000", the playback node of "1" video file is "00:00.000". Accordingly, the description of the third time paragraph is an instruction to instruct the playback module 4 to read the content after the 30th second of the "main" main video file at 30 seconds on the timeline, and at the same time read "1" The content after the fifth minute of the video file stops at 34.999 seconds in the timeline, which means that the playback module 4 reads the content of the "main" main video file until the 34.999th second and reads the "1" video file. content to the 4.999th second. Thereby, the playback module 4 can present a screen on the player to play the content after the 30th second of the "main" main video file, and also present another screen to play the content after the 0th second of the "1" video file. As a result, in response to the description of the third time paragraph, the player presents the user with two screens to play the content of the "main" and "1" video files respectively, and they are video perspective screens that the user can select through the input interface.

According to the description of the subtitle file in Figure 3, when the timeline advances from the end time of 39.999 seconds in the fourth time section to the start time of 40 seconds in the fifth time section, the video perspective module 6 causes the playback module 4 to stop reading. Get the content after the fifth minute and 4.999 seconds of the "1" video file and then read the content after the 40th second of the "main" main video. In other words, the content from the fifth minute to the next 4.999 seconds of the video file "1" is the content corresponding to the fourth time segment "00:35.000 --> 00:39.999". Once the fourth time period exceeds, the playback module 4 stops reading the "1" video file. Assuming that the user selects the "main" main video file in the fourth time period, the playback module 4 will continuously display the content of the "main" main video file in the main perspective screen during the fourth time period to the fifth time period. . Assuming that the user selects the "1" video file in the fourth time segment, the playback module 4 will display the content of the "1" video file to the main view screen in the fourth time segment and the content of the "main" main video will be hidden. Or pause; only in the fifth time segment will the content of the "main" main video file be presented to the main view screen again.

FIG. 4 illustrates a plurality of pictures presented by a player based on the subtitle file description of the present invention, including a main-view picture 400 and multiple sub-view pictures 401 . When the time progress cursor stays at a time point t on the time axis T, the player presents a main perspective image and multiple sub-perspective images for the user to select through the input interface to switch the perspective images. The main perspective screen 400 continuously plays the content of the video file (such as performer content), while the secondary perspective screen 401 can simultaneously play the content of other video files (such as audience or staff content) or play still images of other video content. The player shown in Figure 4 presents the main perspective picture 400 according to the subtitle file of the present invention, and the secondary perspective picture 401 is superimposed on the main perspective picture 400, but the present invention is not limited to this.

If the user selects the sub-view frame in Figure 4, the player can pause, reduce or hide the video content played in the main view frame 400, and at the same time enlarge one of the video frames 401 selected by the user. As for other sub-frame views not selected by the user, they can be hidden like the original main view frame 400 . It should be understood that as the time progress cursor advances on the timeline T, the player will read one or more videos at different starting times and different ending times based on the description of each time segment in the subtitle file. Stop reading related video files.

The above are only examples and are not limited to the examples. For example, anything that does not deviate from the basic structure of the invention should be within the scope of rights claimed by this patent, and the scope of the patent application should prevail.

1: Audio and video playback system with perspective switching 2:Video file 3: Subtitle file 300: time paragraph 301:Start time 302: end time 303:Video recognition 304:Play node 4:Play module 400: Main perspective screen 401: Sub-perspective screen 5: Subtitle control module 6:Video perspective module S101~S108: Steps T: Timeline t: time point

Figure 1 is a block diagram of an audio and video playback system for perspective switching according to the present invention. Figure 2 is a step flow chart of the audio and video playback method for perspective switching according to the present invention. Figure 3 is a subtitle file embodiment of the video and audio playback system for perspective switching according to the present invention. Figure 4 is a schematic diagram of the player of the video and audio playback system for perspective switching according to the present invention.

1: Audio and video playback system with perspective switching

2:Video file

3: Subtitle file

4:Play module

5: Subtitle control module

6:Video perspective module

Claims (10)

An audio-visual playback system that provides perspective switching, including: A playback module that reads multiple video files and plays one or more frames based on one or more of the multiple video files; A subtitle control module reads and parses a subtitle file that describes a plurality of time segments on a timeline, and each time segment corresponds to a video identification of at least one of the multiple videos; as well as A video perspective module connected to the subtitle control module for receiving the subtitle file and determining the playback module based on each time segment described by the subtitle file and at least one video identification corresponding to each time segment. Read at least one video file. An audio-visual playback system that provides perspective switching as described in claim 1, wherein the one or more pictures include a main-view picture and at least a primary-view picture. An audio-visual playback system that provides perspective switching as described in claim 1, wherein the subtitle file does not describe text for presentation in the one or more frames. An audio-visual playback system for perspective switching is provided as described in claim 1, wherein each time segment described by the subtitle file consists of a start time and an end time, and each video identification indicates one of the plurality of video files. file. An audio-visual playback system for perspective switching is provided as described in claim 4, wherein the video identification also indicates a playback node of one of the plurality of video files. An audio-visual playback system that provides perspective switching as described in claim 1, wherein the timeline is defined by a start time and an end time of a main video file among the plurality of video files. An audio-visual playback system that provides perspective switching as described in claim 1, wherein the video perspective module identifies at least one video file indicated and the at least one video file based on a starting time of each time segment and the corresponding at least one video. A playback node determines that the playback module reads the audio and video content after the playback node of the at least one video file at the starting time. An audio and video playback method that provides perspective switching, including: A playback module obtains, reads and plays a first video file; A subtitle control module reads and parses a subtitle file in response to the first video file read by the playback module. The subtitle file describes multiple time segments on a timeline, and each time segment is associated with A video identification corresponding to at least one of the plurality of videos; and A video perspective module determines whether the playback module reads and plays a second video file based on each time segment described by the subtitle file and at least one video identification corresponding to each time segment; Among them, the playback module presents the first video file in a main perspective screen, the playback module presents the second video file in a primary perspective screen, and the secondary perspective screen is superimposed on the main perspective screen, whereby A plurality of screens for the viewing angle switching are constituted. The audio and video playback method of perspective switching as described in claim 8 further includes: the playback module causes the two video files to be presented in the main perspective screen in response to a switching input from the user, and the first video file is presented in this perspective screen. The audio and video playback method for perspective switching described in claim 8 further includes: at least one video indicated by the video module based on a starting time of each time segment described in the subtitle file and the corresponding at least one video identification. file and a playback node of the at least one video file, determining the audio and video content after the playback node of the at least one video file is read by the playback module at the starting time.