TWI690203B - Video processing method base on time shift function - Google Patents

Abstract

A video processing method is based on a time shift function. The video processing method includes the step S01 to the step S05. The step S01 is receiving a video flow. The step S02 is displaying and registering the video flow synchronously. The step S03 is setting a plurality of tags on the video flow. The step S04 is choosing at least two of the tags. The step S05 is editing the video flow corresponding to the two tags to generate a video clip.

Description

Video and audio processing method based on time shift function

The invention relates to an audio-visual processing method, in particular to an audio-visual processing method based on the time shift function.

Time shift technology is a common function of video recording today, and its purpose is to not interrupt the user's viewing experience.

Time shifting technology generally utilizes a hard disk (Hard Disk) and divides it into a main storage area and a temporary storage area. When the time shift function is activated, the system will play a continuously transmitted audio and video stream to a monitor and store it in the temporary storage area of the hard disk at the same time. When the user is interrupted while watching the program of the audio and video stream, he can press the pause switch, and the continuously transmitted audio and video stream will be continuously stored in the temporary storage area. When the user returns to press the playback switch, the system will extract the stored audio and video streams from the temporary storage area, and the user can continue to watch from the interrupted place without missing the middle screen.

Due to the limited capacity of the temporary storage area of the hard disk, when the audio and video streams stored in the temporary storage area reach the upper limit, the system will choose to overwrite the older audio and video streams with newer audio and video streams. Therefore, if the user wants to keep the old audio and video stream, two methods are generally adopted. The first method is to save the audio and video stream in a space on the hard disk that is divided into a temporary storage area after the time shift is stopped. The second method is to transfer the audio and video stream copy to the main storage area for retention. In other words, in the second way, when the audio and video streaming capacity to be saved is 10GB, the main storage area must have more than 10GB of storage space before it can be transferred.

The current audio and video streams need to be transcoded when they are edited, which usually consumes a lot of processor computing performance, which makes the system not smooth. In addition, the entire audio and video stream will be mixed with such as advertising A picture that meets user needs. Therefore, the existing time-shifting technology, regardless of the time of the file or the size of the file, will contain a lot of invalid content, which makes the overall performance of the system low.

Therefore, how to provide an audio and video processing method capable of maintaining better system performance under the framework of the time-shifting function is one of the current important issues and is still a goal that the industry has to strive to achieve.

In view of this, one object of the present invention is to provide an audio and video processing method that can edit audio and video streams in a time-shifted state for subsequent transfer with a smaller file size and avoid occupying too much hard disk space.

In addition, another object of the present invention is to provide an audio and video processing method that can consume less processor resources to edit audio and video streams in a time-shifted state to maintain system performance.

In order to achieve the above object, the present invention provides an audio and video processing method based on the time shift function, which includes at least steps (S01) to (S05). The audio and video processing method is used in conjunction with an audio and video management system and a non-volatile storage medium. Step (S01) is to receive an audiovisual data stream. Step (S02) is to simultaneously perform a display playback and a temporary storage of the audio and video data stream. Step (S03) is to set a plurality of editing labels on the audiovisual data stream. Step (S04) is to select at least two of the editing tags. Step (S05) is to edit the audio and video data stream corresponding to the two editing tags to generate an audio and video editing segment.

According to an embodiment of the invention, the non-volatile storage medium has a main storage area and a temporary storage area. Among them, the audiovisual data stream is sequentially stored in the temporary storage area of the non-volatile storage medium against a time.

According to an embodiment of the present invention, the audio and video processing method is based on the space capacity of the non-volatile storage medium, and automatically distinguishes the space capacity ratio of the main storage area and the temporary storage area in real time.

According to an embodiment of the present invention, the audiovisual editing clips can be optionally stored in the main storage area, or displayed for playback, or streamed, or output to a corresponding receiving device via a wireless transmission interface.

As mentioned above, according to the video and audio processing method based on the time shift function of the present invention, the user sets the editing label of the video and audio data stream in real time. The user can select the desired editing tag to edit the audiovisual data stream corresponding to the editing tag. Finally, select to display playback, streaming or storage in the main storage area or output through the wireless transmission interface. Because the audio and video editing clips are generated by the editing tags selected by the user, the user can quickly generate an audio and video clip with a smaller file size, which is required by the user, and then transfer or transfer it. In order to avoid the conventional technology, the entire audio and video data stream must be saved before editing, which causes excessive system performance and time.

10, 20‧‧‧ Non-volatile storage media

101, 201, 201A ‧‧‧ main storage area

102, 202, 202A ‧‧‧ temporary storage area

A01‧‧‧ idle space

D01‧‧‧Data file

F01~F20‧‧‧Audio and video data

M01~M04, M11~M13‧Edit label

S01~S06, S11~S13‧‧‧‧Video processing method flow

VF1‧‧‧Video stream

VC1‧‧‧ video editing clips

FIG. 1 is a schematic diagram showing a non-volatile storage medium used in conjunction with the audiovisual processing method of the present invention.

FIG. 2 is a flowchart showing a video processing method according to a preferred embodiment of the present invention.

Figure 3A is a schematic diagram showing the flow of audiovisual data with edit tags.

Figure 3B is a schematic diagram showing one of the audiovisual editing clips.

Figure 4A is a schematic diagram showing another stream of audiovisual data with edit tags.

Fig. 4B is a schematic diagram showing another stream of audiovisual data with edit tags.

FIG. 5 is another flowchart showing the video processing method according to the preferred embodiment of the present invention.

6A and 6B are schematic diagrams showing the division of the main storage area and the temporary storage area of the non-volatile storage medium.

The following will explain the content of the present invention through the embodiments. The embodiments of the present invention are not intended to limit the invention to be implemented in any specific environment, application, or special manner as described in the embodiments. Therefore, the description of the embodiments is only for the purpose of explaining the present invention, not for limiting the present invention. It should be noted that, in the following embodiments and drawings, elements not directly related to the present invention have been omitted and not shown; and the dimensional relationship between the elements in the drawings is only for easy understanding and is not intended to limit the actual scale. In addition, In the following embodiments, the same elements will be described with the same element symbols.

According to the preferred embodiment of the present invention, the video processing method based on the time shift function is used in conjunction with online live broadcast software. Online live broadcasting software, such as Open Broadcaster Software (OBS), is streamed to the network in the form of streaming media to provide viewers with a link to watch.

Please refer to FIG. 1, which is a schematic diagram of a non-volatile storage medium 10 used in conjunction with the audiovisual processing method of the present invention. The non-volatile storage medium 10 is, for example, a hard disk (HD), a solid state drive (SSD), a read-only memory, or a flash memory. In this embodiment, the non-volatile storage medium 10 has a main storage area 101 and a temporary storage area 102. The temporary storage area 102 mainly provides that the system can perform the temporary storage of audio and video when the system is in the state of time shift function.

Next, please refer to FIG. 2 to illustrate the audiovisual processing method according to the preferred embodiment of the present invention, which includes steps S01 to S05. It will be further described here. In this embodiment, the hardware used in conjunction with the image processing method may further include an audio-visual management system, a computer, and a display. The audio-visual management system may be connected to the computer and the display, respectively. The above-mentioned non-volatile storage medium 10 can be installed in a computer, and the audio-visual management system can be a hardware or software built in the computer, which is not limited herein.

Step S01 is to receive an audiovisual data stream, which can be output by the computer and received by the audiovisual management system. In this embodiment, the file format of the audiovisual data stream is, for example, a transport stream (TS).

Step S02 simultaneously performs a display playback and a temporary storage of the audio and video data stream. Among them, the so-called display playback is to stream audio and video data to a display for display. The so-called audio and video temporary storage refers to storing the audio and video data streams in the temporary storage area 102 of the non-volatile storage medium 10 sequentially according to time, because the audio and video data streams located in the temporary storage area 102 are likely to be newer audio and video The data stream is overwritten, so it is called the temporary storage area 102. As shown in FIG. 1, the audiovisual data stream includes plural audiovisual data F01 to F20, which are sequentially stored in the temporary storage area 102 of the non-volatile storage medium 10.

In addition, in this embodiment, step S02 may further include streaming a stream of audiovisual data. The so-called streaming transmission refers to a technology that transmits a series of audio and video data in real time through the network for viewing. Streaming transmission can send live audio and video or videos pre-stored on the server. When the audio and video data is delivered to the viewer's computer, it is immediately played by specific playback software.

Step S03 is to set a plurality of editing tags (Tag) in the audiovisual data stream. The editing label is set by the user through the audio-visual management system to set the label on the audio-visual data at a specific time. As shown in FIG. 3A, the editing labels M01, M02, M03, and M04 can be set for the audiovisual data F03, F08, F12, and F16, respectively, through the audiovisual management system.

For example, the user can set the editing label M01 to the audiovisual data F03 when it appears on the display, and can also set the editing label M01 to the audiovisual data F03 during time-shift playback. In addition to setting a mark on the audio and video data stream, the editing label can also input additional information, such as file name or description, for subsequent use.

Step S04 is to select at least two of the editing tags. In step S05, the audio and video data stream corresponding to the two editing tags is edited to generate an audio and video editing segment (as shown in FIG. 3B). In this embodiment, the user can select the audio and video data stream corresponding to the editing tags M01 and M02 and the audio and video data stream corresponding to the editing tags M03 and M04 to be spliced together by the audio and video management system to generate audio and video Edit the clip VC1. In other words, the audiovisual editing segment VC1 will only retain audiovisual data F03~F08 and audiovisual data F12~F16.

In other embodiments, the audiovisual data F03~F08 corresponding to the editing tags M01 and M02, and the audiovisual data F12~F16 corresponding to the editing tags M03 and M04 can be used as an audiovisual editing segment, respectively. The operation of step S06 described later is performed.

In step S06, the audiovisual editing segment VC1 is substituted for the aforementioned audiovisual data stream for display playback or streaming transmission for viewing by the viewer. In addition, the audio-visual editing segment VC1 can also be selected to be stored in an idle space A01 of the main storage area 101 of the non-volatile storage medium according to the user's needs. Furthermore, the audio-visual editing segment VC1 can also be output to other electronic devices, such as mobile phones or tablets, via a wireless transmission interface computer.

It will be explained here again that, in actual operation, the above-mentioned video and audio data stream may be, for example, the user's game operation screen, which can be transmitted by, for example, a camera, in addition to the screen transmitted by the computer as described above, and the video and audio editing clips VC1 can be a brilliant clip of the game operation screen. In the audio and video management system, the audio and video data stream system can be set as a first lens, and the audio and video editing segment VC1 can be set as a second lens, the user can choose to switch the first lens for streaming transmission through the audio and video management system, Or you can choose to stream the second lens, and you can even perform operations such as pause playback and playback speed adjustment, which are not limited here.

As mentioned above, since the audiovisual editing segment VC1 transferred to the main storage area 101 is the audiovisual data that has been deleted and edited, the file size is relatively small compared to the original audiovisual data stream. Compared with the conventional technology, the complete audio-visual data stream must be saved to the hard disk before editing. Compared with the method of the present invention, the audio-visual processing method can effectively improve the system performance.

For example, assuming that the complete audiovisual data stream has a total of 10 GB, the main storage area 101 of the non-volatile storage medium 10 only has 500 MB of free space, and 100 MB of audiovisual data in the complete audiovisual data stream is what the user needs. In the conventional technology, the main storage area 101 of the non-volatile storage medium 10 must also have more than 10 GB of free space to store the complete audio-visual data stream. Therefore, in the conventional technology, the audio-visual data stream cannot be transferred. . However, with the audio and video processing method of this embodiment, the user can first edit the required audio and video data into an audio and video editing segment VC1 with a file size of 100 MB by setting an editing tag. In this way, the audio and video editing segment VC1 will Can be transferred to the main storage area 101.

In addition, please refer to Figure 4A, where the audio-visual data F01 is the latest audio-visual data, that is, the audio-visual data currently being displayed or playing, and F17 is the oldest audio-visual data. In other embodiments, the action of setting a plurality of editing tags in step S03 can be set by the user via the audio-visual management system for the audio-visual data F08 at a specific time, and the audio-visual management system presets one for the oldest audio-visual data F17. Edit the label M12.

In addition, as shown in FIG. 4B, in other embodiments, the above steps The action of setting plural editing tags in S03 can be set by the user through the audio-visual management system for the audio-visual data F08 at a specific time, and the audio-visual management system presets an editing label M13 in the latest audio-visual data F01.

In this way, the user can set only one editing label, and the other editing label is preset by the system, and the procedures from step S04 to step S06 can be performed, which is more convenient for the user's experience.

Next, please refer to FIG. 5, FIG. 6A and FIG. 6B again. The audio-visual processing method of the present invention can actively allocate the capacity of the main storage area 201 and the temporary storage area 202 in the non-volatile storage medium 20. In this embodiment, as shown in FIG. 6A, the main storage area 201 and the temporary storage area respectively have a capacity space of 50 GB, and the data file D01 occupies 10 GB of the main storage area 201.

As shown in FIG. 5, step S11 is to determine whether the capacity space of the main storage area 201 of the non-volatile storage medium 20 is sufficient when the capacity space of the temporary storage area 202 is insufficient. In this embodiment, when the capacity of the temporary storage area 202 is less than 10%, that is, less than 5 GB (that is, a video and audio data stream VF1 stores at least 45 GB), a determination mechanism will be activated.

Step S12 is to divide a part of the main storage area 201 into a part of the temporary storage area 202 when the capacity space of the main storage area 201 is sufficient. In this embodiment, the audio-visual management system divides 50% of the remaining capacity of the main storage area 201, that is, 20 GB, into a portion of the temporary storage area 202. Therefore, as shown in FIG. 6B, the main non-volatile storage medium 20 The storage area 201A has a total of 30GB, while the temporary storage area 202A has 70GB. In this way, when the capacity of the main storage area is sufficient, the audio and video data stream does not need to cover the old audio and video data stream in the temporary storage area, and the user can also have more buffer time to process the audio and video data stream in the temporary storage area .

In step S13, when the capacity space of the main storage area is insufficient, the audio-visual management system prompts the user on the display in a message to enable the user to deal with it. Furthermore, in other embodiments, when the capacity of the main storage area is insufficient, the newer audio and video data stream can also be used to overwrite the older audio and video data stream in the temporary storage area.

As mentioned above, in this embodiment, the audio and video data stream is described using the transmission stream (TS) file format as an example, but it is not limitative, and any format that can be transmitted as a stream is not limited to this. Also because the audio and video processing methods are direct processing The TS file format does not need to perform transcoding operations, so it does not require a lot of processor resources and can maintain the overall operating performance.

In summary, according to an audio-visual processing method based on the time-shifting function of the present invention, the user edits the settings of the audio-visual data stream in real time. The user can select the desired editing label to edit the audiovisual data stream corresponding to the editing label. Finally, select to display playback, streaming, or storage in the main storage area or output via the wireless transmission interface. Since the audio and video editing clips are generated by editing performed by the user-selected editing tags, the user can quickly generate an audio and video clip with a smaller file size and the user needs to transfer or send it. In order to avoid the conventional technology, the entire audio and video data stream must be saved before editing, and then the subsequent operations will cause excessive system performance.

This invention meets the requirements of the invention patent, and the patent application is filed in accordance with the law. However, the above are only the preferred embodiments of the present invention, and thus cannot limit the scope of patent application in this case. Anyone who is familiar with the skills of this case and equivalent modifications or changes made in accordance with the spirit of the invention of this case should be included in the scope of the following patent applications.

S01~S06‧‧‧‧Video processing method flow

Claims (10)

An audio-visual processing method based on the time-shifting function includes: receiving an audio-visual data stream; simultaneously performing a display playback and an audio-visual temporary storage on the audio-visual data stream; setting a plurality of editing labels on the audio-visual data stream; selecting the editing labels At least two of them; and editing the audiovisual data stream corresponding to the two editing tags to produce an audiovisual editing segment. The audio and video processing method according to claim 1, wherein the audio and video temporary storage is to sequentially store the audio and video data stream in a temporary area of a non-volatile storage medium. The audio and video processing method as described in claim 2 further includes: when the capacity space of the temporary storage area is insufficient, determining whether the capacity space of one of the non-volatile storage media's main storage area is sufficient; and when the capacity of the main storage area When there is enough space, a part of the main storage area is divided into a part of the temporary storage area. The audio-visual processing method as described in claim 1, further includes performing the display and playback of the audio-visual editing segment. The audio-visual processing method according to claim 4, wherein the audio-visual editing segment replaces the audio-visual data stream to perform the display playback. The audio and video processing method according to claim 1, further comprising storing the audio and video editing segment in a main storage area of a non-volatile storage medium. The audio and video processing method according to claim 1, further includes outputting the audio and video editing segment through a wireless transmission interface. The audio and video processing method as described in claim 1, wherein the edit tags correspond to audio and video data streams at different time points, respectively. The audio and video processing method according to claim 1 or 4, further includes streaming the audio and video data stream or the audio and video editing segment. An audio-visual processing method based on the time-shifting function includes: receiving an audio-visual data stream; simultaneously performing a display playback and an audio-visual temporary storage on the audio-visual data stream, wherein the video Temporary audio storage includes: sequentially storing the audiovisual data stream in a temporary storage area of a storage medium; when the capacity of the temporary storage area is insufficient, it is determined whether the capacity of one of the main storage areas of the storage medium is sufficient; and When the capacity of the main storage area is sufficient, divide a part of the main storage area into a part of the temporary storage area; set a plurality of editing labels on the audio-visual data stream; select at least two of the editing labels; and edit Corresponding to the audiovisual data stream between the two editing tags, an audiovisual editing segment is generated.

Images