WO2022143374A1 - Media playing method and electronic device - Google Patents

Abstract

The present application relates to the technical field of video processing, and relates to a media playing method and an electronic device. The method comprises: an electronic device detects a first user input for a first media file; in response to the first user input, the electronic device plays the first media file; and when the first media file is played to a first location, the electronic device plays a second media file, and the electronic device continues to play the first media file, the first location being preset. The present application enables an electronic device to play multiple videos at the same time, thereby facilitating satisfying the requirement of a user for watching multiple videos at the same time, and improving the user experience.

Description

A kind of media playback method and electronic device

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the priority of the Chinese patent application with the application number of 202011634630.6 and the application title of "a media playback method and electronic device" filed with the China Patent Office on December 31, 2020, the entire contents of which are incorporated into this application by reference middle.

technical field

The present application relates to the technical field of video processing, and in particular, to a media playback method and electronic device.

Background technique

At present, the common video file formats are MP4, AVI, etc., and the video files of these formats only support the playback of one video at a certain time, and cannot support the simultaneous playback of multiple videos. Therefore, it cannot meet the viewing needs of users in all directions and from multiple viewing angles. For example, in a live game scene, based on the existing format of video files, it is impossible to play the video of the real-time game and the video of the highlight replay at the same time. When playing a wonderful replay video, if the game is still in progress, it is easy to cause users to miss some real-time game pictures, and the user's viewing experience is poor.

SUMMARY OF THE INVENTION

In order to solve the above technical problems, the present application provides a media playback method and an electronic device, so that the electronic device can play multiple video channels at the same time, so as to satisfy the user's requirement for watching multiple channels of videos at the same time, and improve the user experience.

The first aspect is a playback method according to an embodiment of the present application, which is applied to an electronic device, and specifically includes: the electronic device detects a first user input for a first media file or a first control; The device plays the first media file; when the first media file is played to the first position, the electronic device plays the second media file and continues to play the first media file; wherein the first position is preset.

In the embodiment of the present application, since the second media file can be automatically played when the first media file is played to the first position, the electronic device can play multiple media files at the same time. Therefore, in the case where the media file is a video file, it is helpful to meet the user's requirement of being able to watch videos from multiple viewing angles at the same time, thereby improving the user experience.

In a possible design, the electronic device includes a display screen; the first media file and the second media file are played on the display screen; both the first media file and the second media file are video files. Thereby, it is convenient for users to watch.

In one possible design, the electronic device includes a speaker; the first media file and the second media file are played on the speaker; and both the first media file and the second media file are audio files.

In a possible design, the electronic device is connected to the headset; the first media file and the second media file are played on the headset; both the first media file and the second media file are audio files.

In a possible design, the electronic device includes a display screen and a speaker, and the first media file is played on the display screen; the first media is a video file; the second media file is played on the speaker; and the second media file is an audio file.

In a possible design, the electronic device includes a display screen, and the electronic device is connected to a headset, and the first media file is played on the display screen; the first media file is a video file; the second media file is played on the headset; The second media file is an audio file.

In a possible design, the electronic device includes a display screen, and the electronic device is connected to a headset, and the first media file is played on the headset; the first media file is an audio file; the second media file is played on the display screen; The second media file is a video file.

In a possible design, the electronic device includes a display screen and a speaker, and the first media file is played on the speaker; the first media file is an audio file; the second media file is played on the display screen; the second media file is a video file .

In a possible design, the electronic device may play the second media file and continue to play the first media file when the first media file is played to the first position in the following manner:

When the first media file is played to the first position, the display screen of the electronic device is divided into a first screen and a second screen, the second media file is played on the second screen, and the first media file is continued to be played on the first screen; Wherein, both the first media file and the second media file are video files. So as to facilitate implementation.

In a possible design, the electronic device may play the second media file and continue to play the first media file when the first media file is played to the first position based on the following methods:

When the first media file is played to the first position, a window is displayed on the display screen, and the window displays the second image corresponding to the second media file, and the window is suspended on the first image corresponding to the first media file; Wherein, both the first media file and the second media file are video files. Not only is the implementation convenient, but also the impact on viewing the first picture corresponding to the first media file is reduced.

In a possible design, the first position includes one of the following: a preset playback time point in the first media file, a preset playback frame in the first media file, and a preset playback ratio of the first media file.

In a possible design, the first position is preset by the user. Thereby, the flexibility of setting the first position is improved.

In a possible design, when the first media file is being played, extension information of the first media file is associated; the extension information of the first media file includes a first media file identifier; the first media file identifier is used to identify the first media file; The first media file extension information is associated with the second media file extension information; the second media file extension information includes the second media file identifier and the second media file playback position identifier; the second media file identifier is used to identify the second media file; The media file playback position identifier is used to identify the first playback position information of the first media when the second media starts to play; the first playback position information includes the first position.

For example, the first media file includes media extension information, and the media extension information includes first media file extension information and second media file extension information.

In a possible design, after the second media file is played, the electronic device continues to play the first media file; and the electronic device only plays the first media file.

In a possible design, when the first media file is played to the second position, the electronic device plays the third media file, and the electronic device continues to play the first media file; wherein the second position is preset; the second The position is after the second media file has finished playing.

In a possible design, the second position includes one of the following: a preset playback time point in the first media file, a preset playback frame in the first media file, and a preset playback ratio of the first media file.

In a possible design, the first media file extension information is also associated with third media file extension information; the third media file extension information includes a third media file identifier and a third media file playback position identifier; the The third media file identifier is used to identify the third media file; the third media file playback position identifier is used to identify the second playback position information of the first media when the third media starts to play; The second playback position information includes the second position. For example, the first media file further includes extension information of the third media file.

In a possible design, the extension information of the first media file is mmmw with the first multimedia multiplexing information, the extension information of the second media file is the second mmmw, and the extension information of the third media file is mmmw. The information is the third mmmw, the first mmmw, stsd, stts, stsc, stsz, stss, and stco corresponding to the first mmmw are located in the first media stream box stb1, the second mmmw, the The stsd, stts, stsc, stsz, stss, and stco corresponding to the second mmmw are located in the second media stream box stb1, and the third mmmw, stsd, stts, stsc, stsz, stss, and stco corresponding to the third mmmw are located in In the third media streaming box stb1, the first media streaming box stb1 is located in the first media box media, the second media streaming box stb1 is located in the second media box media, and the third media streaming box The box stb1 is located in the third media box media, the first media box media and the header tkhd corresponding to the first media box media are located in the first stream trak, the second media box media and the The header tkhd corresponding to the second media box media is located in the second stream trak, the third media box media and the header tkhd corresponding to the third media box media are located in the third stream trak, the first stream trak, the The second stream trak, the third stream trak, the header mvhd corresponding to the first stream trak, the second stream trak and the third stream trak are located in the video box moov, the video box moov, the media data mdata and media type ftyp are located in the MP4 file, the first stream trak is used to indicate the first media file, the second stream trak is used to indicate the second media file, and the third stream trak is used to indicate The third media file, the first media file, the second media file and the third media file are all video files. So as to facilitate implementation.

A second aspect is a method for acquiring a video file according to an embodiment of the present application, applied to an electronic device, where the electronic device includes a display screen; specifically, it includes:

The display screen displays a first interface of the first application; the first interface includes a master video file setting control, a master video file preview frame, a first slave video file setting control, a first slave video file preview frame, a first association set controls and finish controls;

in response to a first user input to the main video file setting control, the display screen displays a second interface of the first application; the second interface includes a first video file and a second video file;

In response to a second user input to the first video file, the main video file preview box displays a preview static image or a preview dynamic image of the first video file;

The electronic device displays the second interface in response to a third user input to the first slave video file settings control;

In response to a fourth user input to the second media file, the first slave video file preview frame displays a preview static picture or a preview dynamic picture of the second video file;

In response to a fifth user input to the first association setting control, the display screen displays an association setting frame; the association setting frame is used to set the first association setting frame when the main video file is played to the first position, the first association setting frame A slave video file starts playing, and the playback of the first slave video file will not pause or stop the playback of the master video file; the association setting box includes a first position input box, a first confirmation control and a second confirmation control;

After receiving the sixth user input to the first position input box, and after receiving the seventh user input to the first confirmation control, the first position is set;

After receiving the eighth user input to the completion control, the third video file is acquired.

Through the above technical solutions, users can integrate multiple video files into one video file according to their own needs, so that the electronic device can play multiple videos simultaneously based on one video file.

In a possible design, in response to the operation on the third video file, the electronic device may play the first video file; when the first video file is played to the first position, the electronic device plays the second video file, and Continue to play the first video file.

A third aspect is an electronic device according to an embodiment of the application, and the electronic device includes modules/units for executing the above-mentioned first aspect or any possible design method of the first aspect; these modules/units can be implemented by hardware It can also be implemented by hardware executing corresponding software.

A fourth aspect is an electronic device according to an embodiment of the present application, the electronic device includes modules/units for performing the above-mentioned second aspect or any possible design method of the second aspect; these modules/units can be implemented by hardware It can also be implemented by hardware executing corresponding software.

A fifth aspect is a media playback device according to an embodiment of the application, the media playback device includes a memory, a processor, and a computer program, the computer program is stored in the memory, and when the computer program is executed by the At the time, the media playback apparatus is caused to execute the first aspect of the embodiments of the present application and any possible design technical solutions of the first aspect.

In a possible design, the media playback device is an electronic device, or the media playback device is a chip.

A sixth aspect is a media playback device according to an embodiment of the application, the media playback device includes a memory, a processor, and a computer program, the computer program is stored in the memory, and when the computer program is executed by the At the time, the media playback device is caused to execute the second aspect of the embodiments of the present application and any possible technical solutions of the second aspect.

In a possible design, the media playback device is an electronic device, or the media playback device is a chip.

A seventh aspect is a computer-readable storage medium according to an embodiment of the present application. The computer-readable storage medium includes a computer program. When the computer program runs on an electronic device, the electronic device is made to perform the above-mentioned first aspect. and any possible design technical solutions of the first aspect thereof.

An eighth aspect is a computer-readable storage medium according to an embodiment of the application, the computer-readable storage medium includes a computer program, and when the computer program runs on an electronic device, the electronic device is made to perform the above-mentioned second aspect and any possible design technical solutions of the second aspect thereof.

A ninth aspect is a computer program product according to an embodiment of the present application, which, when running on a computer, enables the computer to execute the technical solutions of the first aspect and any possible designs of the first aspect.

A tenth aspect is a computer program product according to an embodiment of the present application, which, when running on a computer, causes the computer to execute the technical solutions of the second aspect and any possible designs of the second aspect.

For the beneficial effects of the third aspect to the tenth aspect, please refer to the beneficial effects of the method section, and will not be repeated.

Description of drawings

1 is a schematic structural diagram of a video file according to an embodiment of the application;

2 is a schematic structural diagram of a kind of video extension information according to an embodiment of the application;

3 is a schematic diagram of a network architecture of an on-demand scenario according to an embodiment of the present application;

4A is a schematic structural diagram of a video processing device according to an embodiment of the application;

4B is a schematic structural diagram of a video playback device according to an embodiment of the application;

5 is a schematic diagram of an interface for video file integration according to an embodiment of the present application;

6 is another interface schematic diagram for video file integration according to an embodiment of the present application;

7 is another interface schematic diagram for video file integration according to an embodiment of the present application;

8 is a schematic diagram of a video file storage location interface according to an embodiment of the application;

9A is a schematic diagram of another interface for video file integration according to an embodiment of the present application;

9B is a schematic diagram of another interface for video file integration according to an embodiment of the present application;

10 is a schematic interface diagram of a video playback according to an embodiment of the application;

11 is a schematic interface diagram of another video playback according to an embodiment of the application;

12 is a schematic interface diagram of another video playback according to an embodiment of the application;

13 is a schematic diagram of another interface according to an embodiment of the application;

14 is a schematic diagram of a network architecture of a live broadcast scenario according to an embodiment of the application;

15A is a schematic diagram of a playback layout according to an embodiment of the application;

15B is a schematic diagram of another playback layout according to an embodiment of the present application;

16 is a schematic interface diagram of another video playback according to an embodiment of the application;

FIG. 17 is a schematic structural diagram of a video playback apparatus according to an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments of the present application. Wherein, in the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations of the present application. As used in the specification of this application and the appended claims, the singular expressions "a," "an," "the," "above," "the," and "the" are intended to also Expressions such as "one or more" are included unless the context clearly dictates otherwise. It should also be understood that, in the following embodiments of the present application, "at least one" and "one or more" refer to one or more than two (including two). The term "and/or", used to describe the association relationship of related objects, indicates that there can be three kinds of relationships; for example, A and/or B, can indicate: A alone exists, A and B exist at the same time, and B exists alone, A and B can be singular or plural. The character "/" generally indicates that the associated objects are an "or" relationship.

References in this specification to "one embodiment" or "some embodiments" and the like mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in other embodiments," etc. in various places in this specification are not necessarily All refer to the same embodiment, but mean "one or more but not all embodiments" unless specifically emphasized otherwise. The terms "including", "including", "having" and their variants mean "including but not limited to" unless specifically emphasized otherwise. The term "connected" includes both direct and indirect connections unless otherwise specified. "First" and "second" are only for descriptive purposes, and cannot be understood as indicating or implying relative importance or implying the number of indicated technical features.

In the embodiments of the present application, words such as "exemplarily" or "for example" are used to represent examples, illustrations or illustrations. Any embodiment or design described in the embodiments of the present application as "exemplarily" or "such as" should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplarily" or "such as" is intended to present the related concepts in a specific manner.

It should be pointed out that words such as "first" and "second" involved in the embodiments of the present application are only used for the purpose of distinguishing and describing, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying order.

In order to solve the above technical problems, the present application provides a media playback method, which enables an electronic device to simultaneously play multiple media, such as a first media and a second media, according to one media file. In the case where the media is video, the requirement of enabling users to watch multiple video channels at the same time helps to improve user experience.

It should be understood that, in this embodiment of the present application, the media may be video, audio, images, animations, etc., and the media files may be files such as video files, audio files, image files, and the like. The following describes the media playback method of the embodiment of the present application by taking the media file as a video file as an example. When the media file is an audio file or an image file, reference may be made to the related introduction of the video file.

In some embodiments, by adding video extension information to the video file, the video file can support the simultaneous playback of multiple videos, so as to satisfy the user's requirement for watching multiple videos at the same time. Wherein, the video extension information is used to indicate the association relationship of at least two channels of video. For example, the video extension information of the video file is used to indicate the association between the video of the real-time game and the video of the highlight replay. The video playback device can simultaneously play the video of the real-time game and the video of the highlight replay based on the video file.

Take the example that the video extension information is used to indicate the association relationship between the first channel of video and the second channel of video. Exemplarily, the video extension information includes extension information of the first video channel and extension information of the second video channel. The extended information of the first channel video includes a main video identifier; the main video identifier is used to identify the first channel video as the main video. The extended information of the second channel video includes the slave video identifier and the associated identifier played from the slave video. The slave video identifier is used to indicate that the second video is a slave video; the associated identifier of the slave video playback can also be called a slave video playback position identifier, which is used to indicate that the slave video starts to play when the master video is played to the first playback position. Regarding the first playback position, the frame, time, scale, etc. may be used to mark. For example, if the first playback position is the frame, it can be set to start playing the secondary video when the main video reaches the 10th frame; the first playback position is the time, and it can be set to start playing when the main video reaches 1 minute and 20 seconds. Slave video; the first playback position is the ratio, which can be set to start playing the slave video when the main video is played to 1/3.

It should be noted that the above description is only given by taking the video extension information for indicating the association relationship between the first channel of video and the second channel of video for introduction, and is not enough to limit the paired video extension information. In this embodiment of the present application, the video extension information may be used to indicate the association relationship of multiple video channels. For example, there can be multiple channels from the video. Multiple slave videos may be referred to as first slave video, second slave video...etc. In the case of multiple slave videos, only part of the slave videos may have a direct relationship with the master video, and the remaining slave videos may have a direct relationship with the above-mentioned part of the slave videos. For example, take the example that the video extension information is used to indicate the association relationship between the first channel of video, the second channel of video, and the third channel of video. The video extension information includes extension information of the first video channel, extension information of the second video channel and extension information of the third video channel. The extended information of the first video includes the main video identifier, the extended information of the second video includes the associated identifier of the slave video identifier and the second slave video, and the extended information of the third video includes the slave video identifier and the third slave video. the associated identifier. The associated identifier of the second secondary video playback is used to identify that when the primary video is played to the first playback position, the secondary secondary video starts to be played. The associated identifier of the third slave video playback is used to identify that when the second slave video is played to the second playback position, the third slave video starts to play. It can be understood that, the associated identifier of the third slave video playback can also be used to identify that when the main video is played to the third playback position, the third slave video starts playing. It should be noted that the first playback position and the third playback position may be the same or different, which is not limited.

Of course, in the case of multiple channels of slave videos, the video extension information can also be used to indicate the association relationship between the multiple channels of slave videos and the master video respectively. For example, the video extension information is used to indicate the relationship between the first channel of video and the second channel of video, and the relationship between the first channel of video and the third channel of video.

Taking the video extension information including the extension information of the first video and the extension information of the second video as an example, the second video extension information includes the associated identification from the video identification and the playback from the video, and the associated identification played from the video is used for When the identifier starts playing from the video when the main video is played to the first playback position, for example, the associated identifier for playing the slave video may be the frame number (eg, sample index) of the main video. That is, the main video frame serial number included in the extended information of the second video, when the main video frame serial number is used to identify the Nth frame of the main video, where N is a positive integer greater than or equal to 1, then the main video is played to the Nth frame. , start playing the slave video. That is, the Nth frame of the first channel of video is played simultaneously with the first frame of the second channel of video, the N+1th frame of the first channel of video is played simultaneously with the second frame of the second channel of video, and the Nth of the first channel of video is played at the same time. +2 frames are played at the same time as the 3rd frame of the second channel video, and so on, until the second channel video playback ends, the second channel video will not be played, if the first channel video is still not over, the first channel will continue to be played video.

In the embodiment of the present application, the associated identifier for playing the slave video may also use other information to identify the playback position of the master video when the slave video starts to be played. For example, the starting playback time of a certain frame in the master video, the starting playback time of a certain frame in the slave video, the frame identification of the slave video, etc., are not limited thereto.

First, some terms involved in the embodiments of the present application are explained to facilitate understanding by those skilled in the art.

1. Video files. In the embodiment of the present application, the video files are divided into two types based on whether the simultaneous playback of at least two channels of video is supported, which are the first type of video files and the second type of video files respectively. The first type of video file can only support playing one video. The second type of video file supports playing at least two channels of video at the same time. For example, the first type of video file does not include video extension information, and reference may be made to the regulations on video files in the existing protocol, which will not be repeated here.

Exemplarily, the second type of video file includes video extension information. For example, the second type of video file in this embodiment of the present application may include video metadata, video data, and audio data. The video metadata is description information of the video data and the audio data, and is used for indexing to the corresponding video data and audio data. For example, the video metadata includes video extension information. The video extension information is used to describe the association relationship of multiple video channels. In other embodiments of the present application, the video metadata may further include the video type (main video, or secondary video) and the like. Video data is used to describe the images in the video and can be a sequence of images. For a certain second type of video file, it may include video data of one or more channels of video. Audio data is used to describe the sound in the video and can be understood as digitized sound data. In addition, for a certain video file of the second type, audio data of one or more channels of video may also be included. For example, a second-type video file includes video metadata, video data of N-channel video, and audio data of M-channel video. N and M are positive integers, and the values of N and M may be the same or different. For example, the values of N and M are the same, and the audio data of the M-channel video corresponds to the video data of the N-channel video respectively. For another example, the values of N and M are different, N is greater than 1, and M is equal to 1. In this case, the audio data in the video file can correspond to the video data of a certain channel of the N videos, such as the video data of the main video. , or some video data from a video. In addition, it should also be noted that, for a channel of video, taking the main video as an example, the audio data of the main video may include audio data of one or more audio tracks. For example, the audio data of the main video includes audio data of two audio tracks, wherein the audio data of one audio track is used to describe the sound in a certain language (such as Chinese) in the video, and the audio data of the other audio track is used to describe the sound in a certain language (such as Chinese) in the video. To describe the voice in another language (such as English) in the video. In this case, the user can choose to play the sound in Chinese or English as needed when playing the main video.

Take the video format of the second type of video file as MP4 as an example. In this case, the second type of video file can also be referred to as an MP4 file. In some embodiments, as shown in Figure 1, an MP4 file includes ftyp (file type box), mdata (media data box), and moov (movie box). ftyp includes video file format information, where the video file format information included in ftyp is used to identify the video file format as MP4. mdata is used to store media data. It should be understood that the video data and audio data in the embodiments of the present application may be referred to as media data. In some embodiments, video data and audio data may be divided based on chunk-samples, respectively, to facilitate searching. In this case, mdata stores media data in chunks. A chunk may include one or more samples, and a sample is the smallest storage unit of media data (video data or audio data). moov contains video metadata. Illustratively, moov is a container box that contains video metadata that can be interpreted by corresponding sub-boxes. For example, moov includes mvhd (movie header box) and at least one trak (track box). Among them, mvhd is used to store information such as creation time, modification time, duration, and recommended playback rate of the MP4 file. trak is used to store related description information of video data or audio data. Taking a trak as an example, in some embodiments, the trak is a container box, which may include tkhd (track header box) and mdia (media box), etc. tkhd contains the overall information of the media data (audio data or video data) of a video, such as track id, video duration, etc. track id is used to identify a video. For example, mdia is a container box, which can include mdhd (media header box), hdlr (handler reference box) and minf (media information box). mdha is used to define time scale, etc. hdlr contains information related to the video playback process, such as data type (audio, video, etc.). For example, minf is a container box, which can include stb1 (sample table box). stb1 includes stsd(sample description box), stts(time to sample box), stsc(sample to chunk box), stsz(sample size box), stss(sync sample box), stco(chunk offset box), etc. stsd contains the encoding type, width, height, length, audio channel, sampling and other information of the video. stts contains the timing mapping information of the sample, such as sample index, time offset corresponding to the sample index, etc. stsc contains the mapping relationship between sample and chunk. The size of each sample used by stsz to store media data. stss may contain a randomly accessible list of sample indices, each sample index in the list of sample indices being used to indicate a keyframe. In this embodiment of the present application, a key frame can be understood as a video frame that carries a full amount of data, and can be independently decoded into a video frame without referring to a previous video frame. Non-key frames can be understood as video frames of incremental data, and it is necessary to refer to other frames to decode a frame of video. Only keyframes have random access. stco is used to define the position of each chunk in the media data, for example, stco contains the offset of each chunk in the media data. Specifically, for ftyp, mdata, and moov, please refer to the relevant introduction in the existing protocol, which will not be described in detail here.

In the case where the MP4 file is the second type of video file, further, in some embodiments, the field mmmw (multimedia multiway) is added to the stb1 in the trak used to describe the video data, thereby Add the corresponding video extension information to the MP4 file. For example, mmmw includes extended information of one video. For example, in the case of different video types, the extension information included in mmmw in the corresponding stb1 may be different. For example, when the video type of the video identified by the track id in the trak is the main video, the mmmw in the corresponding stb1 may include the main video identifier. In some embodiments, when the video type of the video identified by the track id in the trak is the main video, the mmmw in the corresponding stb1 may also include the track id of the audio data corresponding to the main video. For another example, when the video type of the video identified by the track id in the trak is from the video, the mmmw in the corresponding stb1 can include the associated identification from the video identification and the playback from the video, and the associated identification from the video playback is used to identify the start of playing from the video. the playback position of the main video. For example, the associated identifier for playback from video could be sample index. In some embodiments, when the video type of the video identified by the track id in the trak is the slave video, the mmmw in the corresponding stb1 may include the track id of the audio data corresponding to the slave video.

For example, mmmw is a sub-box of stb1, which can also be understood as a box. Its structure can be shown in Figure 2, including the following fields: box size, box type, version, flags, role, audio track id, sample index. For example, box size can take up 4 bytes to indicate the size of the box; box type can take up 4 bytes to indicate the type of the box; version can take up 1 byte to indicate the version of the box; flags It can occupy 3 bytes, which is used to extend the flag bits of some functions; the role can occupy 4 bytes, which is used to identify the video type (main video or slave video); the audio track id can occupy 4 bytes, which is used to identify the audio data; The sample index can occupy 4 bytes and is used to identify the playback position of the main video when the video starts to play. Among them, the structure of mmmw can be the same for the master video and the slave video. In this case, for the master video, the following fields such as sample index and audio track id can be special identifiers or empty. The special identifiers are used for Indicates that the field is invalid. For slave videos, the audio track id can be a special identifier or empty. Alternatively, the structure of mmmw can be different for master and slave video. In this case, for the master video, the sample index and audio track id in mmmw can be optional fields, and for the slave video, the audio trcak id can be optional fields. For example, for the main video, the following fields may not be included in mmmw: sample index or audio track id. Or, for another example, for the slave video, the audio track id may not be included in the mmmw. It should be noted that FIG. 2 is only an example of a structure of mmmw, and does not constitute a limitation to the embodiments of the present application. For example, role can also occupy two bytes and so on.

It should also be noted that the above description is based on the example that the extended information field used for carrying video is mmmw, and the embodiment of this application does not limit the name of the extended information field used to carry video. The field of the extended information may also be referred to as a video extension field or the like.

2. Video playback equipment. The video playback device in the embodiment of the present application is an electronic device, such as a portable terminal. Portable terminals such as mobile phones, tablet computers, notebook computers, etc. In this case, the video playback device can respond to a video application installed on the portable terminal (such as

) to play the corresponding video. In other embodiments, the video playback device may also be a non-portable terminal, such as a smart screen, a desktop computer, or a television. For example, in the case where the video playing device is a TV, the corresponding video can be played in response to the user's operation of selecting a certain channel. Further, in some embodiments, the video playback device may also support the integration of video files. Taking the video playback device as a mobile phone as an example, the mobile phone integrates at least two first-type video files into a The second type of video file is saved locally and/or uploaded to the video server, so that the mobile phone can play at least two channels of video simultaneously based on the second type of video file. The above-mentioned at least two video files of the first type are pre-recorded video files, which can be stored on a video playback device, or can be stored on a network disk or a server (such as a video server). The storage location of video files is not limited. Further, in some instances, after integrating at least two first-type video files into one second-type video file, the mobile phone saves the second-type video file. For example, the mobile phone saves the second video file locally and/or uploads it to a server or a network disk.

3. Video processing equipment. The video processing device in the embodiment of the present application is an electronic device, such as a portable terminal. For example, the portable terminal may be a mobile phone, a tablet computer, a notebook computer, or the like. Alternatively, the video processing device in this embodiment of the present application may also be a non-portable terminal, such as a smart screen, a desktop computer, or a television, etc., which is not limited thereto. It should be noted that when the video processing device is a portable terminal or a non-portable terminal, the video processing device and the video playback device may be the same device or different devices, which are not limited. Alternatively, the video processing device may also be a video server or the like, and the video server in this embodiment of the present application may be a cloud server or a local server, which is not limited. Exemplarily, the video processing device has a video integration function, which supports integrating at least two first-type video files into one second-type video file.

The video playback method in the embodiment of the present application can be applied to a VOD scenario or a live broadcast scenario. The following describes the video playback method according to the embodiment of the present application with reference to specific application scenarios.

FIG. 3 shows a network architecture of an on-demand scenario, including a video server and a video playback device. The video server is configured to receive a video acquisition request from a video playback device, and send a corresponding video file to the video playback device. The video playback device is used to receive an operation of a user to play a certain video, and in response to the above operation, send a video acquisition request to a video server, receive a video file from the video server, and play correspondingly according to the video file. For example, the video playback device sends a video acquisition request to the video server in response to the user's operation on a certain video option in a video application (such as Huawei Video) installed by itself, and receives a video from the video server in response to the video acquisition request. file, and based on the video file, play the video.

In the case that the video file received from the video server is the second type of video file received by the video playback device, the video playback device can play the multi-channel video according to the video file. In some embodiments, the video playback device can adapt to the corresponding video playback layout according to the video extension information, and perform multi-channel video playback. Exemplarily, in the case where the video extension information is used to indicate the association relationship between the two videos, the video playback device plays the secondary video in the small window and the main video in the large window according to the video extension information. Take the example that the video extension information is used for the association between the first channel of video and the second channel of video. For example, the video extension information includes the extension information of the first video channel and the extension information of the second video channel, the extension information of the first channel video includes the main video ID, and the extension information of the second video channel includes the slave video ID and the slave video playback information. The associated identifier, where the main video frame identifier is used to identify the Nth frame in the main video, the video playback device displays a large window according to the video extension information, and plays the first video in the large window. At the Nth frame, continue to play the first video in the large window, display the small window, and play the second video in the small window. After the second video is played, the small window can be hidden. If the first video If the playback is not over, the large window will continue to be displayed, and the first video will be played in the large window. Before the first channel video is played to the Nth frame, the small window may not be displayed. The layout of the large window and the small window can be preset by the user or the system default. For example, the small window can be suspended on the large window and laid out in the form of picture-in-picture. The position of the widget needs to be moved, or the position of the widget can also be fixed. For another example, the small window and the large window may also be tiled, that is, the first channel video and the second channel video are displayed in a split screen. It should be noted that when the small window is suspended on the large window, the size of the large window before the Nth frame of the first channel video is played and the size of the large window when the Nth frame of the first channel video is played can be Does not change. When the large window and the small window are in a tiled layout, in order to adapt to the size of the display screen of the video playback device, the size of the large window before the Nth frame of the first channel of video is played is the same as the Nth frame of the first channel of video played. The size of the large window at frame time may be different, and the size of the large window may be larger than the size of the large window when the Nth frame of the first channel video is played. When the playback of the second channel of video ends, the size of the large window can be restored to the size of the large window before the Nth frame of the first channel of video is played.

For another example, in the case where the video extension information is used to indicate the relationship between the first video and the second video, the first video and the third video, if these three videos are played simultaneously, the video playback device will Video extension information, the first video is played in the first window, the second video is played in the second window, and the third video is played in the third window. The size of the first window is larger than the size of the second window. The size of a window is larger than the size of the third window, the size of the second window and the size of the third window can be the same or different, which is not limited, wherein the second window and the third window can be suspended on the first window, Or the first window, the second window and the third window are tiled layout and so on.

Further, in some embodiments, the network architecture shown in FIG. 3 may further include a video processing device, wherein the video file may be generated by the video processing device and uploaded to the video server. Exemplarily, the video processing device integrates at least two video files of the first type into a video of the second type in response to the user's operation based on a self-installed application with a video integration function (such as a camera application, a gallery application, or a video application, etc.). document. For example, the video processing device and the video playback device may be the same device or different devices, which are not limited. In the case where the video processing device and the video playback device are the same device, in other embodiments, after the video processing device integrates at least two first-type video files into one second-type video file, the The second type of video file is stored locally, that is, in its own internal storage, or in an external storage connected to itself. If the video processing device and the video playback device are the same device, the video playback device can also play the video based on the second type of video file in response to the user's opening operation on the local second type of video file. Alternatively, after the video processing device integrates at least two first-type video files into one second-type video file, the second-type video file can also be uploaded to a network disk or a video server for easy storage.

Of course, in other embodiments of the present application, in the case where the video processing device is not a video server, the video file may also be generated by a video server. For example, the video processing device sends a video file integration request to the video server in response to the user's operation based on the application with the video integration function installed by itself, wherein the video file integration request includes at least two first type video files and the at least two video files. The association relationship between the videos corresponding to the first type of video files respectively. The video server receives the video file integration request from the video processing device, and according to the association relationship between the at least two first-type video files in the video file integration request and the videos corresponding to the at least two first-type video files, at least The two first video files are integrated into one second type video file.

FIG. 4A shows a structure of a video processing device according to an embodiment of the present application, including an acquisition module 401A, an encoding module 402A, an association module 403A, and an encapsulation module 404A. Further, in some embodiments, the video processing device may further include a clipping module 405A.

Wherein, the obtaining module 401A is used to obtain L first-type video files. L is a positive integer greater than or equal to 2. The L video files of the first type are pre-recorded video files, which can be stored on a video processing device, or on a network disk or server, which is not limited. Exemplarily, the obtaining module 401A is configured to receive a first operation of a user selecting a video file based on an application with a video integration function, and in response to the first operation, obtain a first type of video file corresponding to the main video. The obtaining module 401A is further configured to receive a second operation of the user selecting a video file based on an application with a video integration function, and in response to the second operation, obtain a first type of video file corresponding to the slave video. The value of L is related to the number of the first-type video files corresponding to the secondary video selected by the user. In another example, the acquisition module 401A is configured to receive a video file integration request, and obtain L first-type video files from the video file integration request, wherein the L first-type video files include a first-type video file corresponding to a main video. and L-1 slave videos corresponding to the first category of video files.

The encoding module 402A is configured to encode and compress the videos corresponding to the above-mentioned L video files of the first type respectively, so as to obtain L standard video streams.

The association module 403A is used to generate video extension information, where the video extension information is used to indicate the association relationship between the videos corresponding to the W first-type video files respectively. The W first-type video files are video files in the above-mentioned L first-type video files, 2≤W≤L, and W is a positive integer. Exemplarily, the association module 403A may generate the video extension information in response to the user completing the operation of establishing the association relationship between the videos corresponding to the above-mentioned W first-type video files respectively. As another example, the association module 403A may also generate video extension information according to the association relationship of the videos corresponding to the L first-type video files in the video file integration request.

The encapsulation module 404A is configured to obtain a second-type video file according to the W standard video streams and video extension information.

The editing module 405A is used to filter out the W first-type video files from the L first-type video files. Exemplarily, the editing module 405A is configured to filter out W first-type video files from L first-type video files in response to an operation in which the user selects W first-type video files to establish a video association relationship from L first-type video files. video file.

FIG. 4B shows a structure of a video playback device according to an embodiment of the present application, including an acquisition module 401B, a decapsulation module 402B, a decoding module 403B, an association module 404B, and a playback module 405B.

The acquiring module 401B is used to acquire the second type of video files. In some embodiments, the obtaining module 401B is configured to obtain the second type of video file in response to receiving an operation that the user selects to play a certain video.

The decapsulation module 402B is used to decapsulate the second type of video files to obtain video metadata, media data of multi-channel videos (such as video data of P-channel video and audio data of Q-channel video, P and Q are positive integers, and P≥2, 1≤Q≤P, the Q channel video is one or more channels of the P channel video). Wherein, for the audio data of one channel of video, the audio data of one or more audio tracks may be included. For example, in the case that a channel of video corresponds to a Chinese audio track and an English audio track, the audio data of the video channel may include audio data of the Chinese audio track and audio data of the English audio track.

The decoding module 403B is used for decoding the media data of the multi-channel video. Taking the media data of the multi-channel video as the video data of the P-channel video and the audio data of the Q-channel video as an example, the decoding module 403B is configured to decode the video data of the P-channel video and the audio data of the Q-channel video. For example, take the audio data of a certain channel of video including the audio data of the Chinese audio track and the audio data of the English audio track as an example, in this case, the decoding module 403B can set the audio data of the corresponding audio track to decode. For example, if the sound playback of the video is set to Chinese, the decoding module 403B decodes the audio data of the Chinese audio track, so that when the video is played, the sound is played in Chinese. For example, the sound setting of the video may be set by the user according to the user's own needs, or may be the default, which is not limited.

The association module 404B is configured to obtain the frame association information of the multi-channel video according to the video extension information in the video metadata.

The playing module 405B is configured to play the corresponding video according to the frame association information of the multi-channel video. Exemplarily, the playback module 405B is used to determine the number of video playback windows according to the frame associated information of the multi-channel video, and to adapt the layout of the corresponding video playback windows according to the number of video playback windows, and then, in the corresponding video playback The video is played in the window. It should be noted that the layout of the video playback windows corresponding to the number of video playback windows may be set by the user according to their own needs, or may be defaulted by the system, which is not limited.

Taking the video processing device as a mobile phone and an application with a video integration function as the first application as an example, the embodiment of the present application integrates at least two first-type video files into one second-type video file. It should be understood that the first application having the video integration function in the embodiment of the present application may be implemented by adding a video integration function to native applications such as a gallery application function, a video application, and a camera application. Alternatively, the first application having the video integration function in the embodiment of the present application may also be a third-party application, which is not limited. It should be noted that, in the embodiments of the present application, a third-party application may be understood as an application downloaded by a user from an application market APP or a network to a mobile phone according to his/her own needs.

As shown in FIG. 5 , the mobile phone displays an interface 500 , and the interface 500 includes an icon 501 . Icon 501 is used to identify the first application. In response to the user clicking on the icon 501, the mobile phone displays the interface of the first application. For example, the interface of the first application may be interface 510 , including video preview box 01 , video preview box 02 , and video preview box 03 , option 502 , option 503 , and option 504 . The video preview frame 01 is used to preview the main video, the video preview frame 02 is used to preview the slave video 1, the video preview frame 02 is used to preview the slave video, and the option 502 is an option corresponding to the video preview frame 01, which is used to select the corresponding video of the main video. The first type of video file, option 503 is an option corresponding to the video preview frame 02, used to select the first type of video file corresponding to the video 1, and option 504 is an option corresponding to the video preview frame 03, used to select from the video 2. The corresponding first category video file. In some embodiments, the user can increase or delete the number of video preview frames of the slave video on the interface of the first application according to his own needs. It should be noted that the number of video preview boxes on the interface of the first application does not exceed the maximum number of video files supported by the first application for video integration, and the number of video preview boxes on the interface of the first application At least 1. The maximum number of the first type of video files used for video integration may be predefined by the user according to their own needs, or may be preset by the R&D personnel during program development, which is not limited. For example, the first application supports a maximum of four first-type video files to be integrated into one second-type video file. In this case, the interface of the first application includes at most four video preview boxes, one of which is a video preview box. Used to preview the master video, and the other 3 video preview boxes are used to preview the slave video respectively.

Illustratively, as shown in FIG. 6, in response to a user clicking on option 502, interface 600 is displayed. Interface 600 includes options for at least two first category video files, such as option 601 , option 602 , option 603 , and option 604 . The option 601, the option 602, the option 603 and the option 604 are respectively used to identify a first type of video file. It should be noted that the first type of video files respectively identified by option 601, option 602, option 603 and option 604 may be stored on the mobile phone, or may be stored on a network disk or server, which is not limited. Further, in response to the user's operation of clicking option 601, the mobile phone returns to interface 510, and displays the video corresponding to the first type of video file identified by option 601 in the video preview area 01.

In another example, as shown in FIG. 7 , in response to the operation of clicking 503 by the user, the mobile phone displays the interface 600 . In response to the user's operation of clicking option 602, the mobile phone returns to interface 510, and displays the video corresponding to the first type of video file identified by option 602 in the video preview frame 02. In some embodiments, interface 510 includes option 701 for setting the playback position of the main video when video 1 starts playing. For example, in response to the user's operation of clicking option 701, the mobile phone displays a prompt box 710, where the prompt box 710 is used to prompt the user to set the playback position of the main video when the video 1 starts playing. For example, prompt box 710 includes option 711 , option 712 , option 713 , and option 714 . Option 711 is used to set the specific playback position information of the main video, option 712 is used to set the unit for identifying the playback position of the main video, such as frame, second, hour, minute, etc. Option 713 is used to cancel the setting, and option 714 is used to confirm the setting. For example, in response to the operation of options 711 and 712, the mobile phone sets the playback position of the main video from video 1 to the Nth frame, and in response to the operation of the user clicking option 714, the mobile phone returns to the interface 510. Of course, it can be understood that the unit for identifying the playback position of the main video may also be other units such as milliseconds, which is not limited. For example, taking the Nth frame of the main video when the main video starts to play from video 1 set by the user through options 711 and 712, the mobile phone generates the sub-video 1 and the main video according to the settings of options 711 and 712. connection relation. It should be understood that the association between the secondary video 2 and the main video set by the user is similar to the association between the secondary video 1 and the primary video. For example, the first type of video file corresponding to the secondary video Associate the setting option to set the playback position of the main video when starting from video 2. It should be noted that, in this embodiment of the present application, the associated setting options corresponding to the slave video, such as 701, may be displayed after the user selects the video file corresponding to the slave video, or may be displayed when the user does not select the video file corresponding to the slave video. It is displayed on the interface 510, which is not limited.

Further, in some embodiments of the present application, in response to the user's operation of clicking option 502, the mobile phone displays a video file storage location interface, and the video file storage location interface includes at least one video file storage location option. For example, the video file storage location interface can be the interface 800 shown in FIG. 8, including option 801, option 802 and option 803, option 801 is used to indicate that the video file storage location is a gallery application, and option 802 is used to indicate that the video file storage location is cloud disk. In response to the user clicking on option 801 or option 802, the phone displays interface 600. Thus, it is convenient for the user to select the video file.

In addition, in another example, after the user completes the settings on the interface of the first application, as shown in FIG. 9A , in response to the user's operation of clicking option 900, the mobile phone converts the first type of video file corresponding to the main video and the video file corresponding to the secondary video 1 The first type of video file and the first type of video file corresponding to the slave video 2 are integrated into a second type of video file, and the second type of video file includes video extension information, which is used to indicate the main video and the slave video 1. The relationship, and the relationship between the master video and the slave video 2. In another example, after the user completes the settings on the interface of the first application, as shown in FIG. 9B , in response to the user's operation of clicking option 900, the mobile phone stores the first type of video file corresponding to the main video and the first type of video file corresponding to the secondary video 1. The class video files are integrated into a second class video file, and the second class video file includes video extension information, and the video extension information is used to indicate the association relationship between the master video and the slave video 1 . Another example, when the user completes the settings on the interface of the first application, as shown in FIG. 9A , although the user selects the first type of video file corresponding to the sub-video 2, the playback of the main video when the sub-video 2 starts to play is not set. position, so in response to the operation of the user clicking option 900, the mobile phone integrates the first type video file corresponding to the main video and the first type video file corresponding to the slave video 1 into a second type video file, and the second type video file includes Video extension information, where the video extension information is used to indicate the association between the master video and the slave video 1.

Taking the association relationship between the master video and the slave video 1 as an example, the association relationship between the master video and the slave video 1 can be used to indicate the playback position of the master video when the slave video 1 starts to play. Exemplarily, when the video extension information is used to indicate the association relationship between the main video and the slave video 1, the video extension information may include the extension information of the main video and the extension information of the slave video 1, and the extension information of the main video includes the main video identifier, The extended information of the secondary video 1 includes a secondary video ID and a primary video frame ID, and the primary video frame ID is used to indicate the playback position of the primary video when the secondary video 1 starts playing.

It should be noted that the option 900 shown in FIG. 9A or FIG. 9B may be displayed on the interface after the user selects a first-type video file corresponding to a master video and a first-type video file corresponding to a slave video on the interface 510 . 510, or may be displayed on the interface 510 when the displayed interface 510 is displayed in response to the user clicking the icon 501, which is not limited.

In addition, in some embodiments, after obtaining the second type of video file, the mobile phone uploads the second type of video file to a network disk or server, or saves it locally.

The above description takes the integration of at least two first-type video files into one second-type video file on a mobile phone as an example. It should be noted that in this embodiment of the present application, at least two first-type video files can also be integrated. The step for a second type of video file is performed by a server (eg, a video server). For example, after the user has completed setting on the interface of the first application, as shown in FIG. 9A , in response to the user's operation of clicking option 900, the mobile phone sends a video file integration request to the server, wherein the video file integration request includes the corresponding video files corresponding to the main video. The first type of video file, the first type of video file corresponding to the sub-video 1, the first type of video file corresponding to the sub-video 2, the playback position information of the main video when the video 1 starts playing, the main video when the video 2 starts to play. Playing position information, the server receives the video file integration request from the mobile phone, and according to the playing position information of the main video when the video 1 starts to play, and the playing position information of the main video when the video 2 starts to play, the first category corresponding to the main video is The video file, the first type video file corresponding to the slave video 1, and the first type video file corresponding to the slave video 2 are integrated into a second type video file.

It should be understood that the above is only an example of the user selecting the main video, the first type of video file corresponding to the sub-video, and setting the playback position of the main video when the sub-video starts to play, and does not constitute a limitation to the embodiments of the present application. The application embodiments do not limit the manner in which the user selects the master video, the first type of video file corresponding to the slave video, and sets the playback position of the master video when the slave video starts to play.

Taking the video playback device as a mobile phone as an example, the following describes the manner in which the mobile phone plays the second type of video file in combination with a specific scenario.

As shown in FIG. 10 , the mobile phone displays an interface 1000 , and the interface 1000 includes an icon 1001 . Icon 1001 is used to identify the gallery application. In response to the user clicking on the icon 1001, the phone displays the interface of the gallery application. For example, the interface of the gallery application may be interface 1010, including option 1011, where option 1011 is used to identify a video file. In response to the user's operation of clicking option 1011, the mobile phone plays the corresponding video according to the video file identified by option 1011. In some embodiments, in response to the user's operation of clicking option 1011, the mobile phone determines whether the video file identified by option 1011 is a second type of video file. For example, the mobile phone can determine whether the video file identified by option 1011 is the second type of video file by judging whether the video file identified by option 1011 includes video extension information. For example, if the video file identified by option 1011 does not include video extension information, the video file identified by option 1011 is the first type of video file. For another example, if the video file identified by option 1011 includes video extension information, the video file identified by option 1011 is the second type of video file. Take the video file format as MP4 as an example. The mobile phone can determine whether the video file identified by option 1011 includes mmmw. If the video file identified by option 1011 includes mmmw, the video file identified by option 1011 is the second type of video file. If the video file identified by option 1011 does not include mmmw, the video file identified by option 1011 is the first type of video file.

If the video file identified by option 1011 is the first type of video file, the mobile phone will play the video according to the video file identified by option 1011. For the specific playback method, please refer to the existing method for the mobile phone to play video according to the first type of video file, which will not be repeated here. .

If the video file identified by option 1011 is the second type of video file, the mobile phone plays at least two channels of video according to the second type of video file. Take the video extension information in the second type of video file identified by option 1011 as an example for indicating the association relationship between the first channel of video and the second channel of video. For example, the video extension information in the second type video file identified by option 1011 includes the extension information of the first channel video and the extension information of the second channel video, the extension information of the first channel video includes the main video identifier, the second channel video extension information The extended information includes the slave video identification and the main video frame identification, wherein the main video frame identification is used to identify the Nth frame of the main video, then in response to the operation of the user clicking option 1011, the mobile phone plays the first video in the window 1021. When the video of one channel reaches the Nth frame in the window 1021, the video of the second channel starts to be played in the window 1022. For example, as shown in Figure 11, when the first channel of video is played to the Mth frame, the second channel of video plays the last frame, and when the first channel of video is played to the M+1th frame, the second channel of video playback has ended, The window 1022 is hidden, and if the video of the first channel is not finished yet, the video of the first channel continues to be played in the window 1021 .

For example, the mobile phone generates video associated information according to the video extension information in the second type of video file identified by option 1011, and then the mobile phone plays the corresponding video according to the video associated information. The video associated information may be as shown in Table 1.

Table 1

Main video frame number	from the video serial number
1.1	--
1.2	--
...	--
1.N	2
...	--

Taking the video file format of the second type of video file identified by option 1011 as MP4 as an example, the video associated information may also be as shown in Table 2.

Table 2

sample index	DTS	PTS	sample size	offet	sub track id
1.1	T11	T12	Z1	F1	--
1.2	T21	T22	Z2	F2	--
...	...	...	...	...	--
1.N	TN1	TN2	ZN	FN	2
...	...	...	...	...	--

Among them, sample idex indicates the main video frame number, DTS indicates the decoding time of the main video frame, PTS indicates the display time of the main video frame, sample size indicates the frame size of the main video, and offset indicates the position of the frame corresponding to the main video in the video file. , the sub track id is used to identify the slave video. For example, as shown in Table 2, when the sample index is 1.N, the sub track id is 2, that is, when the main video reaches the Nth frame, the sub-track id of 2 starts to play.

For example, the display start time of the slave video with the sub track id of 2 can be set as the display start time of the Nth frame of the master video, and the display time of the slave video with the sub track id of 2 and the display time of the master video can be set. Map onto the same timeline, thereby associating sub track id 2 with frame N of the main video.

In some embodiments, the mobile phone determines the layout of the video playback window according to the video extension information. For example, the mobile phone determines the number of video channels to be played according to the video extension information, then determines the number of video playback windows according to the number of video channels to be played, and then determines the number of video playback windows according to the number of video playback windows. The layout of the video playback window corresponding to the number. The number of video playback windows is the same as the number of video channels to be played. For example, before the first channel of video is played to N frames, only one video needs to be played on the mobile phone, so the number of video playback windows is 1, and the video playback window is used to play the first channel of video. When the mobile phone plays the first video to N frames, there are two videos to be played, namely the first video and the second video. Therefore, the number of video playback windows is 2, which is different from the number of video playback windows. The layout of the video playback window corresponding to the number 2 can be preset by the user, or the default of the gallery application. For example, the two video playback windows are window 1021 and window 1022, and their layouts can be in a picture-in-picture manner. As shown in FIG. 10 , the window 1021 is used to play the first channel of video, and the window 1022 is used to play the second channel of video. Alternatively, the number of video playback windows is 2, and the layout of the windows can be tiled. As shown in FIG. 12, window 1201 is used to play the first channel of video, window 1202 is used to play the second channel of video, and window 1202 is located in the window. The underside of 1202. It should be noted that FIG. 12 shows only a tiled layout of two video playback windows. In this embodiment of the present application, the windows 1201 and 1201 may also be laid out left and right, which is not limited.

In another example, when the mobile phone plays the first video in window 1021 and the second video in window 1022, the second type of video file identified by option 902 includes the audio data of the first video and the second video. In the case of video data, the mobile phone can play the corresponding sound by default according to the audio data of the main video; or the mobile phone can also play the corresponding sound according to the audio data of the secondary video by default. For example, if the mobile phone plays the corresponding sound according to the audio data of the main video by default, the mobile phone plays the first video in the window 1021, and when the second video is played in the window 1022, it defaults to the audio of the first video. data, the sound of the first video is played, and the second video is played silently or silently. For another example, if the mobile phone plays the corresponding sound according to the audio data from the video by default, then the mobile phone plays the first video in the window 1021, and when the second video is played in the window 1022, the default is based on the second video. Audio data, play the sound of the second video, and the first video is played without sound or mute.

Further, in the case where the second type of video file identified by option 1011 includes the audio data of the first video and the second video data, the mobile phone plays the first video in the window 1021, and plays the second video in the window 1022. When the video is selected, the video playback interface may also include a sound option for the first channel video and a sound option for the second channel video. In response to the user's operation on the sound option for the first channel video, the mobile phone plays the sound of the first channel video. , and in response to the user's operation of selecting the sound option of the second channel video, the mobile phone plays the sound of the second channel video. This facilitates user interaction with the device.

Exemplarily, in the case where only the audio data of the first channel of video is included in the second type of video file identified by option 1011, the mobile phone plays the first channel of video in window 1021, and when the second channel of video is played in window 1022, according to the first channel of video. The audio data of one video is played, and the sound of the first video is played. Or, in the case where only the audio data of the second video is included in the second type of video file identified by option 1011, the mobile phone plays the first video in the window 1021, and when the second video is played in the window 1022, according to the second video. The audio data of the channel video is played, and the sound of the second channel video is played.

As shown in FIG. 13 , the mobile phone displays an interface 1300 , and the desktop includes icons 1301 . Icon 1301 is used to identify a video application. In response to the user clicking on icon 1301, the phone displays the interface of the video application. For example, the interface of the video application may be interface 1310 , including video option 1311 . The video option 1311 is used to play the video whose video name is the developer conference. In response to the user clicking the video option 1311, the mobile phone sends a video acquisition request to the video server, and the video acquisition request is used to request to acquire the video file corresponding to the developer conference. The video server receives the video acquisition request from the mobile phone, and returns the video file corresponding to the developer conference to the mobile phone. The mobile phone receives the video file corresponding to the developer conference from the video server, and plays the video according to the video name is the video file corresponding to the developer conference. Specifically, the mobile phone is the video file corresponding to the developer conference according to the video name, and the way of playing the video can refer to the above-mentioned way that the mobile phone plays the video according to the option 1311 for identifying the video file, and will not be repeated here.

The above is only an example of triggering the mobile phone to play video according to the video file when the video playing device is a mobile phone. The embodiment of the present application may also trigger the mobile phone to play the video according to the video file in other ways, which is not limited. For example, in the case where the video playback device is a TV, the video playback device may respond to the user clicking the channel selection button on the remote control to trigger video playback according to the video file from the server of the corresponding channel.

In addition, in a live broadcast scenario, the video playback device can also add video extension information to the video metadata, so that the video playback device can play at least two videos at the same time. Thereby, it can meet the multi-angle viewing needs of users in the live broadcast scene.

Exemplarily, FIG. 14 shows a network architecture of a live broadcast scenario, including at least one camera (eg, camera 1, camera 2, etc.), a broadcast director, a streaming server, and a video playback device.

The camera is used to collect video in real time, and the network architecture of the live broadcast scene includes at least two cameras, and different cameras can be used to collect video from different perspectives. For example, when a certain game is broadcast live, camera 1 can be used to capture images of the real-time game, and camera 2 can be used by the user to capture images of real-time explanations. Among them, the camera 1 is located on the camera position 1, and the camera 2 is located on the camera position 2. The director station is used to receive the video collected from the camera, encode the video from the camera, obtain the corresponding video metadata, video data and audio data, and upload the video metadata, video data and audio data to the push stream server, and the streaming server delivers it to the corresponding video playback device. The video playback device decodes the video data and the audio data according to the video metadata, and plays the corresponding video.

In some embodiments, the director station performs processing such as encoding the video from the camera according to the user's settings. For example, if the user sets to only broadcast the video from camera 1 on one camera position (eg camera position 1), the director generates video metadata according to the user's settings, and the video metadata is used to indicate the camera 1 on camera position 1. For details, please refer to the introduction about video metadata in the existing protocol. And the director station encodes the video from camera 1 on camera 1, obtains video data and audio data, and uploads video metadata, video data and audio data to the streaming server. If the user's settings have not changed, the director only needs to encode the video from camera 1 on camera 1 to obtain video data and audio data, and upload the video data and audio data to the streaming server. , without regenerating video metadata.

For example, for a video playback device, after receiving the video metadata, the video playback device determines whether the video metadata includes video extension information. If the video metadata does not include video extension information, the video playback device determines that the video needs to be played. The number of video playback windows is 1, and the video data and audio data are decoded according to the video metadata, and after decoding, the corresponding video is played according to the layout corresponding to the number of video playback windows being 1. For example, a layout corresponding to 1 video playback window may be full screen or not, may be set according to the user, or may be default, which is not limited.

In some embodiments, in response to the user's setting, the broadcast director determines to update the live broadcast of one video channel to the live broadcast of two or more channels of video. Take the example of updating one channel of live video to two channels of live video. For example, one video is the video from the camera at camera position 1, and the other video is the slow playback video obtained based on the video collected by the camera located at camera position 1 in a certain segment, then the director updates the video metadata, video metadata Including video extension information, and uploading the updated video metadata, video data and audio data of the above two channels of video to the streaming server, and then the server will deliver it to the video playback device. The video playback device can play two-channel videos according to the updated video metadata.

Specifically, the updated video extension information is used to indicate the association relationship between the slow playback video and the video from camera 1 of camera 1 . For example, the extended video information includes extended information of the video from camera 1 of camera 1 and extended information of the slow playback video, the extended information of the video from camera 1 of camera 1 includes the main video identifier, and the extended information of the slow playback video includes The secondary video identification and the main video frame identification, wherein the main video frame identification is used to identify the playback position of the video from the camera of camera position 1 when the slow playback video starts to be played.

For example, after receiving the video metadata, audio data, and video data, the video playback device can determine whether the video metadata includes video extension information. The number of channels, and the number of video playback windows is determined according to the number of channels of the video to be broadcast live. The number of video playback windows is the same as the number of video channels to be broadcast live. Then, the video playback device determines a layout corresponding to the number of video playback windows according to the number of video playback windows. The video playback device plays the above two-channel video according to the layout corresponding to the number of video playback windows. The layout corresponding to the number of video playback windows may be preset by the user on the video playback device, or may be a default, which is not limited. For example, when the number of video playback windows is 2, and the corresponding layout when the number of video playback windows is 2, as shown in FIG. 15A , the main video is played in window 1501A, and the secondary video is played in window 1502A. For another example, when the number of video playback windows is 2, and the corresponding layout when the number of video playback windows is 2, as shown in FIG. 15B , the main video is played in window 1501B, and the secondary video is played in window 1502B.

Further, when the slave video (that is, after the above-mentioned slow playback video is played), the director station re-updates the video metadata, and uploads the re-updated video metadata to the streaming server, and the streaming server sends it to the video playback device. When the video playback device receives the re-updated video metadata, it determines whether the re-updated video metadata includes the video extension information. If it does not include the video extension information, the video playback device determines to play only one video, and one video playback window corresponds to the video. layout and play the corresponding video.

It should be understood that the above only takes the two-channel live video as an example of the video from camera 1 of camera 1 and the slow playback video. The video of camera 1 of camera 1, one channel is the video of camera 2 of camera 2, which is not limited. Of course, the embodiment of the present application is not limited to live broadcast of two channels of video, and can also live broadcast of three or more channels of video at the same time. For live broadcast of 3 or more channels of video, different from live broadcast of two channels of video, the video extension information is used to indicate the association of 3 or more channels of video. For others, please refer to the relevant introduction when live broadcast of two channels of video, here No longer.

It should be noted that, the above-mentioned embodiments are described by taking the integration of at least two first-type video files into one second-type video file as an example, and the method of the embodiment of the present application can also be applied to at least one first-type video file. The video file and a second-class video file are integrated into a new second-class video file, in this case, the main video in the second-class video file used for video file integration is used as the integrated new second-class video file. The master video in the class video file, the video in the first class video file used for video file integration is regarded as the slave video in the new second class video file after integration. The related introduction of the integration of class video files into a second class video file will not be repeated here.

In addition, in this embodiment of the present application, an audio file and a video file may also be integrated into one media file, or at least two audio files may be integrated into one media file, or an audio file and an image file may be integrated into one media file. Taking the integration of two audio files into one media file as an example, the electronic device can play the media file integrated by the two audio files according to the media extension information. For example, the media file includes audio data of the first channel of audio, audio data of the second channel of audio, and audio extension information. Wherein, the audio extension information includes the extension information of the first channel of audio and the extension information of the second channel of audio, the extension information of the first channel of audio includes the main audio identifier, and the extension information of the second channel of audio includes the slave audio identifier and the slave audio playback position. The identifier, from the audio playback position identifier, is used to indicate the playback position of the first channel of audio when the second channel of audio starts to be played. The audio playback position identifier is used to identify when the first channel of audio is played to time T, and the second channel of audio starts to be played. In this case, the electronic device can play the first channel of audio through the speaker. At time T, the second channel of audio is played through the speaker, and the first channel of audio is continued to be played. In some embodiments, when the electronic device is connected to the headset, the electronic device can play the first audio channel through the headset, play the second audio channel through the speaker when the first audio channel reaches time T, and continue to use the headset to play the first audio channel. road audio. Alternatively, the electronic device may play the first channel of audio through the earphone, and when the first channel of audio is played to time T, the second channel of audio may be played through the earphone, and the first channel of audio may continue to be played through the earphone. Alternatively, the electronic device may play the first channel of audio through the speaker, play the second channel of audio through the headset when the first channel of audio is played at time T, and continue to use the speaker to play the first channel of audio.

It should be understood that the above embodiments may be used alone or in combination with each other to achieve different technical effects, which are not limited thereto.

In addition, the above embodiments can also be extended to play scenarios of different media files, so that when playing a certain media file, the electronic device can automatically pull up another media file to play. Take the first media file and the second media file as an example.

Exemplarily, the first media file is associated with first media file extension information, the first media file extension information includes a first media file identifier, the first media file identifier is used to identify the first media file, and the first media file extension information is associated with the second media file. Media file extension information, the second media file extension information includes a second media file identification and a second media file playback position identification, the second media file identification is used to identify the second media file, and the second media file playback position identification is used to identify the first media file. The first play position information of the first media when the second media starts to play, and the first play position information includes the first position.

For example, the extension information of the first media file is associated with the extension information of the first media file, and the extension information of the first media file is associated with the extension information of the second media file by adding the extension information of the first media file and the extension information of the second media file to the first media file The realization can also be realized by establishing a corresponding association relationship, which is not limited.

Take the first playback position information including the first position as an example. The electronic device plays the first media file in response to the operation of playing the first media file, and starts playing the second media file when the first media file is played to the first position. Wherein, when the electronic device plays the second media file, it continues to play the first media file, that is, when the electronic device plays the first media file to the first position, the first media file and the second media file can be played simultaneously. For example, the operation of playing the first media file may be the user's operation on the first media file, or the user's operation on a control for indicating the first media file, or a certain shortcut operation, voice command, etc., which is not limited.

For example, the first media file and the second media file may both be video files. In this case, when the first media file and the second media file are played simultaneously, the first media file and the second media file can be played in a split screen. For example, when the first media file and the second media file are played at the same time, the electronic device can split the display screen into the first screen and the second screen, and play the first media file on the first screen, and play the first media file on the second screen. Play the second media file. Alternatively, when the electronic device plays to the first position, a window is displayed on the display screen, and a picture corresponding to the second media file is displayed in the window. The window is suspended above the picture corresponding to the first media file, that is, the window used for playing the picture corresponding to the second media file is suspended above the window used for playing the picture corresponding to the first media file.

In another example, the first media file is a video file, and the second media file is an audio file. In this case, when the first media file and the second media file are played at the same time, the electronic device plays the first media file muted through the display screen, and plays the second media file through the speaker. In some embodiments, if the electronic device is connected to a headset, the electronic device can play the second media file through the headset, and the electronic device plays the first media file through the speaker without mute, that is, the sound of the first media file is output through the speaker.

In another example, the first media file is an audio file, and the second media file is a video file. In this case, when the first media file and the second media file are played at the same time, the electronic device plays the first media file through the speaker, and plays the second media file through the display screen with mute. In some embodiments, if the electronic device is connected to the headset, the electronic device can play the second media file through the headset without mute. That is, the sound of the second media file is output through the earphone.

Or, in another example, the first media file and the second media file are both audio files. When the first media file and the second media file are played at the same time, if the electronic device is connected to the headset, the electronic device can play the first media file through the speaker and play the second media file through the headset. Alternatively, the electronic device may play the first media file through an earphone and play the second media file through a speaker. In some embodiments, when the first media file and the second media file are played simultaneously, if the electronic device is not connected to the headset, the electronic device can simultaneously play the first media file and the second media file through the speaker.

In some embodiments, the first media file extension information may also be associated with the third media file extension information. The third media file extension information includes the third media file identifier and the third media file playing position identifier. The third media file identifier is used to identify the third media file, and the third media file playback position identifier is used to identify the second playback position information of the first media when the third media starts to play. Take the second playback position information including the second position as an example. In this case, when the first media file is played to the second position, the electronic device starts to play the third media file and continues to play the first media file. That is, the embodiment of the present application does not limit the number of media file extension information associated with the first media file extension information.

For example, the first media file may include first media file extension information, second media file extension information and third media file extension information.

For example, as shown in FIG. 16, the electronic device displays an interface 1600, the interface 1600 includes option 1601 and option 1602, option 1601 is used to identify video file 1, option 1602 is used to identify video file 2, video file 1 and video file 1 are local It can also be saved on the server side, which is not limited. The video file 1 is associated with the extension information of the first video file, the extension information of the first video file is associated with the extension information of the second video file, the extension information of the first video file includes the first video file identifier, and the first video file identifier is used to identify the video file 1, The second video extension information includes a second video file identification and a second video file playback position identification, the second video file identification is used to identify the video file 2, and the second video file playback position identification is used to identify time T, in this case , the electronic device plays the video file 1 in the window 1611 in response to the user clicking on the option 1601. For example, when the video file 1 is played to time T-1, the screen corresponding to the video file 1 displayed in the window 1611. When the video file 1 is played to time T, the electronic device displays the window 1612, and plays the video file 2 in the window 1612, and then continues to play the video file 1 in the window 1611. Further, in some embodiments, as shown in FIG. 16 , when the video file 1 is played to time M, the video file 2 has been played, and the two video files 1 have not been played, then the electronic device continues to play the video file in the window 1611. 1.

It should be understood that the above embodiments may be used alone or in combination with each other to achieve different technical effects, which are not limited thereto.

In the above-mentioned embodiments of the present application, the methods provided by the embodiments of the present application are introduced from the perspective of an electronic device as an execution subject. In order to implement the functions in the methods provided by the above embodiments of the present application, the electronic device may include a hardware structure and/or software modules, and implement the above functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether one of the above functions is performed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.

An embodiment of the present application further provides a video playback apparatus, as shown in FIG. 17 , including one or more processors 1701 and one or more memories 1702 . One or more computer programs are stored in the memory 1702, and when the one or more computer programs are executed by the processor 1701, the video playback device can execute the video playback method provided by the embodiments of the present application.

Further, in some embodiments, the video playback apparatus may further include a transceiver 1703 for communicating with other devices through a transmission medium, so that the video playback apparatus may communicate with other devices. Illustratively, the transceiver 1703 may be a communication interface, a circuit, a bus, a module, or the like, and the other device may be a terminal, a server, or the like. Exemplarily, the transceiver 1703 may be used to send a video acquisition request to a video server, receive a video file, and the like.

In other embodiments, the video playback device may further include a display screen 1704 for displaying the video to be played. Illustratively, display screen 1704 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light). emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (quantum dot light emitting diodes, QLED) and so on.

In addition, the video playback device in the embodiment of the present application may further include a speaker, a touch sensor, etc., which is not limited.

The connection medium between the processor 1701, the memory 1702, the transceiver 1703, and the display screen 1704 is not limited in this embodiment of the present application. For example, in this embodiment of the present application, the processor 1701, the memory 1702, the transceiver 1703, and the display screen 1704 may be connected through a bus, and the bus may be divided into an address bus, a data bus, a control bus, and the like.

In this embodiment of the present application, the processor may be a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component, which can implement or The methods, steps and logic block diagrams disclosed in the embodiments of this application are executed. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the methods disclosed in conjunction with the embodiments of the present application may be directly embodied as executed by a hardware processor, or executed by a combination of hardware and software modules in the processor.

In this embodiment of the present application, the memory may be a non-volatile memory, such as a hard disk drive (HDD) or a solid-state drive (SSD), etc., or may also be a volatile memory (volatile memory), for example Random-access memory (RAM). Memory is, but is not limited to, any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. The memory in this embodiment of the present application may also be a circuit or any other device capable of implementing a storage function, for storing program instructions and/or data.

As used in the above embodiments, depending on the context, the terms "when" or "after" can be interpreted to mean "if" or "after" or "in response to determining..." or "in response to detecting …”. Similarly, depending on the context, the phrases "in determining..." or "if detecting (the stated condition or event)" can be interpreted to mean "if determining..." or "in response to determining..." or "on detecting (the stated condition or event)" or "in response to the detection of (the stated condition or event)".

In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented in software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present invention are generated. The computer may be a general purpose computer, special purpose computer, computer network, or other programmable device. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be downloaded from a website site, computer, server, or data center Transmission to another website site, computer, server, or data center is by wire (eg, coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (eg, infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that includes an integration of one or more available media. The usable media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk (SSD)), and the like. In the case of no conflict, the solutions of the above embodiments can be used in combination.

It should be noted that a part of this patent application file contains content protected by copyright. Except for making copies of the patent file or the contents of the patent file recorded by the Patent Office, the copyright owner reserves the right to copyright.

Claims (17)

1. A playback method, applied to an electronic device, characterized in that the method comprises:

   the electronic device detects a first user input for a first media file;

   In response to the first user input, the electronic device plays the first media file;

   When the first media file is played to a first position, the electronic device plays the second media file, and the electronic device continues to play the first media file; wherein the first position is preset of;

   or,

   the electronic device detects a first user input for a first control;

   In response to the first user input, the electronic device plays a first media file;

   When the first media file is played to a first position, the electronic device plays the second media file, and the electronic device continues to play the first media file; wherein the first position is preset of.
2. The method of claim 1, wherein:

   The electronic device includes a display screen; the first media file and the second media file are played on the display screen; both the first media file and the second media file are video files;

   or,

   The electronic device includes a speaker; the first media file and the second media file are played on the speaker; both the first media file and the second media file are audio files;

   or,

   The electronic device is connected to a headset; the first media file and the second media file are played on the headset; both the first media file and the second media file are audio files;

   or,

   The electronic device includes a display screen and a speaker, and the first media file is played on the display screen; the first media is a video file; the second media file is played on the speaker; the second media file is played on the speaker; The media file is an audio file;

   or,

   The electronic device includes a display screen, and the electronic device is connected to an earphone, and the first media file is played on the display screen; the first media file is a video file; the second media file is displayed on the display screen. Play on the headset; the second media file is an audio file;

   or,

   The electronic device includes a display screen, and the electronic device is connected to a headset, and the first media file is played on the headset; the first media file is an audio file; the second media file is displayed on the display Play on the screen; the second media file is a video file;

   or,

   The electronic device includes a display screen and a speaker, and the first media file is played on the speaker; the first media file is an audio file; the second media file is played on the display screen; the first media file is played on the display screen; The second media file is a video file.
3. The method according to claim 2, wherein when the first media file is played to a first position, the electronic device plays the second media file, and the electronic device continues to play the first media file. Media files; including:

   When the first media file is played to the first position, the display screen of the electronic device is divided into a first screen and a second screen;

   The second screen plays the second media file, and the first screen continues to play the first media file; wherein both the first media file and the second media file are video files.
4. The method according to claim 2, wherein when the first media file is played to a first position, the electronic device plays the second media file, and the electronic device continues to play the first media file. Media files; including:

   When the first media file is played to the first position, the display screen of the electronic device displays a window, the window displays the second screen corresponding to the second media file, and the window is suspended in the first position. On the first picture corresponding to a media file; wherein, both the first media file and the second media file are video files.
5. The method according to any one of claims 1-4, wherein the first position comprises one of the following: a preset playback time point in the first media file, the first media file The preset playback frame in , and the preset playback ratio of the first media file.
6. The method according to any one of claims 1-5, wherein the first position is preset by a user.
7. The method according to any one of claims 1-6, wherein when the first media file is being played, extension information of the first media file is associated with the first media file; and the extension information of the first media file includes the first media file identifier; the first media file identifier is used to identify the first media file; the first media file extension information is associated with the second media file extension information; the second media file extension information includes the second media file identifier and The second media file playback position identifier; the second media file identifier is used to identify the second media file; the second media file playback position identifier is used to identify the first media when the second media starts to play the first playback position information; the first playback position information includes the first position.
8. The method according to any one of claims 1-7, wherein the method further comprises:

   After the second media file is played, the electronic device continues to play the first media file; and the electronic device only plays the first media file.
9. The method according to claim 8, wherein the method further comprises:

   When the first media file is played to the second position, the electronic device plays the third media file, and the electronic device continues to play the first media file; wherein the second position is preset ; the second position is located after the second media file is played.
10. The method according to claim 9, wherein the second position comprises one of the following: a preset playback time point in the first media file, a preset playback frame in the first media file , the preset playback ratio of the first media file.
11. The method according to claim 9 or 10, wherein the first media file extension information is further associated with third media file extension information; the third media file extension information includes a third media file identifier and a third media file A file playback position identifier; the third media file identifier is used to identify the third media file; the third media file playback position identifier is used to identify the second position of the first media when the third media starts to play. Playing position information; the second playing position information includes the second position.
12. The method according to claim 11, wherein the first media file extension information is mmmw with the first multimedia multiplexing information, the second media file extension information is the second mmmw, and the The third media file extension information is the third mmmw, the first mmmw, stsd, stts, stsc, stsz, stss, and stco corresponding to the first mmmw are located in the first media stream box stb1, and the second mmmw , the stsd, stts, stsc, stsz, stss, stco corresponding to the second mmmw are located in the second media stream box stb1, the third mmmw, the stsd, stts, stsc, stsz corresponding to the third mmmw , stss and stco are located in the third media streaming box stb1, the first media streaming box stb1 is located in the first media box media, the second media streaming box stb1 is located in the second media box media, so The third media stream box stb1 is located in the third media box media, the first media box media and the header tkhd corresponding to the first media box media are located in the first stream trak, the second media box media and the header tkhd corresponding to the second media box media is located in the second stream trak, the third media box media and the header tkhd corresponding to the third media box media are located in the third stream trak, and the third media box media is located in the third stream trak. The first stream trak, the second stream trak, the third stream trak, the header mvhd corresponding to the first stream trak, the second stream trak and the third stream trak are located in the video box moov, the video The box moov, media data mdata and media type ftyp are located in the MP4 file, the first stream trak is used to indicate the first media file, the second stream trak is used to indicate the second media file, and the third stream trak is used to indicate the second media file. The stream trak is used to indicate the third media file, and the first media file, the second media file and the third media file are all video files.
13. A method for acquiring a video file, applied to an electronic device, the electronic device comprising a display screen; characterized in that, the method comprises:

    The display screen displays a first interface of the first application; the first interface includes a master video file setting control, a master video file preview frame, a first slave video file setting control, a first slave video file preview frame, a first association set controls and finish controls;

    in response to a first user input to the main video file setting control, the display screen displays a second interface of the first application; the second interface includes a first video file and a second video file;

    In response to a second user input to the first video file, the main video file preview box displays a preview static picture or a preview dynamic picture of the first video file;

    The electronic device displays the second interface in response to a third user input to the first slave video file settings control;

    In response to a fourth user input to the second media file, the first slave video file preview frame displays a preview static picture or a preview dynamic picture of the second video file;

    In response to a fifth user input to the first association setting control, the display screen displays an association setting frame; the association setting frame is used to set the first association setting frame when the main video file is played to the first position, the first association setting frame A slave video file starts playing, and the playback of the first slave video file will not pause or stop the playback of the master video file; the association setting box includes a first position input box, a first confirmation control and a second confirmation control;

    After receiving the sixth user input to the first position input box, and after receiving the seventh user input to the first confirmation control, the first position is set;

    After receiving the eighth user input to the completion control, a third video file is acquired.
14. An electronic device, comprising:

    processor;

    memory;

    and a computer program, which is stored in the memory and, when executed by the processor, causes the electronic device to perform the method of any one of claims 1-13.
15. A chip, characterized in that it includes:

    processor;

    memory;

    and a computer program, which is stored in the memory and, when executed by the processor, causes the chip to perform the method of any one of claims 1-13.
16. A computer-readable storage medium, characterized by comprising a computer program, which, when the computer program is executed on an electronic device, causes the electronic device to execute the method according to any one of claims 1-13.
17. A computer program product which, when run on a computer, causes the computer to perform the method of any one of claims 1-13.

Images