CN117221637A - Video playing method and related equipment - Google Patents

Video playing method and related equipment Download PDF

Info

Publication number
CN117221637A
CN117221637A CN202311295438.2A CN202311295438A CN117221637A CN 117221637 A CN117221637 A CN 117221637A CN 202311295438 A CN202311295438 A CN 202311295438A CN 117221637 A CN117221637 A CN 117221637A
Authority
CN
China
Prior art keywords
video
electronic equipment
playing
target video
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311295438.2A
Other languages
Chinese (zh)
Inventor
李大龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN202311295438.2A priority Critical patent/CN117221637A/en
Publication of CN117221637A publication Critical patent/CN117221637A/en
Pending legal-status Critical Current

Links

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The application discloses a video playing method and related equipment; a communication channel can be established in which the first electronic device is connected to the second electronic device; acquiring a sharing playing request of a target video; triggering the first electronic equipment and the second electronic equipment to play the target video according to the sharing play request; transmitting a first playing progress of the target video on the first electronic equipment to the second electronic equipment through a communication channel so that the second electronic equipment compares the first playing progress with a second playing progress of the target video on the second electronic equipment; when the comparison result of the first playing progress and the second playing progress does not meet the preset condition, triggering the adjustment of the playing progress of the target video in the second electronic equipment so as to enable the first electronic equipment and the second electronic equipment to synchronously play the target video. The application can combine the playing capability of different electronic devices to display the target video in a cooperative sharing mode, so that better film watching experience can be brought to users.

Description

Video playing method and related equipment
Technical Field
The application relates to the technical field of computers, in particular to a video playing method and related equipment.
Background
Video playing is one of the main use scenarios of the current internet industry, and with the continuous perfection and expansion of video types, duration, audience groups and business modes, the requirements of people on video playing are increasing. Today, the form of the viewing (hardware) equipment is various, and the viewing (hardware) equipment is quite different in terms of screen size, weight, power supply mode and the like, for example: a portable intelligent mobile phone and a tablet computer, a portable computer mainly used for desktop environment, a projector mainly used for indoor film observation, a large-screen television and the like. Of these, the most typical and typical ones are mobile phones with relatively small screens, and the other ones are televisions with large-sized screens or smart screens, etc.
For the two types of equipment, although the screen size of the television is larger, the replacement period of the television is longer, and the hardware capability of the television is possibly relatively poorer, so that the television cannot play some videos with higher requirements on equipment configuration; the mobile phone has a short replacement period, the hardware is updated quickly, and high-quality video can be played, but the physical size is low, so that more immersive experience cannot be brought to users. At present, video playing is carried out on the two devices, so that the requirements of users cannot be met well, and the video watching experience of the users is not improved.
Disclosure of Invention
The embodiment of the application provides a video playing method and related equipment, wherein the related equipment can comprise a video playing device, computer equipment, a computer readable storage medium and a computer program product, and can display target videos in a cooperative sharing mode by combining playing capabilities of different electronic equipment, so that better video watching experience can be brought to users.
The embodiment of the application provides a video playing method, which comprises the following steps:
establishing a communication channel for connecting the first electronic device with the second electronic device; obtaining a sharing playing request of target videos of the first electronic equipment and the second electronic equipment;
triggering the first electronic equipment and the second electronic equipment to play the target video according to the sharing play request;
transmitting a first playing progress of the target video on the first electronic device to the second electronic device through the communication channel, so that the second electronic device compares the first playing progress with a second playing progress of the target video on the second electronic device;
when the comparison result of the first playing progress and the second playing progress does not meet the preset condition, triggering the adjustment of the playing progress of the target video in the second electronic equipment so that the first electronic equipment and the second electronic equipment synchronously play the target video.
The embodiment of the application provides a video playing method, which comprises the following steps:
establishing a communication channel for connecting the first electronic device with the second electronic device; obtaining a sharing playing request of target videos of the first electronic equipment and the second electronic equipment;
triggering the first electronic equipment and the second electronic equipment to play the target video according to the sharing play request;
receiving a first playing progress of the target video sent by the first electronic device through the communication channel on the first electronic device;
comparing the first playing progress with a second playing progress of the target video on the second electronic equipment;
and when the comparison result of the first playing progress and the second playing progress does not meet the preset condition, adjusting the playing progress of the target video in the second electronic equipment so as to enable the first electronic equipment and the second electronic equipment to synchronously play the target video.
Accordingly, an embodiment of the present application provides a video playing device, including:
the first establishing unit is used for establishing a communication channel for connecting the first electronic equipment with the second electronic equipment; obtaining a sharing playing request of target videos of the first electronic equipment and the second electronic equipment;
The first triggering unit is used for triggering the first electronic equipment and the second electronic equipment to play the target video according to the sharing play request;
the sending unit is used for sending the first playing progress of the target video on the first electronic equipment to the second electronic equipment through the communication channel so that the second electronic equipment compares the first playing progress with the second playing progress of the target video on the second electronic equipment;
and the first adjusting unit is used for triggering the adjustment of the playing progress of the target video in the second electronic equipment when the comparison result of the first playing progress and the second playing progress does not meet the preset condition, so that the first electronic equipment and the second electronic equipment synchronously play the target video.
Accordingly, an embodiment of the present application provides a video playing device, including:
the second establishing unit is used for establishing a communication channel for connecting the first electronic equipment and the second electronic equipment; obtaining a sharing playing request of target videos of the first electronic equipment and the second electronic equipment;
the second triggering unit is used for triggering the first electronic equipment and the second electronic equipment to play the target video according to the sharing play request;
The receiving unit is used for receiving a first playing progress of the target video sent by the first electronic equipment through the communication channel on the first electronic equipment;
the comparison unit is used for comparing the first playing progress with a second playing progress of the target video on the second electronic equipment;
and the second adjusting unit is used for adjusting the playing progress of the target video in the second electronic equipment when the comparison result of the first playing progress and the second playing progress does not meet the preset condition, so that the first electronic equipment and the second electronic equipment synchronously play the target video.
Optionally, in some embodiments of the present application, the first trigger unit may include a first trigger subunit, a first playing subunit, a second trigger subunit, and a second playing subunit, as follows:
the first triggering subunit is configured to trigger, according to the shared play request, the first electronic device to select a first video code stream corresponding to the first electronic device from a video code stream set of the target video, where the video code stream set includes at least two video code streams;
A first playing subunit, configured to play the target video in the first electronic device based on the first video code stream;
the second triggering subunit is used for triggering the second electronic equipment to select a second video code stream corresponding to the second electronic equipment from the video code stream set of the target video according to the sharing playing request;
and the second playing subunit is used for playing the target video in the second electronic equipment based on the second video code stream.
Optionally, in some embodiments of the present application, the video code stream set includes a mapping relationship between preset device configuration information and a video code stream under preset coding parameters;
the first triggering subunit may be specifically configured to select, according to the shared play request, a first video code stream corresponding to the first electronic device from a video code stream set of the target video based on device configuration information of the first electronic device;
the second triggering subunit may specifically be configured to trigger, according to the shared play request, the second electronic device to select, based on device configuration information of the second electronic device, a second video code stream corresponding to the second electronic device from the video code stream set of the target video.
Optionally, in some embodiments of the present application, the video code streams in the video code stream set include at least one video slice, the number of video slices of each video code stream is the same, and the duration corresponding to the video slices in the same arrangement sequence in each video code stream is the same;
the first playing subunit may specifically be configured to play the target video in the first electronic device according to the sequence of video clips in the first video code stream;
the second playing subunit may specifically be configured to play the target video in the second electronic device according to the sequence of video slices in the second video code stream.
Optionally, in some embodiments of the present application, a play time point for the same video content in each video bitstream of the video bitstream set is the same.
Optionally, in some embodiments of the present application, the video playing device may further include a viewing angle switching unit, as follows:
the visual angle switching unit is used for acquiring a target video code stream corresponding to the switched target playing visual angle based on the switching operation of the playing visual angle of the target video; and switching the currently played video code stream into the target video code stream, and continuously displaying the target video at the target playing view angle based on the current playing progress of the target video.
Optionally, in some embodiments of the present application, the video playing device may further include an interaction unit, as follows:
the interaction unit is used for displaying the target video in a preset interaction mode based on the playing content information of the target video; acquiring object interaction operation information aiming at a target video in the preset interaction mode; and displaying the interaction result corresponding to the object interaction operation information on the playing page of the target video.
Optionally, in some embodiments of the present application, the second adjustment unit may include a first determination subunit, an identification subunit, a second determination subunit, and an adjustment subunit, as follows:
the first determining subunit is configured to determine estimated position information of a target video frame corresponding to a first playing progress in a video frame sequence of the target video according to a timestamp corresponding to the first playing progress;
the identification subunit is used for sequentially identifying key frames in the video frame sequence by taking the estimated position information as a starting point;
the second determining subunit is used for determining target position information of a target video frame in the video frame sequence according to the timestamp corresponding to the key frame and the timestamp corresponding to the first playing progress when the key frame is identified;
And the adjustment subunit is used for adjusting the playing progress of the target video in the second electronic equipment based on the target position information so as to enable the first electronic equipment and the second electronic equipment to synchronously play the target video.
Optionally, in some embodiments of the present application, the second determining subunit may be specifically configured to determine, when a time difference between a time stamp corresponding to the key frame and a time stamp corresponding to the first playing progress is smaller than a preset value, target location information of the target video frame in the video frame sequence based on location information of the key frame in the video frame sequence.
The computer equipment provided by the embodiment of the application comprises a processor and a memory, wherein the memory stores a computer program, and the processor loads the computer program to execute the steps in the video playing method provided by the embodiment of the application.
The embodiment of the application also provides a computer readable storage medium, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the steps in the video playing method provided by the embodiment of the application.
In addition, the embodiment of the application also provides a computer program product, which comprises a computer program, and the computer program realizes the steps in the video playing method provided by the embodiment of the application when being executed by a processor.
The embodiment of the application provides a video playing method and related equipment, which can establish a communication channel for connecting first electronic equipment and second electronic equipment; obtaining a sharing playing request of target videos of the first electronic equipment and the second electronic equipment; triggering the first electronic equipment and the second electronic equipment to play the target video according to the sharing play request; transmitting a first playing progress of the target video on the first electronic device to the second electronic device through the communication channel, so that the second electronic device compares the first playing progress with a second playing progress of the target video on the second electronic device; when the comparison result of the first playing progress and the second playing progress does not meet the preset condition, triggering the adjustment of the playing progress of the target video in the second electronic equipment so that the first electronic equipment and the second electronic equipment synchronously play the target video.
According to the method and the system for synchronously playing the target video on the first electronic equipment and the second electronic equipment, synchronous playing of the target video on the first electronic equipment and the second electronic equipment can be controlled based on the playing progress, so that the second electronic equipment can be used as a complementary viewing equipment of the first electronic equipment, although video playing capabilities of different electronic equipment are poor, the target video can be displayed in a collaborative sharing mode by combining the playing capabilities of different electronic equipment, and better viewing experience can be brought to users.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1a is a schematic view of a video playing method according to an embodiment of the present application;
fig. 1b is a flowchart of a video playing method according to an embodiment of the present application;
fig. 2a is another flowchart of a video playing method according to an embodiment of the present application;
fig. 2b is another explanatory diagram of a video playing method according to an embodiment of the present application;
fig. 2c is another explanatory diagram of a video playing method according to an embodiment of the present application;
fig. 2d is another explanatory diagram of a video playing method according to an embodiment of the present application;
fig. 3a is a schematic structural diagram of a video playing device according to an embodiment of the present application;
fig. 3b is a schematic structural diagram of a video playing device according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a computer device according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to fall within the scope of the application.
Embodiments of the present application provide a video playing method and related devices, which may include video playing apparatuses, computer devices, computer readable storage media, and computer program products.
Specifically, the embodiment of the application provides a video playing device suitable for a first electronic device, wherein the first electronic device can be a terminal and other devices, such as a television and the like; the embodiment of the application also provides a video playing device suitable for the second electronic equipment, wherein the second electronic equipment can be equipment such as a terminal and the like, such as a mobile phone, a tablet personal computer, a notebook computer and the like. The terminal may also be provided with a client, which may be a video client, a streaming client, or a browser client, etc.
The video playing method provided by the application can be applied to an application environment such as a field Jing Suoshi in fig. 1 a. The video playing system includes a first electronic device 110, a second electronic device 120 and a server 130, where the first electronic device 110 and the second electronic device 120 are connected through a network, and the first electronic device 110 and the server 130, and the second electronic device 120 and the server 130 are also connected through a network, for example, through a wired or wireless network connection, etc. In one embodiment, the first electronic device 110 may establish a communication channel with the second electronic device; obtaining a sharing playing request of target videos of the first electronic equipment and the second electronic equipment; triggering the first electronic equipment and the second electronic equipment to play the target video according to the sharing play request; transmitting a first playing progress of the target video on the first electronic device to the second electronic device through the communication channel, so that the second electronic device compares the first playing progress with a second playing progress of the target video on the second electronic device; when the comparison result of the first playing progress and the second playing progress does not meet the preset condition, triggering the adjustment of the playing progress of the target video in the second electronic equipment so that the first electronic equipment and the second electronic equipment synchronously play the target video.
Wherein the second electronic device 120 may be configured to: establishing a communication channel connected with a first electronic device; obtaining a sharing playing request of target videos of the first electronic equipment and the second electronic equipment; triggering the first electronic equipment and the second electronic equipment to play the target video according to the sharing play request; receiving a first playing progress of the target video sent by the first electronic device through the communication channel on the first electronic device; comparing the first playing progress with a second playing progress of the target video on the second electronic equipment; and when the comparison result of the first playing progress and the second playing progress does not meet the preset condition, adjusting the playing progress of the target video in the second electronic equipment so as to enable the first electronic equipment and the second electronic equipment to synchronously play the target video.
Wherein the server 130 may be configured to: based on the shared play request for the target video, the target video is sent to the first electronic device 110 or the second electronic device 120, so that the first electronic device 110 and the second electronic device 120 play the target video synchronously. The server 130 may be an independent physical server, or may be a server cluster or a distributed system or a cloud server formed by a plurality of physical servers.
The following will describe in detail. The following description of the embodiments is not intended to limit the preferred embodiments.
It will be appreciated that in the specific embodiments of the present application, related data such as user information is involved, and when the above embodiments of the present application are applied to specific products or technologies, user permissions or consents need to be obtained, and the collection, use and processing of related data need to comply with related laws and regulations and standards of related countries and regions.
As shown in fig. 1b, an embodiment of the present application provides a video playing method, which may be performed by a computer device, where the computer device may be a first electronic device or a server. In the embodiment of the application, the video playing method is described by taking the embodiment of the first electronic equipment as an example. The specific flow of the video playing method can be as follows:
101. establishing a communication channel for connecting the first electronic device with the second electronic device; and obtaining a shared play request of the target video of the first electronic device and the second electronic device.
In this embodiment, the first electronic device may establish a communication channel connected to the second electronic device, and through the establishment of the communication channel, the first electronic device may be bound to the second electronic device.
The first electronic device may act as a master device, and the second electronic device may act as a slave device, which may be considered as a complementary device to the master device. In a specific scene, the first electronic device may be a television or the like, the second electronic device may be a mobile phone, and the user may play video through the television to enjoy the large-screen viewing and use the mobile phone carried with the user to perform the supplementary viewing.
It should be noted that the second electronic device may be one or more, that is, the first electronic device may establish a communication connection with one second electronic device, or may establish communication connections with a plurality of second electronic devices, which is not limited in this embodiment.
Specifically, when a plurality of persons watch a video through the television, each person can use a mobile phone carried by the person to establish connection with the television, so that the cooperative play between the television and the plurality of mobile phones is performed.
The target video may be any type of video, and the duration of the video is not limited.
The shared play request is specifically a request for requesting the first electronic device and the second electronic device to perform collaborative play of the target video. Here co-play can be understood as simultaneous play.
In some embodiments, the shared play request may be generated by the user directly performing a request operation on the first electronic device, and then, the first electronic device sends the shared play request to the second electronic device through the established communication channel.
In other embodiments, the shared play request may be generated by the user directly performing a request operation on the second electronic device, and then the second electronic device sends the shared play request to the first electronic device through the established communication channel, so that the first electronic device obtains the shared play request.
102. And triggering the first electronic equipment and the second electronic equipment to play the target video according to the sharing play request.
In some embodiments, if the shared play request is generated in the first electronic device, the first electronic device may send the shared play request to the second electronic device, so that the second electronic device plays the target video based on the shared play request, and meanwhile, the first electronic device may play the target video based on the shared play request.
In other embodiments, if the shared play request is generated in the second electronic device, the second electronic device may send the shared play request to the first electronic device, so that the first electronic device plays the target video based on the shared play request, and meanwhile, the second electronic device may play the target video based on the shared play request.
Optionally, in this embodiment, the step of "triggering, according to the sharing playing request, the first electronic device and the second electronic device to play the target video" may include:
triggering the first electronic equipment to select a first video code stream corresponding to the first electronic equipment from a video code stream set of the target video according to the sharing playing request, wherein the video code stream set comprises at least two video code streams;
playing the target video in the first electronic device based on the first video code stream;
triggering the second electronic equipment to select a second video code stream corresponding to the second electronic equipment from the video code stream set of the target video according to the sharing playing request;
and playing the target video in the second electronic equipment based on the second video code stream.
The video code stream set of the target video is specifically namely a master manifest file of the target video, which contains one or more sub-manifest files, and each sub-manifest file is also a video code stream. Specifically, the encoding parameters of different video code streams are different, or the corresponding video shooting angles are different.
In particular, in order to cope with conditions such as diversity equipment and diversity network at the user side, internet video service providers generally encode the same video source into different levels of sources according to quality. For example, a range of from 270p to 1080p SDR may be provided in terms of resolution, luminance dynamic range, up to a maximum of 1080p HDR, 4k 60fps tile source, such grading providing an adaptive choice of screen size, display capability, user available bandwidth, and targeted distribution at the time of user play.
Optionally, in this embodiment, the video code stream set includes mapping relationships between preset device configuration information and video code streams under preset coding parameters;
the step of triggering the first electronic device to select a first video code stream corresponding to the first electronic device from the video code stream set of the target video according to the sharing playing request may include:
selecting a first video code stream corresponding to the first electronic device from a video code stream set of the target video based on the device configuration information of the first electronic device according to the shared play request;
the step of triggering the second electronic device to select a second video code stream corresponding to the second electronic device from the video code stream set of the target video according to the sharing playing request may include:
And triggering the second electronic equipment to select a second video code stream corresponding to the second electronic equipment from the video code stream set of the target video based on the equipment configuration information according to the sharing play request.
The device configuration information may characterize the hardware capability of the device, and may specifically include chip decoding capability, display capability such as screen brightness dynamic range and color gamut coverage.
The coding parameters may include parameters such as a sampling rate of the video frame and a sampling rate of the pixel point.
Optionally, in this embodiment, the video code streams in the video code stream set include at least one video slice, the number of video slices of each video code stream is the same, and the duration corresponding to the video slices in the same arrangement sequence in each video code stream is the same;
the step of playing the target video in the first electronic device based on the first video code stream may include:
playing the target video in the first electronic equipment according to the sequence of video slicing in the first video code stream;
the step of playing the target video in the second electronic device based on the second video code stream may include:
And playing the target video in the second electronic equipment according to the sequence of video slicing in the second video code stream.
The video code stream may include one or more video slices, and the duration of each video slice in the video code stream may be different, and the arrangement order of the video slices in the video code stream may be determined based on the playing time of the video slices, for example, the video slices with the front playing time are arranged in front, and the video slices with the rear playing time are arranged in rear. Specifically, the duration of video slicing may be set to about 2 seconds, where video slicing is a video slice with a shorter duration.
The number of video fragments contained in different video code streams is the same, and the duration corresponding to the video fragments with the same arrangement sequence in different video code streams is the same. For example, the target video has two video streams, namely a master stream and a slave stream, and if the master stream contains 10 video slices, the slave stream also contains 10 video slices, and if a video slice corresponding to a certain 2 second video slice in the master stream is the 8 th video slice, a video slice corresponding to the 8 th video slice in the slave stream is the 2 second video slice. The number and the sequence of the video clips in each video code stream are limited, so that different electronic devices can keep the synchronization of the played content when playing the target video based on different video code streams.
Optionally, in this embodiment, a play time point for the same video content in each video bitstream of the video bitstream set is the same.
The time axes of different video code streams need to be aligned strictly, so that the first electronic device and the second electronic device can be ensured to realize synchronous playing.
103. And sending the first playing progress of the target video on the first electronic equipment to the second electronic equipment through the communication channel, so that the second electronic equipment compares the first playing progress with the second playing progress of the target video on the second electronic equipment.
The first playing progress may specifically be a timestamp of audio and video data being rendered by the current code stream in the first electronic device. The second playing progress may be a timestamp of audio and video data being rendered by the current code stream in the second electronic device.
Specifically, the first electronic device may send the first playing progress to the second electronic device in real time, so that the second electronic device compares the first playing progress with the second playing progress of the target video on the second electronic device in real time. The real-time transmission may specifically be that a first playing progress at the current moment is transmitted at intervals of a preset time period, and the real-time comparison may specifically be that the first playing progress which is newly transmitted by the first electronic device is compared with a second playing progress at the current moment at intervals of the preset time period; the preset time period may be set according to the actual situation, for example, may be set to 1 second or may be set to 2 seconds, which is not particularly limited in this embodiment.
104. When the comparison result of the first playing progress and the second playing progress does not meet the preset condition, triggering the adjustment of the playing progress of the target video in the second electronic equipment so that the first electronic equipment and the second electronic equipment synchronously play the target video.
The preset condition may be set according to practical situations, which is not limited in this embodiment. Specifically, the preset condition may be set such that an absolute value of a progress deviation of the first play progress and the second play progress is smaller than a certain threshold.
It should be noted that, in the process of comparing the first playing progress and the second playing progress, the first electronic device may send a new first playing progress to the second electronic device, or after the first playing progress and the second playing progress are compared, that is, after the comparison result is obtained, the first electronic device sends the new first playing progress to the second electronic device, where the sending time of the new first playing progress may be set according to the actual situation, and specifically relates to the preset time period sent in real time in the foregoing embodiment.
Specifically, if the comparison result of the first playing progress and the second playing progress meets the preset condition, the playing progress of the target video in the second electronic device does not need to be adjusted at present, and whether the playing progress of the target video in the second electronic device needs to be adjusted next is determined according to the new round of playing progress comparison result. Specifically, the first electronic device may continuously send a new first playing progress to the second electronic device, and the latest first playing progress and the corresponding new second playing progress may be compared to determine whether the playing progress of the target video in the second electronic device needs to be adjusted. If the playing progress of the first electronic device and the playing progress of the second electronic device are always synchronous, the synchronous playing of the target video by the first electronic device and the second electronic device are indicated, and the playing progress is not required to be adjusted.
Optionally, in this embodiment, the step of "triggering adjustment of the playing progress of the target video in the second electronic device to enable the first electronic device and the second electronic device to synchronously play the target video" may include:
determining estimated position information of a target video frame corresponding to a first playing progress in a video frame sequence of the target video according to a time stamp corresponding to the first playing progress;
sequentially identifying key frames in the video frame sequence by taking the estimated position information as a starting point;
when a key frame is identified, determining target position information of a target video frame in the video frame sequence according to a time stamp corresponding to the key frame and a time stamp corresponding to the first playing progress;
and triggering the adjustment of the playing progress of the target video in the second electronic equipment based on the target position information, so that the first electronic equipment and the second electronic equipment synchronously play the target video.
The target video frame corresponding to the first playing progress, that is, the video frame to be skipped to play of the target video in the second electronic device, can skip the target video in the second electronic device from the current playing video frame to the position where the target video frame is located to start playing after the adjustment of the playing progress.
In the video playing process, the video jumps from one time point to another time point, and the video is directly played from the other time point, which may be called Seek (search), and the video frame corresponding to the jumped another time point may be regarded as a target video frame, and the target video frame may also be called Seek.
In particular, video frames in the target video may be divided into I frames, P frames, and B frames. The I frame is also called a key frame, and is an intra-frame coded image for compressing the transmission data volume by removing the image space redundant information as far as possible; p-frames are coded pictures that compress the amount of transmission data by sufficiently reducing the temporal redundancy information of previously coded frames in a sequence of pictures, which can be predicted from the P-frames or I-frames preceding it, also called predicted frames; b frames are coded pictures, also called bi-predictive frames, that compress the amount of transmission data taking into account both temporal redundancy information with the coded frame preceding the source picture sequence and the coded frame following the source picture sequence.
The video frame sequence of the target video is specifically a video data stream corresponding to the target video, and the video data stream may include video frame data packets corresponding to each video frame in the target video. Specifically, video frame packets in a video data stream may be arranged according to time information corresponding to each video frame.
Optionally, in this embodiment, the step of determining the target position information of the target video frame in the video frame sequence according to the timestamp corresponding to the key frame and the timestamp corresponding to the first playing progress may include:
and when the time difference between the time stamp corresponding to the key frame and the time stamp corresponding to the first playing progress is smaller than a preset value, determining target position information of the target video frame in the video frame sequence based on the position information of the key frame in the video frame sequence.
The preset value may be set according to actual situations, for example, the preset value may be an I-frame interval, which is an average difference between display timestamps of two I frames in a video.
And when the time difference between the time stamp corresponding to the key frame and the time stamp corresponding to the first playing progress is smaller than a preset value, the position information of the key frame in the video frame sequence can be used as the target position information of the target video frame in the video frame sequence.
After the target position information is determined, the playing progress of the target video in the second electronic device can be adjusted to the first playing progress, so that the first electronic device and the second electronic device can be ensured to synchronously play the target video.
The application scenario of the video playing method provided by the application can be suitable for playing any video program, such as a large-screen television, and intelligent mobile equipment serving as a slave equipment for capability sharing, including but not limited to: a mobile phone, a tablet computer, etc. The application uses the cooperative sharing mode of two devices, so that the application strengths of the two devices are utilized simultaneously, the large-screen immersive playing experience is realized, and the high-quality viewing experience brought by the novel video technologies such as HDR (high dynamic range), WCG (wide color gamut), HFR (high frame rate) and the like can be enjoyed.
As can be seen from the above, the present embodiment can establish a communication channel in which the first electronic device is connected to the second electronic device; obtaining a sharing playing request of target videos of the first electronic equipment and the second electronic equipment; triggering the first electronic equipment and the second electronic equipment to play the target video according to the sharing play request; transmitting a first playing progress of the target video on the first electronic device to the second electronic device through the communication channel, so that the second electronic device compares the first playing progress with a second playing progress of the target video on the second electronic device; when the comparison result of the first playing progress and the second playing progress does not meet the preset condition, triggering the adjustment of the playing progress of the target video in the second electronic equipment so that the first electronic equipment and the second electronic equipment synchronously play the target video.
According to the method and the system for synchronously playing the target video on the first electronic equipment and the second electronic equipment, synchronous playing of the target video on the first electronic equipment and the second electronic equipment can be controlled based on the playing progress, so that the second electronic equipment can be used as a complementary viewing equipment of the first electronic equipment, although video playing capabilities of different electronic equipment are poor, the target video can be displayed in a collaborative sharing mode by combining the playing capabilities of different electronic equipment, and better viewing experience can be brought to users.
As shown in fig. 2a, an embodiment of the present application provides a video playing method, which may be performed by a computer device, where the computer device may be a second electronic device or a server. In the embodiment of the application, the video playing method is described by taking the implementation of the second electronic device as an example. The video playing method comprises the following specific processes:
201. establishing a communication channel for connecting the first electronic device with the second electronic device; and obtaining a shared play request of the target video of the first electronic device and the second electronic device.
In this embodiment, the second electronic device may establish a communication channel connected to the first electronic device, and the first electronic device may be bound to the second electronic device by establishing the communication channel.
The first electronic device may act as a master device, and the second electronic device may act as a slave device, which may be considered as a complementary device to the master device. In a specific scene, the first electronic device may be a television or the like, the second electronic device may be a mobile phone, and the user may play video through the television to enjoy the large-screen viewing and use the mobile phone carried with the user to perform the supplementary viewing.
The target video may be any type of video, and the duration of the video is not limited.
The shared play request is specifically a request for requesting the first electronic device and the second electronic device to perform collaborative play of the target video. Here co-play can be understood as simultaneous play.
In some embodiments, the shared play request may be generated by the user directly performing a request operation on the first electronic device, and then, the first electronic device sends the shared play request to the second electronic device through the established communication channel.
In other embodiments, the shared play request may be generated by the user directly performing a request operation on the second electronic device, and then the second electronic device sends the shared play request to the first electronic device through the established communication channel, so that the first electronic device obtains the shared play request.
202. And triggering the first electronic equipment and the second electronic equipment to play the target video according to the sharing play request.
In some embodiments, if the shared play request is generated in the first electronic device, the first electronic device may send the shared play request to the second electronic device, so that the second electronic device plays the target video based on the shared play request, and meanwhile, the first electronic device may play the target video based on the shared play request.
In other embodiments, if the shared play request is generated in the second electronic device, the second electronic device may send the shared play request to the first electronic device, so that the first electronic device plays the target video based on the shared play request, and meanwhile, the second electronic device may play the target video based on the shared play request.
Optionally, in this embodiment, the step of "triggering, according to the sharing playing request, the first electronic device and the second electronic device to play the target video" may include:
triggering the first electronic equipment to select a first video code stream corresponding to the first electronic equipment from a video code stream set of the target video according to the sharing playing request, wherein the video code stream set comprises at least two video code streams;
Playing the target video in the first electronic device based on the first video code stream;
triggering the second electronic equipment to select a second video code stream corresponding to the second electronic equipment from the video code stream set of the target video according to the sharing playing request;
and playing the target video in the second electronic equipment based on the second video code stream.
The video code stream set of the target video is specifically namely a master manifest file of the target video, which contains one or more sub-manifest files, and each sub-manifest file is also a video code stream. Specifically, the encoding parameters of different video code streams are different, or the corresponding video shooting angles are different.
Optionally, in this embodiment, the video code stream set includes mapping relationships between preset device configuration information and video code streams under preset coding parameters;
the step of triggering the first electronic device to select a first video code stream corresponding to the first electronic device from the video code stream set of the target video according to the sharing playing request may include:
selecting a first video code stream corresponding to the first electronic device from a video code stream set of the target video based on the device configuration information of the first electronic device according to the shared play request;
The step of triggering the second electronic device to select a second video code stream corresponding to the second electronic device from the video code stream set of the target video according to the sharing playing request may include:
and triggering the second electronic equipment to select a second video code stream corresponding to the second electronic equipment from the video code stream set of the target video based on the equipment configuration information according to the sharing play request.
The device configuration information may characterize the hardware capability of the device, and may specifically include chip decoding capability, display capability such as screen brightness dynamic range and color gamut coverage.
The coding parameters may include parameters such as a sampling rate of the video frame and a sampling rate of the pixel point.
Optionally, in this embodiment, the video code streams in the video code stream set include at least one video slice, the number of video slices of each video code stream is the same, and the duration corresponding to the video slices in the same arrangement sequence in each video code stream is the same;
the step of playing the target video in the first electronic device based on the first video code stream may include:
playing the target video in the first electronic equipment according to the sequence of video slicing in the first video code stream;
The step of playing the target video in the second electronic device based on the second video code stream may include:
and playing the target video in the second electronic equipment according to the sequence of video slicing in the second video code stream.
The video code stream may include one or more video slices, and the duration of each video slice in the video code stream may be different, and the arrangement order of the video slices in the video code stream may be determined based on the playing time of the video slices, for example, the video slices with the front playing time are arranged in front, and the video slices with the rear playing time are arranged in rear. Specifically, the duration of video slicing may be set to about 2 seconds, where video slicing is a video slice with a shorter duration.
The number of video fragments contained in different video code streams is the same, and the duration corresponding to the video fragments with the same arrangement sequence in different video code streams is the same. For example, the target video has two video streams, namely a master stream and a slave stream, and if the master stream contains 10 video slices, the slave stream also contains 10 video slices, and if a video slice corresponding to a certain 2 second video slice in the master stream is the 8 th video slice, a video slice corresponding to the 8 th video slice in the slave stream is the 2 second video slice. The number and the sequence of the video clips in each video code stream are limited, so that different electronic devices can keep the synchronization of the played content when playing the target video based on different video code streams.
Optionally, in this embodiment, a play time point for the same video content in each video bitstream of the video bitstream set is the same.
The time axes of different video code streams need to be aligned strictly, so that the first electronic device and the second electronic device can be ensured to realize synchronous playing.
203. And receiving a first playing progress of the target video on the first electronic device, wherein the first playing progress is sent by the first electronic device through the communication channel.
Specifically, the first electronic device may send the first playing progress to the second electronic device in real time, where the real-time sending may specifically be sending the first playing progress at the current moment by a preset time period, where the preset time period may be set according to an actual situation, for example, may be set to 1 second or may be set to 2 seconds, which is not limited in this embodiment specifically.
204. And comparing the first playing progress with a second playing progress of the target video on the second electronic equipment.
The first playing progress may specifically be a timestamp of audio and video data being rendered by the current code stream in the first electronic device. The second playing progress may be a timestamp of audio and video data being rendered by the current code stream in the second electronic device.
Specifically, the second electronic device may compare the first playing progress with the second playing progress of the target video on the second electronic device in real time. The real-time comparison may be that the first playing progress sent by the first electronic device and the second playing progress at the current moment are compared at intervals of a preset time period; the preset time period may be set according to the actual situation, for example, may be set to 1 second or may be set to 2 seconds, which is not particularly limited in this embodiment.
205. And when the comparison result of the first playing progress and the second playing progress does not meet the preset condition, adjusting the playing progress of the target video in the second electronic equipment so as to enable the first electronic equipment and the second electronic equipment to synchronously play the target video.
The preset condition may be set according to practical situations, which is not limited in this embodiment. Specifically, the preset condition may be set such that an absolute value of a progress deviation of the first play progress and the second play progress is smaller than a certain threshold.
Optionally, in this embodiment, the step of adjusting the playing progress of the target video in the second electronic device to enable the first electronic device and the second electronic device to synchronously play the target video may include:
Determining estimated position information of a target video frame corresponding to a first playing progress in a video frame sequence of the target video according to a time stamp corresponding to the first playing progress;
sequentially identifying key frames in the video frame sequence by taking the estimated position information as a starting point;
when a key frame is identified, determining target position information of a target video frame in the video frame sequence according to a time stamp corresponding to the key frame and a time stamp corresponding to the first playing progress;
and adjusting the playing progress of the target video in the second electronic equipment based on the target position information so as to enable the first electronic equipment and the second electronic equipment to synchronously play the target video.
The target video frame corresponding to the first playing progress, that is, the video frame to be skipped to play of the target video in the second electronic device, can skip the target video in the second electronic device from the current playing video frame to the position where the target video frame is located to start playing after the adjustment of the playing progress.
In the video playing process, the video jumps from one time point to another time point, and the video is directly played from the other time point, which may be called Seek (search), and the video frame corresponding to the jumped another time point may be regarded as a target video frame, and the target video frame may also be called Seek.
Optionally, in this embodiment, the step of determining the target position information of the target video frame in the video frame sequence according to the timestamp corresponding to the key frame and the timestamp corresponding to the first playing progress may include:
and when the time difference between the time stamp corresponding to the key frame and the time stamp corresponding to the first playing progress is smaller than a preset value, determining target position information of the target video frame in the video frame sequence based on the position information of the key frame in the video frame sequence.
The preset value may be set according to actual situations, for example, the preset value may be an I-frame interval, which is an average difference between display timestamps of two I frames in a video.
And when the time difference between the time stamp corresponding to the key frame and the time stamp corresponding to the first playing progress is smaller than a preset value, the position information of the key frame in the video frame sequence can be used as the target position information of the target video frame in the video frame sequence.
After the target position information is determined, the playing progress of the target video in the second electronic device can be adjusted to the first playing progress, so that the first electronic device and the second electronic device can be ensured to synchronously play the target video.
Optionally, in this embodiment, the video playing method may further include:
based on the switching operation of the playing view angle of the target video, acquiring a target video code stream corresponding to the switched target playing view angle;
and switching the currently played video code stream into the target video code stream, and continuously displaying the target video at the target playing view angle based on the current playing progress of the target video.
Specifically, the video code stream set of the target video may provide video code streams under various play angles. In this embodiment, a video play view angle selection area may be displayed on a play page of a target video in the second electronic device, where the video play view angle selection area may include a plurality of play view angle selection controls, and a user may click or slide the target play view angle selection controls, so that the play view angle may be switched.
Optionally, in this embodiment, the video playing method may further include:
displaying the target video in a preset interaction mode based on the playing content information of the target video;
acquiring object interaction operation information aiming at a target video in the preset interaction mode;
And displaying the interaction result corresponding to the object interaction operation information on the playing page of the target video.
The preset interaction mode may include a question-answer interaction mode, and the embodiment is not limited thereto. In some embodiments, when the target video is played to a certain video clip, question-answer interaction information may be displayed on a playing page, and the object interaction operation information may be an operation performed by a user on the question-answer interaction information.
Specifically, in the process of playing the target video cooperatively by the first electronic device and the second electronic device, if the first electronic device cannot interact in the video playing process due to lower device configuration, the second electronic device can be used as a supplementary device for interaction, so that the problem that the first electronic device cannot interact is solved.
The application provides a playing enhancement method and a playing enhancement system based on equipment capability sharing, which can effectively solve the problem of video capability dispersion caused by different equipment replacement periods, and can meet the problem of insufficient viewing experience of old and old televisions with longer service periods.
In particular, some users have a strong demand for large-size, immersive or simultaneous viewing by multiple persons, so viewing using a television is still one of the mainstream viewing modes. But limited by the long television update period, the historical stock of devices used by users tend to be significantly lower in hardware capabilities (e.g., decoding display capabilities) than the state of the art. For example, some tv sets cannot support 4K in physical pixel density, cannot support HDR encoding slice source in highest brightness and dynamic range, cannot support slice source in screen refresh frame rate of 60fps or higher, so that lower quality slice sources are distributed to old equipment video service providers, and when the tv set does not support 4K, HDR, HFR, 1080p SDR (Standard Dynamic Range ) slice sources are distributed at most, so that users can enjoy immersion feeling due to large physical size while watching video with the tv set, but cannot experience more excellent image quality characteristics such as HDR, HFR, etc. The application solves the problem that the old equipment can only play the low-quality code stream, so that the user cannot enjoy the high-quality film source such as HDR, WCG, HFR.
The application creatively provides a television and a mobile phone to synchronously watch the video in a cooperative sharing mode, wherein the television meets the requirement of watching the video simultaneously by large size, immersion or multiple persons, and the mobile phone is used as cooperative supplementary equipment to provide high-quality film source experience such as HDR, WCG, HFR.
Because the television is still one of the mainstream video scenes at present, a large number of old and old devices cannot play high-quality video film sources, and the commercial enthusiasm of developing higher-quality audio and video products at the upstream and downstream of an industrial chain can be influenced, so that the development of the industry is delayed as a whole. The application can supplement high-quality experience by utilizing the mobile phone, break the limit of old equipment on the upstream and downstream development of an industrial chain, and maintain the commercial enthusiasm of the industry on high-quality audio and video products, thereby promoting the development of the whole industry.
In a specific embodiment, as shown in fig. 2b, the video playing system of the present application may include a master playing module, a slave playing module, a master-slave binding module, a master playing progress obtaining module, and a slave playing progress controlling module, where the functions of the respective modules are as follows:
s1: the main device playing module is responsible for playing the video code stream coming from the server on the main device, where the main device specifically refers to a terminal device capable of providing a large-size screen and immersive playing experience, and is generally a television set with a large-size screen, as shown in fig. 1a, and the first electronic device is shown in fig. 1 a.
In particular, due to factors such as purchasing habits of users, the update period of the television is significantly longer than that of the mobile phone, which makes a large number of historical stock televisions not having the current latest video capabilities, for example: HDR, WCG, HFR, etc. To accommodate the limited capabilities of such devices, video service providers often distribute low quality video streams.
S2: the slave device playing module is responsible for playing the video code stream from the server on the slave device, where the slave device specifically refers to a mobile phone with a smaller screen size than the S1 master device, and is a second electronic device shown in fig. 1 a.
Particularly, due to factors such as purchasing habit of users, the updating period of the mobile phone is obviously shorter than that of the S1 main equipment, so that the mobile phone generally has the capability of updating more complete video decoding display, including HDR, WCG, HFR and the like, and the equipment can play high-quality video code streams provided by video service providers.
S3: and the master-slave device binding module is used for realizing communication signaling intercommunication between the two devices. Specifically, the DLNA (DIGITAL LIVING NETWORK ALLIANCE), airPlay, miracast and other public protocols can all implement connection of devices, or TCP (Transmission Control Protocol ), UDP (User Datagram Protocol, user datagram protocol) and other public protocols can also be used to implement connection, and the implementation of the connection is strongly associated with actual service development.
S4: and a main equipment playing progress module is obtained, the playing progress is obtained by a player running on the S1 in a certain period (such as 1 second, 5 seconds and the like, which can be determined according to specific service), and the playing progress is sent to the S5 by an inter-equipment signaling channel established in the S3. The playing progress can be obtained by taking the time stamp of the audio and video data being rendered by the current code stream as the reference, and the program realizes strong correlation with the actual service development.
S5: and controlling a slave device playing progress module, comparing the playing progress sent by the S4 with the playing progress on the S2, and if the absolute value of the progress deviation of the two exceeds a certain threshold value, performing forward or backward seek operation on the playing progress of the S2. The implementation of the seek operation can address and locate the audio and video frames in the media file by taking the timestamp which needs seek as a reference, and the media file which is widely used at present can find the audio and video frame timestamp with the smallest error with the timestamp which needs seek because the management mechanism of the audio and video frame timestamp is provided for the media file which needs seek at present, and jump points with the media file. If the audio and video frames are key frames, the audio and video frames can be directly seek; otherwise, the last key frame is skipped and then the target time stamp is decoded by sequence.
For the code stream distribution of the master device and the slave device, for compatibility and utilization of the existing streaming media transmission and distribution architecture, the present embodiment may utilize a manifest file as in HLS (HTTP Live Streaming, HTTP-based media streaming protocol) for unified distribution for the master device and the slave device. Taking HLS protocol as an example, the master manifest file may contain all the level videos of the video service provider, and mark the code stream applicable to the master device and several code streams applicable to the slave devices, as shown in fig. 2 c. The main code stream can be a video with better compatibility, which is applicable to the generation of the coding parameters of the old equipment, and the auxiliary code stream is a code stream coded by using the latest video characteristics, which is applicable to the playing of the new equipment. When the video service provider generates the above-mentioned different-level code streams, although the coding parameters are different (such as the file data pieces in the sub-manifest file shown in fig. 2 c), the time axis alignment must be strictly aligned, so that synchronous playing can be realized although the playing addresses acquired by the master and slave devices are different.
Wherein, specifically, the master manifest file may include at least one video bitstream, as shown in the video bitstream manifest file schematic diagram of fig. 2c, the master manifest file may include a bitstream manifest file address corresponding to a master bitstream, a slave bitstream 0, a slave bitstream 1, and the like, and specifically, the master manifest file may include a master bitstream manifest file address, a slave bitstream manifest 0 file address, and a slave bitstream manifest 1 file address; based on the address of the code stream manifest file, a sub-manifest file corresponding to the corresponding code stream may be obtained, where each sub-manifest file may include attribute information (such as duration and address) of at least one file data slice, and according to the attribute information, the corresponding video code stream may be obtained.
The video playing method provided by the application can realize the capability cooperative sharing of the master device and the slave device, and distributes the main code stream shown in the figure 2c to the television with weaker capability and the slave code stream (possibly more than 1 channel) to the mobile phone with stronger capability, so that the user can utilize the portable mobile phone to carry out supplementary video viewing while watching the video on the large-screen television, and experience the high-quality video viewing experience brought by the latest video technology and characteristics, which is not provided by the old and old television.
TABLE 1
As shown in table 1, the following play enhancement can be achieved by using the present application, which is a collocation example of the encoding parameters of the master-slave code stream:
example 1: the main code stream is an 8bits SDR chip source coded by H.264/AVC, the frame rate is 25fps conventional frame rate, the compatibility is good, and the method is suitable for old equipment in stock. From a 10bits HDR10 slice source where the stream is H.265/HEVC encoded, the frame rate is 25fps conventional. The HEVC coding format and the 10bits HDR capability all need newer equipment capability, so the method is suitable for mobile phones, and the HDR can provide brightness and color experience which are obviously superior to SDR.
Example 2: the main code stream is an 8bits SDR chip source coded by H.264/AVC, the frame rate is 25fps conventional frame rate, the compatibility is good, and the method is suitable for old equipment in stock. From the 8bits SDR slice source of the H.265/HEVC code of the code stream 0, the frame rate is 50fps high frame rate, and the shooting angle of the picture is the deviation of-90 degrees of the main view angle (based on the main code stream). The 8bits SDR source coded by H.265/HEVC is used as the secondary code stream 1, the frame rate is 50fps high frame rate, and the shooting angle of a picture is the main view angle (based on the main code stream) and is deviated by 60 degrees. The HEVC coding format has the advantages that the decoding capability of 50fps needs newer equipment capability, so that the HEVC coding format is suitable for mobile phones, the higher frame rate can provide smoother motion picture quality experience than the conventional frame rate, in addition, 2 times of video streams can provide different shooting angles, users can select the video streams, and the video viewing experience is more in multiple angles.
Example 3: the main code stream is an 8bits SDR chip source coded by H.264/AVC, the frame rate is 25fps conventional frame rate, the compatibility is good, and the method is suitable for old equipment in stock. From the 10bits HDR10 slice source where the stream is H.265/HEVC encoded, the frame rate is 60fps high frame rate. The HEVC coding format, the capability of 10bits HDR and 60fps high frame rate decoding all need newer equipment capability, so the HEVC coding format is suitable for mobile phones, the HDR can provide brightness and color experience which is obviously superior to SDR, and the high frame rate provides smoother motion picture quality experience.
The present embodiment provides the above several collocations and combinations to illustrate how to construct differentiated code streams and how to implement play enhancement among multiple devices, and obviously, there may be more ways for specific business practice. However, the implementation of the present application does not affect the implementation of the overall scheme of the present application, so similar arrangements should be regarded as the technical scope described in the present application, and will not be repeated.
The application provides a playing enhancement method and a playing enhancement system based on equipment capability sharing, which can solve the problem of hardware capability dispersion caused by the difference of updating periods of two kinds of equipment of a television and a mobile phone, realize the existing large-screen immersive playing experience, and also can enjoy the high-quality viewing experience brought by new video technologies such as HDR, WCG, HFR and the like.
In a specific scenario, for the master device playing or slave device playing link shown in fig. 2b, an implementation flow of the corresponding player is shown in fig. 2d, where the implementation flow may relate to a file format parsing module, a progress control module, a video data decoding module, an image rendering module, an audio decoding module, a sound rendering module, a sound and picture synchronization control module, and the specific descriptions of the modules are as follows:
a1: the file format analysis module is responsible for acquiring a playing video file from a server, downloading the playing video file into a playing device system after network transmission, and analyzing the playing video file into a video data stream and an audio data stream according to a video file format specification. In general, video files may be transmitted through the CDN, and the file transfer protocol may be: HTTP, RTSP, HLS, etc.
A2: the progress control module is used for realizing the seek operation possibly performed on the playing progress in the playing process so as to ensure the unification and the calibration of the playing progress of the master device and the slave device, and the specific implementation principle is referred to the description of the above embodiment and is not repeated here.
A3: and the video data decoding module is used for obtaining the original image data and descriptive data associated with the current image frame after using the corresponding decoder for the video data stream output by the A1. Wherein video decoding is the inverse of video encoding.
A4: and the image rendering module is used for displaying the original image data decoded and output by the A3 through the peripheral equipment.
A5: and the audio decoding module is used for obtaining the original sound data after the audio data stream output by the A1 is used by the corresponding decoder. Wherein audio decoding is the inverse of audio encoding.
A6: and the sound rendering module is used for displaying the original sound data decoded and output by the A5 through the peripheral equipment.
A7: the audio-video synchronization control module compares the time stamps of the current image and the sound frame rendered by the A4 and the A6, and if the deviation between the current image and the sound frame is smaller than a certain range, the user can be determined to view the audio-video synchronization experience at the moment without other processing; if the sound and picture are not synchronous, the image or sound data which is too slow can be discarded (i.e. the rendering is skipped), or the image or sound data which is too fast can be delayed to be rendered.
The application provides a playing enhancement method and a playing enhancement system based on equipment capability sharing, which meet the user requirements of large-screen television video watching and utilize mobile phones which are often carried by hand to play respective equipment capability long plates. The television with slow updating and low capability plays the advantages of screen size, satisfies the large-screen immersive viewing experience, and the mobile phone with fast updating and high capability plays the advantages of hardware decoding and high display capability, and plays the same source in a synchronous and real-time mode, so that the mobile phone capability is shared for a television viewer in a collaborative mode. As described above, the scheme provided by the application effectively smoothes the capability spread among devices so as to create a novel cooperative sharing mode, exert the respective advantages of the television and the mobile phone, and provide large-size, immersive and high-quality viewing experience for users.
As can be seen from the above, the present embodiment can establish a communication channel in which the first electronic device is connected to the second electronic device; obtaining a sharing playing request of target videos of the first electronic equipment and the second electronic equipment; triggering the first electronic equipment and the second electronic equipment to play the target video according to the sharing play request; receiving a first playing progress of the target video sent by the first electronic device through the communication channel on the first electronic device; comparing the first playing progress with a second playing progress of the target video on the second electronic equipment; and when the comparison result of the first playing progress and the second playing progress does not meet the preset condition, adjusting the playing progress of the target video in the second electronic equipment so as to enable the first electronic equipment and the second electronic equipment to synchronously play the target video.
According to the method and the system for synchronously playing the target video on the first electronic equipment and the second electronic equipment, synchronous playing of the target video on the first electronic equipment and the second electronic equipment can be controlled based on the playing progress, so that the second electronic equipment can be used as a complementary viewing equipment of the first electronic equipment, although video playing capabilities of different electronic equipment are poor, the target video can be displayed in a collaborative sharing mode by combining the playing capabilities of different electronic equipment, and better viewing experience can be brought to users.
In order to better implement the method, the embodiment of the application also provides a video playing system. The video playback system comprises a first video playback device 31 and a second video playback device 32. As shown in fig. 3a, the first video playback device 31 may include a first establishing unit 3101, a first triggering unit 3102, a transmitting unit 3103, and a first adjusting unit 3104; as shown in fig. 3b, the second video playing device 32 may include a second establishing unit 3201, a second triggering unit 3202, a receiving unit 3203, a comparing unit 3204 and a second adjusting unit 3205, as follows:
A. first video playing device 31
(1) A first establishing unit 3101;
the first establishing unit is used for establishing a communication channel for connecting the first electronic equipment with the second electronic equipment; and obtaining a shared play request of the target video of the first electronic device and the second electronic device.
(2) A first trigger unit 3102;
and the first triggering unit is used for triggering the first electronic equipment and the second electronic equipment to play the target video according to the sharing play request.
Optionally, in some embodiments of the present application, the first trigger unit may include a first trigger subunit, a first playing subunit, a second trigger subunit, and a second playing subunit, as follows:
The first triggering subunit is configured to trigger, according to the shared play request, the first electronic device to select a first video code stream corresponding to the first electronic device from a video code stream set of the target video, where the video code stream set includes at least two video code streams;
a first playing subunit, configured to play the target video in the first electronic device based on the first video code stream;
the second triggering subunit is used for triggering the second electronic equipment to select a second video code stream corresponding to the second electronic equipment from the video code stream set of the target video according to the sharing playing request;
and the second playing subunit is used for playing the target video in the second electronic equipment based on the second video code stream.
Optionally, in some embodiments of the present application, the video code stream set includes a mapping relationship between preset device configuration information and a video code stream under preset coding parameters;
the first triggering subunit may be specifically configured to select, according to the shared play request, a first video code stream corresponding to the first electronic device from a video code stream set of the target video based on device configuration information of the first electronic device;
The second triggering subunit may specifically be configured to trigger, according to the shared play request, the second electronic device to select, based on device configuration information of the second electronic device, a second video code stream corresponding to the second electronic device from the video code stream set of the target video.
Optionally, in some embodiments of the present application, the video code streams in the video code stream set include at least one video slice, the number of video slices of each video code stream is the same, and the duration corresponding to the video slices in the same arrangement sequence in each video code stream is the same;
the first playing subunit may specifically be configured to play the target video in the first electronic device according to the sequence of video clips in the first video code stream;
the second playing subunit may specifically be configured to play the target video in the second electronic device according to the sequence of video slices in the second video code stream.
Optionally, in some embodiments of the present application, a play time point for the same video content in each video bitstream of the video bitstream set is the same.
(3) A transmission unit 3103;
and the sending unit is used for sending the first playing progress of the target video on the first electronic equipment to the second electronic equipment through the communication channel so that the second electronic equipment compares the first playing progress with the second playing progress of the target video on the second electronic equipment.
(4) A first adjusting unit 3104;
and the first adjusting unit is used for triggering the adjustment of the playing progress of the target video in the second electronic equipment when the comparison result of the first playing progress and the second playing progress does not meet the preset condition, so that the first electronic equipment and the second electronic equipment synchronously play the target video.
B. Second video playing device 32
(5) A second establishing unit 3201;
the second establishing unit is used for establishing a communication channel for connecting the first electronic equipment and the second electronic equipment; and obtaining a shared play request of the target video of the first electronic device and the second electronic device.
(6) A second trigger unit 3202;
and the second triggering unit is used for triggering the first electronic equipment and the second electronic equipment to play the target video according to the sharing play request.
(7) A receiving unit 3203;
the receiving unit is used for receiving a first playing progress of the target video sent by the first electronic device through the communication channel on the first electronic device.
(8) A comparison unit 3204;
and the comparison unit is used for comparing the first playing progress with the second playing progress of the target video on the second electronic equipment.
(9) A second adjusting unit 3205;
and the second adjusting unit is used for adjusting the playing progress of the target video in the second electronic equipment when the comparison result of the first playing progress and the second playing progress does not meet the preset condition, so that the first electronic equipment and the second electronic equipment synchronously play the target video.
Optionally, in some embodiments of the present application, the video playing device may further include a viewing angle switching unit, as follows:
the visual angle switching unit is used for acquiring a target video code stream corresponding to the switched target playing visual angle based on the switching operation of the playing visual angle of the target video; and switching the currently played video code stream into the target video code stream, and continuously displaying the target video at the target playing view angle based on the current playing progress of the target video.
Optionally, in some embodiments of the present application, the video playing device may further include an interaction unit, as follows:
the interaction unit is used for displaying the target video in a preset interaction mode based on the playing content information of the target video; acquiring object interaction operation information aiming at a target video in the preset interaction mode; and displaying the interaction result corresponding to the object interaction operation information on the playing page of the target video.
Optionally, in some embodiments of the present application, the second adjustment unit may include a first determination subunit, an identification subunit, a second determination subunit, and an adjustment subunit, as follows:
the first determining subunit is configured to determine estimated position information of a target video frame corresponding to a first playing progress in a video frame sequence of the target video according to a timestamp corresponding to the first playing progress;
the identification subunit is used for sequentially identifying key frames in the video frame sequence by taking the estimated position information as a starting point;
the second determining subunit is used for determining target position information of a target video frame in the video frame sequence according to the timestamp corresponding to the key frame and the timestamp corresponding to the first playing progress when the key frame is identified;
and the adjustment subunit is used for adjusting the playing progress of the target video in the second electronic equipment based on the target position information so as to enable the first electronic equipment and the second electronic equipment to synchronously play the target video.
Optionally, in some embodiments of the present application, the second determining subunit may be specifically configured to determine, when a time difference between a time stamp corresponding to the key frame and a time stamp corresponding to the first playing progress is smaller than a preset value, target location information of the target video frame in the video frame sequence based on location information of the key frame in the video frame sequence.
As can be seen from the above, in this embodiment, the first establishing unit 3101 may establish a communication channel in which the first electronic device is connected to the second electronic device; obtaining a sharing playing request of target videos of the first electronic equipment and the second electronic equipment; triggering the first electronic device and the second electronic device to play the target video through a first triggering unit 3102 according to the sharing play request; transmitting, by the transmitting unit 3103, a first playing progress of the target video on the first electronic device to the second electronic device through the communication channel, so that the second electronic device compares the first playing progress with a second playing progress of the target video on the second electronic device; when the comparison result of the first playing progress and the second playing progress does not meet the preset condition, a first adjusting unit 3104 triggers the adjustment of the playing progress of the target video in the second electronic device, so that the first electronic device and the second electronic device synchronously play the target video;
or, a communication channel in which the first electronic device is connected to the second electronic device is established through the second establishing unit 3201; obtaining a sharing playing request of target videos of the first electronic equipment and the second electronic equipment; triggering the first electronic device and the second electronic device to play the target video through a second triggering unit 3202 according to the sharing play request; receiving, by a receiving unit 3203, a first playing progress of the target video on the first electronic device, where the first playing progress is sent by the first electronic device through the communication channel; comparing, by a comparing unit 3204, the first playing progress and a second playing progress of the target video on the second electronic device; and when the comparison result of the first playing progress and the second playing progress does not meet the preset condition, the second adjusting unit 3205 adjusts the playing progress of the target video in the second electronic device, so that the first electronic device and the second electronic device synchronously play the target video.
According to the method and the system for synchronously playing the target video on the first electronic equipment and the second electronic equipment, synchronous playing of the target video on the first electronic equipment and the second electronic equipment can be controlled based on the playing progress, so that the second electronic equipment can be used as a complementary viewing equipment of the first electronic equipment, although video playing capabilities of different electronic equipment are poor, the target video can be displayed in a collaborative sharing mode by combining the playing capabilities of different electronic equipment, and better viewing experience can be brought to users.
The embodiment of the present application further provides a computer device, as shown in fig. 4, which shows a schematic structural diagram of the computer device according to the embodiment of the present application, where the computer device may be a terminal (such as a first electronic device or a second electronic device) or a server, and specifically:
the computer device may include one or more processors 401 of a processing core, memory 402 of one or more computer readable storage media, a power supply 403, and an input unit 404, among other components. Those skilled in the art will appreciate that the computer device structure shown in FIG. 4 is not limiting of the computer device and may include more or fewer components than shown, or may be combined with certain components, or a different arrangement of components. Wherein:
The processor 401 is a control center of the computer device, connects various parts of the entire computer device using various interfaces and lines, performs various functions of the computer device and processes data by running or executing software programs and/or modules stored in the memory 402, and calling data stored in the memory 402. Optionally, processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, a computer program, etc., and the modem processor mainly processes wireless communication. It will be appreciated that the modem processor described above may not be integrated into the processor 401.
The memory 402 may be used to store software programs and modules, and the processor 401 executes various functional applications and data processing by executing the software programs and modules stored in the memory 402. The memory 402 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, a computer program (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like; the storage data area may store data created according to the use of the computer device, etc. In addition, memory 402 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 with access to the memory 402.
The computer device further comprises a power supply 403 for supplying power to the various components, preferably the power supply 403 may be logically connected to the processor 401 by a power management system, so that functions of charge, discharge, and power consumption management may be performed by the power management system. The power supply 403 may also include one or more of any of a direct current or alternating current power supply, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.
The computer device may also include an input unit 404, which input unit 404 may be used to receive input numeric or character information and to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.
Although not shown, the computer device may further include a display unit or the like, which is not described herein. In particular, in this embodiment, the processor 401 in the computer device loads executable files corresponding to the processes of one or more computer programs into the memory 402 according to the following instructions, and the processor 401 executes the computer programs stored in the memory 402, so as to implement the functions in the embodiments of the present application.
According to the method and the system for synchronously playing the target video on the first electronic equipment and the second electronic equipment, synchronous playing of the target video on the first electronic equipment and the second electronic equipment can be controlled based on the playing progress, so that the second electronic equipment can be used as a complementary viewing equipment of the first electronic equipment, although video playing capabilities of different electronic equipment are poor, the target video can be displayed in a collaborative sharing mode by combining the playing capabilities of different electronic equipment, and better viewing experience can be brought to users.
It will be appreciated by those of ordinary skill in the art that all or part of the steps of the various methods of the above embodiments may be performed by a computer program, or by computer program control related hardware, which may be stored in a computer readable storage medium and loaded and executed by a processor.
To this end, an embodiment of the present application provides a computer readable storage medium having stored therein a computer program that can be loaded by a processor to perform the steps of any of the video playing methods provided by the embodiment of the present application. For example, the computer program may perform the steps of embodiments of the application.
Wherein the computer-readable storage medium may comprise: read Only Memory (ROM), random access Memory (RAM, random Access Memory), magnetic or optical disk, and the like.
Because the computer program stored in the computer readable storage medium can execute the steps in any video playing method provided by the embodiment of the present application, the beneficial effects that any video playing method provided by the embodiment of the present application can be achieved, and detailed descriptions of the previous embodiments are omitted herein.
According to one aspect of the present application, there is provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The computer instructions are read from a computer-readable storage medium by a processor of a computer device, and executed by the processor, cause the computer device to perform the methods provided in various alternative implementations of the video playback aspects described above.
The foregoing describes in detail a video playing method and related devices provided by the embodiments of the present application, and specific examples are applied to illustrate the principles and implementations of the present application, where the foregoing examples are only for helping to understand the method and core ideas of the present application; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in light of the ideas of the present application, the present description should not be construed as limiting the present application.

Claims (15)

1. A video playing method, comprising:
establishing a communication channel for connecting the first electronic device with the second electronic device; obtaining a sharing playing request of target videos of the first electronic equipment and the second electronic equipment;
triggering the first electronic equipment and the second electronic equipment to play the target video according to the sharing play request;
transmitting a first playing progress of the target video on the first electronic device to the second electronic device through the communication channel, so that the second electronic device compares the first playing progress with a second playing progress of the target video on the second electronic device;
when the comparison result of the first playing progress and the second playing progress does not meet the preset condition, triggering the adjustment of the playing progress of the target video in the second electronic equipment so that the first electronic equipment and the second electronic equipment synchronously play the target video.
2. The method of claim 1, wherein the triggering the first electronic device and the second electronic device to play the target video according to the shared play request comprises:
Triggering the first electronic equipment to select a first video code stream corresponding to the first electronic equipment from a video code stream set of the target video according to the sharing playing request, wherein the video code stream set comprises at least two video code streams;
playing the target video in the first electronic device based on the first video code stream;
triggering the second electronic equipment to select a second video code stream corresponding to the second electronic equipment from the video code stream set of the target video according to the sharing playing request;
and playing the target video in the second electronic equipment based on the second video code stream.
3. The method according to claim 2, wherein the set of video streams includes a mapping relationship between preset device configuration information and video streams under preset encoding parameters;
triggering the first electronic device to select a first video code stream corresponding to the first electronic device from a video code stream set of the target video according to the sharing playing request, including:
selecting a first video code stream corresponding to the first electronic device from a video code stream set of the target video based on the device configuration information of the first electronic device according to the shared play request;
Triggering the second electronic device to select a second video code stream corresponding to the second electronic device from the video code stream set of the target video according to the sharing playing request, including:
and triggering the second electronic equipment to select a second video code stream corresponding to the second electronic equipment from the video code stream set of the target video based on the equipment configuration information according to the sharing play request.
4. The method according to claim 2, wherein the video code streams in the video code stream set include at least one video slice, the number of video slices in each video code stream is the same, and the duration corresponding to the video slices in the same arrangement sequence in each video code stream is the same;
the playing the target video in the first electronic device based on the first video code stream includes:
playing the target video in the first electronic equipment according to the sequence of video slicing in the first video code stream;
the playing the target video in the second electronic device based on the second video code stream includes:
and playing the target video in the second electronic equipment according to the sequence of video slicing in the second video code stream.
5. The method of claim 2, wherein the play time point for the same video content in each video stream of the set of video streams is the same.
6. A video playing method, comprising:
establishing a communication channel for connecting the first electronic device with the second electronic device; obtaining a sharing playing request of target videos of the first electronic equipment and the second electronic equipment;
triggering the first electronic equipment and the second electronic equipment to play the target video according to the sharing play request;
receiving a first playing progress of the target video sent by the first electronic device through the communication channel on the first electronic device;
comparing the first playing progress with a second playing progress of the target video on the second electronic equipment;
and when the comparison result of the first playing progress and the second playing progress does not meet the preset condition, adjusting the playing progress of the target video in the second electronic equipment so as to enable the first electronic equipment and the second electronic equipment to synchronously play the target video.
7. The method of claim 6, wherein the method further comprises:
Based on the switching operation of the playing view angle of the target video, acquiring a target video code stream corresponding to the switched target playing view angle;
and switching the currently played video code stream into the target video code stream, and continuously displaying the target video at the target playing view angle based on the current playing progress of the target video.
8. The method of claim 6, wherein the method further comprises:
displaying the target video in a preset interaction mode based on the playing content information of the target video;
acquiring object interaction operation information aiming at a target video in the preset interaction mode;
and displaying the interaction result corresponding to the object interaction operation information on the playing page of the target video.
9. The method of claim 6, wherein the adjusting the playing progress of the target video in the second electronic device to enable the first electronic device and the second electronic device to synchronously play the target video comprises:
determining estimated position information of a target video frame corresponding to a first playing progress in a video frame sequence of the target video according to a time stamp corresponding to the first playing progress;
Sequentially identifying key frames in the video frame sequence by taking the estimated position information as a starting point;
when a key frame is identified, determining target position information of a target video frame in the video frame sequence according to a time stamp corresponding to the key frame and a time stamp corresponding to the first playing progress;
and adjusting the playing progress of the target video in the second electronic equipment based on the target position information so as to enable the first electronic equipment and the second electronic equipment to synchronously play the target video.
10. The method according to claim 9, wherein determining the target position information of the target video frame in the video frame sequence according to the timestamp corresponding to the key frame and the timestamp corresponding to the first playing progress comprises:
and when the time difference between the time stamp corresponding to the key frame and the time stamp corresponding to the first playing progress is smaller than a preset value, determining target position information of the target video frame in the video frame sequence based on the position information of the key frame in the video frame sequence.
11. A video playback device, the device comprising:
The first establishing unit is used for establishing a communication channel for connecting the first electronic equipment with the second electronic equipment; obtaining a sharing playing request of target videos of the first electronic equipment and the second electronic equipment;
the first triggering unit is used for triggering the first electronic equipment and the second electronic equipment to play the target video according to the sharing play request;
the sending unit is used for sending the first playing progress of the target video on the first electronic equipment to the second electronic equipment through the communication channel so that the second electronic equipment compares the first playing progress with the second playing progress of the target video on the second electronic equipment;
and the first adjusting unit is used for triggering the adjustment of the playing progress of the target video in the second electronic equipment when the comparison result of the first playing progress and the second playing progress does not meet the preset condition, so that the first electronic equipment and the second electronic equipment synchronously play the target video.
12. A video playback device, the device comprising:
the second establishing unit is used for establishing a communication channel for connecting the first electronic equipment and the second electronic equipment; obtaining a sharing playing request of target videos of the first electronic equipment and the second electronic equipment;
The second triggering unit is used for triggering the first electronic equipment and the second electronic equipment to play the target video according to the sharing play request;
the receiving unit is used for receiving a first playing progress of the target video sent by the first electronic equipment through the communication channel on the first electronic equipment;
the comparison unit is used for comparing the first playing progress with a second playing progress of the target video on the second electronic equipment;
and the second adjusting unit is used for adjusting the playing progress of the target video in the second electronic equipment when the comparison result of the first playing progress and the second playing progress does not meet the preset condition, so that the first electronic equipment and the second electronic equipment synchronously play the target video.
13. A computer device comprising a memory and a processor; the memory stores a computer program, and the processor is configured to execute the computer program in the memory to perform the operations in the video playback method of any one of claims 1 to 5 or the video playback method of any one of claims 6 to 10.
14. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program adapted to be loaded by a processor for performing the steps of the video playing method of any one of claims 1 to 5 or the video playing method of any one of claims 6 to 10.
15. A computer program product comprising a computer program, characterized in that the computer program, when executed by a processor, implements the steps of the video playback method of any one of claims 1 to 5 or the video playback method of any one of claims 6 to 10.
CN202311295438.2A 2023-10-07 2023-10-07 Video playing method and related equipment Pending CN117221637A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311295438.2A CN117221637A (en) 2023-10-07 2023-10-07 Video playing method and related equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311295438.2A CN117221637A (en) 2023-10-07 2023-10-07 Video playing method and related equipment

Publications (1)

Publication Number Publication Date
CN117221637A true CN117221637A (en) 2023-12-12

Family

ID=89035267

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311295438.2A Pending CN117221637A (en) 2023-10-07 2023-10-07 Video playing method and related equipment

Country Status (1)

Country Link
CN (1) CN117221637A (en)

Similar Documents

Publication Publication Date Title
KR101687640B1 (en) Method for synchronized content playback
CN101917391B (en) Method for playing network video and system for playing network video
JP5964972B2 (en) Stream multimedia data from multiple sources
US20140297804A1 (en) Control of multimedia content streaming through client-server interactions
US10791366B2 (en) Fast channel change in a video delivery network
US20180077385A1 (en) Data, multimedia & video transmission updating system
EP2060104A1 (en) Techniques for managing visual compositions for a multimedia conference call
US10958972B2 (en) Channel change method and apparatus
US20200322567A1 (en) Video Chunk Combination Optimization
US11120615B2 (en) Dynamic rendering of low frequency objects in a virtual reality system
US10708667B1 (en) Combining fragments with different encodings
JP2011511554A (en) Method for streaming video data
CN103918258A (en) Reducing amount of data in video encoding
US9667885B2 (en) Systems and methods to achieve interactive special effects
Zeng et al. A new architecture of 8k vr fov video end-to-end technology
CN117221637A (en) Video playing method and related equipment
US20220103899A1 (en) A client and a method for managing, at the client, a streaming session of a multimedia content
KR20090040107A (en) Method for real-time personal broadcasting
Stamos Katsigiannis et al. 5G: Disruption in media and entertainment
CN107801103B (en) Multimedia resource self-adaptive synchronization method based on network condition under heterogeneous network
KR20090040106A (en) Method for real-time personal broadcasting
CN114546308A (en) Application interface screen projection method, device, equipment and storage medium
CN117395427A (en) Playing control method in media sharing
CN116886944A (en) Screen live broadcast method and device of panoramic camera
CN102316359A (en) Method and device for transmitting video data

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40097773

Country of ref document: HK