CN111010620B - Method and device for multimedia resource carousel, electronic equipment and storage medium - Google Patents

Method and device for multimedia resource carousel, electronic equipment and storage medium Download PDF

Info

Publication number
CN111010620B
CN111010620B CN201911220822.XA CN201911220822A CN111010620B CN 111010620 B CN111010620 B CN 111010620B CN 201911220822 A CN201911220822 A CN 201911220822A CN 111010620 B CN111010620 B CN 111010620B
Authority
CN
China
Prior art keywords
resource
slice
carousel
sub
playing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911220822.XA
Other languages
Chinese (zh)
Other versions
CN111010620A (en
Inventor
陆世明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hisense Visual Technology Co Ltd
Original Assignee
Hisense Visual Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hisense Visual Technology Co Ltd filed Critical Hisense Visual Technology Co Ltd
Priority to CN201911220822.XA priority Critical patent/CN111010620B/en
Publication of CN111010620A publication Critical patent/CN111010620A/en
Application granted granted Critical
Publication of CN111010620B publication Critical patent/CN111010620B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/262Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
    • H04N21/26258Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/262Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
    • H04N21/26275Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists for distributing content or additional data in a staggered manner, e.g. repeating movies on different channels in a time-staggered manner in a near video on demand system
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47202End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The application provides a method, a device, an electronic device and a storage medium for multimedia resource carousel, wherein the method comprises the following steps: sending a carousel request to a server; receiving a carousel response sent by a server, wherein the carousel response comprises a request address of at least one slice resource of at least one sub-resource, and receiving a target slice resource; and playing the received target slice resources according to the playing sequence of the received target slice resources, and displaying the playing time length and/or the playing progress of the currently played slice resources. According to the method and the device, the intelligent device can achieve the purpose of displaying the resource playing time and/or the resource playing progress in the resource carousel process.

Description

Method and device for multimedia resource carousel, electronic equipment and storage medium
Technical Field
The present application relates to the field of multimedia resource playing technologies, and in particular, to a method and an apparatus for multimedia resource carousel, an electronic device, and a storage medium.
Background
The multimedia resources comprise picture resources, audio and video resources, animation resources and the like. The multimedia resource carousel refers to the circulation playing of the multimedia resources in a fixed sequence and in a live form. Illustratively, the server lays out A, B, C three movies in a carousel resource and plays them in a loop in a live form. Different from the on-demand, the resource carousel simulation is a live broadcast mode, and is a video live broadcast service provided by an online video live broadcast protocol.
The carousel has various advantages of live broadcasting (such as high timeliness and strong interactivity), and inherits the disadvantages of live broadcasting, such as the fact that a user cannot acquire the playing time length and the playing progress of the currently played resource when watching the carousel resource.
Disclosure of Invention
The application provides a method, a device, electronic equipment and a storage medium for multimedia resource carousel, which can realize the display of resource playing time and/or playing progress in the resource carousel process.
A first aspect of the present application provides a method for multimedia resource carousel, including:
sending a carousel request to a server, wherein the carousel request is used for requesting a multimedia resource to be carousel, and the multimedia resource to be carousel comprises at least one sub-resource;
receiving a carousel response sent by the server, wherein the carousel response comprises a request address of at least one slice resource of at least one sub-resource;
receiving a target slice resource according to the request address of the at least one slice resource;
and playing the received target slice resources according to the playing sequence of the received target slice resources, and displaying the playing time length and/or the playing progress of the currently played slice resources.
Optionally, the carousel response further includes time information and a play sequence identifier of each slice resource, where the time information includes a play start time of the slice resource in the sub resource to which the slice resource belongs and a total play duration of the sub resource to which the slice resource belongs, and the displaying of the play duration and/or the play progress of the currently played slice resource includes:
and displaying the playing duration and/or the playing progress of the currently played slice resource according to the time information of the currently played slice resource.
Optionally, the displaying the playing duration and/or the playing progress of the currently played slice resource according to the time information of the currently played slice resource includes:
acquiring the played time of the currently played slice resource;
acquiring the playing time length of the currently played slice resource according to the playing start time of the currently played slice resource in the sub-resource and the played time; and/or the presence of a gas in the gas,
and acquiring the playing progress of the currently played slice resource according to the playing duration of the currently played slice resource and the total playing duration of the sub-resource to which the currently played slice resource belongs.
Optionally, the obtaining the played time of the currently played slice resource includes:
and determining the played time of the currently played resource frame of the currently played slice resource relative to the first resource frame of the currently played slice resource as the played time.
Optionally, the obtaining the played time of the currently played slice resource includes:
and taking the played time of the currently played slice resource represented by the system clock as the played time.
Optionally, the slice resource further carries an identifier of a sub-resource to which the slice resource belongs, and the identifiers of the playing sequences of the slice resources of one sub-resource are different.
Optionally, the method further includes: and if the rest of the slice resources with the preset number are not played in the received slice resources, sending a new carousel request to the server, wherein the new carousel request is used for requesting the multimedia resources to be carousel.
Optionally, the time information further includes: the playing termination time of the slice resource in the sub-resource to which the slice resource belongs; the method further comprises the following steps: and sending a new carousel request to the server when determining that the resource of the currently played slice resource with the residual preset time is not played according to the playing start time and the playing end time of the currently played slice resource in the sub-resource to which the currently played slice resource belongs, wherein the new carousel request is used for requesting the multimedia resource to be carousel.
Optionally, the carousel response includes a download address of a list file, where the list file includes a request address of at least one slice resource of the at least one sub resource, time information of each slice resource, and a play order identifier, and before receiving a target slice resource according to the request address of the at least one slice resource, the method further includes: receiving a download address of the list file from the server;
downloading the list file;
and analyzing the list file to obtain a request address of at least one slice resource of the at least one sub resource, time information of each slice resource and a playing sequence identifier.
A second aspect of the present application provides a method for multimedia resource carousel, including:
receiving a carousel request sent by an intelligent device, wherein the carousel request is used for requesting a multimedia resource to be carousel, and the multimedia resource to be carousel comprises at least one sub-resource;
and sending a carousel response to the intelligent equipment, wherein the carousel response comprises a request address of at least one slice resource of at least one sub-resource.
Optionally, the carousel response further includes: the time information of each slice resource comprises the playing start time of the slice resource in the sub-resource to which the slice resource belongs and the total playing duration of the sub-resource to which the slice resource belongs.
Optionally, the carousel response includes a download address of the list file, and the sending the carousel response to the intelligent device includes:
writing a request address of at least one slice resource of at least one sub resource to be sent, time information of each slice resource and a playing sequence identifier into the list file according to the number of slice resources allowed to be carried in the carousel response;
and encapsulating the download address of the list file in the carousel response and sending the carousel response to the intelligent equipment.
Optionally, the slice resource further carries an identifier of a sub-resource to which the slice resource belongs, and the identifiers of the playing sequences of the slice resources of one sub-resource are different.
Optionally, the method further includes: and receiving a new carousel request sent by the intelligent equipment.
A third aspect of the present application provides an apparatus for multimedia resource carousel, including:
the system comprises a receiving and sending module, a relay module and a transmitting and receiving module, wherein the receiving and sending module is used for sending a carousel request to a server and receiving a carousel response sent by the server, the carousel request is used for requesting a multimedia resource to be carousel, the multimedia resource to be carousel comprises at least one sub-resource, and the carousel response comprises a request address of at least one slice resource of the at least one sub-resource;
the processing module is used for receiving the target slice resource according to the request address of the at least one slice resource;
and the display module is used for playing the received target slice resources according to the playing sequence of the received target slice resources and displaying the playing time length and/or the playing progress of the currently played slice resources.
Optionally, the carousel response further includes time information and a playing sequence identifier of each slice resource, where the time information includes a playing start time of the slice resource in the sub resource to which the slice resource belongs and a total playing duration of the sub resource to which the slice resource belongs.
Correspondingly, the display module is specifically configured to display the playing duration and/or the playing progress of the currently played slice resource according to the time information of the currently played slice resource.
Optionally, the display module is specifically configured to obtain a played time of the currently played slice resource; acquiring the playing time length of the currently played slice resource according to the playing start time of the currently played slice resource in the sub-resource and the played time; and/or acquiring the playing progress of the currently played slice resource according to the playing time length of the currently played slice resource and the total playing time length of the sub-resource to which the currently played slice resource belongs.
Optionally, the display module is specifically configured to determine a played time of a currently played resource frame of the currently played slice resource relative to a first resource frame of the currently played slice resource as the played time.
Optionally, the display module is specifically configured to use the played time of the currently played slice resource represented by the system clock as the played time.
Optionally, the slice resource further carries an identifier of a sub-resource to which the slice resource belongs, and the identifiers of the playing sequences of the slice resources of one sub-resource are different.
The receiving and sending module is further configured to send a new carousel request to the server in the received slice resources if a preset number of remaining slice resources are not played, where the new carousel request is used to request the multimedia resources to be carousel.
Optionally, the time information further includes: and the playing termination time of the slice resource in the sub-resource.
Correspondingly, the transceiver module is further configured to send a new carousel request to the server when determining that the currently played slice resource has no resource with the remaining preset time according to the play start time and the play end time of the current slice resource in the sub-resource to which the current slice resource belongs, where the new carousel request is used to request the multimedia resource to be carousel.
Optionally, the carousel response includes a download address of a list file, where the list file includes a request address of at least one slice resource of the at least one sub resource, time information of each slice resource, and a play sequence identifier.
The processing module is specifically configured to receive a download address of the list file from the server, download the list file, analyze the list file, and obtain a request address of at least one slice resource of the at least one sub resource, time information of each slice resource, and a play sequence identifier.
A fourth aspect of the present application provides an apparatus for multimedia resource carousel, comprising:
the system comprises a receiving and sending module, a transmitting and receiving module and a transmitting and receiving module, wherein the receiving and sending module is used for receiving a carousel request sent by intelligent equipment and sending a carousel response to the intelligent equipment; the carousel request is used for requesting a multimedia resource to be carousel, the multimedia resource to be carousel includes at least one sub-resource, and the carousel response includes a request address of at least one slice resource of the at least one sub-resource.
Optionally, the carousel response further includes time information and a playing sequence identifier of each slice resource, where the time information includes a playing start time of the slice resource in the sub resource to which the slice resource belongs and a total playing duration of the sub resource to which the slice resource belongs.
Optionally, the processing module is configured to write a request address of at least one slice resource of at least one to-be-sent sub resource, time information of each slice resource, and a play sequence identifier into the list file according to the number of slice resources allowed to be carried in the carousel response;
correspondingly, the transceiver module is further configured to encapsulate the download address of the list file in the carousel response and send the carousel response to the intelligent device.
Optionally, the slice resource further carries an identifier of a sub-resource to which the slice resource belongs, and the identifiers of the playing sequences of the slice resources of one sub-resource are different.
Optionally, the transceiver module is further configured to receive a new carousel request sent by the intelligent device.
A fifth aspect of the present application provides an electronic device, comprising: at least one processor and memory;
the memory stores computer-executable instructions;
the at least one processor executes computer-executable instructions stored by the memory to cause the electronic device to perform the method of the first aspect of multimedia asset carousel described above.
A sixth aspect of the present application provides a computer-readable storage medium having stored thereon computer-executable instructions that, when executed by a processor, implement the method for carousel of digital multimedia assets of the first aspect.
A seventh aspect of the present application further provides an intelligent display device, including:
a display;
the system comprises a transceiver and a server, wherein the transceiver is configured to send a carousel request to the server, the carousel request is used for requesting multimedia resources to be carousel, and the multimedia resources to be carousel comprise at least one sub-resource; receiving a carousel response sent by the server, wherein the carousel response comprises a request address of at least one slice resource of at least one sub-resource;
and the controller is configured to control to request a target slice resource according to the request address of the at least one slice resource, control to play the received target slice resource according to the playing sequence of the received target slice resource, and display the playing time length and/or the playing progress of the currently played slice resource.
The application provides a method, a device, an electronic device and a storage medium for multimedia resource carousel, wherein the method comprises the following steps: sending a carousel request to a server; receiving a carousel response sent by a server, wherein the carousel response comprises a request address of at least one slice resource of at least one sub-resource, and receiving a target slice resource; and playing the received target slice resources according to the playing sequence of the received target slice resources, and displaying the playing time length and/or the playing progress of the currently played slice resources. The multimedia resource carousel method can display the resource playing time and/or the resource playing progress in the resource carousel process.
Drawings
Fig. 1 is a schematic view of a scene to which the multimedia resource carousel method provided in the present application is applied;
FIG. 2 is a schematic diagram of interface changes of a smart device in the prior art;
fig. 3 is a schematic diagram illustrating interface changes of a smart phone in the prior art;
FIG. 4 is a schematic diagram of a resource carousel principle;
fig. 5 is a first schematic interaction flow diagram of a method for multimedia resource carousel according to the present application;
FIG. 6 is a schematic diagram illustrating an interface change of the smart device provided herein;
fig. 7 is a schematic flowchart of a process of obtaining a playing time and/or a playing progress of a slice resource played before being obtained according to the present application;
FIG. 8 is a schematic diagram of a server according to the present application;
fig. 9 is a schematic interaction flow diagram of a method for multimedia resource carousel according to the present application;
FIG. 10 is a schematic view of a player structure provided in the present application;
fig. 11 is a third schematic view illustrating an interaction flow of a method for multimedia resource carousel according to the present application;
fig. 12 is a schematic structural diagram of an apparatus for carousel of multimedia resources according to the present application;
fig. 13 is a schematic structural diagram of another apparatus for multimedia resource carousel provided in the present application;
fig. 14 is a schematic structural diagram of an electronic device provided in the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the embodiments of the present application, and it is obvious that the described embodiments are some but not all of the embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In order to more clearly describe the multimedia resource carousel method provided by the present application, the following first introduces a multimedia resource carousel method in the prior art with reference to a specific application scenario. It should be understood that the multimedia resources in the present application may include one or more of picture resources, audio and video resources, animation resources, and the like.
Fig. 1 is a scene schematic diagram applicable to the multimedia resource carousel method provided in the present application. As shown in fig. 1, the scenario includes: intelligent device and server. The intelligent device is an electronic device capable of resource carousel, such as an intelligent television, an intelligent mobile phone, an intelligent sound box with a display screen, and the like. The server can be a code stream server and is used for providing carousel resources for the intelligent equipment.
An application program supporting the resource carousel can be installed on the intelligent device, and a user can open the application program to watch the carousel resources. Fig. 2 is a schematic diagram of interface changes of a smart device in the prior art. As shown in the interface 201 of fig. 2, 3 multimedia resources to be played in turn, which are respectively a multimedia resource a, a multimedia resource B, and a multimedia resource C, can be displayed on the interface. The multimedia resource a includes a sub-resource 1, a sub-resource 2, a sub-resource 3, and a sub-resource 4. Illustratively, the multimedia resource a may be a movie carousel resource, and correspondingly, the sub-resource 1, the sub-resource 2, the sub-resource 3, and the sub-resource 4 included therein may be 4 movies, such as movie a, movie b, movie c, and movie d, respectively.
The server may be pre-arranged according to the order of sub-resource 1, sub-resource 2, sub-resource 3, and sub-resource 4, and arranged to multi-media resource a. When the intelligent device is an intelligent television, the user can select the multimedia resource a through a control device (such as a remote controller) (for example, the dashed box indicates that the multimedia resource a is selected), so that the intelligent television circularly plays the multimedia resource a according to the sequence of the sub-resource 1, the sub-resource 2, the sub-resource 3 and the sub-resource 4. It is conceivable that, when the smart device is a smart phone, the user may select the multimedia resource a on the interface of the smart phone by clicking or other operation manners, so that the smart phone cyclically plays the multimedia resource a according to the sequence of the sub resource 1, the sub resource 2, the sub resource 3, and the sub resource 4.
It should be understood that fig. 2 illustrates an example in which the smart device is a smart tv. Correspondingly, after the user selects the multimedia resource A, the smart television starts to perform carousel on the multimedia resource A. The interface of the smart television jumps to the interface 202, and the sub-resource 1 (e.g. a video frame of the movie a) is displayed on the interface 202. It should be noted that the carousel format is a play format in which a certain number of sub-resources are played in a loop in a live manner. The user opens the multimedia resource at any time and watches at any time, and the playing position of the watched sub-resource depends on the position of the sub-resource pushed by the server at that time (refer to the following description of the carousel principle).
Since carousel is a live broadcast form, the live broadcast technology in the prior art does not support obtaining the current play duration and play progress of the multimedia resource watched by the user. Therefore, in the current resource carousel process, when a user watches carousel resources, the current playing duration and playing progress of the multimedia resources cannot be obtained, and the user experience is poor. Illustratively, as shown in the interface 202 in fig. 2, when the user views the current playing time and the playing progress of the multimedia resource according to the prior art, the current playing time and the playing progress of the multimedia resource are not displayed on the interface. If the user clicks the interface of the smart phone when watching the carousel resource on the smart phone, the current playing duration and the playing progress of the multimedia resource are not displayed on the interface.
Compared with the on-demand service, when the user watches the carousel resource on the smart phone, the user clicks an interface of the smart phone, and the current playing time and playing progress of the multimedia resource are displayed on the interface, as shown in the interface of the smart phone in fig. 3. Fig. 3 is a schematic diagram of interface changes of a smartphone in the prior art. As shown in interface 301 of fig. 3, a video on demand, such as movie x, is played on the smartphone. When the user clicks on interface 301, the interface transitions to interface 302. Correspondingly, as shown in the interface 302, the current playing time and playing progress of the movie x are displayed on the interface 302.
In order to solve the above problems, the present application provides a multimedia resource carousel method, which can obtain a playing duration and/or a playing progress of a played multimedia resource, and improve user experience.
Before introducing the multimedia resource carousel method provided by the present application, a resource carousel principle adopted in the present application is first explained. Fig. 4 is a schematic diagram of a resource carousel principle. Shown in fig. 4 is multimedia asset a, which includes sub-asset 1, sub-asset 2, sub-asset 3, and sub-asset 4. The sub-resources are connected end to form a closed loop.
Wherein the sub-resources are characterized by different gray color patches in fig. 4. The server divides each sub-resource into a plurality of slice resources in advance according to a preset slice rule. For example, sub-resource 1 includes 5 slice resources, sub-resource 2 includes 3 slice resources, sub-resource 3 includes 5 slice resources, and sub-resource 4 includes 5 slice resources.
The playing time length corresponding to each slice resource may be the same or different, and the slice rules corresponding to different sub-resources may be the same or different. Illustratively, for example, the playing duration corresponding to each slice resource in the sub resource 1 is 10s, and the playing durations corresponding to 3 slice resources in the sub resource 2 are 3s, 5s, and 8s, respectively. In the present application, there is no limitation on the rule how the server slices the child resources. It should be understood that, for convenience of description, the following embodiments take the example that the playing time length corresponding to each slice resource is 10 s.
For the convenience of explaining the transmission of the slice resources in the carousel principle, each slice resource in fig. 4 is numbered sequentially, such as slice resources 1-18.
When the intelligent equipment requests the multimedia resource from the server, the server sends the multimedia resource to the intelligent equipment according to the position of the currently pushed multimedia resource. Illustratively, if the multimedia resource currently pushed by the server is a slice resource 1-3, the slice resource 1-3 is sent to the smart device. And if the multimedia resource currently pushed by the server is the slice resource 2-4, sending the slice resource 2-4 to the intelligent equipment. The number of slice resources pushed to the intelligent device by the server at a time may be fixed or unfixed, and the pushing rule may be preset. If the number of the slice resources pushed to the intelligent device by the server each time is 3, the pushing rules can be that pushing is carried out at intervals of one or more, if the number of the slice resources pushed last time is 1-3, the slice resources are pushed this time 2-4; or the slice resource pushed last time is 1-3, and the slice resource pushed this time is 3-5. In this embodiment, the number of slice resources and the pushing rule that the server pushes to the smart device at a time are not limited. It should be understood that, in the following embodiments, the number of slice resources pushed to the smart device by the server at a time is 3, and the pushing rule is that the slice resources pushed last time are 1 to 3, and the slice resources pushed this time are 2 to 4.
The following describes a multimedia resource carousel method provided by the present application with reference to a specific embodiment from the perspective of interaction between an intelligent device and a server. Fig. 5 is a first interaction flow diagram of a multimedia resource carousel method provided in the present application. As shown in fig. 5, the method for multimedia resource carousel provided in this embodiment may include:
s501, the intelligent device sends a carousel request to a server, the carousel request is used for requesting multimedia resources to be carousel, and the multimedia resources to be carousel comprise at least one sub-resource.
Correspondingly, the server receives the carousel request sent by the intelligent device.
In this embodiment, a user may trigger the smart device to send a carousel request to the server. Optionally, the types of the smart devices are different, and the triggering manners of the smart devices may be different, specifically, refer to the manners of triggering the smart devices to send the carousel request to the server in fig. 2 and fig. 3.
Fig. 6 is a schematic diagram of an interface change of the smart device provided in the present application. Therein, the interface 601 in fig. 6 may be the same as the interface 201 in the prior art, such as in fig. 2. When a user selects the multimedia resource a in the interface 601 through a control device (such as a remote controller), a limb action or voice interaction, the intelligent device is triggered to send a carousel request to the server. The carousel request is used for requesting a server for a multimedia resource to be carousel, and correspondingly, the multimedia resource to be carousel is a multimedia resource a.
It should be understood that the resource pre-organized by several sub-resources (e.g. movies, audio, pictures) etc. is referred to as the multimedia resource to be carousel in this embodiment. Optionally, the carousel request includes an identifier of a multimedia resource to be carousel, and the multimedia resource to be carousel includes at least one sub-resource. It will be appreciated that the identity of the multimedia asset to be carousel can uniquely identify the multimedia asset to distinguish it from other multimedia assets. Illustratively, the identification of the multimedia resource to be carousel may be a.
S502, the server sends a carousel response to the intelligent device, wherein the carousel response comprises a request address of at least one slice resource of at least one sub-resource.
Correspondingly, the intelligent device receives the carousel response sent by the server.
In view of the fact that the resource carousel is a live broadcasting method, when the server sends the multimedia resource to be carousel to the intelligent device, the server can determine the slice resource to be sent to the intelligent device according to the position of the multimedia resource to be carousel pushed by the current server.
In this embodiment, optionally, when the server receives a carousel request from the intelligent device, the carousel request includes an identifier of a multimedia resource to be carousel. The server can send carousel response to the intelligent device according to the identification of the multimedia resource to be carousel. Wherein, the carousel response includes a request address of at least one slice resource of the at least one sub-resource.
Illustratively, if the multimedia resource to be carousel pushed by the current server is movie 1 in the multimedia resource a, the server starts to push the resource to be carousel from the first slice resource of movie 1, and the number of slice resources pushed by the server is 3. Correspondingly, the carousel response includes the request addresses of slice resource 1, slice resource 2, and slice resource 3 of sub-resource movie 1 in multimedia resource a.
The server may encapsulate the request address of the slice resource in a carousel response and send the carousel response to the smart device. Optionally, in this embodiment, the server may directly send the request address of the slice resource to the smart device.
S503, the intelligent device receives the target slice resource according to the request address of the at least one slice resource.
In this embodiment, the intelligent device receives the target slice resource according to the request address of at least one slice resource in the carousel response. Wherein, it should be understood that the target slice resource is a slice resource that has not been received in at least one slice resource.
Illustratively, if the slice resources pushed last by the server are slice resources 1, 2, and 3 of movie a, at least one slice resource pushed this time is slice resources 2, 3, and 4 of movie a. Given that the smart device has already received the slice resources 1, 2, and 3 of movie a, only the slice resource 4 of movie a needs to be received currently, i.e., the slice resource 4 of movie a is the target slice resource. In this embodiment, the adoption of this method can avoid receiving repeated slice resources, occupying storage space and wasting download traffic.
Optionally, in this embodiment, the sequence number identifier of each slice resource in the multimedia resource to be carousel is different. As shown in fig. 4, numbers 1 to 18 in fig. 4 may be sequence number identifiers of each slice resource, and correspondingly, in this embodiment, the target slice resource may be determined according to the sequence number identifier of the slice resource.
Optionally, the slice resource in this embodiment also carries an identifier of a sub-resource to which the slice resource belongs, and the playing sequence identifiers of the slice resources of one sub-resource are different. Illustratively, slice resources 1, 2, and 3, such as movie a, carry an identification of movie a, such as a; the slice resources 1 and 2 of movie b carry the identifier of movie b, respectively. Wherein, the playing sequence identifiers of the slice resources 1, 2 and 3 in movie a are 1, 2 and 3, respectively, and the playing sequence identifiers of the slice resources 1 and 2 in movie b are 1 and 2, respectively. Correspondingly, in this embodiment, the target slice resource may be determined according to the sequence number identifier of the slice resource and the identifier of the sub-resource carried by each slice resource. Illustratively, the play order identification of the slice resources 1, 2, and 3 of movie a may be a1, a2, A3, which can not only characterize the play order of the slice resources 1, 2, and 3, but also characterize the sub-resources to which the slice resources 1, 2, and 3 belong.
S504, the intelligent device plays the received target slice resources according to the playing sequence of the received target slice resources, and displays the playing time length and/or the playing progress of the currently played slice resources.
The intelligent device can play the received target slice resources in sequence according to the playing sequence of the received target slice resources. Specifically, in this embodiment, the playing sequence of the received target slice resource is determined according to the playing sequence identifier of the target slice resource in the carousel response, and the received target slice resource is played according to the playing sequence, and the playing duration and/or the playing progress of the currently played slice resource can be displayed when the slice resource is played.
In this embodiment, one possible implementation manner for the intelligent device to obtain the playing duration and/or the playing progress of the currently played slice resource is as follows:
the carousel response sent by the server to the intelligent device includes: the time information of each slice resource comprises the playing start time of the slice resource in the sub-resource to which the slice resource belongs and the total playing duration of the sub-resource to which the slice resource belongs.
Illustratively, the multimedia resources to be carousel as currently pushed by the server are request addresses of slice resource 1, slice resource 2, and slice resource 3 of sub-resource movie 1 in multimedia resource a, and time information and play order identifiers of slice resource 1, slice resource 2, and slice resource 3.
Taking the time information of the slice resource 1 as an example, the time information of the slice resource 1 includes the playing start time (e.g. 0s) of the slice resource 1 in the sub-resource (movie a) to which the slice resource belongs and the total playing duration of the sub-resource to which the slice resource belongs, for example, the total playing duration of the movie a is 60 s. It is understood that the time information of the slice resource 2 includes the play start time 10s of the slice resource 2 in the movie a, and the total play duration of the movie a is 60 s. Correspondingly, the time information of the slice resource 3 includes the play start time 20s of the slice resource 3 in the movie a, and the total play duration of the movie a is 60 s.
The playing sequence identifier of the slice resource 1, the slice resource 2, and the slice resource 3 may be an order representing the playing sequence of the slice resource 1, the slice resource 2, and the slice resource 3. Illustratively, as the playing order of the slice resource 1, the slice resource 2 and the slice resource 3 is the slice resource 1, the slice resource 2 and the slice resource 3, respectively, the playing order identifiers of the slice resource 1, the slice resource 2 and the slice resource 3 may be 1, 2 and 3, respectively.
It should be noted that, if the multimedia resource to be carousel currently pushed by the server is the last slice resource of movie a and the first two slice resources of movie b, the carousel response includes slice resources of two sub-resources. Such as movie a slice resource 6 and movie b slice resource 1 and slice resource 2. Wherein, the time information of the slice resource 1 of the movie b includes a playing start time 0s of the slice resource 1 in the movie b, and the total playing duration of the movie b is 20 s. Alternatively, the playback order identifiers of the slice resource 1 and the slice resource 2 of the movie a and the movie b may be 6, 7, and 8, respectively.
In this embodiment, the intelligent device may display the playing duration and/or the playing progress of the currently played slice resource according to the time information of the currently played slice resource. Illustratively, corresponding to the interface 601 in fig. 6 described above, after the user selects the multimedia asset a to be carouseled, the interface jumps to the interface 602. The interface 602 may display a video frame of the movie a, and unlike the interface 202, the interface 602 in this embodiment further displays the playing time and/or the playing progress of the movie a. Illustratively, the playing time of movie a is 30s, and the playing progress can be represented by a prior art progress bar, such as 1/2.
Optionally, the smart device may display the playing time and/or the playing progress of the currently played slice resource after receiving a request for displaying the playing time and/or the playing progress input by the user. If the user selects an ok control on the remote controller, a request for displaying the playing time length and/or the playing progress is input to the carousel application layer processor. Or, if the user clicks an interface of the intelligent terminal, the request for displaying the playing time length and/or the playing progress is input to the carousel application layer processor.
In a possible implementation manner, the resource carousel in this embodiment may adopt an existing HTTP-based streaming media network transmission protocol, that is, an hls (HTTP Live streaming) protocol. Wherein, the request address of at least one slice resource of at least one sub-resource, the time information of each slice resource and the play order identifier of the slice resource included in the carousel response may all be encapsulated in a list file, such as an m3u8 list file.
Correspondingly, after receiving the carousel request from the intelligent device, the server may write the request address of at least one slice resource of at least one sub-resource to be sent, the time information of each slice resource, and the play sequence identifier into the list file according to the number of slice resources allowed to be carried in the carousel response. It should be understood that the server may slice the multimedia resources to be played in turn in advance, store the time information of each slice resource, and generate and store the playing sequence identifier of each slice resource correspondingly. After receiving the carousel request, the time information and the play sequence identifier of the to-be-sent slice resource can be obtained, and the time information and the play sequence identifier of the to-be-sent slice resource and the request address of the slice resource are written into the list file.
After the intelligent device obtains the download address of the list file from the server, the list file can be downloaded according to the download address. In view of the fact that the list file is obtained by the server through the HLS protocol, correspondingly, the intelligent device analyzes the list file through the HLS protocol to obtain a request address of at least one slice resource of at least one sub resource, time information of each slice resource, and a play sequence identifier.
In this embodiment, one possible implementation manner for the intelligent device to obtain the playing duration and/or the playing progress of the currently played slice resource is as follows: the server may identify, by using the time information of each slice resource and the playing sequence of the slice resource, where the time information includes a playing start time of the slice resource in the sub-resource to which the slice resource belongs and a total playing duration of the sub-resource to which the slice resource belongs, determine a playing duration and/or a playing progress of each resource frame in each slice resource, and correspondingly, may store the playing duration and/or the playing progress of each resource frame in each slice resource in a carousel response and send the carousel response to the smart device.
It is conceivable that, after receiving the carousel response, the intelligent device may display the playing duration and/or the playing progress of the currently played slice resource according to the playing duration and/or the playing progress corresponding to the resource frame of the currently played slice resource, that is, the playing duration and/or the playing progress corresponding to the resource frame of the currently played slice resource.
The following describes a specific manner in which the smart device displays the playing duration and/or the playing progress of the currently played slice resource according to the time information of the currently played slice resource in this embodiment:
optionally, fig. 7 is a schematic flow chart illustrating the process of obtaining the playing time and/or the playing progress of the slice resource played before being obtained. As shown in fig. 7, the above S504 may include:
s5041, a played time of the currently played slice resource is acquired.
In this embodiment, a first possible implementation manner for obtaining the played time of the currently played slice resource is as follows: and determining the played time of the currently played resource frame of the currently played slice resource relative to the played time of the first resource frame of the currently played slice resource as the played time.
For example, taking the slice resource 1 of the movie a as an example, taking the first resource frame of the slice resource 1 as an example, and taking the played time of the currently played resource frame relative to the first resource frame as 3s, the played time of the currently played slice resource is 3 s.
Optionally, in this embodiment, the played Time of the resource frame currently being played relative to the first resource frame of the slice resource currently being played may be calculated by using Time Stamp information of the resource frame, such as (Presentation Time Stamp, PTS), of the current resource frame relative to the played Time of the first resource frame.
In this embodiment, a second possible implementation manner for obtaining the played time of the currently played slice resource is as follows: and taking the played time of the currently played slice resource represented by the system clock as the played time.
Illustratively, taking the slice resource 1 of the movie a as an example, taking the first resource frame of the slice resource 1 as 10s as an example, the time represented by the system clock starting to play the first resource frame is 10 o 'clock 30 min 30s, and the time represented by the system clock playing the current frame is 10 o' clock 30 min 33s, then the played time of the currently played slice resource represented by the system clock is 3 s.
S5042, obtaining a playing duration of a currently played slice resource according to a playing start time and a played time of the currently played slice resource in the sub-resource to which the currently played slice resource belongs; and/or acquiring the playing progress of the currently played slice resource according to the playing time length of the currently played slice resource and the total playing time length of the sub-resource to which the currently played slice resource belongs.
In this embodiment, since the carousel response includes the play start time of each slice resource in the sub resource to which the slice resource belongs, the intelligent device may obtain the play start time and the played time of the currently played slice resource in the sub resource to which the slice resource belongs, and obtain the play duration of the currently played slice resource. Illustratively, the playing start time of the currently playing slice resource in the sub-resource is 30s, the played time of the currently playing slice resource is 3s, and the playing duration of the currently playing slice resource is 33 s.
After the intelligent device obtains the playing time length of the currently played slice resource, the playing progress of the currently played slice resource can be obtained by combining the total playing time length of the sub-resource to which the currently played slice resource belongs. Illustratively, as described above, if the playing time length of the currently played slice resource is 33s, and the total playing time length of the sub-resource belonging to the currently played slice resource is 60s, the playing progress of the currently played slice resource is 33s/60 s-55%.
In a possible implementation manner of this embodiment, the slice resource in this embodiment also carries an identifier of a sub-resource to which the slice resource belongs, and the identifiers of the playing sequences of the slice resources of one sub-resource are different. The smart device may recalculate the play duration and/or the play progress when the smart device determines that the currently played slice resource and the last played slice resource belong to different sub-resources. Illustratively, a slice resource 6 of movie a, a slice resource 1 of movie b, and a slice resource 2 are included in the carousel response. Correspondingly, when the smart device plays the slice resource 1 of the movie b, considering that the slice resource is different from the sub-resource to which the slice resource 6 played last belongs, in this embodiment, the playing progress of the last sub-resource may be cleared by 0, and the playing duration and/or the playing progress of the sub-resource movie b may be restarted to be calculated.
In the above embodiments, it is described by taking an example that the smart device sends a carousel request to the server, for example, after the smart device requests to acquire the slice resources 1, 2, and 3 of the sub-resource movie a, the smart device needs to request again to acquire the slice resources 2, 3, and 4 of the movie a, that is, when the smart device continuously sends a carousel request to the server, the server returns a carousel response to the smart device, so that the smart device can continuously play the multimedia resource to be carousel.
The time for the intelligent device to send the carousel request to the server again may be: and if the rest of the slice resources with the preset number are not played in the received slice resources, sending a new carousel request to the server. Illustratively, if the preset number is 2, a new carousel request is sent to the server when the slice resource 1 is played (slice resources 2 and 3 are left unplayed). Or,
the time information of the slice resource in this embodiment further includes: and the playing termination time of the slice resource in the sub-resource. Correspondingly, the intelligent device may send a new carousel request to the server when determining that the resource of the currently played slice resource that has the remaining preset time is not played according to the play start time and the play end time of the currently played slice resource in the sub-resource to which the currently played slice resource belongs. Illustratively, if the remaining preset time is 2s, a new carousel request is sent to the server when the playing slice resource 1 still has 2s (if the total duration of the slice resource 1 is 10s, and the currently playing is 8 s).
Wherein the new carousel request is used for requesting multimedia resources to be carousel. It should be understood that, after receiving the new carousel request, the server may send, according to the number of slice resources allowed to be carried in the carousel response, a request address of at least one slice resource of at least one new sub-resource to be sent, time information of each slice resource, and a play order identifier to the intelligent device.
Correspondingly, after the smart device receives a new carousel response to be sent from the server, the playing duration and/or the playing progress of the currently played slice resource may be displayed in the manners in S503 and S504.
Optionally, fig. 8 is a schematic structural diagram of a server provided in the present application. As shown in fig. 8, the server may include a list file update module, a resource parsing module, and a storage module. After the server receives the new carousel request, the list file update module may update the list file (m3u8 file) according to the HLS protocol specification. Specifically, the list file updating module may call the resource parsing module, and for example, the list file updating module sends an update request to the resource parsing module. After the resource analysis module receives the update request, the time information and the sequential carousel identifier of the slice resource to be sent can be acquired in the storage module, so that the time information and the sequential carousel identifier of the slice resource to be sent are sent to the list file update module. The list updating module can write the time information and the sequential carousel identifier of the slice resource to be sent into a list file, and the list file is an updated list file.
Illustratively, the storage module stores therein time information and sequential carousel identification of a plurality of slice resources of the multimedia resource to be carousel. Table one is an exemplary storage method:
watch 1
Figure GDA0003707941600000161
Taking a1(0-10s, 60s) as an example, where a1 is the sequential carousel identifier of the slice resource, 0-10s are the start playing time and the end playing time of the slice resource in the sub-resource to which the slice resource belongs, and 60s is the total playing time of the sub-resource to which the slice resource belongs.
The method for multimedia resource carousel provided by the embodiment comprises the following steps: sending a carousel request to a server, and receiving a carousel response sent by the server, wherein the carousel response comprises a request address of at least one slice resource of at least one sub-resource; receiving a target slice resource according to the request address of the at least one slice resource, wherein the target slice resource is an unrequested slice resource in the at least one slice resource; and playing the requested target slice resources according to the playing sequence of the requested target slice resources, and displaying the playing time length and/or the playing progress of the currently played slice resources. The method for the multimedia resource carousel in the embodiment can achieve the purpose of displaying the resource playing time and/or the resource playing progress in the resource carousel process. Further, specifically, the server may also send time information of the slice resource when sending the slice resource to the intelligent device, so that the intelligent device may display the playing time and/or the playing progress of the currently played slice resource according to the time information, and further, the purpose of displaying the resource playing time and/or the playing progress in the resource carousel process may be achieved.
On the basis of the above embodiments, the following further explains the multimedia resource carousel method provided by the present application from the internal structure of the smart device. First, a method for carousel multimedia resources is described when an intelligent device includes a carousel application layer processor and a player. Fig. 9 is a schematic interaction flow diagram of a multimedia resource carousel method according to the present application. As shown in fig. 9, the method for multimedia resource carousel includes:
s901, the carousel application layer processor sends a carousel request to the player.
In this embodiment, a carousel application is installed in the intelligent device. And when the carousel application layer processor receives a carousel request input by a user, forwarding the carousel request to the player. The carousel request input by the user refers to an action that the user triggers the intelligent device to send the carousel request to the server in the above embodiment. Illustratively, the carousel request is input by a user through a control device (e.g., a remote control), a physical action, or voice interaction.
S902, the player sends a carousel request to the server.
S903, the server sends a carousel response to the player, the carousel response includes a download address of a list file, and the list file includes a request address of at least one slice resource of at least one sub resource, time information of each slice resource, and a play sequence identifier.
Correspondingly, the player receives a carousel response from the server.
S904, the player downloads the list file according to the download address of the list file.
Optionally, fig. 10 is a schematic structural diagram of a player provided in the present application, where the player may include: the device comprises a list file analyzing module, a downloading module, a decoding module, a buffering module, a graph pushing module, a storage module, a calculating module and a display module.
The downloading module is used for downloading the list file.
S905, the player analyzes the list file, and obtains a request address of at least one slice resource of at least one sub resource, time information of each slice resource and a playing sequence identifier.
Correspondingly, the list file analyzing module is used for analyzing the list file according to the HLS protocol, and further acquiring a request address of at least one slice resource of at least one sub-resource, time information of each slice resource and a playing sequence identifier.
S906, the player receives the target slice resource according to the request address of at least one slice resource of the at least one sub-resource.
It should be understood that, in this embodiment, according to the request address of at least one slice resource of at least one sub-resource, the specific manner of requesting the target slice resource may be to download the target slice resource according to the request address of the at least one slice resource.
Specifically, the downloading module is further configured to download the target slice resource. Correspondingly, the decoding module is used for decoding the target slice resource and sending the target slice resource to the buffer module; the storage module is further configured to store the acquired time information and the playing sequence identifier of each slice resource.
It should be understood that the manner in which the server encodes the video frames and the manner in which the player decodes the video frames may be pre-agreed.
S907, the player plays the received target slice resource according to the playing sequence identifier of the received target slice resource, and displays the playing duration and/or the playing progress of the currently played slice resource according to the time information of the currently played slice resource.
Correspondingly, the target slice resource entering the buffer module is pushed to the display module by the image pushing module, i.e. the received (downloaded) target slice resource is played.
The computing module can execute the actions of the intelligent device, and further acquire the playing time and/or playing progress of the currently played slice resource according to the time information of each slice resource stored by the storage module, and send the playing time and/or playing progress to the display module for displaying.
Optionally, in this embodiment, after the player receives the request for displaying the playing time length and/or the playing progress sent by the carousel application layer processor, the player may perform the operation of calculating and displaying the playing time length and/or the playing progress of the currently played slice resource. It should be understood that the request for displaying the playing time and/or the playing progress sent by the carousel application layer processor may be sent by the carousel application layer processor after receiving the request for displaying the playing time and/or the playing progress input by the user. If the user selects an ok control on the remote controller, a request for displaying the playing time length and/or the playing progress is input to the carousel application layer processor. Or, for example, the user clicks an interface of the intelligent terminal, that is, a request for displaying the playing time length and/or the playing progress is input to the carousel application layer processor.
It should be understood that, in this embodiment, the player may perform the actions performed by the smart device in the foregoing embodiment, and reference may be made to the relevant descriptions in S501 to S504 in the foregoing embodiment for S902 to S907 in this embodiment, which are not described herein again.
In this embodiment, the slave intelligent device includes a carousel application layer processor and a player, and a web proxy module is provided in the carousel application layer, and the web proxy module interacts with the server and the player respectively to complete the carousel of the resource and the display of the play duration and/or the play progress. Fig. 11 is a third schematic view of an interaction flow of the multimedia resource carousel method provided in the present application. As shown in fig. 11, the method for multimedia resource carousel includes:
s1101, the player sends a carousel request to the web proxy module, wherein the carousel request is used for requesting multimedia resources to be carousel, the carousel request comprises an identifier of the multimedia resources to be carousel, and the multimedia resources to be carousel comprise at least one sub-resource.
It should be understood that the main function of the web proxy module in this embodiment is to virtualize a web proxy server, i.e. http web server, locally on the intelligent device side. Correspondingly, when receiving a carousel request input by a user, the web proxy module may generate a local proxy address corresponding to the multimedia resource to be carousel, that is, an address of the web proxy module, according to the multimedia resource to be carousel in the carousel request. The web proxy module calls the player to initiate a carousel request by using the local proxy address, namely the web proxy module sends the carousel request to the player, and after the player receives the play request, the player requests the web proxy module for an m3u8 file, namely the carousel request is sent to the web proxy module.
S1102, the web proxy module forwards the carousel request to the server.
S1103, the web proxy module receives a second carousel response sent by the server, where the second carousel response includes at least one slice resource of at least one sub-resource, time information of each slice resource, and a play order identifier, and the time information includes a play start time of the slice resource in the sub-resource to which the slice resource belongs and a total play duration of the sub-resource to which the slice resource belongs.
It should be understood that, in order to distinguish the carousel responses in this embodiment, the web proxy module receives the carousel response sent by the server as the second carousel response, and the web proxy module sends the carousel response to the player as the first carousel response.
The second carousel response is the same as the carousel response sent by the server to the smart device in the above embodiment.
S1104, the web proxy module sends a first carousel response to the player, where the first carousel response includes at least one slice resource of the at least one sub resource and a playing sequence identifier of each slice resource.
Correspondingly, the player receives a first carousel response sent by the web proxy module. In view of the fact that the web proxy module calculates and obtains the playing time length and/or the playing progress of the currently played slice resource in this embodiment, the web proxy module may send at least one slice resource of at least one sub-resource in the second carousel response and the playing sequence identifier of each slice resource to the player.
In this embodiment, in a possible implementation manner, the sending, by the web proxy module, the first carousel response to the player may include:
the web proxy module sends the list file to the player. The list file comprises a virtual address of at least one slice resource of at least one sub resource and a playing sequence identifier of each slice resource, and the virtual address is a local address corresponding to the web proxy module. After the player parses the list file, in view of the local address corresponding to the web proxy module requested by the player, the player parses the obtained virtual address of the at least one slice resource of the at least one sub-resource as the local address corresponding to the web proxy module. Thus, the player also sends a slice resource request to the web proxy module to request at least one slice resource of the at least one sub-resource in the list file.
Correspondingly, after receiving the slice resource request sent by the player, the web proxy module may forward the slice resource request to the server. And after receiving the slice resource request, the server sends at least one slice resource of the at least one sub-resource to the web proxy module. Correspondingly, after the web proxy module receives the at least one slice resource of the at least one sub-resource, the at least one slice resource of the at least one sub-resource may be sent to the player.
S1105, the web proxy module obtains the playing time and/or playing progress of the currently played slice resource according to the time information of the currently played slice resource of the player.
It should be understood that, in the embodiment, reference may be made to relevant description in the second possible implementation manner in S504 in the above embodiment for the way that the web proxy module calculates and acquires the playing time and/or the playing progress of the currently played slice resource, and this implementation manner may avoid a problem that, in the first possible implementation manner, the player needs to call an interface of the map pushing module to query the PTS information of the resource frame to implement the calculation each time the player calculates the playing time and/or the playing progress of the currently played slice resource. In a second possible implementation manner, the playing duration and/or the playing progress of the currently played slice resource can be obtained only by calculating according to the time information represented by the system clock when the first frame starts.
S1106, the web proxy module sends the playing time length and/or the playing progress of the currently played slice resource to the player.
S1107, the player plays the slice resources according to the playing sequence identifier of the slice resources, and displays the playing duration and/or the playing progress of the currently played slice resources according to the time information of the currently played slice resources sent by the web proxy module.
In this embodiment, the web agent module executes a process of obtaining the playing duration and/or the playing progress of the currently played slice resource, so that the carousel application layer of the intelligent device can also sense the time information of the slice resource.
Corresponding to the foregoing embodiment, when the intelligent device sends a new carousel request to the server, if a preset number of slice resources remain and are not played, the player may send the new carousel request to the web proxy module, so that the web proxy module sends the new carousel request to the server; or,
and when determining that the resource with the residual preset time of the currently played slice resource is not played according to the playing start time and the playing end time of the currently played slice resource in the sub-resource, the player sends a new carousel request to the web proxy module so that the web proxy module sends the new carousel request to the server.
Optionally, in this embodiment, after receiving the second carousel response sent by the server, the web proxy module may set the total play duration of each sub-resource. Specifically, the storage may be in the form of key-value, where key is an identifier of the sub-resource, and value is a total playing time length of the sub-resource.
In this embodiment, an interface for querying the total playing time of the sub-resource may be added to the web proxy module, and according to the above design, the carousel application may already know the playing progress of the sub-resource when the current sub-resource is played, that is, it is known that the sub-resource is played too long and remains not played for a long time. When the player detects that the current sub-resource is played completely, the next sub-resource starts to be played, the player can request the time length information of the sub-resource from the web proxy module, and the web proxy module queries the key-value storage list according to the identifier of the requested sub-resource to complete the instant update of the total playing time length of the sub-resource.
Optionally, at any time when the sub-resource is played, the player may send a request for querying the total playing time of the sub-resource to the web proxy module. Corresponding to the scene, the player sends a query request to the web proxy module. The query request is used for requesting the total playing time length of the sub-resource to which the currently played slice resource belongs.
After receiving the query request sent by the player, the player may send the total playing time length of the sub-resource to which the currently played slice resource belongs to the player, and correspondingly, after receiving the total playing time length of the sub-resource to which the currently played slice resource belongs, the player may display the total playing time length of the sub-resource to which the currently played slice resource belongs.
Fig. 12 is a schematic structural diagram of an apparatus for carousel of multimedia resources according to the present application. The apparatus for multimedia resource carousel may be an intelligent device in the foregoing embodiment. As shown in fig. 12, the apparatus 1200 for multimedia resource carousel includes: a transceiver module 1201, a processing module 1202, and a display module 1203.
The transceiving module 1201 is configured to send a carousel request to a server, where the carousel request is used to request a multimedia resource to be carousel, and the multimedia resource to be carousel includes at least one sub-resource.
The transceiver module 1201 is further configured to receive a carousel response sent by the server, where the carousel response includes a request address of at least one slice resource of at least one sub-resource.
A processing module 1202 is configured to receive a target slice resource according to a request address of at least one slice resource.
The display module 1203 is configured to play the received target slice resource according to the playing order of the received target slice resource, and display the playing duration and/or the playing progress of the currently played slice resource.
Optionally, the carousel response further includes time information and a playing sequence identifier of each slice resource, where the time information includes a playing start time of the slice resource in the sub resource to which the slice resource belongs and a total playing duration of the sub resource to which the slice resource belongs.
Optionally, the display module 1203 is specifically configured to obtain a played time of the currently played slice resource; acquiring the playing time length of the currently played slice resource according to the playing start time and the played time of the currently played slice resource in the sub-resource to which the currently played slice resource belongs; and/or acquiring the playing progress of the currently played slice resource according to the playing time length of the currently played slice resource and the total playing time length of the sub-resource to which the currently played slice resource belongs.
Optionally, the display module 1203 is specifically configured to determine a played time of a currently played resource frame of the currently played slice resource relative to a first resource frame of the currently played slice resource as the played time.
Optionally, the display module 1203 is specifically configured to use the played time of the currently played slice resource represented by the system clock as the played time.
Optionally, the slice resource also carries an identifier of a sub-resource to which the slice resource belongs, and the identifiers of the playing order of the slice resources of one sub-resource are different.
The transceiver module 1201 is further configured to send a new carousel request to the server if a preset number of slice resources remain and are not played in the received slice resources, where the new carousel request is used to request a multimedia resource to be carousel.
Optionally, the time information further includes: and the playing termination time of the slice resource in the sub-resource.
Correspondingly, the transceiver module 1201 is further configured to, when determining that the resource of the currently played slice resource that has the remaining preset time is not played according to the play start time and the play end time of the current slice resource in the sub-resource to which the current slice resource belongs, send a new carousel request to the server, where the new carousel request is used to request the multimedia resource to be carousel.
Optionally, the carousel response includes a download address of a list file, and the list file includes a request address of at least one slice resource of at least one sub resource, time information of each slice resource, and a play sequence identifier.
The processing module 1202 is specifically configured to receive a download address of the list file from the server, download the list file, analyze the list file, and obtain a request address of at least one slice resource of the at least one sub resource, time information of each slice resource, and a play sequence identifier.
Fig. 13 is a schematic structural diagram of another apparatus for multimedia resource carousel according to the present application. The device for multimedia resource carousel may be the server in the above embodiment. As shown in fig. 13, the apparatus 1300 for carousel of multimedia resources comprises: a transceiver module 1301 and a processing module 1302.
The transceiver module 1301 is configured to receive a carousel request sent by the intelligent device, and send a carousel response to the intelligent device according to an identifier of a multimedia resource to be carousel; the carousel request is used for requesting a multimedia resource to be carousel, the multimedia resource to be carousel includes at least one sub-resource, and the carousel response includes a request address of at least one slice resource of the at least one sub-resource.
Optionally, the carousel response further includes time information and a playing sequence identifier of each slice resource, where the time information includes a playing start time of the slice resource in the sub resource to which the slice resource belongs and a total playing duration of the sub resource to which the slice resource belongs.
Optionally, the processing module 1302 is configured to write, according to the number of slice resources allowed to be carried in the carousel response, a request address of at least one slice resource of at least one sub-resource to be sent, time information of each slice resource, and a play sequence identifier into the list file;
correspondingly, the transceiver module 1301 is further configured to encapsulate the download address of the list file in a carousel response and send the carousel response to the intelligent device.
Optionally, the slice resource also carries an identifier of a sub-resource to which the slice resource belongs, and the identifiers of the playing order of the slice resources of one sub-resource are different.
Optionally, the transceiver module 1301 is further configured to receive a new carousel request sent by the intelligent device.
The principle and technical effect of the apparatus for multimedia resource carousel provided in this embodiment are similar to those of the method for multimedia resource carousel, and are not described herein again.
Fig. 14 is a schematic structural diagram of an electronic device provided in the present application. The electronic device may be the carousel apparatus for multimedia resources in fig. 12 or fig. 13. As shown in fig. 14, the electronic device 1400 includes: a memory 1401, and at least one processor 1402.
Memory 1401 for storing program instructions.
The processor 1402 is configured to implement the method for multimedia resource carousel in this embodiment when the program instructions are executed, and specific implementation principles may be referred to the foregoing embodiments, which are not described herein again.
The electronic device 1400 may also include input/output interfaces 1403.
The input/output interface 1403 may include a separate output interface and input interface, or may be an integrated interface that integrates input and output. The output interface is used for outputting data, the input interface is used for acquiring input data, the output data is a general name output in the method embodiment, and the input data is a general name input in the method embodiment.
The present application further provides an intelligent display device, including: a display;
the system comprises a transceiver and a server, wherein the transceiver is configured to send a carousel request to the server, the carousel request is used for requesting multimedia resources to be carousel, and the multimedia resources to be carousel comprise at least one sub-resource; receiving a carousel response sent by the server, wherein the carousel response comprises a request address of at least one slice resource of at least one sub-resource;
and the controller is configured to request a target slice resource according to the request address of the at least one slice resource, control to play the received target slice resource according to the playing sequence of the received target slice resource, and display the playing time length and/or the playing progress of the currently played slice resource.
It should be understood that the transceiver in this embodiment is configured to perform the actions of the transceiver module described above, the controller is configured to perform the actions of the processing module described above, and the display is used to perform the actions of the display module described above.
The principle and technical effect of the intelligent display device provided in this embodiment are similar to those of the apparatus for multimedia resource carousel in fig. 12, and are not described herein again.
The present application further provides a readable storage medium, in which execution instructions are stored, and when at least one processor of an electronic device executes the execution instructions, when the computer execution instructions are executed by the processor, the method for multimedia resource carousel in the foregoing embodiments is implemented.
The present application also provides a program product comprising execution instructions stored in a readable storage medium. The at least one processor of the electronic device may read the execution instruction from the readable storage medium, and the execution of the execution instruction by the at least one processor causes the electronic device to implement the method for multimedia resource carousel provided by the various embodiments described above.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is merely a logical division, and in actual implementation, there may be other divisions, for example, multiple modules or components may be combined or integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or modules, and may be in an electrical, mechanical or other form.
The modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical modules, may be located in one place, or may be distributed on a plurality of network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.
In addition, functional modules in the embodiments of the present application may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware form, and can also be realized in a form of hardware and a software functional module.
The integrated module implemented in the form of a software functional module may be stored in a computer-readable storage medium. The software functional module is stored in a storage medium and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) or a processor (processor) to execute some steps of the methods according to the embodiments of the present application. And the aforementioned storage medium includes: a U disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In the above-mentioned embodiment of the apparatus for multimedia resource carousel, it should be understood that the Processor may be a Central Processing Unit (CPU), or may be other general-purpose processors, Digital Signal Processors (DSP), Application Specific Integrated Circuits (ASIC), etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present application may be embodied directly in a hardware processor, or in a combination of the hardware and software modules in the processor.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

Claims (12)

1. A method for multimedia resource carousel, comprising:
sending a carousel request to a server, wherein the carousel request is used for requesting a multimedia resource to be carousel, and the multimedia resource to be carousel comprises at least one sub-resource;
receiving a carousel response sent by the server, where the carousel response includes a request address of at least one slice resource of at least one of the sub-resources, time information of each slice resource, and a play sequence identifier, and the time information includes a play start time of the slice resource in the sub-resource to which the slice resource belongs, a total play duration of the sub-resource to which the slice resource belongs, and a play end time of the slice resource in the sub-resource to which the slice resource belongs;
receiving a target slice resource according to the request address of the at least one slice resource, wherein the target slice resource is an unreceived slice resource in the at least one slice resource;
playing the received target slice resources according to the playing sequence identification of the received target slice resources;
acquiring the played time of the currently played slice resource;
acquiring the playing time length of the currently played slice resource according to the playing start time of the currently played slice resource in the sub-resource and the played time; and/or the presence of a gas in the gas,
acquiring the playing progress of the currently played slice resource according to the playing duration of the currently played slice resource and the total playing duration of the sub-resource to which the currently played slice resource belongs;
if the slice resources with the preset number are not played in the received slice resources, sending a new carousel request to the server, wherein the new carousel request is used for requesting the multimedia resources to be carousel;
and sending a new carousel request to the server when determining that the resource with the residual preset time of the currently played slice resource is not played according to the playing start time and the playing end time of the currently played slice resource in the sub-resource to which the currently played slice resource belongs, wherein the new carousel request is used for requesting the multimedia resource to be carousel.
2. The method of claim 1, wherein the obtaining the played time of the currently played slice resource comprises:
and determining the played time of the currently played resource frame of the currently played slice resource relative to the first resource frame of the currently played slice resource as the played time.
3. The method of claim 1, wherein the obtaining the played time of the currently played slice resource comprises:
and taking the played time of the currently played slice resource represented by the system clock as the played time.
4. The method according to any one of claims 1 to 3, wherein the slice resource further carries an identifier of a sub-resource to which the slice resource belongs, and the slice resource of one of the sub-resources has a different play order identifier.
5. The method according to any one of claims 1 to 3, wherein the carousel response includes a download address of a list file, the list file includes a request address of at least one slice resource of the at least one sub resource, time information of each slice resource, and a play order identifier, and before receiving a target slice resource according to the request address of the at least one slice resource, the method further includes:
receiving a download address of the list file from the server;
downloading the list file;
and analyzing the list file to obtain a request address of at least one slice resource of the at least one sub resource, time information of each slice resource and a playing sequence identifier.
6. A method for multimedia resource carousel, comprising:
receiving a carousel request sent by an intelligent device, wherein the carousel request is used for requesting a multimedia resource to be carousel, and the multimedia resource to be carousel comprises at least one sub-resource;
sending a carousel response to the intelligent device, where the carousel response includes a request address of at least one slice resource of at least one of the sub-resources, time information of each slice resource, and a playing sequence identifier of the slice resource, and the time information includes a playing start time of the slice resource in the sub-resource to which the slice resource belongs, a total playing duration of the sub-resource to which the slice resource belongs, and a playing end time of the slice resource in the sub-resource to which the slice resource belongs;
and receiving a new carousel request sent by the intelligent equipment.
7. The method of claim 6, wherein the carousel response includes a download address of the list file, and wherein sending the carousel response to the smart device comprises:
writing a request address of at least one slice resource of at least one sub resource to be sent, time information of each slice resource and a playing sequence identifier into the list file according to the number of slice resources allowed to be carried in the carousel response;
and encapsulating the download address of the list file in the carousel response and sending the carousel response to the intelligent equipment.
8. The method according to claim 6, wherein the slice resource further carries an identifier of a sub-resource to which the slice resource belongs, and the slice resource of one of the sub-resources has a different play order identifier.
9. An apparatus for multimedia resource carousel, comprising:
a receiving and sending module, configured to send a carousel request to a server, and receive a carousel response sent by the server, where the carousel request is used to request a multimedia resource to be carousel, the multimedia resource to be carousel includes at least one sub-resource, the carousel response includes a request address of at least one slice resource of the at least one sub-resource, time information of each slice resource, and a play sequence identifier, and the time information includes a play start time of the slice resource in the sub-resource to which the slice resource belongs, a total play duration of the sub-resource to which the slice resource belongs, and a play end time of the slice resource in the sub-resource to which the slice resource belongs;
the processing module is used for receiving a target slice resource according to the request address of the at least one slice resource, wherein the target slice resource is a slice resource which is not received in the at least one slice resource;
the display module is used for playing the received target slice resources according to the playing sequence identification of the received target slice resources and displaying the playing duration and/or the playing progress of the currently played slice resources according to the time information of the currently played slice resources;
the display module is specifically configured to obtain a played time of the currently played slice resource; acquiring the playing time length of the currently played slice resource according to the playing start time of the currently played slice resource in the sub-resource and the played time; and/or acquiring the playing progress of the currently played slice resource according to the playing time length of the currently played slice resource and the total playing time length of the sub-resource to which the currently played slice resource belongs;
the receiving and sending module is further configured to send a new carousel request to the server in the received slice resources if a preset number of remaining slice resources are not played, where the new carousel request is used to request the multimedia resources to be carousel;
the receiving and sending module is further configured to send a new carousel request to the server when determining that the currently played slice resource has a resource with a remaining preset time that is not played according to the play start time and the play end time of the currently played slice resource in the sub-resource to which the currently played slice resource belongs, where the new carousel request is used for requesting the multimedia resource to be carousel.
10. An intelligent display device, comprising:
a display;
the system comprises a transceiver and a server, wherein the transceiver is configured to send a carousel request to the server, the carousel request is used for requesting multimedia resources to be carousel, and the multimedia resources to be carousel comprise at least one sub-resource; receiving a carousel response sent by the server, where the carousel response includes a request address of at least one slice resource of at least one of the sub-resources, time information of each slice resource, and a play sequence identifier, and the time information includes a play start time of the slice resource in the sub-resource to which the slice resource belongs, a total play duration of the sub-resource to which the slice resource belongs, and a play end time of the slice resource in the sub-resource to which the slice resource belongs;
the transceiver is further configured to send a new carousel request to a server if a preset number of slice resources remain and are not played in the received slice resources, where the new carousel request is used to request the multimedia resources to be carousel; or, the server is further configured to send a new carousel request to the server when determining that the currently played slice resource has a resource with a remaining preset time that is not played according to the playing start time and the playing end time of the currently played slice resource in the sub-resource to which the currently played slice resource belongs, where the new carousel request is used for requesting the multimedia resource to be carousel;
the controller is configured to control a request target slice resource according to a request address of the at least one slice resource, and control playing of the received target slice resource according to a playing sequence identifier of the received target slice resource, wherein the target slice resource is an unreceived slice resource in the at least one slice resource, and the played time of the currently played slice resource is acquired; acquiring the playing time length of the currently played slice resource according to the playing start time of the currently played slice resource in the sub-resource and the played time; and/or acquiring the playing progress of the currently played slice resource according to the playing time length of the currently played slice resource and the total playing time length of the sub-resource to which the currently played slice resource belongs.
11. An electronic device, comprising: at least one processor and memory;
the memory stores computer-executable instructions;
the at least one processor executing the computer-executable instructions stored by the memory causes the electronic device to perform the method of any of claims 1-5 or any of claims 6-8.
12. A computer-readable storage medium having computer-executable instructions stored thereon which, when executed by a processor, implement the method of any one of claims 1-5 or 6-8.
CN201911220822.XA 2019-12-03 2019-12-03 Method and device for multimedia resource carousel, electronic equipment and storage medium Active CN111010620B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911220822.XA CN111010620B (en) 2019-12-03 2019-12-03 Method and device for multimedia resource carousel, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911220822.XA CN111010620B (en) 2019-12-03 2019-12-03 Method and device for multimedia resource carousel, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN111010620A CN111010620A (en) 2020-04-14
CN111010620B true CN111010620B (en) 2022-08-02

Family

ID=70113923

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911220822.XA Active CN111010620B (en) 2019-12-03 2019-12-03 Method and device for multimedia resource carousel, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN111010620B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113271489A (en) * 2021-06-15 2021-08-17 青岛聚看云科技有限公司 Method for automatically and alternately broadcasting materials and display equipment
CN115243077A (en) * 2022-07-21 2022-10-25 平安信托有限责任公司 Audio and video resource on-demand method and device, computer equipment and storage medium

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101794486B1 (en) * 2010-04-01 2017-11-06 소니 주식회사 Image processing device, method and recording medium
US8930492B2 (en) * 2011-10-17 2015-01-06 Blackberry Limited Method and electronic device for content sharing
CN103747285A (en) * 2013-12-27 2014-04-23 乐视网信息技术(北京)股份有限公司 Program playing method, server side and client
CN105872677A (en) * 2015-12-30 2016-08-17 乐视网信息技术(北京)股份有限公司 Multichannel video information displaying method and device

Also Published As

Publication number Publication date
CN111010620A (en) 2020-04-14

Similar Documents

Publication Publication Date Title
NL2016051B1 (en) Live-stream video advertisement system
EP3501014A1 (en) Secondary content insertion in 360-degree video
CN111901674A (en) Video playing control and device
US9367125B2 (en) Terminal apparatus for shooting and distributing video data and video-data distribution method
CN111601136B (en) Video data processing method and device, computer equipment and storage medium
CN113767639B (en) Method, apparatus and non-volatile computer readable medium for receiving media data
US10116719B1 (en) Customized dash manifest
US10104143B1 (en) Manifest segmentation
CN106791988B (en) Multimedia data carousel method and terminal
US20220060532A1 (en) Method for transmitting resources and electronic device
CN112616065B (en) Screen image initiating method, device and system and readable storage medium
EP2903260A1 (en) Multi-speed playing method, device and system
CN111010620B (en) Method and device for multimedia resource carousel, electronic equipment and storage medium
JP7252373B2 (en) Method, apparatus and computer program for receiving media data for media content
CN103747285A (en) Program playing method, server side and client
CN113141523A (en) Resource transmission method, device, terminal and storage medium
KR20220131314A (en) Methods and devices for streaming media
JP7290260B1 (en) Servers, terminals and computer programs
CN111131845A (en) Method, electronic device and storage medium for multimedia resource carousel
KR101314939B1 (en) Method for provisioning a multimedia service
US20180324480A1 (en) Client and Method for Playing a Sequence of Video Streams, and Corresponding Server and Computer Program Product
CN108574881B (en) Projection type recommendation method, server and client
CN115643429A (en) Video playing method and device, electronic equipment and computer readable storage medium
KR20200135324A (en) Information processing devices, information processing devices and programs
CN113364728B (en) Media content receiving method, device, storage medium and computer equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 266555 Qingdao economic and Technological Development Zone, Shandong, Hong Kong Road, No. 218

Applicant after: Hisense Visual Technology Co., Ltd.

Address before: 266555 Qingdao economic and Technological Development Zone, Shandong, Hong Kong Road, No. 218

Applicant before: QINGDAO HISENSE ELECTRONICS Co.,Ltd.

SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant