CN108632644B - Preview display method and device - Google Patents

Preview display method and device Download PDF

Info

Publication number
CN108632644B
CN108632644B CN201710170348.9A CN201710170348A CN108632644B CN 108632644 B CN108632644 B CN 108632644B CN 201710170348 A CN201710170348 A CN 201710170348A CN 108632644 B CN108632644 B CN 108632644B
Authority
CN
China
Prior art keywords
preview
client
preview image
information
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710170348.9A
Other languages
Chinese (zh)
Other versions
CN108632644A (en
Inventor
徐玉丰
顾迎节
周爱彬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201710170348.9A priority Critical patent/CN108632644B/en
Priority to PCT/CN2018/078446 priority patent/WO2018171437A1/en
Publication of CN108632644A publication Critical patent/CN108632644A/en
Application granted granted Critical
Publication of CN108632644B publication Critical patent/CN108632644B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/835—Generation of protective data, e.g. certificates
    • H04N21/8355—Generation of protective data, e.g. certificates involving usage data, e.g. number of copies or viewings allowed
    • H04N21/83555—Generation of protective data, e.g. certificates involving usage data, e.g. number of copies or viewings allowed using a structured language for describing usage rules of the content, e.g. REL
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8455—Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL

Abstract

The embodiment of the invention provides a method for displaying a preview, which comprises the steps that a client side obtains an index file of a video program from a server, wherein the index file contains description information of the preview; the client acquires a preview according to the preview description information; and the client displays the preview picture according to the user operation instruction. The method includes the description information of the preview image in the index file of the video program, so that the client can directly acquire the preview image according to the index file when playing the video according to the index file. The realization of the preview image is combined with the playing protocol, so that the consistency of user experience is ensured, the complexity of a video service provider for independently developing the preview image to realize the protocol is reduced, and the video service can be quickly online.

Description

Preview display method and device
Technical Field
The invention relates to the field of videos, in particular to a method and equipment for displaying a preview.
Background
With the development of the internet, video resources are more and more abundant, and in video playing, dragging a video progress by dragging a playing progress bar is a common user experience. In the process of dragging the video progress, many video service manufacturers provide a preview effect at present, and can accurately see a preview (video) of a video at a corresponding playing progress bar position, so as to help a user to quickly locate a desired content.
However, at present, preview image implementation protocols and video playing protocols provided by video service manufacturers are mutually independent, in addition, preview image information provided by the video service manufacturers is not uniform, implementation differences among the manufacturers are large, and consistency of user experience is not facilitated.
Disclosure of Invention
In view of this, it is actually necessary to provide a preview implementing method combined with a playing protocol, so as to ensure the consistency of user experience.
In a first aspect, a method for displaying a preview image is provided, including:
a client acquires an index file of a video program from a server, wherein the index file contains description information of a preview, and the index file is a Media Presentation Description (MPD) file in a DASH protocol;
the client acquires the preview image from the server according to the preview image description information;
and the client displays the preview according to the user operation instruction, for example, when the user drags the playing progress bar, the preview at the corresponding position is displayed. The method includes the description information of the preview image in the index file of the video program, so that the client can directly acquire the preview image according to the index file when playing the video according to the index file. The realization of the preview image is combined with the playing protocol, so that the consistency of user experience is ensured, the complexity of a video service provider for independently developing the preview image to realize the protocol is reduced, and the video service can be quickly online.
Optionally, the preview description information includes:
the address information of the preview image and the time information corresponding to the preview image, wherein the address information can be the position information stored in the preview image, and the time information corresponding to the preview image can comprise the corresponding time of the first preview image of the video and the time interval between the preview images. Therefore, when the client displays the preview images, which preview image needs to be displayed specifically can be determined according to the time information of the preview images and the position of the playing progress bar, so that the corresponding preview images are obtained for displaying, and the consistency of the displayed preview images and the video is ensured.
Optionally, the client may download the preview image from the server to the local in advance according to the address information of the preview image, and when the user drags the play progress bar, the client acquires the preview image of the corresponding time from the local, so that the preview image is displayed at a higher speed and in a higher real-time manner.
Optionally, when the user drags the playing progress bar, the client determines the address information of the corresponding preview image according to the position of the playing progress bar and the time information corresponding to the preview image, and downloads the preview image from the server according to the determined address information of the preview image. The optional mode can reduce the storage pressure of the client and save the storage space.
In a second aspect, a method for displaying a preview image is provided, which is applied to a server side, and includes:
the method comprises the steps that a server sends an index file of a video program to a client, wherein the index file is a Media Presentation Description (MPD) file of a DASH protocol, and the index file contains description information of a preview;
receiving a client preview downloading request;
and responding to the downloading request of the client, and sending the preview image to the client.
Optionally, the preview description information includes:
the address information of the preview image and the time information corresponding to the preview image.
Optionally, the method further includes:
the server generates a preview image and preview image description information according to the preview image generation rule.
Optionally, the preview generation rule includes:
preview interval time information and preview resolution information.
Optionally, the server may generate the preview image by directly capturing the video frames from the video file according to the interval time information and the resolution information of the preview image.
In a third aspect, a client device is provided, including:
the receiver is configured to obtain an index file of a video program from a server, where the index file is an MPD file of a DASH protocol and includes description information of a preview;
and the processor is used for acquiring the preview image from the server according to the preview image description information and displaying the preview image according to a user operation instruction.
Optionally, the preview description information includes:
the address information of the preview image and the time information corresponding to the preview image.
Optionally, the processor is specifically configured to:
and when the user drags the playing progress bar, displaying a corresponding preview according to the position of the playing progress bar.
Optionally, the processor is further configured to: and before the user drags the playing progress bar, downloading the preview image from the server according to the address information of the preview image.
Optionally, the processor is further configured to: when a user drags a playing progress bar, according to the position of the playing progress bar and the time information corresponding to the preview images, determining the address information of the corresponding preview images, and downloading the preview images from a server according to the determined address information of the preview images.
In a fourth aspect, a server is provided, comprising:
the device comprises a transmitter, a client and a server, wherein the transmitter is used for sending an index file of a video program to the client, the index file is an MPD (media distribution protocol) file of a DASH (digital video over coax) protocol, and the index file contains description information of a preview;
the receiver is used for receiving a client-side preview downloading request;
the transmitter is also used for responding to a downloading request of the client and sending the preview image to the client.
Optionally, the server further includes:
and the processor is used for generating the preview image and the preview image description information according to the preview image generation rule.
Optionally, the preview generation rule includes:
preview interval time information and preview resolution information.
Optionally, the processor may generate the preview image by directly capturing the video frames from the video file according to the interval time information and the resolution information of the preview image.
In a fifth aspect, there is provided a computer program product comprising executable program code, wherein the program code comprises instructions which, when executed by the processor, cause the server or client to perform the preview representation method according to the above aspect.
In a sixth aspect, an embodiment of the present application provides a computer storage medium for storing computer software instructions for the server and the client, which includes a program designed to execute the above aspects.
Drawings
FIG. 1 is a system architecture diagram for adaptive HTTP streaming implementing embodiments of the present application;
FIG. 2 is a block diagram of a network device architecture for implementing embodiments of the present application;
FIG. 3 is an interaction flowchart of a preview representation method according to an embodiment of the present application;
fig. 4 is an interactive flowchart of a preview representation method according to another embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention.
Fig. 1 illustrates a typical system architecture for adaptive HTTP streaming implementing embodiments of the present application. As shown in fig. 1, the system 100 may include n HTTP servers 110, which may be any integer number, a client 120, and a network 130. The HTTP server 110 and the client 120 may be coupled to each other through other network components such as a network 130 and an HTTP cache (not shown).
The HTTP server 110 may be any hardware computer server for sending and receiving data over HTTP. The HTTP server 110 may include a server DASH Module (DM) 111 for sending and receiving data over HTTP and according to the DASH standard. The HTTP servers may form a Content Distribution Network (CDN)140, and the CDN140 may refer to a distributed server system deployed at multiple data centers over multiple backbones for distributing content. The CDN140 may include any number of HTTP servers 110 such that n may be any integer number. Typically, a CDN may include thousands of hundreds of servers.
Client 120 may be any hardware device for sending and receiving data over HTTP. For example, the client 120 may be a laptop, tablet, desktop, mobile phone, or other device. The client 120 may include a client DASH Module (DM) 121, an application 122, and a Graphical User Interface (GUI) 123.
The client DM121 may be used to send and receive data over HTTP and according to the DASH standard. The client DM121 may further include a DASH Access Engine (DAE) 1211 and a media output (ME) 1212. The DAE1211 may be the primary component for receiving raw data from the HTTP server 110 and constructing the data into a viewing format. For example, the DAE1211 may format data in a Moving Picture Experts Group (MPEG) container format together with timing data, and then output the formatted data to the ME 1212. The ME1212 may be responsible for initializing, playing back, and other functions associated with the content and outputting the content to the application 122.
The application 122 may be a web browser or other application having an interface for downloading and presenting content. The application 122 may be coupled to the GUI123 such that a user associated with the client 120 may view various functions of the application 122. The application 122 may include a search function so that a user can search for content. For example, if the application 122 is a media player, the application 122 may include a search field so that a user may enter a string to search for a movie. The application 122 may present a search hit list from which the user may select a desired movie. After selection, the application 122 may send an instruction to download the movie to the client DM 121. DM121 may download the movie and process the movie for output to application 122. The application 122 may provide instructions to the GUI123 for the GUI123 to present the movie for viewing by the user. The application 122 may further provide instructions to the GUI123 for the GUI123 to present a progress bar showing the temporal progress of the movie.
The network 130 may be any network for providing communication between the HTTP server 110 and the client 120. For example, the network 130 may be the internet, a mobile telephone network, or other network. The network 130 may allow communication along a wired or wireless channel.
Fig. 2 is a schematic diagram of a network device 200 for implementing an embodiment of the invention. The apparatus 200 may comprise a plurality of ingress ports 210 and/or a receiver unit (Rx)220 for receiving data; a logic unit or processor 230 for processing signals; a plurality of egress ports 240 and/or a transmitter unit (Tx)250 for transmitting data to other components; and a memory 260. The apparatus 200 may be adapted to implement any of the disclosed features, methods, and apparatus. For example, the appliance 200 may be adapted to implement the HTTP server 110, and the client 120.
Logic unit 230, which may be referred to as a Central Processing Unit (CPU), may be in communication with ingress port 210, receiver unit 220, egress port 240, transmitter unit 250, and memory 260. Logic unit 230 may be implemented as one or more CPU chips, cores (e.g., multi-core processors), Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), and/or Digital Signal Processors (DSPs), and/or may be part of one or more ASICs.
The memory 260 may be comprised of one or more magnetic disks, tape drives, optical disk drives, or solid state drives; non-volatile storage available for data and as an overflow data storage device; may be used to store programs when such programs are selected for execution; and may be used to store instructions and data that are read during program execution. The memory 260 may be volatile and/or nonvolatile and may be Read Only Memory (ROM), Random Access Memory (RAM), Ternary Content Addressable Memory (TCAM), Static Random Access Memory (SRAM), other suitable memory types, or any combination thereof. The memory 260 may include a DM270, and the DM270 may be adapted to implement the server DM111 or the client DM 121. Although memory 260 is shown as including DM270, logic 230 or any combination of logic 230 and memory 260 may include DM 270.
Based on the foregoing typical system architecture and network device for HTTP streaming, fig. 3 is a flowchart illustrating a preview method according to an embodiment of the present application.
The client 110 may use an HTTP GET request or similar message to download a Media Presentation Description (MPD) from the HTTP server 120 or an HTTP cache (not shown). The MPD may be an extensible markup language (XML) document. The MPD contains metadata of a format used for encoding media content, such as information of a bit rate, codec, screen resolution, and language, and in this embodiment, the MPD further includes description information of a preview.
In this embodiment, when video content is injected, the server may read a preview generation rule corresponding to the video, for example: the interval time of the preview images, the resolution of the preview images and the like, and the description information of the preview images is generated, and the description information of the preview images can be realized in various ways:
in a first implementation manner, all the preview graphs may be compressed into one file, and carried in a compressed package form, and the attribute parameters of the preview graphs are defined in MPD Representation and described as follows:
Figure BDA0001250982590000041
Figure BDA0001250982590000051
presentation of elements within the Representation tag:
id: and identifying a preview picture group.
And (2) width: width of preview, unit: a pixel.
height: height of preview, unit: a pixel.
startTime: the first preview corresponds to a point in time in the video.
interval: interval duration of adjacent previews, unit: and second.
number: the total number of preview images generated by the video.
BaseURL: and the group of preview images are packaged into URL after zip files for downloading.
In the second embodiment, the preview is described by a list, and the attribute parameters of the preview are defined in MPDRepresentation, which is described as follows:
Figure BDA0001250982590000052
presentation of elements within the Representation tag:
id: identification of preview images (groups).
And (2) width: width of preview, unit: a pixel.
height: height of preview, unit: a pixel.
startTime: the first preview corresponds to a point in time in the video.
interval: interval duration of adjacent preview pictures, unit: second of
number: the total number of preview images generated by the video.
Segment URL: tag support multivalue
Media: and specific URL of the preview image file is used for terminal downloading.
In a third embodiment, a preview is described by a template, and the attribute parameters of the preview are defined in MPDRepresentation and are described as follows:
Figure BDA0001250982590000061
presentation of elements within the Representation tag:
previewttemplate: a rule of a preview download address (URL).
Previewttimeline: rules for previewing corresponding video content are described.
startTime: the first preview corresponds to a point in time in the video.
interval: interval duration of adjacent preview pictures, unit: and second.
number: the total number of preview images generated by the video.
id: preview picture (group) identification.
And (2) width: width of preview, unit: a pixel.
height: height of preview, unit: a pixel.
As shown in fig. 3, the preview representation method of the present embodiment includes the following steps:
in step 310, the client 120 may send a request for the MPD to the HTTP server 110.
The HTTP server 110 may send the MPD to the client 120, step 320. The client 120 may receive the MPD through the DASH access engine DAE1211, where the MPD includes description information of the preview map, and specifically, the description information of the preview map may include address information and time information of the preview map, and may further include resolution information of the preview map.
Step 330, the client 120 parses the description information of the preview image from the MPD file, and obtains the address information, the time information, and the resolution information of the preview image, where the time information of the preview image at least includes: the time corresponding to the first frame preview, the interval time between adjacent previews, and the total number of frames of the previews.
In step 340, the client 120 requests the HTTP server for the preview image according to the description information of the preview image.
Specifically, the client 120 may select an appropriate preview resolution and a corresponding preview xml document according to terminal parameters such as a screen size, and request to download a corresponding preview from the server according to an address of the preview in the document.
In step 350, the HTTP server sends the preview image to the client 120, and the client 120 caches the preview image in the local storage.
In step 360, the client 120 displays the preview of the corresponding progress when the user drags the play progress bar.
Specifically, when the user drags the playing progress bar, the position and time of the playing progress bar stop are determined, and the preview image of the corresponding time is obtained according to the time to be displayed. It should be noted that dragging the playing progress bar may be achieved by the user directly dragging with a mouse, or by the user directly inputting a time parameter to position the playing progress bar.
Optionally, the client 120 may download all the preview images from the server to the local storage in advance according to the address information of the preview images when the video playing starts, and obtain the preview images of the corresponding time from the local for display when the user drags the playing progress bar.
In addition, the client 120 may also determine a stop position of the progress bar and a corresponding time when the user drags the progress bar, select a preview image of the corresponding time according to the time, and download the corresponding preview image from the server in real time according to the position information of the preview image for display.
Fig. 4 is an interactive flowchart of a preview showing method according to another embodiment of the present application.
In this embodiment, the preview description information may be an independent XML file, and the MPD may only include a description of the XML file, such as a URL of the preview XML file. And after the MPD is analyzed, the client acquires the preview XML file from the server according to the URL of the preview XML file. The description of the MPD about the preview XML file may be as follows:
Figure BDA0001250982590000071
description of the parameters:
mimeType: the application/XML, non-video audio, preview is in the application class, and is carried by XML
value: it is clear that it is for timeline preview, timelinepreview.
Reproduction id: when there are multiple sets of resolution preview images providing previews, multiple redentifications are distinguished by id.
width, preview width, in pixels
height, Preview height, in pixels
BaseURL: and the client can acquire the detailed description information of the preview according to the URL of the XML file of the preview.
Specifically, the preview XML file has a plurality of descriptions, in this embodiment, the preview XML file in the first implementation is in a single-picture mode, each preview is a single picture, and the descriptions are as follows:
<！–Preview preview_240.XML-->
<xml version＝"1.0"encoding＝"UTF-8">
<timemline>
<image time＝“000006”id＝“preview_240_$time$.jpg”/>
<image time＝"000012"id＝"preview_240_$time$.jpg"/>
<image time＝"005900"id＝"preview_240_$time$.jpg"/>
</timemline>
description of the parameters:
time line: the content under the XML node is a scene for the timeline
image: the representation is a description of the object node of the preview graph
time: format time minute second HHMMSS
id ═ preview _240_ $ time $. jpg ": URL of preview file
In a second implementation manner, the preview picture XML file is in a merged picture mode, that is, a plurality of preview pictures are synthesized in one picture:
<！–Preview preview_240.XML-->
<xml version＝"1.0"encoding＝"UTF-8">
<timemline>
<image startTime＝“000000”endTime＝”001000”interval＝”6”
id＝“preview_$startTime$_$endTime$.jpg”/>
<image startTime＝“001000”endTime＝”002000”interval＝”6”
id＝“preview_$startTime$_$endTime$.jpg”/>
…
<image startTime＝“012000”endTime＝”013000”interval＝”6”
id＝“preview_$startTime$_$endTime$.jpg”/>
</timemline>
description of the parameters:
time line: the content under the XML node is a scene for the timeline
image: the representation is a description of the object node of the preview graph
startTime: start time of video, format: HHMMSS
endTime: end time of video, format: HHMMSS
interval: interval time, unit: second of
id ═ preview _ $ startTime $ _ $ endTime $. jpg ": URL of preview file
The image merging mode can reduce the number of images, and the client reads the merged images, so that the number of opened and closed files can be reduced, and the display speed is increased.
In this embodiment, the preview display method includes the following steps:
at step 410, the client 120 may send a request for the MPD to the HTTP server 110.
The HTTP server 110 may send the MPD to the client 120, step 420. The client 120 may receive the MPD through the DAE1211, where the MPD includes preview description information, and specifically, the preview description information includes a URL of a preview description file.
Specifically, the preview description information may be described as follows:
Figure BDA0001250982590000081
Figure BDA0001250982590000091
the client 120 determines that the video supports the characteristics of the preview image according to the value, "timelinepreview view," wherein multiple redeactions indicate that the preview image with multiple resolutions can be obtained, and the terminal can select a suitable resolution preview image xml according to the size of its screen, which takes the obtained preview image with 240 resolutions as an example in this example.
In step 430, the client 120 parses the URL of the preview description file from the MPD file.
In step 440, the client 120 requests the preview representation file from the server according to the URL of the preview representation file.
Specifically, the client 120 may request the description file of the preview image from the server according to the BaseURL of the selected preview image with the resolution of 240.
The HTTP server 110 returns the description file of the preview image to the client 120, step 450.
Specifically, the preview description file may be an XML document, and the specific content may be as follows:
<！–Preview XML-->
<xml version＝"1.0"encoding＝"UTF-8">
<timemline>
<image time＝“000006”id＝“preview_240_000006.jpg”/>
<image time＝"000012"id＝"preview_240_000012.jpg"/>
....
<image time＝"013000"id＝"preview_240_013000.jpg"/>
</timemline>
in step 460, the client 120 requests the HTTP server for the preview image according to the description file of the preview image.
At step 470, the HTTP server sends the preview image to the client 120, and the client 120 caches the preview image in the local storage.
In step 480, when the user drags the play progress bar, the client 120 displays a preview of the corresponding progress.
Specifically, when the user drags the playing progress bar, the position and time of the playing progress bar stop are determined, and the preview image of the corresponding time is obtained according to the time to be displayed.
Optionally, the client 120 may download all the preview images from the server to the local storage in advance according to the address information of the preview images when the video playing starts, and obtain the preview images of the corresponding time from the local for display when the user drags the playing progress bar.
In addition, the client 120 may also determine a stop position of the progress bar and a corresponding time when the user drags the progress bar, select a preview image of the corresponding time according to the time, and download the corresponding preview image from the server in real time according to the position information of the preview image for display.
It should be noted that the solution of the embodiment of the present application may also be applicable to other HTTP protocols such as HLS, for example, the HLS protocol is applicable, and the description information of the preview image may be included in the M3U8 file, and the specific implementation may refer to the above embodiment.
Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the examples described in connection with the embodiments disclosed herein may be embodied in electronic hardware, computer software, or combinations of both, and that the components and steps of the examples have been described in a functional general in the foregoing description for the purpose of illustrating clearly the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may also be an electric, mechanical or other form of connection.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment of the present invention.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention essentially or partially contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
While the invention has been described with reference to specific embodiments, the invention is not limited thereto, and various equivalent modifications and substitutions can be easily made by those skilled in the art within the technical scope of the invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (19)

1. A method for displaying a preview image is characterized by comprising the following steps:
a client acquires an index file of a video program from a server, wherein the index file is a Media Presentation Description (MPD) file of a DASH protocol, and the index file contains description information of a preview;
the client acquires a preview according to the preview description information;
the client displays the preview image according to a user operation instruction;
the step that the client acquires the preview according to the preview description information comprises the following steps:
the client acquires the stop position of the progress bar and the corresponding time point, determines the position information of the preview image corresponding to the time point, and downloads the corresponding preview image from the server in real time according to the position information for display.
2. The method of claim 1, wherein the preview description information includes:
the address information of the preview image and the time information corresponding to the preview image.
3. The method of claim 1, wherein the client displays the preview image according to a user operation instruction, and comprises:
and when the user drags the playing progress bar, displaying a corresponding preview according to the position of the playing progress bar.
4. The method of claim 2, wherein the client displays the preview image according to the user operation instruction, and comprises:
and when the user drags the playing progress bar, displaying a corresponding preview according to the position of the playing progress bar.
5. The method according to any one of claims 1-4, wherein the client obtains the preview image according to the preview image description information, including:
before the user drags the playing progress bar, downloading the preview image from the server to be stored locally according to the address information of the preview image.
6. The method according to any one of claims 1-4, wherein the client obtains the preview image according to the preview image description information, including:
when a user drags a playing progress bar, according to the position of the playing progress bar and the time information corresponding to the preview images, determining the address information of the corresponding preview images, and downloading the preview images from a server according to the determined address information of the preview images.
7. A method for displaying a preview image is characterized by comprising the following steps:
the method comprises the steps that a server sends an index file of a video program to a client, wherein the index file is an MPD (media distribution protocol) file of a DASH (digital video over coax) protocol, and the index file contains description information of a preview;
the server receives a client preview downloading request;
the server responds to a downloading request of the client and sends the preview image to the client;
the server responds to the downloading request of the client, and the step of sending the preview image to the client comprises the following steps:
and the server sends a preview image corresponding to the position information in the preview image downloading request to the client, wherein the position information is determined by the client according to the stop position of the progress bar and the corresponding time point.
8. The method of claim 7, wherein the preview description information includes:
the address information of the preview image and the time information corresponding to the preview image.
9. The method of claim 7 or 8, wherein the method further comprises:
and generating a preview image and preview image description information according to the preview image generation rule.
10. The method of claim 9, wherein the preview generation rule comprises:
preview interval time information and preview resolution information.
11. A client device, comprising:
the receiver is configured to obtain an index file of a video program from a server, where the index file is an MPD file of a DASH protocol and includes description information of a preview;
the processor is used for acquiring the preview according to the preview description information; displaying the preview picture according to a user operation instruction;
in the aspect of obtaining the preview image according to the preview image description information, the processor is specifically configured to:
the method comprises the steps of obtaining the stop position of a progress bar and a corresponding time point, determining the position information of a preview image corresponding to the time point, and downloading the corresponding preview image from a server in real time according to the position information for displaying.
12. The client apparatus according to claim 11, wherein the preview drawing description information includes:
the address information of the preview image and the time information corresponding to the preview image.
13. The client device of claim 11, wherein the processor is specifically configured to:
and when the user drags the playing progress bar, displaying a corresponding preview according to the position of the playing progress bar.
14. The client device of claim 12, wherein the processor is specifically configured to:
and when the user drags the playing progress bar, displaying a corresponding preview according to the position of the playing progress bar.
15. The client device of any of claims 11-14, wherein the processor is further configured to: and before the user drags the playing progress bar, downloading the preview image from the server according to the address information of the preview image.
16. The client device of any of claims 11-14, wherein the processor is further configured to: when a user drags a playing progress bar, according to the position of the playing progress bar and the time information corresponding to the preview images, determining the address information of the corresponding preview images, and downloading the preview images from a server according to the determined address information of the preview images.
17. A server, comprising:
the device comprises a transmitter, a client and a server, wherein the transmitter is used for sending an index file of a video program to the client, the index file is an MPD (media distribution protocol) file of a DASH (digital video over coax) protocol, and the index file contains description information of a preview;
the receiver is used for receiving a client-side preview downloading request;
the transmitter is also used for responding to a downloading request of the client and sending the preview image to the client;
in the aspect of sending the preview image to the client in response to the download request of the client, the transmitter is specifically configured to:
and sending a preview image corresponding to the position information in the preview image downloading request to the client, wherein the position information is determined by the client according to the stop position of the progress bar and the corresponding time point.
18. The server of claim 17, further comprising:
and the processor is used for generating the preview image and the preview image description information according to the preview image generation rule.
19. The server according to claim 18, wherein the preview generation rule includes:
preview interval time information and preview resolution information.
CN201710170348.9A 2017-03-21 2017-03-21 Preview display method and device Active CN108632644B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201710170348.9A CN108632644B (en) 2017-03-21 2017-03-21 Preview display method and device
PCT/CN2018/078446 WO2018171437A1 (en) 2017-03-21 2018-03-08 Display method and device for preview image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710170348.9A CN108632644B (en) 2017-03-21 2017-03-21 Preview display method and device

Publications (2)

Publication Number Publication Date
CN108632644A CN108632644A (en) 2018-10-09
CN108632644B true CN108632644B (en) 2020-09-11

Family

ID=63586278

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710170348.9A Active CN108632644B (en) 2017-03-21 2017-03-21 Preview display method and device

Country Status (2)

Country Link
CN (1) CN108632644B (en)
WO (1) WO2018171437A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109561337A (en) * 2018-11-19 2019-04-02 青岛海信传媒网络技术有限公司 The playing method and device of preview video
CN110198452B (en) * 2019-04-02 2021-09-14 腾讯科技（深圳）有限公司 Live video previewing method, device and system
CN115499702A (en) * 2021-06-18 2022-12-20 阿里巴巴新加坡控股有限公司 Preview image display method and device, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102316370A (en) * 2010-06-29 2012-01-11 腾讯科技（深圳）有限公司 Method and device for displaying playback information
CN102932679A (en) * 2012-11-21 2013-02-13 合一网络技术(北京)有限公司 Network video previewing system and method
CN103957471A (en) * 2014-05-05 2014-07-30 华为技术有限公司 Network video playing method and device
CN103974147A (en) * 2014-03-07 2014-08-06 北京邮电大学 MPEG (moving picture experts group)-DASH protocol based online video playing control system with code rate switch control and static abstract technology
CN104937583A (en) * 2013-01-18 2015-09-23 华为技术有限公司 Method and apparatus for performing adaptive streaming on media contents

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20120010089A (en) * 2010-07-20 2012-02-02 삼성전자주식회사 Method and apparatus for improving quality of multimedia streaming service based on hypertext transfer protocol

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102316370A (en) * 2010-06-29 2012-01-11 腾讯科技（深圳）有限公司 Method and device for displaying playback information
CN102932679A (en) * 2012-11-21 2013-02-13 合一网络技术(北京)有限公司 Network video previewing system and method
CN104937583A (en) * 2013-01-18 2015-09-23 华为技术有限公司 Method and apparatus for performing adaptive streaming on media contents
CN103974147A (en) * 2014-03-07 2014-08-06 北京邮电大学 MPEG (moving picture experts group)-DASH protocol based online video playing control system with code rate switch control and static abstract technology
CN103957471A (en) * 2014-05-05 2014-07-30 华为技术有限公司 Network video playing method and device

Also Published As

Publication number Publication date
CN108632644A (en) 2018-10-09
WO2018171437A1 (en) 2018-09-27

Similar Documents

Publication Publication Date Title
US9992537B2 (en) Real-time tracking collection for video experiences
US9852762B2 (en) User interface for video preview creation
JP6172688B2 (en) Content-specific identification and timing behavior in dynamic adaptive streaming over hypertext transfer protocols
JP6064249B2 (en) Dynamic adaptive streaming over hypertext transfer protocol client behavior framework and session management implementation
JP6397911B2 (en) Video broadcast system and method for distributing video content
US11032570B2 (en) Media data processing method and apparatus
US20100242066A1 (en) Method of Performing Random Seek Preview for Streaming Video
US10820045B2 (en) Method and system for video stream personalization
WO2013110042A1 (en) Social video network
US10515476B2 (en) Image fetching for timeline scrubbing of digital media
US20190098369A1 (en) System and method for secure cross-platform video transmission
CN108632644B (en) Preview display method and device
US9680895B1 (en) Media content review timeline
JP2013255210A (en) Video display method, video display device and video display program
US11677796B2 (en) System and method for video encoding optimization and broadcasting
US20220321972A1 (en) Transmitting content based on genre information
KR101944601B1 (en) Method for identifying objects across time periods and corresponding device
US20180324480A1 (en) Client and Method for Playing a Sequence of Video Streams, and Corresponding Server and Computer Program Product
CN113315982A (en) Live broadcast method, computer storage medium and equipment
CN116708867B (en) Live broadcast data processing method, device, equipment and storage medium
US10965984B1 (en) Minimization of video re-buffering using local animation
US20230217047A1 (en) Method, system, and computer-readable recording medium for implementing fast-switching mode between channels in multi-live transmission environment
US20230336597A1 (en) Method and system for monitoring streaming
JP5930562B1 (en) Movie display support program and movie display support device
Bresnahan A Live Broadcast 4K Television System Utilizing the MPEG-DASH Adaptive Bit Rate Protocol and Internet Technologies

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant