CN107370768B - Intelligent television streaming media preview system and method - Google Patents

Intelligent television streaming media preview system and method Download PDF

Info

Publication number
CN107370768B
CN107370768B CN201710817116.8A CN201710817116A CN107370768B CN 107370768 B CN107370768 B CN 107370768B CN 201710817116 A CN201710817116 A CN 201710817116A CN 107370768 B CN107370768 B CN 107370768B
Authority
CN
China
Prior art keywords
key frame
module
picture
pictures
preview
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710817116.8A
Other languages
Chinese (zh)
Other versions
CN107370768A (en
Inventor
纪琦华
蒲珂
曾泽基
方宏
李哲山
鲁豪
胡彬
魏明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhongguang Hot Cloud Technology Co Ltd
Original Assignee
Zhongguang Hot Cloud Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhongguang Hot Cloud Technology Co Ltd filed Critical Zhongguang Hot Cloud Technology Co Ltd
Priority to CN201710817116.8A priority Critical patent/CN107370768B/en
Publication of CN107370768A publication Critical patent/CN107370768A/en
Application granted granted Critical
Publication of CN107370768B publication Critical patent/CN107370768B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/75Media network packet handling
    • H04L65/764Media network packet handling at the destination 
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4331Caching operations, e.g. of an advertisement for later insertion during playback
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving MPEG packets from an IP network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6587Control parameters, e.g. trick play commands, viewpoint selection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8455Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments

Abstract

The invention relates to an intelligent television streaming media preview system, which comprises a streaming media server, an intelligent television processor, a local buffer and a control terminal, wherein the local buffer and the control terminal are connected with the intelligent television processor; the streaming media server comprises a key frame intercepting module and a key frame sending module; the intelligent television processor comprises a display module, an updating module, a picture loading module and an exit module; the method comprises the steps of downloading key frame pictures, displaying the key frame pictures through an N-column floating window display method when the key frame pictures need to be displayed, quickly responding, greatly reducing time delay, avoiding conflict between the floating window and a video playing window, carrying out the whole browsing process in the floating window, not influencing the playing of normal videos, displaying the key frame pictures in the N-column floating window, updating the display pictures in the floating window in real time, and quickly, simply and conveniently browsing the preview pictures of the whole videos in a dynamic mode through a fast forward or backward key.

Description

Intelligent television streaming media preview system and method
Technical Field
The invention belongs to the technical field of communication, and particularly relates to a system and a method for previewing streaming media of an intelligent television.
Background
At present, the application of an intelligent television or a television carrying an intelligent television box is more and more extensive, a user often needs to preview the content of a certain streaming media integrally when watching a program video of the intelligent television, a mode of previewing the streaming media at a PC end generally places a cursor on a progress bar, and a preview image of a cursor point can be seen, but on the intelligent television, the mode is difficult to realize, and the mode can only manually obtain the video preview image of a certain point and can not smoothly preview the streaming media; in the prior art, a smart television has a certain preview function, that is, previewing pictures of streaming media is browsed in a fast forward process, so that the whole content of the streaming media is difficult to preview while watching a video.
Disclosure of Invention
In order to solve the above problems, the present invention provides a streaming media preview system for an intelligent television, and the specific scheme is as follows:
a stream media preview system of an intelligent television comprises a stream media server, an intelligent television processor, a local buffer and a control terminal, wherein the local buffer and the control terminal are connected with the intelligent television processor;
the streaming media server comprises a key frame intercepting module and a key frame sending module;
the key frame intercepting module is used for analyzing the video content of the streaming media, extracting key frame pictures with equal time intervals T1 and carrying out time stamp and number marking on the key frame pictures;
the key frame sending module is used for receiving a video playing request of a user, packaging the key frame pictures obtained by the key frame intercepting module and sending the packaged key frame pictures to the local cache;
the intelligent television processor comprises a display module, an updating module, a picture loading module and an exit module;
the display module is used for displaying n rows of floating windows after receiving a preview instruction sent by the control terminal, fixing a cursor on one floating window, entering a preview state and simultaneously sending a picture loading instruction to the picture loading module; the specification explains that the normal playing can not be influenced
The updating module is used for receiving a forward or backward instruction sent by the control terminal in a preview state and sending an instruction for updating the key frame picture to the picture loading module;
the picture loading module is used for receiving a picture loading instruction, loading the key frame pictures, displaying the key frame pictures in the floating window according to the time sequence, and receiving and executing a key frame picture updating instruction;
and the exit module is used for receiving an exit instruction sent by the control terminal and exiting the floating window for display.
The method comprises the steps of downloading key frame pictures, displaying the key frame pictures through an N-column floating window display method when the key frame pictures need to be displayed, quickly responding, greatly reducing time delay, avoiding conflict between the floating window and a video playing window, carrying out the whole browsing process in the floating window, not influencing the playing of normal videos, displaying the key frame pictures in the N-column floating window, updating the display pictures in the floating window in real time, and quickly, simply and conveniently browsing the preview pictures of the whole videos in a dynamic mode through a fast forward or backward key.
On the other hand, the invention provides an intelligent television streaming media previewing method, which comprises the following steps:
acquiring and sending key frame pictures: the streaming media server analyzes the video content of the streaming media, extracts the key frame pictures with equal time intervals T1, carries out time stamp and number marking on the key frame pictures, packs the key frame pictures and sends the key frame pictures to a local buffer while a user video playing request is carried out;
entering a preview state: when the control terminal sends a preview instruction, displaying n rows of floating windows on a playing interface, fixing a cursor on one floating window, and entering a preview state;
a key frame display step: loading the key frame pictures, and displaying the key frame pictures in the floating window according to the time stamp information of the key frame pictures in a time sequence;
and (3) updating the picture: when a forward or backward command sent by the control terminal in a preview state is received, updating the picture in the floating window to a next key frame or a previous key frame;
exiting the preview state: and when an exit instruction sent by the control terminal is received, exiting the floating window display and exiting the preview state.
Further, the key frame displaying step includes the steps of:
a progress judgment step, namely judging the current playing progress of the video when the control terminal sends a preview instruction;
a main key frame loading step, namely extracting a key frame picture with the number of X nearest to the current playing progress according to the current playing progress of the video and the time information of the key frame picture, displaying the key frame picture in a floating window fixed by a cursor, and setting the key frame picture as a main key frame;
and loading other key frames: and calling adjacent key frame pictures according to a preset rule according to the timestamp information of the main key frame, and then sending the adjacent key frame pictures to other floating windows for displaying according to a time sequence.
The method comprises the steps that a streaming media server downloads and packages key frame pictures at time intervals in advance, when a user carries out a video watching request, the key frame pictures are packaged and distributed and stored in a local cache of an intelligent television terminal, when the user wants to preview a scenario, the user only needs to enter a preview state to display 1 line of floating windows with N columns, the local key frames are loaded in the floating windows according to a time sequence, the key frames are replaced only needing to be called from the local cache, the response is quick and sensitive, the time delay is greatly reduced, the floating windows and a video playing window do not conflict, the whole browsing process is carried out in the floating windows, the playing of normal videos is not influenced, the keys are displayed in an N-column floating window mode, the displayed pictures in the floating windows can be updated in real time, and the preview pictures of the whole videos can be browsed in a dynamic mode quickly, simply and conveniently through a fast forward or backward key.
Drawings
FIG. 1 is a connection relationship diagram between each component and module of a smart television streaming media preview system in embodiment 1;
FIG. 2 is a connection relationship diagram between each component and module of the intelligent television streaming media preview system in embodiment 1;
FIG. 3 is a connection relationship diagram between each component and module of the intelligent television streaming media preview system in embodiment 2;
fig. 4 is a flowchart of a method for previewing streaming media of an intelligent television in embodiment 3.
Detailed Description
The invention is further described with reference to the following figures and examples, which are provided for the purpose of illustrating the general inventive concept and are not intended to limit the scope of the invention.
Example 1
A stream media preview system of an intelligent television is disclosed, as shown in figure 1, and comprises a stream media server 1, an intelligent television processor 2, a local buffer 4 connected with the intelligent television processor 2 and a control terminal 5;
the streaming media server 1 comprises a key frame intercepting module 101 and a key frame sending module 102;
the key frame intercepting module 101 is configured to analyze video content of the streaming media, extract key frame pictures at equal time intervals T1, and perform timestamp and number marking on the key frame pictures;
the key frame sending module 102 is configured to, while receiving a video playing request of a user, package and send the key frame pictures obtained by the key frame capturing module 101 to the local buffer 4;
the intelligent television processor 2 comprises a display module 103, an updating module 104, a picture loading module 105 and an exit module 106;
the display module 103 is used for displaying n rows of floating windows after receiving the preview instruction sent by the control terminal 5, fixing a cursor on one floating window, entering a preview state, and sending a picture loading instruction to the picture loading module 105;
an updating module 104, configured to receive a forward or backward instruction sent by the control terminal 5 in a preview state, and send an instruction for updating the key frame picture to the picture loading module 105;
the picture loading module 105 is used for receiving a picture loading instruction, loading the key frame pictures, displaying the key frame pictures in the floating window according to a time sequence, and receiving and executing a key frame picture updating instruction;
and the exit module 106 is configured to receive an exit instruction sent by the control terminal 5, and exit from the floating window display.
The method comprises the steps that a streaming media server downloads and packages key frame pictures at time intervals in advance, when a user carries out a video watching request, the key frame pictures are packaged and distributed and stored in a local cache of an intelligent television terminal, when the user wants to preview a scenario, the user only needs to enter a preview state to display 1 line of floating windows with N columns, the local key frames are loaded in the floating windows according to a time sequence, the key frames are replaced only needing to be called from the local cache, the response is quick and sensitive, the time delay is greatly reduced, the floating windows and a video playing window do not conflict, the whole browsing process is carried out in the floating windows, the playing of normal videos is not influenced, the keys are displayed in an N-column floating window mode, the displayed pictures in the floating windows can be updated in real time, and the preview pictures of the whole videos can be browsed in a dynamic mode quickly, simply and conveniently through a fast forward or backward key.
Example 2
A stream media preview system of an intelligent television is shown in figure 2, and is different from the embodiment 1 in that the preview system is further limited in that a trigger key of a preview instruction does not comprise a forward key, a backward key, a fast forward key and a fast backward key; the processor 2 further comprises a state judgment module 205 and a single-window display module 206, and the picture loading module 105 comprises a progress judgment sub-module 201, a main key frame loading sub-module 202, other key frame loading sub-modules 203, a key frame updating sub-module 204 and a quick preview picture extraction sub-module 207;
the display module 103 is further configured to send a progress judgment instruction to the progress judgment sub-module 201 when receiving a preview instruction sent by the control terminal 5;
the progress judgment submodule 201 is configured to receive a progress judgment instruction, obtain a current video playing progress, and send a loading instruction to the main key frame loading submodule 202;
the main key frame loading submodule 202 is used for extracting the key frame picture with the number of X nearest to the current playing progress and displaying the key frame picture in a floating window fixed by a cursor according to the current playing progress of the video and the time information of the key frame picture;
the other key frame loading submodule 203 is used for calling the adjacent key frame pictures according to a preset rule and then sending the adjacent key frame pictures to other floating windows for displaying according to the time sequence according to the timestamp information of the key frame pictures extracted by the main key frame loading submodule 202;
a key frame updating submodule 204, configured to receive an update key frame instruction sent by the updating module 104, and update all the key frame pictures of the floating window to a next key frame or a previous key frame;
the state judgment module 205, when receiving the forward or backward command sent by the control terminal 5, judges whether the preview state is present, and if the judgment result is "no", sends a single-window displaying command to the single-window displaying module 206, and sends an extracting command to the fast preview picture extracting submodule 207;
a single-window display module 206, configured to display a single floating window on the video playing interface when receiving a fast-forward or fast-backward instruction sent by the control terminal 5 or a single-window display instruction sent by the state judgment module 205;
and the fast preview picture extraction submodule 207 is used for receiving an extraction instruction, judging the multiple of fast forward or fast backward or the step length time of forward or backward, extracting corresponding key frame pictures according to the current playing progress of the video, and sending and continuously updating the key frame pictures in the single floating window.
When entering the preview state each time, the current playing progress is judged, the key frame displayed in the floating window is ensured to be matched with the playing progress, and the problem that repeated previewing is generated to view the content when the interval between the previous previewing and the current previewing is larger, the current playing progress is already higher, but the previewing picture is still kept on the previous time progress is avoided.
When a user forwards or backwards in a non-preview state or sets multiple fast forward or fast backward operation, the user needs to carry out fast forward or fast backward, only a single floating window is displayed at the moment, and according to the set multiple or the self-defined time for forwarding or backward of the control terminal is not long, key frame pictures are called at intervals to carry out single display, so that the user can watch a certain amount of pictures in the process of fast forward or fast backward, but the pictures are not redundant, simple and fast, and suitable for application.
Example 3
A streaming media preview system of a smart television, as shown in fig. 3, differs from embodiment 2 in that, further, a preset rule is a preset time interval T2; the processor 2 further comprises a time judging module 301, a scene analyzing module 302, an inserting module 303, a first scene judging module 304 and a second scene judging module 305;
the main key frame loading sub-module 202 is further configured to send a time judgment instruction to the time judgment module 301 after extracting the key frame picture with the number X;
the time judging module 301 is configured to judge the sizes of T1 and T2, and send a scene analysis instruction to the scene analysis module 302 if T1 is less than T2;
a scene analysis module 302, configured to analyze scene information of the key frame picture numbered X + nT2, the key frame picture numbered X + nT2-T2, and the key frame skipped therebetween, and send a determination instruction to the first scene determination module 304;
a first scene judgment module 304, configured to judge whether the scene information of the key frame picture skipped in the middle is the same as the scene information of the key frame picture numbered as X + nT2, and if the judgment result is "no", send a judgment instruction to the second scene judgment module 305;
a second scene determining module 305, configured to determine whether the scene information of the key frame pictures skipped in the middle is the same as the scene information of the key frame pictures numbered as X + nT2-T2, and if the determination result is "no", send an insertion instruction to the insertion module 303;
the inserting module 303 is configured to receive an inserting instruction, call a skipped key frame picture between the key frame picture with the number X + nT2 and the key frame picture with the number X + nT2-T2, and insert the skipped key frame pictures into the floating window for display according to a time sequence.
When the streaming media server extracts key frames at a smaller time interval, for example, 1s, but the preset display time interval of the smart television terminal is a relatively larger time interval, for example, 5s, then key frames need to be selected according to the larger time interval T2, for example, 45s, a main key frame with the number of X is extracted according to the video progress, and other key frames are set according to X, X-10, X-5, X, X +5, X +10, X +15, and displayed in sequence, the key frames between adjacent X + nT2 and X + (n-1) T2 time points necessarily have omitted key frames, the scene of the omitted key frames is determined, if a key point picture with scene switching is found in the omitted key frames, the key point picture is extracted and displayed in sequence of timestamps, insert and show in the corresponding floating window, be favorable to the whole of scenario to be held, nimble display mode has more excellent experience sense of watching the video, more has the practicality.
Example 4
A method for previewing streaming media of an intelligent tv, as shown in fig. 4, where a preset rule is a preset time interval T2, includes the following steps:
acquiring and sending key frame pictures: the streaming media server analyzes the video content of the streaming media, extracts the key frame pictures with equal time intervals T1, carries out time stamp and number marking on the key frame pictures, packs the key frame pictures and sends the key frame pictures to a local buffer while a user video playing request is carried out;
entering a preview state: when the control terminal sends a preview instruction, displaying n rows of floating windows on a playing interface, fixing a cursor on one floating window, and entering a preview state;
a progress judgment step, namely judging the current playing progress of the video when the control terminal sends a preview instruction;
a main key frame loading step, namely extracting a key frame picture with the number of X nearest to the current playing progress according to the current playing progress of the video and the time information of the key frame picture, displaying the key frame picture in a floating window fixed by a cursor, and setting the key frame picture as a main key frame;
a time judgment step: after the main key frame picture with the number X is extracted, judging the sizes of T1 and T2, and if T1 is less than T2, performing a scene analysis step;
a scene analysis step of analyzing scene information of the key frame pictures with the number of X + nT2, the key frame pictures with the number of X + nT2-T2 and the key frames skipped in the middle;
a first scene judgment step of judging whether the scene information of the key frame picture skipped in the middle is the same as the scene information of the key frame picture with the number of X + nT2, and if the judgment result is 'NO', performing a second scene judgment step;
a second scene judgment step of judging whether the scene information of the key frame pictures skipped in the middle is the same as the scene information of the key frame pictures with the number of X + nT2-T2, and if the judgment result is 'NO', performing an insertion step;
an insertion step; removing skipped key frame pictures between the key frame picture with the number of X + nT2 and the key frame picture with the number of X + nT2-T2, and inserting the skipped key frame pictures into a floating window for displaying according to the time sequence;
and (3) updating the picture: when a forward or backward command sent by the control terminal in a preview state is received, updating the picture in the floating window to a next key frame or a previous key frame;
exiting the preview state: and when an exit instruction sent by the control terminal is received, exiting the floating window display and exiting the preview state.
Example 5
An intelligent television streaming media previewing method is different from the embodiment 4 in that the method further comprises the following steps:
a state judgment step, judging whether the state is in a preview state when a forward or backward command sent by the control terminal is received, and if the judgment result is 'no', performing a single-window display step;
and a single window display step: and displaying a single floating window in the video playing window, extracting corresponding key frame pictures according to the multiple of fast forward or fast backward, or the step length time of forward or backward, and the current playing progress of the video, and continuously updating the key frame pictures in the single floating window.

Claims (7)

1. The intelligent television streaming media previewing system is characterized by comprising a streaming media server (1), an intelligent television processor (2), a local buffer (4) and a control terminal (5), wherein the local buffer (4) and the control terminal are connected with the intelligent television processor (2);
the streaming media server (1) comprises a key frame intercepting module (101) and a key frame sending module (102);
the key frame intercepting module (101) is used for analyzing the video content of the streaming media, extracting key frame pictures with equal time intervals T1, and carrying out time stamping and numbering marking on the key frame pictures;
the key frame sending module (102) is used for receiving a video playing request of a user, packaging the key frame pictures obtained by the key frame intercepting module (101) and sending the packaged key frame pictures to a local buffer (4);
the intelligent television processor (2) comprises a display module (103), an updating module (104), a picture loading module (105) and an exit module (106);
the display module (103) displays n rows of floating windows after receiving a preview instruction sent by the control terminal (5), fixes a cursor on one floating window, enters a preview state, and simultaneously sends a picture loading instruction to the picture loading module (105);
the updating module (104) is used for receiving a forward or backward instruction sent by the control terminal (5) in a preview state and sending an instruction for updating the key frame picture to the picture loading module (105);
the picture loading module (105) is used for receiving a picture loading instruction, loading the key frame pictures, displaying the key frame pictures in the floating window according to a time sequence, and receiving and executing a key frame picture updating instruction;
the exit module (106) is used for receiving an exit instruction sent by the control terminal (5) and exiting the floating window for display;
the picture loading module (105) comprises a progress judgment sub-module (201), a main key frame loading sub-module (202), other key frame loading sub-modules (203) and a key frame updating sub-module (204);
the display module (103) is further configured to send a progress judgment instruction to the progress judgment submodule (201) when receiving a preview instruction sent by the control terminal (5);
the progress judgment submodule (201) is used for receiving a progress judgment instruction, acquiring the current playing progress of the video and sending a loading instruction to the main key frame loading submodule (202);
the main key frame loading submodule (202) extracts a key frame picture which is nearest to the current playing progress and is numbered X according to the current playing progress of the video and the time information of the key frame picture, and displays the key frame picture in a floating window fixed by a cursor;
the other key frame loading submodule (203) is used for calling adjacent key frame pictures according to a preset rule and then sending the adjacent key frame pictures to other floating windows for displaying according to a time sequence according to the timestamp information of the key frame pictures extracted by the main key frame loading submodule (202);
the key frame updating submodule (204) is used for receiving a key frame updating instruction sent by the updating module (104) and updating all the key frame pictures of the floating window to the next key frame or the previous key frame;
the preset rule is a preset time interval T2;
the processor (2) further comprises a time judging module (301), a scene analyzing module (302), an inserting module (303), a first scene judging module (304) and a second scene judging module (305);
the main key frame loading sub-module (202) is further used for sending a time judgment instruction to the time judgment module (301) after the key frame picture with the number X is extracted;
the time judging module (301) is used for judging the sizes of T1 and T2, and if T1 is less than T2, a scene analysis command is sent to the scene analysis module (302);
the scene analysis module (302) is used for analyzing scene information of key frame pictures with the number of X + nT2, key frame pictures with the number of X + nT2-T2 and key frames skipped in the middle and sending judgment instructions to the first scene judgment module (304);
the first scene judging module (304) is configured to judge whether the scene information of the key frame picture skipped in the middle is the same as the scene information of the key frame picture numbered as X + nT2, and if the judgment result is "no", send a judgment instruction to the second scene judging module (305);
the second scene judging module (305) is used for judging whether the scene information of the key frame pictures with the skipped middle is the same as the scene information of the key frame pictures with the number of X + nT2-T2, and if the judgment result is 'NO', sending an inserting instruction to the inserting module (303);
the inserting module (303) is configured to receive an inserting instruction, call a skipped key frame picture between the key frame picture numbered X + nT2 and the key frame picture numbered X + nT2-T2, and insert the skipped key frame pictures into the floating window for display according to a time sequence.
2. The intelligent television streaming media preview system of claim 1, wherein the trigger button of the preview instruction does not include a forward button, a backward button, a fast forward button, and a fast backward button.
3. The intelligent television streaming media preview system of claim 2, wherein the processor (2) further comprises a status judgment module (205), a single window display module (206), and the picture loading module (105) further comprises a quick preview picture extraction sub-module (207);
the state judgment module (205) judges whether the image is in a preview state when receiving a forward or backward instruction sent by the control terminal (5), and if the judgment result is 'no', sends a single-window display instruction to the single-window display module (206) and sends an extraction instruction to the quick preview image extraction submodule (207);
the single-window display module (206) displays a single floating window on the video playing interface when receiving a fast forward or fast backward instruction sent by the control terminal (5) or a single-window display instruction sent by the state judgment module (205);
and the fast preview picture extraction submodule (207) is used for receiving an extraction instruction, judging the multiple of fast forward or fast backward or the step length time of forward or backward, extracting the corresponding key frame picture according to the current playing progress of the video, and continuously updating the key frame picture in the single floating window.
4. An intelligent television streaming media previewing method is characterized by comprising the following steps:
acquiring and sending key frame pictures: the streaming media server analyzes the video content of the streaming media, extracts the key frame pictures with equal time intervals T1, carries out time stamp and number marking on the key frame pictures, packs the key frame pictures and sends the key frame pictures to a local buffer while a user video playing request is carried out;
entering a preview state: when the control terminal sends a preview instruction, displaying n rows of floating windows on a playing interface, fixing a cursor on one floating window, and entering a preview state;
a key frame display step: loading the key frame pictures, and displaying the key frame pictures in the floating window according to the time stamp information of the key frame pictures in a time sequence;
and (3) updating the picture: when a forward or backward command sent by the control terminal in a preview state is received, updating the picture in the floating window to a next key frame or a previous key frame;
exiting the preview state: and when an exit instruction sent by the control terminal is received, exiting the floating window display and exiting the preview state.
5. The intelligent television streaming preview method of claim 4, wherein the key frame display step comprises the steps of:
a progress judgment step, namely judging the current playing progress of the video when the control terminal sends a preview instruction;
a main key frame loading step, namely extracting a key frame picture with the number of X nearest to the current playing progress according to the current playing progress of the video and the time information of the key frame picture, displaying the key frame picture in a floating window fixed by a cursor, and setting the key frame picture as a main key frame;
and loading other key frames: and calling adjacent key frame pictures according to a preset rule according to the timestamp information of the main key frame, and then sending the adjacent key frame pictures to other floating windows for displaying according to a time sequence.
6. The intelligent television streaming preview method of claim 5, wherein the preset rule is a preset time interval T2, the method further comprising the steps of,
a time judgment step: after the main key frame picture with the number X is extracted, judging the sizes of T1 and T2, and if T1 is less than T2, performing a scene analysis step;
a scene analysis step of analyzing scene information of the key frame pictures with the number of X + nT2, the key frame pictures with the number of X + nT2-T2 and the key frames skipped in the middle;
a first scene judgment step of judging whether the scene information of the key frame picture skipped in the middle is the same as the scene information of the key frame picture with the number of X + nT2, and if the judgment result is 'NO', performing a second scene judgment step;
a second scene judgment step of judging whether the scene information of the key frame pictures skipped in the middle is the same as the scene information of the key frame pictures with the number of X + nT2-T2, and if the judgment result is 'NO', performing an insertion step;
an insertion step; and (4) removing skipped key frame pictures among the key frame pictures with the number of X + nT2 and the key frame pictures with the number of X + nT2-T2, and inserting the skipped key frame pictures into the floating window for displaying according to the time sequence.
7. The intelligent television streaming preview method of claim 6, wherein the method further comprises the steps of:
a state judgment step, judging whether the state is in a preview state when a forward or backward command sent by the control terminal is received, and if the judgment result is 'no', performing a single-window display step;
and a single window display step: and displaying a single floating window in the video playing window, extracting corresponding key frame pictures according to the multiple of fast forward or fast backward, or the step length time of forward or backward, and the current playing progress of the video, and continuously updating the key frame pictures in the single floating window.
CN201710817116.8A 2017-09-12 2017-09-12 Intelligent television streaming media preview system and method Active CN107370768B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710817116.8A CN107370768B (en) 2017-09-12 2017-09-12 Intelligent television streaming media preview system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710817116.8A CN107370768B (en) 2017-09-12 2017-09-12 Intelligent television streaming media preview system and method

Publications (2)

Publication Number Publication Date
CN107370768A CN107370768A (en) 2017-11-21
CN107370768B true CN107370768B (en) 2020-03-10

Family

ID=60302567

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710817116.8A Active CN107370768B (en) 2017-09-12 2017-09-12 Intelligent television streaming media preview system and method

Country Status (1)

Country Link
CN (1) CN107370768B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108477961A (en) * 2018-02-07 2018-09-04 深圳德田文化发展有限公司 A kind of method of counting of prayer wheel, system and prayer wheel
CN110740290B (en) * 2018-07-20 2021-08-31 浙江宇视科技有限公司 Monitoring video previewing method and device
CN110446118B (en) * 2019-07-01 2021-08-20 创新先进技术有限公司 Video resource preprocessing method and device and video resource downloading method and device
CN112468869B (en) * 2020-12-15 2022-12-06 北京字节跳动网络技术有限公司 Multimedia file playing control method, device, equipment and medium
CN112584226B (en) * 2021-02-25 2021-06-18 全时云商务服务股份有限公司 Screen capturing method and device for sharing desktop

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102547374A (en) * 2010-12-07 2012-07-04 华录文化产业有限公司 Video image preview method and device based on play time point
CN103546813A (en) * 2013-08-16 2014-01-29 Tcl集团股份有限公司 Android platform based video preview method and smart television
CN103942275A (en) * 2014-03-27 2014-07-23 百度在线网络技术(北京)有限公司 Video identification method and device

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101328199B1 (en) * 2012-11-05 2013-11-13 넥스트리밍(주) Method and terminal and recording medium for editing moving images

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102547374A (en) * 2010-12-07 2012-07-04 华录文化产业有限公司 Video image preview method and device based on play time point
CN103546813A (en) * 2013-08-16 2014-01-29 Tcl集团股份有限公司 Android platform based video preview method and smart television
CN103942275A (en) * 2014-03-27 2014-07-23 百度在线网络技术(北京)有限公司 Video identification method and device

Also Published As

Publication number Publication date
CN107370768A (en) 2017-11-21

Similar Documents

Publication Publication Date Title
CN107370768B (en) Intelligent television streaming media preview system and method
US10628477B2 (en) Search-based navigation of media content
CN110062284B (en) Video playing method and device and electronic equipment
CN110784750B (en) Video playing method and device and computer equipment
US20110289108A1 (en) Assisted Hybrid Mobile Browser
CN109803151B (en) Multimedia data stream switching method and device, storage medium and electronic device
US20160216797A1 (en) Method for capturing screen content of mobile terminal and device thereof
CN108040277B (en) Subtitle switching method and device for multi-language subtitles obtained after decoding
CN109040830B (en) Live broadcast pause prediction method, switching method and device
CN105100912A (en) Streaming media processing method and streaming media processing apparatus
CN104717542A (en) Method, device and system for obtaining synchronization information of intelligent television
CN111698565A (en) Video playing method and device and electronic equipment
CN111147942A (en) Video playing method and device, electronic equipment and storage medium
US20170171605A1 (en) Method and Electronic Device for Switching Live Broadcast to On-Demand Unicast
CN112422888B (en) Video splicing method and device, electronic equipment and computer readable storage medium
CN112188294B (en) Signal source display method and device
US20150271049A1 (en) Optical Character Recognition for Video Automation
KR102618667B1 (en) Multimedia information processing methods, devices, electronic devices and media
EP3151549A1 (en) A digital video recorder and a method for dynamic management of advertising content on a digital video recorder
CN105357561A (en) Information processing method and terminal
JP4938384B2 (en) Moving image data distribution system, moving image data providing method, moving image data distribution program, moving image data providing program, and computer-readable recording medium on which those programs are recorded
US20140344730A1 (en) Method and apparatus for reproducing content
CN105681869A (en) Video browsing method and device
CN115495185A (en) Method and device for displaying page elements
CN112423059B (en) Gesture-based video control method, television, and computer-readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant