WO2017084353A1 - 视频片段快速搜寻方法、装置、系统和计算机可读介质 - Google Patents

视频片段快速搜寻方法、装置、系统和计算机可读介质 Download PDF

Info

Publication number
WO2017084353A1
WO2017084353A1 PCT/CN2016/088569 CN2016088569W WO2017084353A1 WO 2017084353 A1 WO2017084353 A1 WO 2017084353A1 CN 2016088569 W CN2016088569 W CN 2016088569W WO 2017084353 A1 WO2017084353 A1 WO 2017084353A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
frame
feature
appears
video feature
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/088569
Other languages
English (en)
French (fr)
Inventor
杨星
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Le Holdings Beijing Co Ltd
Leshi Zhixin Electronic Technology Tianjin Co Ltd
Original Assignee
Le Holdings Beijing Co Ltd
Leshi Zhixin Electronic Technology Tianjin Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Le Holdings Beijing Co Ltd, Leshi Zhixin Electronic Technology Tianjin Co Ltd filed Critical Le Holdings Beijing Co Ltd
Priority to US15/241,449 priority Critical patent/US20170139933A1/en
Publication of WO2017084353A1 publication Critical patent/WO2017084353A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23406—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving management of server-side video buffer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream

Definitions

  • the present invention relates to a video clip fast search method, apparatus, system and computer readable medium.
  • the method and system search for a video clip of interest based on the identification of a particular video feature, such as a human face.
  • the prior art generally employs a fixed point in time search method. For example, in a movie video with an overall duration of 60 minutes, 20 minutes and 40 minutes are selected as fixed time points. If the user selects 20 minutes, the movie video jumps directly to the 20th minute to start playing; if the user selects 40 minutes, it jumps directly to the 40th minute to start playing.
  • this fixed time point selection search method is extremely inaccurate. Searching for playback from a fixed point in time often overlooks the bridges that many users want to see, and often has to watch a lot of clips that they don't want to see. If the user wants to see a clip that is related to a character or scene, then this fixed point-in-time search method will not be able to meet this need.
  • Embodiments of the present invention provide a video clip fast searching method, apparatus, system, and computer readable medium, which are intended to search for a video segment of interest more quickly and conveniently based on the identification of a particular video feature (eg, a face).
  • a particular video feature eg, a face
  • an embodiment of the present invention provides a video segment fast searching method, where the method includes: analyzing each frame in a video, when a first video feature appears in the analyzed frame, Determining the frame as a start frame, recording a time point at which the start frame appears in the video; when the first video feature appears in each frame after the start frame, accumulating the number of the first video feature Forming a video segment for the first video feature between the start frame and the end frame to find the first video feature until the first video feature is found to be absent in the completed frame The point in time that appears in the video.
  • the number of the second video features is accumulated from the second frame until the second is found in the specific frame. If the video feature no longer exists, a video segment for the second video feature is formed between the second frame and the particular frame.
  • the feature value is extracted for the first video feature in the start frame, and the feature value is stored.
  • Another embodiment of the present invention provides a video clip fast searching method, the method comprising: selecting the first video feature; and searching for the first video feature to appear in the video based on the selecting a time point, wherein, when the first video feature appears in each frame after the start frame in the video, the number of the first video features is accumulated until the first video feature is found in the completed frame If not already present, a video segment for the first video feature is formed between the start frame and the end frame.
  • An embodiment of the present invention further provides a video segment fast searching device, the device comprising: a video feature analyzing unit, configured to analyze each frame in the video one by one, and the specified first video feature appears in the analyzed frame. Setting the frame as a start frame, recording a time point at which the start frame appears in the video; and a video segment generating unit, configured to: when the first video feature appears in each frame after the start frame And the number of the first video features is accumulated until a first video feature is found to be absent in the completed frame, and a video segment for the first video feature is formed between the start frame and the end frame. To be able to search for the first video feature in the The point in time that appears in the video.
  • the apparatus further includes a feature value extracting unit, configured to extract a feature value for the first video feature in the start frame according to the algorithm library and store the feature value.
  • a feature value extracting unit configured to extract a feature value for the first video feature in the start frame according to the algorithm library and store the feature value.
  • An embodiment of the present invention further provides a video segment fast searching device, the device comprising: a feature selecting unit, the feature selecting unit is configured to select the first video feature; a searching unit, the searching The unit is configured to search for a time point in which the first video feature appears in the video based on the selection, where the first video feature occurs in each frame after the start frame in the video, The number of video features is accumulated until a first video feature is found to be absent in the completed frame, and a video segment for the first video feature is formed between the start frame and the end frame.
  • An embodiment of the present invention further provides a video clip fast searching system, the system comprising: a server end, wherein the server side is configured to analyze each frame in the video, when the first video feature appears in the analyzed frame Setting the frame as a start frame, recording a time point at which the start frame appears in the video; when the first video feature appears in each frame after the start frame, the number of the first video feature Performing an accumulation until a first video feature is found to be absent in the completed frame, forming a video segment for the first video feature between the start frame and the end frame to enable searching for the first a point in time at which the video feature appears in the video; the client, the client is configured to select the first video feature, and based on the selecting, the server searches for the first video feature in the video a time point of occurrence, wherein, when the first video feature appears in each frame after the start frame in the video, the number of the first video feature is accumulated until the first video is found in the completed frame Syndrome does not exist, a video segment is formed for the first video characteristic between
  • the number of the second video features is accumulated from the second frame until If it is found that the second video feature is no longer present in a particular frame, then a video segment for the second video feature is formed between the second frame and the particular frame.
  • the server extracts a feature value for the first video feature in the start frame according to the algorithm library, and stores the feature value.
  • An embodiment of the present invention further provides a computer readable medium having stored thereon a corresponding computer program for use in the aforementioned video clip fast search method.
  • the processing of the video clips for a specific video feature is completed by processing on the server side, and then the video clips are searched at the client.
  • a specific video feature e.g., a character
  • the user can conveniently find and watch the desired video clip for a specific video feature.
  • the video clip search for the specific video feature adopted by the present invention is obviously more convenient and faster.
  • Fig. 1 is a flow chart showing the processing procedure of the search method in the server side according to the first embodiment of the present invention.
  • FIG. 2 is a flow chart showing a search method of a search method on a client according to a second embodiment of the present invention
  • Figure 3 is a block diagram showing the structure of a search device in a third embodiment of the present invention.
  • Figure 4 is a block diagram showing the structure of a search device in a fourth embodiment of the present invention.
  • Figure 5 is a block diagram showing the structure of a search device in a fifth embodiment of the present invention.
  • FIG. 6 is a block diagram showing the structure of a video clip fast search system in a sixth embodiment of the present invention.
  • FIG. 7 is a block diagram showing the structure of a video clip fast search system in a seventh embodiment of the present invention.
  • Fig. 8 is a block diagram showing the structure of a video clip quick search system in accordance with an eighth embodiment of the present invention.
  • the embodiment of the present invention is different from the prior art in that a fixed time point is used for searching, but a specific video feature specified by the user is used for corresponding searching, so that the user can quickly find the video clip that he wants to see.
  • a picture is provided by a user, and a specific video feature (for example, a character picture, a scene picture) in a picture provided by the user is previously searched in the video, and an automatic search is performed for the specific video feature, so that the user can conveniently find the specific The specific feature of the video feature in the video, thereby locking the specific location of the video feature in the overall video.
  • FIG. 1 shows a processing procedure of a search method on a server side according to an embodiment of the present invention.
  • step 100 the server analyzes each frame in the video to obtain a specific face image in the video picture of the frame.
  • step 101 when the user-specified person 1 appears in the video picture of the analyzed frame, the frame is set as the start frame, and the feature value of the character 1 is extracted according to the algorithm library, and the character 1 is The feature values are stored on the remote server while recording the point in time at which the first frame appears in the video.
  • the character 1 in the video picture and the algorithm library are pre- The feature values entered first are paired and compared. In the case where it is determined that the character 1 presented in the video picture matches the feature values (for example, nose, eye, mouth, and ear features) of the character 1 entered in the algorithm library, the feature values of the character 1 will be Remotely transferred to the remote server and stored on the remote server, and the time point at which the matching image appears in the video will also be recorded.
  • the feature values for example, nose, eye, mouth, and ear features
  • step 102 the second frame immediately following the first frame is analyzed.
  • each feature value of the character 2 is also pre-recorded in the algorithm library. Therefore, according to the manner described above, the character 2 presented in the video picture is also associated with each feature value of the character 2 entered in the algorithm library. For pairing comparison, in the case of paired contrast matching, the character values of the character 2 will also be stored on the remote server, and the time point at which the second frame (as the starting frame of the character 2) appears in the video is recorded. .
  • step 103 the third frame immediately following the second frame is analyzed.
  • step 104 until the Nth frame is found to find that the character 1 is no longer present, the time point of the Nth frame in the video at this time is recorded, and the Nth frame may be referred to as a completed frame for the character 1.
  • a video segment for the character 1 is formed between the start frame and the end frame.
  • the start frame and the end frame are also examined for other characters (for example, the character 2, the character 3, and the character 4), thereby determining the respective video segments for other characters.
  • the Nth frame it can also be repeated for the character 1.
  • the step 101 and the subsequent steps are restarted.
  • the character 1 will appear again in the next start frame and end again in the next completed frame, whereby the next video segment for the character 1 is formed between the next start frame and the next completed frame.
  • the processing of the video segments for a plurality of specific video features is completed by the server, and the effective cooperation between the server and the client enables the user to conveniently find the desired video segment for the specific video feature and perform the video segment. Watch.
  • the method adopted by the present invention is not only more convenient and fast, but also can search and select multiple video features.
  • the feature values are stored in the remote server, which can be utilized in the next comparison, which greatly improves the efficiency and accuracy of the search.
  • FIG. 2 shows a process of the search method on the server side according to another embodiment of the present invention.
  • each frame in the video is analyzed.
  • the frame is set as the start frame, and the time point at which the start frame appears in the video is recorded.
  • the frame is set as the start frame, and the feature value of the character 1 is extracted according to the algorithm library, and the feature value of the character 1 is stored in
  • the remote server simultaneously records the point in time when the first frame appears in the video.
  • the Nth frame is at the time point in the video, and the Nth frame may be referred to as the completed frame for the character 1.
  • a video segment for the character 1 is formed between the start frame and the end frame to be able to search for a point in time at which the first video feature appears in the video.
  • the processing of the video segments for a particular video feature is completed by processing on the server side, and the video segments are then searched at the client.
  • the user can easily find and watch the desired video clip for a specific video feature.
  • the video clip search for specific video features employed by the present invention is obviously more convenient and faster.
  • FIG. 3 illustrates a process of cooperation between a client and a server on a search method according to an embodiment of the present invention.
  • step 200 the user can click on the processed video above at the client.
  • step 201 the client obtains the list of characters appearing in the entire video from the server side, and optionally, the image of the corresponding character in the video is also displayed at the client.
  • step 202 the user will see the specific person appearing in the video in the interface, and the user can directly select the person who wants to watch (for example, a specific actor) through the interactive page in the interface.
  • step 203 when the user selects a certain character (for example, the character 1 described above), the client will obtain the entire list of the characters appearing in the video from the server side, and automatically search according to the list. The selected point in time at which the character first appeared in the video.
  • a certain character for example, the character 1 described above
  • the client will examine the time point in the list corresponding to the subsequent start frame of the character until finally searching for the video segment desired to be viewed. In this case, the user will be able to see the character story that he wishes to watch.
  • the first video segment, the second video segment, the third video segment, and the fourth video segment of the character 1, the character 2, the character 3, and the character 4 representing different video features are formed.
  • the list can be visually presented on the client's interactive interface (eg, a TV screen).
  • the user can randomly select the first video segment, the second video segment, the third video segment, and the fourth video segment of each of the character 1, the character 2, the character 3, and the character 4 on the interactive interface according to their own preferences. For example, if the user wants to see the second video segment of the character 3, then click on "People 3/Second Video Segment" on the screen to see the desired video content.
  • the client can also hide this list from the user.
  • the user wants to see the second video segment of the character 3
  • the user only needs to input "person 3/second video segment" at the client, and can also see the desired video content.
  • the above refers to the "person” as an example to introduce the cooperation between the client and the server.
  • the "person” only represents a specific video feature, in fact, in the customer.
  • the client searches for the video segment, and through the effective cooperation between the server and the client, the user can conveniently find and view the desired video segment for a specific video feature.
  • the video clip search for the specific video feature adopted by the present invention is obviously more convenient and faster.
  • a video segment fast searching device is provided, and the device may Running on the server side, the video feature analyzing unit 410 and the video segment generating unit 420 are included. As shown in Figure 4:
  • the video feature analysis unit 410 is configured to analyze each frame in the video, and when the specified first video feature appears in the analyzed frame, set the frame as a start frame, and record the time when the start frame appears in the video. point.
  • the video feature analyzing unit 410 compares and compares the character 1 in the video picture with the feature value pre-recorded in the algorithm library in the video picture of the analyzed frame. If they match, the first video feature is considered to be present in the frame picture.
  • the video segment generating unit 420 is configured to accumulate the first video feature when the first video feature appears in each frame after the start frame, until the first video feature is found to be absent in the completed frame. And forming a video segment for the first video feature between the start frame and the end frame. Specifically, when it is found that the character 1 does not exist when the Nth frame is observed, the time point of the Nth frame in the video at this time is recorded, and the Nth frame may be referred to as a completed frame for the character 1.
  • the video segment generating unit 420 forms a video segment for the person 1 between the start frame and the end frame.
  • the video segment is used to enable a client to search for a point in time at which the first video feature appears in the video.
  • the processing of the video clips for specific video features is completed by the server, and then the video segments are searched at the client.
  • the server Through the effective cooperation between the server and the client, the user can easily find and watch the desired video clip for a specific video feature.
  • the video clip search for the specific video feature adopted by the present invention is obviously more convenient and faster.
  • a video segment fast searching device is provided, and the device may be run on a server side, and includes a video feature analyzing unit 510 and a video segment generating unit 520. As shown in Figure 5:
  • the video feature analysis unit 510 is configured to analyze each frame in the video, when the analyzed frame is out When the first video feature is specified, the frame is set as the start frame, and the time point at which the start frame appears in the video is recorded. The video feature analyzing unit 510 compares and compares the character 1 in the video picture with the feature value pre-recorded in the algorithm library in the video picture of the analyzed frame. If they match, the first video feature is considered to be present in the frame picture.
  • the apparatus further includes a feature value extracting unit 511 for extracting a feature value for the first video feature in the start frame according to the algorithm library and storing the feature value.
  • a feature value extracting unit 511 for extracting a feature value for the first video feature in the start frame according to the algorithm library and storing the feature value.
  • the video segment generating unit 520 is configured to accumulate the first video feature when the first video feature appears in each frame after the start frame, until the first video feature is found to be absent in the completed frame. And forming a video segment for the first video feature between the start frame and the end frame. Specifically, when it is found that the character 1 does not exist when the Nth frame is observed, the time point of the Nth frame in the video at this time is recorded, and the Nth frame may be referred to as a completed frame for the character 1.
  • the video segment generating unit 520 forms a video segment for the person 1 between the start frame and the end frame.
  • the video segment is used to enable a client to search for a point in time at which the first video feature appears in the video.
  • the processing of the video clips for specific video features is completed by the server, and then the video segments are searched at the client.
  • the user can easily find and watch the desired video clip for a specific video feature.
  • the feature values of the video features are stored on the remote server, the feature values can be stored such that other parties acquire the feature values and use the feature values to search for particular video features.
  • the video clip search for the specific video feature adopted by the present invention is obviously more convenient and faster.
  • a video clip fast searching device is provided, and the device operates At the client side, a feature selection unit 610 and a search unit 620 are included. As shown in Figure 6:
  • the feature selection unit 610 is configured to select the first video feature. For example, the client will get a list of people appearing in the entire video from the server side, which can be visually presented on the client's interactive interface (eg, a TV screen). At this time, the user can use the feature selection unit 610 to randomly select the first video segment, the second video segment, the third video segment, and the fourth video segment of each of the person 1, the character 2, the character 3, and the character 4 on the interactive interface.
  • the searching unit 620 is configured to search for a time point at which the first video feature appears in the video based on the selection.
  • the number of the first video feature is accumulated until the first video feature is found to be absent in the completed frame.
  • a video segment for the first video feature is then formed between the start frame and the end frame.
  • Each frame in which the first video feature appears corresponds to a point in time at which the first video feature appears in the video.
  • the client searches for the video segment, and through the effective cooperation between the server and the client, the user can conveniently find and view the desired video segment for a specific video feature.
  • the video clip search for the specific video feature adopted by the present invention is obviously more convenient and faster.
  • a video segment fast searching system is provided, and the system includes a server end 710 and a client end 720. As shown in Figure 7:
  • the server 710 is configured to analyze each frame in the video.
  • the first video feature appears in the analyzed frame, set the frame as a start frame, and record a time point at which the start frame appears in the video.
  • the number of the first video features is accumulated until it is found in the completed frame that the first video feature does not exist, then A video segment for the first video feature is formed between the start frame and the end frame to enable searching for a point in time at which the first video feature appears in the video.
  • the client 720 is configured to select the first video feature, based on the selection,
  • the server searches for a point in time when the first video feature appears in the video, where the first video feature is present in each frame after the start frame in the video.
  • the accumulation is performed until a first video feature is found to be absent in the completed frame, and a video segment for the first video feature is formed between the start frame and the end frame.
  • the processing of the video segments for a particular video feature is completed by processing on the server side, and the video segments are then searched at the client.
  • the user can conveniently find and watch the desired video clip for a specific video feature.
  • the video clip search for the specific video feature adopted by the present invention is obviously more convenient and faster.
  • a video clip fast searching system is provided, and the system includes a server end 810 and a client end 820. As shown in Figure 8:
  • the server 810 is configured to analyze each frame in the video.
  • the first video feature appears in the analyzed frame, set the frame as a start frame, and record a time point at which the start frame appears in the video.
  • the number of the first video features is accumulated until it is found in the completed frame that the first video feature does not exist, then A video segment for the first video feature is formed between the start frame and the end frame to enable searching for a point in time at which the first video feature appears in the video.
  • the server end 810 further includes a feature value extracting unit 811, configured to extract a feature value for the first video feature in the start frame according to the algorithm library and store the feature value.
  • the client 820 is configured to select the first video feature, and based on the selecting, the server searches for a time point at which the first video feature appears in the video, where a start frame in the video When the first video feature appears in each subsequent frame, the number of the first video features is accumulated until the first video feature is found to be absent in the completed frame, and the start frame and the end are completed. A video segment for the first video feature is formed between the frames.
  • the client searches for the video segment, and through the effective cooperation between the server and the client, the user can conveniently find and view the desired video segment for a specific video feature.
  • the feature values of the video features are stored on the remote server, the feature values can be stored such that other parties acquire the feature values and use the feature values to search for particular video features.
  • the video clip search for the specific video feature adopted by the present invention is obviously more convenient and faster.
  • the processing of the video segments for a specific video feature is completed by processing on the server side, and then the video segments are searched at the client.
  • a specific video feature such as a character
  • the user can conveniently find and watch the desired video clip for a specific video feature.
  • the video segment search for the specific video feature used in the embodiment of the present invention is obviously more convenient and faster.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).
  • the technical solution of the embodiments of the present invention may be embodied in the form of a software product stored in a storage medium.
  • a number of instructions are included to cause a mobile terminal (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .
  • the device embodiments described above are merely illustrative, wherein the described as separate components
  • the illustrated units may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the objectives of the embodiments of the present invention. Those of ordinary skill in the art can understand and implement without deliberate labor.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

提供一种视频片段快速搜寻方法、装置、系统和计算机可读介质，在服务器端分析视频中的每一帧，当分析的帧的视频图片中出现指定的视频特征时，该帧被设定为起始帧，记录起始帧在视频中出现的时间点；当起始帧后的各帧的视频图片中出现该视频特征时，对该视频特征的数量进行累加，直至发现在完结帧中发现该视频特征已经不存在，则在起始帧和完结帧之间形成针对该视频特征的视频段；当在客户端选定该视频特征时，客户端从服务器端获取该视频特征在视频中所出现的列表，根据列表自动搜寻到该视频特征出现在所述视频中的时间点。相比于现有技术中的固定时间点搜寻方式，所采用的针对特定视频特征的视频片段搜寻显然更为方便和快捷。

Description

视频片段快速搜寻方法、装置、系统和计算机可读介质
本申请要求2015年11月20日提交的中国专利申请201510799082.5的优先权，其全部内容通过引用被合并于此。
技术领域
本发明涉及一种视频片段快速搜寻方法、装置、系统和计算机可读介质，特别地，该方法及系统基于特定视频特征(例如人脸)的识别来搜寻感兴趣的视频片段。
背景技术
当用户在显示屏上观看视频时，用户往往不会对整段视频均感兴趣。基于其个人爱好、时间限制，用户经常希望能够直接跳到特定的视频片段以观赏这一视频片段。
例如，当用户在显示屏上观看一部电影时，该用户有可能只关注该电影中出现的某一明星，因此只希望欣赏该明星出现的桥段。这就要求能够提供一种视频片段搜寻方法，使用户能够快速且方便地搜寻到感兴趣的视频片段。
在此情况下，现有技术通常采用固定时间点搜寻方法。例如，在一部整体时长为60分钟的电影视频中，选择20分钟点、40分钟点作为固定时间点。用户如果选择20分钟点，则电影视频直接跳到第20分钟开始播放；用户如果选择40分钟点，则直接跳到第40分钟开始播放。
发明人在实现发明的过程中发现：这种固定时间点选择搜寻方法极为不精确。从固定时间点搜寻播放，往往会忽略很多用户所希望看到的桥段，而且往往不得不观看很多并不希望看到的片段。如果用户希望观赏到的片段是与某个人物或场景相关，那么这种固定时间点搜寻方法将无法满足这种需求。
发明内容
本发明实施例提供一种视频片段快速搜寻方法、装置、系统和计算机可读介质，旨在基于特定视频特征(例如人脸)的识别来更快捷且方便地搜寻感兴趣的视频片段。
具体而言，本发明的一个实施例提供了一种视频片段快速搜寻方法，其特征在于，所述方法包括：分析视频中的每一帧，当分析的帧中出现第一视频特征时，设定该帧为起始帧，记录起始帧在所述视频中出现的时间点；当起始帧后的各帧中出现所述第一视频特征时，对该第一视频特征的数量进行累加，直至在完结帧中发现所述第一视频特征已经不存在，则在所述起始帧和完结帧之间形成针对所述第一视频特征的视频段，以能够搜寻所述第一视频特征在所述视频中出现的时间点。
可选地，当在起始帧后的第二帧中出现指定的第二视频特征时，从第二帧开始对所述第二视频特征的数量进行累加，直至发现在特定帧中该第二视频特征已不存在，则在所述第二帧和所述特定帧之间形成针对所述第二视频特征的视频段。
可选地，根据算法库，针对处于起始帧的第一视频特征提取特征值，并存储该特征值。
本发明的另一实施例提供了一种视频片段快速搜寻方法，所述方法包括：对所述第一视频特征进行选择；基于所述选择，搜寻所述第一视频特征在所述视频中出现的时间点，其中，当视频中的起始帧后的各帧中出现所述第一视频特征时，对该第一视频特征的数量进行累加，直至在完结帧中发现所述第一视频特征已经不存在，则在所述起始帧和完结帧之间形成针对所述第一视频特征的视频段。
本发明的一实施例还提供了一种视频片段快速搜寻装置，所述装置包括：视频特征分析单元，用于逐一分析视频中的每一帧，当分析的帧中出现指定的第一视频特征时，设定该帧为起始帧，记录起始帧在所述视频中出现的时间点；视频段生成单元，用于当起始帧后的各帧中出现所述第一视频特征时对该第一视频特征的数量进行累加，直至在完结帧中发现所述第一视频特征已经不存在，则在所述起始帧和完结帧之间形成针对所述第一视频特征的视频段，以能够搜寻所述第一视频特征在所 述视频中出现的时间点。
可选地，所述装置还包括特征值提取单元，所述特征值提取单元用于根据算法库针对处于起始帧的第一视频特征提取特征值并存储该特征值。
本发明的一实施例还相应提供了一种视频片段快速搜寻装置，所述装置包括：特征选择单元，所述特征选择单元用于对所述第一视频特征进行选择；搜寻单元，所述搜寻单元用于基于所述选择搜寻所述第一视频特征在所述视频中出现的时间点，其中，当视频中的起始帧后的各帧中出现所述第一视频特征时，对该第一视频特征的数量进行累加，直至在完结帧中发现所述第一视频特征已经不存在，则在所述起始帧和完结帧之间形成针对所述第一视频特征的视频段。
本发明的一实施例还相应提供了一种视频片段快速搜寻系统，该系统包括：服务器端，所述服务器端用于分析视频中的每一帧，当分析的帧中出现第一视频特征时，设定该帧为起始帧，记录起始帧在所述视频中出现的时间点；当起始帧后的各帧中出现所述第一视频特征时，对该第一视频特征的数量进行累加，直至在完结帧中发现所述第一视频特征已经不存在，则在所述起始帧和完结帧之间形成针对所述第一视频特征的视频段，以能够搜寻所述第一视频特征在所述视频中出现的时间点；客户端，所述客户端用于对所述第一视频特征进行选择，基于所述选择，服务器端搜寻所述第一视频特征在所述视频中出现的时间点，其中，当视频中的起始帧后的各帧中出现所述第一视频特征时，对该第一视频特征的数量进行累加，直至在完结帧中发现所述第一视频特征已经不存在，则在所述起始帧和完结帧之间形成针对所述第一视频特征的视频段。
可选地，在所述服务器端中，当在紧随起始帧的第二帧中出现指定的第二视频特征时，从第二帧开始对所述第二视频特征的数量进行累加，直至发现在特定帧中该第二视频特征已不存在，则在所述第二帧和所述特定帧之间形成针对所述第二视频特征的视频段。
可选地，所述服务器端根据算法库针对处于起始帧的第一视频特征提取特征值，并存储该特征值。
本发明的一实施例还相应提供了一种计算机可读介质，所述计算机可读介质上存储有相应的计算机程序，所述计算机程序用于前述的视频片段快速搜寻方法。
根据本发明的上述视频片段快速搜寻方法和系统，通过服务器端进行处理完成了针对特定视频特征(例如人物)的视频片段的拣选，随之在客户端对这些视频片段进行搜寻。由此，通过服务器端和客户端的有效配合，使得用户可以方便查找到针对特定视频特征的期望的视频片段并进行观赏。相比于现有技术中的固定时间点搜寻方式，本发明所采用的针对特定视频特征的视频片段搜寻显然更为方便和快捷。
附图说明
本发明实施例的附图旨在对本申请的技术方案进行清晰直观的显示，所示附图如下：
图1示出了根据本发明第一实施例中的搜寻方法在服务器端的处理过程的流程图。
图2示出了根据本发明第二实施例中的搜寻方法在客户端的搜寻方法流程图；
图3示出了根据本发明第三实施例中的搜寻装置的结构框图；
图4示出了根据本发明第四实施例中的搜寻装置的结构框图；
图5示出了根据本发明第五实施例中的搜寻装置的结构框图；
图6示出了根据本发明第六实施例中的视频片段快速搜寻系统的结构框图；
图7示出了根据本发明第七实施例中的视频片段快速搜寻系统的结构框图；
图8示出了根据本发明第八实施例中的视频片段快速搜寻系统的结构框图。
具体实施方式
本发明实施例不同于现有技术采用固定时间点进行搜寻的方式，而是通过用户指定的特定视频特征来进行相应搜寻，从而让用户能够快速查找到自己想要看到的视频片段。特别地，由用户提供图片，在视频中预先查找用户提供的图片中的特定视频特征(例如，人物画面、场景画面)，针对该特定视频特征进行自动搜寻，以便使用户能够方便地查找到特定视频特征在视频中的具体帧，由此锁定视频特征在整体视频中的具体位置。
上述过程需要服务器端和客户端的有效配合。下文中，将结合实施例介绍服务器端和客户端如何配合以实现本发明的上述基本构想。
需要注意的是，下文中将“特定视频特征”具体化为“人物”。但可以理解的是，本发明并不限于对于人物的搜寻，对于其他视频特征的搜寻也落在本发明的保护范围之内。
第一实施例：
图1示出了根据本发明实施例的搜寻方法在服务器端的处理过程。
在步骤100，服务器端分析视频中的每一帧，以获取该帧的视频图片中的特定人脸图像。
接下来，在步骤101中，当所分析的帧的视频图片中出现用户指定的人物1时，则该帧被设定为起始帧，并根据算法库，提取人物1的特征值，将人物1的特征值存储于远程服务器，同时记录第一帧在视频中出现的时间点。
举例而言，可以提前在算法库中录入代表不同视频特征的人物(如人物1、人物2、人物3、人物4)的体貌特征(如鼻特征、眼特征、口特征、耳特征)：
人物1 鼻特征 眼特征 口特征 耳特征
人物2 鼻特征 眼特征 口特征 耳特征
人物3 鼻特征 眼特征 口特征 耳特征
人物4 鼻特征 眼特征 口特征 耳特征
在所分析的帧的视频图片时，将视频图片中的人物1与算法库中预 先录入的特征值进行配对对比。在确定视频图片中所呈现的人物1与算法库中所录入的关于人物1的各特征值(例如，鼻、眼、口、耳特征)吻合的情况下，人物1的各特征值将会被远程传输至远程服务器并存储在该远程服务器上，同时还将记录下配对对比时吻合的画面在视频中所出现的时间点。
在步骤102中，接下来分析紧随第一帧的第二帧。
当第二帧继续出现人物1并开始出现人物2时，根据算法库的识别，由于第一帧中已经出现了人物1，则对人物1的数量累加1，针对人物2，则进行步骤101的操作。
具体而言，算法库中也预先录入了人物2的各特征值，因此，依照上文所述方式，视频图片中所呈现的人物2也与算法库中所录入的关于人物2的各特征值进行配对对比，在配对对比吻合的情况下，人物2的各特征值也将被存储于远程服务器上，并记录下第二帧(作为人物2的起始帧)在视频中所出现的时间点。
在步骤103中，接下来分析紧随第二帧的第三帧。
当第三帧继续出现人物1时，根据算法库的识别，获知人物1已经出现在了第一帧和第二帧，则对人物1的数量再累加1。以此类推。
在步骤104中，直至考察到第N帧时发现人物1已经不存在，则记录下此时第N帧在视频中的时间点，第N帧可称为针对人物1的完结帧。在起始帧和完结帧之间形成针对人物1的视频段。
类似地，依据上述方式，也同时针对其他人物(例如，人物2、人物3、人物4)进行起始帧和完结帧的考察，从而确定针对其他人物的各自的视频段。
通过上述过程就完成了服务器端的一次处理。
需要注意的是，如果服务器端只针对一个人物进行处理，则上述过程将变得更为简单，只需要考察人物1在视频中出现的数量和结束帧，而无需考察人物2和/或其他人物。
另外，还需要注意的是，在第N帧之后，还可以针对人物1重复上 述步骤，重新开始启动步骤101以及随后步骤。在此情况下，人物1将再次出现在下一起始帧，并再次完结于下一完结帧，由此，在下一起始帧和下一完结帧之间形成针对人物1的下一视频段。
采用本实施例，通过服务器端进行处理完成了针对多个特定视频特征的视频片段的拣选，通过服务器端和客户端的有效配合，使得用户可以方便查找到针对特定视频特征的期望的视频片段并进行观赏。相比于现有技术中的固定时间点搜寻方式，本发明所采用的方法不仅更为方便和快捷，而且可以对多个视频特征进行搜寻、选择。而且，在对特定视频特征的特征值进行提取后，将特征值存储于远程服务器，可以在下次比对时利用，大大提高了搜索的效率和准确性。
第二实施例：
图2显示了根据本发明另一实施例的搜寻方法在服务器端的处理过程。
在步骤111，分析视频中的每一帧，当分析的帧中出现第一视频特征时，设定该帧为起始帧，记录起始帧在所述视频中出现的时间点。
具体地，当所分析的帧的视频图片中出现用户指定的人物1时，则该帧被设定为起始帧，并根据算法库，提取人物1的特征值，将人物1的特征值存储于远程服务器，同时记录第一帧在视频中出现的时间点。
在步骤112，当起始帧后的各帧中出现所述第一视频特征时，对该第一视频特征的数量进行累加，直至考察到第N帧时发现人物1已经不存在，则记录下此时第N帧在视频中的时间点，第N帧可称为针对人物1的完结帧。在起始帧和完结帧之间形成针对人物1的视频段，以能够搜寻所述第一视频特征在所述视频中出现的时间点。
采用本实施例，通过服务器端进行处理完成了针对特定视频特征的视频片段的拣选，随之在客户端对这些视频片段进行搜寻。通过服务器端和客户端的有效配合，使得用户可以方便查找到针对特定视频特征的期望的视频片段并进行观赏。相比于现有技术中的固定时间点搜寻方式， 本发明所采用的针对特定视频特征的视频片段搜寻显然更为方便和快捷。
下文将结合实施例介绍客户端对已被服务器端处理过的视频的相应操作。
第三实施例：
图3示出了根据本发明实施例的搜寻方法在客户端对服务器端的配合过程。
具体而言，在步骤200中，用户可以在客户端点击处理过的上述视频。
然后，在步骤201中，客户端会从服务器端获得整个视频中出现的人物列表，可选地，同时在客户端处还会显示出相应人物在视频中的图片。
随后，在步骤202中，用户将会在界面中看到视频中所出现的特定人物，用户可以通过界面中的交互页面直接选择希望观看的人物(例如，特定演员)。
在步骤203中，当用户选定某一人物(例如，上文所述的人物1)时，客户端将从服务器端获取该人物在视频中所出现的全部列表，并且根据该列表自动搜寻到选定的该人物第一次出现在视频中的时间点。
进一步，如果用户希望观赏关于该人物在列表中的另一视频段时，客户端将考察列表中的关于该人物的其后的起始帧对应的时间点，直至最终搜寻所希望观看的视频段，在此情况下，用户将能观赏到希望观看的人物剧情。
举例而言，通过上述处理过程，形成了代表不同视频特征的人物1、人物2、人物3、人物4的第一视频段、第二视频段、第三视频段、第四视频段。
相应地，列表将形成如下：
Figure PCTCN2016088569-appb-000001
该列表可以直观地呈现在客户端的交互界面(例如，电视屏幕)上。此时，用户可以依据自身的喜好在交互界面上任意点选人物1、人物2、人物3、人物4各自的第一视频段、第二视频段、第三视频段、第四视频段。例如，用户希望看到人物3的第二视频段，则直接在屏幕上点选“人物3/第二视频段”，即可看到其期望的视频内容。
当然，客户端也可以向用户隐藏这一列表。在此情况下，如用户希望看到人物3的第二视频段，只需用户在客户端输入“人物3/第二视频段”，也可以看到其期望的视频内容。
需要注意的是，上文以“人物”为例介绍了客户端和服务器端之间的配合，然而，可以理解的是，“人物”仅仅代表了一种特定的视频特征，实际上，在客户端和服务器端的配合过程中，也可以考虑针对人物之外的其他特定情境进行搜寻，例如搜寻视频中出现的建筑物、河流、山川等等。
采用本实施例，客户端对视频片段进行搜寻，通过服务器端和客户端的有效配合，使得用户可以方便查找到针对特定视频特征的期望的视频片段并进行观赏。相比于现有技术中的固定时间点搜寻方式，本发明所采用的针对特定视频特征的视频片段搜寻显然更为方便和快捷。
第四实施例：
在本实施例中，提供了一种视频片段快速搜寻装置，所述装置可以 运行在服务器端，包括视频特征分析单元410和视频段生成单元420。如图4所示：
视频特征分析单元410用于分析视频中的每一帧，当分析的帧中出现指定的第一视频特征时，设定该帧为起始帧，记录起始帧在所述视频中出现的时间点。视频特征分析单元410在所分析的帧的视频图片时，将视频图片中的人物1与算法库中预先录入的特征值进行配对对比。如果相匹配，则认为该帧图片中出现了第一视频特征。
视频段生成单元420用于当起始帧后的各帧中出现所述第一视频特征时对该第一视频特征的数量进行累加，直至在完结帧中发现所述第一视频特征已经不存在，则在所述起始帧和完结帧之间形成针对所述第一视频特征的视频段。具体地，在考察到第N帧时发现人物1已经不存在，则记录下此时第N帧在视频中的时间点，第N帧可称为针对人物1的完结帧。视频段生成单元420在起始帧和完结帧之间形成针对人物1的视频段。
所述视频段用以使客户端能够搜寻所述第一视频特征在所述视频中出现的时间点。
采用本实施例，通过服务器端进行处理，完成了针对特定视频特征的视频片段的拣选，随之在客户端对这些视频片段进行搜寻。通过服务器端和客户端的有效配合，使得用户可以方便查找到针对特定视频特征的期望的视频片段并进行观赏。相比于现有技术中的固定时间点搜寻方式，本发明所采用的针对特定视频特征的视频片段搜寻显然更为方便和快捷。
第五实施例：
在本实施例中，提供了一种视频片段快速搜寻装置，所述装置可以运行在服务器端，包括视频特征分析单元510和视频段生成单元520。如图5所示：
视频特征分析单元510用于分析视频中的每一帧，当分析的帧中出 现指定的第一视频特征时，设定该帧为起始帧，记录起始帧在所述视频中出现的时间点。视频特征分析单元510在所分析的帧的视频图片时，将视频图片中的人物1与算法库中预先录入的特征值进行配对对比。如果相匹配，则认为该帧图片中出现了第一视频特征。
所述装置还包括特征值提取单元511，所述特征值提取单元用于根据算法库针对处于起始帧的第一视频特征提取特征值并存储该特征值。在确定视频图片中所呈现的人物1与算法库中所录入的关于人物1的各特征值(例如，鼻、眼、口、耳特征)吻合的情况下，人物1的各特征值将会被远程传输至远程服务器并存储在该远程服务器上。
视频段生成单元520用于当起始帧后的各帧中出现所述第一视频特征时对该第一视频特征的数量进行累加，直至在完结帧中发现所述第一视频特征已经不存在，则在所述起始帧和完结帧之间形成针对所述第一视频特征的视频段。具体地，在考察到第N帧时发现人物1已经不存在，则记录下此时第N帧在视频中的时间点，第N帧可称为针对人物1的完结帧。视频段生成单元520在起始帧和完结帧之间形成针对人物1的视频段。
所述视频段用以使客户端能够搜寻所述第一视频特征在所述视频中出现的时间点。
采用本实施例，通过服务器端进行处理，完成了针对特定视频特征的视频片段的拣选，随之在客户端对这些视频片段进行搜寻。通过服务器端和客户端的有效配合，使得用户可以方便查找到针对特定视频特征的期望的视频片段并进行观赏。而且，由于将视频特征的特征值存储到远程服务器上，因此能够对特征值进行存储，以便使其他方获取所述特征值并用所述所述特征值搜索特定的视频特征。相比于现有技术中的固定时间点搜寻方式，本发明所采用的针对特定视频特征的视频片段搜寻显然更为方便和快捷。
第六实施例：
在本实施例中，提供了一种视频片段快速搜寻装置，所述装置运行 于客户端，包括特征选择单元610和搜寻单元620。如图6所示：
所述特征选择单元610用于对所述第一视频特征进行选择。例如，客户端会从服务器端获得整个视频中出现的人物列表，该列表可以直观地呈现在客户端的交互界面(例如，电视屏幕)上。此时，用户可以利用特征选择单元610在交互界面上任意点选人物1、人物2、人物3、人物4各自的第一视频段、第二视频段、第三视频段、第四视频段。
所述搜寻单元620用于基于所述选择搜寻所述第一视频特征在所述视频中出现的时间点。
其中，当视频中的起始帧后的各帧中出现所述第一视频特征时，对该第一视频特征的数量进行累加，直至在完结帧中发现所述第一视频特征已经不存在，则在所述起始帧和完结帧之间形成针对所述第一视频特征的视频段。每个出现第一视频特征的帧都对应一个第一视频特征在所述视频中出现的时间点。
采用本实施例，客户端对视频片段进行搜寻，通过服务器端和客户端的有效配合，使得用户可以方便查找到针对特定视频特征的期望的视频片段并进行观赏。相比于现有技术中的固定时间点搜寻方式，本发明所采用的针对特定视频特征的视频片段搜寻显然更为方便和快捷。
第七实施例：
本实施例中提供了一种视频片段快速搜寻系统，该系统包括服务器端710和客户端720。如图7所示：
所述服务器端710用于分析视频中的每一帧，当分析的帧中出现第一视频特征时，设定该帧为起始帧，记录起始帧在所述视频中出现的时间点；当起始帧后的各帧中出现所述第一视频特征时，对该第一视频特征的数量进行累加，直至在完结帧中发现所述第一视频特征已经不存在，则在所述起始帧和完结帧之间形成针对所述第一视频特征的视频段，以能够搜寻所述第一视频特征在所述视频中出现的时间点。
所述客户端720用于对所述第一视频特征进行选择，基于所述选择， 服务器端搜寻所述第一视频特征在所述视频中出现的时间点，其中，当视频中的起始帧后的各帧中出现所述第一视频特征时，对该第一视频特征的数量进行累加，直至在完结帧中发现所述第一视频特征已经不存在，则在所述起始帧和完结帧之间形成针对所述第一视频特征的视频段。
采用本实施例，通过服务器端进行处理完成了针对特定视频特征的视频片段的拣选，随之在客户端对这些视频片段进行搜寻。由此，通过服务器端和客户端的有效配合，使得用户可以方便查找到针对特定视频特征的期望的视频片段并进行观赏。相比于现有技术中的固定时间点搜寻方式，本发明所采用的针对特定视频特征的视频片段搜寻显然更为方便和快捷。
第八实施例：
本实施例中提供了一种视频片段快速搜寻系统，该系统包括服务器端810和客户端820。如图8所示：
所述服务器端810用于分析视频中的每一帧，当分析的帧中出现第一视频特征时，设定该帧为起始帧，记录起始帧在所述视频中出现的时间点；当起始帧后的各帧中出现所述第一视频特征时，对该第一视频特征的数量进行累加，直至在完结帧中发现所述第一视频特征已经不存在，则在所述起始帧和完结帧之间形成针对所述第一视频特征的视频段，以能够搜寻所述第一视频特征在所述视频中出现的时间点。
所述服务器端810还包括特征值提取单元811，所述特征值提取单元用于根据算法库针对处于起始帧的第一视频特征提取特征值并存储该特征值。
所述客户端820用于对所述第一视频特征进行选择，基于所述选择，服务器端搜寻所述第一视频特征在所述视频中出现的时间点，其中，当视频中的起始帧后的各帧中出现所述第一视频特征时，对该第一视频特征的数量进行累加，直至在完结帧中发现所述第一视频特征已经不存在，则在所述起始帧和完结帧之间形成针对所述第一视频特征的视频段。
采用本实施例，客户端对视频片段进行搜寻，通过服务器端和客户端的有效配合，使得用户可以方便查找到针对特定视频特征的期望的视频片段并进行观赏。而且，由于将视频特征的特征值存储到远程服务器上，因此能够对特征值进行存储，以便使其他方获取所述特征值并用所述所述特征值搜索特定的视频特征。相比于现有技术中的固定时间点搜寻方式，本发明所采用的针对特定视频特征的视频片段搜寻显然更为方便和快捷。
简而言之，在本发明实施例中，通过服务器端进行处理完成了针对特定视频特征(例如人物)的视频片段的拣选，随之在客户端对这些视频片段进行搜寻。由此，通过服务器端和客户端的有效配合，使得用户可以方便查找到针对特定视频特征的期望的视频片段并进行观赏。相比于现有技术中的固定时间点搜寻方式，本发明实施例所采用的针对特定视频特征的视频片段搜寻显然更为方便和快捷。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程，是可以通过计算机程序来指令相关的硬件来完成，所述程序可存储于计算机可读取存储介质中。执行时的程序，可包括如上述各方法的实施例的流程。其中，所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory,ROM)或随机存储记忆体(Random Access Memory，RAM)等。
基于这样的理解，本发明实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台移动终端(可以是个人计算机，服务器，或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所描述的装置实施例仅仅是示意性的，其中所述作为分离部件 说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本发明实施例方案的目的。本领域普通技术人员在不付出创造性的劳动的情况下，即可以理解并实施。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到各实施方式可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件实现。基于这样的理解，上述技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品可以存储在计算机可读存储介质中，如ROM/RAM、磁碟、光盘等，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行各个实施例或者实施例的某些部分所述的方法。
最后应说明的是：以上实施例仅用以说明本发明实施例的技术方案，而非对其限制；尽管参照前述实施例对本发明实施例进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。

Claims (11)

  1. 一种视频片段快速搜寻方法，其特征在于，所述方法包括：
    分析视频中的每一帧，当分析的帧中出现第一视频特征时，设定该帧为起始帧，记录起始帧在所述视频中出现的时间点；
    当起始帧后的各帧中出现所述第一视频特征时，对该第一视频特征的数量进行累加，直至在完结帧中发现所述第一视频特征已经不存在，则在所述起始帧和完结帧之间形成针对所述第一视频特征的视频段，以能够搜寻所述第一视频特征在所述视频中出现的时间点。
  2. 根据权利要求1所述的方法，其特征在于，当在起始帧后的第二帧中出现指定的第二视频特征时，从第二帧开始对所述第二视频特征的数量进行累加，直至发现在特定帧中该第二视频特征已不存在，则在所述第二帧和所述特定帧之间形成针对所述第二视频特征的视频段。
  3. 根据权利要求1所述的方法，其特征在于，根据算法库，针对处于起始帧的第一视频特征提取特征值，并存储该特征值。
  4. 一种视频片段快速搜寻方法，其特征在于，所述方法包括：
    对所述第一视频特征进行选择；
    基于所述选择，搜寻所述第一视频特征在所述视频中出现的时间点，其中，当视频中的起始帧后的各帧中出现所述第一视频特征时，对该第一视频特征的数量进行累加，直至在完结帧中发现所述第一视频特征已经不存在，则在所述起始帧和完结帧之间形成针对所述第一视频特征的视频段。
  5. 一种视频片段快速搜寻装置，其特征在于，所述装置包括：
    视频特征分析单元，用于逐一分析视频中的每一帧，当分析的帧中出现指定的第一视频特征时，设定该帧为起始帧，记录起始帧在所述视频中出现的时间点；
    视频段生成单元，用于当起始帧后的各帧中出现所述第一视频特征时对该第一视频特征的数量进行累加，直至在完结帧中发现所述第一视 频特征已经不存在，则在所述起始帧和完结帧之间形成针对所述第一视频特征的视频段，以能够搜寻所述第一视频特征在所述视频中出现的时间点。
  6. 根据权利要求5所述的装置，其特征在于，所述装置还包括特征值提取单元，所述特征值提取单元用于根据算法库针对处于起始帧的第一视频特征提取特征值并存储该特征值。
  7. 一种视频片段快速搜寻装置，其特征在于，所述装置包括：
    特征选择单元，所述特征选择单元用于对所述第一视频特征进行选择；
    搜寻单元，所述搜寻单元用于基于所述选择搜寻所述第一视频特征在所述视频中出现的时间点，其中，当视频中的起始帧后的各帧中出现所述第一视频特征时，对该第一视频特征的数量进行累加，直至在完结帧中发现所述第一视频特征已经不存在，则在所述起始帧和完结帧之间形成针对所述第一视频特征的视频段。
  8. 一种视频片段快速搜寻系统，其特征在于，该系统包括：
    服务器端，所述服务器端用于分析视频中的每一帧，当分析的帧中出现第一视频特征时，设定该帧为起始帧，记录起始帧在所述视频中出现的时间点；当起始帧后的各帧中出现所述第一视频特征时，对该第一视频特征的数量进行累加，直至在完结帧中发现所述第一视频特征已经不存在，则在所述起始帧和完结帧之间形成针对所述第一视频特征的视频段，以能够搜寻所述第一视频特征在所述视频中出现的时间点；以及
    客户端，所述客户端用于对所述第一视频特征进行选择，基于所述选择，服务器端搜寻所述第一视频特征在所述视频中出现的时间点，其中，当视频中的起始帧后的各帧中出现所述第一视频特征时，对该第一视频特征的数量进行累加，直至在完结帧中发现所述第一视频特征已经不存在，则在所述起始帧和完结帧之间形成针对所述第一视频特征的视频段。
  9. 根据权利要求8所述的系统，其特征在于，在所述服务器端中， 当在紧随起始帧的第二帧中出现指定的第二视频特征时，从第二帧开始对所述第二视频特征的数量进行累加，直至发现在特定帧中该第二视频特征已不存在，则在所述第二帧和所述特定帧之间形成针对所述第二视频特征的视频段。
  10. 根据权利要求8所述的系统，其特征在于，所述服务器端根据算法库针对处于起始帧的第一视频特征提取特征值，并存储该特征值。
  11. 一种计算机可读介质，其特征在于，所述计算机可读介质上存储有相应的计算机程序，所述计算机程序用于运行权利要求1-4中任一项所述的视频片段快速搜寻方法。
PCT/CN2016/088569 2015-11-18 2016-07-05 视频片段快速搜寻方法、装置、系统和计算机可读介质 Ceased WO2017084353A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/241,449 US20170139933A1 (en) 2015-11-18 2016-08-19 Electronic Device, And Computer-Readable Storage Medium For Quickly Searching Video Segments

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510799082.5 2015-11-18
CN201510799082.5A CN105898368A (zh) 2015-11-18 2015-11-18 视频片段快速搜寻方法和系统

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/241,449 Continuation US20170139933A1 (en) 2015-11-18 2016-08-19 Electronic Device, And Computer-Readable Storage Medium For Quickly Searching Video Segments

Publications (1)

Publication Number Publication Date
WO2017084353A1 true WO2017084353A1 (zh) 2017-05-26

Family

ID=57002351

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/088569 Ceased WO2017084353A1 (zh) 2015-11-18 2016-07-05 视频片段快速搜寻方法、装置、系统和计算机可读介质

Country Status (2)

Country Link
CN (1) CN105898368A (zh)
WO (1) WO2017084353A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110545475A (zh) * 2019-08-26 2019-12-06 北京奇艺世纪科技有限公司 一种视频播放方法、装置及电子设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120210232A1 (en) * 2011-02-16 2012-08-16 Wang Xiaohuan C Rate Conform Operation for a Media-Editing Application
CN103312943A (zh) * 2012-03-07 2013-09-18 三星电子株式会社 用于指导视频特征信息的视频编辑装置和方法
CN104731944A (zh) * 2015-03-31 2015-06-24 努比亚技术有限公司 视频搜索方法及装置
CN104796781A (zh) * 2015-03-31 2015-07-22 小米科技有限责任公司 视频片段提取方法及装置
CN105007531A (zh) * 2014-04-23 2015-10-28 Lg电子株式会社 图像显示装置及其控制方法

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103823870B (zh) * 2014-02-26 2020-05-26 联想(北京)有限公司 一种信息处理方法及电子设备
CN104298748A (zh) * 2014-10-13 2015-01-21 中南民族大学 一种用于视频中人脸检索的装置及方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120210232A1 (en) * 2011-02-16 2012-08-16 Wang Xiaohuan C Rate Conform Operation for a Media-Editing Application
CN103312943A (zh) * 2012-03-07 2013-09-18 三星电子株式会社 用于指导视频特征信息的视频编辑装置和方法
CN105007531A (zh) * 2014-04-23 2015-10-28 Lg电子株式会社 图像显示装置及其控制方法
CN104731944A (zh) * 2015-03-31 2015-06-24 努比亚技术有限公司 视频搜索方法及装置
CN104796781A (zh) * 2015-03-31 2015-07-22 小米科技有限责任公司 视频片段提取方法及装置

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110545475A (zh) * 2019-08-26 2019-12-06 北京奇艺世纪科技有限公司 一种视频播放方法、装置及电子设备

Also Published As

Publication number Publication date
CN105898368A (zh) 2016-08-24

Similar Documents

Publication Publication Date Title
CN106331778B (zh) 视频推荐方法和装置
US8879788B2 (en) Video processing apparatus, method and system
US20170065889A1 (en) Identifying And Extracting Video Game Highlights Based On Audio Analysis
CN111447505B (zh) 视频剪辑方法、网络设备及计算机可读存储介质
CN109905782A (zh) 一种控制方法及装置
KR20070118635A (ko) 오디오 및/또는 비주얼 데이터의 서머라이제이션
CN113709527B (zh) 多主播场景中关注主播的方法及装置
WO2019144848A1 (zh) 一种用于信息推荐的方法与装置
CN108197336B (zh) 一种视频查找的方法及装置
US20150156227A1 (en) Synchronize Tape Delay and Social Networking Experience
CN103984778B (zh) 一种视频检索方法及系统
CN113542833A (zh) 基于人脸识别的视频播放方法、装置、设备及存储介质
CN106874827A (zh) 视频识别方法和装置
CN114925233B (zh) 一种视频推荐方法、装置、电子设备及存储介质
CN115080792B (zh) 一种视频关联方法、装置、电子设备及存储介质
US11537639B2 (en) Re-identification of physical objects in an image background via creation and storage of temporary data objects that link an object to a background
CN114117120B (zh) 基于内容分析的视频文件智能索引生成系统及方法
US20170040040A1 (en) Video information processing system
US20170139933A1 (en) Electronic Device, And Computer-Readable Storage Medium For Quickly Searching Video Segments
WO2017084353A1 (zh) 视频片段快速搜寻方法、装置、系统和计算机可读介质
CN117221669B (zh) 一种弹幕生成方法及装置
KR102534270B1 (ko) 메타 데이터 제공 장치 및 방법
CN115734025A (zh) 检测视频的冗余片段的方法及其系统
CN114302231A (zh) 视频处理方法及装置、电子设备和存储介质
CN110929095A (zh) 视频摘要回放方法、装置、电子设备及可读存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16865533

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16865533

Country of ref document: EP

Kind code of ref document: A1