EP2828857A1 - Personalized multigranularity video segmenting - Google Patents

Personalized multigranularity video segmenting

Info

Publication number
EP2828857A1
EP2828857A1 EP13709073.4A EP13709073A EP2828857A1 EP 2828857 A1 EP2828857 A1 EP 2828857A1 EP 13709073 A EP13709073 A EP 13709073A EP 2828857 A1 EP2828857 A1 EP 2828857A1
Authority
EP
European Patent Office
Prior art keywords
shots
similarity value
audiovisual content
segmenting
similarity
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP13709073.4A
Other languages
German (de)
French (fr)
Inventor
Hassane Guermoud
Louis Chevallier
Lionel Oisel
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thomson Licensing SAS
Original Assignee
Thomson Licensing SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing SAS filed Critical Thomson Licensing SAS
Priority to EP13709073.4A priority Critical patent/EP2828857A1/en
Publication of EP2828857A1 publication Critical patent/EP2828857A1/en
Withdrawn legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/87—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving scene cut or scene change detection in combination with video compression
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H04N19/467—Embedding additional information in the video signal during the compression process characterised by the embedded information being invisible, e.g. watermarking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/147—Scene change detection
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102—Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/105—Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs

Definitions

  • the invention relates to the field of automatic video segmenting.
  • a first known segmenting solution consists in detecting shots in the video content, determining similarities between the detected shots and merging some detected shots so as to get a reasonable number of segments for the video content. The steps of detecting and determining
  • segmenting is somehow arbitrary because it relies only on the time intervals, but does not take account of the semantic of the video, as it is done with the first known segmenting solution.
  • This second known segmenting solution has, however, the advantage of allowing the user to choose the granularity of the segments of the content video to segment without waiting too long, contrary to the first described solution, which leads to a fixed segmenting. While the two described solutions are both valuable, their respective advantages appear to be contradictory in that they cannot be combined in a single solution. It is therefore an object of the invention to overcome the limits of the present state of the art by providing such solution, allowing the user to quickly segment a video in a semantic manner.
  • the data may be retrieved from a server or from a physical medium.
  • the method may also comprise a step of modifying the initial threshold similarity value before the
  • the method comprises a step of
  • the invention also relates to an apparatus for
  • segmenting an audiovisual content comprising a module adapted to retrieve data representative of similarity values between a plurality of shots of the audiovisual content, and a processor for clustering contiguous shots having a similarity value smaller than an initial threshold similarity value into clustered segments.
  • FIG. 1 shows a flowchart of the method according to the invention
  • FIG. 2 shows a receiver implementing the invention
  • Figure 3 gives an overview of the different types of segmentation that the invention allows to achieve Figure 4 shows how playing on a threshold similarity value allows the user to change the segmentation of the audiovisual content
  • Figure 5 is an alternative illustration on how the receiver generates chaptering of different levels
  • Fig.l illustrates an implementation of a method
  • a step of generating 10 pre-segmentation data is processed offline. Then, at the level of the receiver 24, the generated data are retrieved 11, and the audiovisual content is clustered 12.
  • the pre-segmentation data 21 may be stored on a server and retrieved 11 upon request by a receiver 24 via a network.
  • the pre-segmentation data 21 may also be written to a physical medium, such as a Blu-ray disc for example.
  • Pre-segmentation data 21 representative of similarity values between a plurality of shots of an audiovisual content 20 are first generated 10 as follows: a shot detection is first performed on the audiovisual content 20 by determining the luminance histogram differences between two successive images. When this difference is above a predefined threshold, then a transition between two shots has been detected. Once the shots have been all detected, a module extracts determined features as well as a key frame for each detected shot. This key frame possesses features which are characteristic of the detected shot. There are many ways to extract a key frame: one way is to extract the middle frame of the shot. A matrix similarity MS(i,j) related to the detected shots is then determined. The elements of this similarity matrix are coefficients representing a distance between shots. The distance between two shots is a value representative of the distance between features relative to each of the shot. These features are for example color features and edge features associated to the extracted key frame. Let us suppose fifteen shots have been detected: then MS (3, 13)
  • wc and we are weighting coefficients respectively related to colour and edge features, and color_dist and edge_dist respectively represent color distance and edge distance between shot 3 and shot 13.
  • Similarity between two shots is defined as the inverse of the distance between two shots.
  • Fig.2 illustrates a receiver 24 adapted to implement a method according to the invention.
  • This receiver has a module 25 adapted to retrieve pre-segmentation data 21, as well as a module adapted to retrieve an audiovisual content 20 in the case the audiovisual content 20 is stored outside of the receiver 24.
  • the receiver has a module 25 adapted to retrieve pre-segmentation data 21, as well as a module adapted to retrieve an audiovisual content 20 in the case the audiovisual content 20 is stored outside of the receiver 24.
  • the receiver 24 comprises a processor adapted to cluster segments of the audiovisual content 20.
  • the receiver 24 comprises also a media reader 23 adapted to read the audiovisual content 20.
  • the receiver 24 may be also adapted to retrieve 11 the pre-segmentation data 21 from a
  • a chaptering is also generated outside of the receiver 24 and is comprised in the pre- segmentation data 21.
  • a chaptering designates a set of temporal indexes associated to frames of the
  • a classic way to generate a chaptering is to first cluster 12 the contiguous detected shots which have a similarity value smaller than pre-defined similarity, and then to generate an identifier for each cluster.
  • Each cluster is
  • Fig.3 illustrates the definition given to a chapter of level i, where i is an integer.
  • the audiovisual content 20 is divided in five chapters, chap 1 to chap 5. This is called a chaptering of level 1.
  • chapters may be then still divided in sub-chapters: as exemplified in Fig.3, chap 4 is selected and is divided itself in four chapters, namely chap 4.1, chap 4.2, chap 4.3 and chap 4.4. These four chapters are chapters of level 2. Then it is still possible to divide one of those four chapters. Chap 4.3 is divided in three chapters, namely chap 4.3.1, chap 4.3.2 and chap 4.3.3, that is chapters of level 3. The granularity of the different chaptering levels is different in that a chaptering of level i is divided in chapters whose length is smaller than chapters of a chaptering of level i+1.
  • a step of detection of contiguous shots is performed at the level of the receiver 24.
  • the detected contiguous shots with a similarity above an initial threshold similarity value TSl are clustered 12. This allows to generate a
  • level 1 at the level of the receiver 24. Identifiers, key frames for example, are then generated to identify the generated clusters, and are displayed on a display to the user. Optionally, this chaptering of level 1 may be also generated outside the receiver 24 and retrieved 11 by the receiver 24.
  • the receiver 24 retrieves 11 the pre-segmentation data 21.
  • the initial threshold As illustrated in Fig.4, the initial threshold
  • TSl similarity value
  • TSl similarity value
  • the user By increasing TSl, the user gets less chapters, and by decreasing TSl, the user gets more chapters. This way, the user can modify the granularity of the chapters of the audiovisual content 20 and browse the audiovisual content 20 in a quick and personalized way.
  • an obtained chapter may be itself
  • FIG.5 A clustered segment of a chaptering of level 1 is selected, then steps of detecting and clustering 12 contiguous shots presenting a threshold similarity value TS2 smaller than TS1 are performed. A chaptering of level 3 is then obtained.
  • This threshold similarity value TS2 may advantageously be adjusted by the user. As a result, a same segment may be divided into sub-segments of different granularity. It appears for example on the
  • a chaptering of level (i+1) may be obtained from a chaptering of level i, by performing a clustering 12 of contiguous shots presenting a threshold similarity TS(i+l) smaller than a threshold similarity TS (i) .
  • the level of chaptering may then be easily ascended or descended, and allows an intuitive and quick browsing.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention pertains to method for segmenting an audiovisual content (20) in a semantic manner and in quick way. To achieve that, pre-segmentation data (21) are generated offline and retrieved (11) by an end user. At the level of the end user, a step of clustering (12) segments is performed. The invention allows also to approach a desired semantic granularity by modifying a clustering threshold. The invention also allows to quickly generate a semantic segmenting for a segment, which allows to the user to quickly browse the audiovisual content (20).

Description

PERSONALIZED MUL IGRANULARI Y VIDEO SEGMENTING
TECHNICAL FIELD
The invention relates to the field of automatic video segmenting.
BACKGROUND
In order for a user to quickly browse a video content, some solutions already exist. They typically consist in segmenting a video in sub-segments. A first known segmenting solution consists in detecting shots in the video content, determining similarities between the detected shots and merging some detected shots so as to get a reasonable number of segments for the video content. The steps of detecting and determining
similarities take usually some hours, it is therefore typically done only once and leads to a semantic but fixed segmenting. Therefore, a second known segmenting solution is proposed in US2010/0162313, consisting in segmenting a video content according to time intervals entered by the user. While this is an interesting solution to quickly get a segmented video, the
segmenting is somehow arbitrary because it relies only on the time intervals, but does not take account of the semantic of the video, as it is done with the first known segmenting solution. This second known segmenting solution has, however, the advantage of allowing the user to choose the granularity of the segments of the content video to segment without waiting too long, contrary to the first described solution, which leads to a fixed segmenting. While the two described solutions are both valuable, their respective advantages appear to be contradictory in that they cannot be combined in a single solution. It is therefore an object of the invention to overcome the limits of the present state of the art by providing such solution, allowing the user to quickly segment a video in a semantic manner.
SUMMARY OF THE INVENTION
It is proposed a method for segmenting an audiovisual content comprising retrieving (11) pre-segmentation data (21) representative of similarity values between a plurality of shots of the audiovisual content (20), clustering (12) contiguous shots having a similarity value smaller than an initial threshold (TS1)
similarity value into clustered segments, selecting one clustered segment, detecting a new plurality of shots in the clustered segment, determining similarity values between the shots of the new plurality of shots, and clustering (12) the contiguous shots belonging to the new plurality of shots and having a similarity value smaller than a second threshold (TS2) similarity value, the second threshold (TS2) similarity value being smaller than the initial threshold (TS1) similarity value . As the step of generating data representative of similarity values between a plurality of shots of the audiovisual content is time consuming, it is
advantageously performed offline. This way, those data are retrieved for use, and the clustering, which necessitates much less time and computing power, is done at the level of the end user. As a result, the user may browse sub-segments of a segment, the sub- segments having a meaningful semantic content.
The data may be retrieved from a server or from a physical medium.
The method may also comprise a step of modifying the initial threshold similarity value before the
clustering step.
This way, the user has the possibility to personalize the segmentation of the audiovisual content in that he approaches intuitively the segment granularity he wishes .
Advantageously, the method comprises a step of
modifying the second threshold similarity value.
This way, the granularity of sub-segments of a segment may be approached according to the segment granularity chosen by the user.
The invention also relates to an apparatus for
segmenting an audiovisual content comprising a module adapted to retrieve data representative of similarity values between a plurality of shots of the audiovisual content, and a processor for clustering contiguous shots having a similarity value smaller than an initial threshold similarity value into clustered segments.
BRIEF DESCRIPTION OF THE DRAWINGS
Figure 1 shows a flowchart of the method according to the invention
Figure 2 shows a receiver implementing the invention
Figure 3 gives an overview of the different types of segmentation that the invention allows to achieve Figure 4 shows how playing on a threshold similarity value allows the user to change the segmentation of the audiovisual content
Figure 5 is an alternative illustration on how the receiver generates chaptering of different levels
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
For a better understanding, the invention shall now be explained in more detail in the following description with reference to the figures. It is understood that the invention is not limited to the described
embodiments and that specified features can also expediently be combined and/or modified without
departing from the scope of the present invention as defined in the appended claims.
Fig.l illustrates an implementation of a method
according to the invention. A step of generating 10 pre-segmentation data is processed offline. Then, at the level of the receiver 24, the generated data are retrieved 11, and the audiovisual content is clustered 12.
The pre-segmentation data 21 may be stored on a server and retrieved 11 upon request by a receiver 24 via a network. The pre-segmentation data 21 may also be written to a physical medium, such as a Blu-ray disc for example.
Pre-segmentation data 21 representative of similarity values between a plurality of shots of an audiovisual content 20 are first generated 10 as follows: a shot detection is first performed on the audiovisual content 20 by determining the luminance histogram differences between two successive images. When this difference is above a predefined threshold, then a transition between two shots has been detected. Once the shots have been all detected, a module extracts determined features as well as a key frame for each detected shot. This key frame possesses features which are characteristic of the detected shot. There are many ways to extract a key frame: one way is to extract the middle frame of the shot. A matrix similarity MS(i,j) related to the detected shots is then determined. The elements of this similarity matrix are coefficients representing a distance between shots. The distance between two shots is a value representative of the distance between features relative to each of the shot. These features are for example color features and edge features associated to the extracted key frame. Let us suppose fifteen shots have been detected: then MS (3, 13)
represents the distance between the detected shot 3 and the detected shot 13. An example of distance is:
M(3,13) = Distance (3, 13) =
(1/ (wc+we) ) * (wc*color_dist + we*edge_dist )
Where wc and we are weighting coefficients respectively related to colour and edge features, and color_dist and edge_dist respectively represent color distance and edge distance between shot 3 and shot 13.
Similarity between two shots is defined as the inverse of the distance between two shots.
Fig.2 illustrates a receiver 24 adapted to implement a method according to the invention. This receiver has a module 25 adapted to retrieve pre-segmentation data 21, as well as a module adapted to retrieve an audiovisual content 20 in the case the audiovisual content 20 is stored outside of the receiver 24. The receiver
comprises a processor adapted to cluster segments of the audiovisual content 20. The receiver 24 comprises also a media reader 23 adapted to read the audiovisual content 20. The receiver 24 may be also adapted to retrieve 11 the pre-segmentation data 21 from a
physical medium. Optionally, a chaptering is also generated outside of the receiver 24 and is comprised in the pre- segmentation data 21. A chaptering designates a set of temporal indexes associated to frames of the
audiovisual content 20. A classic way to generate a chaptering is to first cluster 12 the contiguous detected shots which have a similarity value smaller than pre-defined similarity, and then to generate an identifier for each cluster. Each cluster is
characterized by at least two temporal indexes, one representing the beginning of the cluster and the other representing the end of the cluster.
Fig.3 illustrates the definition given to a chapter of level i, where i is an integer. The audiovisual content 20 is divided in five chapters, chap 1 to chap 5. This is called a chaptering of level 1. One of those
chapters may be then still divided in sub-chapters: as exemplified in Fig.3, chap 4 is selected and is divided itself in four chapters, namely chap 4.1, chap 4.2, chap 4.3 and chap 4.4. These four chapters are chapters of level 2. Then it is still possible to divide one of those four chapters. Chap 4.3 is divided in three chapters, namely chap 4.3.1, chap 4.3.2 and chap 4.3.3, that is chapters of level 3. The granularity of the different chaptering levels is different in that a chaptering of level i is divided in chapters whose length is smaller than chapters of a chaptering of level i+1. At the level of the receiver 24, an audiovisual content 20 is retrieved 11, as well as the data representative of similarity values between a plurality of shots of the audiovisual content 20. A step of detection of contiguous shots is performed at the level of the receiver 24. The detected contiguous shots with a similarity above an initial threshold similarity value TSl are clustered 12. This allows to generate a
chaptering of level 1 at the level of the receiver 24. Identifiers, key frames for example, are then generated to identify the generated clusters, and are displayed on a display to the user. Optionally, this chaptering of level 1 may be also generated outside the receiver 24 and retrieved 11 by the receiver 24.
As the step of generating the semantic pre-segmentation is time consuming and takes typically some hours, but needs to be done only once, it is advantageous to perform it offline before that the receiver 24, for example a set top box with limited computing power, retrieves 11 the pre-segmentation data 21. As illustrated in Fig.4, the initial threshold
similarity value TSl may be modified by the user. By increasing TSl, the user gets less chapters, and by decreasing TSl, the user gets more chapters. This way, the user can modify the granularity of the chapters of the audiovisual content 20 and browse the audiovisual content 20 in a quick and personalized way. Optionally, an obtained chapter may be itself
chaptered. This is illustrated by Fig.5. A clustered segment of a chaptering of level 1 is selected, then steps of detecting and clustering 12 contiguous shots presenting a threshold similarity value TS2 smaller than TS1 are performed. A chaptering of level 3 is then obtained. This threshold similarity value TS2 may advantageously be adjusted by the user. As a result, a same segment may be divided into sub-segments of different granularity. It appears for example on the
Fig.5 that the granularity of chap 5'' is smaller than the granularity of the chapter 3' , which is itself smaller than the granularity of chapter 1. This way, the user quickly browses the audiovisual content 20 in a personalized manner.
This process can of course be generalized: thus, a chaptering of level (i+1) may be obtained from a chaptering of level i, by performing a clustering 12 of contiguous shots presenting a threshold similarity TS(i+l) smaller than a threshold similarity TS (i) . The level of chaptering may then be easily ascended or descended, and allows an intuitive and quick browsing.

Claims

1. Method for segmenting an audiovisual content (20) comprising :
- retrieving (11) pre-segmentation data (21) representative of similarity values between a plurality of shots of the audiovisual content (20) ;
- clustering (12) contiguous shots having a similarity value smaller than an initial threshold (TS1) similarity value into clustered segments;
- selecting one clustered segment;
- detecting a new plurality of shots in the clustered segment;
- determining similarity values between the shots of the new plurality of shots; and
- clustering (12) the contiguous shots belonging to the new plurality of shots and having a
similarity value smaller than a second threshold (TS2) similarity value, the second threshold (TS2) similarity value being smaller than the initial threshold (TS1) similarity value.
2. Method according to claim 1, wherein the pre- segmentation data (21) are retrieved (11) from a server .
3. Method according to claim 1, wherein the pre- segmentation data (21) are retrieved (11) from a physical medium.
4. Method according to any of claims 1 to 3, comprising modifying the initial threshold (TS1) similarity value before the clustering step (12).
5. Method according to claim 4, comprising modifying the second threshold (TS2) similarity value.
6. Apparatus (24) for segmenting an audiovisual content (20) comprising:
- A module (25) adapted to retrieve (11) pre- segmentation data (21) representative of
similarity values between a plurality of shots of the audiovisual content (20); and
- A processor (22) for clustering (12) contiguous shots having a similarity value smaller than an initial threshold similarity value (TS1)
clustered segments.
EP13709073.4A 2012-03-23 2013-03-01 Personalized multigranularity video segmenting Withdrawn EP2828857A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP13709073.4A EP2828857A1 (en) 2012-03-23 2013-03-01 Personalized multigranularity video segmenting

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP12305337.3A EP2642487A1 (en) 2012-03-23 2012-03-23 Personalized multigranularity video segmenting
EP13709073.4A EP2828857A1 (en) 2012-03-23 2013-03-01 Personalized multigranularity video segmenting
PCT/EP2013/054190 WO2013139575A1 (en) 2012-03-23 2013-03-01 Personalized multigranularity video segmenting

Publications (1)

Publication Number Publication Date
EP2828857A1 true EP2828857A1 (en) 2015-01-28

Family

ID=47878012

Family Applications (2)

Application Number Title Priority Date Filing Date
EP12305337.3A Withdrawn EP2642487A1 (en) 2012-03-23 2012-03-23 Personalized multigranularity video segmenting
EP13709073.4A Withdrawn EP2828857A1 (en) 2012-03-23 2013-03-01 Personalized multigranularity video segmenting

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP12305337.3A Withdrawn EP2642487A1 (en) 2012-03-23 2012-03-23 Personalized multigranularity video segmenting

Country Status (3)

Country Link
US (1) US20150050007A1 (en)
EP (2) EP2642487A1 (en)
WO (1) WO2013139575A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110879952B (en) * 2018-09-06 2023-06-16 阿里巴巴集团控股有限公司 Video frame sequence processing method and device

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5956026A (en) * 1997-12-19 1999-09-21 Sharp Laboratories Of America, Inc. Method for hierarchical summarization and browsing of digital video
US6807306B1 (en) * 1999-05-28 2004-10-19 Xerox Corporation Time-constrained keyframe selection method
EP1129573A2 (en) * 1999-07-06 2001-09-05 Koninklijke Philips Electronics N.V. Automatic extraction method of the structure of a video sequence
US20040125877A1 (en) * 2000-07-17 2004-07-01 Shin-Fu Chang Method and system for indexing and content-based adaptive streaming of digital video content
US7224892B2 (en) * 2001-06-26 2007-05-29 Canon Kabushiki Kaisha Moving image recording apparatus and method, moving image reproducing apparatus, moving image recording and reproducing method, and programs and storage media
US20040143434A1 (en) * 2003-01-17 2004-07-22 Ajay Divakaran Audio-Assisted segmentation and browsing of news videos
DE102007013811A1 (en) * 2007-03-22 2008-09-25 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. A method for temporally segmenting a video into video sequences and selecting keyframes for finding image content including subshot detection
DE102007028175A1 (en) * 2007-06-20 2009-01-02 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Automated method for temporal segmentation of a video into scenes taking into account different types of transitions between image sequences
EP2353163A1 (en) * 2008-11-13 2011-08-10 France Telecom Method for cutting multimedia content, and corresponding device and computer program
US8914826B2 (en) 2008-12-23 2014-12-16 Verizon Patent And Licensing Inc. Method and system for creating a chapter menu for a video program
WO2011146898A2 (en) * 2010-05-21 2011-11-24 Bologh Mark J Internet system for ultra high video quality

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2013139575A1 *

Also Published As

Publication number Publication date
WO2013139575A1 (en) 2013-09-26
EP2642487A1 (en) 2013-09-25
US20150050007A1 (en) 2015-02-19

Similar Documents

Publication Publication Date Title
CN113613065B (en) Video editing method, apparatus, electronic device, and storage medium
US8195038B2 (en) Brief and high-interest video summary generation
US8363960B2 (en) Method and device for selection of key-frames for retrieving picture contents, and method and device for temporal segmentation of a sequence of successive video pictures or a shot
US8316301B2 (en) Apparatus, medium, and method segmenting video sequences based on topic
JP3951556B2 (en) How to select keyframes from selected clusters
CN102207954B (en) Electronic equipment, content recommendation method and program thereof
CN100342376C (en) System and method for analyzing video content using detected text in video frames
US8467611B2 (en) Video key-frame extraction using bi-level sparsity
US20120148149A1 (en) Video key frame extraction using sparse representation
WO2017114211A1 (en) Method and apparatus for detecting switching of video scenes
CN113255423B (en) Method and device for extracting color scheme from video
US20040181545A1 (en) Generating and rendering annotated video files
CN101568968B (en) Method for creating a new summary of an audiovisual document that already includes a summary and reports and a receiver that can implement said method
KR20080007424A (en) Content processing device and content processing method, and computer program
CN110933520A (en) A surveillance video display method and storage medium based on spiral abstract
CN103631786B (en) Clustering method and device for video files
US20120188443A1 (en) Host computer with tv module and subtitle displaying method
EP2156438A1 (en) Method and apparatus for automatically generating summaries of a multimedia file
US9854220B2 (en) Information processing apparatus, program, and information processing method
US20150050007A1 (en) Personalized multigranularity video segmenting
KR101822443B1 (en) Video Abstraction Method and Apparatus using Shot Boundary and caption
KR20050033075A (en) Unit for and method of detection a content property in a sequence of video images
WO2013098848A2 (en) Method and apparatus for automatic genre identification and classification
Zou et al. Hlv-1k: A large-scale hour-long video benchmark for time-specific long video understanding
CN107748761B (en) A Key Frame Extraction Method for Video Summary

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20140909

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20150720

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20171003