KR101663416B1 - Method and System for ALIGNED THUMBNAIL BASED VIDEO BROWSING SYSTEM WITH OTT DONGLE - Google Patents

Method and System for ALIGNED THUMBNAIL BASED VIDEO BROWSING SYSTEM WITH OTT DONGLE Download PDF

Info

Publication number
KR101663416B1
KR101663416B1 KR1020150042443A KR20150042443A KR101663416B1 KR 101663416 B1 KR101663416 B1 KR 101663416B1 KR 1020150042443 A KR1020150042443 A KR 1020150042443A KR 20150042443 A KR20150042443 A KR 20150042443A KR 101663416 B1 KR101663416 B1 KR 101663416B1
Authority
KR
South Korea
Prior art keywords
video
thumbnails
thumbnail
sorted
ott
Prior art date
Application number
KR1020150042443A
Other languages
Korean (ko)
Other versions
KR20160115218A (en
Inventor
조근식
윤의녕
Original Assignee
인하대학교 산학협력단
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 인하대학교 산학협력단 filed Critical 인하대학교 산학협력단
Priority to KR1020150042443A priority Critical patent/KR101663416B1/en
Publication of KR20160115218A publication Critical patent/KR20160115218A/en
Application granted granted Critical
Publication of KR101663416B1 publication Critical patent/KR101663416B1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/43615—Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H04N21/43632—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wired protocol, e.g. IEEE 1394
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H04N21/43637—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8549—Creating video summaries, e.g. movie trailer

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

An ordered thumbnail-based video browsing method and system using an OTT dongle is presented. The sorted thumbnail-based video browsing method using the OTT dongle proposed in the present invention generates an aligned thumbnail corresponding to the frames through a preprocessing process of dividing the video into frames, and stores the generated sorted thumbnails Connecting an OTT dongle to a mobile terminal to browse scenes of video in an application of the mobile terminal using the sorted thumbnails, playing on the TV using the aligned thumbnails in the mobile terminal environment via the OTT dongle, And browsing specific scenes of the video being played.

Description

TECHNICAL FIELD [0001] The present invention relates to a video browsing method and system based on sorted thumbnails using an OTT dongle,

A second screen environment using a mobile device while watching a TV is constructed by using an OTT dongle to display specific scenes of a moving picture being reproduced on a TV through a thumbnail displayed on a mobile device of a user And moving to a time of appearance of a specific scene of a video desired by a user, and a system thereof.

(STB) or OTT streaming device (Over-The-Top) for building such a second-screen environment, along with a growing number of people using mobile devices such as smart pads or smartphones while watching TV streaming device, and the service market for it is getting bigger.

OTT Dongle is a small streaming device that connects to a device with a large screen such as a TV and plays the video. Second screen devices such as smartphones are required to manipulate the video being played using the OTT dongle. Users who use a second screen device can interact with the video being played on a TV (First Screen Device), or use various services such as SNS and web browsing while watching TV.

Traditional OTT dongle applications such as YouTube, Viki, and Netflix provide a time slider for video control, allowing users to move to specific times of video. However, it is not easy for the user to grasp the content of the video using the time slider, so that the user can not easily move to a time when a specific person or a specific scene appears, and the user must spend time searching for a specific scene desired by the user.

Accordingly, in this specification, the content-based video browsing method is used in order to easily move to a time when a user wants a specific scene of video in a secondary screen environment. We also propose Aligned Thumbnails to simplify the number of thumbnails for video browsing and make it faster and easier for users to find desired scenes. Finally, we propose a hierarchical sliding interface to visualize the proposed sorted thumbnails.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a method and system for confirming the contents of a video being reproduced in a secondary screen environment and moving to a time when a specific scene appears easily and quickly.

In one aspect, an aligned thumbnail-based video browsing method using an OTT dongle proposed in the present invention generates an aligned thumbnail corresponding to the frames through a preprocessing process of dividing a video into frames, A step of connecting an OTT dongle and a mobile terminal through an application to establish a second screen environment, a step of transmitting the OTT dongle to the mobile terminal environment through the use of the sorted thumbnails, And browsing the scenes.

Generating an aligned thumbnail through a preprocessing process of dividing the video into frames and storing the generated aligned thumbnail comprises the steps of loading video stored in a media server through an aligned thumbnail generator, Generating an aligned thumbnail, and storing the sorted thumbnail in a thumbnail store.

The step of dividing the video into frames and generating an aligned thumbnail may include extracting frames from the video, dividing the frames of the video into a plurality of shots using a color histogram-based shot boundary detection technique, Setting a first frame of the frames constituting each shot as a key frame of the shot when a plurality of shots are detected, the aligned thumbnail generator clustering similar shots using a sequence alignment algorithm, The sorted thumbnail generator may include selecting the first key frames of the shot sequences aligned with similar shots, and then creating thumbnails to generate sorted thumbnails.

Browsing specific scenes of a video being played back on a TV using the aligned thumbnails in the mobile terminal environment via the OTT dongle may comprise: when the OTT dongle and the mobile terminal are connected, the OTT dongle executes the application, Selecting from a list of videos stored in a video storage of a media server a video desired to be played back, down-sizing the sorted thumbnails stored in the thumbnail storage through the synchronization manager of the media server, Selecting a thumbnail of a specific scene to be played back from a specific time of the video corresponding to the thumbnail.

The method of playing back the video corresponding to the thumbnail from a specific time can slide the sorted thumbnails to the left and right through the sliding interface to identify a specific scene of the video and move to a desired specific time.

The sorted thumbnail may represent a thumbnail of a representative key frame of key frames of a shot sequence that is a group of a plurality of similar shots.

In one aspect, an aligned thumbnail-based video browsing system using OTT dongles proposed in the present invention includes an aligned thumbnail generator for generating aligned thumbnails corresponding to the frames through a preprocessing process of dividing the video into frames, A video store for storing video for generating sorted thumbnails corresponding to the frames, a thumbnail store for storing the generated sorted thumbnails, an OTT dongle for connecting a mobile terminal with an application through a second screen environment, And a synchronization manager for browsing specific scenes of video being played on the TV using the sorted thumbnails in the mobile terminal environment via the OTT dongle.

The sorted thumbnail generator may retrieve video stored in the video store, divide the video into frames, and generate an aligned thumbnail.

The aligned thumbnail generator extracts frames from the video, divides the video frames into a plurality of shots using a color histogram-based shot boundary detection technique, and when the plurality of shots are detected, The first frame of frames is set as the key frame of the shot, the aligned thumbnail generator classifies similar shots using a sequence alignment algorithm and then arranges them into a shot sequence, and the aligned thumbnail generator arranges similar shots After selecting the first key frames of the shot sequences, a thumbnail may be generated to generate an aligned thumbnail.

When the OTT dongle and the mobile terminal are connected, the synchronization manager executes the application, selects video from the list of videos stored in the video repository of the media server, The sorted thumbnails stored in the thumbnail storage can be downloaded to the application through the synchronization manager and a thumbnail of a specific scene desired to be reproduced among the sorted thumbnails can be reproduced from a specific time of the video corresponding to the thumbnail.

According to embodiments of the present invention, a user can browse specific scenes of a video being played back on a TV through a thumbnail displayed on an individual mobile device, and move to a specific scene of a desired scene of the user. It also improves user accessibility and convenience by providing an intuitive interface to second-screen device applications.

1 is a flowchart illustrating a method of browsing an ordered thumbnail-based video using an OTT dongle according to an embodiment of the present invention.
2 is a diagram illustrating a configuration of an ordered thumbnail-based video browsing system using an OTT dongle according to an embodiment of the present invention.
FIG. 3 illustrates a process of generating and storing sorted thumbnails according to an embodiment of the present invention. Referring to FIG.
4 is a diagram for explaining a second screen environment using an OTT dongle according to an embodiment of the present invention.
5 is a diagram for explaining an application to be executed on an OTT dongle according to an embodiment of the present invention.
6 is a diagram for explaining a process of generating an aligned thumbnail according to an embodiment of the present invention.
7 is a diagram illustrating an application interface for operation in a mobile device according to an exemplary embodiment of the present invention.
FIG. 8 is a diagram illustrating a process of browsing and browsing specific scenes of video through sorted thumbnails in a mobile terminal environment according to an exemplary embodiment of the present invention. Referring to FIG.
9 is a diagram illustrating an embodiment of an aligned thumbnail-based video browsing system operation in accordance with an embodiment of the present invention.
10 is a diagram illustrating a hierarchical sliding interface for an aligned thumbnail according to an embodiment of the present invention.

The present invention relates to a video browsing method and system using thumbnails arranged in a secondary screen environment and browsing specific scenes of a moving picture being played back on a TV through a thumbnail displayed on a user's personal mobile device, And to provide a method of moving quickly and easily to the time of appearance of a specific scene of a video desired by a user. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a flowchart illustrating a method of browsing an ordered thumbnail-based video using an OTT dongle according to an embodiment of the present invention.

An ordered thumbnail-based video browsing method using an OTT dongle generates an aligned thumbnail corresponding to the frames through a preprocessing process of dividing the video into frames, storing the generated sorted thumbnails (110) Connecting (120) an OTT dongle to a mobile terminal to browse scenes of the video in an application of the mobile terminal using the aligned thumbnail, using the sorted thumbnail in the mobile terminal environment via the OTT dongle And browsing 130 specific scenes of the video being played.

In step 110, an aligned thumbnail corresponding to the frames is generated through a preprocessing process of dividing the video into frames, and the generated aligned thumbnail can be stored.

FIG. 3 illustrates a process of generating and storing sorted thumbnails according to an embodiment of the present invention. Referring to FIG. Step 110 includes the steps of loading (310) video stored in the media server through an aligned thumbnail generator, dividing the video into frames and generating aligned thumbnails (320-360) And storing the sorted thumbnails in a thumbnail store (370).

The steps of dividing the video into frames and generating aligned thumbnails 320-360 may include extracting 320 the frames from the video, using the color histogram-based shot boundary detection technique to generate frames of the video (340) a step 330 of setting the first frame of the frames constituting the respective shots as a key frame of the shot when the plurality of shots are detected, and the aligned thumbnail generator (350) sorting similar shots using an algorithm, and then sorting the similar shots into a shot sequence. The sorted thumbnail generator generates thumbnails by selecting first key frames of the shot sequences arranged in similar shots and creating thumbnails (Step 360).

Next, in step 120, the OTT dongle and the mobile terminal may be connected to browse scenes of video in an application of the mobile terminal using the aligned thumbnails.

4 is a diagram for explaining a second screen environment using an OTT dongle according to an embodiment of the present invention.

When the OTT dongle 420 is connected to the TV 410 having the HDMI port and the OTT dongle is connected to the OTT dongle using the smart phone 430, the user can play the video to be viewed on the TV. In order to reproduce video using the OTT dongle, a mobile device application running on the mobile device and an OTT dongle application 510 on the web server 500 of FIG. 5 running on the OTT dongle need.

5 is a diagram for explaining an application to be executed on an OTT dongle according to an embodiment of the present invention.

In order to play video using the OTT dongle, a mobile device application running on the mobile device and an OTT dongle application 510 on the web server 500 running on the OTT dongle are required. In the present invention, an OTT dongle application 510 for synchronizing a video being reproduced with a mobile device or a video to be reproduced in an OTT dongle to be displayed in a mobile device application, and a video player (520).

6 is a diagram for explaining a process of generating an aligned thumbnail according to an embodiment of the present invention.

First, the aligned thumbnail generator extracts frames from the stored video. Then, the frames of the video are divided into shots using a color histogram based shot boundary detection technique. When the shots are detected, the first frame of each shot is used as a key-frame of the shot. For example, in the case of the frames a1 and a75 in Fig. 6, the shots A1 and A2 are used as representative key frames, respectively.

When the key frame of the shot is selected, the aligned thumbnail generator clusters similar shots using a shot sequence sorting algorithm, and arranges them into a shot sequence.

Finally, the aligned thumbnail generator selects the first key frames of the shot sequences aligned with similar shots and uses them as thumbnails to create sorted thumbnails. For example, the A1 keyframe of shot sequence 1 and the B1 keyframe of shot sequence 2 are used as aligned thumbnails.

7 is a diagram illustrating an application interface for operation in a mobile device according to an exemplary embodiment of the present invention.

The user runs the application and connects to the OTT dongle using the OTT dongle connection button 710. [ The video to be played back on the TV to which the OTT dongle is connected is then selected from the list of videos 720 stored in the video repository 710 of the media server. When the OTT dongle is connected to the application, the pre-connection button 710 is changed to the post-connection button 720. The user can operate the video being played on the TV using the OTT dongle through control buttons 740 such as playing, pausing, stopping, moving to the beginning of the video, sound volume, and the like. The user can slide the sorted thumbnails displayed on the sliding interface 750 to the left and right to confirm the content of the video and move to the desired time by moving to the sliding.

Finally, in step 130, the OTT dongle may browse specific scenes of video being played on the TV using the aligned thumbnails in the mobile terminal environment.

FIG. 8 is a diagram illustrating a process of browsing and browsing specific scenes of video through sorted thumbnails in a mobile terminal environment according to an exemplary embodiment of the present invention. Referring to FIG.

A method for browsing specific scenes of a video being played back on a TV through a sorted thumbnail in a mobile terminal environment, the OTT dongle executing the application and, when the OTT dongle is connected to the mobile terminal, A step 810 of selecting from a list of videos stored in the video storage of the media server, a step 820 of downloading sorted thumbnails stored in the thumbnail storage to an application through the synchronization manager of the media server, And playing the video corresponding to the thumbnail if a thumbnail desired to be reproduced is selected.

The method for playing back the video corresponding to the thumbnail can slide the aligned thumbnails to the left and right through the sliding interface to check the contents of the video and move to a desired specific time.

9 is a diagram illustrating an embodiment of an aligned thumbnail-based video browsing system operation in accordance with an embodiment of the present invention.

In other words, it illustrates a scenario regarding a method of browsing video using sorted thumbnails in a second screen environment using an OTT dongle.

1) Run the application.

2) Connect the application and the OTT dongle using the connect button 710.

3) Upon completion of the connection, the OTT dongle automatically loads the OTT dongle receiver application on the web server 510 and executes it on the OTT dongle.

4) Select the video to be played back from the list of videos 720 stored in the video store 311 of the media server.

5) When the OTT dongle and the application are connected, the sorted thumbnails stored in the thumbnail store 213 are downloaded to the application through the synchronization manager 214 of the media server.

6) When the user clicks the play button among the control buttons 540 of the application to play the video, the video on the media server is displayed using the video player 520 of the web server.

7) The user can view the contents of the video by watching the sorted thumbnails shown in the application's interface and play the video at the desired specific time.

10 is a diagram illustrating a hierarchical sliding interface for an aligned thumbnail according to an embodiment of the present invention.

The application of the inventive "aligned thumbnail-based video browsing system" has a hierarchical sliding interface as shown in FIG. Only shows the sorted thumbnail to the sliding interface, because only similar shots meeting the shot sequence representative key frame of the of the thumbnail, for detailed thumbnail yes obscured by a user for convenience B 2, B 3, D 2, etc. shot of I can not access the thumbnail. In order to compensate for this, an ordered thumbnail step 1010 and a shot step 1020 are divided. When the user clicks a specific thumbnail, a thumbnail of the shots in the same shot sequence is displayed through a sliding interface.

The user can find the desired thumbnail to the left or right through the sliding motion. However, if the time to change when the thumbnail is selected, for example, A 1 00:31:27 and the time of the currently playing video is different, for example D 3 00:33:41, it is difficult to find the content of the video desired by the user . This requires synchronization between the video being played and the thumbnail.

2 is a diagram illustrating a configuration of an ordered thumbnail-based video browsing system using an OTT dongle according to an embodiment of the present invention.

The video browsing system 200 according to the present embodiment may include a media server 210, a bus 220, a network interface 230, a memory 240, and a database 250. Memory 240 may include an operating system 241 and a video browsing routine 242. The media server 210 may include a video store 211, an aligned thumbnail generator 212, a thumbnail store 213, and a synchronization manager 214. In other embodiments, the secure channel utilization system 200 in molecular communications may include more components than the components of FIG. However, there is no need to clearly illustrate most prior art components. For example, the secure channel utilization system 200 in molecular communications may include other components such as a display or a transceiver.

The memory 240 may be a computer-readable recording medium and may include a permanent mass storage device such as a random access memory (RAM), a read only memory (ROM), and a disk drive. In addition, the memory 240 may store program code for the operating system 241 and the video browsing routine 242. These software components may be loaded from a computer readable recording medium separate from the memory 240 using a drive mechanism (not shown). Such a computer-readable recording medium may include a computer-readable recording medium (not shown) such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, or a memory card. In other embodiments, the software components may be loaded into the memory 240 via the network interface 230 rather than from a computer readable recording medium.

The bus 220 may enable communication and data transmission between components of the secure channel utilization system 200 in molecular communications. The bus 220 may be configured using a high-speed serial bus, a parallel bus, a Storage Area Network (SAN), and / or other suitable communication technology.

The network interface 230 may be a computer hardware component for connecting the secure channel utilization system 200 in molecular communications to a computer network. The network interface 230 may allow the secure channel utilization system 200 in molecular communications to connect to the computer network via a wireless or wired connection.

The database 250 may store and maintain all information required for video browsing. Although FIG. 2 shows that the database 250 is built and included in the secure channel using system 200 in the molecular communication, the present invention is not limited thereto and may be omitted depending on the system implementation method or environment, It is also possible that some databases exist as external databases built on separate, separate systems.

The media server 210 may be configured to process instructions of a computer program by performing input / output operations of the secure channel utilization system 200 in basic arithmetic, logic, and molecular communications. The commands may be provided by the memory 240 or the network interface 230 and via the bus 220 to the media server 210. The processor 210 may be configured to execute program code for the video store 211, the aligned thumbnail generator 212, the thumbnail store 213, and the synchronization manager 214. Such program code may be stored in a recording device such as memory 240. [

The video store 211, the aligned thumbnail generator 212, the thumbnail store 213, and the synchronization manager 214 may be configured to perform the steps 110 to 130 of FIG.

The secure channel utilization system 200 in molecular communications may include a histogram video store 211, an aligned thumbnail generator 212, a thumbnail store 213, and a synchronization manager 214.

The histogram video store 211 may store video for generating aligned thumbnails corresponding to the frames.

The aligned thumbnail generator 212 may generate an aligned thumbnail corresponding to the frames through a preprocessing process of dividing the video into frames. The aligned thumbnail generator 212 may retrieve the video stored in the video store, divide the video into frames, and generate an aligned thumbnail.

More specifically, frames are extracted from a video, and the frames of the video are divided into a plurality of shots using a color histogram-based shot boundary detection technique. When the plurality of shots are detected, the first frame of each of the shots is set as a key frame of the shot. The sorted thumbnail generator classifies similar shots using a sequence alignment algorithm and then arranges them into a shot sequence. The sorted thumbnail generator selects first key frames of the shot sequences arranged in similar shots, You can create a sorted thumbnail.

The thumbnail store 213 may store the generated sorted thumbnails.

The synchronization manager 214 connects the OTT dongle and the mobile terminal to browse scenes of the video in the application of the mobile terminal using the sorted thumbnails and uses the sorted thumbnails in the mobile terminal environment via the OTT dongle It is possible to browse specific scenes of the video being reproduced on the TV.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the apparatus and components described in the embodiments may be implemented within a computer system, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA) A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing unit may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer storage media, or device , Or may be permanently or temporarily embodied in a transmitted signal wave. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims (10)

A method of browsing video based on sorted thumbnails using an OTT dongle,
Constructing a second screen environment using an OTT dongle to browse a specific scene of video being played on a TV at a mobile terminal;
Creating an ordered thumbnail from the video and bringing it into the mobile terminal environment to browse scenes of the video
Lt; / RTI >
Wherein the step of generating an ordered thumbnail from the video and bringing it into the mobile terminal environment to browse scenes of the video comprises:
Generating and storing sorted thumbnails from the video; And
Browsing specific scenes of video being played on the TV using the aligned thumbnails in the mobile terminal environment via the OTT dongle
Lt; / RTI >
Wherein the sorted thumbnails represent thumbnails of representative key frames among key frames of a shot sequence that is a group of a plurality of similar shots. delete The method according to claim 1,
Wherein generating and storing sorted thumbnails from the video comprises:
Loading video stored in the media server through an ordered thumbnail generator;
Dividing the video into frames and generating an aligned thumbnail; And
Storing the sorted thumbnails in a thumbnail store
A method of video browsing based on sorted thumbnails using an OTT dongle. The method of claim 3,
Dividing the video into frames and generating an aligned thumbnail comprises:
Extracting frames from the video;
Dividing the video frames into a plurality of shots using a color histogram-based shot boundary detection technique;
Setting a first frame of each of the shots as a key frame of the shot when the plurality of shots are detected;
Wherein the sorted thumbnail generator comprises: clustering similar shots using a sequence alignment algorithm and arranging them into a shot sequence; And
Wherein the sorted thumbnail generator generates thumbnails by selecting first key frames of the shot sequences arranged in similar shots,
A method of video browsing based on sorted thumbnails using an OTT dongle. The method according to claim 1,
Browsing specific scenes of video being played on a TV using the sorted thumbnails in the mobile terminal environment via the OTT dongle,
When the OTT dongle and the mobile terminal are connected, the OTT dongle executes an application and selects video to be played back from a list of videos stored in a video repository of the media server;
Downloading sorted thumbnails stored in a thumbnail store to an application through a synchronization manager of the media server; And
Selecting a thumbnail to be played back among the sorted thumbnails, and playing the video corresponding to the thumbnail
A method of video browsing based on sorted thumbnails using an OTT dongle. 6. The method of claim 5,
The method of playing a video corresponding to the thumbnail comprises sliding the aligned thumbnails to the left and right through a sliding interface, confirming the contents of the video, and moving the selected thumbnails to a desired specific time. A thumbnail-based video browsing method. delete An ordered thumbnail-based video browsing system using an OTT dongle,
An aligned thumbnail generator for generating an aligned thumbnail corresponding to the frames through a preprocessing step of dividing the video into frames;
A video store for storing video for generating aligned thumbnails corresponding to the frames;
A thumbnail store for storing the generated sorted thumbnails; And
Connecting the OTT dongle and the mobile terminal to browse the video scenes in the application of the mobile terminal using the sorted thumbnails and identifying the video being played on the TV using the sorted thumbnails in the mobile terminal environment through the OTT dongle A synchronization manager for browsing scenes
Lt; / RTI >
Wherein the sorted thumbnails represent thumbnails of representative key frames among key frames of a shot sequence that is a group of a plurality of similar shots. 9. The method of claim 8,
Wherein the sorted thumbnail generator comprises:
Extracting frames from the video, dividing frames of the video into a plurality of shots using a color histogram-based shot boundary detection technique, and if the plurality of shots are detected, detecting a first frame of the frames constituting each shot And the sorted thumbnail generator arranges similar shot shots using a sequence alignment algorithm and then arranges them into a shot sequence, and the aligned thumbnail generator sets the first shot of the shot sequences arranged with similar shots And selecting thumbnails to generate thumbnails to generate sorted thumbnails. 9. The method of claim 8,
Wherein the synchronization manager comprises:
When the OTT dongle and the mobile terminal are connected, the OTT dongle executes the application, selects a video to be played back from a list of videos stored in the video repository of the media server, The method according to claim 1, further comprising the steps of: receiving thumbnails stored in a thumbnail store and downloading thumbnails corresponding to the thumbnails when the selected thumbnails are selected from among the sorted thumbnails; Video browsing system.
KR1020150042443A 2015-03-26 2015-03-26 Method and System for ALIGNED THUMBNAIL BASED VIDEO BROWSING SYSTEM WITH OTT DONGLE KR101663416B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150042443A KR101663416B1 (en) 2015-03-26 2015-03-26 Method and System for ALIGNED THUMBNAIL BASED VIDEO BROWSING SYSTEM WITH OTT DONGLE

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150042443A KR101663416B1 (en) 2015-03-26 2015-03-26 Method and System for ALIGNED THUMBNAIL BASED VIDEO BROWSING SYSTEM WITH OTT DONGLE

Publications (2)

Publication Number Publication Date
KR20160115218A KR20160115218A (en) 2016-10-06
KR101663416B1 true KR101663416B1 (en) 2016-10-07

Family

ID=57145501

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150042443A KR101663416B1 (en) 2015-03-26 2015-03-26 Method and System for ALIGNED THUMBNAIL BASED VIDEO BROWSING SYSTEM WITH OTT DONGLE

Country Status (1)

Country Link
KR (1) KR101663416B1 (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100652760B1 (en) * 2005-09-23 2006-12-01 엘지전자 주식회사 Method for searching video file in mobile terminal

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100713501B1 (en) * 2004-10-05 2007-05-02 삼성전자주식회사 Method of moving picture indexing in mobile phone
KR101231104B1 (en) * 2011-05-17 2013-02-07 엔그램테크놀로지(주) Remote control unit system for smart tv and control method therefor
KR101629274B1 (en) * 2012-07-10 2016-06-13 주식회사 케이티 Apparatus and method for transmitting contents

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100652760B1 (en) * 2005-09-23 2006-12-01 엘지전자 주식회사 Method for searching video file in mobile terminal

Also Published As

Publication number Publication date
KR20160115218A (en) 2016-10-06

Similar Documents

Publication Publication Date Title
US10560739B2 (en) Method, system, apparatus, and non-transitory computer readable recording medium for extracting and providing highlight image of video content
CN112565825B (en) Video data processing method, device, equipment and medium
US9979788B2 (en) Content synchronization apparatus and method
CN101443849B (en) Video browsing user interface
US20140075316A1 (en) Method and apparatus for creating a customizable media program queue
EP2985706A1 (en) Method and apparatus for providing image contents
CN111095939B (en) Identifying previously streamed portions of media items to avoid repeated playback
CN104040479A (en) Alternate view video playback on second screen
US9426411B2 (en) Method and apparatus for generating summarized information, and server for the same
US11277668B2 (en) Methods, systems, and media for providing media guidance
US20190364211A1 (en) System and method for editing video contents automatically technical field
CN103455539A (en) Information processing device, information processing method and program
US20140075310A1 (en) Method and Apparatus For creating user-defined media program excerpts
TW201914310A (en) Method, system and non-transitory computer readable medium for multimedia focusing
CN105981103A (en) Browsing videos via a segment list
WO2018175490A1 (en) Providing a heat map overlay representative of user preferences relating to rendered content
US11838576B2 (en) Video distribution system, method, computing device and user equipment
US20120314043A1 (en) Managing multimedia contents using general objects
KR101663416B1 (en) Method and System for ALIGNED THUMBNAIL BASED VIDEO BROWSING SYSTEM WITH OTT DONGLE
US20140189769A1 (en) Information management device, server, and control method
JP2014082734A (en) Clip configuration system and method of video scene, and recording media
US11902603B2 (en) Methods and systems for utilizing live embedded tracking data within a live sports video stream
US20240137588A1 (en) Methods and systems for utilizing live embedded tracking data within a live sports video stream
KR20140011126A (en) Method of storing and encoding the video captured at web site using toolbar and providing cloud service

Legal Events

Date Code Title Description
E701 Decision to grant or registration of patent right
GRNT Written decision to grant
FPAY Annual fee payment

Payment date: 20190717

Year of fee payment: 4