KR102214838B1 - Terminal and operating method thereof - Google Patents

Abstract

In the operating method of a terminal according to an embodiment of the present invention, based on at least one of video and audio included in the video, the feature of a video including at least one of a specific image and a specific sound in the entire playback section of the video Acquiring section information for a specific reproduction section in which the appears; And displaying the obtained section information.

Description

Terminal and its operation method {TERMINAL AND OPERATING METHOD THEREOF}

The present invention relates to a terminal and a method of operating the same, and more particularly, to a terminal that acquires section information of a video being played and displays the acquired section information.

Terminals can be divided into mobile/portable terminals and stationary terminals depending on whether they can be moved. Again, the mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry it.

As the functions are diversified, such a terminal is in the form of a multimedia player with complex functions such as, for example, taking photos or videos, playing music or video files, and receiving games and broadcasts. It is being implemented.

Accordingly, the user of the terminal is using the terminal to watch various videos such as dramas, movies, and music videos, and the user can view the video in various places according to the shape and size of the terminal.

However, since only the progress section of the video is displayed on the progressive bar displayed when the video is viewed through the terminal, information on the video being played is not provided. Therefore, there is a problem that it is difficult for the user to know specifically information about the video being played.

An embodiment of the present invention provides a terminal capable of providing section information of the acquired video by acquiring section information on a playback section including characteristics of a video being played back, and an operating method thereof.

In the operating method of a terminal according to an embodiment of the present invention, based on at least one of video and audio included in the video, the feature of a video including at least one of a specific image and a specific sound in the entire playback section of the video Acquiring section information for a specific reproduction section in which the appears; And displaying the obtained section information.

In a terminal according to another embodiment of the present invention, a display unit; And, based on one or more of the video and the audio included in the video, obtain section information on a specific playback section in which the characteristics of the video including at least one of a specific image and a specific sound appear in the entire playback section of the video, and obtain And a control unit that displays information about the selected section on the display unit.

According to the terminal and its operating method according to an embodiment of the present invention, a user may be provided with section information on a playback section including characteristics of a video.

In particular, according to an embodiment of the present invention, it is possible to provide a user with an intuitive control method for a video together with section information of the video.

1 is a block diagram of a terminal according to an embodiment of the present invention.
2 to 3 are flowcharts illustrating a method of operating a terminal according to an embodiment of the present invention.
4 is an exemplary diagram showing display of section information of a terminal according to an embodiment of the present invention.
5 to 8 show progressive bars displaying section information according to an embodiment of the present invention.
9 to 11 show a playback indicator according to an embodiment of the present invention.
12 shows an extension of a playback indicator according to an embodiment of the present invention.
13 shows a three-dimensional progressive bar according to another embodiment of the present invention.
14 shows the movement of a three-dimensional progressive bar according to an embodiment of the present invention.
15 shows the rotation of a three-dimensional progressive bar according to an embodiment of the present invention.
16 illustrates an image file extraction operation for a partial section according to an embodiment of the present invention.
17 illustrates a preview image display for a partial section according to an embodiment of the present invention.
18 illustrates display of a preview image for a partial section according to another embodiment of the present invention.
19 shows a preview image display for a partial section according to another embodiment of the present invention.
20 illustrates a display of information on a plurality of sections according to an embodiment of the present invention.
21 shows a display of information about a plurality of sections according to another embodiment of the present invention.
22 is an exemplary view showing a new feature combination according to a user input according to an embodiment of the present invention.
23 shows a playlist according to an embodiment of the present invention.
24 illustrates creation of a playlist according to an embodiment of the present invention.
25 illustrates a progressive bar representing information about a plurality of sections according to an embodiment of the present invention.
26 shows a rating display according to an embodiment of the present invention.
27 to 28 illustrate conversion of a progressive bar shape according to an embodiment of the present invention.
29 to 30 illustrate a three-dimensional progressive bar displaying section information on a moving section according to an embodiment of the present invention.
31 is an exemplary diagram for displaying a plurality of section information according to an embodiment of the present invention.

Hereinafter, a terminal related to the present invention will be described in more detail with reference to the drawings. The suffixes "module" and "unit" for components used in the following description are given or used interchangeably in consideration of only the ease of preparation of the specification, and do not have meanings or roles that are distinguished from each other.

Mobile terminals described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation system, and the like. However, it will be readily apparent to those skilled in the art that the configuration according to the embodiment described in the present specification may also be applied to a fixed terminal such as a digital TV or a desktop computer, except when applicable only to a mobile terminal.

Next, a structure of a mobile terminal according to an embodiment of the present invention will be described with reference to FIG. 1.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio/video (A/V) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, and an interface. The unit 170, the control unit 180, and the power supply unit 190 may be included. Since the components shown in FIG. 1 are not essential, a mobile terminal having more components or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the mobile terminal 100 and a wireless communication system or between the mobile terminal 100 and a network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114, and a location information module 115. .

The broadcast reception module 111 receives a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and/or broadcast-related information, or a server that receives and transmits a previously-generated broadcast signal and/or broadcast-related information to a terminal. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal in a form in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, it may exist in the form of an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or an Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 includes, for example, Digital Multimedia Broadcasting-Terrestrial (DMB-T), Digital Multimedia Broadcasting-Satellite (DMB-S), Media Forward Link Only (MediaFLO), and Digital Video Broadcasting (DVB-H). -Handheld), ISDB-T (Integrated Services Digital Broadcast-Terrestrial), and other digital broadcasting systems can be used to receive digital broadcasting signals. Of course, the broadcast reception module 111 may be configured to be suitable for not only the digital broadcasting system described above, but also other broadcasting systems.

The broadcast signal and/or broadcast related information received through the broadcast reception module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include a voice call signal, a video call signal, or various types of data according to transmission/reception of text/multimedia messages.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built-in or external to the mobile terminal 100. As a wireless Internet technology, WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), and the like may be used.

The short-range communication module 114 refers to a module for short-range communication. As short range communication technology, Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The location information module 115 is a module for obtaining a location of a mobile terminal, and a representative example thereof is a Global Position System (GPS) module.

Referring to FIG. 1, an audio/video (A/V) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes an image frame such as a still image or a video obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, or the like and processes it as electrical voice data. In the case of a call mode, the processed voice data may be converted into a format that can be transmitted to a mobile communication base station through the mobile communication module 112 and then output. Various noise removal algorithms may be implemented in the microphone 122 to remove noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the mobile terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (positive pressure/power failure), a jog wheel, a jog switch, and the like.

The sensing unit 140 detects the current state of the mobile terminal 100, such as an open/closed state of the mobile terminal 100, the position of the mobile terminal 100, the presence of user contact, the orientation of the mobile terminal, and acceleration/deceleration of the mobile terminal. Thus, a sensing signal for controlling the operation of the mobile terminal 100 is generated. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. In addition, it is also possible to sense whether the power supply unit 190 supplies power or whether the interface unit 170 is coupled to an external device.

Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for generating output related to visual, auditory, or tactile sense, and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154. I can.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, a user interface (UI) or a graphical user interface (GUI) related to a call is displayed. When the mobile terminal 100 is in a video call mode or a photographing mode, a photographed or/and received image, UI, or GUI is displayed.

The display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display. display) and a 3D display.

Some of these displays may be configured as a transparent type or a light-transmitting type so that the outside can be seen through them. This may be referred to as a transparent display, and a representative example of the transparent display is TOLED (Transparant OLED). The rear structure of the display unit 151 may also be configured as a light transmission type structure. With this structure, the user can see an object located behind the mobile terminal body through an area occupied by the display unit 151 of the mobile terminal body.

Two or more display units 151 may exist depending on the implementation form of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display units may be spaced apart or integrally disposed on one surface, or may be disposed on different surfaces.

When the display unit 151 and the sensor (hereinafter referred to as a “touch sensor”) 144 for detecting a touch operation form a mutual layer structure (hereinafter, referred to as “touch screen”), the display unit 151 In addition to the output device, it can also be used as an input device. The touch sensor 144 may have a shape such as, for example, a touch film, a touch sheet, and a touch pad.

The touch sensor 144 may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or a capacitance generated at a specific portion of the display unit 151 into an electrical input signal. The touch sensor 144 may be configured to detect not only a touched position and area, but also a pressure at the time of touch.

When there is a touch input to the touch sensor 144, a signal(s) corresponding thereto is transmitted to the touch controller. The touch controller processes the signal(s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can know whether an area of the display unit 151 is touched.

Referring to FIG. 1, a proximity sensor 141 may be disposed in an inner area of a mobile terminal surrounded by the touch screen or near the touch screen. The proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity using the force of an electromagnetic field or infrared rays without mechanical contact. The proximity sensor 141 has a longer lifespan and higher utilization than a contact sensor.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, an infrared proximity sensor, and the like. When the touch screen is capacitive, it is configured to detect the proximity of the pointer by a change in an electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) 144 may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, an action of allowing the pointer to be recognized as being positioned on the touch screen by approaching the touch screen without contacting the pointer is referred to as "proximity touch", and the touch The act of actually touching the pointer on the screen is referred to as "contact touch". A position at which a proximity touch is performed by a pointer on the touch screen means a position at which the pointer corresponds vertically to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (eg, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, etc.). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 152 also outputs sound signals related to functions (eg, call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. The sound output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event in the mobile terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, key signal input, and touch input. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than a video signal or an audio signal, for example, by vibration. The video signal or audio signal may also be output through the display unit 151 or the audio output module 152, so that they 151 and 152 may be classified as part of the alarm unit 153.

The haptic module 154 generates various tactile effects that a user can feel. A typical example of the tactile effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output.

In addition to vibration, the haptic module 154 is used for stimulation such as an arrangement of pins that move vertically with respect to the contact skin surface, a blowing force or suction force of air through a jet or inlet, a grazing on the skin surface, contact of an electrode, electrostatic force, etc. It can generate various tactile effects, such as the effect by the effect and the effect by reproducing the feeling of cooling and warming using an endothermic or heat generating element.

The haptic module 154 may not only transmit a tactile effect through direct contact, but may also be implemented so that a user can feel the tactile effect through muscle sensations such as a finger or an arm. Two or more haptic modules 154 may be provided depending on the configuration aspect of the mobile terminal 100.

The memory 160 may store a program for the operation of the controller 180 and may temporarily store input/output data (eg, a phone book, a message, a still image, a video, etc.). The memory 160 may store data related to vibrations and sounds of various patterns output when a touch input on the touch screen is performed.

The memory 160 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), and RAM. (Random Access Memory, RAM), SRAM (Static Random Access Memory), ROM (Read-Only Memory, ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic It may include at least one type of storage medium among a disk and an optical disk. The mobile terminal 100 may operate in connection with a web storage that performs a storage function of the memory 160 over the Internet.

The interface unit 170 serves as a passage for all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or receives power and transmits it to each component inside the mobile terminal 100, or transmits data inside the mobile terminal 100 to an external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device equipped with an identification module, an audio input/output (I/O) port, A video input/output (I/O) port, an earphone port, etc. may be included in the interface unit 170.

The identification module is a chip that stores various types of information for authenticating the right to use the mobile terminal 100, and includes a user identification module (UIM), a subscriber identity module (SIM), and a universal user authentication module ( Universal Subscriber Identity Module, USIM), etc. may be included. A device equipped with an identification module (hereinafter,'identification device') may be manufactured in the form of a smart card. Therefore, the identification device can be connected to the mobile terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit becomes a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input from the cradle by a user are moved. It can be a passage to the terminal. Various command signals or the power input from the cradle may be operated as signals for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 generally controls the overall operation of the mobile terminal. For example, it performs related control and processing for voice calls, data communication, and video calls. The controller 180 may also include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The controller 180 may perform a pattern recognition process capable of recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The controller 180 may identify a playback section including a feature of the video among the entire playback section of the video. In addition, the controller 180 may acquire feature information on the video based on one or more of an image and an audio of the video. The controller 180 may obtain section information for a video based on the feature information.

Specifically, the controller 180 may obtain section information on a specific playback section in which a feature of a video including one or more of a specific image and a specific sound appears in the entire playback section of the video based on the feature information on the video. .

The feature information on the video may be information on the feature of the video in which at least one of a specific image and a specific sound is included in a specific section of the video.

For example, a feature related to a specific image of a video may be a feature of one of a person, a background, and a place appearing in the video.

In one embodiment, the feature of the video may be a person appearing in the video, and the corresponding section information may be information on a reproduction section in which the person X appears in the entire video.

In another embodiment, the feature of the video may be a place appearing in the video, and the corresponding section information may be information on a playback section in which place 1 appears in the entire video.

A characteristic related to a specific sound of the video may be a characteristic of one of a voice output from the video or background music.

In an embodiment, the feature of the video may be a voice output from the video, and the section information accordingly may be information on a playback section in which the voice of the person Y is output in the entire video.

In another embodiment, the feature of the video may be background music output from the video, and the corresponding section information may be information on a playback section in which background music 1 is output from the entire video.

The controller 180 may obtain section information about the video from the video.

For example, the controller 180 may obtain one or more of characteristic information on a person, background, place, voice, and background music for a video from EPG (Electronic Program Guide) information. Further, the controller 180 may obtain section information for each feature based on the acquired feature information.

As another example, the controller 180 may acquire one or more of information on a person, a background location, a voice, and background music for the video by recognizing an image or audio of a video through automatic content recognition. I can. Accordingly, the controller 180 may recognize one or more of an image and an audio for the video being played, and obtain characteristic information on the video being played. Further, the controller 180 may obtain section information for each feature based on the acquired feature information.

In addition, the controller 180 may obtain new feature information for a video by combining feature information obtained from EPG information and feature information obtained through automatic content recognition. In addition, the controller 180 may obtain section information, which is information about a reproduction section including a new feature, based on the acquired new feature information.

Details on automatic content recognition are known techniques, and detailed descriptions thereof will be omitted.

Based on the acquired feature information of the video, the controller 180 may classify a playback section including each feature in the entire section of the video.

For example, the controller 180 may identify a playback section in which the person Y appears in the entire section of the video.

As another example, the controller 180 may identify a playback section in which background music 2 is output in the entire section of the video.

Specifically, the controller 180 may classify a section in which each feature is included in the entire playback section of the video based on the feature information of each video.

For example, the controller 180 may distinguish a reproduction section in which each of a plurality of persons appears in the entire reproduction section of a video with respect to a feature of a person, which is one feature information.

The controller 180 may display section information of the acquired video.

For example, the controller 180 may display section information on the acquired video on the display unit 151. In addition, the controller 180 may divide and display the entire playback section into a playback section in which features of the video appear and a playback section in which the feature of the video does not appear.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for the operation of each component.

Various embodiments described herein may be implemented in a recording medium that can be read by a computer or a similar device using, for example, software, hardware, or a combination thereof.

According to hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions, in some cases such an embodiment. They can be implemented by the controller 180.

According to a software implementation, embodiments such as procedures or functions may be implemented together with separate software modules that perform at least one function or operation. The software code can be implemented by a software application written in an appropriate programming language. The software code is stored in the memory 160 and can be executed by the controller 180.

2 to 31, a method of operating a terminal according to the present invention will be described.

2 to 3 are flowcharts illustrating a method of operating a terminal according to an embodiment of the present invention.

Referring to FIG. 2, the controller 180 receives a user input for playing a video from a user (S110).

The controller 180 may receive a user's touch input for playing a video through the touch sensor 144. In addition, the controller 180 may receive a user input for playing a video through an external input device such as a keypad or a mouse.

Here, the moving picture may be a moving picture stored in the memory 160 of the terminal 100 or may be a moving picture according to a broadcast signal received through the broadcast receiving module 111. Also, it may be a video received through the wireless Internet module 113 or the short-range communication module 114.

The controller 180 plays the video in response to a user input for playing the video (S112).

For example, the controller 180 may play a video selected by the user on the full screen in response to a user input. Thus, the controller 180 can display a video played through the display unit 151.

The controller 180 acquires section information for the video being played (S114).

The controller 180 may acquire feature information for a video based on one or more of an image and an audio for the video from the video being played.

For example, the controller 180 may acquire feature information including one or more of features of a person, a background, a place, a voice, and a background music for a video being played.

The controller 180 may acquire feature information on the video through EPG information on the video being played. In addition, the controller 180 may acquire feature information on the video through automatic content recognition on the video being played.

The controller 180 may identify a playback section including features acquired from the entire playback section of the video. Accordingly, the control unit 180 may distinguish a reproduction section including each of the plurality of features in the entire reproduction section. In addition, the controller 180 may obtain section information for a video based on each division of a playback section including each of the plurality of feature information in the entire playback section. For example, the controller 180 may obtain section information for the video by dividing each playback section including characteristics of a person, background, place, voice, and background music for the video in the entire playback section of the video. I can.

The controller 180 displays section information for the acquired video in the form of a progressive bar (S116).

The controller 180 may display section information on the acquired video on the display unit 151. Specifically, the controller 180 may classify a reproduction section including each feature from a plurality of features of the acquired video. In addition, the controller 180 may distinguish and display a playback section including a feature of the video from among all playback sections based on section information on the acquired video. In addition, the controller 180 may distinguish and display a playback section including each of the plurality of features among the entire playback section based on information on a plurality of sections of the acquired video.

For example, the controller 180 may display section information for the acquired video in the form of a progressive bar. The controller 180 may display information about a plurality of sections of the acquired video on one progressive bar.

Specifically, the controller 180 may display section information for the acquired video on the three-dimensional progressive bar 200. The controller 180 may display section information for each feature of the video acquired on each side of the three-dimensional progressive bar 200, respectively, and each displayed on each side of the three-dimensional progressive bar 200 The section information may be different characteristics of one video. In addition, the controller 180 may distinguish and display a section including each of a plurality of features among the entire playback section of the video. Accordingly, the controller 180 can display the entire section of the video from the left end to the right end on each side of the three-dimensional progressive bar 200, and the section including each of the plurality of features is a three-dimensional progressive bar 200 ) Can be marked separately for each side.

For example, on each side of the three-dimensional progressive bar 200, the controller 180 may display a playback section including a feature of a moving picture on each side by distinguishing it from a section not including the feature of the moving picture. The controller 180 may differently display a playback section including a feature of a video on one surface of the three-dimensional progressive bar 200 and a playback section without a feature of the video and at least one of color, contrast, and three-dimensional effect. .

This will be described with reference to FIGS. 4 to 8.

4 to 8 illustrate a progressive bar 200 displaying section information according to an embodiment of the present invention.

The controller 180 may display section information on the video on the progressive bar by dividing and displaying the section information including the feature of the video in the entire playback section.

Referring to FIG. 4, the controller 180 may distinguish and display the playback section 210 including the first feature in the progressive bar 202 for the entire playback section.

In addition, the controller 180 may display section information on a three-dimensional progress bar 200 capable of displaying section information for a plurality of features.

Referring to FIG. 5, the controller 180 can display information about each section on each side of the three-dimensional progressive bar 200, so that the entire playback section of the video is displayed on one side of the three-dimensional progressive bar 200. Among the playback sections including the first feature (hereinafter referred to as “first feature section”, 210) may be displayed, and on the other side, the playback section including the second feature among the entire playback sections of the video (hereinafter, It is referred to as a “second feature section.” 220) may be displayed. Here, the first feature and the second feature may be different features.

In addition, the controller 180 may display an information window indicating characteristics displayed on each surface of the three-dimensional progressive bar 200. Specifically, the control unit 180 may display an information window on a characteristic represented by each surface of the three-dimensional progressive bar 200 for each surface.

For example, as shown in FIG. 6, the controller 180 may display an information window 215 indicating characteristics of a surface displayed in front of the entire screen among a plurality of surfaces of the three-dimensional progressive bar 200. have.

Specifically, referring to FIG. 7, when the first characteristic of the three-dimensional progressive bar 200 is information on the appearance of the person X, the controller 180 may display the face of the person X on the information window 215. . In addition, the control unit 180 displays, on the side where the first characteristic of the three-dimensional progressive bar 200 is displayed, the playback section in which the person X appears among the entire playback section of the video, and separates the playback section in which the person X does not appear. can do.

As another example, referring to FIG. 8, when the second characteristic of the three-dimensional progressive bar 200 is information on background music (BGM), the controller 180 displays the song name of BGM 1 on the information window 215. I can. In addition, the controller 180 displays the playback section in which the BGM 1 is output among the entire playback section of the video on the side where the second display of the three-dimensional progressive bar 200 is displayed, in distinction from the playback section in which BGM 1 is not output. I can.

Meanwhile, the controller 180 may display the displayed information window 215 only for a predetermined period of time, or the three-dimensional progressive bar 200 may be displayed during the displayed period of time.

The controller 180 may display a playback indicator 280 on the three-dimensional progressive bar 200 indicating a progress section of the video being played.

The playback indicator 280 will be described with reference to FIG. 9.

9 shows a playback indicator 280 according to an embodiment of the present invention.

Referring to FIG. 9, the controller 180 may display a progression section of a video being played on a surface representing a first characteristic, which is one surface of the three-dimensional progressive bar 200, as a playback indicator 280.

In addition, the controller 180 may display the viewing rating of the moving section of the video through the playback indicator 280.

For example, the controller 180 may display different colors of the playback indicator 280 according to the viewing grade of the moving section of the video. Specifically, the controller 180 may display the color of the playback indicator 280 in green when the viewing rating of the moving section of the video is all viewers. The controller 180 may display the color of the playback indicator 280 in yellow when the viewing rating of the moving section of the video is 15 years or older. The controller 180 may display the color of the playback indicator 280 in red when the viewing rating of the moving section of the video is 19 years or older.

In addition, the controller 180 may display the number of times the video is played through the playback indicator 280.

For example, the controller 180 may differently display the color or contrast of the playback indicator 280 according to the number of times the video is played.

In an embodiment, when the number of times of reproducing a section in progress increases, the controller 180 may display the contrast of the reproducing indicator 280 in a proportional to the increased number of reproducing times.

In another embodiment, when the ongoing section is a section to be played for the first time, the controller 180 may display a color of the playback indicator 280 in white. The controller 180 may display the color of the reproduction indicator 280 in gray when the number of reproduction times of the corresponding section is greater than or equal to the first reference value. The controller 180 may display the color of the reproduction indicator 280 in black when the number of reproduction times of the corresponding section is greater than or equal to the second reference value.

In addition, the controller 180 may display the playback speed of the video through the playback indicator 280.

Specifically, the controller 180 may divide and display the playback speed of the video in the form of the playback indicator 280.

This will be described with reference to FIGS. 10 to 11.

10 to 11 show a playback indicator 280 according to an embodiment of the present invention.

Referring to FIG. 10, when a video being played is being played at 1x speed, the controller 180 may display a playback indicator 280 in the form of an arrow.

In addition, referring to FIG. 11, when the video being played is being played at double speed, the controller 180 may display the playback indicator 280 in the form of two arrows.

Further, the controller 180 may display section information other than section information displayed on the progressive bar through the reproduction indicator 280.

This will be described with reference to FIG. 12.

12 shows an extension of the playback indicator 280 according to an embodiment of the present invention.

Referring to FIG. 12, the controller 180 includes a first feature section 210 including a first feature displayed on a three-dimensional progressive bar 200 and a second feature section 220 including a second feature. Section information including other features may be displayed through the reproduction indicator expansion unit 288. Accordingly, when a playback section including features other than the first feature and the second feature is in progress, the controller 180 may display section information included in the ongoing section through the playback indicator expansion unit 288. .

In another embodiment, the controller 180 may display a user's preference for a specific section among the entire playback section of the video and the number of times of playback on the three-dimensional progressive bar 200.

This will be described with reference to FIG. 13.

13 shows a three-dimensional progressive bar 200 according to another embodiment of the present invention.

Referring to FIG. 13, the controller 180 may display a user's preference for a specific section of a video being played on the three-dimensional progressive bar 200 as a star-shaped indicator 212. Accordingly, the controller 180 may increase and display the number of stars included in the star-shaped indicator 212 as the user's preference increases.

In addition, the controller 180 may display the number of times the user's playback for a specific section of the video being played on the three-dimensional progressive bar 200 as a playback arrow-shaped indicator 214. Accordingly, the controller 180 may increase and display the number of playback arrows included in the playback arrow type indicator 214 as the number of times the user plays the specific section of the video increases.

Refer to FIG. 2 again.

The controller 180 receives a user input for controlling the displayed section information (S118).

The controller 180 may receive a user input for controlling a section including section information from the three-dimensional progressive bar 200 displayed on the display unit 151 through the touch sensor 144. In addition, the controller 180 may receive a user input for controlling a video through an external input device such as a keypad or a mouse.

The controller 180 performs a control operation corresponding to the input user input on the displayed section information (S120).

The controller 180 may perform a control operation corresponding to an input user input on section information displayed on the three-dimensional progressive bar 200.

This will be described with reference to FIGS. 14 to 28.

The controller 180 may move the displayed three-dimensional progressive bar 200 in response to an input user input.

14 shows the movement of the three-dimensional progressive bar 200 according to an embodiment of the present invention.

For example, referring to FIG. 14, when the controller 180 touches the three-dimensional progressive bar 200 and receives a user's drag input moving to the right of the entire screen, the controller 180 controls the three-dimensional progressive bar 200 It can be moved to the right side of the entire screen in response to the drag input of.

The controller 180 may rotate the three-dimensional progressive bar 200 in response to an input user input.

Specifically, when the controller 180 touches the three-dimensional progressive bar 200 and receives a user input that flicks upward or downward, the controller 180 opens the three-dimensional progressive bar 200 in the flicking direction. Can be rotated.

15 shows the rotation of the three-dimensional progressive bar 200 according to an embodiment of the present invention.

Referring to FIG. 15, when the controller 180 touches the three-dimensional progressive bar 200 and receives a user input that flicks downwardly, a surface for a first feature including the first feature section 210 The three-dimensional progressive bar 200 in which the surface of the second feature including the and the second feature section 220 is displayed on the entire screen may be rotated. Accordingly, the control unit 180 includes a surface for a second characteristic including the second characteristic section 220 of the three-dimensional progressive bar 200 and a surface for a third characteristic including the third characteristic section 230. Can be displayed in full screen.

The controller 180 may receive a user input for section information displayed on the three-dimensional progressive bar 200 and extract an image file of a section including the corresponding section information.

For example, when receiving a user input that flicks downward by touching a partial section including section information on the three-dimensional progressive bar 200, the controller 180 displays an image file corresponding to the touched section. Can be extracted.

16 illustrates an image file extraction operation for a partial section according to an embodiment of the present invention.

Referring to FIG. 16, when the controller 180 touches the section 210 including the first feature information on the three-dimensional progressive bar 200 and receives a user input that flicks downward, the first feature section The image file of 210 can be extracted.

The controller 180 may receive a user input for a partial section displayed on the three-dimensional progressive bar 200 and reproduce a preview image of the corresponding section.

For example, when receiving a user input of flicking upward by touching a partial section including section information from the three-dimensional progressive bar 200, the controller 180 displays a preview image of the touched section. Can be displayed.

17 illustrates a preview image display for a partial section according to an embodiment of the present invention.

Referring to FIG. 17, when the controller 180 touches the first feature section 210 on the three-dimensional progressive bar 200 and receives a user input that flicks upward, the first feature section 210 is A preview image 290 may be displayed. As shown in FIG. 17, the controller 180 may display the preview image 290 on the upper side of the three-dimensional progressive bar 200, or preview a partial screen of the entire screen as shown in FIG. An image 290 can also be displayed.

As another example, when receiving a user input that flicks upward by touching a partial section including a feature of a video in the three-dimensional progressive bar 200, the controller 180 displays a thumbnail image for the touched partial section. can do. In addition, the controller 180 may display a thumbnail image extracted at predetermined time intervals in some of the touched sections.

In addition, the controller 180 may simultaneously display a preview image or a thumbnail image for a plurality of section information.

For example, referring to FIG. 19, the controller 180 displays a preview image 292 for the first feature section 210 on the upper left of the full screen, and previews the second feature section 220. The video can be displayed on the top right of the entire screen.

In addition, the controller 180 may divide the entire screen and display a progressive bar for each of a plurality of section information, respectively.

Referring to FIG. 20, the control unit 180 divides the entire screen into four screens, and a progressive bar 202 for a first feature, a progressive bar 204 for a second feature, and a third feature. A progressive bar 206 for and a progressive bar 208 for the fourth feature may be displayed on each of the divided screens.

In another embodiment, the controller 180 may display a progressive bar for a plurality of section information on the upper, lower, left, and right sides of the entire screen.

Referring to FIG. 21, the controller 180 displays a progressive bar 202 for a first feature on the left side of the entire screen, and a progressive bar 204 for a second feature on the top of the entire screen. In addition, a progressive bar 206 for the third feature may be displayed on the right side of the entire screen, and a progressive bar 208 for the fourth feature may be displayed on the lower side of the entire screen.

The controller 180 may receive a user input for a partial section displayed on the three-dimensional progressive bar 200 and display section information on a new feature by combining a plurality of different features.

For example, the controller 180 may receive a user input of dragging and dropping a section including one feature into a section including another feature, and display section information for a new feature combining each feature. I can.

Referring to FIG. 22, when receiving a user input for dragging and dropping the first feature section 210 including the first feature into the fourth feature section 240 including the fourth feature, the controller 180 It is possible to add section information for the fifth feature that combines the first feature and the fourth feature. In addition, the controller 180 may display the section 260 including the added fifth feature on the progressive bar 208 for the fifth feature.

For example, if the first feature section 210 is a section in which the person A appears, and the fourth feature section is a section in which the person B appears, the fifth feature is the person A and B appear simultaneously. It can be something to do. In addition, the controller 180 may display the section including the fifth feature on the three-dimensional progressive bar 200.

The controller 180 may generate a play list by receiving a user input for a partial section displayed on the three-dimensional progressive bar 200.

For example, the controller 180 may receive a user input of dragging and dropping a section including one feature onto the playlist 270 to generate a playlist including the dragged and dropped section.

Referring to FIG. 23, when receiving a user input for dragging and dropping the first feature section 210 to the playlist 270, the controller 180 plays back including the dragged and dropped first feature section 210 You can create a list.

Referring to FIG. 24 as an embodiment, the controller 180 displays a first feature section 210, a second feature section 220, and a fourth feature section 240 including fourth feature information in a playlist 270. ), a playlist 270 including the dragged-and-dropped first feature section 210, the second feature section 220, and the fourth feature section 240 is generated. I can.

In addition, the controller 180 may store only the playback section included in the generated playlist 270. In addition, the controller 180 can reproduce only the reproduction section included in the generated playlist 270.

The controller 180 may receive a user input for the playback indicator 280 displayed on the three-dimensional progressive bar 200 and perform an operation corresponding to the received user input.

For example, the controller 180 may display a progressive bar for each of a plurality of section information included in the three-dimensional progressive bar 200 according to a user input to the playback indicator 280.

As shown in FIG. 25, when the controller 180 touches the playback indicator 280 and receives a user input flicking upwards of the three-dimensional progressive bar 200, the three-dimensional progressive bar 200 A progressive bar for each section information included in can be displayed. Accordingly, the controller 180 includes a progressive bar 202 for section information including a first feature, a progressive bar 204 for section information including a second feature, and a third feature. A progressive bar 206 for section information and a progressive bar 208 for section information including the fourth feature may be displayed.

In addition, when displaying each of the progressive bars for a plurality of section information, the controller 180 may display a viewing rating for a specific section.

Referring to FIG. 26, the controller 180 includes a progressive bar 202 for a first feature, a progressive bar 204 for a second feature, a progressive bar 206 for a third feature, and In the progressive bar 208 for the fourth feature, a viewing rating indicator 275 may be displayed for a playback section other than all viewers.

As another example, the controller 180 may change the shape of the three-dimensional progressive bar 200 according to a user input to the playback indicator 280.

For example, as shown in FIG. 27, when the controller 180 touches the playback indicator 280 and receives a user input that flicks downward of the three-dimensional progressive bar 200, the three-dimensional progressive bar You can change 200 to a progressive bar 202 for the first feature.

And, as shown in FIG. 28, when the controller 180 touches the playback indicator 280 and receives a user input that flicks downward of the progressive bar 202 for the first characteristic, the first characteristic The progressive bar 202 for may be changed to a general progressive bar 201 that displays a progress section.

Next, following FIG. 2, FIG. 3 will be described.

3 is a flowchart for displaying section information of the terminal 100 according to an embodiment of the present invention.

Referring to FIG. 3, if a user input is not received for a preset time (S122), the controller 180 removes the progressive bar displaying section information for a video (S124).

In addition, the controller 180 may play the video on the entire screen from which the progressive bar displaying section information has been removed.

For example, if a user input is not received for a preset time, the controller 180 may remove the three-dimensional progressive bar 200 that displays information about a plurality of sections.

When the moving section of the video reaches a specific section including the characteristics of the video (S126), the controller 180 displays a progressive bar displaying section information (S128).

When the moving section of the video reaches a specific section including one or more features, the controller 180 may display a progressive bar displaying section information.

This will be described with reference to FIGS. 29 to 30.

29 to 30 illustrate a three-dimensional progressive bar 200 that displays section information on a moving section according to an embodiment of the present invention.

Referring to FIG. 29, when the moving section of the video reaches the first feature section 210 including the first feature, the controller 180 may display the three-dimensional progressive bar 200. In addition, the control unit 180 may display the remaining sections except for the first characteristic section 210 in the entire section of the three-dimensional progressive bar 200 in a semi-transparent form.

In addition, the controller 180 may rotate the three-dimensional progressive bar 200 so that when a section including another feature is reached during a section including one feature, a surface displaying the other feature is displayed.

Referring to FIG. 30, when the controller 180 reaches the second feature section 220 including the second feature while the first feature section 210 is in progress, the entire surface on which the second feature section 220 is displayed is The three-dimensional progressive bar 200 may be rotated to appear on the front of the screen.

In another embodiment, the controller 180 may display information about a plurality of sections of a video on a plurality of partial areas of the entire screen, respectively.

Specifically, the controller 180 may display information about a plurality of sections of the video in each corner area of the entire screen.

This will be described with reference to FIG. 31.

31 is an exemplary diagram for displaying a plurality of section information according to an embodiment of the present invention.

Referring to FIG. 31, the controller 180 stores section information on a plurality of features, such as a first feature, a second feature, a third feature, and a fourth feature, in the corner regions of the entire screen (292, 294, 296, 298). Each can be marked on. In addition, when the moving section of the video reaches an area including a plurality of features, the first feature, the second feature, the third feature, and the fourth feature, each of the corner regions 292, 294, 296, and Section information corresponding to each feature may be displayed in 298). In addition, the controller 180 may display information on each of a plurality of features in each of the corner areas 292, 294, 296, and 298 of the entire screen.

According to an embodiment of the present invention, the above-described method can be implemented as code that can be read by a processor in a medium on which a program is recorded. Examples of media that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and are implemented in the form of carrier waves (for example, transmission over the Internet) Include.

The mobile terminal described above is not limited to the configuration and method of the above-described embodiments, but the embodiments are configured by selectively combining all or part of each of the embodiments so that various modifications can be made. May be.

Claims (15)

In the method of operating the terminal,
Acquiring section information on a specific playback section in which a characteristic of a video including at least one of a specific image and a specific sound appears in the entire playback section of the video, based on at least one of video and audio included in the video; And
Including the step of displaying the obtained section information,
Displaying the section information
A first playback section including a first characteristic among all playback sections of the video is displayed on a first surface of a three-dimensional progressive bar having a plurality of sides, and a second surface of the three-dimensional progressive bar Including the step of displaying a second playback section including a second characteristic of the entire playback section,
The first feature and the second feature are different from each other,
How to operate the terminal. The method of claim 1,
Displaying the acquired section information
And dividing and displaying the entire playback section of the video into a playback section in which the feature of the video appears and a playback section in which the feature of the video does not appear.
How to operate the terminal. The method of claim 1,
Further comprising performing a control operation on a specific playback section in which the characteristic of the video appears based on a user input for the displayed section information,
The control operation for the specific playback section is
Including one or more of extracting an image file for the specific playback section, playing a preview video, displaying a thumbnail image, combining new features, and creating a playlist
How to operate the terminal. The method of claim 3,
The new feature combination
Including an operation of combining new features of the video by using a plurality of specific playback sections in which different video features appear.
How to operate the terminal. The method of claim 1,
Displaying the acquired section information
During the playback of the video, when a progress section reaches a specific playback section in which the characteristics of the video appear, displaying the section information
How to operate the terminal. delete The method of claim 5,
Further comprising performing a control operation on the partial reproduction section based on a user input for the partial reproduction section of the progressive bar,
The control operation for the partial playback section is
Including at least one of extracting an image file for the partial playback section, playing a preview video, displaying a thumbnail image, combining a new feature, and creating a playlist.
How to operate the terminal. The method of claim 7,
The above progressive bar
During the playback of the video, including a playback indicator indicating a progress section of the video,
The step of performing the control operation
Changing the shape of the progressive bar based on a user input to the playback indicator
How to operate the terminal. The method of claim 1,
The step of obtaining the section information
Including the step of obtaining section information for each of the plurality of features of the video,
Displaying the acquired section information
Including the step of dividing and displaying section information for each of the obtained plurality of features
How to operate the terminal. The method of claim 1,
The specific image is
Including at least one of a person, a place, and a background appearing in the video,
The specific sound
Included in at least one of audio and background music output from the video
How to operate the terminal. In the terminal,
A display unit; And
Based on at least one of the video and the audio included in the video, section information on a specific playback section in which the characteristics of the video including at least one of a specific image and a specific sound appear in the entire playback section of the video, and acquired And a control unit for displaying section information on the display unit using a three-dimensional progressive bar having a plurality of surfaces,
The control unit,
A first playback section including a first characteristic among all playback sections of the video is displayed on a first surface of the three-dimensional progressive bar having a plurality of sides, and the video is displayed on the second side of the three-dimensional progressive bar. Display the second playback section including the second feature among the entire playback sections of
The first feature and the second feature are different from each other,
terminal. The method of claim 11,
The control unit
Dividing and displaying the entire playback section of the video based on the acquired section information into a playback section in which the feature of the video appears and a playback section in which the feature of the video does not appear
terminal. The method of claim 11,
The control unit
During the playback of the video, when a progress section reaches a specific playback section in which the characteristic of the video appears, displaying the section information
terminal. delete The method of claim 11,
The control unit
Perform a control operation on the partial reproduction section based on a user input for the partial reproduction section of the progressive bar,
The control operation for the partial playback section is
Including at least one of extracting an image file for the partial playback section, playing a preview video, displaying a thumbnail image, combining a new feature, and creating a playlist.
terminal.

Images