KR102350770B1 - Mobile terminal and operating method thereof - Google Patents

Abstract

In a method of operating a mobile terminal according to an embodiment of the present invention, a video is played through a touch screen provided in the mobile terminal, a first touch input is received on the touch screen, and applied through the received first touch input. Receiving a second touch input having a pressure intensity different from the intensity of the applied pressure, and based on at least one of a movement direction of the received second touch input and a pressure intensity of the second touch input controlling the skip speed and skip direction.

Description

Mobile terminal and its operating method {MOBILE TERMINAL AND OPERATING METHOD THEREOF}

The present invention relates to a mobile terminal and a method of operating the same.

The terminal may be divided into a mobile/portable terminal and a stationary terminal according to whether the terminal can be moved. Again, the mobile terminal can be divided into a handheld terminal and a vehicle mounted terminal depending on whether the user can carry it directly.

The functions of mobile terminals are diversifying. For example, there are functions for data and voice communication, image and video shooting through a camera, voice recording, music file playback through a speaker system, and an image or video output to the display unit. Some terminals add an electronic game play function or perform a multimedia player function. In particular, recent mobile terminals can receive multicast signals that provide broadcast and visual content such as video or television programs.

As such a terminal is diversified in functions, for example, in the form of a multimedia device (Multimedia player) equipped with complex functions such as image or video recording, music or video file playback, game, broadcast reception, etc. is being implemented.

In order to support and increase the function of the terminal, it may be considered to improve the structural part and/or the software part of the terminal.

Meanwhile, the mobile terminal may receive a user's touch input through the touch screen, and may perform various functions according to the received touch input.

However, in the prior art, as a complex touch input has to be received to perform a specific function of the mobile terminal, the user may feel inconvenient in manipulating the touch screen.

An object of the present invention is to provide a mobile terminal that allows a user to easily control playback and edit of a video through a touch input having a pressure greater than or equal to a certain level, and an operating method thereof.

Another object of the present invention is to provide a mobile terminal capable of adjusting a skip speed of a video according to the intensity of pressure applied through a touch input, and an operating method thereof.

In a method of operating a mobile terminal according to an embodiment of the present invention, a video is played through a touch screen provided in the mobile terminal, a first touch input is received on the touch screen, and applied through the received first touch input. Receiving a second touch input having a pressure intensity different from the intensity of the applied pressure, and based on at least one of a movement direction of the received second touch input and a pressure intensity of the second touch input controlling the skip speed and skip direction.

A mobile terminal according to an embodiment of the present invention includes a touch screen that receives a touch input, plays a video through the touch screen, receives a first touch input, and controls pressure applied through the received first touch input. Receive a second touch input having a pressure intensity different from the intensity, and skip speed and skip of the video based on at least one of a movement direction of the received second touch input and a pressure intensity of the second touch input A control unit for controlling the direction is included.

According to various embodiments of the present disclosure, a user may easily control playback and edit of a video through a touch input having a pressure greater than or equal to a certain level.

Also, it is possible to easily adjust the skip speed of the video according to the strength of the pressure applied through the touch input.

1 is a block diagram illustrating a mobile terminal related to the present invention.
2 is a flowchart illustrating a method of operating a mobile terminal according to an embodiment of the present invention.
3 is a view for explaining an example of a screen configuration of a touch screen when playing a video according to an embodiment of the present invention.
4 is a view for explaining an indicator displayed on a touch screen when a second touch input having a pressure different from that of a first touch input is received, according to an embodiment of the present invention.
5 to 7 illustrate an embodiment of controlling a skip direction and a skip speed of a video based on at least one of a movement direction of a second touch input and a pressure applied through the second touch input, according to an embodiment of the present invention; show
8 to 10 are diagrams for explaining an embodiment for controlling playback of a section of a moving picture according to an embodiment of the present invention.
11 is a view for explaining an embodiment of controlling playback of a video while a plurality of execution windows are displayed according to an embodiment of the present invention.
12 is a flowchart illustrating a method of operating a mobile terminal according to another embodiment of the present invention.
13 is a view for explaining an example of displaying a thumbnail image of a video during playback of a video according to an embodiment of the present invention.
14 to 18 are diagrams for explaining various embodiments of controlling the reproduction of a video according to a touch input for a thumbnail image.
19 is a flowchart illustrating a method of operating a mobile terminal according to another embodiment of the present invention.
20 and 21 are diagrams for explaining an embodiment in which a mobile terminal enters a video editing mode according to an embodiment of the present invention.
22 to 25 are diagrams for explaining an embodiment of editing a video according to various embodiments of the present disclosure.
26 to 28 are diagrams for explaining a process of performing a video editing method according to an embodiment of the present invention.
29 is a view for explaining a process of linking the reproduction of a captured image and a moving picture according to an embodiment of the present invention.

Hereinafter, the embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but the same or similar components are assigned the same reference numbers regardless of reference numerals, and redundant description thereof will be omitted. The suffixes "module" and "part" for components used in the following description are given or mixed in consideration of only the ease of writing the specification, and do not have distinct meanings or roles by themselves. In addition, in describing the embodiments disclosed in the present specification, if it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed in this specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical idea disclosed herein is not limited by the accompanying drawings, and all changes included in the spirit and scope of the present invention , should be understood to include equivalents or substitutes.

Terms including an ordinal number such as 1st, 2nd, etc. may be used to describe various elements, but the elements are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another.

When an element is referred to as being “connected” or “connected” to another element, it is understood that it may be directly connected or connected to the other element, but other elements may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that the other element does not exist in the middle.

The singular expression includes the plural expression unless the context clearly dictates otherwise.

In the present application, terms such as “comprises” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

The mobile terminal described in this specification includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation system, and a slate PC. , tablet PCs, ultrabooks, wearable devices, for example, watch-type terminals (smartwatch), glass-type terminals (smart glass), HMD (head mounted display), etc. may be included. have.

However, it will be readily apparent to those skilled in the art that the configuration according to the embodiment described in this specification may be applied to a fixed terminal such as a digital TV, a desktop computer, a digital signage, etc., except when applicable only to a mobile terminal. will be.

1 is a block diagram illustrating a mobile terminal related to the present invention.

The mobile terminal 100 includes a wireless communication unit 110 , an input unit 120 , a sensing unit 140 , an output unit 150 , an interface unit 160 , a memory 170 , a control unit 180 , and a power supply unit 190 . ) and the like. The components shown in FIG. 1 are not essential for implementing the mobile terminal, so the mobile terminal described in this specification may have more or fewer components than those listed above.

More specifically, among the components, the wireless communication unit 110 is between the mobile terminal 100 and the wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or between the mobile terminal 100 and an external server. It may include one or more modules that enable wireless communication between them. In addition, the wireless communication unit 110 may include one or more modules for connecting the mobile terminal 100 to one or more networks.

The wireless communication unit 110 may include at least one of a broadcast reception module 111 , a mobile communication module 112 , a wireless Internet module 113 , a short-range communication module 114 , and a location information module 115 . .

The input unit 120 includes a camera 121 or an image input unit for inputting an image signal, a microphone 122 or an audio input unit for inputting an audio signal, and a user input unit 123 for receiving information from a user, for example, , a touch key, a push key, etc.). The voice data or image data collected by the input unit 120 may be analyzed and processed as a user's control command.

The sensing unit 140 may include one or more sensors for sensing at least one of information in the mobile terminal, information on the surrounding environment surrounding the mobile terminal, and user information. For example, the sensing unit 140 may include a proximity sensor 141, an illumination sensor 142, an illumination sensor, a touch sensor, an acceleration sensor, a magnetic sensor, and gravity. Sensor (G-sensor), gyroscope sensor, motion sensor, RGB sensor, infrared sensor (IR sensor: infrared sensor), fingerprint recognition sensor (finger scan sensor), ultrasonic sensor , optical sensors (eg, cameras (see 121)), microphones (see 122), battery gauges, environmental sensors (eg, barometers, hygrometers, thermometers, radiation detection sensors, It may include at least one of a thermal sensor, a gas sensor, etc.) and a chemical sensor (eg, an electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the mobile terminal disclosed in the present specification may combine and utilize information sensed by at least two or more of these sensors.

The output unit 150 is for generating an output related to visual, auditory or tactile sense, and includes at least one of a display unit 151 , a sound output unit 152 , a haptip module 153 , and an optical output unit 154 . can do. The display unit 151 may implement a touch screen by forming a layer structure with the touch sensor or being integrally formed. Such a touch screen may function as the user input unit 123 providing an input interface between the mobile terminal 100 and the user, and may provide an output interface between the mobile terminal 100 and the user. Hereinafter, reference numerals of the touch screen and the display unit 151 are uniformly used as 151 .

The interface unit 160 serves as a passage with various types of external devices connected to the mobile terminal 100 . The interface unit 160 connects a device equipped with a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, and an identification module. It may include at least one of a port, an audio input/output (I/O) port, a video input/output (I/O) port, and an earphone port. In response to the connection of the external device to the interface unit 160 , the mobile terminal 100 may perform appropriate control related to the connected external device.

In addition, the memory 170 stores data supporting various functions of the mobile terminal 100 . The memory 170 may store a plurality of application programs (or applications) driven in the mobile terminal 100 , data for operation of the mobile terminal 100 , and commands. At least some of these application programs may be downloaded from an external server through wireless communication. In addition, at least some of these application programs may exist on the mobile terminal 100 from the time of shipment for basic functions (eg, incoming calls, outgoing functions, message reception, and outgoing functions) of the mobile terminal 100 . Meanwhile, the application program may be stored in the memory 170 , installed on the mobile terminal 100 , and driven to perform an operation (or function) of the mobile terminal by the controller 180 .

In addition to the operation related to the application program, the controller 180 generally controls the overall operation of the mobile terminal 100 . The controller 180 may provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the above-described components or by driving an application program stored in the memory 170 .

In addition, the controller 180 may control at least some of the components discussed with reference to FIG. 1 in order to drive an application program stored in the memory 170 . Furthermore, in order to drive the application program, the controller 180 may operate at least two or more of the components included in the mobile terminal 100 in combination with each other.

The power supply unit 190 receives external power and internal power under the control of the control unit 180 to supply power to each component included in the mobile terminal 100 . The power supply unit 190 includes a battery, and the battery may be a built-in battery or a replaceable battery.

At least some of the respective components may operate in cooperation with each other in order to implement an operation, control, or control method of a mobile terminal according to various embodiments to be described below. Also, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 170 .

[[UX Part Start]]

Hereinafter, before looking at various embodiments implemented through the mobile terminal 100 as described above, the above-listed components will be described in more detail with reference to FIG. 1 .

First, referring to the wireless communication unit 110 , the broadcast reception module 111 of the wireless communication unit 110 receives a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more of the broadcast reception modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

Mobile communication module 112, the technical standards or communication methods for mobile communication (eg, Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), EV -Enhanced Voice-Data Optimized or Enhanced Voice-Data Only (DO), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), LTE-A (Long Term Evolution-Advanced, etc.) transmits and receives a radio signal to and from at least one of a base station, an external terminal, and a server on a mobile communication network constructed according to.

The wireless signal may include various types of data according to transmission/reception of a voice call signal, a video call signal, or a text/multimedia message.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built-in or external to the mobile terminal 100 . The wireless Internet module 113 is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

As wireless Internet technology, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), etc., and the wireless Internet module ( 113) transmits and receives data according to at least one wireless Internet technology within a range including Internet technologies not listed above.

From the point of view that wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc. is made through a mobile communication network, the wireless Internet module 113 performs wireless Internet access through the mobile communication network. ) may be understood as a type of the mobile communication module 112 .

Short-range communication module 114 is for short-range communication, Bluetooth™, RFID (Radio Frequency Identification), infrared communication (Infrared Data Association; IrDA), UWB (Ultra Wideband), ZigBee, NFC At least one of (Near Field Communication), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct, and Wireless Universal Serial Bus (USB) technologies may be used to support short-range communication. The short-distance communication module 114 is, between the mobile terminal 100 and the wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or the mobile terminal 100 through wireless area networks (Wireless Area Networks). ) and another mobile terminal (100, or an external server) can support wireless communication between the network located. The local area network may be local area networks (Wireless Personal Area Networks).

Here, the other mobile terminal 100 is a wearable device capable of exchanging (or interworking) data with the mobile terminal 100 according to the present invention, for example, a smart watch, smart glasses. (smart glass) or HMD (head mounted display)). The short-range communication module 114 may detect (or recognize) a wearable device capable of communicating with the mobile terminal 100 in the vicinity of the mobile terminal 100 . Furthermore, when the detected wearable device is a device authenticated to communicate with the mobile terminal 100 according to the present invention, the controller 180 transmits at least a portion of data processed by the mobile terminal 100 to the short-range communication module ( 114) to the wearable device. Accordingly, the user of the wearable device may use data processed by the mobile terminal 100 through the wearable device. For example, according to this, when a call is received in the mobile terminal 100, the user performs a phone call through the wearable device, or when a message is received in the mobile terminal 100, the user receives the received call through the wearable device. It is possible to check the message.

The location information module 115 is a module for obtaining a location (or current location) of a mobile terminal, and a representative example thereof includes a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, if the mobile terminal utilizes a GPS module, it can acquire the location of the mobile terminal by using a signal transmitted from a GPS satellite. As another example, if the mobile terminal utilizes the Wi-Fi module, the location of the mobile terminal may be obtained based on information of the Wi-Fi module and a wireless access point (AP) that transmits or receives a wireless signal. If necessary, the location information module 115 may perform any function of the other modules of the wireless communication unit 110 to obtain data on the location of the mobile terminal as a substitute or additionally. The location information module 115 is a module used to obtain the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or obtains the location of the mobile terminal.

Next, the input unit 120 is for input of image information (or signal), audio information (or signal), data, or information input from a user. For input of image information, the mobile terminal 100 has one Alternatively, a plurality of cameras 121 may be provided. The camera 121 processes an image frame such as a still image or a moving image obtained by an image sensor in a video call mode or a shooting mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170 . On the other hand, the plurality of cameras 121 provided in the mobile terminal 100 may be arranged to form a matrix structure, and through the cameras 121 forming the matrix structure as described above, various angles or focal points are applied to the mobile terminal 100 . A plurality of image information with can be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to acquire a left image and a right image for realizing a stereoscopic image.

The microphone 122 processes an external sound signal as electrical voice data. The processed voice data may be utilized in various ways according to a function (or an application program being executed) being performed by the mobile terminal 100 . Meanwhile, various noise removal algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 122 .

The user input unit 123 is for receiving information from a user, and when information is input through the user input unit 123 , the controller 180 may control the operation of the mobile terminal 100 to correspond to the input information. . The user input unit 123 is a mechanical input means (or, a mechanical key, for example, a button located on the front, back or side of the mobile terminal 100, a dome switch (dome switch), a jog wheel, jog switch, etc.) and a touch input means. As an example, the touch input means consists of a virtual key, a soft key, or a visual key displayed on the touch screen through software processing, or a part other than the touch screen. It may be made of a touch key (touch key) disposed on the. On the other hand, the virtual key or the visual key, it is possible to be displayed on the touch screen while having various forms, for example, graphic (graphic), text (text), icon (icon), video (video) or these can be made by a combination of

On the other hand, the sensing unit 140 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a sensing signal corresponding thereto. The controller 180 may control the driving or operation of the mobile terminal 100 or perform data processing, function, or operation related to an application program installed in the mobile terminal 100 based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor 141 may be disposed in an inner region of the mobile terminal covered by the touch screen described above or near the touch screen.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the proximity sensor 141 may be configured to detect the proximity of an object having conductivity by a change in an electric field according to the proximity of the object. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of description, the act of approaching an object on the touch screen without contacting it so that the object is recognized that it is located on the touch screen is called “proximity touch”, and the touch The act of actually touching an object on the screen is called "contact touch". The position where the object is touched in proximity on the touch screen means a position where the object is perpendicular to the touch screen when the object is touched in proximity. The proximity sensor 141 may detect a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.) have. Meanwhile, the controller 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 141 as described above, and further, provides visual information corresponding to the processed data. It can be printed on the touch screen. Furthermore, the controller 180 may control the mobile terminal 100 to process different operations or data (or information) according to whether a touch to the same point on the touch screen is a proximity touch or a contact touch. .

The touch sensor receives a touch (or touch input) applied to the touch screen (or the display unit 151) using at least one of various touch methods such as a resistive film method, a capacitive method, an infrared method, an ultrasonic method, and a magnetic field method. detect

As an example, the touch sensor may be configured to convert a change in pressure applied to a specific part of the touch screen or a change in capacitance occurring in a specific part of the touch screen into an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the time of touch, an electrostatic capacitance at the time of touch, etc. in which a touch object applying a touch on the touch screen is touched on the touch sensor. Here, the touch object is an object that applies a touch to the touch sensor, and may be, for example, a finger, a touch pen, a stylus pen, or a pointer.

As such, when there is a touch input to the touch sensor, a signal(s) corresponding thereto is sent to the touch controller. The touch controller processes the signal(s) and then transmits corresponding data to the controller 180 . Accordingly, the controller 180 can know which area of the display unit 151 has been touched, and the like. Here, the touch controller may be a component separate from the controller 180 , or may be the controller 180 itself.

Meanwhile, the controller 180 may perform different controls or may perform the same control according to the type of the touch object that touches the touch screen (or a touch key provided in addition to the touch screen). Whether to perform different control or the same control according to the type of the touch object may be determined according to the current operating state of the mobile terminal 100 or a running application program.

On the other hand, the above-described touch sensor and proximity sensor independently or in combination, a short (or tap) touch on the touch screen (short touch), long touch (long touch), multi touch (multi touch), drag touch (drag touch) ), flick touch, pinch-in touch, pinch-out touch, swype touch, hovering touch, etc. It can sense touch.

The ultrasonic sensor may recognize position information of a sensing target by using ultrasonic waves. Meanwhile, the controller 180 may calculate the position of the wave source through information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source may be calculated using the property that light is much faster than ultrasonic waves, that is, the time at which light arrives at the optical sensor is much faster than the time at which ultrasonic waves reach the ultrasonic sensor. More specifically, the position of the wave source may be calculated using a time difference from the time that the ultrasonic wave arrives using light as a reference signal.

On the other hand, the camera 121 as seen in the configuration of the input unit 120 includes at least one of a camera sensor (eg, CCD, CMOS, etc.), a photo sensor (or image sensor), and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to detect a touch of a sensing target for a 3D stereoscopic image. The photo sensor may be stacked on the display device, and the photo sensor is configured to scan the motion of a sensing target close to the touch screen. More specifically, the photo sensor mounts a photo diode and TR (transistor) in rows/columns and scans the contents placed on the photo sensor using an electrical signal that changes according to the amount of light applied to the photo diode. That is, the photo sensor calculates the coordinates of the sensing target according to the amount of change in light, and through this, location information of the sensing target can be obtained.

The display unit 151 displays (outputs) information processed by the mobile terminal 100 . For example, the display unit 151 may display execution screen information of an application program driven in the mobile terminal 100 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information. .

Also, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

A three-dimensional display method such as a stereoscopic method (glasses method), an auto stereoscopic method (glassesless method), or a projection method (holographic method) may be applied to the stereoscopic display unit.

The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output unit 152 also outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100 . The sound output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that the user can feel. A representative example of the tactile effect generated by the haptic module 153 may be vibration. The intensity and pattern of vibration generated by the haptic module 153 may be controlled by a user's selection or setting of the controller. For example, the haptic module 153 may synthesize and output different vibrations or output them sequentially.

In addition to vibration, the haptic module 153 is configured to respond to stimuli such as a pin arrangement that moves vertically with respect to the contact skin surface, a jet force or suction force of air through a nozzle or an inlet, rubbing against the skin surface, contact of an electrode, electrostatic force, etc. Various tactile effects can be generated, such as the effect of heat absorption and the effect of reproducing a feeling of coolness and warmth using an element capable of absorbing heat or generating heat.

The haptic module 153 may not only deliver a tactile effect through direct contact, but may also be implemented so that the user can feel the tactile effect through a muscle sense such as a finger or arm. Two or more haptic modules 153 may be provided according to the configuration of the mobile terminal 100 .

The light output unit 154 outputs a signal for notifying the occurrence of an event by using the light of the light source of the mobile terminal 100 . Examples of the event occurring in the mobile terminal 100 may be message reception, call signal reception, missed call, alarm, schedule notification, email reception, information reception through an application, and the like.

The signal output from the optical output unit 154 is implemented as the mobile terminal emits light of a single color or a plurality of colors toward the front or rear. The signal output may be terminated when the mobile terminal detects the user's event confirmation.

The interface unit 160 serves as a passage with all external devices connected to the mobile terminal 100 . The interface unit 160 receives data from an external device, receives power and transmits it to each component inside the mobile terminal 100 , or transmits data inside the mobile terminal 100 to an external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device equipped with an identification module (port), an audio I/O (Input/Output) port, a video I/O (Input/Output) port, an earphone port, etc. may be included in the interface unit 160 .

On the other hand, the identification module is a chip storing various types of information for authenticating the use authority of the mobile terminal 100, a user identification module (UIM), a subscriber identity module (subscriber identity module; SIM), universal user authentication It may include a universal subscriber identity module (USIM) and the like. A device equipped with an identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Accordingly, the identification device may be connected to the terminal 100 through the interface unit 160 .

In addition, when the mobile terminal 100 is connected to an external cradle, the interface unit 160 becomes a passage through which power from the cradle is supplied to the mobile terminal 100, or is input from the cradle by a user. Various command signals may be a path through which the mobile terminal 100 is transmitted. Various command signals or the power input from the cradle may be operated as signals for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180 , and may temporarily store input/output data (eg, a phone book, a message, a still image, a moving picture, etc.). The memory 170 may store data related to vibration and sound of various patterns output when a touch input on the touch screen is input.

Memory 170 is a flash memory type (flash memory type), hard disk type (hard disk type), SSD type (Solid State Disk type), SDD type (Silicon Disk Drive type), multimedia card micro type (multimedia card micro type) ), card-type memory (such as SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read (EEPROM) -only memory), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk may include at least one type of storage medium. The mobile terminal 100 may be operated in relation to a web storage that performs a storage function of the memory 170 on the Internet.

Meanwhile, as described above, the controller 180 controls the operation related to the application program and the general operation of the mobile terminal 100 in general. For example, if the state of the mobile terminal satisfies a set condition, the controller 180 may execute or release a lock state restricting input of a user's control command to applications.

In addition, the controller 180 performs control and processing related to voice calls, data communication, video calls, etc., or performs pattern recognition processing capable of recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively. can Furthermore, in order to implement various embodiments described below on the mobile terminal 100 according to the present invention, the controller 180 may control one or a combination of any one or a plurality of the components described above.

The power supply unit 190 receives external power and internal power under the control of the control unit 180 to supply power required for operation of each component. The power supply unit 190 includes a battery, and the battery may be a built-in battery configured to be rechargeable, and may be detachably coupled to the terminal body for charging or the like.

In addition, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of the interface 160 to which an external charger that supplies power for charging the battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 190 uses one or more of an inductive coupling method based on a magnetic induction phenomenon or a resonance coupling method based on an electromagnetic resonance phenomenon from an external wireless power transmitter. power can be transmitted.

Meanwhile, various embodiments below may be implemented in a computer-readable recording medium using, for example, software, hardware, or a combination thereof.

Next, a communication system that can be implemented through the mobile terminal 100 according to the present invention will be described.

First, the communication system may use different air interfaces and/or physical layers. For example, the air interfaces available by a communication system include Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA). ), Universal Mobile Telecommunications Systems (UMTS) (especially Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A)), Global System for Mobile Communications (GSM), etc. may be included.

Hereinafter, for convenience of description, the description will be limited to CDMA. However, it is apparent that the present invention can be applied to all communication systems including CDMA wireless communication systems as well as OFDM (Orthogonal Frequency Division Multiplexing) wireless communication systems.

The CDMA wireless communication system includes at least one terminal 100, at least one base station (Base Station, BS (also referred to as Node B or Evolved Node B)), and at least one base station controller (Base Station Controllers, BSCs). ), and a mobile switching center (MSC). The MSC is configured to be connected to a Public Switched Telephone Network (PSTN) and BSCs. BSCs may be connected in pairs with a BS through a backhaul line. The backhaul line may be provided according to at least one of E1/T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, and xDSL. Accordingly, a plurality of BSCs may be included in a CDMA wireless communication system.

Each of the plurality of BSs may include at least one sector, and each sector may include an omni-directional antenna or an antenna pointing in a specific radial direction from the BS. In addition, each sector may include two or more antennas of various types. Each BS may be configured to support multiple frequency assignments, and each of the multiple frequency assignments may have a specific spectrum (eg, 1.25 MHz, 5 MHz, etc.).

The intersection of sector and frequency allocation may be referred to as a CDMA channel. BSs may be referred to as Base Station Transceiver Subsystems (BTSs). In this case, one BSC and at least one BS may be collectively referred to as a “base station”. A base station may also refer to a “cell site”. Alternatively, each of a plurality of sectors for a specific BS may be referred to as a plurality of cell sites.

A broadcast transmitter (BT) transmits a broadcast signal to the terminals 100 operating in the system. The broadcast reception module 111 shown in FIG. 1 is provided in the terminal 100 to receive a broadcast signal transmitted by BT.

In addition, a global positioning system (GPS) for confirming the location of the mobile terminal 100 may be linked to the CDMA wireless communication system. The satellite 300 helps to determine the location of the mobile terminal 100 . Useful location information may be obtained by two or fewer or more satellites. Here, the location of the mobile terminal 100 may be tracked using not only the GPS tracking technology but also all techniques capable of tracking the location. In addition, at least one of the GPS satellites may optionally or additionally be responsible for satellite DMB transmission.

The location information module 115 provided in the mobile terminal is for detecting, calculating, or identifying the location of the mobile terminal, and representative examples thereof may include a Global Position System (GPS) module and a Wireless Fidelity (WiFi) module. If necessary, the location information module 115 may perform any function of the other modules of the wireless communication unit 110 to obtain data on the location of the mobile terminal as a substitute or additionally.

The GPS module 115 calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information to accurately calculate three-dimensional current location information according to latitude, longitude, and altitude. can do. Currently, a method of calculating position and time information using three satellites and correcting errors in the calculated position and time information using another one satellite is widely used. In addition, the GPS module 115 may calculate the speed information by continuously calculating the current location in real time. However, it is difficult to accurately measure the position of the mobile terminal using the GPS module in the shaded area of the satellite signal, such as indoors. Accordingly, in order to compensate for positioning by the GPS method, a WiFi Positioning System (WPS) may be utilized.

A WiFi positioning system (WPS) uses a WiFi module provided in the mobile terminal 100 and a wireless AP (Wireless Access Point) that transmits or receives a wireless signal with the WiFi module, the mobile terminal 100 As a technology for tracking the location of a wireless network, it refers to a wireless local area network (WLAN)-based positioning technology using WiFi.

The Wi-Fi location tracking system may include a Wi-Fi positioning server, the mobile terminal 100, a wireless AP connected to the mobile terminal 100, and a database in which arbitrary wireless AP information is stored.

The mobile terminal 100 connected to the wireless AP may transmit a location information request message to the Wi-Fi location location server.

The Wi-Fi positioning server extracts information on the wireless AP connected to the mobile terminal 100 based on the location information request message (or signal) of the mobile terminal 100 . Information on the wireless AP connected to the mobile terminal 100 may be transmitted to the Wi-Fi positioning server through the mobile terminal 100 or may be transmitted from the wireless AP to the Wi-Fi positioning server.

Based on the location information request message of the mobile terminal 100, the extracted wireless AP information is MAC Address, Service Set IDentification (SSID), Received Signal Strength Indicator (RSSI), Reference Signal Received Power (RSRP), RSRQ ( Reference Signal Received Quality), channel information, Privacy, Network Type, signal strength, and noise strength may be at least one.

As described above, the Wi-Fi positioning server may receive information of a wireless AP connected to the mobile terminal 100 and extract wireless AP information corresponding to a wireless AP to which the mobile terminal is connected from a pre-established database. At this time, the information of arbitrary wireless APs stored in the database includes MAC Address, SSID, channel information, Privacy, Network Type, latitude and longitude coordinates of the wireless AP, the name of the building where the wireless AP is located, the number of floors, and detailed indoor location information (GPS coordinates). available), the AP owner's address, phone number, and the like. In this case, in order to remove a mobile AP or a wireless AP provided using an illegal MAC address in the positioning process, the Wi-Fi positioning server may extract only a predetermined number of wireless AP information in order of increasing RSSI.

Thereafter, the Wi-Fi positioning server may extract (or analyze) the location information of the mobile terminal 100 by using at least one wireless AP information extracted from the database. By comparing the included information and the received wireless AP information, the location information of the mobile terminal 100 is extracted (or analyzed).

As a method for extracting (or analyzing) the location information of the mobile terminal 100, a Cell-ID method, a fingerprint method, a triangulation method, a landmark method, etc. may be utilized.

The Cell-ID method is a method of determining the location of a wireless AP having the strongest signal strength among surrounding wireless AP information collected by the mobile terminal as the location of the mobile terminal. It has the advantages of being simple to implement, not requiring additional cost, and being able to quickly obtain location information, but has a disadvantage in that the positioning accuracy is lowered when the installation density of the wireless AP is low.

The fingerprint method is a method of collecting signal strength information by selecting a reference position in a service area, and estimating the position through signal strength information transmitted from a mobile terminal based on the collected information. In order to use the fingerprint method, it is necessary to make a database of propagation characteristics in advance.

The triangulation method is a method of calculating the position of a mobile terminal based on the coordinates of at least three wireless APs and the distance between the mobile terminal. In order to measure the distance between the mobile terminal and the wireless AP, the signal strength is converted into distance information, the time at which a wireless signal is transmitted (Time of Arrival, ToA), and the time difference of the signal is transmitted (Time Difference of Arrival, TDoA) , the angle at which the signal is transmitted (Angle of Arrival, AoA), etc. may be used.

The landmark method is a method of measuring the location of a mobile terminal using a landmark transmitter that knows the location.

In addition to the enumerated methods, various algorithms may be utilized as a method for extracting (or analyzing) location information of a mobile terminal.

The extracted location information of the mobile terminal 100 is transmitted to the mobile terminal 100 through the Wi-Fi positioning server, so that the mobile terminal 100 can acquire the location information.

The mobile terminal 100 may acquire location information by being connected to at least one wireless AP. In this case, the number of wireless APs required to acquire the location information of the mobile terminal 100 may be variously changed according to the wireless communication environment in which the mobile terminal 100 is located.

Next, FIG. 2 will be described.

2 is a flowchart illustrating a method of operating a mobile terminal according to an embodiment of the present invention.

The controller 180 of the mobile terminal 100 plays a video through the touch screen (S101). In an embodiment, the controller 180 may receive a request for playing a video, and play the video on the touch screen according to the received request.

The controller 180 of the mobile terminal 100 receives the first touch input on the speed control area of the touch screen while the video is being played ( S103 ). In an embodiment, the screen of the touch screen may include a speed control area. The screen of the touch screen may additionally include at least one of an editing area and a reproduction control area. The speed control area may be an area for controlling the playback speed of a moving picture. The editing area may be an area for editing a video. The reproduction control area may be an area controlling reproduction of a moving picture. The screen configuration of the touch screen during video playback will be described with reference to FIG. 3 .

3 is a view for explaining an example of a screen configuration of a touch screen when playing a video according to an embodiment of the present invention.

Referring to FIG. 3 , the screen configuration of the touch screen included in the mobile terminal 100 is illustrated when a moving picture is played. The screen of the touch screen may include the speed control area 200 . The screen of the touch screen may additionally include at least one or more of the editing area 300 and the reproduction control area 500 .

The speed control area 200 may be an area where a moving picture is played, and the speed control area 200 may be an area for receiving a touch input for controlling a skip speed of a moving image according to a touch input.

The editing area 300 may be an area for displaying a progress bar indicating a playback trend of a video and an area for receiving a touch input for editing a video.

The playback control area 500 is an area for controlling the playback of a video, and it receives a touch input for performing functions such as stopping the video, playing the video in full screen, fast forwarding, fast forwarding, and adjusting the volume. It can be an area.

A detailed description of each area will be described later.

Fig. 2 will be described again.

The controller 180 of the mobile terminal 100 receives the first touch input on the speed control area of the touch screen (S103). In an embodiment, the controller 180 may stop the video being played according to the received first touch input. In another embodiment, the controller 180 may display at least one of the editing area and the reproduction control area according to the received first touch input. In another embodiment, the controller 180 may not show any response in response to the received first touch input.

The controller 180 of the mobile terminal 100 receives a second touch input having a pressure different from the pressure applied through the received first touch input (S105).

The pressure applied through the first touch input is referred to as a first pressure, and the pressure applied through the second touch input is referred to as a second pressure. The intensity of the second pressure may be greater than the intensity of the first pressure. The intensity of the second pressure may be greater than or equal to the reference pressure intensity. The reference pressure intensity may be a minimum pressure intensity to control the skip speed of moving pictures.

A point at which the first touch input is applied and a point at which the second touch input is applied on the speed control area 200 on the touch screen may be the same.

The controller 180 of the mobile terminal 100 displays an indicator indicating that a pressure different from the input of the first touch input is applied according to the received second touch input (S107). In an embodiment, when the pressure applied through the second touch input is different from the pressure applied through the first touch input, the controller 180 may display an indicator for notifying the user at one side of the point at which the second touch input is received. can be displayed in For example, when the intensity of the pressure applied through the second touch input is equal to or greater than the reference pressure intensity, the controller 180 may display an indicator indicating that the pressure equal to or greater than the reference pressure intensity is applied on the touch screen when the second touch input is received. It can be marked on one side of the point. The indicator will be described with reference to FIG. 4 .

4 is a view for explaining an indicator displayed on a touch screen when a second touch input having a pressure different from that of a first touch input is received, according to an embodiment of the present invention.

Referring to FIG. 4 , the controller 180 of the mobile terminal 100 applies a first touch input and a second touch input to the same point in the speed control area 200 of the touch screen while the video is being played or the video is stopped. can receive In an embodiment, the strength of the pressure applied through the second touch input may be greater than the strength of the pressure applied through the first touch input. As the second touch input is received, the controller 180 may display an indicator 201 indicating that the intensity of the pressure applied through the second touch input is equal to or greater than the reference pressure intensity at the point where the second touch input is applied. The indicator 201 may indicate that the video skip speed is in a controllable state.

The user can easily recognize that the video can be skipped through the indicator 201 .

Fig. 2 will be described again.

The controller 180 of the mobile terminal 100 controls the skip direction and the skip speed of the video based on at least one of the moving direction of the second touch input and the strength of the pressure applied through the second touch input (S109). In an embodiment, when the moving direction of the second touch input is to the right, the controller 180 may move the skip direction of the video from the current playback time to a later playback time, and the moving direction of the second touch input is to the left direction, the skip direction of the video may be moved from the current playback time to the previous playback time.

In an embodiment, the controller 180 may increase the skip speed as the strength of the pressure applied through the second touch input increases. For example, assuming that the reference pressure intensity is 1, when the intensity of pressure applied through the second touch input is a value corresponding to 2, the controller 180 may adjust the skip speed to 1/4 speed, , in the case of a value corresponding to 4, the skip speed can be adjusted to 1/2. However, here, the numerical value is merely an example.

In another embodiment, the controller 180 may adjust the skip speed of the video based on the total playing time of the video and the strength of the pressure applied through the second touch input. For example, if the total playing time of the video is longer than the preset time, the skip speed of the video is skipped at 1/4, 1/3, 1/2 speed as the intensity of the pressure applied through the second touch input increases. You can gradually increase the speed. If the total playback time of the video is less than the preset time, the skip speed of the video may be adjusted to only 1/2 speed based on the pressure applied through the second touch input.

Step S109 will be described with reference to FIGS. 5 to 7 .

5 to 7 illustrate an embodiment of controlling a skip direction and a skip speed of a video based on at least one of a movement direction of a second touch input and a pressure applied through the second touch input, according to an embodiment of the present invention; show

First, referring to FIG. 5 , an indicator 201 is displayed on the speed control area 200 according to a user's second touch input. In this state, when the mobile terminal 100 receives an input swiping to move the direction of the second touch input to the right, and the intensity of pressure applied through the second touch input is greater than or equal to the reference pressure intensity, the mobile terminal 100 moves The terminal 100 may move the skip direction of the video from the current playback time to a subsequent playback time and simultaneously adjust the skip speed of the video to 1/2. As the mobile terminal 100 receives a swapping input for moving the direction of the second touch input to the right, the mobile terminal 100 plays a video to be moved on the speed control area 200 of the touch screen. A playback time pop-up window 203 indicating a starting point and a skip speed pop-up window 205 indicating a skip speed may be displayed.

The user can easily grasp at a glance at which point the playback timing of the video moves and at what speed through the playback timing pop-up window 203 and the skip speed pop-up window 205 .

Next, FIG. 6 will be described.

Referring to FIG. 6 , the mobile terminal 100 displays an indicator 201, a play time pop-up window 203 displaying a skip time, and a skip speed pop-up window 205, in the speed control area ( 200) can be displayed. The playback timing and skip speed displayed on the playback timing pop-up window 203 may vary depending on the strength of the pressure applied through the second touch input. That is, as the strength of the pressure applied through the second touch input increases, the playback timing displayed on the playback timing pop-up window 203 may be delayed further, and the skip speed displayed on the skip speed pop-up window 205 may further increase. . The playback time displayed on the playback time pop-up window 203 may be a time after the current playback time, but is not limited thereto, and may be a time before the current playback time. When the playback time displayed in the playback time pop-up window 203 is before the current playback time, the mobile terminal 100 may display this information on the speed control area 200 .

In this state, as the mobile terminal 100 receives an input for swiping the direction of the second touch input to the right, the mobile terminal 100 changes the skip direction of the video from the current playback time to a subsequent playback time. You can adjust the skip speed of the video by 1/2 while moving it to .

The user can easily grasp at a glance at which point the playback timing of the video moves and at what speed through the playback timing pop-up window 203 and the skip speed pop-up window 205 .

Next, FIG. 7 will be described.

Referring to FIG. 7 , the mobile terminal 100 may display the indicator 201 and the skip time pop-up window 207 on the speed control area 200 according to the reception of the second touch input. The skip time displayed on the skip time pop-up window 207 may vary according to the strength of the pressure applied through the second touch input. That is, as the strength of the pressure applied through the second touch input increases, the skip time displayed on the skip time pop-up window 207 may also increase. In this state, as the mobile terminal 100 receives an input for swiping to move the direction of the second touch input to the right, the mobile terminal 100 may move the playback time of the video after the current playback time by the skip time.

Fig. 2 will be described again.

The controller 180 of the mobile terminal 100 receives the third touch input for setting the section of the video (S111), and plays the section of the video set according to the received third touch input (S113). According to an embodiment, the third touch input may be an input for repeatedly playing a specific section among the entire playback section of a video. The controller 180 may repeatedly reproduce a specific section according to a third touch input for repeatedly reproducing the specific section.

In another embodiment, the third touch input may be an input for simultaneously playing back a plurality of specific sections among the entire playback sections of a video. The controller 180 may simultaneously play videos corresponding to each of the plurality of specific sections on the speed control area 200 of the touch screen according to a third touch input for simultaneously playing the plurality of specific sections.

Steps S111 to S113 will be described with reference to FIGS. 8 to 10 .

8 to 10 are diagrams for explaining an embodiment for controlling playback of a section of a moving picture according to an embodiment of the present invention.

In particular, FIG. 8 is a view for explaining a method for repeatedly playing a specific section among all playback sections of a video according to an embodiment of the present invention, and FIGS. 9 to 10 are views of a video according to an embodiment of the present invention. It is a diagram for explaining a method for simultaneously reproducing a plurality of specific sections among all reproduction sections.

First, referring to FIG. 8 , when the mobile terminal 100 receives the second touch input 211 on the speed control area 200 of the touch screen, an indicator 201, a playback timing popup indicating a playback timing to be moved A window 203 and a skip speed pop-up window 205 indicating the skip speed may be displayed. Thereafter, the mobile terminal 100 may receive the third touch input 213 having a pressure strength equal to or greater than the reference pressure strength. The mobile terminal 100 may display an indicator 223 indicating that a repetition section has been designated according to the reception of the third touch input 213 . In response to the second touch input and the third touch input, the mobile terminal 100 performs a section from 03:34, which is the current playback time of the video, to 05:33, which is the playback time to be moved (the time to be skipped) according to the second touch input. It can be played repeatedly.

A user can repeatedly watch a desired section of a video by simply adjusting the intensity of the touch input.

Next, FIGS. 9 to 10 will be described.

Referring to FIG. 9 , the controller 180 of the mobile terminal 100 may simultaneously receive a second touch input 211 and a third touch input 213 . It is assumed that the pressure intensity of the second touch input 211 and the pressure intensity of the third touch input 215 are equal to or greater than the reference pressure intensity. In response to reception of the second touch input 211 , the mobile terminal 100 displays an indicator 201 corresponding to the second touch input 211 and a playback timing popup indicating a playback timing to be moved according to the second touch input 211 . The window 203 is displayed, and when the third touch input 215 is received, the indicator 225 corresponding to the third touch input 215 and the playback time point (skip point) to be moved according to the third touch input 215 are displayed. ), a playback time pop-up window 227 may be displayed. The playback timing displayed on each playback timing pop-up window may be adjusted according to the intensity of pressure applied through each touch input. When the second touch input 211 is moved to the right and the third touch input 215 is moved to the left, the mobile terminal 100 performs a second touch input 211 from 03:34, which is the current playback time of the video. The video 231 corresponding to the section up to 05:33, which is the playback time to be moved according to , is played over the entire area of the speed control area 200, and from 03:34, the current playback time of the video, to the third touch input 215 ), the moving picture 233 corresponding to the section up to 02:33, which is the playback time point to be moved according to ), may be simultaneously reproduced in a partial area of the speed control area 200 .

A user can simultaneously view desired sections of a video by simply adjusting the intensity of a plurality of touch inputs.

Fig. 2 will be described again.

According to an embodiment of the present invention, embodiments of skip speed, skip direction, repeated playback of a specific section, and simultaneous playback of specific sections of a moving picture may be performed even in a state in which a plurality of execution windows are displayed. The plurality of execution windows may be windows displayed according to the execution of each of the plurality of applications.

This will be described with reference to FIG. 11 .

11 is a view for explaining an embodiment of controlling playback of a video while a plurality of execution windows are displayed according to an embodiment of the present invention.

The mobile terminal 100 may display the video playback screen 710 as a reduced screen in response to receiving a request to display another execution screen while the video playback screen 710 is being played in full screen. At the same time, the mobile terminal 100 may display the initial screen 730 . The mobile terminal 100 may execute the selected application in response to a request for selecting any one of a plurality of applications displayed on the initial screen 730 . The video playback screen 710 may be displayed as translucent. While displaying the initial screen 730 and the video playback screen 710, the mobile terminal 100 may perform skip speed, skip direction, repeat playback of a specific section, and simultaneous playback of specific sections according to a user's touch input while displaying the initial screen 730 and the video playback screen 710. have. This is the same as the content described with reference to FIGS. 2 to 10 .

The user may control the playback of the video only by a touch input having a reference pressure strength or higher while displaying execution windows of other applications.

Next, FIG. 12 will be described.

12 is a flowchart illustrating a method of operating a mobile terminal according to another embodiment of the present invention.

The controller 180 of the mobile terminal 100 plays a video through the touch screen (S301).

The controller 180 of the mobile terminal 100 receives a request for displaying a thumbnail image of a video during playback of the video (S303), and displays the thumbnail image of the video according to the received request (S305). According to an embodiment, the request for displaying the thumbnail image may be a request for selecting one of a progress bar and a reproduction control bar included in the editing area 300 of the touch screen. This will be described with reference to FIG. 13 .

13 is a view for explaining an example of displaying a thumbnail image of a video during playback of a video according to an embodiment of the present invention.

Referring to FIG. 13 , the editing area 300 may include a progress bar 301 and a reproduction control bar 303 . The progress bar 301 shows the playback trend of the video, and the playback control bar 303 shows the current playback time of the video and enables movement to a specific playback timing at the same time.

While the video is being played, the controller 180 of the mobile terminal 100 controls a touch input for one point of the progress bar 301 or moves the playback control bar 303 to a specific point on the progress bar 301 . A touch input may be received. The controller 180 may display a thumbnail image 305 corresponding to a point of the progress bar 301 on one side of the progress bar 301 according to reception of a touch input for a point of the progress bar 301 . That is, the request for displaying the thumbnail image of the video may be a touch input on a point of the progress bar 301 .

Fig. 12 will be described again.

The controller 180 of the mobile terminal 100 receives a touch input for the displayed thumbnail image (S307), and controls playback of a video according to the received touch input (S309).

According to an embodiment, the touch input for the thumbnail image may be a touch input for selecting the thumbnail image. The controller 180 may play a video on the speed control area 200 from a playback time corresponding to the thumbnail image according to reception of a touch input for selecting a thumbnail image.

In another embodiment, the touch input for the thumbnail image may be an input for selecting and capturing the thumbnail image. In this case, the strength of the pressure applied through the touch input for selecting the thumbnail may be the reference pressure strength.

In another embodiment, the touch input for the thumbnail image may be an input for selecting the thumbnail image and flicking it to the speed control area 200 . The controller 180 may play a video from a playback time corresponding to the thumbnail image in a portion of the speed control area 200 according to an input of selecting a thumbnail image and flicking it in a specific direction. In this case, the intensity of the pressure applied through the touch input for selecting the thumbnail image may be greater than or equal to the reference pressure intensity. Steps S307 to S309 will be described with reference to FIGS. 14 to 18 .

14 to 18 are diagrams for explaining various embodiments of controlling the reproduction of a video according to a touch input for a thumbnail image.

Referring to FIG. 14 , the controller 180 plays a video from the playback time corresponding to the thumbnail image 305 selected according to a touch input for selecting the thumbnail image 305 shown in FIG. 13 over the entire speed control area 200 . can be played on the screen.

The user can check the point of the video he wants to find through the thumbnail image and watch the video from that point.

Next, FIG. 15 will be described.

In particular, it is assumed in FIG. 15 that the pressure applied through the input for touching the thumbnail image is equal to or greater than the reference pressure intensity.

In the state of FIG. 13 , when a touch input for selecting a thumbnail image is received, the controller 180 may capture the thumbnail image 305 . When the pressure applied through the touch input for selecting the thumbnail image is greater than or equal to the reference pressure intensity, the controller 180 displays an indicator 307 indicating that pressure greater than or equal to the reference pressure intensity is applied and simultaneously captures the thumbnail image 305 can do.

The controller 180 may display a message indicating that the thumbnail image 305 has been captured according to the selected touch input, or may output that the thumbnail image 305 has been captured through the sound output unit 152 . The capture icon 297 displayed on the speed control area 200 is an icon for capturing a moving picture being played on the speed control area 200 .

The user can capture a specific point of the video by simply touching the thumbnail image with a pressure intensity greater than or equal to a certain level.

Next, FIGS. 16 to 18 will be described.

First, referring to FIG. 16 , when a touch input for selecting the thumbnail image 305 is received, the pressure applied through the touch input is equal to or greater than the reference pressure strength, and an input for flicking the touch input is received , the controller 180 may play a video from the playback time corresponding to the selected thumbnail image 305 through the floating window 309 as shown in FIG. 17 . Here, the direction in which the flicking input is directed may be the upper side of the speed control area 200 side. There is no need to be limited thereto. If a touch input for selecting the floating window 309 is received and the pressure applied through the received touch input is equal to or greater than the reference pressure intensity, the controller 180 controls the video being played on the floating window 309 in the speed control area. It is possible to play through the entire area of 200 or make the floating window 309 disappear. As another example, when a touch input for selecting the floating window 309 is received, the controller 180 may display a floating playback menu for controlling the floating window 309 . The floating playback menu may include an enlargement option for enlarging the floating window 309 to the entire area of the speed control area 200 and a close option for closing the floating window 309 .

As another example, when a touch input for selecting the thumbnail image 305 is received, the pressure applied through the touch input is equal to or greater than the reference pressure strength, and an input flicking the touch input is received, the controller 180 ), as shown in FIG. 18, reproduces the video from the playback time corresponding to the thumbnail image 305 in the left half area 311 of the speed control area 200 and simultaneously plays the original video in the speed control area ( 200) can be reproduced in the right half area 313. Meanwhile, the strength of the pressure applied through the touch input for selecting the thumbnail image 305 in FIG. 18 may be greater than the strength of the pressure applied through the touch input applied in FIG. 17 . That is, based on the pressure intensity of the touch input for selecting the thumbnail image 305 , the video from the playback time corresponding to the thumbnail image 305 may be reproduced in a different way.

If a touch input for selecting any one of the left half area 311 and the right half area 313 of the speed control area 200 is received, and the pressure applied through the received touch input is equal to or greater than the reference pressure strength In this case, the controller 180 may reproduce the video being reproduced in the selected area on the entire area of the speed control area 200 .

Next, FIG. 19 will be described.

19 is a flowchart illustrating a method of operating a mobile terminal according to another embodiment of the present invention.

The controller 180 of the mobile terminal 100 plays a video through the touch screen (S501). According to an embodiment, after the steps S103 to S113 are performed, the step S503 may be performed.

The controller 180 of the mobile terminal 100 receives a request for displaying a thumbnail image of a video during playback of the video (S503), and displays the thumbnail image of the video according to the received request (S505). This is the same as described in FIG. 13 .

The controller 180 of the mobile terminal 100 receives a request for editing a video being played (S507), and enters a video editing mode according to the received request (S509).

According to an embodiment, the request for editing a video may be touch inputs having a reference pressure strength or higher at two points of the progress bar 301 included in the editing area 300 of the touch screen. This will be described with reference to FIGS. 20 and 21 .

20 and 21 are diagrams for explaining an embodiment in which a mobile terminal enters a video editing mode according to an embodiment of the present invention.

Referring to FIG. 20 , when a touch input is applied to a point 304 of the progress bar 301 included in the editing area 300 , a thumbnail image 305 corresponding to the one point 304 is displayed in progress. It may be displayed on one side of the bar 301 . In this state, the controller 180 may receive a touch input having greater than or equal to the reference pressure intensity with respect to a point 304 of the progress bar 301 . In response to reception of a touch input having a reference pressure strength or greater, the controller 180 may display an indicator indicating that a pressure greater than or equal to the reference pressure strength is applied and a skip point 321 of the video. Thereafter, as shown in FIG. 21 , when a touch input having a pressure greater than or equal to the reference pressure intensity is applied to the other point 306 of the progress bar 301 , a thumbnail image 308 corresponding to the skip point 321 . ) is displayed and the mobile terminal 100 may enter the video editing mode.

The mobile terminal 100 may enter a state in which a video can be edited only by a user's simple touch input having a predetermined pressure on the progress bar 301 .

Fig. 19 will be described again.

The controller 180 of the mobile terminal 100 edits the video being played according to the flicking input while entering the video editing mode (S511).

Step S511 will be described with reference to FIGS. 22 to 25 .

22 to 25 are diagrams for explaining an embodiment of editing a video according to various embodiments of the present disclosure.

Referring to FIG. 22 , as shown in FIG. 21 , in a state in which the mobile terminal 100 enters the video editing mode, the controller 180 may receive a touch input for selecting the progress bar 301 . Thereafter, upon receiving the flicking input flicking upward, the controller 180 may change the screen of the touch screen to a section editing screen for section editing of a moving picture as shown in FIG. 23 . Here, the section of the video may be a section from a playback time corresponding to one point 304 of the progress bar 301 described in FIGS. 20 and 21 to a playback time corresponding to another point 306 .

Next, FIGS. 24 and 25 will be described.

Referring to FIG. 24 , as shown in FIG. 21 , in a state in which the mobile terminal 100 enters the video editing mode, the controller 180 may receive a touch input for selecting the progress bar 301 . After that, as the controller 180 receives a flicking input flicking downward, as shown in FIG. 25 , a section utilization menu 400 for utilizing a specific section of the video is displayed on the screen of the touch screen. can Here, the section of the video may be a section from a playback time corresponding to one point 304 of the progress bar 301 described in FIGS. 20 and 21 to a playback time corresponding to another point 306 . Referring to FIG. 25 , the section utilization menu 400 may include a storage option 410 , a transmission option 430 , and a deletion option 450 . The storage option 410 is an option for storing the section of the video in the memory 170, the transmission option 430 is an option for transmitting the section of the video to another user's mobile terminal or peripheral device, and the deletion option 450 ) may be an option for deleting a section of a video.

Meanwhile, according to another embodiment of the present invention, an image corresponding to a specific point of a video may be captured only by a touch input having a pressure equal to or greater than the reference pressure intensity. The captured video image may be stored in the memory 170, and later, may be linked with playback of the video.

This will be described with reference to FIGS. 26 to 28 .

26 to 28 are diagrams for explaining a process of performing a video editing method according to an embodiment of the present invention.

Hereinafter, it is assumed that the mobile terminal 100 has entered the editing mode. The mobile terminal 100 may enter the editing mode in various ways. In addition to the method described with reference to FIG. 19 , the mobile terminal 100 may enter the edit mode according to a request for selecting a separate edit icon.

Referring to FIG. 26 , the mobile terminal 100 may receive a touch input for a point on the speed control area 200 while playing a video. When the pressure applied through the received touch input is equal to or greater than the reference pressure, the mobile terminal 100 displays an indicator 201 notifying this, and displays a thumbnail image 251 corresponding to the skip point obtained through the touch input. can In this state, the mobile terminal 100 may store the thumbnail image 251 in the memory 170 upon receiving a request for selecting the displayed thumbnail image 251 .

The captured thumbnail images may be displayed at a position adjacent to the progress bar 301 when the playback of the video is finished or when the playback of the video is started. Referring to FIG. 27 , when the video ends, the controller 180 may display a plurality of thumbnails 251 , 253 , and 255 at positions adjacent to the progress bar 301 . Each of the plurality of thumbnail images 251 , 253 , and 255 may be a captured thumbnail image as described with reference to FIG. 26 . As another example, each of the plurality of thumbnail images 251 , 253 , and 255 may be a captured image as described in the embodiment of FIG. 15 .

Referring to FIG. 28 , a plurality of thumbnail images 251 , 253 , and 255 may be stored in a gallery folder of the memory 170 . The memory 170 may additionally store thumbnail images of adjacent viewpoints of each of the plurality of thumbnail images 251 , 253 , and 255 . That is, in preparation for a case in which the captured image is not a part desired by the user, the controller 180 may additionally store the captured image and adjacent images of the playback time.

In an embodiment, when a touch input for selecting any one of the plurality of thumbnail images 251 , 253 , and 255 is received and the pressure applied through the received touch input is equal to or greater than the reference pressure strength, the mobile terminal 100 A video may be played from a playback time corresponding to the selected thumbnail image.

In another embodiment, when a touch input for selecting any one of the plurality of thumbnail images 251 , 253 , and 255 is received, and the pressure applied through the received touch input is greater than or equal to the reference pressure strength, the playback icon is displayed. can This will be described with reference to FIG. 29 .

29 is a view for explaining a process of linking the reproduction of a captured image and a moving picture according to an embodiment of the present invention.

A touch input for the first thumbnail image 251 among the plurality of thumbnail images 251 , 253 , and 255 stored in the memory 170 of the mobile terminal 100 is received, and the pressure applied through the received touch input is When the pressure is greater than or equal to the reference pressure strength, the mobile terminal 100 may display the play icon 254 on one side of the first thumbnail image 251 . For example, the playback icon 254 may be displayed in a half area of the area occupied by the first thumbnail image 251 . The mobile terminal 100 may receive a request to select the play icon 254 and play the video from the playback time corresponding to the first thumbnail image 251 . The mobile terminal 100 may execute an application for playing a video to play a video corresponding to the first thumbnail image 251 in response to a request for selecting the play icon 254 .

The user can watch the video from the corresponding part by simply inputting a simple touch on the thumbnail images that he has captured.

The present invention described above can be implemented as computer-readable codes on a medium in which a program is recorded. The computer-readable medium includes all types of recording devices in which data readable by a computer system is stored. Examples of computer-readable media include Hard Disk Drive (HDD), Solid State Disk (SSD), Silicon Disk Drive (SDD), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. There is also a carrier wave (eg, transmission through the Internet) includes implementation in the form of. In addition, the computer may include the control unit 180 of the terminal. Accordingly, the above detailed description should not be construed as restrictive in all respects but as exemplary. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are included in the scope of the present invention.

Claims (20)

A method of operating a mobile terminal, comprising:
playing a video through a touch screen provided in the mobile terminal;
receiving a first touch input on the touch screen;
receiving a second touch input having a pressure intensity different from that of a pressure applied through the received first touch input; and
Controlling a skip speed and a skip direction of the video based on at least one of the received moving direction of the second touch input and the strength of the pressure of the second touch input,
The method of operation is
receiving a touch input for a point on the progress bar displayed on the touch screen;
displaying a thumbnail image corresponding to the one point according to the received touch input; and
When a third touch input equal to or greater than a reference pressure strength for selecting the thumbnail image is received, capturing the thumbnail image and simultaneously displaying a message indicating that the thumbnail image has been captured
A method of operating a mobile terminal. According to claim 1,
The intensity of the pressure of the second touch input is greater than the intensity of the pressure of the first touch input.
A method of operating a mobile terminal. 3. The method of claim 2,
The intensity of the pressure of the second touch input is greater than or equal to the reference pressure intensity;
Displaying an indicator indicating that pressure equal to or greater than the reference pressure intensity is applied according to the reception of the second touch input
A method of operating a mobile terminal. 4. The method of claim 3,
In response to the reception of the second touch input, further displaying a reproduction time pop-up window including a skip time point and a skip speed pop-up window corresponding to the intensity of pressure applied through the second touch input;
A method of operating a mobile terminal. According to claim 1,
The step of controlling the skip speed and skip direction of the video includes:
Controlling the skip speed based on the strength of the pressure of the second touch input and the total playback time of the video
A method of operating a mobile terminal. 6. The method of claim 5,
The step of controlling the skip speed based on the strength of the pressure of the second touch input and the total playing time of the video includes:
When the total playback time of the video is equal to or longer than a preset time, increasing the skip speed as the pressure of the second touch input increases
A method of operating a mobile terminal. delete According to claim 1,
receiving an input flicking the third touch input; and
Further comprising the step of displaying a video from a playback time corresponding to the selected thumbnail image through a floating window according to a flicking input,
The intensity of the pressure of the third touch input is equal to or greater than the reference pressure intensity.
A method of operating a mobile terminal. According to claim 1,
receiving two touch inputs having a reference pressure intensity or greater at one point and another point on the progress bar displayed on the touch screen, respectively; and
The method further comprising the step of entering an editing mode in which the video can be edited according to the received two touch inputs
A method of operating a mobile terminal. 10. The method of claim 9,
receiving an input flicking a point on the progress bar; and
The method further comprising editing a playback section from a playback time corresponding to the one point to a playback time corresponding to the other point according to a flicking input
A method of operating a mobile terminal. In a mobile terminal,
a touch screen that receives a touch input; and
A video is played through the touch screen, a first touch input is received, a second touch input having a pressure intensity different from that of a pressure applied through the received first touch input is received, and the received second touch input is received. 2 A control unit for controlling a skip speed and a skip direction of the video based on at least one of a movement direction of the second touch input and a pressure strength of the second touch input;
the control unit
receiving a touch input for a point on the progress bar displayed on the touch screen, and displaying a thumbnail image corresponding to the one point according to the received touch input;
When a third touch input equal to or greater than a reference pressure strength for selecting the thumbnail image is received, the thumbnail image is captured and a message indicating that the thumbnail image has been captured is displayed.
mobile terminal. 12. The method of claim 11,
The intensity of the pressure of the second touch input is greater than the intensity of the pressure of the first touch input.
mobile terminal. 13. The method of claim 12,
The intensity of the pressure of the second touch input is greater than or equal to the reference pressure intensity;
the control unit
controlling the touch screen to display an indicator indicating that a pressure equal to or greater than the reference pressure strength is applied according to the reception of the second touch input
mobile terminal. 14. The method of claim 13,
the control unit
Controlling the touch screen to further display a reproduction time pop-up window including a skip time point according to reception of the second touch input and a skip speed pop-up window corresponding to the intensity of pressure applied through the second touch input
mobile terminal. 12. The method of claim 11,
the control unit
controlling the skip speed based on the strength of the pressure of the second touch input and the total playing time of the video.
mobile terminal. 16. The method of claim 15,
the control unit
When the total playback time of the video is equal to or longer than a preset time, the skip speed is increased as the pressure of the second touch input increases.
mobile terminal. delete 12. The method of claim 11,
the control unit
receiving an input for flicking the third touch input, and controlling the touch screen to display a video from a playback time corresponding to the selected thumbnail image through a floating window according to the flicking input
mobile terminal. 12. The method of claim 11,
the control unit
Edit capable of receiving two touch inputs having a reference pressure intensity or higher at each of one point and another point on the progress bar displayed on the touch screen, and editing the video by using the mobile terminal according to the received two touch inputs to enter the mode
mobile terminal. 20. The method of claim 19,
the control unit
receiving an input for flicking a point on the progress bar, and editing a playback section from a playback time corresponding to the one point to a playback time corresponding to the other point according to the flicking input
mobile terminal.

Images