KR102100779B1 - Mobile terminal and control method thereof - Google Patents

Abstract

A mobile terminal and a control method thereof are disclosed. The mobile terminal of the present invention and a control method thereof include: a memory; A display displaying a video; And a controller configured to display the selected at least one object in a changed position from an initial position when the selection signal for at least one object included in the video is acquired, and to store the displayed at least one object in the memory. It is characterized by including. According to the present invention, the selected object can be separated from the original position and displayed at another position.

Description

Mobile terminal and its control method {MOBILE TERMINAL AND CONTROL METHOD THEREOF}

The present invention relates to a mobile terminal, and more particularly, to a mobile terminal capable of separating a selected object from its original location and displaying it at another location, and a control method thereof.

Terminals such as personal computers, laptops, mobile phones, etc. have various functions, such as taking pictures or videos, playing music or video files, playing games, and multimedia devices with multiple functions. It is implemented in the form of (Multimedia player).

Terminal is mobile Depending on whether it can be divided into a mobile terminal (mobile terminal) and a stationary terminal (stationary terminal). Again, the mobile terminal may be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry it.

In order to support and increase the function of the terminal, it is considered to improve the structural part and / or software part of the terminal.

The present invention relates to a mobile terminal capable of separating a selected object from its original location and displaying it at another location, and a control method thereof.

A mobile terminal according to an embodiment of the present invention for realizing the above-described problems includes a memory; A display displaying a video; And a controller configured to display the selected at least one object in a changed position from an initial position when the selection signal for at least one object included in the video is acquired, and to store the displayed at least one object in the memory. It can contain.

It further includes a camera, and the image may be an image acquired through the camera.

The video may be an image previously stored in the memory.

The selection signal may be a user's touch operation on at least one of the at least one object.

The touch operation may be at least one of a long touch on the at least one object and a drag touch along the contour of the at least one object.

When the selection signal for the at least one is obtained, the controller may display a region indicator including the selected at least one object.

The control unit may display an image of the selected at least one object copied.

The selection signal is a selection signal for a plurality of objects, and when the control unit acquires a selection signal for the plurality of objects, the change over time of the plurality of objects is separately displayed on the display. You can.

When the selected at least one object disappears from the display, the controller may stop displaying the change over time of the selected at least one object.

When the at least one object that has disappeared is displayed again on the display, the controller may re-display the change of the selected at least one object over time.

In addition, a control method of a mobile terminal according to an embodiment of the present invention for realizing the above-described problems, displaying a video including at least one object; Obtaining a selection signal for at least one of the at least one object; Displaying a change over time of the selected at least one object; And storing the displayed at least one object.

The method may further include photographing the image using a camera.

The selection signal may be a touch operation of at least one of a user's long touch on at least one of the at least one object and a drag touch along the outline of the at least one object.

When acquiring the selection signal for the at least one, the method may further include displaying an area indicator including the selected at least one object.

When the at least one selected object disappears, the method may further include stopping displaying of the change of the selected at least one object over time.

When the at least one object that has disappeared is displayed again, the step of displaying the change over time of the selected at least one object again may be further included.

The mobile terminal and the control method according to the present invention have an effect of separating the selected object from the original location and displaying it at another location.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention (block diagram).
2A is a front perspective view of a mobile terminal according to an embodiment of the present invention.
2B is a rear perspective view of a mobile terminal according to an embodiment of the present invention.
3 is a flowchart illustrating the operation of the mobile terminal of FIG. 1.
4 to 6 are views specifically illustrating the operation of the mobile terminal of FIG. 3.
7 is a diagram illustrating the display of an object over time in the mobile terminal of FIG. 3.
8 to 12 are views showing another operation process of the mobile terminal of FIG. 3.
13 is a diagram illustrating another example of selecting an object in the mobile terminal of FIG. 3.
14 is a diagram illustrating another example of displaying the selected object in the mobile terminal of FIG. 3.
15 is a diagram illustrating an example of using an object selected in the mobile terminal of FIG. 3.
16 is a diagram illustrating the structure of an object reproducible in the mobile terminal of FIG. 1.

The above-mentioned objects, features and advantages of the present invention will become more apparent through the following detailed description in conjunction with the accompanying drawings. However, the present invention can be modified in various ways and can have various embodiments. Hereinafter, specific embodiments will be illustrated in the drawings and described in detail. Throughout the specification, the same reference numbers refer to the same components in principle. In addition, when it is determined that a detailed description of a known function or configuration related to the present invention may unnecessarily obscure the subject matter of the present invention, the detailed description will be omitted. In addition, the numbers used in the description process of the present specification (for example, first, second, etc.) are only identification numbers for distinguishing one component from other components.

Hereinafter, a mobile terminal related to the present invention will be described in more detail with reference to the drawings. The suffixes "modules" and "parts" for the components used in the following description are given or mixed only considering the ease of writing the specification, and do not have meanings or roles distinguished from each other in themselves.

The mobile terminal described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, personal digital assistants (PDA), portable multimedia player (PMP), navigation, and the like. However, it will be readily appreciated by those skilled in the art that the configuration according to the embodiments described herein may also be applied to fixed terminals such as digital TVs and desktop computers, except when applicable only to mobile terminals.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention (block diagram).

The mobile terminal 100 includes a wireless communication unit 110, an audio / video (A / V) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory unit 160, An interface unit 170, a control unit 180, and a power supply unit 190 may be included. The components shown in FIG. 1 are not essential, so a mobile terminal with more or fewer components may be implemented.

Hereinafter, the components will be described in turn.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast reception module 111, a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114, and a location information module 115. .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits broadcast signals and / or broadcast-related information or a server that receives previously generated broadcast signals and / or broadcast-related information and transmits them to a terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, and may also include a TV broadcast signal or a radio broadcast signal combined with a data broadcast signal.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, it may exist in the form of an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or an Electronic Service Guide (ESG) of Digital Video BroadcastHandheld (DVBH).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems, in particular, Digital Multimedia Broadcasting Terrestrial (DMBT), Digital Multimedia Broadcasting Satellite (DMBS), Media Forward Link Only (FLOF), Digital Video BroadcastHandheld DVBH ), A digital broadcasting signal can be received using a digital broadcasting system such as ISDBT (Integrated Services Digital Broadcast Terrestrial). Of course, the broadcast receiving module 111 may be configured to be suitable for other broadcast systems that provide broadcast signals as well as the digital broadcast systems described above.

The broadcast signal and / or broadcast-related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives wireless signals to and from at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, or a text / multimedia message.

The wireless Internet module 113 refers to a module for wireless Internet access, and the wireless Internet module 113 may be built in or external to the mobile terminal 100. Wireless Internet technology (Wireless LAN) (WiFi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) may be used.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), and ZigBee may be used as short-range communication technology.

The location information module 115 is a module for confirming or obtaining the location of the mobile terminal. A representative example of the location information module is a Global Position System (GPS) module. According to the present technology, the GPS module 115 calculates information on a distance at which a point (object) is separated from three or more satellites, and information on a time when the distance information is measured, and then calculates the distance information. By applying the trigonometry to, it is possible to calculate three-dimensional position information according to latitude, longitude, and altitude for a point (object) at an hour. Furthermore, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another one satellite is also used. The GPS module 115 continuously calculates the current position in real time and uses it to calculate speed information.

Referring to FIG. 1, an audio / video (A / V) input unit 120 is for inputting an audio signal or a video signal, which may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by an image sensor in a video call mode or a shooting mode. The processed image frame may be displayed on the display unit 151.

The image frames processed by the camera 121 may be stored in the memory unit 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided according to a configuration aspect of the terminal.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, or a voice recognition mode, and processes it as electrical voice data. The processed voice data may be converted into a form transmittable to a mobile communication base station through the mobile communication module 112 and output. Various noise reduction algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 122.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may be configured with a key pad dome switch, a touch pad (static pressure / blackout), a jog wheel, a jog switch, or the like.

The sensing unit 140 detects the current state of the mobile terminal 100, such as the open / closed state of the mobile terminal 100, the location of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, and acceleration / deceleration of the mobile terminal. By generating a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, a sensing function related to whether the power supply unit 190 is supplied with power or whether the interface unit 170 is coupled with an external device may be in charge. Meanwhile, the sensing unit 140 may include a proximity sensor.

The output unit 150 is for generating output related to vision, hearing, or tactile sense, and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154. You can.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, a UI (User Interface) or a GUI (Graphic User Interface) related to the call is displayed. When the mobile terminal 100 is in a video call mode or a shooting mode, it displays a photographed or / and received video, UI, or GUI.

The display unit 151 is a liquid crystal display, a thin film transistor liquid crystal display, an organic light emitting diode, a flexible display, or a 3D display. It may include at least one.

Some of these displays may be of a transparent type or a light transmissive type so that the outside can be seen through them. This may be called a transparent display, and a typical example of the transparent display is a transparent LCD. The rear structure of the display unit 151 may also be configured as a light transmissive structure. With this structure, the user can see an object located behind the terminal body through an area occupied by the display unit 151 of the terminal body.

Two or more display units 151 may exist depending on the implementation form of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display units may be spaced apart or integrally disposed on one surface, or may be disposed on different surfaces.

When the display unit 151 and a sensor detecting a touch operation (hereinafter referred to as a “touch sensor”) form a mutual layer structure (hereinafter, abbreviated as “touch screen”), the display unit 151 is an output device. In addition, it can be used as an input device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, and the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the touched position and area, but also pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and then transmits corresponding data to the controller 180. Accordingly, the control unit 180 can know which area of the display unit 151 has been touched, and the like.

Referring to FIG. 1, a proximity sensor may be disposed in an inner region of a mobile terminal surrounded by the touch screen or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without mechanical contact using electromagnetic force or infrared rays. Proximity sensors have a longer lifespan and higher utilization than contact sensors.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor.

When the touch screen is capacitive, it is configured to detect the proximity of the pointer due to a change in electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of description, the act of causing the pointer to be recognized as being positioned on the touch screen without touching the pointer on the touch screen is referred to as “proximity touch”, and the touch The act of actually touching the pointer on the screen is referred to as "contact touch". The location on the touch screen that is a proximity touch with a pointer means a location where the pointer is perpendicular to the touch screen when the pointer is touched close.

The proximity sensor detects a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory unit 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, or the like. The sound output module 152 outputs sound signals related to functions (eg, call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. The sound output module 152 may include a receiver, a speaker, and a buzzer.

The alarm unit 153 outputs a signal for notifying the occurrence of an event in the mobile terminal 100. Examples of events generated in the mobile terminal include call signal reception, message reception, key signal input, and touch input. The alarm unit 153 may output a signal for notifying the occurrence of an event by other forms, for example, vibration, in addition to a video signal or an audio signal. The video signal or the audio signal may also be output through the display unit 151 or the audio output module 152.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the tactile effect generated by the haptic module 154 is vibration. The intensity and pattern of vibration generated by the haptic module 154 are controllable. For example, different vibrations may be synthesized and output or sequentially output.

In addition to vibration, the haptic module 154 can be applied to effects caused by stimulation by pin arrays that vertically move with respect to the contact skin surface, effects caused by stimulation through air or the inhalation force of air through a spray or inlet, and stimulation through a skin surface. Various tactile effects can be generated, such as an effect, an effect caused by stimulation through contact of an electrode, an effect caused by stimulation using electrostatic force, and an effect of reproducing a feeling of cold and warm using an element capable of absorbing heat or generating heat.

The haptic module 154 may not only transmit the tactile effect through direct contact, but may also implement the haptic effect through muscle sensation such as a user's finger or arm. Two or more haptic modules 154 may be provided according to a configuration aspect of the portable terminal 100.

The memory unit 160 may store a program for the operation of the controller 180, and may temporarily store input / output data (eg, a phone book, a message, a still image, a video, etc.). The memory unit 160 may store data related to various patterns of vibration and sound output when a touch is input on the touch screen.

The memory unit 160 includes a flash memory type, a hard disk type, a multimedia card micro type, and a card type memory (for example, SD or XD memory, etc.), At least one of Random Access Memory (RAM), Static Random Access Memory (SRAM), ReadOnly Memory (ROM), Electrically Erasable Programmable ReadOnly Memory (EEPROM), Programmable ReadOnly Memory (PROM) magnetic memory, magnetic disk, and optical disk It may include a storage medium of the type. The mobile terminal 100 may operate in connection with a web storage that performs a storage function of the memory unit 160 on the Internet.

The interface unit 170 serves as a passage with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or receives power and transmits it to each component inside the mobile terminal 100 or allows data inside the mobile terminal 100 to be transmitted to the external device. For example, wired / wireless headset port, external charger port, wired / wireless data port, memory card port, port for connecting devices equipped with an identification module, audio input / output (I / O) port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip that stores various information for authenticating the usage rights of the mobile terminal 100, a user identification module (UIM), a subscriber identification module (SIM), and a universal user authentication module ( Universal Subscriber Identity Module (USIM). The device provided with the identification module (hereinafter referred to as an 'identification device') may be manufactured in a smart card format. Therefore, the identification device may be connected to the terminal 100 through a port.

When the mobile terminal 100 is connected to an external cradle, the interface unit becomes a passage through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user from the cradle are moved. It can be a passage to the terminal. Various command signals or power inputted from the cradle may be operated as signals for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, it performs related control and processing for voice calls, data communication, video calls, and the like. The controller 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the controller 180, or may be implemented separately from the controller 180.

The controller 180 may perform pattern recognition processing capable of recognizing handwriting input or picture drawing input performed on the touch screen as text and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power required for the operation of each component.

The various embodiments described herein can be implemented in a computer- or similar device-readable recording medium using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), It may be implemented using at least one of processors, controllers, microcontrollers, microprocessors, and electrical units for performing functions. 180).

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code can be implemented by software applications written in the appropriate programming language. In addition, the software code may be stored in the memory unit 160 and executed by the control unit 180.

2A is a perspective view of an example of a mobile terminal or a mobile terminal related to the present invention as viewed from the front.

The disclosed portable terminal 100 has a bar-shaped terminal body. However, the present invention is not limited to this, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are movably coupled.

The body includes a case (casing, housing, cover, etc.) forming an exterior. In this embodiment, the case may be divided into a front case 101 and a rear case 102. Various electronic components are embedded in a space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102.

The cases may be formed by injecting synthetic resin or may be formed to have a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

A display unit 151, an audio output unit 152, a camera 121, a user input unit 130 / 131,132, a microphone 122, an interface 170, etc. may be disposed on the terminal body, mainly the front case 101. have.

The display unit 151 occupies most of the main surface of the front case 101. An acoustic output unit 152 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151, and a user input unit 131 and a microphone 122 are arranged in an area adjacent to the other end. The user input unit 132 and the interface 170 are disposed on side surfaces of the front case 101 and the rear case 102.

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100, and may include a plurality of operation units 131 and 132.

The operation units 131 and 132 may also be collectively referred to as a manipulating portion, and any method may be employed as long as the user operates with a tactile feeling.

Contents input by the operation units 131 and 132 may be variously set. For example, the first operation unit 131 receives a command such as start, end, scroll, and the like, and the second operation unit 132 adjusts the volume of sound output from the sound output unit 152 or the display unit 151 ) To a touch recognition mode.

2B is a rear perspective view of the portable terminal shown in FIG. 2A.

Referring to FIG. 2B, a camera 121 ′ may be additionally mounted on the rear side of the terminal body, that is, the rear case 102. The camera 121 ′ has a photographing direction substantially opposite to the camera 121 (see FIG. 2A), and may be a camera having different pixels from the camera 121.

For example, in the case of a video call, the camera 121 has a low pixel so that the user's face is captured and transmitted to the other party, and the camera 121 'may not shoot the general subject and send it immediately. It is desirable to have high pixels in many cases. The cameras 121 and 121 'may be installed on the terminal body to be rotated or popped up.

A flash 123 and a mirror 124 are additionally disposed adjacent to the camera 121 '. When the flash 123 photographs the subject with the camera 121 ', light is directed toward the subject. The mirror 124 allows the user to see his or her face, etc., when the user wants to take a picture (self-portrait) using the camera 121 '.

A sound output unit 152 'may be additionally disposed on the rear side of the terminal body. The audio output unit 152 'may implement a stereo function together with the audio output unit 152 (see FIG. 2A), or may be used to implement a speakerphone mode during a call.

On the side of the terminal body, an antenna 124 for receiving a broadcast signal may be additionally disposed in addition to an antenna for a call. The antenna 124 forming part of the broadcast receiving module 111 (refer to FIG. 1) may be installed so as to be pulled out from the terminal body.

The terminal body is equipped with a power supply unit 190 for supplying power to the portable terminal 100. The power supply unit 190 may be built in the terminal body or may be detachable directly from the outside of the terminal body.

A touch pad 135 for sensing a touch may be additionally mounted on the rear case 102. The touch pad 135 may also be configured as a light transmitting type like the display unit 151. In this case, if the display unit 151 is configured to output visual information on both sides, it is possible to recognize the visual information through the touch pad 135 as well. Information output on both sides may be controlled by the touch pad 135. Unlike this, a display may be additionally mounted on the touch pad 135, and the touch screen may be disposed on the rear case 102.

The touch pad 135 operates in relation to the display unit 151 of the front case 101. The touch pad 135 may be disposed parallel to the rear of the display unit 151. The touch pad 135 may have the same or smaller size than the display unit 151.

3 is a flowchart illustrating the operation of the mobile terminal of FIG. 1.

As shown in this, the controller 180 of the mobile terminal 100 according to an embodiment of the present invention may perform a step (S10) of displaying an image.

The image may be at least one of an image captured through the camera 121 of the mobile terminal 100, an image captured through the camera 121, and an image acquired from another device. For example, it means that it may be a video filmed through the camera 121. Alternatively, it may be a video stored in the memory 160. In other words, it means that it may be video content obtained and stored from other mobile terminals and / or servers.

Step S20 of obtaining a selection signal for a specific object included in the image may be performed.

At least one object may be included in the image. Objects can vary. For example, it may be an image of another person or an image of a specific object. The object included in the image may change at least one of shape, color, and position according to the passage of time. For example, it means that the image is a video image, and that the video image may include a moving person.

A selection signal for a specific object included in an image may be acquired. For example, it means that a selection signal for an image of a specific person can be obtained. As will be described in detail in a corresponding part, the selection signal for a specific object may be a touch operation of long-touching the object or dragging it along the periphery of the object.

Step S30 of displaying a specific object separately from other objects may be performed.

When a selection signal for a specific object is obtained, the controller 180 can recognize the object separately from other objects. For example, when an image of a plurality of people is included and a specific person is selected, it means that an image of the selected specific person can be displayed separately from other people. The separated display may mean, for example, a case in which the selected object is moved and displayed from the first location to another location.

Step S40 of storing data of a specific object may be performed.

The controller 180 may store the selected specific object in the memory 160. For example, when an image is a video image, it means that image data corresponding to a selected person among a plurality of people included in the video image can be stored. The storage of the data of a specific object may be performed separately from the storage of the image in which the object was included.

4 to 6 are views specifically illustrating the operation of the mobile terminal of FIG. 3.

As shown in these drawings, the controller 180 of the mobile terminal 100 according to an embodiment of the present invention may display a specific object included in an image separately from an initial position.

As illustrated in FIGS. 4A and 4B, an image including a plurality of objects OB may be displayed on the display 151. For example, it means that images of multiple people can be displayed. The plurality of objects OB may include first to third objects OB1 to OB3.

The image displayed on the display 151 may be a video image. That is, it means that at least one of the shape, color, and position of the object OB may be an image that changes over time.

As shown in Fig. 5A, the user can select a specific object OB with a finger F or the like. The selection of the object OB may be performed by a long touch on the specific object OB. For example, it means that the first object OB1 may be selected by long-touching the first object OB1 which is a specific person among a plurality of people.

As illustrated in (b) of FIG. 5, when it is recognized that the first object OB1 is selected, the controller 180 may display the area indicator SA including the recognized object. For example, it means that a rectangular area indicator SA including the selected first object OB1 may be displayed.

The controller 180 can display the area except for the selected object OB to be blurred. For example, it means that the area outside the area indicator SA can be shaded, unlike the area inside the area indicator SA. When the shades of the inside and outside of the area indicator SA are changed, the mobile terminal 100 can more clearly recognize the selected object OB.

The user who selects the first object OB1 may select a location to move the first object OB1 through a drag touch operation. For example, it means that a touch operation of dragging to the right while the first object OB1 is selected is performed.

6A, in response to a user's touch operation, the controller 180 can display the first object OB1 separately from the initial position. For example, it means that the copy image SOB of the first object OB1 can be displayed on the display 151.

The copy image SOB may be displayed in the same manner as the selected object OB when the video, which is an image, is played. For example, when the image is played, the copy image SOB is also played, and the image is played. If this is interrupted, the copy image (SOB) also means that playback may be stopped in that state.

As illustrated in FIG. 6B, the controller 180 can display a menu SA that can perform a specific function for the copy image SOB. For example, it means that a menu to store a copy image (SOB), adjust the size, adjust the orientation, or adjust the resolution can be displayed.

7 is a diagram illustrating the display of an object over time in the mobile terminal of FIG. 3.

As shown in this, the mobile terminal 100 according to an embodiment of the present invention can select a specific time range of the displayed object OB and store the operation of the object OB within the selected time range. have.

At least one of the shape, color, and position of the object OB may change according to passage of time. For example, it means that the shape of the object OB may be changed at time t1 and time t2.

The user can set the time range ST. For example, a time range ST may be set from a time point t2 to a time point t5. At the time t2, the user may touch the object OB. That is, it means that the separated display for the touched object OB can be made from the time t2. At time t5, the user may perform an operation such as touching the object OB again, that is, the separation display of the touched object OB may end at time t5.

8 to 12 are views showing another operation process of the mobile terminal of FIG. 3.

As shown in these drawings, the controller 180 of the mobile terminal 100 according to an embodiment of the present invention may display the selected object OB at a changed position.

As illustrated in FIGS. 8A and 8B, a specific image may be displayed on the display 151. The displayed image may be an image being captured through the camera 121 of the mobile terminal 100. The image may include a plurality of objects OB. The video may be a video. That is, it means that the position of the object OB may change according to the passage of time.

As shown in Fig. 9A, the user can select the third object OB3, which is a specific object OB, with a finger F or the like.

As illustrated in FIG. 9B, when the third object OB3 is selected, the controller 180 may display the first copy image SOB1 corresponding to the selected third object OB3. For example, it means that the face image of the selected person can be displayed separately. The first copy image SOB1 may reflect the continuously changing third object OB3.

As shown in Fig. 10A, the user can select the first object OB1 with a finger F or the like.

As illustrated in FIG. 10B, the controller 180 can display a second copy image SOB2 reflecting the selected first object OB1. The second copy image SOB2 may be displayed together with the first copy image SOB1. That is, it means that the controller 180 can receive a plurality of objects OB and simultaneously display a plurality of copy images SOB1 and SOB2.

As illustrated in (a) of FIG. 11, first and second copy images SOB1 and SOB2 may be displayed on the display 151.

11B, the first and third objects OB1 and OB3 may disappear from the display 151. For example, it means that a person corresponding to the first and third objects OB1 and OB3 may be out of the shooting range of the camera 121. When the first and third objects OB1 and OB3 disappear, the controller 180 may make the corresponding first and second copy images SOB1 and SOB2 disappear. For example, the area where the first and second copy images SOB1 and SOB2 existed may be left as it is, or the area where the first and second copy images SOB1 and SOB2 existed may be disappeared.

As illustrated in FIG. 12A, the first object OB1 may appear again on the display 141. For example, it means that a person corresponding to the first object OB1 may re-enter the photographing area of the camera 121. When the first object OB1 is displayed again, the controller 180 can display the second copy image SOB2 corresponding to the first object OB1 again.

As illustrated in FIG. 12B, the third object OB3 may be displayed again. When the third object O3 is displayed again, the controller 180 may display the first copy image SOB1 corresponding thereto again. That is, when the same shape as the previously selected object OB is photographed, it means that the controller 180 can select and display the object OB even if there is no repetitive selection operation of the user.

13 is a diagram illustrating another example of selecting an object in the mobile terminal of FIG. 3.

As illustrated, the controller 180 of the mobile terminal 100 according to an embodiment of the present invention may select a specific object OB in response to various touch operations of the user.

As illustrated in FIG. 13A, the user may touch a specific object OB with a finger F or the like. The touch at this time may be a long touch on a specific object OB. When a specific object OB is selected, the controller 180 can display the indicator OL along the outline of the selected object OB. When the indicator OL is displayed, the user can more clearly recognize the object OB selected by the user.

As illustrated in FIG. 13B, the user can drag and touch the outline of a specific object OB with a finger F or the like. The controller 180 may select an object OB included in the drag touched area.

14 is a diagram illustrating another example of displaying the selected object in the mobile terminal of FIG. 3.

As illustrated, the controller 180 of the mobile terminal 100 according to an embodiment of the present invention may display the selected object OB as a continuous still image FT. For example, it means that the shape of the object OB, which changes over time, can be displayed on the display 151 in the form of overlapping parts of the image.

15 is a diagram illustrating an example of using objects selected in the mobile terminal of FIG. 3.

As illustrated, the controller 180 of the mobile terminal 100 according to an embodiment of the present invention can use an image of the selected object OB for various applications.

The selected object OB may be represented as first to n images F1 to Fn according to the passage of time. For example, if a person is a smiling video, it means that it may be a facial expression image over time.

The representative image F may be selected from the first to n images F1 to Fn by the control operation of the controller 180 or the user's selection.

The controller 180 can use the representative image F for various applications. For example, the representative image F may be stored in the memory 160 so that the user can use it for viewing or the like. Alternatively, the representative image F may be transmitted to another device or the like. Alternatively, the representative image F can be added to the person's contact information.

16 is a diagram illustrating the structure of an object reproducible in the mobile terminal of FIG. 1.

As illustrated, the controller 180 of the mobile terminal 100 according to an embodiment of the present invention may display an image based on a data frame structure of a displayed image.

The video V may include a plurality of frames. The plurality of frames may include an I frame, a P frame, and a B frame.

The I frame can be a self-contained frame that can be independently decoded without reference to other images. The first image of a video can always be an I frame. Also, the starting point of the viewer or the starting point of resynchronization may be an I frame. That is, it means that random access to a specific point of the video V may be possible using an I frame.

The P frame may be a prediction frame. The P frame may refer to portions of the previous I frame and / or P frame. The P frame has a small capacity, but may be susceptible to transmission errors due to the complex dependency on other I frames and / or P frames.

The B frame can refer to both previous and subsequent frames.

The controller 180 may use an I frame when displaying an image at another point or extracting an image. Also, the I frame may be used when the controller 180 displays a continuous still image (FT in FIG. 14).

The present invention is not limited to the described embodiments, and it is obvious to those skilled in the art that various modifications and variations can be made without departing from the spirit and scope of the present invention. Therefore, it should be said that such modifications or variations belong to the claims of the present invention.

100: mobile terminal 110: wireless communication unit
140: sensing unit 151: display unit
180: control unit

Claims (16)

Memory;
A display displaying a video within a camera shooting range; And
When a selection signal for at least one object included in the video is acquired, a copy image of the object is displayed in a region separate from the object, and when the object is out of the shooting range, the copy image is skipped And a control unit that displays both the object and the copy image based on the object being re-entered within the shooting range, and stores the operation of the object included in the video in the memory. According to claim 1,
More cameras,
The video above,
A mobile terminal characterized in that it is an image photographed through the camera. delete According to claim 1,
The selection signal,
And a user's touch operation on at least one of the at least one object. According to claim 4,
The touch operation,
And at least one of a long touch on the at least one object and a drag touch along the contour of the at least one object. According to claim 1,
The control unit,
And when a selection signal for the at least one is obtained, a region indicator including the at least one selected object is displayed. delete According to claim 1,
The selection signal is a selection signal for a plurality of objects,
The control unit,
When the selection signals for the plurality of objects are acquired,
A mobile terminal, characterized in that the change over time of the plurality of objects is displayed separately on the display. delete delete delete delete delete delete delete delete

Images