KR102295170B1 - Display apparatus for operating multimedia content and operation method thereof - Google Patents

Abstract

A method and apparatus for manipulating multimedia content through a user interface (UI) that allow a user to easily manipulate multimedia content are provided. A multimedia content manipulation method according to an embodiment of the present invention includes detecting a pinch-in gesture or a pinch-out gesture through the touch screen, and the plurality of touches. detecting a moving gesture with respect to input coordinates and manipulating the output of the multimedia content according to the moving direction and the distance.

Description

A display device for manipulating multimedia content and a method for manipulating the same

The present invention relates to a display device for manipulating multimedia content and a method for manipulating the same. More particularly, it relates to a method of manipulating multimedia content according to a user's input by a display device that provides multimedia content to a user.

As portable terminals such as smartphones and tablet PCs are widely used, display devices having a touch screen have been widely used. A touch screen is an input/output device capable of detecting a touch of a user's body or the like while outputting a screen by including a touch panel together with a display panel.

The technical problem to be solved by the present invention is to provide a user interface (UI) that allows a user to easily manipulate multimedia content.

The technical problems of the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the following description.

In order to solve the above technical problem, a multimedia content manipulation method according to an embodiment of the present invention includes the steps of outputting the multimedia content, and a pinch-in gesture ( detecting a pinch-in gesture or a pinch-out gesture, and in response to the pinch-in gesture or the pinch-out gesture, Displaying a first object on the touch screen, detecting a moving gesture with respect to the plurality of touch input coordinates, and displaying the first object according to the moving direction and distance of the moving gesture It may include moving the location and manipulating the output of the multimedia content according to the moving direction and the distance.

Also, according to another embodiment, the multimedia content may include map information, and the manipulating the output may include changing a scale at which the map information is output.

Also, according to another embodiment, the multimedia content may include an image or a moving picture, and the step of manipulating the output may include changing an output option set to output the image or moving picture.

Also, according to another embodiment, the multimedia content may include text, and the step of manipulating the output may include changing a font size of the text.

In addition, according to another embodiment, the step of outputting the multimedia content includes the step of playing a video or sound, and the step of manipulating the output is characterized in that the playback position of the video or the sound is changed. can

In addition, according to another embodiment, the displaying of the first object includes a search bar displayed within a moving range of the first object and a second operation value located at one side of the search bar. It may be characterized in that the object is further displayed.

According to another embodiment, the detecting of the movement gesture may include calculating a movement gesture vector from vectors indicating the distance and direction moved by each of the plurality of touch input coordinates; Separating the movement direction component and the normal direction component for the first object from the vector, and when the ratio of the movement direction component to the size of the normal direction component is equal to or greater than a threshold value, the moving and the manipulating are executed may include the step of

In addition, according to another embodiment, the method for manipulating multimedia content includes, when the movement gesture is detected, calculating a distance between the touch input coordinates and determining a manipulation amount based on the calculated distance. Further comprising, the manipulating step may be characterized in that the manipulation of the output of the multimedia content based on the determined manipulation amount.

In order to solve the above technical problem, a display device according to an embodiment of the present invention includes a processor, a memory for storing a plurality of operations executed by the processor, and a touch screen for outputting a screen and detecting a touch input However, the plurality of operations include an operation of outputting multimedia content and a pinch-in gesture or a pinch-out gesture from a plurality of touch input coordinates detected through the touch screen. an operation of detecting , and an operation of displaying a first object on the screen in response to the pinch-in gesture or the pinch-out gesture; An operation of detecting a moving gesture with respect to input coordinates, an operation of moving a position where the first object is displayed according to the moving direction and distance of the moving gesture, and the multimedia content according to the moving direction and the distance It can include operations that manipulate the output of .

In addition, the display apparatus according to another embodiment may further include a camera, wherein the multimedia content is a preview image signal obtained through the camera, and the operation of manipulating the output may include an operation of controlling the camera. can

A computer program recorded in a non-transitory computer-readable medium according to an embodiment of the present invention for solving the technical problem, when the instructions of the computer program are executed by a processor of a server, Outputting multimedia content including a screen, detecting a pinch-in gesture or a pinch-out gesture from a plurality of touch input coordinates, the pinch-in In response to a gesture (Pinch-in Gesture) or the pinch-out gesture (Pinch-out Gesture), displaying a first object on the screen, and a moving gesture with respect to the plurality of touch input coordinates (Moving Gesture) An operation comprising the steps of: detecting, moving a position where the first object is displayed according to the moving direction and distance of the moving gesture, and manipulating the output of the multimedia content according to the moving direction and the distance This may be characterized in that it is performed.

1 is a diagram illustrating a structure of a display device according to an exemplary embodiment.
2 is a diagram illustrating an example for explaining a pinch-in gesture and a pinch-out gesture.
3 is a diagram illustrating a process in which a display apparatus manipulates multimedia content according to an embodiment.
4 is a diagram illustrating a first object and a second object displayed according to an exemplary embodiment.
5 is a diagram illustrating a concept for explaining a moving gesture according to an embodiment.
6 is a diagram illustrating an example of manipulating the output of map information according to an embodiment.
7 is a diagram illustrating an example of manipulating an output of an image according to an embodiment.
8 is a diagram illustrating an example of manipulating a font of text according to an embodiment.
9 is a diagram illustrating a process for detecting a movement gesture according to an embodiment.
10 is a diagram illustrating a concept for explaining a method of determining whether a touch input is a movement gesture, according to an embodiment.
11 is a diagram illustrating a process in which a display apparatus manipulates an output of multimedia content according to a manipulation amount, according to an exemplary embodiment.
12 is a diagram for describing an example in which a display device moves a position where a first object is displayed according to a manipulation amount, according to an exemplary embodiment.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Advantages and features of the present invention, and a method for achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments published below, but may be implemented in various different forms, only these embodiments make the publication of the present invention complete, and common knowledge in the technical field to which the present invention pertains It is provided to fully inform the possessor of the scope of the invention, and the present invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout.

Unless otherwise defined, all terms (including technical and scientific terms) used herein may be used with the meaning commonly understood by those of ordinary skill in the art to which the present invention belongs. In addition, terms defined in a commonly used dictionary are not to be interpreted ideally or excessively unless clearly defined in particular. The terminology used herein is for the purpose of describing the embodiments and is not intended to limit the present invention. As used herein, the singular also includes the plural unless specifically stated otherwise in the phrase.

In this specification, the term "touch or touch input" may include not only a case of direct contact, but also a case where the display device detects the body of a user who is close to the display device (eg, within 2 cm). .

Hereinafter, some embodiments of the present invention will be described with reference to the drawings.

1 is a diagram illustrating a structure of a display device according to an exemplary embodiment. 1 is only a display device according to an exemplary embodiment, and the display device according to the present invention may include fewer or more components than those illustrated in FIG. 1 .

The display device 100 may be connected to an external device (not shown) using the mobile communication module 120 , the sub communication module 130 , and the connector 165 . The external device may include at least one of another device (not shown), a mobile phone (not shown), a smart phone (not shown), a tablet PC (not shown), and a server (not shown).

Referring to FIG. 1 , the display apparatus 100 includes a touch screen 190 and a touch screen controller 195 . In addition, the display device 100 includes a control unit 110 , a mobile communication module 120 , a sub communication module 130 , a multimedia module 140 , a camera module 150 , a GPS module 155 , an input/output module ( 160 ), a sensor module 170 , a storage unit 175 , and a power supply unit 180 . The sub communication module 130 includes at least one of a wireless LAN module 131 and a short-range communication module 132, and the multimedia module 140 includes a broadcast communication module 141, an audio playback module 142, and a video playback module. It may include at least one of (143). The camera module 150 includes at least one of a first camera 151 and a second camera 152 , and the input/output module 160 includes a button 161 , a microphone 162 , a speaker 163 , and vibration. It may include at least one of a motor 164 , a connector 165 , and a keypad 166 .

The control unit 110 stores signals or data input from the outside of the CPU 111 , the ROM 112 in which a control program for controlling the display apparatus 100 is stored, and the display apparatus 100 , or the display apparatus 100 . It may include a RAM 113 that is a memory used as a storage area for a work performed in the . The CPU 111 may include a plurality of processors such as single core, dual core, triple core, or quad core. The CPU 111 , the ROM 112 , and the RAM 113 may be interconnected through an internal bus BUS.

The control unit 110 includes a mobile communication module 120 , a sub communication module 130 , a multimedia module 140 , a camera module 150 , a GPS module 155 , an input/output module 160 , a sensor module 170 , and storage. The unit 175 , the power supply unit 180 , the touch screen 190 , and the touch screen controller 195 can be controlled.

The mobile communication module 120 may allow the display device 100 to be connected to an external device through mobile communication using at least one (one or a plurality of) antennas (not shown) under the control of the controller 110 . . The mobile communication module 120 communicates with a mobile phone (not shown), a smart phone (not shown), a tablet PC (not shown) or another device (not shown) having a phone number input to the display device 100 and It can transmit/receive a wireless signal for transmitting a voice call, a video call, a text message (SMS) or a multimedia message (MMS).

The sub communication module 130 may include at least one of a wireless LAN module 131 and a short-range communication module 132 . For example, only the wireless LAN module 131 may be included, only the short-range communication module 132 may be included, or both the wireless LAN module 131 and the short-range communication module 132 may be included.

The wireless LAN module 131 may connect to the Internet at a location where a wireless access point (AP) (not shown) is installed under the control of the controller 110 . The wireless LAN module 131 may support the IEEE802.11x wireless LAN standard of the American Institute of Electrical and Electronics Engineers (IEEE). The short-range communication module 132 may perform wireless short-distance communication between the display apparatus 100 and an image forming apparatus (not shown) under the control of the controller 110 . The short-distance communication method may include Bluetooth, infrared data association (IrDA), Zig-bee, and the like.

The display apparatus 100 may include at least one of a mobile communication module 120 , a wireless LAN module 131 , and a short-range communication module 132 according to performance.

The multimedia module 140 may include a broadcast communication module 141 , an audio playback module 142 , or a video playback module 143 . The broadcast communication module 141 includes a broadcast signal (eg, a TV broadcast signal, a radio broadcast signal, or a data broadcast signal) transmitted from a broadcast station through a broadcast communication antenna (not shown) under the control of the controller 110 and broadcast Additional information (eg, an electric program guide (EPG) or an electric service guide (ESG)) may be received. The audio reproduction module 142 may reproduce a stored or received digital audio file under the control of the controller 110 . The video playback module 143 may play a stored or received digital video file under the control of the controller 110 . The video reproduction module 143 may reproduce a digital audio file.

The multimedia module 140 may include an audio playback module 142 and a video playback module 143 excluding the broadcast communication module 141 . In addition, the audio reproduction module 142 or the video reproduction module 143 of the multimedia module 140 may be included in the controller 100 .

The camera module 150 may include at least one of a first camera 151 and a second camera 152 for capturing still images or moving images under the control of the controller 110 . Also, the first camera 151 or the second camera 152 may include an auxiliary light source (not shown) that provides an amount of light required for photographing. The first camera 151 may be disposed on the front side of the display device 100 , and the second camera 152 may be disposed on the back side of the display device 100 . Alternatively, the first camera 151 and the second camera 152 may be disposed adjacent to each other (eg, with an interval greater than 1 cm and less than 8 cm) to capture a 3D still image or a 3D video.

The GPS module 155 receives radio waves from a plurality of GPS satellites (not shown) on Earth's orbit, and uses a time of arrival from the GPS satellites (not shown) to the display device 100 . Thus, the position of the display apparatus 100 may be calculated.

The input/output module 160 may include at least one of a plurality of buttons 161 , a microphone 162 , a speaker 163 , a vibration motor 164 , a connector 165 , and a keypad 166 .

The button 161 may be formed on the front, side, or rear of the housing of the display device 100 , and includes a power/lock button (not shown), a volume button (not shown), a menu button, a home button, and a return button. It may include at least one of a back button and a search button 161 .

The microphone 162 may generate an electrical signal by receiving a voice or sound under the control of the controller 110 .

The speaker 163 displays sounds corresponding to various signals of the mobile communication module 120 , the sub communication module 130 , the multimedia module 140 , or the camera module 150 according to the control of the controller 110 , to the display apparatus 100 . ) can be output externally. The speaker 163 may output a sound corresponding to a function performed by the display apparatus 100 . One or a plurality of speakers 163 may be formed at an appropriate location or locations of the housing of the display device 100 .

The vibration motor 164 may convert an electrical signal into mechanical vibration under the control of the controller 110 . For example, the display device 100 in the vibration mode may operate the vibration motor 164 when a voice call is received from another device (not shown). The vibration motor 164 may operate in response to a user's touch operation making contact on the touch screen 190 and a continuous movement of a touch input on the touch screen 190 .

The connector 165 may be used as an interface for connecting the display device 100 and an external device (not shown) or a power source (not shown). Data stored in the storage unit 175 of the display apparatus 100 is transmitted to an external device (not shown) or an external device (not shown) through a wired cable connected to the connector 165 under the control of the controller 110 . data can be received from Power may be input from a power source (not shown) through a wired cable connected to the connector 165 or a battery (not shown) may be charged.

The keypad 166 may receive a key input from a user to control the display apparatus 100 . The keypad 166 includes a physical keypad (not shown) formed on the display device 100 or a virtual keypad (not shown) displayed on the touch screen 190 . A physical cap (not shown) formed in the display apparatus 100 may be excluded depending on the performance or structure of the display apparatus 100 .

The sensor module 170 includes at least one sensor that detects the state of the display apparatus 100 . For example, the sensor module 170 may include a proximity sensor for detecting whether the user approaches the display device 100 , an illuminance sensor (not shown) for detecting the amount of light around the display device 100 , or a display device. It may include a motion sensor (not shown) that detects the operation (eg, rotation of the display apparatus 100 , acceleration or vibration applied to the display apparatus 100 ). The sensor of the sensor module 170 may be added or deleted according to the performance of the display apparatus 100 .

The storage unit 175 includes a mobile communication module 120 , a sub communication module 130 , a multimedia module 140 , a camera module 150 , a GPS module 155 , and an input/output module according to the control of the controller 110 . It is possible to store signals or data input/output corresponding to the operations of 160 , the sensor module 170 , and the touch screen 190 . The storage unit 175 may store control programs and applications for controlling the display apparatus 100 or the controller 110 .

The term “storage unit” may include a storage unit 175 , a ROM 112 in the control unit 110 , a RAM 113 , or a memory card (not shown) mounted in the display apparatus 100 . The storage unit may include a non-volatile memory, a volatile memory, a hard disk drive (HDD), or a solid state drive (SSD).

The power supply unit 180 may supply power to at least one battery (not shown) disposed in the housing of the display apparatus 100 under the control of the control unit 110 . Also, the power supply unit 180 may supply power input from an external power source (not shown) to each unit of the display apparatus 100 through a wired cable connected to the connector 165 .

The touch screen 190 may output a user interface corresponding to various services to the user. The touch screen 190 may transmit an analog signal corresponding to at least one touch input to the user interface to the touch screen controller 195 . The touch screen 190 may receive at least one touch input through a user's body (eg, a finger) or a touchable input means (eg, a stylus pen). Also, the touch screen 190 may receive continuous movement of at least one touch input. The touch screen 190 may transmit an analog signal corresponding to the continuous movement of the touch input to the touch screen controller 195 .

In the present invention, the touch input is not limited to input through contact between the touch screen 190 and the user's body or a touchable input means, and a non-contact input (eg, the distance between the touch screen 190 and the body) is not limited. 1 mm or less). The detectable interval on the touch screen 190 may be changed according to the performance or structure of the display apparatus 100 .

The touch screen 190 may be implemented by, for example, a resistive method, a capacitive method, an infrared method, or an ultrasonic wave method.

The touch screen controller 195 may convert an analog signal received from the touch screen 190 into a digital signal (eg, X coordinate and Y coordinate) and transmit it to the controller 110 . The controller 110 may control the touch screen 190 using a digital signal received from the touch screen controller 195 . For example, the controller 110 may select an application execution icon (not shown) displayed on the touch screen 190 in response to a touch input or may execute an application. The touch screen controller 195 may be included in the touch screen 190 or the controller 110 .

2 is a diagram illustrating an example for explaining a pinch-in gesture and a pinch-out gesture. In particular, FIG. 2A is a diagram for explaining a pinch-in chester. The display apparatus 100 may obtain touch input coordinates for a plurality of locations 211 and 212 where a touch input is detected on the touch screen 190 . Here, in a state where the touch input to the plurality of locations 211 and 212 is maintained, the touch input coordinates of the locations where the touch input is sensed may be moved in opposite directions 221 and 222 to each other. Here, the opposite direction does not mean that the direction is exactly opposite to each other, but includes movement of the touch input coordinates in a direction away from each other. When the touch input coordinates of positions where the touch input is sensed move in opposite directions 221 and 222 , the display apparatus 100 may determine that a pinch-in gesture is input.

Also, FIG. 2B is a diagram for explaining a pinch-out gesture. Contrary to the panchi-in gesture, when the touch input coordinates of the plurality of locations 213 and 214 where the touch input is detected on the touch screen 190 move in the opposite directions 223 and 224, the display device ( 100) may determine that a pinch-out gesture is input. Here, the facing direction does not mean only the directions exactly facing each other, but includes moving in a direction in which the touch input coordinates become closer to each other.

3 is a diagram illustrating a process in which the display apparatus 100 manipulates multimedia content according to an exemplary embodiment.

First, the display apparatus 100 may output multimedia content (S310). In this specification, multimedia content means information including at least one of an image (including a still image), a moving picture, a sound, text, and a diagram.

Thereafter, the display apparatus 100 may monitor a touch input detected through the touch screen 190 ( S320 ). As a result of monitoring the touch input, the display apparatus 100 may determine whether the detected touch input is a pinch-in gesture or a pinch-out gesture ( S330 ). When the detected touch input is not a pinch-in gesture or a pinch-out gesture, the display apparatus 100 may continuously monitor the touch input by performing step S320 again.

When the detected touch input is a pinch-in gesture or a pinch-out gesture, the display apparatus 100 may display the first object (S340). Here, the first object may be a user interface (UI) object displayed on the touch screen 190 of the display apparatus 100 . For example, the first object may be an icon, a figure, or an image constituting a graphical user interface (GUI). According to an embodiment, the display apparatus 100 may display the first object by overlapping the screen displayed on the touch screen 190 in S340 before step S340 is performed.

Also, according to another exemplary embodiment, the display apparatus 100 may further display the second object. Here, the second object may be displayed in an area in which the first object can move. The first object may move along the area in which the second object is displayed.

Here, referring to FIG. 4 , a second object including a first object 420 and a search bar 430 displayed on the touch screen 190 of the display apparatus 100 is illustrated according to an exemplary embodiment. has been However, the shapes of the first object 320 and the second object shown in FIG. 2 are only for describing an embodiment, and the present invention is not limited thereto.

When it is determined that the touch input sensed at the plurality of positions 411 and 412 is a pitch-in gesture or a pitch-out gesture, the display apparatus 100 may display the first object 420 and the second object. have. The position where the first object 420 is displayed may be moved in a predetermined direction 440 along the area where the search bar 430 is displayed. Here, the predetermined direction 440 is illustrated in a vertical direction with respect to the touch screen 190 , but is not limited thereto.

Also, according to another exemplary embodiment, the second object may further include a manipulation value displayed in the area 435 of one side of the search bar 430 . The manipulation value means a value at which multimedia content is manipulated. For example, when the multimedia content is a map, the manipulation value may include a scale for outputting map information. For another example, when the multimedia content is an image or a video, the manipulation value may include a scale for outputting the image or video. However, it is not limited thereto, and the manipulated value is any value that can be manipulated for the output content, such as contrast, color, and output mode (eg, movie mode, news mode, sport mode, black and white mode, etc.) can also be changed to

According to an embodiment, when the touch input is terminated because the object that has been in contact with the touch screen 190 falls, the display apparatus 100 displays the first object and the second object immediately or after a predetermined time has elapsed. can be removed.

Referring back to FIG. 3 , when a touch input is detected while the first object is displayed, the display apparatus 100 may monitor whether the touch input is a moving gesture ( S350 ).

Hereinafter, the concept of a movement gesture will be described with reference to FIG. 5 .

According to an embodiment, the display apparatus 100 may monitor touch input coordinates of each of a plurality of locations 411 and 412 at which a touch input constituting a pinch-in or pinch-out gesture is sensed. As a result of the monitoring, the display apparatus 100 may calculate vectors indicating the movement distances and movement directions 511 and 512 of the respective touch input coordinates.

According to an embodiment, the display apparatus 100 may determine that the touch input is a movement gesture when the directions of the vectors are within a predetermined range, ie, have similar directions.

According to another embodiment, the display apparatus 100 may determine that the touch input is a movement gesture when the movement distance of the input coordinates is greater than or equal to a threshold value and the change amount of the distance between the input coordinates is less than or equal to the threshold value.

When it is determined that a movement gesture is input (S360), the display apparatus 100 may move in which the first object is displayed according to the movement direction and distance of the movement gesture (S370). Also, the display apparatus 100 may manipulate the output of the multimedia content output in step S310 according to the moving direction and distance of the moving gesture (S380). The operation performed in step S380 may be changed according to the type of multimedia content. For example, when an application for taking a photo is executed in step S310 and a preview image obtained through the camera module 150 is output, in step S380 the display device 100 displays the camera module 150 to the camera. By controlling , the preview image can be zoomed in or zoomed out. According to an embodiment, in a state in which an image or a moving picture is being output, the display apparatus 100 may zoom-in or zoom-out the image or moving picture in operation S380. However, the present invention is not limited thereto, and the contrast, color, output mode (eg, movie mode, news mode, sport mode, black and white mode, etc.) of the image or video output in step S380 is output according to an embodiment. An operable output option may be manipulated for an image or a moving picture to be manipulated. For another example, when a moving picture or sound is reproduced in step S310 , the display apparatus 100 may change the reproduction position at which the moving image or sound is reproduced forward or backward. As another example, the multimedia content output in step S310 may be a web page output through a browser. In this case, in step S380, a web page output as a previously displayed page or a later displayed page may be changed according to the history of the browsed web page.

6 is a diagram illustrating an example of manipulating an output of map information when multimedia content includes map information, according to an embodiment.

Referring to FIG. 6 , when a pinch-in gesture or a pinch-out gesture is input while the screen 601 on which map information is displayed is output, manipulation with the first object 420-1 and the navigation bar 430 is performed. The second object including the value display area 435 - 1 may be overlapped and displayed on the screen 601 . When map information is displayed on the screen 601 , values indicating a scale may be displayed in the manipulation value display area 435 - 1 . Whether any information is displayed on the screen 601 is determined depending on what application the display device 100 is running, or what the displayed screen means by performing image recognition on a screen-captured image It may be implemented in various ways, such as determined.

Here, while the touch input constituting the pinch-in gesture or the pinch-out gesture is maintained, the positions 411-1 and 412-1 of the touch input may move to other positions 411-2 and 412-2. have. Here, the first object may be moved from a position 420-1 on the search bar 430 to a position 420-2 corresponding to the direction and distance in which the touch input is moved.

Also, in response to the direction and distance in which the touch input moves, the display apparatus 100 may display the screen 602 including the scaled map information.

7 is a diagram illustrating an example of manipulating an output of an image according to an embodiment.

Referring to FIG. 7 , when a pinch-in gesture or a pinch-out gesture is input while the screen 701 on which the image 710-1 is displayed is output, the first object 420-3 and the navigation bar ( The second object including the 430 and the manipulation value display area 435 - 2 may be overlapped and displayed on the screen 701 . When an image is displayed on the screen 701 , values indicating a magnification for outputting an image may be displayed in the manipulation value display area 435 - 2 .

Here, while the touch input constituting the pinch-in gesture or pinch-out gesture is maintained, the positions 411-3 and 412-3 of the touch input may move to other positions 411-4 and 412-4. have. Here, the first object may be moved from a position 420 - 3 on the search bar 430 to a position 420 - 4 corresponding to the direction and distance in which the touch input is moved.

Also, the display apparatus 100 may display the screen 702 including the image 710 - 2 of which the magnification is changed according to the direction and distance in which the touch input is moved.

In this specification, the embodiment related to the image may be equally applied to the case of the statue image.

8 is a diagram illustrating an example of manipulating a font of text according to an embodiment.

Referring to FIG. 8 , when a pinch-in gesture or a pinch-out gesture is input while the screen 801 on which text is displayed is output, the first object 420-5, the navigation bar 430, and the manipulation value The second object including the display area 435 - 3 may overlap and be displayed on the screen 801 . When text is displayed on the screen 701 , values indicating a font size of the text may be displayed in the operation value display area 435 - 3 .

Here, while the touch input constituting the pinch-in gesture or the pinch-out gesture is maintained, the positions 411-5 and 412-5 of the touch input may move to other positions 411-6 and 412-6. have. Here, the first object may be moved from a position 420 - 5 on the search bar 430 to a position 420 - 6 corresponding to the direction and distance in which the touch input is moved.

Also, in response to the direction and distance in which the touch input is moved, the display apparatus 100 may display the screen 802 including the text whose font site is changed.

Referring back to FIG. 3 , when it is determined in step S360 that the touch input is not a moving gesture or after steps S370 and S380 are performed, the gesture is terminated as the object in contact with the display device 100 is separated can be determined (S390). If the gesture is not terminated, step S350 may be performed again. When the gesture is finished, the display apparatus 100 may prevent the displayed first object from being displayed on the screen.

9 is a diagram illustrating a process for detecting a movement gesture according to an embodiment.

First, the display apparatus 100 may calculate a vector of a movement gesture (S910). According to an embodiment, in order to calculate the vector of the movement gesture, the display apparatus 100 calculates vectors representing the direction and distance moved by the touch input coordinates, respectively, and calculates the vector of the movement gesture by summing the vectors. can do. Alternatively, according to another embodiment, the display apparatus 100 calculates an average value of each touch input coordinate in order to calculate a vector of a movement gesture, and returns the difference between the average value of the touch input coordinates after movement and the average value of the touch input coordinates before movement. It is also possible to calculate a vector of the movement gesture based on it. However, the present invention is not limited thereto.

Thereafter, the display apparatus 100 may calculate a first movement distance with respect to the movement direction of the first object and a second movement distance with respect to the normal direction from the calculated vector of the movement gesture ( S920 ). Referring to FIG. 10 , when the moving direction of the first object is the vertical direction 440 , the display device may separate the vector components in the vertical direction 440 and the normal direction thereof.

Thereafter, the display apparatus 100 may determine whether the ratio of the first movement distance to the second movement distance is equal to or greater than a threshold value (S930). The display apparatus 100 may move the position of the first object only when the ratio of the first movement distance to the second movement distance is equal to or greater than the threshold value (S940) and manipulate the output of the content (S950). That is, when the moving gesture is the vertical direction in which the first object moves, steps S940 and S950 may not be executed with respect to the moving gesture input in the left and right directions.

Referring to FIG. 10 , when the vector of the movement gesture is a first vector 510-1, the first vector 510-1 is a movement direction component 1010 having the same direction as the movement direction 440 of the first object. -1) and the normal direction component 1020-1. When the movement direction component 1010-1 is large like the first vector 510-1, the display apparatus 100 may execute steps S940 and S950. Conversely, in the case of the second vector 510 - 2 , since the movement direction component 1010 - 2 is significantly smaller than the normal direction component 1020 - 2 , the display apparatus 100 does not execute steps S940 and S950 . may not be

11 is a diagram illustrating a process in which a display apparatus manipulates an output of multimedia content according to a manipulation amount, according to an exemplary embodiment.

First, the display apparatus 100 may detect a moving gesture while the first object is displayed ( S1110 ). Thereafter, the display apparatus 100 may calculate a distance between the touch input coordinates constituting the moving gesture ( S1120 ). Based on the distance between the touch input coordinates, the display apparatus 100 may determine a manipulation amount ( S1130 ). Here, the manipulation amount refers to the degree to which the multimedia content is manipulated. Alternatively, the manipulation amount may be applied as a weight for the moving distance of the moving gesture.

Thereafter, the display apparatus 100 may manipulate the output of the content in proportion to the amount of manipulation ( S1140 ). For example, referring to FIG. 12 , an example in which the display apparatus 100 changes a position at which a first object is displayed according to a manipulation amount is illustrated. As shown in (a) of FIG. 12 , when the distance 1210-1 between the touch input coordinates 411-7 and 412-7 constituting the movement gesture is large, the movement distance 1200 of the touch input coordinates is large. Compared to , the movement distance 1220-1 of the first object may be greater. Conversely, as shown in (b) of FIG. 12 , even when the touch input coordinates 411 - 8 and 412 - 8 constituting the movement gesture are moved by the same movement distance 1200 , the touch input coordinates 411 - 411 - When the distance 1210 - 2 between 7 and 412 - 7 is small, the first object 420 - 8 may move by a smaller movement distance 1220 - 2 . Similarly, in step S1140 of FIG. 11 , the display apparatus 100 may manipulate the multimedia content in proportion to the moving distance of the first object. For example, in the case of outputting an image or a video, the greater the distance between the touch input coordinates constituting the movement gesture is, the greater the amount of change in which the magnification of the image or video is changed according to the movement gesture may be applied.

The methods according to the embodiments of the present invention described so far may be performed by executing operations included in a computer program implemented as computer readable code. The computer program may be transmitted from the first computing device to the second computing device through a network such as the Internet and installed in the second computing device, thereby being used in the second computing device. The first computing device and the second computing device include all of a server device, a physical server belonging to a server pool for cloud services, and a stationary computing device such as a desktop PC. The above-described computing device may be included in the display device.

The computer program may be stored in a recording medium such as a DVD-ROM or a flash memory device.

Although embodiments of the present invention have been described with reference to the accompanying drawings, those of ordinary skill in the art to which the present invention pertains can realize that the present invention can be implemented in other specific forms without changing the technical spirit or essential features. can understand Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

Claims (11)

A method for a display device having a touch screen to manipulate multimedia content, the method comprising:
outputting the multimedia content;
A pinch-in gesture or a pinch-out gesture is detected from coordinates of a plurality of touch inputs detected through the touch screen, wherein the plurality of touch inputs are applied to the touch screen. an input to the outputted multimedia content;
displaying a first object for manipulating the output of the multimedia content on the touch screen in response to the pinch-in gesture or the pinch-out gesture;
A moving gesture is detected with respect to the coordinates of the plurality of touch inputs, wherein a distance traveled by each of the coordinates of the plurality of touch inputs is equal to or greater than a first reference value, and the coordinates of the plurality of touch inputs a gesture detected when the amount of change in the distance between the two is less than or equal to a second reference value;
moving a position where the first object is displayed according to a moving direction of the moving gesture and a moving distance of the moving gesture; and
Manipulating the output of the multimedia content according to the moving direction and the moving distance;
How to manipulate multimedia content. According to claim 1,
The multimedia content is
contains map information;
Manipulating the output includes:
characterized in that the scale at which the map information is output is changed,
How to manipulate multimedia content. According to claim 1,
The multimedia content is
contains images or videos;
Manipulating the output includes:
Characterized in changing the output option set to output the image or video,
How to manipulate multimedia content. According to claim 1,
The multimedia content is
contains text;
Manipulating the output includes:
Characterized in changing the font size of the text,
How to manipulate multimedia content. According to claim 1,
The step of outputting the multimedia content comprises:
Playing a video or sound,
Manipulating the output includes:
characterized in that the playback position of the video or the sound is changed,
How to manipulate multimedia content. According to claim 1,
Displaying the first object comprises:
characterized in that it further displays a second object including a search bar displayed within a range in which the first object is moved and a manipulation value located at one side of the search bar,
How to manipulate multimedia content. According to claim 1,
The step of detecting the movement gesture comprises:
calculating a movement gesture vector from vectors indicating a distance and a direction moved by each of the coordinates of the plurality of touch inputs;
separating a movement direction component and a normal direction component for the first object from the vector of the movement gesture;
When the ratio of the movement direction component to the size of the normal direction component is equal to or greater than a threshold value, executing the moving step and the manipulating step;
How to manipulate multimedia content. According to claim 1,
The multimedia content manipulation method comprises:
calculating a distance between coordinates of the touch input when the movement gesture is detected; and
Determining an operation amount based on the calculated distance; further comprising,
The operation step is
characterized in that the output of the multimedia content is manipulated based on the determined amount of manipulation,
How to manipulate multimedia content. In the display device having a touch screen,
processor;
a memory storing a plurality of operations executed by the processor; and
A touch screen that outputs a screen and senses a touch input,
The plurality of operations are
an operation for outputting multimedia content;
A pinch-in gesture or a pinch-out gesture is detected from coordinates of a plurality of touch inputs detected through the touch screen, wherein the plurality of touch inputs are applied to the touch screen. an operation that is an input to the outputted multimedia content;
displaying a first object for manipulating the output of the multimedia content on the touch screen in response to the pinch-in gesture or the pinch-out gesture;
A moving gesture is detected with respect to the coordinates of the plurality of touch inputs, wherein a distance traveled by each of the coordinates of the plurality of touch inputs is equal to or greater than a first reference value, and the coordinates of the plurality of touch inputs an operation, which is a gesture detected when an amount of change in a distance between the two is less than or equal to a second reference value;
an operation of moving a position where the first object is displayed according to a moving direction of the moving gesture and a moving distance of the moving gesture; and
including; an operation of manipulating the output of the multimedia content according to the moving direction and the moving distance
display device. 10. The method of claim 9,
The display device is
further including a camera,
The multimedia content is
It is a preview image signal obtained through the camera,
The operation of manipulating the output includes an operation of controlling the camera,
display device. A computer program recorded on a non-transitory computer readable medium, wherein the instructions of the computer program are executed by a processor of a server,
outputting multimedia content;
A pinch-in gesture or a pinch-out gesture is detected from coordinates of a plurality of touch inputs detected through a touch screen, wherein the plurality of touch inputs are output to the touch screen which is an input for the multimedia content;
displaying a first object for manipulating the output of the multimedia content on the touch screen in response to the pinch-in gesture or the pinch-out gesture;
A moving gesture is detected with respect to the coordinates of the plurality of touch inputs, wherein a distance traveled by each of the coordinates of the plurality of touch inputs is equal to or greater than a first reference value, and the coordinates of the plurality of touch inputs a gesture detected when the amount of change in the distance between them is less than or equal to a second reference value;
moving a position where the first object is displayed according to a moving direction of the moving gesture and a moving distance of the moving gesture; and
Manipulating the output of the multimedia content according to the moving direction and the moving distance;
computer program.

Images