KR20110034740A - Portable device and related control method for video content through manipulation of object in the video content - Google Patents

Abstract

PURPOSE: A portable device and a related control method for video content through manipulation of an object in the video content are provided to control a video intuitively by controlling an object within the video while reproducing video contents. CONSTITUTION: A touch sensing unit(112) senses a touch input on a display unit(114), and a storage unit(120) stores a control command mapping table(126) and video contents(122). A control unit(130) judges the input type based on a touch input signal of the touch sensing unit while reproducing the video contents video through a reproduction unit. Based on the control command mapping table, the control unit controls a reproduction-related function of the video contents according to the control command corresponding to the judged input type.

Description

[0001] The present invention relates to a moving picture control method for moving objects in a moving picture being played back on a mobile device,

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a moving picture control interface that is being played back on a mobile device, and more particularly, And controlling a moving picture related function during playback by operating the portable terminal.

In recent years, various types of portable multimedia devices such as an MP3 player and a portable multimedia player (PMP) have been widely used by young users. As the popularity of various portable devices has increased, users' demands are becoming more diverse, and the competition of manufacturers to meet them is becoming more and more intense. Accordingly, portable devices that can use more functions more conveniently are continuously being developed, and various multimedia functions and wireless Internet functions are added, and the operating environment of the portable devices is gradually moving to the PC level.

Portable devices are basically small in size because they must be easily portable by the user. Therefore, the size of an input device and an output device typically represented by a keypad and a liquid crystal screen (LCD screen) are limited. Under these constraints, it is essential to develop a user interface that takes various and complex functions into a portable device and improves the accessibility and convenience of the user to perform the functions. Moreover, as the operating environment of a conventional portable device is different from that of a PC-level operating environment, a need for a suitable user interface is increasing.

Accordingly, various types of user interfaces have been developed, one of which is a touch interface. For example, there is a technique of employing a touch pad in an input unit in addition to a conventional keypad, a technique of forming a keypad and a touch pad by attaching a touch sensor to the keypad area, and a technique of completely removing the keypad and introducing a touch screen.

Among them, the touch screen simultaneously provides an input interface and an output interface between the portable device and the user. The touch screen can eliminate the existing keypad, thereby increasing the display area, and has an advantage in that the user can intuitively operate on the input side.

On the other hand, recent portable devices provide a function to easily view and play a video anytime and anywhere. However, in order to control video during video playback on a mobile device equipped with a touch screen, the menu or icon must be displayed on the screen. Therefore, not only a troublesome process of displaying a menu or an icon on the screen is required, but also a menu or an icon appears on the screen, which hides the image being reproduced and feels a little uncomfortable.

Therefore, there is a need for a technology that can intuitively control the video directly from the video without displaying the control-related menus or icons on the screen when the video is played on the touch-screen portable device.

Accordingly, an object of the present invention is to solve the above-mentioned problems of the related art, and it is an object of the present invention to provide a touch screen interface, .

It is another object of the present invention to intuitively perform various control functions related to video playback and volume control without selecting a moving picture being played back through a portable device.

To achieve these and other advantages and in accordance with the purpose of the present invention, as embodied and broadly described herein, a portable device includes a display unit, a touch sensing unit, a storage unit, a moving picture player, and a control unit.

The touch sensing unit is mounted on the display unit to sense a touch and generate an input signal corresponding to the touch. The storage unit stores a control command mapping table in which a correspondence relation between moving image content including an object and an input type by the touch and a control command is defined. The moving picture player reproduces the moving picture content and outputs the reproduced moving picture through the display unit. The control unit receives the touch input signal for a specific object from the touch sensing unit during the reproduction of the moving picture content by the moving picture player, identifies the input type, inquires the control command mapping table, Recognizes a corresponding control command, and controls a function related to reproduction of the moving picture content according to the recognized control command.

In the portable device according to the present invention, the storage unit may further store an object mapping table for defining an object that can be motion-controlled, and the controller inquires the object mapping table, It is possible to determine whether or not the object is controllable.

Further, the input type may include at least one of n-touches (where n is a natural number of 1 or more) and a drag in a specific direction.

Also, the control command defined in the control command mapping table may include at least one of playback, stop, pause, fast forward, fast forward, skip forward, skip backward, double speed, and volume control.

According to another aspect of the present invention, there is provided a method of controlling a moving image through object manipulation, comprising: reproducing moving image content including an object and outputting the reproduced moving image content through a display unit; Receiving a touch input signal for a specific object through the touch sensing unit mounted on the display unit and determining an input type; Inquiring a control command mapping table to recognize a control command corresponding to the determined input type; And controlling a function related to reproduction of the moving picture content according to the recognized control command.

In the moving picture playback scene control method according to the present invention, the input type determination step may include determining whether the (n + 1) -th touch is generated after receiving the touch input signal according to the n-th touch for the specific object (Wherein n is a natural number of 1 or more); If the touch input signal corresponding to the (n + 1) -th touch is not received, recognizing the touch input signal by touching it n times; Determining whether the same area of the (n + 1) th touch is generated when the touch input signal corresponding to the (n + 1) -th touch is received; If the (n + 1) th touch occurs in the same area, (n + 1) touches; And if the (n + 1) th touch does not occur in the same area, recognizing it as a drag.

In this case, the step of recognizing with the drag may include extracting the direction of the drag.

In addition, the moving picture control method of the present invention may further include, before the input type determination step, determining whether the specific object is an object capable of moving picture control.

In this case, the method of the present invention may further comprise the step of outputting an uncontrollable message if the specific object is not a motion controllable object.

Further, in the method of the present invention, the control command may include at least one of playback, stop, pause, fast forward, fast reverse, skip forward, skip backward, speed up, and volume control.

According to the present invention, there is an advantage that a moving picture intuitively can be directly controlled through manipulation of an object included in a moving picture without displaying a control-related menu or icon during playback of moving picture contents in a mobile device adopting a touch screen interface .

In addition, the present invention has an advantage in that various control functions related to video playback and volume control can be intuitively performed without selecting a video screen being reproduced through a portable device.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In describing the embodiments, descriptions of techniques which are well known in the technical field to which the present invention belongs and which are not directly related to the present invention will not be described as much as possible. This is to omit the unnecessary description so as to convey the key of the present invention more clearly without fading. In the meantime, the same reference numerals are assigned to the same or corresponding components throughout the accompanying drawings.

The present invention relates to a technology capable of performing a video related control function by allowing a user to directly manipulate a specific object included in a moving picture through a touch screen during playback of moving picture contents through a portable device adopting a touch screen interface. Control functions include play, stop, pause, fast forward, fast reverse, skip forward, skip backward, speed, and volume control.

FIGS. 1A and 1B are diagrams for intuitively explaining a moving picture control method through object manipulation according to the present invention. 1A and 1B are merely examples for facilitating understanding, and the present invention is not necessarily limited to such a configuration.

1A, the portable device 100 includes a touch screen 110, and it is assumed that moving picture content (e.g., a movie) is being played through the touch screen 110. [ The moving picture being reproduced includes the objects 10a and 10b.

In the present specification, an 'object' means that a visual image can be clearly distinguished from a plurality of visual elements included in a moving image, and examples of the object include a person, an animal, a house, a car, an airplane, and the like. These objects 10a and 10b are classified into an object capable of controlling the moving image of the present invention and an object not having the moving image control, and the distinction is stored in the portable device 100 in advance. This will be explained later in detail.

1B, when a user touches (22, touch), touches (22, 23), touches (22) or touches a specific object (10a) When dragging (24, drag), if the object 10a selected by the user is an object capable of motion control, a control command corresponding to the user input is performed. The control command is set differently according to one-time touch, two-time touch, and drag direction, and these correspondence relationships are stored in the portable device 100 in advance. This is explained in detail later. For example, a different control command is assigned to each of "touch" for one touch, "stop" for touch twice, "backward" for the left drag, and "volume up" for the upper drag. However, this is for illustrative purposes only, and the present invention is not limited thereto. In addition, although the touch type mapped to the control command is exemplified as one touch and two touches, it is also possible to touch three or more times, and another control command can be additionally assigned thereto.

As described above, according to the control method of the present invention, the user directly touches or drags a specific person or object displayed on the screen on the touch screen 110, thereby performing a drag operation according to a control command preset in the touch type or drag direction So that the user can control the video.

Next, the configuration and operation of the portable device according to the present invention will be described with reference to FIG. 2 is a block diagram showing a configuration of a portable device according to an embodiment of the present invention.

As shown in FIG. 2, the portable device 100 includes a touch screen 110, a storage unit 120, and a control unit 130. The touch screen 110 includes a touch sensing unit 112 and a display unit 114. The storage unit 120 includes a moving picture content 122 and an object mapping table 124 and a control command mapping table 126 . The control unit 130 includes a moving picture player 132.

The portable device 100 according to the present invention can be used for a mobile broadcasting receiver such as a mobile phone, a smart phone, a PDA (personal digital assistant), a DMB (digital multimedia broadcasting) receiver, an MP3 player, multimedia player). However, the portable device 100 of the present invention is not limited to this example, and the present invention can be applied to any portable electronic device having a touch screen 110 and capable of reproducing moving pictures.

The touch screen 110 provides an input interface and an output interface at the same time. That is, the touch screen 110 includes a touch sensing unit 112 as an input device, and a display unit 114 as a display device. Meanwhile, the portable device 100 according to the present invention may further include a conventional input device (e.g., various pointing input devices such as a keypad or a wheel key) in addition to the touch screen 110. And a voice output unit (i.e., a speaker) are omitted from the description and illustration of components that are basically provided in a conventional portable device 100. [

The touch sensing unit 112 senses a touch action of the user and generates an input signal according to the sensed touch action and transmits the input signal to the control unit 130. The touch sensing unit 112 is, for example, a touch panel or a touch sensor mounted on the display unit 114. When a touch occurs, the touch sensing unit 112 detects a change in the physical quantity and converts it into an electrical signal.

The display unit 114 displays various types of menus of the portable device 100 under the control of the control unit 130, and displays information input by the user or information provided to the user. The display unit 114 may be composed of, for example, a liquid crystal display (LCD) or other display device corresponding thereto.

The storage unit 120 stores various programs and applications related to the functions of the portable device 100 and stores data necessary for performing the functions and data generated during the performance of the functions. The storage unit 120 may include one or more buffers for temporarily storing data, and may further include a separate external storage medium. Particularly, in the present invention, the storage unit 120 includes the moving picture content 122, the object mapping table 124, and the control command mapping table 126.

The object mapping table 124 includes object related data for each moving picture content 122. [ In particular, the object mapping table 124 defines an object that can be motion-controlled, and includes an object included in the corresponding scene and its coordinate area information for each moving scene. Table 1 below is an example of the object mapping table 124 for moving image AAA.

Video name AAA Controllable object A_01, A_02, B_01, C_01, D_01, D_02, D_03 scene Embedded Objects Object coordinate area S-001 A_01 X121 to X129, Y87 to Y115 B_01 X389 to X456, Y104 to Y125 S-002 A_01 X135 to X148, Y36 to Y90 A_02 X29 to X79, Y248 to Y276 C_01 X589 to X792, Y204 to Y254 S-003 A_02 X109 to X131, Y269 to Y301 C_01 X600 to X762, Y279 to Y302 D_01 X190 to X234, Y309 to Y361 S-004 D_01 X244 to X278, Y311 to Y389 D_02 X772 to X790, Y155 to Y190 D_03 X547 to X588, Y401 to Y442

Briefly described with reference to Table 1, objects controllable in the moving picture AAA are predetermined in A_01, A_02, B_01, C_01, D_01, D_02, and D_03. An object not defined in the object mapping table 124 can not be controlled even if the user selects the object. In the scene S-001, the objects A_01 and B_01 are shown and their on-screen coordinate areas are (X121 to X129, Y87 to Y115), (X389 to X456, Y104 to Y125), respectively. Also, as the scene S-001 changes to the scene S-002, the object B_01 disappears and the objects A_02 and C_01 newly appear. In Table 1, the coordinate area means a pixel range occupied on the screen for each object. Table 1 exemplifies the coordinate area as a rectangle, but the coordinate area is not necessarily limited to a rectangle, and various modifications are possible.

The object mapping table 124 defines which object is controllable, and includes information about which object is included in each scene and whose coordinate area is. Accordingly, when the user touches a specific object in a specific scene for moving picture control, the control unit 130, which will be described later, recognizes the object selected by the user with reference to the object mapping table 124 and determines whether or not the object can be controlled. This will be explained later.

The control command mapping table 126 defines the user input type and defines the correspondence between the input type and the control command. Table 2 below is an example of the control command mapping table 126.

Input Type Control command Touch once Pause Touch twice stop Drag left Rewind Drag right Fast forward Drag up Increase volume Drag down Volume down

When the user touches or drags the object, the control unit 130 determines the input type of the user by referring to the control command mapping table 124 and recognizes the control command corresponding to the input type. In the example of Table 2, the input type is illustrated as one touch, two touches, and up / down / left / right drag, but the present invention is not limited thereto. In another example, an input type may be determined by a single touch, a double touch, an up or down or a left or right directional drag, or another type of input by one touch and four directional drag. It is also possible that three or more touches are included in the input type. However, it is desirable to simplify such an input type as much as possible so that the user can understand it intuitively and do not inconvenience it.

The control command is not limited to the example shown in Table 2, and can be any control function related to moving picture control. For example, it is possible to assign a control command to the control command mapping table 124 by playing, stopping, pausing, fast forwarding, fast forwarding, skipping forward, skipping backward,

The control unit 130 performs an overall control function for the portable device 100. In particular, the controller 130 of the present invention includes a moving picture player 132. The moving picture player 132 may be realized in the form of software and stored in the storage unit 120. When the moving picture reproducing function is executed, the moving picture player 122 is activated by the control unit 130 and stored in the storage unit 120 Playback.

In addition, the controller 130 of the present invention receives a touch input signal for a specific object from the touch sensing unit 112 during motion picture reproduction by the motion picture player 132, determines an input type by a user, (126), recognizes a control command corresponding to a user input type, and controls a function related to playback of moving picture content according to a control command.

Hereinafter, a moving image control method using the portable device of the present invention will be described. From the following description, the structure and operation of the above-described portable device 100 will become clearer as well. 3 is a flowchart illustrating a moving image control method through object manipulation according to an embodiment of the present invention.

Referring to FIGS. 2 and 3, the moving picture reproducer 132 reproduces the specific moving picture content 122 stored in the storage unit 120 (step S11). Accordingly, the moving picture contents 122 being reproduced are visually output on the display unit 114. [

During playback of the moving image, the controller 130 recognizes that the specific object is selected by the first touch (step S12). That is, when the user touches the touch screen 110, the touch sensing unit 112 detects the touch and generates an input signal and transmits the input signal to the controller 130. The control unit 130 receives the input signal transmitted from the touch sensing unit 112 and extracts touch coordinates. Then, the control unit 130 inquires the object mapping table 124 described in Table 1 to determine whether the touch coordinates belong to the object included in the scene at the time of touch generation and the coordinate area thereof. For example, in the example of Table 1, when the user touch occurs in the scene S-001 and the extracted touch coordinate is (X123 to X125, Y95 to Y99), this touch coordinate corresponds to the coordinate area X121 ~ X129, Y87 ~ Y115). Accordingly, the control unit 130 determines that the user has touched the object A_01.

In addition, the controller 130 determines whether the object selected by the user is a controllable object (step S13). That is, the control unit 130 checks whether the object touched by the user belongs to the controllable object defined in the object mapping table 124 by inquiring the object mapping table 124. [ Although the steps S12 and S13 are separately described for convenience, the control unit 130 determines whether the user touches the object through the inquiry of the object mapping table 124 after extracting the touch coordinates in step S12, You can judge at once.

If the object touched by the user is not a controllable object, the control unit 130 outputs a controllable message through the display unit 114 (step S14). That is, since the user can not know which object among a large number of objects included in the moving picture is controllable while viewing the moving image, the user can visually feedback the user when the object is touched, thereby enhancing user convenience.

If the object touched by the user is a controllable object, the control unit 130 determines whether a second touch occurs within a predetermined time (S15). The second touch means a subsequent touch that occurs again within a predetermined time after the first touch occurs at a specific point. The second touch may be a touch that is released again after the first touch is released, that is, a touch that occurs consecutively at the same point, or a touch that the touch point moves in a state where the first touch is not released. The former means touch twice, and the latter means drag.

Accordingly, the controller 130 receives an input signal corresponding to the first touch from the touch sensing unit 112 and waits for a next input signal for a predetermined time to determine whether or not the second touch is generated. As in the case of the first touch, the controller 130 receiving the input signal according to the second touch extracts touch coordinates from the received input signal.

If the second touch does not occur for a predetermined time, the controller 130 recognizes the input type of the user as one touch (step S16). Then, the process proceeds to step S21 to be described later.

If the second touch occurs, the controller 130 determines whether the second touch has occurred in the same area as the first touch (step S17). Whether or not the same area is generated can be easily performed by comparing the touch coordinates extracted from the touch input signal. However, since it is actually difficult for the first touch and the second touch to occur in exactly the same area at this time, it is determined that the allowable range is set to some extent, and when the touch coordinates are included in the range, the touch of the same area is determined.

If the second touch occurs in the same area as the first touch, the control unit 130 recognizes the input type of the user twice as touch (S18). Then, the process proceeds to step S21 to be described later.

If the second touch does not occur in the same area as the first touch, the controller 130 recognizes the input type of the user as a drag (step S19). Then, the controller 130 extracts the drag direction (step S20). That is, the controller 130 checks the coordinate change of the first touch and the second touch to extract the drag direction. However, since the user's actual dragging behavior generally includes components in an arbitrary direction, when determining the drag direction, it is possible to determine by determining which of the rate of change in the vertical direction and the rate of change in the horizontal direction is the largest.

In step S16, the input type is recognized as a single touch. In step S18, the input type is recognized twice as a touch. In step S20, the input type is recognized as a drag in a specific direction. Then, The mapping table 126 is inquired to recognize a control command corresponding to the input type (step S21). Then, the control unit 130 performs a control function corresponding to the control command (step S22).

The moving picture control method and the portable device through the object manipulation in the moving picture being reproduced by the portable device have been described through the embodiments. Although the present invention has been described with reference to preferred embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, It is not intended to limit the scope. It is to be understood by those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

A method for controlling a moving picture through manipulation of an object in a moving picture being reproduced in a portable device according to the present invention and a portable device having the moving picture reproducing function and applicable to various portable devices, mobile communication terminals, and wireless terminals employing a touch interface have.

FIGS. 1A and 1B are diagrams for intuitively explaining a moving picture control method through object manipulation according to the present invention.

2 is a block diagram showing a configuration of a portable device according to an embodiment of the present invention.

3 is a flowchart illustrating a moving image control method through object manipulation according to an embodiment of the present invention.

DESCRIPTION OF THE EMBODIMENTS

10a, 10b: object 22: first touch point

23: second touch point 24: drag direction

100: portable device 110: touch screen

112: touch sensing unit 114:

120: storage unit 122: video content

124: Object mapping table 126: Control command mapping table

130: control unit 132:

Claims (10)

A display section; A touch sensing unit mounted on the display unit for sensing a touch and generating an input signal corresponding to the touch; A storage unit storing moving picture contents including objects, a control command mapping table in which a correspondence relation between the input type by the touch and a control command is defined; A moving picture player for reproducing the moving picture content and outputting the reproduced moving picture through the display unit; And And a controller for receiving the touch input signal for a specific object from the touch sensing unit during the reproduction of the moving picture content by the moving picture player to inquire the control command mapping table, A control unit for recognizing a command and controlling a function related to reproduction of the moving picture content according to the recognized control command; . The method according to claim 1, Wherein the storage unit further stores an object mapping table for defining an object that can be motion-controlled, and the controller inquires the object mapping table to determine whether the specific object received the touch input signal is an object capable of moving- Mobile devices. The method according to claim 1, Wherein the input type includes at least one of an n-touch (n is a natural number equal to or greater than 1) and a drag in a specific direction. The method according to claim 1, Wherein the control command defined in the control command mapping table includes at least one of playback, stop, pause, fast forward, fast forward, skip forward, skip backward, speed up, and volume control. Reproducing moving picture contents including an object and outputting the reproduced moving picture contents through a display unit; Receiving a touch input signal for a specific object through the touch sensing unit mounted on the display unit and determining an input type; Inquiring a control command mapping table to recognize a control command corresponding to the determined input type; And Controlling a function related to reproduction of the moving picture content according to the recognized control command; And controlling the moving of the object through the object manipulation. The method of claim 5, Wherein the step of discriminating the input type comprises: Determining whether an (n + 1) -th touch is generated after receiving the touch input signal according to the n-th touch on the specific object (n is a natural number of 1 or more); If the touch input signal corresponding to the (n + 1) -th touch is not received, recognizing the touch input signal by touching it n times; Determining whether the same area of the (n + 1) th touch is generated when the touch input signal corresponding to the (n + 1) -th touch is received; If the (n + 1) th touch occurs in the same area, (n + 1) touches; And Recognizing the (n + 1) th touch as a drag if the touch does not occur in the same area; And controlling the motion of the moving object. The method of claim 6, Wherein the step of recognizing by the drag includes extracting the direction of the drag. The method of claim 5, Determining whether the specific object is a video-controlable object before the input type determination step; Further comprising the steps of: determining whether the object is a moving object; The method of claim 8, Outputting an uncontrollable message if the specific object is not a video controllable object; Further comprising the steps of: determining whether the object is a moving object; The method of claim 5, Wherein the control command includes at least one of playback, stop, pause, fast forward, fast forward, skip forward, skip backward, fast speed, and volume control.

Images