KR20150076926A - user terminal device and the controlling method thereof - Google Patents

Abstract

Disclosed is a user terminal device which includes: a storage unit which stores photographed images; a display unit for displaying a first photographed image which is one of the photographed images; and a control unit that displays a second photographed image when a predetermined first gesture is input after the first photographed image is displayed, and displays a graphic object in the size corresponding to the total number of the images stored in the storage unit when a predetermined second gesture is input. When user touch on one point of the graphic object is input, the control unit can display information for an photographed image at a time point corresponding to a touch point. Therefore, user convenience can be increased.

Description

[0001] USER TERMINAL DEVICE AND THE CONTROLLING METHOD THEREOF [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a user terminal device and a control method thereof, and more particularly, to a user terminal device providing a video playback mode and a control method thereof.

Various types of electronic products are being developed and distributed by the development of electronic technology. In particular, various display devices such as a TV, a mobile phone, a PC, a notebook PC, a PDA, a digital camera, and a digital camcorder are widely used in most ordinary households.

A display device equipped with a camera generally supports a video shooting mode and a video playback mode. The user can view the photographed image in the play mode and perform various operations on the photographed image. If there are a lot of photographed images, the display may support a single view mode or a DCM mode in which a plurality of pictures are displayed together.

However, when a plurality of photographed images are viewed in a single view using the user terminal device, user's operation is inconvenient.

SUMMARY OF THE INVENTION The present invention has been made in view of the above needs, and it is an object of the present invention to provide a method and apparatus for providing a user operation by using a graphic object having a size corresponding to the number of previously stored images when a user views a plurality of images in a single view have.

According to an aspect of the present invention, there is provided a user terminal apparatus including a storage unit for storing a shot image, a display unit for displaying a first shot image as one of the shot images, When a preset first gesture is input, a second captured image is displayed. When a predetermined second gesture is input, a graphic object having a size corresponding to the total number of images stored in the storage unit is displayed on the display unit The controller may display information about a photographed image at a time point corresponding to a touch point on the display unit when a user touch on one point of the graphic object is input.

Here, the control unit displays the graphic object in a bar shape having a length corresponding to the number of the entire images, and when the user touch is input in the bar, at least one end of the bar, And may display a thumbnail image of the photographed image photographed at the determined point in time.

The controller may display the graphic object in a bar shape having a length corresponding to the number of the entire images, and when a plurality of points are touched in the bar, a plurality of An indicator can be additionally displayed on the bar.

Here, the controller displays the interval between the plurality of indicators by expanding to the both ends of the bar when the predetermined third gesture is input while the plurality of indicators are displayed on the bar, and when the plurality of indicators are expanded When the user touch is input for the interval between the plurality of indicators, a thumbnail image of the shot image corresponding to the touch point among the plurality of shot images matching the interval between the plurality of indicators can be displayed .

When the plurality of indicators are displayed on the bar, the control unit adds a thumbnail image bar to one side of the bar for sequentially displaying thumbnail images of shot images that match the interval between the plurality of indicators Can be displayed.

When the second gesture is input, the control unit displays a switching screen representing a process of switching the first shot image to the second shot image, and displays the overlapping graphics object on the switching screen .

The first gesture may be a drag or flick gesture, and the second gesture may be a long tap, a long tap and drag, a long tap and flick, a double tap, a surface touch & drag, a surface touch and flick touch & flick) gesture, and the information about the shot image may include at least one of a thumbnail image of the shot image, shooting date information, an image name, shooting location information, shooting device information, have.

Meanwhile, a method of controlling a user terminal according to an exemplary embodiment of the present invention includes displaying a first captured image, which is one of previously stored captured images, when a predetermined first gesture is input in a state in which the first captured image is displayed Displaying a second shot image and displaying a graphic object having a size corresponding to the total number of pre-stored images when a predetermined second gesture is input; and when a user touch on one point of the graphic object is input, And displaying information on a photographed image at a time point corresponding to the point.

Here, the step of displaying the graphic object may include displaying the graphic object in a bar shape having a length corresponding to the number of the entire images, and displaying information about the shot image, When the touch is inputted, the viewpoint is determined according to the distance from at least one end of the bar to the touch point, and a thumbnail image of the shot image photographed at the determined point of time can be displayed.

In addition, the step of displaying a graphic object may display the graphic object in the form of a bar having a length corresponding to the total number of the images, and the control method may further include, when a plurality of points are touched in the bar, And further displaying a plurality of indicators corresponding to each of the plurality of points on the bar.

According to another aspect of the present invention, there is provided a method for controlling a user terminal, the method comprising: when a predetermined third gesture is input in a state where the plurality of indicators are displayed on the bar, And when the user touch is input for the interval between the plurality of indicators in a state in which the plurality of indicators are extended, among the plurality of shot images matching in the interval between the plurality of indicators, And displaying a thumbnail image of the photographed image corresponding to the photographed image.

In addition, the step of additionally displaying a plurality of indicators on the bar may include displaying a thumbnail image bar (bar) for sequentially displaying thumbnail images of shot images that match the interval between the plurality of indicators when the plurality of indicators are displayed on the bar Can be further displayed on one side of the bar.

In addition, the control method of a user terminal according to an embodiment of the present invention may include displaying a switching screen representing a process of switching the first shot image to the second shot image when the second gesture is input, And displaying the graphic object in a superimposed manner on the switching screen.

The first gesture may be a drag or a flick gesture. The second gesture may be a long tap, a long tap and drag, a long tap and a flick, a double tap, a surface touch and drag, and a surface touch & flick gesture, and the information on the shot image includes at least one of a thumbnail image of the shot image, shooting date information, an image name, shooting place information, shooting device information, .

According to the various embodiments described above, in the single view mode state, the graphic object corresponding to the total number of pre-stored shot images and the position of the currently displayed image are displayed together, thereby improving the user's convenience.

1 is a block diagram according to an embodiment of the present invention;
FIGS. 2 (a) to 2 (c) are diagrams illustrating a basic operation of image switching by drag according to an embodiment of the present invention;
3 (a) to 3 (e) illustrate the operation of a long tap and drag according to an embodiment of the present invention,
Figures 4 (a) and 4 (b) illustrate possible placement of graphical objects in accordance with one embodiment of the present invention,
5A and 5B illustrate operations of a graphic object according to an exemplary embodiment of the present invention.
6A to 6C are diagrams illustrating an operation process of a graphic object according to an embodiment of the present invention.
7 illustrates an arrangement of UIs according to another embodiment of the present invention;
Figure 8 is a flow diagram according to an embodiment of the present invention, and
9 is a block diagram of a camera according to another embodiment of the present invention.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram according to an embodiment of the present invention.

1, the user terminal 100 may include a control unit 110, a display unit 120, and a storage unit 130.

The user terminal device 100 may be implemented by various devices including a display unit such as a digital camera, a TV, a mobile phone, a PDA, a notebook PC, a monitor, a tablet PC, an electronic book, an electronic photo frame, a kiosk,

The storage unit 130 may store the photographed image. Also, the storage unit 130 may store various information. The storage unit 130 may be a hard disk, a Blu-ray disk, a USB, a memory card, a ROM, or the like.

The display unit 120 may be implemented as an LCD display including a display panel (not shown) and a backlight unit (not shown). Alternatively, the display unit 120 may be an OLED type, a PDP type, Display. ≪ / RTI > The display unit 120 may display a first shot image which is one of the shot images.

The controller 110 displays a second shot image when a predetermined first gesture is input in a state where the first shot image is displayed and displays a second shot image when a predetermined second gesture is input, The graphic object of the corresponding size can be displayed on the display unit.

In this case, the first gesture may be a drag or a flick gesture. Generally, a user may use a finger, a touch fan, or the like on a smart phone. A flick gesture can be a gesture that speeds up the drag. Also, the second gesture can be at least one of a long tap, a long tap and drag, a long tap and flick, a double tap, a surface touch & drag, a surface touch & flick gesture have. The long tap refers to an operation of touching a finger or a touch pen with a touch panel (not shown) of the display unit for a predetermined time or more. For example, the user may press the touch panel of the user terminal for a few seconds. Long tap and flick means fast dragging with long tap. The double tap means an operation of continuously performing the tap operation twice. The surface touch refers to an operation when the area touched is larger than when the long tap operation is performed. For example, three fingers may be touched on the touch panel of the user terminal device.

In addition, the graphic object may have a size corresponding to the total number of images stored in the storage unit 130. [ Specifically, when 1000 thumbnail images are stored in the storage unit, the graphic object may be configured as a bar having a length of 5 centimeters. In addition, it may be composed of various shapes including a circle, a cylinder, and a 3D shape. The position of the current thumbnail image may be displayed using an indicator or the like. If the thumbnail image currently viewed by the user is a 500th image and the graphic object is 5 centimeters, then the thumbnail image currently viewed by the user may be at a 2.5 centimeter point.

When the user touches one point of the graphic object, the control unit 110 may display information on the captured image at a time point corresponding to the touch point on the display unit 120. [

When the user touches one point of the graphic object, the control unit 110 may display the information about the photographed image at the time point corresponding to the touch point on the display unit 120. A detailed description will be given in Fig.

The controller 110 may display the graphic object in the form of a bar having a length corresponding to the total number of images. And may be configured in the form of a bar 130 in FIG. 3 (b), which will be described later.

In addition, when a user's touch is input from a bar, the controller 110 determines a viewpoint based on a distance from at least one end of the bar to a touch point, and displays a thumbnail image Can be displayed. The detailed description will be also given in Fig. 3 which will be described later.

In addition, the controller 110 displays the graphic object in the form of a bar having a length corresponding to the total number of images, and when a plurality of points are touched in the bar, a plurality of indicators corresponding to the plurality of points are displayed in a bar (bar). 5 and 6, which will be described later.

2 (a) to 2 (c) are diagrams showing a basic operation of image switching by drag according to an embodiment of the present invention.

Referring to FIG. 2 (a), the user terminal 100 may include a display unit 120. A single view thumbnail image is displayed on the display unit 120. The display unit 120 can recognize the user touch and the touch pan. When the user u rubs the display unit 120 (u-1 to u-2), the single view thumbnail image (first image) can be converted to the next thumbnail (second image).

2 (c), the display unit 120 displays the image (second image) converted by the user drag. In the case of FIG. 2 (b), the right half of the first image and the left half of the second image are displayed. This is because the finger rubbed from right (u-1) to left (u-2). The screen of Fig. 2 (b) is referred to as a switching screen. The user operation may be a flick operation as well as a drag operation.

3 (a) to 3 (e) are diagrams illustrating an operation of a long tap and drag according to an embodiment of the present invention.

3 (a), the user's finger is at the u-1 position, and the user can touch one point 150-1 of the display unit 120 for several seconds. The touch can be called a long tap. The user u may perform the long tap to the one point 120-1 and then perform the drag to the u-2 point. A graphic object having a size corresponding to the total number of images stored in the storage unit 110 by the gesture described above can be displayed on the display unit. FIG. 3 (b) is a diagram reflecting the above description.

3 (b), when the second gesture is input, the graphics object can be superimposed and displayed on the switching screen while displaying the switching screen representing the process of switching the first shot image to the second shot image . The first captured image 120-1 is disposed on the left side of the display unit 120 and the second captured image 120-2 is disposed on the right side of the display unit 120. [ The screen composed of the above arrangement is the switching screen.

In this case, when the long tap and drag operation is inputted, while displaying the switching screen expressing the process of switching the first shot image 120-1 to the second shot image 120-2, Can be superimposed and displayed.

The display unit 120 may display the graphic object 130 having a size corresponding to the total number of images stored in the storage unit 130 on the display unit 120. [ In this case, the graphic object 130 can be displayed in the form of a bar having a length corresponding to the total number of images. For example, you could configure 1000 shot images with a 10cm bar. In this case, if the second captured image 120-2 is located at the 700th position, the position of the second captured image 120-2 can be expressed at the position 130-1 of 7 cm of the bar. Here, the case where the user touches another point 130-2 of the graphic object 130 corresponds to FIG. 3 (c).

According to Fig. 3 (c), the user u may touch the second point 130-2 of the graphic object 130. [ When the user touch 130-2 is input in the bar, the viewpoint is determined according to the distance from at least one end of the bar 130 to the touch point, and a thumbnail image of the shot image photographed at the determined point can be displayed . 3 (d).

3 (d), when a user touch is input to the second point 130-2, a thumbnail image 140 is displayed on one side of the display unit 120. [ Here, when the user u selects the thumbnail image 140, the selected thumbnail image 140 may be displayed entirely on the display unit 120 (Fig. 3 (e)) and may be partially displayed will be.

Figures 4 (a) and 4 (b) are diagrams showing possible placement of graphical objects in accordance with an embodiment of the present invention.

According to FIG. 4 (a), one image is displayed on the display unit 120, and the graphic objects 130 can be arranged vertically. The position of the currently displayed image may be displayed 130-1.

According to FIG. 4 (a), one image is displayed on the display unit 120, and the graphic objects 130 can be arranged horizontally. The position of the currently displayed image may be displayed 130-1. The shape of the graphic object can be configured in various ways.

5 (a) and 5 (b) illustrate operations of a graphic object according to an embodiment of the present invention.

5 (a), when two fingers of a user u touch two points on the graphic object 130, the first and second indicators 140-1 and 140-2 are displayed on the graphic object 130 ) Above.

Here, when the user u inputs a preset third gesture in a state where a plurality of indicators are displayed on the bar, the interval between the plurality of indicators can be extended to both ends of the bar and displayed. The third gesture means a state in which two fingers are touched while being touched.

For example, assuming that 1000 thumbnail images are stored in the storage unit and the graphic object 130 is 10 cm, if the user u opens his / her finger, if the 140-1 through 140-2 sections are 1 cm, Can be expressed. When the user inputs an enlargement command, the sections 140-1 to 140-2 are extended to 10 cm as shown in FIG. 5 (b). In this case, the graphic object has a length corresponding to 100 sheets.

If the user touches the plurality of indicator interval sections 140-1 to 140-2 in a state where the plurality of indicators 140-1 and 140-2 are extended, a plurality of indicator interval sections 140-1 (140) corresponding to the touch point (u) among the plurality of captured images matched with the touch point (u).

On the other hand, if two fingers are held together, a graphic object representing 1000 frames of 10 cm corresponding to 100 frames may be displayed. Here, the size and length of the graphic object corresponding to the thumbnail image may be defined by the setting of the user.

6A to 6C are diagrams illustrating an operation process of a graphic object according to an exemplary embodiment of the present invention.

6A, when a plurality of indicators 140-1 and 140-2 are displayed on the bar, the thumbnail images of the photographic images matched to the intervals 140-1 to 140-2 of the plurality of indicators are sequentially A thumbnail image bar (bar) 150 for displaying the thumbnail image can be additionally displayed on one side of the bar. The thumbnail image bar 150 may include a predetermined number of thumbnail images. In the case of FIG. 6 (a), thumbnail images of six (150-1 to 150-6) are arranged, but they can be set differently.

In this case, when the user selects one thumbnail image 150-1 of the thumbnail bar 150 as in the case of FIG. 6 (b), the corresponding thumbnail is displayed on the display unit 120 as shown in FIG. 6 (c) .

7 is a diagram illustrating an arrangement of a UI according to another embodiment of the present invention.

7, the screen of the entire display unit 120 is divided (120-1, 120-2). A first image is displayed in the first area 120-1 of the screen. When the user u touches one point of the graphic object, the thumbnail image 150-n corresponding to one point is displayed in the second area 120-2. 1) is displayed. Information 160 about the shot image can also be arranged. A thumbnail image of the photographed image, photographed date information, image name, photographed location information, photographed device information, and photographer name.

Figure 8 is a flow diagram according to one embodiment of the present invention.

Referring to FIG. 8, the control method of the user terminal device displays the first captured image, which is one of the previously stored captured images (S810). The first photographed image may be an image photographed by a user, and may be a still image of a moving image.

Next, when a predetermined first gesture is inputted (S820), the second shot image is displayed (S840). The first gesture may be an operation such as dragging or flicking. The second captured image is a captured image disposed before and after the first captured image.

On the other hand, if a predetermined second gesture is input (S830), a graphic object having a size corresponding to the total number of previously stored images is displayed (S850). Here, the second gesture may be at least one of a long tap, a long tap and drag, a long tap and flick, a double tap, a surface touch & drag, and a surface touch & flick gesture .

In this case, when the user touches one point of the graphic object, information on a captured image at a time point corresponding to the touch point is displayed (S860). The viewpoint corresponding to the touch point may be the position of the currently displayed image of the graphic object having the size corresponding to the total number of previously stored images.

In addition, the step of displaying the graphic object (S850) may display the graphic object in the form of a bar having a length corresponding to the total number of images. In operation S860, when the user touches the bar, a point of time is determined according to the distance from at least one end of the bar to the touch point, A thumbnail image can be displayed.

In addition, the step of displaying the graphic object (S850) may display the graphic object in the form of a bar having a length corresponding to the total number of images. In this case, when a plurality of points are touched in the bar, the control method of the user terminal device may additionally display a plurality of indicators corresponding to each of the plurality of points on the bar.

Also, when a predetermined third gesture is input in a state where a plurality of indicators are displayed on the bar, the interval between the plurality of indicators can be extended to both ends of the bar and displayed. In this case, when a user touch is input in a plurality of intervals between a plurality of indicators in a state in which a plurality of indicators are extended, a thumbnail image of the shot image corresponding to the touch point among the plurality of shot images matching in the interval between the plurality of indicators Can be displayed.

The step of additionally displaying a plurality of indicators on the bar may include displaying a thumbnail image bar for sequentially displaying a thumbnail image of photographed images matched in a plurality of intervals between the plurality of indicators, Can be additionally displayed.

In addition, when the second gesture is input, the control method of the user terminal device displays the switching screen expressing the process of switching the first shot image to the second shot image while superimposing and displaying the graphic object on the switching screen .

Also, information about the photographed image can be displayed. The information on the photographed image may include at least one of a thumbnail image of the photographed image, photographed date information, image name, photographed location information, photographed device information, and photographer name.

9 is a block diagram of a camera according to another embodiment of the present invention.

An example of a user terminal device may be a camera. The camera 200 includes a photographing unit 210, a communication unit 220, control modules (RAM 230-1, ROM 230-2, GPU 230-3, CPU 230-4) (The display panel 240-1 and the detection sensor 240-2).

The sensing sensor 240-2 is a component for sensing a physical touch input through the user's body or other objects. When a touch is detected, the detection sensor 240-2 outputs a touch event value corresponding to the detected point. The sensing sensor 240-2 may include various types of touch sensors such as a capacitance type or a pressure sensitive type as described above.

The communication unit 220 can communicate with an external device via Wi-Fi, Bluetooth, or the like. The GPU 230-3 can control to display a UI such as a graphic object.

Meanwhile, the control method of the display device according to the above-described various embodiments may be implemented as a program and provided to the user terminal device. Specifically, the method includes displaying a first captured image, which is one of pre-stored captured images, displaying a second captured image when a predetermined first gesture is input while the first captured image is displayed, Displaying a graphical object having a size corresponding to the number of all previously stored images when a user touches one point of the graphic object, and displaying a graphical object corresponding to a point of time corresponding to the touch point, A non-transitory computer readable medium may be provided on which the program containing the step of displaying information is stored.

A non-transitory readable medium is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the apparatus. In particular, the various applications or programs described above may be stored on non-volatile readable media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM,

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention.

100: user terminal device 110:
120: display unit 130: storage unit

Claims (14)

In a user terminal,
A storage unit for storing a shot image;
A display unit for displaying a first shot image which is one of the shot images;
When a predetermined first gesture is input in a state in which the first captured image is displayed, a second captured image is displayed, and when a predetermined second gesture is input, a graphics object having a size corresponding to the total number of images stored in the storage unit And a control unit for displaying on the display unit,
Wherein the control unit displays information on a photographed image at a time point corresponding to a touch point on the display unit when a user touch on one point of the graphic object is input. The method according to claim 1,
Wherein,
Displaying the graphic object in a bar form having a length corresponding to the number of the entire images,
Wherein when the user touch is input in the bar, the viewpoint is determined according to a distance from at least one end of the bar to the touch point, and a thumbnail image of the shot image photographed at the determined point is displayed User terminal. The method according to claim 1,
Wherein,
And displaying the graphic object in a bar shape having a length corresponding to the total number of the images. When a plurality of points are touched in the bar, a plurality of indicators corresponding to the plurality of points are additionally displayed on the bar To the user terminal device. The method of claim 3,
Wherein,
Wherein when a predetermined third gesture is input while the plurality of indicators are displayed on the bar, the interval between the plurality of indicators is extended to both ends of the bar,
When the user touch is input for the interval between the plurality of indicators in a state in which the plurality of indicators are extended, a thumbnail of the shot image corresponding to the touch point among the plurality of shot images matching in the interval between the plurality of indicators And displays the image. The method of claim 3,
Wherein,
And a thumbnail image bar for sequentially displaying a thumbnail image of photographed images matched in the interval between the plurality of indicators is additionally displayed on one side of the bar when the plurality of indicators are displayed on the bar. . The method according to claim 1,
Wherein,
Wherein when the second gesture is input, the display unit displays a switching screen representing a process of switching the first shot image to the second shot image, and displays the overlapping graphics object on the switching screen. Terminal device. 7. The method according to any one of claims 1 to 6,
Wherein the first gesture is a drag or flick gesture,
The second gesture is at least one of a long tap, a long tap and drag, a long tap and flick, a double tap, a surface touch & drag, and a surface touch & flick gesture,
The information about the photographed image may be,
Wherein the information includes at least one of a thumbnail image of the photographed image, a photographed date information, an image name, photographing place information, photographing apparatus information, and photographer name. A method of controlling a user terminal device,
Displaying a first captured image which is one of pre-stored captured images;
When a predetermined first gesture is input in a state where the first shot image is displayed, a second shot image is displayed. When a predetermined second gesture is input, a graphic object having a size corresponding to the number of previously stored images is displayed step; And
And displaying information about a photographed image at a time point corresponding to a touch point when a user touch on one point of the graphic object is input. 9. The method of claim 8,
Wherein the displaying the graphic object comprises:
Displaying the graphic object in a bar form having a length corresponding to the number of the entire images,
Wherein the step of displaying information on the captured image comprises:
Wherein when the user touch is input in the bar, the viewpoint is determined according to a distance from at least one end of the bar to the touch point, and a thumbnail image of the shot image photographed at the determined point is displayed , Control method. 9. The method of claim 8,
Wherein the displaying the graphic object comprises:
Displaying the graphic object in a bar form having a length corresponding to the number of the entire images,
In the control method,
Further comprising displaying a plurality of indicators corresponding to each of the plurality of points on the bar when a plurality of points are touched in the bar. 11. The method of claim 10,
Expanding a gap between the plurality of indicators to both ends of the bar when the predetermined third gesture is input while the plurality of indicators are displayed on the bar; And
When the user touch is input for the interval between the plurality of indicators in a state in which the plurality of indicators are extended, a thumbnail of the shot image corresponding to the touch point among the plurality of shot images matching in the interval between the plurality of indicators Further comprising the step of: displaying an image. 11. The method of claim 10,
Wherein the step of additionally displaying the plurality of indicators in the bar further comprises:
And a thumbnail image bar for sequentially displaying a thumbnail image of photographed images matched in the interval between the plurality of indicators is additionally displayed on one side of the bar when the plurality of indicators are displayed on the bar. Lt; / RTI > 9. The method of claim 8,
And displaying the conversion screen representing the process of switching the first shot image to the second shot image when the second gesture is input and displaying the graphic object on the conversion screen in a superimposed manner Lt; / RTI > 14. The method according to any one of claims 8 to 13,
Wherein the first gesture is a drag or flick gesture,
The second gesture is at least one of a long tap, a long tap and drag, a long tap and flick, a double tap, a surface touch & drag, and a surface touch & flick gesture,
The information about the photographed image may be,
A thumbnail image of the photographed image, a photographed date information, an image name, photographing place information, photographing apparatus information, and photographer name.

Images