TWI681320B - Method of providing content of a device and the device - Google Patents

Abstract

A method of providing content of a device and the device are provided. The device includes a display configured to display content, and an interface configured to receive a first input that selects a part of the displayed content, and a second input that requests to change a size of the displayed content. The device further includes a controller configured to control the display to display the selected part of the displayed content and an unselected part of the displayed content by changing a size of the selected part and a size of the unselected part to be different from each other, in response to the interface receiving the second input.

Description

Method for providing content of device and said device

The method and apparatus consistent with the exemplary embodiment are related to a method and apparatus for providing content.

[Cross-reference to related applications]

This application claims Korean Patent Application No. 10-2014-0098480 filed with the Korean Intellectual Property Office on July 31, 2014, and Korean Patent Application No. 10-2014-0173240 filed on December 4, 2014 As well as the priority of Korean Patent Application No. 10-2015-0075369 filed on May 28, 2015, the disclosure contents of the application are all incorporated herein by reference.

The mobile terminal is a portable device equipped with at least one of functions of performing voice and video calls, inputting or outputting information, and storing data while carrying. As functions are diversified, mobile terminals are gradually equipped to perform complex functions such as capturing images or animations, reproducing music files or animation files, playing games, receiving broadcasts, accessing wireless Internet, etc. Implemented in the form of a multimedia player.

The exemplary embodiments solve at least the above problems and/or disadvantages, as well as other disadvantages not described above. In addition, the exemplary embodiments are not required to overcome the disadvantages described above, and the exemplary embodiments may not overcome any of the problems described above.

The exemplary embodiments provide a method and apparatus for providing content by modifying selected portions of content and unselected portions of content provided by a device to be different from each other.

According to an aspect of the exemplary embodiment, there is provided an apparatus including: a display configured to display content; and an interface configured to receive a first input that selects a portion of the displayed content, and a request to change the display The second input for the size of the content. The device further includes a controller configured to control the display to display the selected portion of the displayed content and the unselected content by changing the size of the selected portion and the size of the unselected portion to be different from each other In response to the interface that received the second input.

The controller may be further configured to control the display to increase the size of the selected portion of the displayed content at the first magnification, and to reduce the unselected portion of the displayed content at the second magnification determined based on the first magnification the size of.

The first input may use an input tool to select a portion of the displayed content, and the controller may be further configured to determine the first magnification based on at least one of the thickness, color, and style of the first input.

The second input may include an open pinch, and the controller may be further configured to determine the first magnification based on the distance moved by the two fingers in the pinch open.

The controller may be further configured to control the display to stop the display of the unselected portion of the displayed content and display the first icon instead of the unselected portion of the displayed content.

The interface may be further configured to receive a third input that selects the first icon, and the controller may be further configured to respond to the interface receiving the third input, control the display to display unselected portions of the displayed content, and to The first icon changes to the second icon.

The interface may be further configured to receive a fourth input selecting the second icon, and the controller may be further configured to control the display to stop the display of unselected portions of the displayed content, and change the second icon to the first An icon in response to the interface receiving the fourth input.

The content may include at least one of handwritten text, key text, and image content.

An aspect according to another exemplary embodiment provides a device including: a display configured to display audio/video (A/V) content; an interface configured to receive a selected display A /V content section input; and a controller configured to control the reproduction speed of the selected section of the displayed A/V content and the reproduction speed of the unselected section of the displayed A/V content to be mutually different.

The display can be further configured to display a timetable indicating the reproduction time point of the A/V content, the input can select the first position and the second position on the timetable, and the controller can be further configured to determine the displayed A/V The selected section of the V content is between the first position and the second position.

The interface can be further configured to receive two-finger pinch with two fingers touching the first position and the second position and moving in directions toward or away from each other (close pinch) or two fingers open, and the controller can be further configured to determine the reproduction speed of the selected section of the displayed A/V content and the displayed A/V content based on the direction and distance of the movement of the two fingers The reproduction speed of the unselected section of.

According to an aspect of another exemplary embodiment, there is provided a method of providing content of a device, the method including displaying content; and receiving a first input that selects a portion of the displayed content, and a second input requesting to change the size of the displayed content . The method further includes displaying the selected portion of the displayed content and the unselected portion of the displayed content by changing the size of the selected portion and the size of the unselected portion to be different from each other in response to receiving the second input interface.

Displaying the selected portion and the unselected portion may include increasing the size of the selected portion of the displayed content at the first magnification, and reducing the unselected portion of the displayed content at the second magnification determined based on the first magnification the size of.

The first input may use an input tool to select a portion of the displayed content, and the method may further include determining the first magnification based on at least one of the thickness, color, and style of the first input.

The second input may include two-finger splaying, and the method may further include determining the first magnification based on the distance moved by the two fingers in the two-finger splaying.

Displaying the selected portion and the unselected portion may include stopping the display of the unselected portion of the displayed content, and displaying the first icon instead of the unselected portion of the displayed content.

The method may further include receiving a third input selecting the first icon, and in response to receiving the third input, displaying an unselected portion of the displayed content, and changing the first icon to the second icon.

According to an aspect of another exemplary embodiment, there is provided an internal Content method, the method includes displaying audio/video (A/V) content, receiving input to select a segment of displayed A/V content, and reproducing the selected segment of displayed A/V content and displaying A The reproduction speed of the unselected section of the /V content is controlled to be different from each other.

The method may further include displaying a timetable indicating the reproduction time point of the A/V content, wherein the first position and the second position on the input timetable are selected, and the selected section of the displayed A/V content is determined at the first position and Between the second position.

The method may further include receiving a two-finger pinch or two-finger splay that two fingers touch the first position and the second position and respectively move in directions toward or away from each other, and the control may include the direction based on the movement of the two fingers And the playback speed of the selected section of the displayed A/V content and the playback speed of the unselected section of the displayed A/V content.

According to an aspect of another exemplary embodiment, there is provided an apparatus including: a display configured to display content; an interface configured to receive input selecting a portion of displayed content; and a controller configured to The configuration is to control the selected portion of the displayed content and the unselected portion of the displayed content by changing the size of the selected portion and the size of the unselected portion to be different from each other.

The content may include video content, and the controller may be further configured to increase the size of the selected portion of the displayed video content and reduce the size of the unselected portion of the displayed video content.

The interface can be further configured to receive a size change input requesting to change the size of the displayed content, and the controller can be further configured to increase the size of the selected portion of the displayed content in response to receiving a clockwise round The size changes the input interface and reduces the size of the selected portion of the displayed content in response to receiving The size of the counterclockwise circle changes the input interface.

The interface can be further configured to receive a size change input requesting to change the size of the displayed content, and the controller can be further configured to increase the size of the selected portion of the displayed content in response to receiving the The size changes the input interface, and reduces the size of the selected portion of the displayed content in response to the interface receiving the size change input including two-finger pinch.

100‧‧‧ installation

111‧‧‧Short-range wireless communication interface

112‧‧‧Mobile communication interface

113‧‧‧Broadcast receiver

120‧‧‧Output interface

121‧‧‧Monitor

122‧‧‧Sound output interface

123‧‧‧Vibration motor

130‧‧‧Controller

140‧‧‧User interface

150‧‧‧sensor

151‧‧‧Geomagnetic sensor

152‧‧‧Acceleration sensor

153‧‧‧Temperature/Humidity Sensor

154‧‧‧Infrared sensor

155‧‧‧Gyroscope sensor

156‧‧‧Position sensor

157‧‧‧Atmospheric sensor

158‧‧‧Proximity sensor

159‧‧‧RGB sensor

160‧‧‧Audio/Video (A/V) interface

161‧‧‧Camera

162‧‧‧Microphone

170‧‧‧Memory

171‧‧‧UI module

172‧‧‧Touch screen module

173‧‧‧Notification Module

200‧‧‧Input tool

310‧‧‧Parts/Highlighted parts

320,910‧‧‧User input

340, 361, 363, 1020, 1120, 1410 ‧‧‧ selected part

350, 362, 1010, 1420 ‧‧‧ unselected part

410, 830‧‧‧ closed curve

420‧‧‧Enter mark

430‧‧‧ underline

510, 2230, 2810‧‧‧Pinch input

520, 920, 1420, 2430, 2910

610, 1110, 3510 ‧‧‧ "Expand" icon

620, 1130, 3530‧‧‧ "fold" icon

810‧‧‧Highlight

820, 3410‧‧‧ search window

930‧‧‧Enlarge button

1140‧‧‧Key text hidden part

1320‧‧‧rectangular area

1510, 1610, 1620, 1630‧‧‧ video content

1520, 1650, 2010, 2140‧‧‧ video

1810, 1920, 2205, 2405, 2720, 2820, 2920

1815‧‧‧

1830, 1930, 2210, 2310, 2410, 2510, 2731, 2831, 2931‧‧‧The first icon

1840, 1940, 2220, 2320, 2420, 2520, 2732, 2832, 2932‧‧‧Second icon

1910‧‧‧Setting window

2110‧‧‧Extracted frame

2120‧‧‧Extracted frame

2710‧‧‧Information

3010‧‧‧Voice list

3020‧‧‧Reproduction speed setting menu

3210‧‧‧rectangular icon

3220‧‧‧Enlarge input icon

3230‧‧‧Reduced input icon

3310‧‧‧ Selected items

3320‧‧‧ unselected items

3420‧‧‧Keyword "Chinjeol Mart"

3431‧‧‧First project

3432‧‧‧The second project

3433‧‧‧The third project

3520‧‧‧ number

3610‧‧‧Scroll bar

3620‧‧‧Region

P1‧‧‧First position

P2‧‧‧Second position

P3‧‧‧ third position

P4‧‧‧ fourth position

S210, S220, S230, S240, S710, S720, S730, S740, S1210, S1220, S1230, S1240, S1710, S1720, S1730, S1740, S2610, S2620, S2630, S2640, S3110, S3120, S3130, S3140 operating

The above and/or other aspects will be more apparent by referring to the accompanying drawings to describe the exemplary embodiments.

FIG. 1 is a view of a system for providing content according to an exemplary embodiment.

FIG. 2 is a flowchart of a method of displaying handwritten text content by enlarging or reducing it according to an exemplary embodiment.

3A to 3D are views illustrating a method of displaying content by enlarging or reducing content according to an exemplary embodiment.

4A to 4C are views illustrating a method of selecting a portion of handwritten text content according to an exemplary embodiment.

5A and 5B are views illustrating an input requesting enlargement or reduction of handwritten text content according to an exemplary embodiment.

6A and 6B are views illustrating a method of displaying modified handwritten text content on a display according to an exemplary embodiment.

FIG. 7 is a flowchart of a method for displaying text by zooming in or zooming out text according to an exemplary embodiment.

8A to 8C are diagrams illustrating text content of a selection key according to an exemplary embodiment Partial view of the method.

9A and 9B are views illustrating an enlarged input requesting selected key text content according to an exemplary embodiment.

FIG. 10 is a view of a screen displaying enlarged and reduced keystroke text content according to an exemplary embodiment.

11A and 11B are views illustrating a method of displaying modified key-type text content on a display according to an exemplary embodiment.

FIG. 12 is a flowchart of a method of displaying image content by zooming in or out thereof according to an exemplary embodiment.

13 is a view illustrating a method of selecting a part of video content according to an exemplary embodiment.

FIG. 14 is a view illustrating a method of displaying image content by enlarging or reducing it according to an exemplary embodiment.

15 and 16 are views illustrating a method of displaying image content by enlarging or reducing it according to an exemplary embodiment.

17 is a flowchart of a method of reproducing a video content by changing its reproduction speed according to an exemplary embodiment.

18 and 19 are views illustrating a method of selecting a partial section of all sections of video content according to an exemplary embodiment.

20, 21A, and 21B are views illustrating a method of reproducing video content by changing the reproduction speed of the video content according to an exemplary embodiment.

22 is a view illustrating an input requesting a change in the reproduction speed for a selected section of video content according to an exemplary embodiment.

23A and 23B illustrate different settings according to the input in FIG. 22 A view of the method for determining the reproduction speed of the selected section.

24 is a view illustrating an input requesting a change in the reproduction speed for a selected section of video content according to an exemplary embodiment.

25A and 25B are views for explaining a method of differently setting the reproduction speed of the section selected according to the input request in FIG. 24.

26 is a flowchart of a method of reproducing an audio content by changing its reproduction speed according to an exemplary embodiment.

FIG. 27 is a view illustrating a method of selecting a partial section of all sections of audio content according to an exemplary embodiment.

28 and 29 are views illustrating an input requesting a change in the reproduction speed for a selected section of audio content according to an exemplary embodiment.

FIG. 30 is a view illustrating a method of reproducing audio content by changing the reproduction speed of the audio content according to an exemplary embodiment.

FIG. 31 is a flowchart of a method of displaying a list by enlarging or reducing it according to an exemplary embodiment.

FIG. 32 is a view illustrating a method of selecting at least one item of a list according to an exemplary embodiment.

FIG. 33 is a view of a screen displaying the list by enlarging or reducing the list according to an exemplary embodiment.

FIG. 34 is a view illustrating a method of selecting at least one item of a list according to an exemplary embodiment.

35A and 35B are views illustrating a method of displaying a modified list on a display according to an exemplary embodiment.

FIG. 36 is a diagram illustrating display of a modified clear on a display according to an exemplary embodiment View of single method.

FIG. 37 is a block diagram of a structure of an apparatus according to an exemplary embodiment.

38 is a block diagram of a structure of a device according to another exemplary embodiment.

Exemplary embodiments are described in more detail herein with reference to the accompanying drawings.

In the following description, even in different drawings, reference numbers of similar drawings are used for similar elements. The matters defined in the description, such as detailed construction and elements, are provided to assist in a comprehensive understanding of the exemplary embodiments. However, it is apparent that the exemplary embodiments can be practiced without those specifically defined matters. In addition, well-known functions or constructions are not described in detail since they would obscure the description with unnecessary details.

It will be understood that the term "comprises and/or comprising" as used herein specifies the presence of stated features or components, but does not exclude the presence or addition of one or more other features or components. In addition, terms such as "unit", "...er (-er, -or)" and "module" described in this specification refer to elements for performing at least one function or operation, and may Implemented by hardware, software, or a combination of hardware and software.

Throughout the specification, "touch input" may refer to a schematic action performed by the user on the touch screen to control the device. The touch gestures described in this specification may include tapping, touching and holding, double tapping, dragging, moving horizontally, toggling, dragging, and dropping.

"Tap" means that the user touches the screen by using a finger or a touch tool such as an electronic pen (eg, stylus) and then immediately self-screens without moving The movement of the curtain to lift a finger or touch a tool.

"Touch and hold" is a motion in which the user touches the screen by using a finger or a touch tool such as an electronic pen and then maintains the above touch motion for a period of time (for example, 2 seconds) after touching the screen. In other words, the time difference between the touch start time and the touch end time is greater than or equal to, for example, 2 seconds. When the touch input continues in time to remind the user that the touch input is light touch or touch and hold, the feedback signal can be provided in a visual, acoustic, or tactile manner. The time may vary according to the embodiment.

"Double touch" is the movement of the user by touching the screen twice with a finger or a touch tool.

"Dragging" is the movement of the user by touching the screen with a finger or touch tool and moving the finger or touch tool to another location on the screen while maintaining the touch motion. The dragging movement can realize the movement of the object or horizontal movement.

"Horizontal movement" refers to a movement in which the user performs a drag movement without selecting an object. Since no objects are selected in the horizontal movement motion, no objects move in the page, but the page itself moves on the screen or a group of objects can be moved within the page.

"Toggle" refers to a motion in which a user performs a drag motion at a speed of, for example, 100 pixels/second by using a finger or a touch tool. A dragging (horizontal movement) motion or a tossing motion can be distinguished based on whether the moving speed of the finger or the touch tool is at a speed of, for example, 100 pixels/second.

"Drag and drop" is a movement in which a user drags an object to a predetermined position on the screen by using a finger or a touch tool, and then places the object at this position.

"Pinch" refers to the movement of the user moving two fingers touching the screen in opposite directions. The pinch-in motion is zooming in (two fingers open) or pinching (two fingers pinching) The gesture of the object or page. The enlargement value or contraction value is determined according to the distance between two fingers.

"Sliding" is the movement of a user by touching an object on the screen with a finger or a touch tool and moving the object horizontally or vertically for a predetermined distance at the same time. The sliding motion in the diagonal direction may not be recognized as a toggle event.

In addition, in the exemplary embodiment, the button input may include a physical user interface (PUI) button input and a graphical user interface (GUI) button input.

In addition, in an exemplary embodiment, the motion input may include user motion input and device motion input. In the case of user motion input, the user's motion can be recognized through the camera. In the case of device motion input, the device can recognize the movement of the device via an acceleration sensor or a gyroscope sensor.

For example, the user motion input may be an input that moves the user's hand away or toward the device, an input that moves the user's hand from right to left or left to right, and a user's hand from top to bottom Or input that moves from bottom to top or input that opens or closes the user's hand.

In addition, the device motion input may be an input to shake the device left and right and up and down, and an input to move the device away or toward the device.

FIG. 1 is a view of a system for providing content according to an exemplary embodiment.

Referring to FIG. 1, the system includes an apparatus 100 and an input tool 200, each of which is discussed in detail below.

The device 100 may be a mobile phone, a smart phone, a laptop computer, a tablet PC, an e-book terminal, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (portable multimedia) player; PMP), navigation device, MP3 player, digital camera, wearable device (eg, glasses or wrist watch), etc., but the exemplary embodiment is not limited thereto.

The device 100 is a device that reproduces various types of content. For example, the content may be handwritten text content, key text content, image content, video content, audio content, list, etc., but the exemplary embodiment is not limited thereto.

The handwritten text content can be a set of strokes entered in a predetermined time sequence. The stroke may represent a trajectory drawn from the touch point on the device 100 by the input tool 200 that maintains the touch. For example, in the equation "3+2=5", when the user draws out each of "3" and "2" without interruption while maintaining the touch, "3" and "2" Each of them can constitute a stroke. For the symbol "+", the user first draws "-" and then draws "|", so that "-" and "|" can each constitute a stroke. One stroke can constitute a character or symbol, or multiple strokes can constitute a character or symbol.

Alternatively or additionally, each stroke contained in the handwritten text content is relative to time information. The time information of the stroke may correspond to the time point at which the stroke is generated or changed. The time information of the stroke can be recorded according to a time stamp format representing time.

The keystroke text content may be a list of characters in sequence, or the list may contain items with the same attributes arranged in sequence.

In addition, the device 100 may display handwritten text content, keystroke text content, video content, list, etc. on the display 121 (FIG. 37) of the device 100. In addition, the device 100 can reproduce video content, audio content, etc., and display a content reproduction screen on the display 121. However, the present exemplary embodiment is not limited to this.

In addition, the input tool 200 is a device used by a user to input information to the device 100. For example, the input tool 200 may be a finger or an electronic pen (for example, (Stylus), keyboard, mouse, etc., but the exemplary embodiment is not limited thereto. The device 100 may receive a user's touch input, and the input tool 200 may receive a touch input on the device 100.

The device 100 may receive input of a partial area of content selected by a user using the input tool 200.

For example, referring to FIG. 1, the user can select the portion of the handwritten text content by highlighting or underlining the portion of the handwritten text content displayed on the device 100 (by using the input tool 200 ). The device 100 can identify the part of the content of the handwritten text in units of strokes or coordinates. For example, the portion of the handwritten text content can be determined by the coordinate value on the coordinate plane corresponding to the display 121 (first coordinate information) or the coordinate value on the coordinate plane corresponding to all the handwritten text content (second coordinate information ) Presented. Alternatively or additionally, the portion of the handwritten text content may be presented by strokes included in the portion of the handwritten text content.

Alternatively or additionally, the user may select the portion of the keystroke text content displayed on the device 100 by using the input tool 200. The device 100 can identify the portion of the keystroke text content in units of coordinates or characters. For example, the portion of the keystroke text content can be determined by the coordinate value on the coordinate plane corresponding to the display 121 (first coordinate information) or the coordinate value on the coordinate plane corresponding to all keystroke text content (second Coordinate information) is presented. Alternatively or additionally, the portion of the keystroke text content may be presented by the characters contained in the portion of the keystroke text content.

Alternatively or additionally, the user may select the part of the image content displayed on the device 100 by using the input tool 200. The device 100 can identify the part of the video content in units of coordinates or objects. For example, the part of the image content can be determined by the coordinate value (first coordinate information) on the coordinate plane corresponding to the display 121 or The coordinate value (second coordinate information) on the coordinate plane corresponding to all image content is presented. Alternatively or additionally, the part of the video content may be presented by objects (eg, people, buildings, characters, etc.) contained in the part of the video content.

Alternatively or additionally, the user may select a portion of the video content or audio content to be reproduced by the device 100 by using the input tool 200. The device 100 can recognize partial sections of video content in units of time. For example, the total reproduction time of the video content is 1 hour, 12 minutes and 23 seconds, which can be selected between 0 seconds when the video content starts and 1 hour, 12 minutes and 23 seconds when the video content ends Part of the section. Therefore, based on the start time of the video content, part of the video content can be presented with time information.

In addition, like the video content, the device 100 can recognize a partial section of the audio content in units of time. Based on the start time of the audio content, part of the audio content can be presented with time information.

Alternatively or additionally, the user may select a portion of the list displayed on the device 100. The device 100 can identify the part of the list in units of items.

The above-mentioned system for providing content is described in detail below with reference to the accompanying drawings.

FIG. 2 is a flowchart of a method of displaying handwritten text content by enlarging or reducing it according to an exemplary embodiment.

Referring to FIG. 2, in operation S210, the device 100 displays the content of the handwritten text on the display 121.

The handwritten text content may represent content obtained by converting the user's handwriting input into digital information. For example, the handwritten text content may include handwritten images, handwritten text, etc. drawn on the digital device, but the exemplary embodiment is not limited thereto. this In addition, the handwritten text content may be generated by the device 100 based on the received touch input on the device 100, or may be generated by and received from an external device.

The device 100 can display handwritten text content on the execution window of the application program. For example, the application program may include a writing laptop application, a memo application, a diary application, a calendar application, an e-book application, a household ledger, etc., but this exemplary embodiment is not limited thereto.

In operation S220, the device 100 receives an input to select a portion of the displayed handwritten text content.

For example, the user can highlight or underline portions of the handwritten text content displayed on the device 100 by using the input tool 200. The device 100 may determine that the highlighted or underlined portion of the handwritten text content is selected.

In addition, the user can draw a closed curve such as a circle or polygon by using the input tool 200. The device 100 may determine that the portion of the handwritten text content included in the drawn closed curve is selected.

In operation S230, the device 100 receives user input to modify (enlarge or reduce) the content of the handwritten text.

For example, the input requesting the enlargement or reduction of the content of the handwritten text may include input of a stroke pattern, button input, user motion input, device motion input, voice input, etc., but the exemplary embodiment is not limited thereto.

In operation S240, the device 100 enlarges or reduces the selected handwritten text content and the unselected handwritten content by different magnifications to display on the display 121.

For example, when the device 100 receives an input requesting the enlargement of the handwritten text content, it may enlarge the selected portion of the handwritten text content at the first magnification and may Amplify the unselected portion of the handwritten text content at a second magnification, where the first magnification can be greater than the second magnification.

In another example, when the device 100 receives an input requesting reduction of the handwritten text content, it may reduce the selected portion of the handwritten text content by the first magnification and reduce the unselected portion of the handwritten text content by the second magnification , Where the first magnification can be greater than the second magnification. In yet another example, when the device 100 receives an input requesting reduction of the handwritten text content, the selected portion of the handwritten text content may be reduced at a magnification of 1 (that is, not reduced), and may be reduced by 0.5 times The magnification reduces the unselected part of the content of the handwritten text, but the exemplary embodiment is not limited thereto.

The above operation will be described in detail below with reference to the accompanying drawings.

3A to 3D are views illustrating a method of displaying content by enlarging or reducing content according to an exemplary embodiment.

Referring to FIG. 3A, the device 100 executes a note application program, and displays handwritten text content on the note application program execution screen. The handwritten text content may be generated by the device 100 based on user input or received from an external device.

The device 100 may receive input by the user using the input tool 200 to select a portion of handwritten text content. For example, as illustrated in FIG. 3A, a user uses an input tool 200 (for example, an electronic pen) to highlight the portion 310 of the handwritten text content to be selected by dragging an area displaying the portion 310 of the handwritten text content to be selected . Therefore, the device 100 determines that the highlighted portion 310 of the handwritten text content is selected.

After selecting a portion of the handwritten text content, the device 100 may receive user input requesting enlargement or reduction of the selected portion of the handwritten text content. For example, as illustrated in FIG. 3B, when a clockwise circle is received on the display 121, When the user inputs 320, the device 100 determines that the user input 320 is an input requesting enlargement of the selected portion of the handwritten text content. In contrast, when a user input that draws a circle counterclockwise on the display 121 is received, the device 100 may determine that the user input 320 is an input requesting reduction of the selected portion of the handwritten text content.

In response to an input requesting an enlargement of the selected portion of the handwritten text content (eg, a clockwise rounded input), the device 100 may only enlarge the selected portion of the handwritten text content. For example, as illustrated in FIG. 3C, the device 100 may be displayed by enlarging the selected portion 340 of the handwritten text content at a predetermined magnification. In addition, as illustrated in FIG. 3B, when the user inputs the magnification by using the input tool 200, the device 100 may display the selected portion 340 of the content of the handwritten text according to the input magnification.

In contrast, in response to an input requesting reduction of the selected portion of the handwritten text content (eg, a counterclockwise rounded input), the device 100 may reduce only the selected portion of the handwritten text content.

In addition, in response to an input requesting an enlargement of the selected portion of the handwritten text content (eg, a clockwise rounded input), the device 100 may enlarge the selected portion of the handwritten text content and reduce the unselected portion of the handwritten text content (eg, , Unselected portion 350 of FIG. 3C). In this state, the selected portion of the handwritten text content can be enlarged at a predetermined magnification, and the unselected portion of the handwritten text content can be reduced at a predetermined magnification.

In addition, when the user inputs the magnification by using the input tool 200, the device 100 may enlarge the selected portion of the handwritten text content at the input magnification, and reduce the unused content of the handwritten text content based on the magnification of the selected portion of the handwritten text content Selected part. For example, when the selected portion of the handwritten text is enlarged twice , You can reduce the unselected part of the handwritten text by 0.5 times. When the selected part of the handwritten text content is enlarged three times, the unselected part of the handwritten text content can be reduced by 1/3 times. However, the present exemplary embodiment is not limited to this.

The device 100 may display by zooming in on the highlighted portion of the handwritten text content by two times, and by reducing the unhighlighted portion of the handwritten text content by 1/2 times. Therefore, the user can recognize the main part of the handwritten text content at first glance, for example, the highlighted part of the handwritten text content.

In contrast, in response to an input requesting reduction of the selected portion of the handwritten text content (eg, counterclockwise input), the device 100 may reduce the selected portion of the handwritten text content and the content of the handwritten text content at different magnifications. The unselected parts are illustrated in Figure 3D. For example, the selected portion 361/363 of the handwritten text content can be reduced by 0.75 times, and the unselected portion 362 of the handwritten text content can be reduced by 0.5 times. The selected portion 361/363 of the handwritten text content may be doubled (that is, not reduced), and only the unselected portion 362 of the handwritten text content may be reduced by 0.5 times. Therefore, when the user continuously inputs a request to reduce the selected portion of the handwritten text content, the unselected portion of the handwritten text content is further reduced compared to the selected portion of the handwritten text content, and therefore the first glance Identify selected portions of handwritten text content.

Alternatively, when an input requesting reduction of the selected portion of the handwritten text content is received, the device 100 may reduce the selected portion of the handwritten text content and enlarge the unselected portion of the handwritten text content. Because the method of reducing the selected portion of the handwritten text content and enlarging the unselected portion of the handwritten text content is similar to the method of enlarging the selected portion of the handwritten text content and reducing the unselected portion of the handwritten text content described with reference to FIG. 3D, so The detailed description is omitted.

Alternatively or additionally, the device 100 may display the selected portion of the handwritten text content in three dimensions (3D) and display the unselected portion of the handwritten text content in two dimensions (2D).

Although FIGS. 3A and 3B illustrate that after selecting a portion of the handwritten text content, an input requesting enlargement or reduction of the portion of the handwritten text content is received, the exemplary embodiment is not limited thereto. After requesting input to enlarge or reduce the portion of the handwritten text content, the area to be enlarged or reduced can be selected.

For example, the user can draw a circle clockwise on the display 121 (input requesting enlargement) or a circle counterclockwise (input requesting reduction) (by using the input tool 200) and then drag the one to be enlarged or reduced The part of the handwritten text content is highlighted to highlight the selected part of the handwritten text content. Therefore, the device 100 may enlarge or reduce the highlighted portion at a preset magnification. Alternatively, before selecting a portion of the handwritten text content, the device 100 may receive an input of magnification and enlarge or reduce the selected portion of the handwritten text content at the received magnification.

4A to 4C are views illustrating a method of selecting a portion of handwritten text content according to an exemplary embodiment.

As illustrated in FIG. 4A, the user strokes a closed curve 410 such as a rectangle by using an input tool 200 (for example, an electronic pen) to include a portion of handwritten text content. Therefore, the device 100 determines that the portion of the content of the handwritten text contained in the closed curve 410 is selected.

Alternatively or additionally, as illustrated in FIG. 4B, the user inputs a mark 420 such as a star or a check mark on a line indicating a portion of the handwritten text content by using the input tool 200 (for example, an electronic pen). Therefore, the device 100 determines that the portion of the content of the handwritten text indicated on the line of the input mark 420 is selected.

In addition, the device 100 may apply different magnifications or reduction magnifications to selected portions of the handwritten text content according to the number of marks 420. For example, when one star mark is input to the first line and two star marks are input to the second line, the device 100 may enlarge the portion of the handwritten text content indicated on the first line twice The portion of the handwritten text indicated on the second line is enlarged three times. However, the present exemplary embodiment is not limited to this.

Alternatively or additionally, as illustrated in FIG. 4C, the user underlines the portion of the handwritten text content by using an input tool 200 (eg, electronic pen) with an underline 430. Therefore, the device 100 determines that the underlined portion of the content of the handwritten text is selected.

In addition, the device 100 may apply different enlargement or reduction factors to selected portions of the handwritten text content according to the thickness value of the underline, the color value of the underline, and the style value of the underline. For example, when the first color value is used to underline the first part of the handwritten text content and the second color value is used to underline the second part of the handwritten text content, the first part of the handwritten text content can be enlarged twice and the The second part of the handwritten text is enlarged three times. However, the present exemplary embodiment is not limited to this.

Alternatively or additionally, when the first portion of the handwritten text content is underlined with a first thickness of the first underline and the second portion of the handwritten text content is underlined with a second thickness of the second thickness, the The first part is enlarged twice and the second part of the handwritten text can be enlarged three times. However, the present exemplary embodiment is not limited to this.

5A and 5B are views illustrating an input requesting enlargement or reduction of handwritten text content according to an exemplary embodiment.

For example, as illustrated in FIG. 5A, when the user performs a pinch input 510 is that when the two fingers are moved in a state of touching the display 121 in a direction toward each other, the device 100 may determine that the pinch input 510 is an input requesting reduction of the selected portion of the handwritten text content.

In contrast, as illustrated in FIG. 5B, when the user performs the spread input 520 to move two fingers in a state of touching the display 121 in a direction away from each other, the device 100 may determine that the spread input 520 is Requests enlargement of selected portions of handwritten text content.

In addition, the device 100 may apply different magnifications to enlarge or reduce the selected portion of the handwritten text content according to the distance moved by the two fingers. For example, when performing a spread input that moves two fingers a first distance in a direction away from each other, the device 100 may enlarge a selected portion of the handwritten text content twice. When performing a spread input that moves two fingers in a direction away from each other by a second distance longer than the first distance, the device 100 may enlarge the selected portion of the handwritten text content three times. However, the present exemplary embodiment is not limited to this.

6A and 6B are views illustrating a method of displaying modified handwritten text content on the display 121 according to an exemplary embodiment.

The device 100 receives input to select a portion of the handwritten text content displayed on the display 121. Since this process is described in detail with reference to FIGS. 4A to 4C, its detailed description is omitted.

In addition, the device 100 receives the input of "folding". The term “folding” means that an unselected portion of the handwritten text content that will not be displayed on the display 121 is folded, and only the selected portion of the handwritten text content is displayed on the display 121.

For example, the input of "folding" may be input of a selection icon (for example, a folding icon), or by using the input tool 200 on the display 121 clockwise or The input of the counterclockwise circle is as described above with reference to FIG. 3B. Alternatively or additionally, as described above with reference to FIGS. 5A and 5B, the input of “folding” may be a pinch input in which the user moves two fingers in a state of touching the display 121 toward each other. However, the present exemplary embodiment is not limited to this.

When receiving the folding input, the device 100 may display only the selected portion of the handwritten text content, and may not display the unselected portion of the handwritten text content. In this state, the device 100 as illustrated in FIG. 6A displays the selected portion of the handwritten text content by enlarging it at a predetermined magnification or input magnification. In addition, the device 100 displays an “expanded” icon 610 to have an unselected portion of the handwritten text content displayed on the display 121.

When the user selects the "expand" icon 610 (as illustrated in FIG. 6B), the hidden portion of the handwritten text content (that is, the unselected portion of the handwritten text content) is displayed again, and the "expand" icon 610 is displayed Change to the "fold" icon 620 to be displayed. In addition, the device 100 can display the enlarged portion of the handwritten text content to the original size by displaying it.

In addition, when the user selects the "folding" icon 620 again (as illustrated in FIG. 6A), the device 100 displays only the selected portion of the handwritten text content, and does not display the unselected portion of the handwritten text content. The "fold" icon 620 is displayed by changing to the "expand" icon 610.

FIG. 7 is a flowchart of a method for displaying text by zooming in or zooming out text according to an exemplary embodiment.

Referring to FIG. 7, in operation S710, the device 100 displays the key text content on the display 121.

The key text content can be generated by the device 100 according to the user's text input It can be generated by and received from an external device.

In addition, the device 100 can display key text on the execution window of the application. For example, the applications may include a memo application, a diary application, a calendar application, an e-book application, a household ledger, etc., but the exemplary embodiment is not limited thereto.

In operation S720, the device 100 receives an input to select a part of the displayed keystroke text content.

For example, the user may highlight or underline the part of the text content of the key displayed on the device 100 by using the input tool 200. The device 100 may determine that the highlighted or underlined portion of the keystroke text content is selected.

In addition, the user can draw a closed curve such as a circle or a polygon on the key text by using the input tool 200. The device 100 may determine the part of the keystroke text content included in the closed curve to be selected.

In addition, users can select text by using keyword search. When the user searches by inputting keywords, he can select words corresponding to the keywords, or can select sentences or paragraphs containing the keywords.

In operation S730, the device 100 receives user input to modify the key text content.

For example, the device 100 may receive user input requesting enlargement or reduction of key text content, for example, input of a stroke pattern, button input, user motion input, device motion input, voice input, etc., but this exemplary implementation Examples are not limited to this.

In operation S740, the device 100 enlarges or reduces the selected portion of the key-type text content and the unselected portion of the key-type text content by pressing different magnifications It is divided and displayed on the display 121.

The above operation will be described in detail below with reference to the accompanying drawings.

8A to 8C are views illustrating a method of selecting a key to type a portion of text content according to an exemplary embodiment.

Referring to FIG. 8A to FIG. 8C, the device 100 executes the e-book application program, and displays the key text on the e-book application program execution screen.

As illustrated in FIG. 8A, when a user input of a word (for example, "but") by tapping the key with the input tool 200 is received, the device 100 may determine the word, Any one of the sentence containing the word and the paragraph containing the word is selected. In addition, the selected word, sentence or paragraph can be highlighted 810 or underlined.

Alternatively or additionally, the device 100 may select a part of the text content based on the search keyword input. For example, as illustrated in FIG. 8B, the user inputs a keyword (for example, "but") in the search window 820 displayed on the e-book application screen by using, for example, the input tool 200. When a keyword is received and the search request input is received, the device 100 can select and highlight any one of the word, the sentence containing the word, and the paragraph containing the word by searching for the keyword.

In addition, the device 100 may select a part of the text content based on the closed curve input. For example, as illustrated in FIG. 8C, the user draws a closed curve 830 such as a rectangle by using the input tool 200. The device 100 may select a part of the key text content contained in the closed curve 830 or draw a paragraph surrounded by the closed curve 830.

Alternatively or additionally, the user may underline or highlight the portion of the text content of the key by using the input tool 200. The device 100 can select keystrokes The underlined part of the content or the highlighted part of the keystroke text content. In addition, the device 100 may select a sentence or paragraph containing the underlined or highlighted portion of the keystroke text content. However, the present exemplary embodiment is not limited to this.

9A and 9B are views illustrating an enlarged input requesting selected key text content according to an exemplary embodiment.

After selecting a portion of the keystroke text content (as illustrated in FIGS. 8A to 8C), the device 100 may receive an input requesting enlargement of the selected portion of the keystroke text content. For example, when the device 100 receives a user input 910 (as illustrated in FIG. 9A) by using the input tool 200 to circle the display 121 clockwise, the device 100 may determine that the user input 910 is a request key Enlarged input of selected parts of text content.

Alternatively or additionally, when performing the spread input 920 (as illustrated in FIG. 9B) where the user moves two fingers in a state of touching the display 121 in a direction away from each other, the device 100 may determine the spread input 920 Input for requesting enlargement of selected portions of handwritten text content.

Alternatively or additionally, as illustrated in FIGS. 9A and 9B, when an input of a zoom-in button 930 or GUI button displayed on the display 121 is received or an input of a button or PUI button included in the device 100 is received, the device 100 The determination input is a request to enlarge the selected part of the text content.

The device 100 may receive user motion input or device motion input. For example, when the device 100 recognizes the motion of the user opening the hand or moving the hand away from the device 100 via the camera, the device 100 may determine that the motion is an input requesting an enlargement of the selected portion of the text content.

In addition, when received by using an acceleration sensor or a gyroscope sensor When the device 100 moves toward the user, the device 100 may determine that the input is a request to enlarge the selected portion of the text content.

Alternatively or additionally, although FIGS. 9A and 9B only illustrate an enlarged input requesting a selected portion of the text content, a similar method may be performed to request a reduced input of the selected portion of the text content.

For example, when the device 100 receives a user input by using the input tool 200 to make a circle counterclockwise, the user moves the two fingers in the state of touching the display 121 in the direction toward each other, and the pinch input, the reduction button When input, motion input by the user holding the hand, motion input by the user's hand moving away from the device 100, or motion input by the device 100 moving away from the user, the device 100 can determine that each input is the selected Partially reduced input. However, the present exemplary embodiment is not limited to this.

FIG. 10 is a view of a screen displaying enlarged and reduced keystroke text content according to an exemplary embodiment.

Referring to FIG. 10, when an input for zooming in described with reference to FIGS. 9A and 9B is received, the device 100 enlarges the key-pressed selected portion 1020 of the text content, and reduces the key-pressing the unselected portion 1010 of the text content. In this regard, the device 100 may reduce the unselected portion 1010 of the keystroke text content based on the magnification of the selected portion 1020 for enlarging the keystroke text content. For example, when the selected portion 1020 of the key-type text content is enlarged twice, the device 100 may reduce the unselected portion 1010 of the key-type text content by 0.5 times. When the selected portion 1020 of the key-type text content is enlarged three times, the device 100 may reduce the unselected portion 1010 of the key-type text content by 1/3 times. However, the present exemplary embodiment is not limited to this, and the key-type text content may be enlarged or reduced based on various magnifications.

Therefore, as illustrated in FIG. 10, the device 100 is displayed by zooming in on the selected portion 1020 of the text content, and by reducing the key in the unselected portion 1010 of the text content, and thus the user can Identify the part at a glance.

Alternatively or additionally, the device 100 may display selected portions of the key text content in 3D and display unselected portions of the text content in 2D.

11A and 11B are views illustrating a method of displaying modified key text content on the display 121 according to an exemplary embodiment.

The device 100 may receive an input to select a portion of the keystroke text content displayed on the display 121. Since the above operations are described with reference to FIGS. 8A to 8C in detail, detailed descriptions thereof are omitted.

In addition, the device 100 can receive a "folding" input. For example, the "fold" input may be an input to select an icon (eg, a folded icon), or an input by using the input tool 200 to circle clockwise or counterclockwise on the display 121 (as described with reference to FIG. 9A ), or a pinch input or a spread input that moves two fingers in a state of touching the display 121 toward or away from each other (as described with reference to FIGS. 9A and 9B). However, the present exemplary embodiment is not limited to this.

When the "fold" input is received, the device 100 may display only the selected portion of the keystroke text content, and may not display the unselected portion of the keystroke text content. In this state, the device 100 displays the selected portion 1120 of the text content by pressing a preset magnification or entering a magnification key, as illustrated in FIG. 11A. In addition, the device 100 displays an “expanded” icon 1110 to cause the device 100 to display the unselected portion of the handwritten text content on the display 121.

When the user selects the "expand" icon 1110 (as illustrated in FIG. 11B), the hidden portion 1140 of the keystroke text content is displayed again (meaning, within the keystroke text The unselected part of the content), and change the "expand" icon 1110 to the "fold" icon 1130 to be displayed. In addition, the device 100 can display the enlarged portion of the handwritten text content to the original size by displaying it.

In addition, when the user selects the "fold" icon 1130 again (as illustrated in FIG. 11A), the device 100 displays only the selected portion 1120 of the key-type text content, and does not display the unselected portion 1140 of the key-type text content . Change the "fold" icon 1130 to the "expand" icon 1110 to be displayed.

FIG. 12 is a flowchart of a method of displaying image content by zooming in or out thereof according to an exemplary embodiment.

Referring to FIG. 12, in operation S1210, the device 100 displays the video content on the display 121.

The video content may be captured by the device 100, or generated based on user input, or may be generated by and received from an external device.

In addition, the device 100 can display the image content on the execution window of the application program. For example, the application program may include a gallery application program, an image editing application program, etc., but the exemplary embodiment is not limited thereto.

In operation S1220, the device 100 receives an input to select a portion of the displayed video content.

For example, the user can draw a closed curve such as a circle or polygon on the image content displayed on the device 100 by using the input tool 200. The device 100 may determine that a part of the video content included in the closed curve is selected.

In operation S1230, the device 100 receives user input to modify the video content.

For example, the device 100 may receive a request to enlarge or reduce the video content User input, for example, input of a stroke pattern, button input, user motion input, device motion input, voice input, etc., but this exemplary embodiment is not limited thereto.

In operation S1240, the device 100 enlarges or reduces the selected portion of the video content and the unselected portion of the video content by different magnifications for display.

The above operation will be described in detail below with reference to the accompanying drawings.

13 is a view of a method of selecting a portion of video content according to an exemplary embodiment.

Referring to FIG. 13, the device 100 executes a gallery application, and displays image content on the gallery application execution screen.

In addition, the device 100 may receive user input to select an area of video content. For example, the user can select the area by selecting or setting the shape of the area to be used for selection and touching and dragging the image content. As illustrated, in FIG. 13, when the user selects the rectangle as the shape to be selected by using the input tool 200, and then touches the first point of the image content and drags to the second point, the selected first A rectangular area 1320 diagonal to the second point.

However, the shape of the area and user input to select the area are not limited to this. The shape of the area may include a circle, an ellipse, a freely curved shape, etc., and user input may include key input, touch input (eg, touch, double touch, toggle, slide, etc.), voice input, motion input, etc. .

FIG. 14 is a view of a method of displaying image content by enlarging or reducing it according to an exemplary embodiment.

As in the device 100 described with reference to FIG. 13, after selecting a portion of the video content displayed on the display 121, it may receive a request for the selected portion of the video content 1410 Amplified input.

For example, as illustrated in FIG. 14, when receiving the spread input 1420 in which the user moves two fingers in a state of touching the selected portion 1410 of the video content in a direction away from each other, the device 100 may It is determined that the spread input 1420 is an input requesting enlargement of the selected portion 1410 of the video content.

However, this exemplary embodiment is not limited. When the device 100 receives an input by drawing a pattern on the display 121 by using the input tool 200 (for example, a clockwise input), an enlarged GUI input displayed on the display 121, or a PUI button included in the device 100, the device 100 may determine that each input is an input requesting enlargement of the selected portion of the video content.

In addition, when the device 100 recognizes the movement of the user opening the hand or the movement of the user's hand away from the device 100 via the camera, the device 100 may determine that the movement is an input requesting enlargement of the selected portion of the video content.

In addition, when the device 100 receives an input that the device 100 moves toward the user by using an acceleration sensor or a gyroscope sensor, the device 100 may determine that the input is an input requesting enlargement of a selected portion of the video content.

Alternatively or additionally, although FIG. 14 only illustrates an input requesting enlargement of a selected portion of video content, an input requesting reduction of a selected portion of video content may be processed in a similar manner. For example, when receiving a pinch input in which the user moves two fingers in a state facing each other while touching a selected portion of the video content, the device 100 may determine that the pinch input is the selected portion requesting the video content Reduced input.

Referring to FIG. 14, when an input requesting enlargement of a selected portion of video content is received, the device 100 enlarges the selected portion 1410 of the video content and reduces the shadow Like the unselected portion 1430 of the content. In this state, the device 100 may reduce the unselected portion 1430 of the video content based on the magnification of the selected portion 1410 used to enlarge the video content.

For example, when the selected portion 1410 of the video content is enlarged twice, the device 100 may reduce the unselected portion 1420 of the video content by 0.5 times. When the selected portion 1410 of the video content is enlarged three times, the device 100 can reduce the unselected portion 1420 of the video content by 1/3 times. However, the present exemplary embodiment is not limited to this, and a portion of video content may be enlarged or reduced based on various magnifications.

Alternatively, the device 100 may display the selected portion of the video content in 3D and the unselected portion of the video content in 2D.

15 and 16 are views illustrating a method of displaying image content by enlarging or reducing it according to an exemplary embodiment.

Referring to FIG. 15, the device 100 executes a gallery application, and displays multiple image contents on the gallery application execution screen.

The device 100 may receive a user input selecting an object included in any of the video contents. Objects can include people, buildings, characters, etc.

For example, as illustrated in FIG. 15, the first person’s image 1520 can be selected by inputting by touching and dragging the first person’s image 1520 included in the first image content 1510 (eg, using the input tool 200) . Alternatively, the first person's image 1520 may be selected by inputting by tapping or double-tapping the first person's image 1520 (eg, using the input tool 200). However, user input is not limited to this, and may include key input, voice input, motion input, etc. with or without the input tool 200.

When the first person is selected, as illustrated in FIG. 16, the device 100 extracts the image content 1610 including the first person from the image content by using, for example, face recognition. At least one of content 1620 and video content 1630.

However, the present exemplary embodiment is not limited to this. When the selected object is a building, the device 100 may extract at least one of the image contents including the building by using, for example, pattern recognition. In addition, when the selected object is a character, the device 100 may extract at least one of the image contents including the character by performing character recognition technology using, for example, optical character recognition (OCR).

In addition, the device 100 displays the extracted video content 1610 on the display 121, enlarges the image 1650 of the object (for example, the first person) included in the extracted video content 1610, and reduces the content of the video content 1610 other than the object Part. In this regard, the device 100 may reduce other parts of the image content 1610 other than the object based on the magnification of the image 1650 used to enlarge the object.

For example, when the image 1650 of an object is enlarged twice, the device 100 may reduce the other part of the image content 1610 other than the object by 0.5 times. When the image 1650 of the object is enlarged three times, the device 100 can reduce the other part of the image content 1610 excluding the object by 1/3 times. However, the present exemplary embodiment is not limited to this. The image content 1610 may be enlarged or reduced based on various magnifications.

In addition, the device 100 displays the extracted image content 1610 on the display 121, and can display the image of the object in 3D by giving a 3D effect to the image of the object (for example, the first person) included in the extracted image content 1610.

17 is a flowchart of a method of reproducing a video content by changing its reproduction speed according to an exemplary embodiment.

Referring to FIG. 17, in operation S1710, the device 100 reproduces the video content, and displays a reproduction screen of the video content.

The video content may be the video content captured by the device 100 or by an external device Video content generated or received from external devices. In addition, the device 100 can display video content on the execution window of the application program.

The video content reproduction screen may include a timetable indicating the reproduction time of the video content.

In operation S1720, the device 100 receives a user input that selects a partial reproduction section of all the reproduction sections of the video content.

For example, the device 100 may receive a user input selecting a partial reproduction section on the timetable displayed on the reproduction screen.

Referring to operation S1730, the device 100 receives user input to change the reproduction speed of the video content.

For example, the device 100 may receive user input that requests control of the reproduction speed of the video content to be slower or faster than the existing reproduction speed. The user input requesting the control of the reproduction speed of the video content is slower or faster than the existing reproduction speed may include the spread input of moving two fingers touching the display 121 in a direction away from each other, and moving the touch in a direction toward each other The pinch input of two fingers of the display 121, input of a stroke pattern, button input, user motion input, device motion input, voice input, etc., but the present exemplary embodiment is not limited thereto.

In operation S1740, the device 100 reproduces the video content of the selected section and the video content of the unselected section at different reproduction speeds.

For example, the device 100 may control the reproduction speed of the selected section of the video content to be faster or slower than the reproduction speed of the unselected section of the video content. However, the present exemplary embodiment is not limited to this.

Alternatively or additionally, the device 100 may reproduce selected sections of the video content and unselected sections of the video content at different reproduction sound volumes.

Alternatively or additionally, the device 100 may receive a user input selecting a sound included in the video content, and may control the reproduction speed or reproduction volume regarding the section containing the selected sound.

Alternatively or additionally, the device 100 may control the reproduction speed or the reproduction volume with respect to the section whose volume of the sound contained in the video content is equal to or greater than a preset value.

The above operation will be described in detail below with reference to the accompanying drawings.

18 and 19 are views illustrating a method of selecting a partial section of all sections of video content according to an exemplary embodiment.

Referring to FIG. 18, the device 100 executes a video reproduction application, and displays video content on the video reproduction application execution screen. In addition, the screen includes a time table 1810 indicating the reproduction time point of the video content.

For example, as illustrated in FIG. 18, when the total reproduction time of the video content is 3 minutes and 36 seconds (00:03:36) and the current time point of the reproduced video is 43 seconds (00:00:43) If all the timetables 1810 displayed by the device 100 correspond to a period of 3 minutes and 36 seconds, the device 100 displays the icon at the time point 1815 corresponding to the time point of 43 seconds on the time table 1810. In addition, a section from the start point of the time table 1810 corresponding to the time point of 0 second of the time table 1810 to the time point 1815 corresponding to the time point of 43 seconds is highlighted.

In addition, the user selects a partial section of the video content by using the time schedule 1810 of the video content, as illustrated in FIG. 18.

For example, the user selects a partial segment by moving and setting a first icon 1830 indicating the start point of the partial segment and a second icon 1840 indicating the end point of the partial segment marked on the timetable 1810 .

In this state, when the first icon 1830 is located on the timetable 1810 The first position at the first time point (eg, 35 seconds (00:00:35)) and the second icon 1840 is located on the timetable 1810 indicating the second time point (eg, 1 minute and 48 seconds (00:01 : 48)) At the second position, the device 100 determines that the section between the first position and the second position is the selected partial section.

When a partial section is selected, the device 100 can reproduce the selected partial section of the video content and the unselected section of the video content at different reproduction speeds.

For example, as illustrated in FIG. 18, when video content corresponding to a period of 73 seconds (for example, from 35 seconds to 1 minute and 48 seconds) in the selected partial section is reproduced, it can be reproduced at the existing reproduction speed Video content. In addition, video content in unselected sections (for example, a period of 0 seconds to 35 seconds and a period of 1 minute and 48 seconds to 3 minutes and 36 seconds) can be reproduced at a reproduction speed slower or faster than the existing reproduction speed.

Alternatively, the device 100 may control the reproduction speed of the selected partial section of the video content to be faster or slower according to a preset ratio, and control the reproduction speed of the unselected section of the video content that is the same as the existing reproduction speed.

Alternatively, the device 100 may control the reproduction speed of the video content contained in the selected partial section at a preset ratio (first ratio), and control the unselected area of the video content at a preset ratio (second ratio) The segment reproduction speed is slow. In this state, the device 100 may set the second ratio based on the first ratio. For example, when the first ratio is twice, the second ratio may be 0.5 times, and when the first ratio is three times, the second ratio may be 1/3 times.

In contrast, the device 100 may control the reproduction speed of the video content contained in the selected partial section at a predetermined ratio to be slow, and control the reproduction speed of the unselected section of the video content at a predetermined ratio to be fast.

Alternatively, the device 100 may control the selected portion of the video content The reproduction volume of the included video content is higher or lower than the reproduction volume of the unselected section of the video content.

Referring to FIG. 19, the user can select a partial section by directly inputting the start point and end point of the section.

For example, as illustrated in FIG. 19, the device 100 displays a setting window 1910 on the display 121. The setting window 1910 includes items for inputting the start point and end point of the partial section to be selected, and items for setting the reproduction speed of the selected partial section.

As illustrated in FIG. 19, when the user inputs 35 seconds (00:00:35) as the starting point and 1 minute and 48 seconds (00:01:48) as the ending point, the device 100 displays the corresponding on the timetable 1920 The first icon 1930 at the start point and the second icon 1940 at the end point.

In addition, when the user inputs the speed as "slow" and the ratio as "0.5" times through the setting window 1910, the device 100 can control 73 seconds corresponding to the selected partial section at a ratio of 0.5 times the existing reproduction speed The period of time (for example, from 35 seconds to 1 minute and 48 seconds) of video content is slow to reproduce.

20, 21A, and 21B are views illustrating a method of reproducing video content by changing the reproduction speed of the video content according to an exemplary embodiment.

Referring to FIG. 20, the device 100 can execute a video application and display a plurality of frames forming video content on the video application execution screen in chronological order.

The device 100 may receive a user input selecting an object included in any of a plurality of frames, and the object may include people, buildings, characters, and the like.

For example, as illustrated in FIG. 20, the image of the first person may be selected by touching and dragging the input of the image 2010 of the first person included in the first frame. Substitute The first person's image 2010 can be selected by tapping or double-tapping the first person's image 2010. However, user input is not limited to this, and may include key input, voice input, motion input, and the like.

When the first person is selected, the device 100 may extract at least one frame including the first person from the frame forming the video content by using, for example, face recognition.

When reproducing the frame, the device 100 may reproduce the extracted frame and the unextracted frame at different reproduction speeds.

For example, as illustrated in FIG. 21A, the extracted frame 2110 (that is, the frame containing the first person’s image 2140) can be reproduced at the existing reproduction speed, while the unextracted frame 2120 (that is, not The frame containing the image 2140 of the first person can be reproduced at a reproduction speed faster (for example, double) than the existing reproduction speed. However, the present exemplary embodiment is not limited to this, and the reproduction speed of the extracted frame and the unextracted frame may be changed in various ways.

22 is a view illustrating an input requesting a change in the reproduction speed for a selected section of video content according to an exemplary embodiment.

Referring to FIG. 22, the device 100 can execute a video application and display video content on the video application execution screen. In addition, the device 100 may display a timetable 2205 indicating the reproduction time point of the video content.

Alternatively, as illustrated in FIG. 22, the user may perform a pinch input 2230 to touch the first position on the timetable 2205 that is set as the starting point of the section by using one finger and to touch by using another finger The second position on the timetable 2205 is set as the end point of the section, and then two fingers are dragged in the direction toward each other. In this state, the device 100 may display the first icon 2210 at the first position touched by the user and the second icon at the second position touched by the user 2220, and the user can drag the first icon 2210 and the second icon 2220 touched by the finger in directions toward each other.

The device 100 may set the reproduction speed of the selected partial section to be faster than the existing reproduction speed. In addition, the reproduction speed of the unselected section may be equal to or slower than the existing reproduction speed. In this state, the increase rate of the reproduction speed of the selected partial section may be determined based on the moving distance between the first icon 2210 and the second icon 2220. The process described above is described in detail below with reference to FIGS. 23A and 23B.

23A and 23B are views for explaining a method of differently setting the reproduction speed of the section selected according to the input request in FIG. 22.

The device 100 may variously set the reproduction speed of the partial section selected according to the moving distance between the first icon 2310 and the second icon 2320.

Referring to FIG. 23A and FIG. 23B, the user can enter the pinch input 2230 described by referring to FIG. 22 (that is, touch the first position P1 with one finger and the second position P2 with the other finger, and then face each other Drag two fingers in the direction of) to move the first icon 2310 at the first position P1 and the second icon 2320 at the second position P2 to the third position P3 and the fourth position P4, respectively.

When the distance between the third position P3 and the fourth position P4 is 1/3 of the distance between the first position P1 and the second position P2 (as illustrated in FIG. 23A), the device 100 may The reproduction speed is set to be twice faster than the existing reproduction speed.

Alternatively or additionally, when the distance between the third position P3 and the fourth position P4 is 1/2 of the distance between the first position P1 and the second position P2 (as illustrated in FIG. 23B), the device 100 may change The reproduction speed of some sections is set to be twice as fast as the existing reproduction speed. However, the present exemplary embodiment is not limited to this.

24 is a diagram illustrating selection of video content for a request according to an exemplary embodiment A view of the input of changes in the reproduction speed of a given section.

Referring to FIG. 24, the device 100 can execute a video application and display video content on the video application execution screen. In addition, the device 100 may display a timetable 2405 indicating the reproduction time point of the video content.

Alternatively, as illustrated in FIG. 24, the user can perform the spread input 2430 to touch the first position of the timetable 2405 to be set as the starting point of the partial section by using one finger and by using another The finger touches the second position of the timetable 2405 that will be set as the end point of the partial section, and then drags two fingers in a direction away from each other. In this state, the device 100 may display the first icon 2410 at the first position touched by the user and the second icon 2420 at the second position touched by the user, and the user may The first icon 2410 and the second icon 2420 touched by the finger are dragged in the direction of each other.

The device 100 may set the reproduction speed of the selected partial section to be slower than the existing reproduction speed. In addition, the reproduction speed of the unselected section may be equal to or faster than the existing reproduction speed. In this state, the reduction rate of the reproduction speed of the selected partial section may be determined based on the moving distance between the first icon 2410 and the second icon 2420. The process described above is described in detail below with reference to FIGS. 25A and 25B.

25A and 25B are views for explaining a method of differently setting the reproduction speed of the section selected according to the input request in FIG. 24.

The device 100 may variously set the reproduction speed of the partial section selected according to the moving distance between the first icon 2510 and the second icon 2520.

Referring to FIGS. 25A and 25B, the user can open the input 2430 by referring to FIG. 24 (that is, touch the first position P1 with one finger and the second position P2 with the other finger, and then leave Drag two fingers in the direction of each other) Do not move the first icon 2510 located at the first position P1 and the second icon 2520 located at the second position P2 to the third position P3 and the fourth position P4.

When the distance between the third position P3 and the fourth position P4 is longer than the distance between the first position P1 and the second position P2 (as illustrated in FIG. 25A), the device 100 may set the reproduction of the partial section The speed is 1/2 times slower than the existing reproduction speed.

Alternatively or additionally, when the distance between the third position P3 and the fourth position P4 is twice longer than the distance between the first position P1 and the second position P2 (as illustrated in FIG. 23B), the device 100 may set The reproduction speed of some sections is 2/3 times slower than the existing reproduction speed. However, the present exemplary embodiment is not limited to this.

26 is a flowchart of a method of reproducing an audio content by changing its reproduction speed according to an exemplary embodiment.

Referring to FIG. 26, in operation S2610, the device 100 reproduces the audio content, and displays a reproduction screen of the audio content.

The audio content may be a voice file, a music file, etc. recorded by the device 100, or may be generated by and received from an external device. In addition, the device 100 can display audio content on the execution window of the application program.

The audio content reproduction screen may include a timetable indicating the reproduction time point of the audio content.

In operation S2620, the device 100 receives a user input selecting a partial reproduction section of all the reproduction sections of the audio content.

For example, the device 100 may receive a user input selecting a partial reproduction section on the timetable displayed on the reproduction screen.

In operation S2630, the device 100 receives user input to change the reproduction speed of the audio content.

For example, the device 100 may receive user input requesting that the control of the reproduction speed of the audio content be slower or faster than the existing reproduction speed. The user input requesting the control of the reproduction speed of the audio content is slower or faster than the existing reproduction speed may include a spreading input of two fingers touching the display 121 in a direction away from each other or toward each other, a stroke pattern Input, button input, user motion input, device motion input, voice input, etc., but the exemplary embodiment is not limited thereto.

In operation S2640, the device 100 reproduces the audio content of the selected section and the audio content of the unselected section at different reproduction speeds.

For example, the device 100 may control the reproduction speed of the audio content of the selected section to be faster or slower than the reproduction speed of the audio content of the unselected section. However, the present exemplary embodiment is not limited to this.

Alternatively or additionally, the device 100 may reproduce the audio content of the selected section and the audio content of the unselected section at different reproduction sound volumes.

Alternatively or additionally, the device 100 may receive a user input selecting a sound included in the audio content, and may control the reproduction speed or reproduction volume regarding the section containing the selected sound.

Alternatively or additionally, the device 100 may control the reproduction speed or the reproduction volume with respect to the section whose volume of the sound contained in the audio content is equal to or greater than a preset value.

The above operation will be described in detail below with reference to the accompanying drawings.

FIG. 27 is a view illustrating a method of selecting a partial section of all sections of audio content according to an exemplary embodiment.

Referring to FIG. 27, the device 100 can execute an audio reproduction application and display audio content on the audio reproduction application execution screen. In addition, the reproduction of audio content The screen may contain information about the audio content 2710, for example, the name of the audio content, the manufacturer of the audio content, the singer of the audio content, the album containing the audio content. The audio content reproduction screen may include a timetable 2720 indicating the reproduction time point of the audio content, a reproduction button to reproduce the audio content, a stop button to stop the reproduction of the audio content, and a previous song to move to the previous audio content in the reproduction list Button, move to the next song button to reproduce the next audio content in the list.

Alternatively or additionally, as illustrated in FIG. 27, the user may select a partial section of the audio content by using the audio content timetable 2720.

For example, the user may move the first icon 2731 indicating the start point of the partial section and the second icon 2732 indicating the end point of the partial section on the timetable 2720 by moving on the timetable 2720 Select some sections.

When the first icon 2731 is located at the first position on the timetable 2720 indicating the first time point and the second icon 2732 is located at the second position indicating the second time point on the timetable 2720, the device 100 may determine the first time The section between the point and the second time point is a partial section.

When selecting a partial section, the device 100 can reproduce the audio content corresponding to the selected partial section and the audio content corresponding to the unselected partial section at different reproduction speeds. The above operation will be described in detail below with reference to FIGS. 28 and 29.

28 and 29 are views illustrating an input requesting a change in the reproduction speed for a selected section of audio content according to an exemplary embodiment.

Referring to FIG. 28, a partial audio section is selected and the user can perform the first position corresponding to the start point of the partial section on the timetable 2820 by using one finger and the time corresponding to the time by touching with another finger The second position of the end point of the partial section on the table 2820 and then drag the pinch of the two fingers towards each other Close input 2810. For example, the first icon 2831 displayed at the first position and the second icon 2832 displayed at the second position may be dragged in directions toward each other.

The device 100 may set the reproduction speed of the selected partial section to be faster than the existing reproduction speed. In this state, the increase rate of the reproduction speed of the selected partial zone may be determined as a preset ratio, or the increase may be determined according to the moving distance between the first icon 2831 and the second icon 2832 ratio. Since the process described above is described in detail above with reference to FIGS. 23A and 23B, a detailed description thereof is omitted.

In addition, the device 100 may set the reproduction speed of the unselected section to be the same as or slower than the existing reproduction speed.

Alternatively or additionally, referring to FIG. 29, the user may perform a spread input 2910 on the timetable 2920 to touch the first position corresponding to the start point of the partial section on the timetable 2920 by using one finger and by using The other finger touches the second position corresponding to the end point of the partial section on the timetable 2920, and then drags two fingers in a direction away from each other. For example, the first icon 2931 displayed at the first position and the second icon 2932 displayed at the second position may be dragged in directions spaced apart from each other.

The device 100 may set the reproduction speed of the selected section to be slower than the existing reproduction speed. In this state, the reduction ratio of the reproduction speed of the selected section may be determined as a preset ratio, or the reduction ratio may be determined according to the moving distance between the first icon 2931 and the second icon 2932. Since the process described above is described in detail above with reference to FIGS. 25A and 25B, a detailed description thereof is omitted.

In addition, the device 100 may set the reproduction speed of the unselected section to be the same as or faster than the existing reproduction speed.

FIG. 30 is a diagram illustrating the process of changing audio content according to an exemplary embodiment. A view of the method of reproducing audio content at current speed.

Referring to FIG. 30, the device 100 can execute an audio reproduction application and display a reproduction screen of audio content on the audio reproduction application execution screen.

The audio content reproduction screen may contain information about the audio content, a timetable indicating the reproduction time point of the audio content, a reproduction button to reproduce the audio content, a stop button to stop the reproduction of the audio content, and a move to the previous audio content in the reproduction list Button of the previous song, the button of the next song to move to the next audio content, etc.

In addition, the device 100 may display the voice list 3010 based on the information about the voice included in the audio content. For example, when the audio content is a song file sung by singers A, B, and C, the audio content may include A's voice, B's voice, and C's voice. The device 100 as illustrated in FIG. 30 may display a voice list 3010 for selecting any one of the voice of A, the voice of B, and the voice of C. The audio information contained in the audio content may be the information contained in the metadata of the audio content.

The user can select any one of the voices in the voice list 3010 and set the reproduction speed for the audio segment containing the selected voice by using the reproduction speed setting menu 3020. For example, as illustrated in FIG. 30, the user can set whether the reproduction speed is faster or slower than the existing reproduction speed or a multiple thereof that will be faster or slower.

Alternatively or additionally, as illustrated in FIG. 30, when the singer C is selected from the voice list and selects 0.5 times slower reproduction speed according to the user input, the device 100 may set the reproduction speed of the audio section containing the voice of C 0.5 times slower than the existing reproduction speed. In this state, information about the audio section containing the voice of C can be included in the metadata of the audio content. Alternatively, the device 100 may extract the audio segment containing the voice of C from the audio content via voice recognition.

In addition, the device 100 may select a partial reproduction section of the section of audio content via voice recognition. For example, when the audio content includes the voice of A, the voice of B, and the voice of C (as illustrated in FIG. 30), the user can select the time point at which the voice of C is reproduced, thereby outputting the voice of C. The device 100 may extract the audio segment of the voice of C including the segment of the audio content by recognizing the voice of C.

Alternatively, when the time point of the audio section is selected, the device 100 may extract the same content as the voice reproduced at the selected time point (for example, the voice of C) based on the information about the audio section containing metadata of the audio content Audio section of your voice.

FIG. 31 is a flowchart of a method of displaying a list by enlarging or reducing it according to an exemplary embodiment.

Referring to FIG. 31, in operation S3110, the device 100 displays a list.

The list represents a group of items with the same attributes. For example, the list may be an array of data items that satisfy the conditions in sequence. The list may include a list of phone numbers, a list of messages, a list of recommended books, a list of schedules, a list of financial management, a list of photos, a list of music files, a list of animations, etc. However, the present exemplary embodiment is not limited to this.

In addition, the list may be generated by the device 100 or may be generated by or received from an external device.

In addition, the device 100 can display a list on the application execution window. For example, the applications may include a phone book application, a messaging application, an album application, a household ledger application, etc. However, the present exemplary embodiment is not limited to this.

In operation S3120, the device 100 receives user input of at least one item included in the selection list.

In operation S3130, the device 100 receives user input to modify the list.

For example, the device 100 may receive a request to enlarge or reduce the list User input. The user input requesting the enlargement or reduction of the list may include input of a stroke pattern, button input, user motion input, device motion input, voice input, etc., but the exemplary embodiment is not limited thereto.

In operation S3140, the device 100 enlarges or reduces the selected item and the unselected item by different magnifications to display on the display 121.

The above operation will be described in detail below with reference to the accompanying drawings.

FIG. 32 is a view illustrating a method of selecting at least one item of a list according to an exemplary embodiment.

Referring to FIG. 32, the device 100 can execute the household ledger application and display a list of financial expenses on the household ledger application execution screen. The list of financial expenses may contain items of financial expenses arranged by users in order of date.

In addition, the items included in the financial expense list may include the date of the expense, the location of the expense, the reason for the expense, cash or card, the amount of expense, etc.

As illustrated in FIG. 32, the user can select at least one of the items included in the financial expense list. For example, the user can select an item by touching the item itself or a rectangular icon 3210 indicating the item. In addition, the user can select multiple items.

When the device 100 receives an input to select an item, the device 100 may display a check mark on the rectangular icon 3210 of the item, or may display it by highlighting the item.

After selecting an item, the device 100 may receive a user input requesting enlargement or reduction of the selected item. For example, as illustrated in FIG. 32, when the enlarged input icon 3220 displayed on the display 121 is touched, the device 100 may determine that the touch is an input requesting enlargement of the selected item. In contrast, the touch is displayed on the display 121 In the reduced input icon 3230, the device 100 may determine that the touch is an input requesting reduction of the selected item.

In addition, when receiving a user input that is circled clockwise on the display 121, a spread input where the user moves two fingers in a state of touching each other in the direction away from each other, or a button included in the device 100 ( For example, when inputting a physical user interface (PUI) button, the device 100 may determine that each input is an input requesting magnification of the selected item.

Alternatively or additionally, the device 100 may receive user motion input or device motion input. For example, when the device 100 recognizes the movement of the user opening the hand or moving the hand away from the device 100 via the camera, the device 100 may determine that each input is an input requesting magnification of the selected item.

Furthermore, the input requesting reduction of the selected content can be performed in a similar method. For example, when a user input by using the input tool 200 to draw a circle counterclockwise, a pinch input by a user moving two fingers in a state of touching the display 121 in a direction toward each other, a reduction button input, When the user holds the hand motion input, the user's hand moves toward the device 100, or the device 100 moves toward the user, the device 100 may determine that each input is a reduced input requesting the selected portion. However, the present exemplary embodiment is not limited to this.

FIG. 33 is a view of a screen displaying the list by enlarging or reducing the list according to an exemplary embodiment.

Referring to FIG. 33, when an input requesting enlargement of a selected item is received, the device 100 may enlarge the selected item 3310 and reduce the unselected item 3320. In this state, the device 100 may reduce the unselected items 3320 based on the magnification used to enlarge the selected items 3310. For example, when the selected item 3310 is enlarged twice, the device 100 can reduce unselected items 3320 by 0.5 times. When the selected item 3310 is enlarged three times, the device 100 can reduce the unselected item 3320 by 1/3 times. However, the present exemplary embodiment is not limited to this, and items included in the list may be enlarged or reduced based on various magnifications.

Therefore, as illustrated in FIG. 33, since the device 100 displays the selected item 3310 by zooming in and displays the unselected item 3320 by zooming out, the user can recognize the item at first glance.

Alternatively or additionally, the device 100 may display selected items in 3D and display unselected items in 2D.

FIG. 34 is a view illustrating a method of selecting at least one item of a list according to an exemplary embodiment.

Referring to FIG. 34, the device 100 executes the household ledger application and displays a list of financial expenses on the household ledger application execution screen. In addition, the device 100 may display a search window 3410 for searching keywords on the execution screen of the household ledger application.

The device 100 may input selection items based on search keywords. For example, as illustrated in FIG. 34, the user can input keywords into the search window 3410 by using the input tool 200. For example, the keyword may be related to the date spent, the location where the cost was spent, the reason for the cost, and so on. However, the present exemplary embodiment is not limited to this.

When a keyword is input and a search request input is received, the device 100 may search for the keyword and select an item containing the keyword. In addition, the device 100 may display the discovered keywords by highlighting them.

For example, as illustrated in FIG. 34, when the user enters the keyword "Chinjeol Mart" 3420 (where the user spends money) into the search window 3410 When requesting a search, the device 100 may search for and select the first item 3431, the second item 3432, and the third item 3433 that contain the keyword "Chinjeol Mart" 3420 among the data of the section of the usage area.

Therefore, the user can search or select items spent on a certain date by entering the date spent through keyword search, or search or select items spent on a certain place or borrow by inputting a place to spend Search for or select items to spend by entering keywords related to costs.

35A and 35B are views illustrating a method of displaying a modified list on the display 121 according to an exemplary embodiment.

The device 100 may receive an input of "folding" on the selected item in the list displayed on the display 121. For example, the input of "folding" may be an input of selecting an icon (for example, a folding icon), or an input of drawing a circle clockwise or counterclockwise on the display 121 by using the input tool 200. Alternatively or additionally, the input of "folding" may be a pinch/spread input of a user moving two fingers in a state of touching the display 121 in a direction toward or away from each other. However, the present exemplary embodiment is not limited to this.

When the input of "folding" is received, the device 100 may display only the selected item and may not display the unselected item. In this state, the device 100 may display the selected item by zooming in at a preset magnification or inputting a magnification, as illustrated in FIG. 35A. In addition, the device 100 may display an "expand" icon 3510 to display unselected items on the display 121. In addition, a number 3520 indicating the number of unselected items may be displayed.

When the user selects the "expand" icon 3510 (as illustrated in FIG. 35B), unselected items can be displayed again and the "expand" icon 3510 can be changed to "fold" "Fold" icon 3530 to display.

In addition, when the user selects the "folding" icon 3530 again (as illustrated in FIG. 35A), the device 100 may display only selected items and may not display unselected items. The "folded" icon 3530 can be displayed by changing to the "expanded" icon 3510.

FIG. 36 is a view illustrating a method of displaying a modified list on a display according to an exemplary embodiment.

The device 100 can make the selected item displayed on the list and the unselected item display scroll speed different from each other. For example, when receiving an input that the user touches and drags the scroll bar 3610, the device 100 may display it by scrolling the list in the dragging direction. When the list is scrolled and the selected item is included in the area 3620 of the screen, the device 100 makes the scroll speed different from the existing scroll speed. The existing scroll speed indicates the scroll speed when the scroll bar 3610 is touched and dragged without selecting an item from the list. In addition, the area 3620 of the screen is not limited to the area illustrated in FIG. 36 and may be set to an area having various sizes, shapes, and positions.

For example, when the selected item is included in the area 3620 of the screen, the scroll speed may be set to be slower than the existing scroll speed. In addition, when an unselected item is included in the area 3620 of the screen, the scroll speed can be set to be faster than the existing scroll speed. However, the present exemplary embodiment is not limited to this.

37 is a block diagram of the structure of the device 100 according to an exemplary embodiment; and FIG. 38 is a block diagram of the structure of the device 100 according to another exemplary embodiment.

As illustrated in FIG. 37, the device 100 includes a user interface 140, a display 121 and a controller 130. However, all the illustrated elements are not necessarily indispensable, and the device 100 may be embodied by more or less than the number of illustrated elements.

For example, as illustrated in FIG. 38, except for the user interface 140, the display In addition to the display 121 and the controller 130, the device 100 further includes a communication interface 110, an output interface 120, a sensor 150, an audio/video (A/V) interface 160, and a memory 170.

These elements are described in detail below.

The display 121 displays and outputs information processed by the device 100. For example, the display 121 may display handwritten text content, key text content, video content, lists, video content reproduction screens, audio content reproduction screens, and the like.

Alternatively, when the display 121 and the touch screen in the form of a touch panel forming a layer structure, in addition to the output device, the display 121 can also be used as an input device. The display 121 may include at least one of a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a 3D display, and an electrophoretic display. In addition, according to the implementation type of the device 100, the device 100 may include two or more of the displays 121.

The user interface 140 represents a device used by a user to input data to control the device 100. For example, the user interface 140 may include a keypad, a hemispherical switch, a touchpad (including a capacitive overlay type, a resistive overlay type, an infrared beam type, a surface acoustic wave type, an integral strain gauge type, and a piezoelectric type ), a jog wheel, a jog switch, etc., but the exemplary embodiment is not limited thereto.

The user interface 140 can receive user input selecting a portion of handwritten text content displayed on the display 121, user input selecting a portion of key text content displayed on the display 121, and selecting image content displayed on the display 121 At least one of the user input of the part, the user input of the part that selects all sections of the video content, the user input of the part that selects all sections of the audio content, and the selection of items in the list displayed on the display 121 User input.

In addition, the user interface 140 can receive user input for enlarging or reducing content, user input for changing the reproduction speed of video content or audio content, and the like. In this state, the user input may include touch input, stroke pattern input, button input, user motion input, device motion input, voice input, etc., but the exemplary embodiment is not limited thereto.

The controller 130, which is, for example, a processor, may control the overall operation of the device 100. For example, the controller 130 can control the communication interface 110, the output interface 120, the user interface 140, the sensor 150, the A/V interface 160, etc. by executing the program stored in the memory 170.

The controller 130 may display the selected handwritten text content and the unselected handwritten text content at different magnifications on the display 121.

The controller 130 may use different magnifications to enlarge or reduce the content of the selected handwritten text according to the thickness value, color value, and style value of the underline.

When receiving a pinch/spread input in which the user moves two fingers in a state of touching or moving away from each other in the direction toward or away from each other, the controller 130 may use different magnifications according to the distance moved by the two fingers Used to enlarge or reduce the content of selected handwritten text.

The controller 130 can display the selected keystroke text content and the unselected keystroke text content at different magnifications to display it on the display 121.

The controller 130 can display the selected image content and the unselected image content on the display 121 by zooming in or out at different magnifications.

The controller 130 can reproduce the selected section of the video content and the unselected section of the video content at different reproduction speeds.

The controller 130 can reproduce the selected section of the audio content at different reproduction speeds Unselected section with audio content.

When receiving a pinch/spread input that moves two fingers in a state toward or away from each other while touching the display 121, the controller 130 may change the selected section of the video content according to the distance moved by the two fingers The rate of increase or decrease of the reproduction speed.

When receiving a pinch/spread input that moves two fingers in a state toward or away from each other while touching the display 121, the controller 130 may change the selected section of the audio content according to the distance moved by the two fingers The rate of increase or decrease of the reproduction speed.

The controller 130 may display the selected item and the unselected item in the list by zooming in or out at different magnifications on the display 121.

The communication interface 110 may include one or more constituent elements that enable communication between the device 100 and an external device. For example, the communication interface 110 includes a short-range wireless communication interface 111, a mobile communication interface 112, and a broadcast receiver 113.

The short-range wireless communication interface 111 may include a Bluetooth communication interface, a Bluetooth low energy (BLE) communication interface, a near field communication (NFC) unit, a WLAN (Wi-Fi) communication interface, and a Zigbee Communication interface, infrared data association (IrDA) communication interface, Wi-Fi Direct (WFD) communication interface, ultra wideband (UWB) communication interface, Ant+ communication interface, etc., but this example The sexual embodiment is not limited to this.

The mobile communication interface 112 can send and receive wireless signals regarding at least one of the base station, the external terminal, and the server 300 via the mobile communication network. According to the sending and receiving of text/multimedia messages, wireless signals can include voice call signals and video call Called signals or various types of information.

The broadcast receiver 113 receives broadcast signals and/or information related to broadcast from the outside via a broadcast channel. The broadcast channel may include a satellite channel and a ground wave channel. In some embodiments, the device 100 may not include the broadcast receiver 113.

The communication interface 110 can transmit the multimedia information stored in the memory 170 to the server 300. For example, the multimedia information may include images, text, graphics, sound, video, animation, etc., but this exemplary embodiment is not limited thereto.

The output interface 120 outputs audio signals, video signals, or vibration signals, and includes a display 121, a sound output interface 122, and a vibration motor 123.

The audio output interface 122 outputs audio data received from the communication interface 110 or stored in the memory 170. In addition, the sound output interface 122 outputs sound signals related to functions first performed by the device 100, for example, call signal reception sound, message reception sound, or alarm sound. The sound output interface 122 may include a speaker, a buzzer, and the like.

The vibration motor 123 may output a vibration signal. For example, the vibration motor 123 may output a vibration signal corresponding to the output of audio data or video data, for example, a call signal reception sound or a message reception sound. In addition, when the touch is input to the touch signal, the vibration motor 123 may output a vibration signal.

The sensor 150 may sense the state of the device 100 or the state of the periphery of the device 100 and transmit the sensed information to the controller 130.

The sensor 150 may include a geomagnetic sensor 151, an acceleration sensor 152, a temperature/humidity sensor 153, an infrared sensor 154, a gyro sensor 155, a position sensor 156 (eg, a global positioning system (global positioning system; GPS)), atmospheric sensor 157, proximity sensor 158, and RGB sensor 159 At least one of (for example, an illuminance sensor), but the present exemplary embodiment is not limited thereto. Since the function of each sensor can be intuitively guessed from its name by those skilled in the art, its detailed description is omitted.

The sensor 150 may sense the position of the device 100 by using a position sensor.

The A/V interface 160 is used to input audio signals or video signals, and includes a camera 161 and a microphone 162. The camera 161 can acquire a frame such as a still image or an executed image via an image sensor in a video call mode or a photographing mode. The image captured by the image sensor can be processed by the controller 130 or a separate image processor.

The image frame processed by the camera 161 can be stored in the memory 170 or transmitted to the outside through the communication interface 150. Two or more of the cameras 161 may be provided.

The microphone 162 receives external sound signals and processes the received signals into electrical voice data. For example, the microphone 162 may receive sound signals from external devices or speakers. The microphone 162 may use various noise removal algorithms to remove noise generated during the input of an external sound signal.

The memory 170 can store programs for processing and controlling the controller 130 and data input and output.

The memory 170 may include at least one type of storage medium, such as flash memory type memory, hard disk type, multimedia card micro type, card type (eg, SD or XD memory, etc.), random access memory (random access memory; RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable erasable memory (electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (programmable read-only memory; PROM), magnetic memory, magnetic disks and optical discs. In addition, the device 100 can run a web storage or cloud server that performs the storage function of the memory 170 on the Internet.

The programs stored in the memory 170 can be classified into multiple modules according to their functions, for example, the UI module 171, the touch screen module 172, the notification module 173, and the like.

The UI module 171 may provide a UI or GUI engaged with the device 100 for each application. The touch screen module 172 can sense a user's touch gesture on the touch screen and transmit information about the touch gesture to the controller 130. The touch screen module 172 can recognize and analyze the touch code. The touch screen module 172 can be configured by a separate hardware including a controller.

Various sensors can be provided in or around the touch screen to sense touch or proximity touch on the touch screen. An example of a sensor that senses touch on the touch screen may be a tactile sensor. A tactile sensor means a sensor that detects contact of an object to a degree that human senses or exceeds human sense. The tactile sensor can detect various pieces of information, such as the roughness of the contact surface, the hardness of the contact object, and the temperature of the contact location.

In addition, an example of a sensor for sensing a touch on a touch screen is a proximity sensor.

The proximity sensor means a sensor that detects the presence of an object that is close to a predetermined detection surface or an object that exists nearby by using the force of an electronic field or using infrared rays without mechanical contact. Proximity sensors can include, for example, transmissive photoelectric sensors, direct reflective photoelectric sensors, specular reflective photoelectric sensors, high-frequency oscillation proximity sensors, capacitive proximity sensors, magnetic proximity sensors Sensor, infrared proximity sensor, etc. The user's touch gesture can include touch, Touch and hold, double tap, drag, move horizontally, toggle, drag and drop, slide, etc.

The notification module 173 may generate a signal to notify the occurrence of the event in the device 100. The events occurring in the device 100 may include, for example, call signal reception, message reception, key signal input, schedule notification, and the like. The notification module 173 may output the notification signal through the display 121 in the form of a video signal, output the audio signal through the sound output interface 122, or output the vibration signal through the vibration motor 123.

In addition, the exemplary embodiments may also be implemented via computer readable program code and/or instructions on a medium (eg, non-transitory computer readable medium) to control at least one processing element to implement any of the above embodiments. The media may correspond to any one or more media that can act as storage and/or perform the transmission of computer-readable program code.

The computer-readable program code can be recorded on and/or transmitted on the media in various ways, and examples of the media include recording media such as magnetic storage media (eg, ROM, floppy disk, hard disk, etc.), and optical recording Media (for example, compact disc read only memory (CD-ROM) or digital versatile disc (DVD)), and transmission media such as Internet transmission media. Therefore, the media may have a structure suitable for storing or carrying signals or information, such as a device for carrying bit stream according to one or more exemplary embodiments. The media can also be on a distributed network, so that the computer-readable program code is stored on the media in a distributed manner and/or transmitted and executed on the media. Furthermore, the processing element may include a processor or a computer processor, and the processing element may be distributed and/or included in a single device.

The foregoing exemplary embodiments and advantages are merely illustrative and should not be construed as limiting. This teaching can be easily applied to other types of equipment. In addition, instantiation The description of the sexual embodiments is intended to be illustrative, and is not intended to limit the scope of patent application, and many alternatives, modifications, and variations will be apparent to those skilled in the art.

100‧‧‧ installation

200‧‧‧Input tool

Claims (10)

An apparatus includes: a display configured to display content; an interface configured to receive a first input selecting a portion of the content displayed and a second input requesting a change in the size of the content displayed And a controller configured to control the display to display the selected portion of the displayed content by changing the size of the selected portion and the size of the unselected portion to be different from each other And the unselected portion of the displayed content in response to the interface receiving the second input, wherein the controller is further configured to control the display to: at a first magnification Increasing the size of the selected portion of the displayed content; and decreasing the size of the unselected portion of the displayed content at a second magnification determined based on the first magnification Size, where the first input uses an input tool to select the portion of the displayed content, and the controller is further configured to determine based on at least one of the thickness, color, and style of the first input The first magnification. The device according to item 1 of the patent scope, wherein the second input includes two-finger splay, and the controller is further configured to be based on the distance moved by two fingers in the two-finger splay The first magnification is determined. The device according to item 1 of the patent application scope, wherein the controller is further configured to control the display to: Stopping the display of the unselected portion of the displayed content; and displaying a first icon in place of the unselected portion of the displayed content. The device of claim 3, wherein the interface is further configured to receive a third input that selects the first icon, and the controller is further configured to control the display to display The unselected part of the content displayed, and the first icon is changed to a second icon in response to the interface receiving the third input. The device according to item 4 of the patent application scope, wherein the interface is further configured to receive a fourth input selecting the second icon, and the controller is further configured to control the display to stop displaying Display of the unselected part of the content, and changing the second icon to the first icon in response to the interface receiving the fourth input. The device according to item 1 of the patent application scope, wherein the content includes at least one of handwritten text, keystroke text, and video content. A method of providing content of a device, the method comprising: displaying content; receiving a first input selecting a portion of the content displayed, and a second input requesting to change the size of the displayed content; and by selecting The size of the part and the size of the unselected part are changed to be different from each other to display the selected part of the displayed content and the unselected part of the displayed content in response to receiving The interface of the second input, wherein the displaying the selected portion and the unselected portion include: increasing the selected portion of the displayed content at a first magnification The size of; and reducing the size of the unselected portion of the displayed content at a second magnification determined based on the first magnification, wherein the first input is selected for display using an input tool And the method further includes determining the first magnification based on at least one of the thickness, color, and style of the first input. The method for providing the content of the device as described in item 7 of the patent application range, wherein the second input includes two-finger splay, and the method further includes based on the distance moved by the two fingers in the two-finger splay To determine the first magnification. The method for providing content of a device as described in item 7 of the patent application range, wherein the displaying the selected portion and the unselected portion includes: stopping the display of the unselected portion of the displayed content ; And displaying a first icon in place of the unselected portion of the displayed content. The method for providing the content of the device as described in item 9 of the patent application scope further includes: receiving a third input selecting the first icon; and displaying the unselected portion of the displayed content, and will The first icon changes to the second icon in response to the interface receiving the third input.

Images