KR102097696B1 - Method of controlling touch function and an electronic device thereof - Google Patents

Abstract

The present invention includes the steps of sensing at least one first touch on a displayed content area, and determining a size of a first rectangle formed by the detected touch; Determining a size of a second rectangle formed by the sensed second touches; And comparing the sizes of the first rectangle and the second rectangle, and determining a function of the touch on the content area to display the content area and an apparatus to perform the method.

Description

Method for controlling touch function and its electronic device {METHOD OF CONTROLLING TOUCH FUNCTION AND AN ELECTRONIC DEVICE THEREOF}

The present invention relates to a method for controlling a touch function according to a touch and / or a movement (drag) of a touch on a content area of a touch screen of an electronic device, and an electronic device executing the method.

As a touch input type electronic device has been developed, a user can easily control scrolling or zooming of content displayed on a touch screen of an electronic device by touching an arbitrary area of the electronic device. For example, the content may be scrolled by touching an arbitrary area of the content displayed on the touch screen of the electronic device, or the content may be enlarged or reduced as much as a user desires.

However, in a conventional electronic device, a user first determines whether a touch input in a touch area is a single touch input or a multi-touch input, and the touch input operation scrolls the content displayed on the touch screen according to each touch input method. It is determined whether the operation is an operation to enlarge or reduce the content displayed on the touch screen. That is, in the electronic device, an algorithm is differently applied according to the number of each case, and a very complicated algorithm is required to recognize a single operation.

Accordingly, there is a need for a method for easily controlling scrolling of content displayed on a touch screen of an electronic device or enlargement / reduction of a content area according to a touch input by a user.

The present invention has been proposed to solve the above problems of the previously proposed methods, and an apparatus and method for confirming whether it is an event for expanding / reducing an area of content displayed on a touch screen according to a change in a touch area I would like to suggest.

Another proposal of the present invention is an apparatus and method for controlling scrolling of content displayed on a touch screen or enlargement / reduction of a content area according to a change in size of a touch area according to a movement of a touch (drag, movement). I would like to suggest.

Another proposal of the present invention is a device capable of controlling scrolling of a content area displayed on a touch screen or enlargement / reduction of an area according to a change in the number of pixels included in the touch area according to a movement of a touch (drag, movement). And to propose a method.

The operation method of the electronic device of the present invention for achieving the above object is a process of detecting at least one second touch on a displayed content area, and determining a size of a second rectangle formed by the detected touch , Determining a size of a third rectangle formed by the sensed third touches, and comparing the size of the third rectangle and the second rectangle to determine the size of the touch on the content area. And determining a function to display the content area.

An electronic device of the present invention for achieving the above object, a touch screen; One or more processors, a memory, and stored in the memory, and driven by the one or more processors, detect at least one second touch to a content area displayed on a touch screen, and are formed by the detected touch Determining a size of the second rectangle; Determining a size of a third rectangle formed by the sensed third touches; And comparing the sizes of the second and third rectangles to determine a function of the touch on the content area and displaying the content area on the touch screen.

Detecting at least one second touch to the displayed content area of the present invention, determining the size of the second rectangle formed by the sensed touch, and determining the size of the second square formed by the sensed touch. There is an effect of determining the size of the 3 squares and comparing the sizes of the second and third squares to determine the function of the touch on the content area.

1 (a) is a view for explaining a method for confirming whether an event for scrolling or enlarging / reducing an area of content displayed on a touch screen according to a change in a touch area according to an embodiment of the present invention
1 (b) is a view for explaining a method for determining a rectangular area of a touch area according to an embodiment of the present invention;
2 is a view showing an embodiment of generating a set area when a first touch input according to the present invention is received;
3 is a view showing an embodiment of generating a set area when two touch inputs according to the present invention are received;
4 is a view showing an embodiment of applying an offset when it is determined that an X coordinate of an intersection of a detected first pixel and an intersection of a second pixel according to the present invention is the same;
5 is a view showing an embodiment of applying an offset when it is determined that the Y coordinate of the intersection of the detected first pixel and the intersection of the second pixel according to the present invention is the same;
6 is a view showing an embodiment of scrolling displayed content by receiving one touch input according to the present invention;
7 is a view showing an embodiment of scrolling displayed content by receiving two touch inputs according to the present invention;
8 is a view showing an embodiment of scrolling displayed content by receiving a multi-touch input according to the present invention;
9 is a view showing an embodiment of reducing the displayed content by receiving two touch inputs according to the present invention;
10 is a flowchart illustrating an operation sequence of an electronic device according to an embodiment of the present invention,
11 is a block diagram showing the configuration of an electronic device according to an embodiment of the present invention;
12A is a flowchart of a method of an electronic device for adjusting a touch area according to an embodiment of the present invention.
12 (b) is a block diagram of an electronic device for adjusting a touch area according to the present invention,
13 (a) to 13 (d) are diagrams schematically showing an embodiment of scrolling or enlarging / reducing a displayed content area according to the present invention;
14 is a view showing another embodiment of enlarging displayed content by receiving two touch inputs according to the present invention;
15 is a diagram illustrating an embodiment of scrolling displayed content by receiving a multi-touch input according to the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. And, in the description of the present invention, if it is determined that a detailed description of related known functions or configurations may unnecessarily obscure the subject matter of the present invention, the detailed description will be omitted. In addition, terms to be described later are terms defined in consideration of functions in the present invention, which may vary according to a user's or operator's intention or practice. Therefore, the definition should be made based on the contents throughout this specification.

1 (a) is a diagram for explaining a method of determining whether an event is for scrolling or enlarging / reducing an area of content displayed on a touch screen according to a change in a touch area according to an embodiment of the present invention.

When the first touch is made among the areas of the content displayed on the screen of the electronic device, the first rectangular area 103 is generated at the point of the first touch. The method of forming the square will be described in detail in FIGS. 1 (b) and 2. When the point of the first touch exactly matches the point of the coordinate, the size of the first rectangle may be zero.

Also, the first rectangle may or may not appear on the touch screen. Within a certain period of time after the first touch (here, it means a time difference in which the user of the electronic device does not feel that the touch is completely discontinuous, for example, a constant time of 150 ms or less, which may be predetermined) When the second touch of (may) is made, the minimum value and the maximum value are determined based on the x and y values of the coordinates of the point of the first touch and the point of the second touch, and the second has four vertices. A square 104 can be formed. The second rectangle may or may not appear on the touch screen.

Further, even after the second touch, a plurality of touches made within a predetermined time may be further included. When a plurality of touches are additionally made within a predetermined time, a second rectangle having four vertices may be formed by setting a minimum value and a maximum value based on the x and y values of the coordinates of the points of the plurality of touch points. . In this case, all of the multiple touches are referred to as the second touch.

Next, by comparing the size (area) of the first rectangle and the area of the second rectangle, if the size of the second rectangle is greater than a predetermined first threshold, the first and second touches are touch screens. The content area displayed on is viewed as an event for scrolling or zooming.

In the following description, it is also referred to as a second touch including a first touch and a second touch. For example, in the description of FIGS. 7, 8, 9, 10, 11, 12, 13 (a) (b) (c) (d), 14 and 15, the second touch is The first touch and the second touch described above may be included.

Thereafter, when the second touch moves (drag, move) to form a third touch, four vertices determined according to the minimum and maximum values based on the x and y values of each coordinate of the third touch points. Compare the size of the third rectangle with the size of the second rectangle. In addition, the third rectangle may or may not appear on the touch screen. If the size of the third rectangle is larger than a predetermined second threshold value (also expressed as an offset) than the size of the second rectangle, the second and third touches are content areas displayed on the touch screen according to the change rate of the size To enlarge. An example in which the size of the third rectangle is larger than a predetermined threshold than the size of the second rectangle is shown in FIG. 13 (c). In addition, if the size of the third rectangle is smaller than a predetermined threshold than the size of the second rectangle, the content area displayed on the touch screen is reduced according to the rate of change of the sizes of the second and third touches. An example in which the size of the third rectangle is smaller than a predetermined threshold than the size of the second rectangle is shown in FIG. 13 (d).

Here, the threshold may be determined in consideration of the size of the touch screen.

Here, the ratio of enlargement or reduction of the content area may be proportional to the difference between the size of the third rectangle and the size of the second rectangle. Here, the proportionality may be a one-dimensional proportionality or a multidimensional proportionality relationship. That is, the enlarged value or reduced value of the content area may be a one-dimensional equation or a multidimensional equation relationship in which the difference between the size of the third rectangle and the size of the second rectangle is a variable.

Also, conditions for expanding the content area displayed on the touch screen may be differently set (may). That is, it may be given that the size of the rectangle exceeds the reference value as a condition for expanding the displayed content area. For example, when the reference value of the square size is set to 4 cm ² , the displayed content area can be enlarged from the time when the size of the second square exceeds this reference value (the first square is equal to or greater than the reference value). On the assumption that it is small). The ratio of the content area expansion may be linked to the ratio exceeding the reference value. If the size of the first rectangle is greater than or equal to a reference value, the displayed content area may be enlarged from a time when the size of the second rectangle becomes larger than the size of the first rectangle. The ratio of magnification can be linked to the ratio exceeding the reference value. On the condition that the displayed content area is reduced, the size of the rectangle becomes less than the reference value (assuming that the size of the first rectangle described in FIG. 1 (a) is equal to or greater than the reference value) to the reduction of the displayed content area. It can be given as a condition for.

In addition, two conditions for expanding the displayed content area described above can be used together. That is, the size of the rectangle exceeds the reference value, and the size of the third rectangle becomes larger than a predetermined second threshold value (also expressed as an offset) than the size of the second rectangle. You can do it as a condition. The size of the rectangle becomes less than a reference value and the size of the third rectangle becomes smaller than a predetermined second threshold value (sometimes expressed as an offset) than the size of the second rectangle as a condition of reducing the content area displayed on the touch screen. It can be decided.

In addition, here, instead of the size of the second and third rectangles, a reference value may be used as a value obtained by adding each product of the difference between the X-axis and the Y-axis of the coordinate points of each rectangle. That is, (Xmax-Xmin) ² + (Ymax-Ymin) ² can be used as a comparison criterion instead of a rectangle size (Xmax is the maximum value of the X axis among the coordinates of each point of the rectangle, and Xmin is the coordinates of each point of the rectangle) Of the X-axis minimum value, Ymax is the maximum Y-axis of the coordinates of each rectangle point, Ymin is the minimum Y-axis of the coordinates of each square point).

1 (b) is a view for explaining a method of determining a rectangular area by two touches according to an embodiment of the present invention. The electronic device according to the present invention receives two touch inputs in the area of the displayed content from the user.

The rectangular area 101 may be formed by determining a minimum value and a maximum value based on the x and y values of coordinates that do not exceed the coordinate values of two touch input points among areas of content displayed on the touch screen. Alternatively, the rectangular area 102 may be formed by determining the minimum and maximum values based on the x and y values of the closest coordinates, exceeding the coordinate values of the points of the two touch inputs among the areas of the content displayed on the touch screen. have.

Further, the rectangular areas 101 and 102 may be defined as areas generated based on the number of pixels included in two touch areas detected by two touch inputs among areas of content displayed on the touch screen. have.

When the rectangular area 101 is determined, when two touches are moved (105) to form another rectangle 106, the sizes of the rectangle 101 and the other rectangles 106 are compared, and when it becomes larger, displayed on the touch screen. Expand the content area.

2 is a view showing an embodiment of generating a set area when a first touch input is received according to the present invention. First, the electronic device according to the present invention may receive a touch input of at least one area of a content area displayed by a user. More specifically, the electronic device may receive one touch of an area of content displayed on the touch screen, or may receive two touches. Hereinafter, in the embodiment of the present invention, it will be described in detail a method of generating a set region on the assumption that a touch is received from one of the regions of content displayed on the touch screen.

The set area in the present invention may be defined as an area generated based on a pixel included in an area detected by one touch input among areas of content displayed on a touch screen. First, the electronic device may detect that one of the areas of the content displayed on the touch screen receives a touch input, and detect an intersection of pixels closest to the touch area. For example, if it is determined that any one pixel is touch input in the electronic device, the electronic device may detect an intersection of pixels closest to the center of the touch input area. Thereafter, the electronic device may generate an area set to include at least one pixel based on the intersection of the detected pixels. For example, as illustrated in FIG. 2, if the electronic device detects an intersection 201 of pixels, the electronic device may set an area 202 to include one pixel based on the detected intersection 201 of pixels. You can create That is, the electronic device may generate a pixel equal to a quarter of the four pixels centered on the intersection 201 of the detected pixels as the set region 202. As another example, the electronic device may generate an area 203 set to include four pixels based on the intersection 201 of the detected pixels. That is, the electronic device may generate the surrounding four pixels around the intersection 201 of the detected pixels as the set region 203. As another example, the electronic device may generate an area 204 set to include 16 pixels based on the intersection 201 of the detected pixels. That is, the electronic device may generate an area 204 set to include 16 pixels around the intersection point 201 of the detected pixels. In conclusion, when one touch input is received from the electronic device, the electronic device may generate an area set to include at least one pixel based on the intersection of the detected pixels. However, in this case, when the point of one touch exactly matches the point of the coordinate, the size of the rectangle may be zero.

3 is a view showing an embodiment of generating a set area when two touch inputs according to the present invention are received. First, the electronic device according to the present invention may receive a touch input of at least one area of a displayed content area. More specifically, the electronic device may receive a single touch input of one of the areas of the content displayed on the touch screen, or may receive dual touch inputs of the two areas. Hereinafter, in the embodiment of the present invention, it will be described in detail how to generate a set region on the assumption that two regions of a region of content displayed on the touch screen are dual-touch input.

The set area in the present invention may be defined as an area generated based on pixels included in a dual touch area detected by two touch inputs among areas of content displayed on a touch screen. First, the electronic device detects that two areas of the content area displayed on the touch screen receive a touch input, so that the intersection point 301 of the first pixel and the intersection point 302 of the second pixel closest to each touch area are detected. Can be detected. More specifically, when two areas of the content displayed on the touch screen are touch input by the electronic device, the electronic device intersects 301 and the second pixel of the first pixel that is an intersection of pixels closest to each touch input area. The intersection point 302 of the pixel can be detected. Thereafter, the electronic device may diagonally connect the detected intersection point 301 of the first pixel and the intersection point 302 of the second pixel to generate an area set to include at least one pixel. For example, the electronic device may set a total of 8 pixels (4 horizontal pixels and 2 vertical pixels) diagonally crossing the detected first pixel intersection point 301 and the second pixel intersection point 302 ( 303). As another example, the electronic device may set a total of 24 pixels (6 horizontal pixels and 4 vertical pixels) diagonally crossing the detected first pixel intersection 301 and the second pixel intersection 302 ( 304). As another example, the electronic device may set a total of 48 pixels (8 horizontal pixels and 6 vertical pixels) diagonally crossing the detected first pixel intersection 301 and the second pixel intersection 302 ( 305). In conclusion, the electronic device may diagonally connect the detected intersection point 301 of the first pixel and the intersection point 302 of the second pixel to generate an area set to include at least one pixel.

4 is a view showing an embodiment of applying an offset when it is determined that the X coordinates of the intersection of the detected first pixel and the intersection of the second pixel according to the present invention are the same. First, the electronic device detects that two areas of the content area displayed on the touch screen receive touch input, so that the intersection point 401 of the first pixel and the intersection point 402 of the second pixel closest to each touch area are detected. Can be detected. More specifically, when two areas of content displayed on the touch screen are touch input by the electronic device, the electronic device intersects 401 and the second pixel of the first pixel that is the intersection of pixels closest to each touch input area. Pixel intersection 402 may be detected. Thereafter, the electronic device may diagonally connect the detected intersection point 401 of the first pixel and the intersection point 402 of the second pixel to generate a square that is an area set to include at least one pixel.

However, as illustrated in FIG. 4A, if it is determined that the X-coordinates of the intersection 401 of the first pixel and the intersection 402 of the second pixel detected by the electronic device are the same, the electronic device sets the area. Cannot be created. More specifically, the electronic device performs an algorithm for generating a set region by connecting an intersection 401 of the first pixel and an intersection 402 of the second pixel, if the intersection of the first pixel 401 ) And the intersection point 402 of the second pixel is the same, a problem that the present algorithm cannot be performed may occur. Accordingly, when it is determined that the intersection 401 of the first pixel and the intersection 402 of the second pixel detected by the electronic device according to the present invention are the same, the electronic device may apply an offset to each X coordinate. have. More specifically, the electronic device may subtract the α value set in the X coordinate of the first pixel, and add or subtract the α value set in the X coordinate of the second pixel. For example, suppose that the X coordinate of the first pixel detected by the electronic device is X1, and the X coordinate of the detected second pixel is also X1. As described above, if the X coordinate of the first pixel and the X coordinate of the second pixel detected by the electronic device are the same as X1, the electronic device subtracts the α value set in X1, which is the X coordinate of the first pixel, and the second The α value set in X1, which is the X coordinate of the pixel, can be added or subtracted. Accordingly, the electronic device can obtain the X1-α value as the X coordinate of the intersection point of the first pixel, and obtain the X1 + α value as the X coordinate of the intersection point of the second pixel. In conclusion, as illustrated in FIG. 4B, the electronic device applies the offset to the detected X-coordinate, and the intersection of the newly obtained first pixel (X1-α Y1, 403) and the intersection of the second pixel (X1) + α Y2, 404) may be connected to generate a set region 405.

Alternatively, as illustrated in FIG. 4A, the first touch point (intersection of the first pixel) 401 and the second touch point (intersection of the second pixel) detected in the electronic device ( If the X coordinate of 402) is the same, the size is replaced by the square of the difference value (Y1-Y2) of the Y-axis value (Y1) of the point of the first touch and the Y-axis value (Y2) of the point of the second touch. You can. That is, (Y1-Y2) ² can be regarded as the size of the set area.

5 is a view showing an embodiment of applying an offset when it is determined that the Y coordinates of the intersection of the detected first pixel and the intersection of the second pixel according to the present invention are the same. First, the electronic device detects that a touch is input to two of the regions of the content displayed on the touch screen, and the intersection 501 of the first pixel and the intersection 502 of the second pixel closest to each touch region are detected. Can be detected. More specifically, when a touch is input to two areas of the content displayed on the touch screen in the electronic device, the electronic device intersects the first pixel, 501 and the second, which are the intersections of the pixels closest to each touch input area. Pixel intersection 502 may be detected. Thereafter, the electronic device may diagonally connect the detected intersection point 501 of the first pixel and the intersection point 502 of the second pixel to generate a square that is an area set to include at least one pixel.

However, as illustrated in FIG. 5A, if it is determined that the Y coordinates of the intersection 501 of the first pixel and the intersection 502 of the second pixel detected by the electronic device are the same, the electronic device sets the area. Cannot be created. More specifically, the electronic device performs an algorithm for generating a set region by connecting the first pixel intersection 501 and the second pixel intersection 502, if the first pixel intersection 501 ) And the second pixel have the same intersection point 502, a problem that the present algorithm cannot be performed may occur. Accordingly, in the electronic device according to the present invention, if it is determined that the detected intersection point 501 of the first pixel and the intersection point 502 of the second pixel are the same, the electronic device may apply an offset to each Y coordinate. More specifically, the electronic device may subtract the α value set in the Y coordinate of the first pixel, and add or subtract the α value set in the Y coordinate of the second pixel. For example, assume that the Y coordinate of the first pixel detected by the electronic device is Y1, and the Y coordinate of the detected second pixel is also Y1. As described above, if the Y coordinate of the first pixel and the Y coordinate of the second pixel detected by the electronic device are the same as Y1, the electronic device subtracts the α value set in Y1, which is the Y coordinate of the first pixel, and the second The α value set in the Y coordinate Y1 of the pixel can be added or subtracted. Accordingly, the electronic device can obtain a Y1-α value as the Y coordinate of the intersection point of the first pixel, and obtain a Y1 + α value as the Y coordinate of the intersection point of the second pixel. In conclusion, as shown in FIG. 5 (b), the electronic device applies the offset to the detected Y coordinate, and the intersection of the newly obtained first pixel (X1, Y1-α, 503) and the second pixel ( The set region 505 may be generated by connecting X2 and Y1 + α values, 504.

Alternatively, as illustrated in FIG. 5A, the first touch point (intersection of the first pixel) 501 and the second touch point (intersection of the second pixel) detected in the electronic device ( If the Y coordinate of 502) is the same, the size is replaced by the square of the difference value (X1-X2) between the X-axis value (X1) of the point of the first touch and the X-axis value (X2) of the point of the second touch. You can. That is, (X1-X2) ² can be regarded as the size of the set area.

6 is a diagram illustrating an embodiment of scrolling displayed content by receiving one touch input according to the present invention. As illustrated in FIG. 6, the electronic device according to the present invention may receive one touch input and scroll a content area displayed on the touch screen. Even when receiving a single touch input, if additional conditions are given, scrolling or zooming of the content area displayed on the touch screen may be possible.

However, hereinafter, a case in which the content area displayed on the touch screen is scrolled will be described. First, the electronic device may measure the amount of change in the number of pixels included in the region 602 generated as the touch area is moved, and then determine the amount of change in the number of measured pixels. Thereafter, if the increased or decreased change amount of the number of pixels determined by the electronic device is greater than or equal to the set first change amount and less than the set second change amount, the electronic device may scroll the content to the area where the touch area is moved. For example, suppose that the number of pixels included in the initially generated region 601 is 4, the set first change amount is 0, and the set second change amount is the number of 10 pixels. In the above-described assumption, if the amount of change in pixels is measured by the touch input moved from the number of 4 pixels generated by the initial touch input of the electronic device, the electronic device moves the content displayed on the touch screen to the touch area. You can scroll through the area. More specifically, the electronic device increases or decreases the amount of change in the number of pixels in the area 602 newly generated by the touch input moved from the number of pixels generated by the initial touch input, and is a set second change amount or more. If it is determined as less, the electronic device may scroll the content displayed on the touch screen to the area where the touch area is moved.

Also, the electronic device may measure the amount of change in the size of the region 602 generated as the touch area is moved, and then determine the amount of change in the size of the measured change. Thereafter, if the increased or decreased change amount of the size determined by the electronic device is greater than or equal to the set first change amount and less than the set second change amount, the electronic device may scroll the content to the moved area of the touch area. For example, suppose that the size in the generated region is 84 mm ² , the set first change amount is 0 mm ² , and the set second change amount is 20 mm ² . In the above-mentioned assumption, if the amount of change of the pixel is measured as 0 mm ² by the touch input moved from 8 mm ^{2 which} is the size of the area generated by the first touch input of the electronic device, the electronic device touches the content displayed on the touch screen You can scroll to this moved area. More specifically, the electronic device increases or decreases the amount of change in the size in the area 602 newly generated by the touch input moved from the size 601 of the area generated by the initial touch input, and is the set second change or more. If it is determined that the amount is less than the change, the electronic device may scroll the content displayed on the touch screen to the area where the touch area is moved.

7 is a view showing an embodiment of scrolling displayed content by receiving two touch inputs according to the present invention. As illustrated in FIG. 7, the electronic device according to the present invention may receive two touch inputs and scroll content displayed on the touch screen. First, the electronic device detects that two areas of the content area displayed on the touch screen receive touch input, so that the intersection point 701 of the first pixel and the intersection point 702 of the second pixel closest to each touch area are detected. Can be detected. More specifically, when two areas of content displayed on the touch screen are touch input by the electronic device, the electronic device intersects 701 and the second pixel of the first pixel that is an intersection of pixels closest to each touch input area. The intersection point 702 of the pixel can be detected. Thereafter, the electronic device may diagonally connect the detected intersection point 701 of the first pixel and the intersection point 702 of the second pixel to generate an area 703 set to include at least one pixel. For example, the electronic device may generate a rectangle that diagonally crosses the detected intersection point 701 of the first pixel and the intersection point 702 of the second pixel, thereby generating the set region 703 in the present invention.

Thereafter, the electronic device may measure the amount of change in the number of pixels included in the area 704 generated as the touch area is moved, and then determine the amount of change in the number of measured pixels. Thereafter, if the increased or decreased change amount of the number of pixels determined by the electronic device is greater than or equal to the set first change amount and less than the set second change amount, the electronic device may scroll the content to the area where the touch area is moved. For example, suppose that the number of pixels included in the generated area 703 is 20, the set first change amount is 0, and the set second change amount is the number of 20 pixels. In the above-described assumption, if the amount of change in pixels is measured by the touch input moved from the number of 20 pixels generated by the initial touch input of the electronic device, the electronic device moves the content displayed on the touch screen to the touch area. You can scroll through the area. More specifically, the electronic device increases or decreases the amount of change in the number of pixels in the region 704 newly generated by the touch input moved from the number of pixels generated by the initial touch input, and is a set second change amount or more. If it is determined as less, the electronic device may scroll the content displayed on the touch screen to the area where the touch area is moved.

In addition, the electronic device may measure the amount of change in the size of the region 704 generated as the touch area is moved, and then determine the amount of change in the size of the measured change. Thereafter, if the increased or decreased change amount of the size determined by the electronic device is greater than or equal to the set first change amount and less than the set second change amount, the electronic device may scroll the content to the moved area of the touch area. For example, suppose that the size in the generated region is 84 mm ² , the set first change amount is 0 mm ² , and the set second change amount is 20 mm ² . In the above-described assumption, by a touch input is moved from the of the generated region by the first touch input of the electronic device size 84mm ² if the increased amount of change of the pixels measured in 15mm ^2, the electronic device the content displayed on the touch screen The touch area may scroll to the moved area. More specifically, the electronic device increases or decreases the amount of change in the size in the area 704 newly generated by the touch input moved from the size 703 of the area generated by the initial touch input, and is the set second change or more. If it is determined that the amount is less than the change, the electronic device may scroll the content displayed on the touch screen to the area where the touch area is moved.

8 is a diagram illustrating an embodiment of scrolling displayed content by receiving a multi-touch input according to the present invention.

The electronic device detects three touch inputs 801, 802, and 803 of the content area displayed on the touch screen. Comparing the X and Y coordinate values of each sensed touch input, determining the maximum and minimum values of the X value, and determining the minimum and maximum values of the Y coordinate value, the second rectangle (box) area 803 consisting of these coordinate values To set. Next, the size of the third rectangle (box) 805 formed by the maximum and minimum values of the X and Y coordinates of the two touch points is determined by decreasing one touch as the above two touches move (drag). do. When the difference between the size of the third rectangle and the size of the second rectangle is less than or equal to a threshold (also expressed as an offset), the movement of the upper touch is determined to scroll the upper content area. In this case, the content area is scrolled and displayed. Scrolling here corresponds to scroll down.

Here, the threshold value is a predetermined value according to the function setting of the electronic device, and may be changed according to the user's setting.

Here, as described in FIG. 1 (a), the size (area) of the first rectangle formed by the first touch included in the second touch is compared with the area of the second rectangle of the second touch. Thus, when the size of the second rectangle is larger than a predetermined first threshold, the first and second touches view the content area displayed on the touch screen as an event for scrolling or zooming. It may be additionally performed before the process of detecting three touch inputs 801, 802, and 803 of the content area displayed on the touch screen.

Here, the area of the content displayed on the touch screen of the electronic device may point to an object displayed on the touch screen of the electronic device. The object may be a graphical object (may).

 9 is a view showing an embodiment of reducing the displayed content by receiving two touch inputs according to the present invention.

The electronic device detects two touch inputs 901 and 902 among the areas of the content displayed on the touch screen, compares the X and Y coordinate values of each detected touch input, and determines the maximum and minimum values of the X value. (Here, the case where a constant offset is set at the maximum and minimum values of the X value) The minimum and maximum values of the Y coordinate value are determined (here, the case where a constant offset is set at the maximum and minimum values of the Y value) A second square (box) region 903 made up of these coordinate values is set. Next, the size of the third rectangle (box) 907 formed by the maximum and minimum values of X and Y coordinates of the touch points generated by dragging (dragging) the above two touches (by applying a constant offset) is determined. Decide. As illustrated in FIG. 9, the size of the third rectangle 907 is smaller than the size of the second rectangle 903. That is, the case where the difference between the maximum and minimum values of X and Y coordinates of the moved touch and a minimum value (by applying a constant offset) is smaller than that before the movement. When the difference in size of the rectangle exceeds a predetermined threshold, the movement of the upper touch is determined to zoom in on the upper content area. In this case, the content area is reduced to the touch screen. Is displayed.

Here, the reduction ratio of the content area may be proportional to the difference between the size of the third rectangle and the size of the second rectangle. Here, the proportionality may be a one-dimensional proportionality or a multidimensional proportionality relationship. That is, the reduction value of the content area may be a one-dimensional equation or a multi-dimensional equation relationship in which the difference between the size of the third rectangle and the size of the second rectangle is a variable.

In addition, here, instead of the size of the second and third rectangles, a reference value may be used as a value obtained by adding each product of the difference between the X-axis and the Y-axis of the coordinate points of each rectangle. That is, (Xmax-Xmin) ² + (Ymax-Ymin) ² can be used as a comparison criterion instead of a rectangle size (Xmax is the maximum value of the X axis among the coordinates of each point of the rectangle, and Xmin is the coordinates of each point of the rectangle) Of the X-axis minimum value, Ymax is the maximum Y-axis of the coordinates of each rectangle point, Ymin is the minimum Y-axis of the coordinates of each square point).

Here, the process of viewing the content area displayed on the touch screen as an event for scrolling or zooming as described in FIG. 1 (a), the electronic device touches two of the content areas displayed on the touch screen. It may be made before the process of sensing the inputs 901 and 902.

Here, the threshold value is a predetermined value according to the function setting of the electronic device, and may be changed according to the user's setting.

The enlargement of the content area displayed on the touch screen of the electronic device may be a large adjustment of a parameter of an object displayed on the touch screen of the electronic device (may).

10 is a flowchart of a method of an electronic device for adjusting a touch area according to an embodiment of the present invention. First, the electronic device senses at least one touch (second touch) on the displayed content area (1001), and determines the size of the second rectangle formed by the detected touch (1002). Next, the size of the third rectangle formed by the detected third touches is determined (1003). Next, the sizes of the squares are compared (1004) to determine the function of the touch on the content area. The function of the touch may mean enlargement or reduction of the content area displayed on the touch screen of the electronic device. Alternatively, it may mean scrolling of the content area. That is, the content area is displayed according to the determined function by performing this method of the third rectangle (1005).

Here, the second rectangle and the third rectangle are composed of four vertices determined according to the minimum and maximum values based on the x and y values of the coordinates of the second and third touch points. By comparing the size of the third rectangle with the size of the second rectangle, if the size of the third rectangle is greater than a predetermined threshold than the size of the second rectangle, the second and third touches are touched according to the rate of change of the size The content area displayed on the screen is enlarged. An example in which the size of the third rectangle is larger than a predetermined threshold than the size of the second rectangle is shown in FIG. 13 (c). In addition, if the size of the third rectangle is smaller than a predetermined threshold than the size of the second rectangle, the content area displayed on the touch screen is reduced according to the rate of change of the sizes of the second and third touches. An example in which the size of the third rectangle is smaller than a predetermined threshold than the size of the second rectangle is shown in FIG. 13 (d).

Here, the ratio of enlargement or reduction of the content area may be proportional to the difference between the size of the third rectangle and the size of the second rectangle. Here, the proportionality may be a one-dimensional proportionality or a multidimensional proportionality relationship. That is, the enlarged value or reduced value of the content area may be a one-dimensional equation or a multidimensional equation relationship in which the difference between the size of the third rectangle and the size of the second rectangle is a variable.

In addition, here, instead of the size of the second and third rectangles, a reference value may be used as a value obtained by adding each product of the difference between the X-axis and the Y-axis of the coordinate points of each rectangle. That is, (Xmax-Xmin) ² + (Ymax-Ymin) ² can be used as a comparison criterion instead of a rectangle size (Xmax is the maximum value of the X axis among the coordinates of each point of the rectangle, and Xmin is the coordinates of each point of the rectangle) Of the X-axis minimum value, Ymax is the maximum Y-axis of the coordinates of each rectangle point, Ymin is the minimum Y-axis of the coordinates of each square point).

Here, the threshold value is a predetermined value according to the function setting of the electronic device, and may be changed according to the user's setting.

Here, the second touch may be a plurality of touches, and among the plurality of touches, a first touch that is first touched among areas of content displayed on the screen of the electronic device may be included. This relationship may be as described in the description of FIG. 1 (a) (may).

That is, the size (area) of the first rectangle formed by the first touch included in the second touch is compared with the area of the second rectangle of the second touch, and the size of the second rectangle is determined in advance. If it is greater than a threshold value, the process of viewing the content area displayed on the touch screen as an event for scrolling or zooming may include at least one of the content areas displayed on the touch screen of the electronic device. It may be made before the sensing step 1001 of the touches (second touch).

Here, the area of the content displayed on the touch screen of the electronic device may point to an object displayed on the touch screen of the electronic device. The object may be a graphical object.

The enlargement or reduction of the content area is to adjust parameters of an object displayed on the touch screen of the electronic device.

The scrolling of the content area may indicate scrolling of an object displayed on the touch screen of the electronic device (may).

Adjusting the parameter of an object displayed on the touch screen of the electronic device may indicate increasing or reducing (zooming-out) the size of the content displayed on the touch screen of the electronic device (zooming-in). The scrolling of an object displayed on the touch screen of the electronic device may indicate that the content displayed on the touch screen of the electronic device is scrolled up or down.

11 is a block diagram showing the configuration of an electronic device according to an embodiment of the present invention. The electronic device 1100 may be a portable electronic device, a portable terminal, a mobile phone, a mobile pad, a media player, a tablet computer It may be a device such as (tablet computer), handheld computer or PDA (Personal Digital Assistant). Further, it may be any portable electronic device including a device that combines two or more of these devices.

The electronic device 1100 includes a memory 1110, a processor unit 1120, a first wireless communication subsystem 1130, a second wireless communication subsystem 1131, an external port 1160, an audio sub It includes a system 1150, a speaker 1151, a microphone 1152, an input / output (IO) system 1170, a touch screen 1180, and other input or control devices 1190. A plurality of memory 1110 and external ports 1160 may be used.

The processor unit 1120 may include a memory interface 1121, one or more processors 1122, and a peripheral interface 1123. In some cases, the entire processor unit 1120 is also referred to as a processor.

In the present invention, the processor unit 1120 detects at least one first touch on the displayed content area, and determines the size of the first rectangle formed by the detected touch; the detected touch moves Determining a size of the second rectangle formed by the second touches; And comparing the sizes of the first rectangle and the second rectangle, and determining a function of the touch on the content area to display the content area.

The processor 1122 executes various software programs to perform various functions for the electronic device 1100, and also performs processing and control for voice communication and data communication. In addition, in addition to these conventional functions, the processor 1122 also executes specific software modules (instruction sets) stored in the memory 1110 to perform various specific functions corresponding to the modules. That is, the processor 1122 works with the software modules stored in the memory 1110 to perform the method of the embodiment of the present invention described herein.

The processor 1122 may include one or more data processors, image processors, or codecs (CODECs). The data processor, image processor or codec can also be configured separately. Also, it may be composed of several processors performing different functions. The peripheral device interface 1123 connects the input / output subsystem 1170 of the electronic device 1100 and various peripheral devices to the processor 1122 and the memory 1110 (via a memory interface).

The various components of the electronic device 1100 may be coupled by one or more communication buses (not shown) or stream lines (not shown).

The external port 1160 is used to directly connect a portable electronic device (not shown) to another electronic device or indirectly connect to another electronic device through a network (eg, Internet, intranet, wireless LAN, etc.). The external port 1160 is, for example, but not limited to, a Universal Serial Bus (USB) port or a FIREWIRE port.

The motion sensor 1191 and the first optical sensor 1192 may be coupled to the peripheral device interface 1123 to enable various functions. For example, the motion sensor 1191 and the light sensor 1192 may be coupled to the peripheral interface 1123 to enable motion detection of the electronic device and light detection from the outside, respectively. In addition, other sensors, such as a position measurement system, a temperature sensor, or a biological sensor, may be connected to the peripheral device interface 1123 to perform related functions.

The camera subsystem 1193 may perform camera functions, such as recording photos and video clips.

The optical sensor 1192 may use a charged coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) device.

The communication function is performed through one or more wireless communication subsystems 1130, 1131. The wireless communication subsystems 1130 and 1131 may include radio frequency receivers and transceivers and / or optical (eg, infrared) receivers and transceivers. The first communication subsystem 1130 and the second communication subsystem 1131 may be classified according to a communication network through which the electronic device 1100 communicates. For example, communication networks include, but are not limited to, Global System for Mobile Communication (GSM) networks, Enhanced Data GSM Environment (EDGE) networks, Code Division Multiple Access (CDMA) networks, and W-Code Division (W-CDMA). A communication subsystem designed to operate over multiple access (LTE) networks, long term evolution (LTE) networks, orthogonal frequency division multiple access (OFDMA) networks, wireless fidelity (Wi-Fi) networks, WiMax networks, and / or Bluetooth networks. It can contain. The first wireless communication subsystem 1130 and the second wireless communication subsystem 1131 may be combined to form one wireless communication subsystem.

An audio subsystem 1150 can be coupled to the speaker 1151 and the microphone 1152 to handle input and output of audio streams such as speech recognition, speech duplication, digital recording and telephone functions. That is, the audio subsystem 1150 communicates with the user through a speaker 1151 and a microphone 1152. The audio subsystem 1150 receives the data stream through the peripheral interface 1123 of the processor unit 1120, and converts the received data stream into an electrical stream. The converted electric signal (electric signal) is delivered to the speaker 1151. The speaker 1151 converts and outputs an electric stream into a sound wave that can be heard by a human. The microphone 1152 converts sound waves transmitted from a person or other sound sources into an electric stream. Audio subsystem 1150 receives the converted electrical stream from microphone 1152. The audio subsystem 1150 converts the received electrical stream into an audio data stream, and transmits the converted audio data stream to the peripheral interface 1123. The audio subsystem 1150 may include attachable and detachable earphones, headphones, or headsets.

The input / output (I / O) subsystem 1170 may include a touch screen controller 1171 and / or other input controller 1172. The touch screen controller 1171 may be coupled to the touch screen 1180. The touch screen 1180 and the touch screen controller 1171 are not limited to the following, but also other capacitive, resistive, infrared and surface acoustic wave techniques for determining one or more contact points with the touch screen 1180. Any multi-touch sensing technique, including proximity sensor arrangements or other elements, can be used to detect contact and movement or interruption thereof. Other input controller 1172 can be coupled to other input / control devices 1190. Other input / control devices 1190 may be one or more buttons, rocker switches, thumb-wheels, dials, sticks, and / or pointer devices such as stylus.

The touch screen 1180 provides an input / output interface between the electronic device 1100 and a user. That is, the touch screen 1180 transmits a user's touch input to the electronic device 1100. It is also a medium that shows the output from the electronic device 1100 to the user. That is, the touch screen 1180 shows a visual output to the user. These visual outputs appear in the form of text, graphics, video and combinations thereof.

Various displays may be used as the touch screen 1180. For example, but not limited to, liquid crystal display (LCD), light emitting diode (LED), light emitting polymer display (LPD), organic light emitting diode (OLED), active matrix organic light emitting diode (AMOLED) or FLED (Flexible LED) can be used.

The memory 1110 may be coupled to the memory interface 1121. The memory 1110 may include high-speed random access memory and / or non-volatile memory, such as one or more magnetic disk storage devices, one or more optical storage devices, and / or flash memory (eg, NAND, NOR).

The memory 1110 stores software. The software components include an operating system module 1111, a communication module 1112, a graphics module 1113, a user interface module 1114 and an MPEG module 1115, a camera module 1116, one or more application modules (1117). In addition, since a module that is a software component can be expressed as a set of instructions, the module is also referred to as an instruction set. Modules can also be expressed as programs. Operating system software 1111 (e.g., built-in operating system such as WINDOWS, LINUX, Darwin, RTXC, UNIX, OS X, or VxWorks) is a set of software that controls common system operation. Includes components. Control of such general system operation means, for example, memory management and control, storage hardware (device) control and management, power control and management, and the like. The operating system software also functions to facilitate communication between various hardware (devices) and software components (modules).

The communication module 1112 may enable communication with other electronic devices such as computers, servers, and / or portable terminals through the wireless communication subsystems 1130 and 1131 or the external ports 1160.

The graphics module 1113 includes various software components for providing and displaying graphics on the touch screen 1180. The term graphics is used to include text, web pages, icons, digital images, videos, animations, and the like.

The user interface module 1114 includes various software components related to the user interface. It includes information on how the state of the user interface changes or under what conditions the state of the user interface changes.

The codec (CODEC) module 1115 may include software components related to encoding and decoding of a video file. The codec module may include a video stream module such as an MPEG module and / or H204 module. In addition, the codec module may include codec modules for various audio files such as AAA, AMR, and WMA. In addition, the codec module 1115 includes a set of instructions corresponding to the method of the present invention.

The camera module 1116 includes camera related software components that enable camera related processes and functions.

The application module 1117 includes a browser, email, instant message, word processing, keyboard emulation, address book, and touch list , Widgets, digital rights management (DRM), voice recognition, voice duplication, position determining function, location based service, and the like.

In addition, various functions of the electronic device 1100 according to the present invention mentioned above and to be described below include one or more stream processing and / or application specific integrated circuits (ASICs). Hardware and / or software and / or combinations thereof.

For example, referring to FIGS. 13 (a) to 13 (d), the present invention is stored in a touch screen, one or more processors, memory, and memory, and is driven by one or more processors, Detecting at least one second touch on the content area displayed on the screen, determining the size of the second rectangle formed by the sensed touch, and the third rectangle formed by the sensed touch moved by the third touches A program that performs a process of determining a size of the screen, comparing the sizes of the second and third rectangles, and determining the function of the touch on the content area to display the content area on the touch screen, or a program including such commands. It may be a device that includes. Here, the process of displaying may indicate scrolling of the content area or enlargement or reduction of the content area.

Here, the ratio of enlargement or reduction of the content area may be proportional to the difference between the size of the third rectangle and the size of the second rectangle. Here, the proportionality may be a one-dimensional proportionality or a multidimensional proportionality relationship. That is, the enlarged value or reduced value of the content area may be a one-dimensional equation or a multidimensional equation relationship in which the difference between the size of the third rectangle and the size of the second rectangle is a variable.

In addition, here, instead of the size of the second and third rectangles, a reference value may be used as a value obtained by adding each product of the difference between the X-axis and the Y-axis of the coordinate points of each rectangle. That is, (Xmax-Xmin) ² + (Ymax-Ymin) ² can be used as a comparison criterion instead of a rectangle size (Xmax is the maximum value of the X axis among the coordinates of each point of the rectangle, and Xmin is the coordinates of each point of the rectangle) Of the X-axis minimum value, Ymax is the maximum Y-axis of the coordinates of each rectangle point, Ymin is the minimum Y-axis of the coordinates of each square point).

Also, conditions for expanding the content area displayed on the touch screen may be differently set (may). That is, it may be given that the size of the rectangle exceeds the reference value as a condition for expanding the displayed content area. For example, when the reference value of the square size is set to 4 cm ² , the displayed content area can be enlarged from the time when the size of the second square exceeds this reference value (described in FIG. 1 (a)). The first rectangle is assumed to be equal to or less than the reference value). The ratio of the content area expansion may be linked to the ratio exceeding the reference value. If the size of the first rectangle is greater than or equal to a reference value, the displayed content area may be enlarged from a time when the size of the second rectangle becomes larger than the size of the first rectangle. The ratio of magnification can be linked to the ratio exceeding the reference value. As a condition for reducing the displayed content area, the size of the rectangle may be less than the reference value as a condition for the reduction of the displayed content area (the size of the first rectangle described in FIG. 1 (a) is the same as the reference value) Assuming greater or greater).

In addition, two conditions for expanding the displayed content area described above can be used together. That is, the size of the rectangle exceeds the reference value, and the size of the third rectangle becomes larger than a predetermined second threshold value (also expressed as an offset) than the size of the second rectangle. You can do it as a condition. The size of the rectangle becomes less than a reference value and the size of the third rectangle becomes smaller than a predetermined second threshold value (sometimes expressed as an offset) than the size of the second rectangle as a condition of reducing the content area displayed on the touch screen. It can be decided.

12A is a flowchart of a method of an electronic device for adjusting a touch area according to an embodiment of the present invention. First, the electronic device detects at least one second touch on the displayed content area, and determines the size of the second rectangle formed by the detected touch (1201). Next, the size of the third rectangle formed by the sensed third touches is determined (1202). Next, the size of the second rectangle and the third rectangle are compared to determine a function of the touch on the content area. The content area is displayed according to the determined function by performing this method (1203).

Here, the second rectangle and the third rectangle are composed of four vertices determined according to the minimum and maximum values based on the x and y values of the coordinates of the second and third touch points. By comparing the size of the third rectangle with the size of the second rectangle, if the size of the third rectangle is greater than a predetermined threshold than the size of the second rectangle, the second and third touches are touched according to the rate of change of the size The content area displayed on the screen is enlarged. An example in which the size of the third rectangle is larger than a predetermined threshold than the size of the second rectangle is shown in FIG. 13 (c). In addition, if the size of the third rectangle is smaller than a predetermined threshold than the size of the second rectangle, the content area displayed on the touch screen is reduced according to the rate of change of the sizes of the second and third touches. An example in which the size of the third rectangle is smaller than a predetermined threshold than the size of the second rectangle is shown in FIG. 13 (d).

Here, the ratio of enlargement or reduction of the content area may be proportional to the difference between the size of the third rectangle and the size of the second rectangle. Here, the proportionality may be a one-dimensional proportionality or a multidimensional proportionality relationship. That is, the enlarged value or reduced value of the content area may be a one-dimensional equation or a multidimensional equation relationship in which the difference between the size of the third rectangle and the size of the second rectangle is a variable.

In addition, here, instead of the size of the second and third rectangles, a reference value may be used as a value obtained by adding each product of the difference between the X-axis and the Y-axis of the coordinate points of each rectangle. That is, (Xmax-Xmin) ² + (Ymax-Ymin) ² can be used as a comparison criterion instead of a rectangle size (Xmax is the maximum value of the X axis among the coordinates of each point of the rectangle, and Xmin is the coordinates of each point of the rectangle) Of the X-axis minimum value, Ymax is the maximum Y-axis of the coordinates of each rectangle point, Ymin is the minimum Y-axis of the coordinates of each square point).

Here, the threshold value is a predetermined value according to the function setting of the electronic device, and may be changed according to the user's setting.

Here, the second touch may be a plurality of touches, and among the plurality of touches, a first touch that is first touched among areas of content displayed on the screen of the electronic device may be included. This relationship may be as described in the description of FIG. 1 (a).

That is, the size (area) of the first rectangle formed by the first touch included in the second touch is compared with the area of the second rectangle of the second touch, and the size of the second rectangle is determined in advance. If it is greater than a threshold value, the process of viewing the content area displayed on the touch screen as an event for scrolling or zooming may include at least one of the content areas displayed on the touch screen of the electronic device. A second touch may be sensed and may be additionally made before step 1201 of determining the size of the second rectangle formed by the touch.

Here, the area of the content displayed on the touch screen of the electronic device may point to an object displayed on the touch screen of the electronic device. The object may be a graphical object.

The enlargement or reduction of the content area is to adjust parameters of an object displayed on the touch screen of the electronic device.

The scrolling of the content area may indicate scrolling of an object displayed on the touch screen of the electronic device (may).

Adjusting the parameter of an object displayed on the touch screen of the electronic device increases (magnifying, zooming-in) or reducing (de-magnifying, zooming) the size of the content displayed on the touch screen of the electronic device. -out), and scrolling an object displayed on the touch screen of the electronic device may indicate scrolling up or down content displayed on the touch screen of the electronic device. (may).

Also, conditions for expanding the content area displayed on the touch screen may be differently set (may). That is, it may be given that the size of the rectangle exceeds the reference value as a condition for expanding the displayed content area. For example, when the reference value of the square size is set to 4 cm ² , the displayed content area can be enlarged from the time when the size of the second square exceeds this reference value (described in FIG. 1 (a)). The first rectangle is assumed to be equal to or less than the reference value). The ratio of the content area expansion may be linked to the ratio exceeding the reference value. If the size of the first rectangle is greater than or equal to a reference value, the displayed content area may be enlarged from a time when the size of the second rectangle becomes larger than the size of the first rectangle. The ratio of magnification can be linked to the ratio exceeding the reference value. As a condition for reducing the displayed content area, the size of the rectangle may be less than the reference value as a condition for the reduction of the displayed content area (the size of the first rectangle described in FIG. 1 (a) is the same as the reference value) Assuming greater or greater).

In addition, two conditions for expanding the displayed content area described above can be used together. That is, the size of the rectangle exceeds the reference value, and the size of the third rectangle becomes larger than a predetermined second threshold value (also expressed as an offset) than the size of the second rectangle. You can do it as a condition. The size of the rectangle becomes less than a reference value and the size of the third rectangle becomes smaller than a predetermined second threshold value (sometimes expressed as an offset) than the size of the second rectangle as a condition of reducing the content area displayed on the touch screen. It can be decided.

12B is a block diagram of an electronic device for adjusting a touch area according to the present invention.

First, the second rectangle size determining means 1204 of the electronic device detects at least one second touches on the displayed content area, and determines the size of the second rectangle formed by the sensed touch. Next, the third rectangle size determining unit 1205 determines the size of the second rectangle formed by the detected third touches. The size of the second rectangle and the third rectangle are compared to determine a function of the touch on the content area. The display control means 1206 performs such a method to control to display the content area according to the determined function.

Here, the means may be included in the processor unit 1120 of FIG. 11. Alternatively, it may be included in the processor 1122 of FIG. 11.

Here, the second rectangle and the third rectangle are composed of four vertices determined according to the minimum and maximum values based on the x and y values of the coordinates of the second and third touch points. By comparing the size of the third rectangle with the size of the second rectangle, if the size of the third rectangle is greater than a predetermined threshold than the size of the second rectangle, the second and third touches are touched according to the rate of change of the size The content area displayed on the screen is enlarged. An example in which the size of the third rectangle is larger than a predetermined threshold than the size of the second rectangle is shown in FIG. 13 (c). In addition, if the size of the third rectangle is smaller than a predetermined threshold than the size of the second rectangle, the content area displayed on the touch screen is reduced according to the rate of change of the sizes of the second and third touches. An example in which the size of the third rectangle is smaller than a predetermined threshold than the size of the second rectangle is shown in FIG. 13 (d).

Here, the ratio of enlargement or reduction of the content area may be proportional to the difference between the size of the third rectangle and the size of the second rectangle. Here, the proportionality may be a one-dimensional proportionality or a multidimensional proportionality relationship. That is, the enlarged value or reduced value of the content area may be a one-dimensional equation or a multidimensional equation relationship in which the difference between the size of the third rectangle and the size of the second rectangle is a variable.

In addition, here, instead of the size of the second and third rectangles, a reference value may be used as a value obtained by adding each product of the difference between the X-axis and the Y-axis of the coordinate points of each rectangle. That is, (Xmax-Xmin) ² + (Ymax-Ymin) ² can be used as a comparison criterion instead of a rectangle size (Xmax is the maximum value of the X axis among the coordinates of each point of the rectangle, and Xmin is the coordinates of each point of the rectangle) Of the X-axis minimum value, Ymax is the maximum Y-axis of the coordinates of each rectangle point, Ymin is the minimum Y-axis of the coordinates of each square point).

Here, the second touch may be a plurality of touches, and among the plurality of touches, a first touch that is first touched among areas of content displayed on the screen of the electronic device may be included. This relationship is as described in the description of FIG. 1 (a).

That is, the size (area) of the first rectangle formed by the first touch included in the second touch is compared with the area of the second rectangle of the second touch, and the size of the second rectangle is determined in advance. If it is greater than a threshold value, the process of viewing the content area displayed on the touch screen as an event for scrolling or zooming may include at least one of the content areas displayed on the touch screen of the electronic device. Means for sensing the second touches and determining the size of the second rectangle formed by the sensed touch (not shown) may be additionally provided (may).

Here, the area of the content displayed on the touch screen of the electronic device may point to an object displayed on the touch screen of the electronic device. The object may be a graphical object.

The enlargement or reduction of the content area is to adjust parameters of an object displayed on the touch screen of the electronic device.

The scrolling of the content area may indicate scrolling of an object displayed on the touch screen of the electronic device (may).

Adjusting the parameter of an object displayed on the touch screen of the electronic device increases (magnifying, zooming-in) or reducing (de-magnifying, zooming) the size of the content displayed on the touch screen of the electronic device. -out), and scrolling an object displayed on the touch screen of the electronic device may indicate scrolling up or down content displayed on the touch screen of the electronic device. (may).

Also, conditions for expanding the content area displayed on the touch screen may be differently set (may). That is, it may be given that the size of the rectangle exceeds the reference value as a condition for expanding the displayed content area. For example, when the reference value of the square size is set to 4 cm ² , the displayed content area can be enlarged from the time when the size of the second square exceeds this reference value (described in FIG. 1 (a)). The first rectangle is assumed to be equal to or less than the reference value). The ratio of the content area expansion may be linked to the ratio exceeding the reference value. If the size of the first rectangle is greater than or equal to a reference value, the displayed content area may be enlarged from a time when the size of the second rectangle becomes larger than the size of the first rectangle. The ratio of magnification can be linked to the ratio exceeding the reference value. As a condition for reducing the displayed content area, the size of the rectangle may be less than the reference value as a condition for the reduction of the displayed content area (the size of the first rectangle described in FIG. 1 (a) is the same as the reference value) Assuming greater or greater).

In addition, two conditions for expanding the displayed content area described above can be used together. That is, the size of the rectangle exceeds the reference value, and the size of the third rectangle becomes larger than a predetermined second threshold value (also expressed as an offset) than the size of the second rectangle. You can do it as a condition. The size of the rectangle becomes less than a reference value and the size of the third rectangle becomes smaller than a predetermined second threshold value (sometimes expressed as an offset) than the size of the second rectangle as a condition of reducing the content area displayed on the touch screen. It can be decided.

13 (a) is a diagram schematically showing an example in which the displayed content is scrolled down according to the present invention. The electronic device can sense each of 16 distinct touches, for example. The electronic device detects at least one touch input among areas of content displayed on the touch screen. Comparing the X and Y coordinate values of each detected touch input, determining the maximum and minimum values of the X value, and determining the minimum and maximum values of the Y coordinate value to form a second rectangle (box) area 1301 consisting of these coordinate values To set. Since there is only one X and Y coordinate value when there is only one touch input, in this case, it can be determined as a rectangle having the smallest unit around the X and Y coordinate values.

Next, the size of the third rectangle (box) 1302 formed by the maximum and minimum values of the X and Y coordinates of the touch point generated when at least one touch is moved (drag) is determined. The variable in the present invention is the size of the third rectangle (box) 1302 formed by the maximum and minimum values of the X and Y coordinates of the touch point. The determined size of the third rectangle is compared with the size of the second rectangle. When the difference between the size of the third rectangle and the size of the second rectangle is less than or equal to a threshold, it is determined that the movement of the upper touch scrolls the upper content area. In this case, the content area is scrolled and displayed. Scrolling here corresponds to scroll down.

Here, the threshold value is a predetermined value according to the function setting of the electronic device, and may be changed according to the user's setting.

Here, the touch forming the second square may be a plurality of touches, and among the plurality of touches, a first touch that is first touched among areas of content displayed on the screen of the electronic device may be included. This relationship may be viewed as an event for scrolling or enlarging / reducing the content area displayed on the touch screen as described in the description of FIG. 1 (a).

Here, the area of the content displayed on the touch screen of the electronic device may point to an object displayed on the touch screen of the electronic device. The object may be a graphical object (may).

13 (b) is a diagram schematically showing an embodiment in which displayed content scrolls up according to the present invention. The electronic device detects at least one touch input among the areas of the content displayed on the touch screen, compares the X and Y coordinate values of each detected touch input, determines the maximum and minimum values of the X value, and determines the The minimum and maximum values are determined to set a second square (box) area 1303 composed of these coordinate values. Since there is only one X and Y coordinate value when there is only one touch input, in this case, it can be determined as a rectangle having the smallest unit around the X and Y coordinate values.

Next, the size of the third rectangle (box) 1304 formed by the maximum and minimum values of the X and Y coordinates of the touch point generated when at least one touch is moved (drag) is determined. The determined size of the third rectangle is compared with the size of the first rectangle. When the difference between the size of the third rectangle and the size of the second rectangle is less than or equal to a threshold, it is determined that the movement of the upper touch scrolls the upper content area. In this case, the content area is scrolled and displayed. Scrolling here corresponds to scrolling up.

Here, the threshold value is a predetermined value according to the function setting of the electronic device, and may be changed according to the user's setting.

Here, the touch forming the second rectangle may be a plurality of touches, and among the plurality of touches, a first touch that is first touched among areas of content displayed on the screen of the electronic device may be included. This relationship may be viewed as an event for scrolling or enlarging / reducing the content area displayed on the touch screen as described in the description of FIG. 1 (a).

Here, the area of the content displayed on the touch screen of the electronic device may point to an object displayed on the touch screen of the electronic device. The object may be a graphical object (may).

13 (c) is a diagram schematically showing an embodiment in which the displayed content according to the present invention is enlarged. The electronic device detects at least one touch input among the areas of the content displayed on the touch screen, compares the X and Y coordinate values of each detected touch input, determines the maximum and minimum values of the X value, and determines the The second rectangle (box) region 1305 made up of these coordinate values is set by determining the minimum and maximum values. Next, the size of the third rectangle (box) 1306 formed by the maximum and minimum values of the X and Y coordinates of the touch points generated when the at least one touch is moved (drag) is determined. When the size of the third rectangle is larger than the size of the second rectangle, which is greater than a threshold, it is determined that the movement of the touch is to enlarge (magnifying, zooming in) the content area. In this case, the content area is enlarged and displayed.

Here, the ratio of enlargement of the content area may be proportional to the difference between the size of the third rectangle and the size of the second rectangle. Here, the proportionality may be a one-dimensional proportionality or a multidimensional proportionality relationship. That is, the enlarged value of the content area may be a one-dimensional equation or a multidimensional equation relationship in which the difference between the size of the third rectangle and the size of the second rectangle is a variable.

In addition, here, instead of the size of the second and third rectangles, a reference value may be used as a value obtained by adding each product of the difference between the X-axis and the Y-axis of the coordinate points of each rectangle. That is, (Xmax-Xmin) ² + (Ymax-Ymin) ² can be used as a comparison criterion instead of a rectangle size (Xmax is the maximum value of the X axis among the coordinates of each point of the rectangle, and Xmin is the coordinates of each point of the rectangle) Of the X-axis minimum value, Ymax is the maximum Y-axis of the coordinates of each rectangle point, Ymin is the minimum Y-axis of the coordinates of each square point).

Here, the threshold value is a predetermined value according to the function setting of the electronic device, and may be changed according to the user's setting.

Here, the second touch forming the second quadrangle may be a plurality of touches, and among the plurality of touches, a first touch that is the first touch of an area of content displayed on the screen of the electronic device may be included. This relationship may be viewed as an event for scrolling or enlarging / reducing the content area displayed on the touch screen as described in the description of FIG. 1 (a).

The enlargement of the content area displayed on the touch screen of the electronic device may be a large adjustment of a parameter of an object displayed on the touch screen of the electronic device (may).

13 (d) is a diagram schematically showing an embodiment in which the displayed content according to the present invention is reduced. The electronic device detects at least one touch input among the areas of the content displayed on the touch screen, compares the X and Y coordinate values of each detected touch input, determines the maximum and minimum values of the X value, and determines the The minimum and maximum values are determined to set a second square (box) area 1307 composed of these coordinate values. Next, the size of the third rectangle (box) 1308 formed by the maximum and minimum values of the X and Y coordinates of the touch point generated when the at least one touch is moved (drag) is determined. When the size of the third rectangle is smaller than the size of the second rectangle, which is smaller than a threshold, it is determined that the movement of the upper touch is zooming in the upper content area. In this case, the content area is reduced and displayed.

Here, the reduction ratio of the content area may be proportional to the difference between the size of the third rectangle and the size of the second rectangle. Here, the proportionality may be a one-dimensional proportionality or a multidimensional proportionality relationship. That is, the reduction value of the content area may be a one-dimensional equation or a multi-dimensional equation relationship in which the difference between the size of the third rectangle and the size of the second rectangle is a variable.

In addition, here, instead of the size of the second and third rectangles, a reference value may be used as a value obtained by adding each product of the difference between the X-axis and the Y-axis of the coordinate points of each rectangle. That is, (Xmax-Xmin) ² + (Ymax-Ymin) ² can be used as a comparison criterion instead of a rectangle size (Xmax is the maximum value of the X axis among the coordinates of each point of the rectangle, and Xmin is the coordinates of each point of the rectangle) Of the X-axis minimum value, Ymax is the maximum Y-axis of the coordinates of each rectangle point, Ymin is the minimum Y-axis of the coordinates of each square point).

Here, the threshold value is a predetermined value according to the function setting of the electronic device, and may be changed according to the user's setting.

Here, the second touch forming the second quadrangle may be a plurality of touches, and among the plurality of touches, a first touch that is the first touch of an area of content displayed on the screen of the electronic device may be included. This relationship may be viewed as an event for scrolling or enlarging / reducing the content area displayed on the touch screen as described in the description of FIG. 1 (a).

The enlargement of the content area displayed on the touch screen of the electronic device may be a small adjustment of a parameter of an object displayed on the touch screen of the electronic device (may).

In addition, in FIG. 13C, conditions for expanding the content area displayed on the touch screen may be differently set (may). That is, it may be given that the size of the rectangle exceeds the reference value as a condition for expanding the displayed content area. For example, when the reference value of the square size is set to 4 cm ² , the displayed content area can be enlarged from the time when the size of the second square exceeds this reference value (described in FIG. 1 (a)). The first rectangle is assumed to be equal to or less than the reference value). The ratio of the content area expansion may be linked to the ratio exceeding the reference value. If the size of the first rectangle is greater than or equal to a reference value, the displayed content area may be enlarged from a time when the size of the second rectangle becomes larger than the size of the first rectangle. The ratio of magnification can be linked to the ratio exceeding the reference value.

In addition, in FIG. 13 (d), as a condition for reducing the displayed content area, a size of a rectangle that is less than a reference value may be given as a condition for reducing the displayed content area (described in FIG. 1 (a)). The size of the first rectangle is assumed to be equal to or greater than the reference value).

In addition, two conditions for expanding the displayed content area described above can be used together. That is, the size of the rectangle exceeds the reference value, and the size of the third rectangle becomes larger than a predetermined second threshold value (also expressed as an offset) than the size of the second rectangle. You can do it as a condition. The size of the rectangle becomes less than a reference value and the size of the third rectangle becomes smaller than a predetermined second threshold value (sometimes expressed as an offset) than the size of the second rectangle as a condition of reducing the content area displayed on the touch screen. It can be decided.

14 is a diagram schematically showing an embodiment in which the displayed content is enlarged when two touches according to the present invention move. The electronic device detects two touch inputs 1401 and 1402 of the content area displayed on the touch screen, compares the X and Y coordinate values of each detected touch input, and determines the maximum and minimum values of the X value. (Here, the case where a constant offset is assigned to the maximum and minimum values of the X value) The minimum and maximum values of the Y coordinate value are determined (here, the cases where a constant offset is given to the maximum and minimum values of the Y value) are displayed. A second square (box) area 1403 made of coordinate values is set. Next, the size of the third rectangle (box) 11407 formed by the maximum and minimum values of X and Y coordinates of the touch points generated by moving (dragging) the above two touches (by applying a constant offset) Decide. As shown in FIG. 14, the size of the third rectangle is larger than the size of the second rectangle. In other words, the difference between the maximum and minimum values of X and Y coordinates of the moved touch (by applying a constant offset) is greater than that before the movement. When the difference in size of the rectangle exceeds a predetermined threshold, the movement of the upper touch determines to magnify (magnifying, zooming in) the content area, and in this case, the content area is displayed on the touch screen. It is enlarged and displayed.

Here, the ratio of enlargement or reduction of the content area may be proportional to the difference between the size of the third rectangle and the size of the second rectangle. Here, the proportionality may be a one-dimensional proportionality or a multidimensional proportionality relationship. That is, the enlarged value or reduced value of the content area may be a one-dimensional equation or a multidimensional equation relationship in which the difference between the size of the third rectangle and the size of the second rectangle is a variable.

In addition, here, instead of the size of the second and third rectangles, a reference value may be used as a value obtained by adding each product of the difference between the X-axis and the Y-axis of the coordinate points of each rectangle. That is, (Xmax-Xmin) ² + (Ymax-Ymin) ² can be used as a comparison criterion instead of a rectangle size (Xmax is the maximum value of the X axis among the coordinates of each point of the rectangle, and Xmin is the coordinates of each point of the rectangle) Of the X-axis minimum value, Ymax is the maximum Y-axis of the coordinates of each rectangle point, Ymin is the minimum Y-axis of the coordinates of each square point).

Here, the threshold value is a predetermined value according to the function setting of the electronic device, and may be changed according to the user's setting.

Here, the second touch forming the second quadrangle may be a plurality of touches, and among the plurality of touches, a first touch that is the first touch of an area of content displayed on the screen of the electronic device may be included. This relationship may be viewed as an event for scrolling or enlarging / reducing the content area displayed on the touch screen as described in the description of FIG. 1 (a).

The enlargement of the content area displayed on the touch screen of the electronic device may be a large adjustment of a parameter of an object displayed on the touch screen of the electronic device (may).

15 is a diagram schematically showing an embodiment in which displayed content scrolls down according to a plurality of touch movements according to the present invention. The electronic device detects two touch inputs 1501 and 1502 among the content areas displayed on the touch screen. Comparing the X and Y coordinate values of each detected touch input, determining the maximum and minimum values of the X value, and determining the minimum and maximum values of the Y coordinate value to form a second rectangle (box) area 1503 consisting of these coordinate values To set. Next, as the above two touches move (drag), the touch increases further to increase the size of the third rectangle (box) 1504 formed by the maximum and minimum values of the X and Y coordinates of the three touch points. Decide. When the difference between the size of the third rectangle and the size of the second rectangle is less than or equal to a threshold, it is determined that the movement of the upper touch scrolls the upper content area. In this case, the content area is scrolled and displayed. Scrolling here corresponds to scroll down.

Here, the threshold value is a predetermined value according to the function setting of the electronic device, and may be changed according to the user's setting.

Here, the touch forming the second square may be a plurality of touches, and among the plurality of touches, a first touch that is first touched among areas of content displayed on the screen of the electronic device may be included. This relationship may be viewed as an event for scrolling or enlarging / reducing the content area displayed on the touch screen as described in the description of FIG. 1 (a).

Here, the area of the content displayed on the touch screen of the electronic device may point to an object displayed on the touch screen of the electronic device. The object may be a graphical object (may).

Obviously, there are many different ways to modify these embodiments while remaining within the scope of the claims. In other words, there may be many other ways in which the invention may be practiced without departing from the scope of the claims below.

101: rectangular area 102: rectangular area
103: square area
106: blind area generated as the touch area is moved
1100: electronic device 1110: memory
1111: operating system module 1112: communication module
1113: Graphics module 1114: User interface module
1115: CODEC module 1116: Camera module
1117: application 1120: processor unit
1121: memory interface 1122: processor
1123: Peripheral interface 1130: First wireless communication subsystem
1131: Second wireless communication subsystem 1150: Audio subsystem
1151: speaker 1152: microphone
1160: external port 1170: input and output system
1171: Touch screen controller 1172: Other input controller
1180: Touch screen 1190: Other input / control devices
1191: motion sensor 1192: first light sensor
1193: camera subsystem

Claims (17)

In the operation method of the electronic device,
Sensing at least one first touch on the displayed content area;
Determining a size of a first region formed by the at least one first touch;
Determining a size of a second area formed by at least one second touch moved from the at least one first touch;
And comparing the sizes of the first area and the second area, and scrolling or enlarging or reducing the content area based on the comparison result,
The operation of determining the size of the first region,
Detecting a first touch point and a second touch point of the first area;
Determining whether the x-coordinate of the first touch point is the same as the x-coordinate of the second touch point or the y-coordinate of the first touch point and the y-coordinate of the second touch point;
If the x-coordinate of the first touch point is the same as the x-coordinate of the second touch point or the y-coordinate of the first touch point is the same as the y-coordinate of the second touch point, the x-coordinate of the first touch point Adding an offset to and subtracting the offset from the x coordinate of the second touch point, or adding the offset to the y coordinate of the first touch point and subtracting the offset from the y coordinate of the second touch point; And
And determining a size of the first area by connecting the first point to which the offset is added to the first touch point and the second point to which the offset is subtracted from the second touch point.
delete According to claim 1,
And when the size of the second region is greater than a threshold of the size of the first region, performing an enlargement function for the content region.
According to claim 1,
And when the size of the second area is smaller than a size of the first area by a threshold or more, performing a reduction function for the content area.
According to claim 1,
And when the size of the second area has a size within the threshold and a size of the first area, scrolling the content area.
delete In the electronic device,
touch screen;
At least one processor operatively connected to the touch screen; And
A memory operatively connected to the processor,
When the memory is executed, the processor,
Detecting at least one first touch on a content area displayed on the touch screen,
Determining a size of a first region formed by the at least one first touch,
Determining a size of a second area formed by at least one second touch moved from the at least one first touch,
Compare the sizes of the first area and the second area, and store instructions for scrolling or enlarging or reducing the content area on the touch screen based on the comparison result,
The instructions, the processor detects the first touch point and the second touch point of the first area as at least part of the operation of determining the size of the first area, the x coordinate of the first touch point and the It is determined whether the x coordinate of the second touch point is the same, or whether the y coordinate of the first touch point and the y coordinate of the second touch point are the same, and the x coordinate of the first touch point and the second touch point are determined. If the x-coordinate of is the same or the y-coordinate of the first touch point is the same as the y-coordinate of the second touch point, an offset is added to the x-coordinate of the first touch point and the x-coordinate of the second touch point is The first point and the subtracting the offset, or adding the offset to the y coordinate of the first touch point, subtracting the offset from the y coordinate of the second touch point, and adding the offset to the first touch point and the 2 by connecting the second point obtained by subtracting the offset in the touch point, electronic device, to determine a size of the first area.
delete The method of claim 7,
The instructions may cause the processor to perform an enlargement function for the content area when the size of the second area is greater than or equal to a threshold value of the size of the first area.
The method of claim 7,
The instructions may cause the processor to perform a reduction function for the content area when the size of the second area is smaller than a size of the first area by a threshold value or more.
The method of claim 7,
The instructions, the electronic device to cause the processor to perform a scroll function for the content area when the size of the second area has a value within a range of a size and a threshold of the first area.
delete In the electronic device,
touch screen;
Memory; And
And a processor operatively connected to the touch screen and the memory, the processor comprising:
Detecting at least one first touch on a content area displayed on the touch screen,
Determining a size of a first region formed by the at least one first touch,
Determining a size of a second area formed by at least one second touch moved from the at least one first touch,
It is set to compare the sizes of the first area and the second area, and scroll or enlarge or reduce the content area through the touch screen based on the comparison result,
The processor detects the first touch point and the second touch point of the first area as at least a part of the operation of determining the size of the first area, the x coordinate of the first touch point and the second touch point It is determined whether x coordinates of the same or the y coordinate of the first touch point and the y coordinate of the second touch point are the same, and the x coordinate of the first touch point and the x coordinate of the second touch point are If it is the same or the y coordinate of the first touch point is the same as the y coordinate of the second touch point, an offset is added to the x coordinate of the first touch point and the offset is subtracted from the x coordinate of the second touch point or , Or adding the offset to the y coordinate of the first touch point, subtracting the offset from the y coordinate of the second touch point, and off from the first point and the second touch point that added the offset to the first touch point By connecting the first point minus the electronic device is configured to determine the size of the first area.
delete The method of claim 13,
The processor is configured to perform an enlargement function for the content area when the size of the second area is greater than a threshold of the size of the first area.
The method of claim 13,
The processor, when the size of the second area is smaller than a threshold of the size of the first area, an electronic device to perform a reduction function for the content area.
The method of claim 13,
The processor is configured to perform a scrolling function for the content area when the size of the second area has a value within a range of a size and a threshold of the first area.

Images