KR102308968B1 - Method and storage medium, mobile terminal for controlling screen - Google Patents

Abstract

Disclosed is a screen control method of a mobile terminal according to the present invention. The present invention provides a method for controlling a screen of a mobile terminal including a motion sensor and a touch screen, the method comprising: detecting a current posture in which the mobile terminal is placed using the motion sensor; Comprising the step of determining whether the mobile terminal is in use by comparing the current posture and the posture used when using the mobile terminal, if the current posture of the mobile terminal is located in the use posture, the touch The screen is characterized in that it is configured to remain in use.

Description

How to control the screen, storage medium and mobile terminal {METHOD AND STORAGE MEDIUM, MOBILE TERMINAL FOR CONTROLLING SCREEN}

The present invention relates to screen control of a mobile terminal, and more specifically, a screen control method using various physical movements of the mobile terminal as well as a screen control method using the mobile terminal's usage posture to determine whether the mobile terminal is being used it's about

A portable mobile terminal 10 such as a smart phone provides a screen including a touch screen 11 as an input device capable of a user's touch input due to a limited size.

However, since the capacity of the battery built into the mobile terminal is small, when the mobile terminal is not in use, the screen turns off and the mobile terminal moves to standby mode. In most cases, if an input such as a touch input is not received for a predetermined period of time, the mobile terminal automatically switches to the standby mode. However, the standby mode of the mobile terminal has a disadvantage in that it occurs too frequently even while the user is using it.

In addition, in the case of the mobile terminal, when the touch screen is too small and there are many contents to be transmitted, a situation arises in which all contents corresponding to one screen cannot be displayed. In order to solve this problem, the user performs a screen scroll or other desired operation by inputting a touch such as a flick to the touch screen.

In this case, there are many cases where the user provides a touch input to the mobile terminal using both hands or, when holding an object in the other hand, holds the mobile terminal with one hand and provides the touch input to the touch screen, which is a screen. However, when the user provides a desired touch input to the mobile terminal while holding the mobile terminal with one hand, the mobile terminal is dropped, the touch screen is frequently contaminated by the hand, or the desired touch operation is not performed properly. did.

Therefore, when the user uses the mobile terminal, various screen control operations such as turning on the screen, scrolling the screen, or taking a picture are performed through various physical operations of the mobile terminal rather than a touch input to control various screens corresponding thereto. have.

Patent Document 0001) Korean Patent Application Laid-Open No. 10-2014-0105352, published on September 01, 2014 (Title: Context-aware-based screen scrolling method, storage medium and terminal) Korean Patent Registration No. 110-0599190, published on July 04, 2006 (Title: System and method for providing a picture moving according to the change in inclination of a mobile communication terminal)

The present invention was devised to solve the above problems, and provides a method for determining whether the mobile terminal is in use by using the use posture, which is the posture in which the mobile terminal is placed.

The present invention provides a method capable of providing a screen control operation including a screen scroll mode by using various physical movements of a mobile terminal.

The present invention provides a method for controlling a selection mode using various physical movements of a mobile terminal.

In addition, the present invention provides a method of providing a photo taking operation using various physical movements of a mobile terminal.

In order to achieve the above object, the present invention provides a method for controlling a screen of a mobile terminal including a motion detection sensor and a touch screen, the method comprising: detecting a current posture in which the mobile terminal is placed using the motion detection sensor; ; Comprising the step of determining whether the mobile terminal is in use by comparing the current posture and the posture used when using the mobile terminal, if the current posture of the mobile terminal is located in the use posture, the touch The screen is characterized in that it is configured to remain in use.

The present invention provides a method for controlling a screen of a mobile terminal including a motion detection sensor and a touch screen, wherein an application including more information than displayed on one screen is executed on the mobile terminal and the information is displayed on the touch screen being displayed on the ; determining an event that occurs during or when the mobile terminal moves in the opposite direction to the physical movement after the physical movement by using the motion sensor and returns to the position before movement; and executing a screen scrolling mode corresponding to the event in the application, wherein the screen scrolling mode is characterized in that the screen is scrolled within a preset range or another item at a time.

The present invention provides a method for controlling a screen of a mobile terminal including a proximity sensor, a motion sensor, and a touch screen, wherein the proximity event is released within a preset time after the proximity event by the proximity sensor occurs ) determining the event to be; and executing a screen control task corresponding to the release event.

The present invention provides a method for controlling a screen of a mobile terminal including a proximity sensor, a motion sensor, and a touch screen. detecting at least one of the generated proximity events; including a selection mode including a plurality of items and including a selection item in which one item is selected, and performing an operation on the selection mode in response to the event, wherein the operation includes: It is characterized in that at least one of moving a selection item to another item, displaying the sub-content by selecting the selection item, or executing the selection item is included.

The present invention provides a method for controlling a screen of a mobile terminal including a motion sensor and a touch screen, the method comprising the steps of: executing an application for taking a picture in the mobile terminal; detecting an event caused by the physical movement of the mobile terminal using the motion sensor; and executing a photo taking task in the application in response to the event.

As described above, the present invention has been devised to solve the above problems, and provides a method for determining whether the mobile terminal is in use by using the use posture, which is the posture in which the mobile terminal is placed. It works.

The present invention has the effect of providing a method capable of providing a screen control operation including a screen scroll mode by using various physical movements of a mobile terminal.

The present invention has an effect of providing a method for controlling a selection mode using various physical movements of a mobile terminal.

In addition, the present invention has an effect of providing a method of providing a photo taking operation using various physical movements of a mobile terminal.

1 is a diagram showing a schematic block diagram of a mobile terminal;
2 is a view showing a front view of a mobile terminal;
3 is a flowchart showing a screen control method using a posture of use according to the present invention;
4 is a view showing a posture in which the mobile terminal is placed when viewed from the side when the user stands and uses the mobile terminal;
5 is a view showing the range of use of the posture according to the present invention;
6 is a diagram of an event caused by physical movement of a mobile terminal according to the present invention;
7 is a view showing a screen scroll mode according to a first example of the present invention;
8 is a view showing a screen scroll mode according to a second example of the present invention;
9 and 10 are diagrams showing the physical movement of a mobile terminal according to the present invention;
11 is a view showing a state in which a proximity event according to the present invention is generated.
12 is a view showing a process in which a proximity event occurs after physical movement according to the present invention;
13 to 15 are diagrams showing the operation of the selection mode and the non-selection mode according to the present invention;

Hereinafter, with reference to the accompanying drawings, a preferred embodiment that can be easily carried out the present invention will be described in detail. However, when it is determined that a detailed description of a related well-known function or configuration may unnecessarily obscure the gist of the present invention in describing the operating principle of the preferred embodiment of the present invention in detail, the detailed description thereof will be omitted. This is to more clearly convey the essence of the present invention by omitting unnecessary description.

The terms used herein are only used to describe specific embodiments, and are not intended to limit the present invention, and the singular expression may include a plural expression unless the context clearly indicates otherwise.

A mobile terminal can transmit information to another terminal, including a smart phone, Personal Digital Assistants (PDAs), or a smart watch, or computing functions and data communication capabilities, and power supply internally. As an arbitrary terminal solved in , it can be implemented as a communication terminal that a user can carry and use. Accordingly, the mobile terminal may be any portable device having a touch screen and a wireless communication function.

1 is a diagram showing a schematic block diagram of a mobile terminal.

As shown in the figure, the mobile terminal 10 schematically includes a control unit 20, a sensor module 30, at least one touch screen 50, a communication module 60 for communicating with the outside, and a storage unit 70. , including an input/output module 80 and a power supply unit 90 including a physical button. In addition, the touch screen 50 may include at least one touch screen controller (not shown). The control unit 20 may control the sensor module 30 , the touch screen 50 , the communication module 60 , the storage unit 70 , the input/output module 80 , the power supply unit 90 , the touch screen controller, and the like. .

The controller may sense at least one user input through a direct touch input in which the user directly touches the touch screen with a finger or the like or an input unit such as a stylus pen. The touch screen 50 of the mobile terminal may be implemented by, for example, a resistive method, a capacitive method, an infrared method, an acoustic wave method, or a combination thereof. .

The sensor module 30 of the mobile terminal 10 includes a proximity sensor 31 for detecting whether an arbitrary object approaches the mobile terminal, a gyroscope 32 for detecting a rotational motion of the mobile terminal, and an acceleration motion of the mobile terminal. The acceleration sensor 33 for detecting may include.

The mobile terminal may receive and store a corresponding program or application from a program providing device connected by wire or wirelessly.

2 is a view showing a front view of a mobile terminal.

Referring to FIG. 2 , the touch screen 50 is disposed in the center of the front surface of the mobile terminal 10 , and may be formed to occupy most of the front surface of the mobile terminal 10 . Below the touch screen 50 , touch keys such as the home button 82 or the back button 81 , or mechanical buttons or a combination thereof may be formed. In addition, these touch keys may be configured as a part of the touch screen 50 . A proximity sensor 31 , a first camera, an illuminance sensor, and a gesture sensor may be disposed on the upper front side of the mobile terminal 10 . A second camera, a flash, etc. may be disposed on the rear side of the mobile terminal 10 .

The back button 81 of the drawing may be used to return from the currently executed screen to a previously executed screen or to terminate an application currently being used. If the user selects the home button 82 , any other screen disappears on the touch screen 50 and a home screen is displayed. If the home button 82 is selected when there are multiple home screens, the main home screen may be displayed on the screen, that is, the touch screen. For example, when the home button 82 is selected while an application is being executed on the touch screen 50 , the home screen is displayed (displayed) on the touch screen 50 . The touch screen 50 may provide a user with a user graphic interface corresponding to various services.

In the case of FIG. 2 , an example in which a main home screen is displayed among one or more home screens on the touch screen 50 is shown. The main home screen is the first screen displayed on the touch screen 50 when the power of the mobile terminal 10 is turned on or a screen displayed when a home button is selected. If there is only one home screen, the home screen becomes the main home screen. The home screen may include shortcut icons 55 or widgets (not shown) for executing an application. An icon or an execution state is displayed on the screen of the mobile terminal, and a user's operation corresponding to the displayed screen is received through the touch screen or by a motion detection sensor of the mobile terminal, and the operation corresponding to the operation or operation is performed. can be done

The proximity sensor 31 may be disposed in a specific area surrounding the touch screen or near the touch screen, and in the case of FIG. 2 , it is an example disposed on the upper right side of the mobile terminal. The proximity sensor 31 refers to a sensor that detects the proximity of an approaching object or an arbitrary object existing in the vicinity using infrared rays or the like without mechanical contact. The proximity sensor 31 may be, for example, a high frequency oscillation type, a capacitive type, a magnetic type, an infrared type, or the like.

The motion sensor refers to any sensor capable of detecting the posture, angle, or direction of the mobile terminal, and specifically, the acceleration sensor 33, the gyroscope 32, the geomagnetic sensor 35, and the gravity sensor 36 ) or a combination thereof. Accordingly, the controller of the mobile terminal can sense the posture of the mobile terminal with respect to the reference plane (ground), that is, the direction, angle, or both of the mobile terminal in real time by using the motion sensor.

In general, the gyro sensor receives roll, pitch, and yaw values in a short time, but the reliability is low. It is also used to increase the reliability of the value.

For example, the gravity sensor detects the direction in which gravity acts by processing the information of the acceleration sensor in software. The gravity sensor is used to determine whether to display the phone screen horizontally or vertically by determining the direction in which gravity acts. In addition, the mobile terminal may further provide an orientation sensor, which is a software sensor composed of a combination of an acceleration sensor and a geomagnetic sensor, and measures changing directions and rotation angles with respect to three axes of x, y, and z. In addition, the mobile terminal may further provide a rotation vector sensor or a motion sensor, which is a software sensor consisting of a combination of values of an acceleration sensor, a geomagnetic sensor, and a gyro sensor, and The combination detects the posture or direction in which the mobile terminal is placed.

For example, in the case of an orientation sensor, pitch, roll, and yaw values are provided, and these are the front and rear rotation values (inclination) of the mobile terminal, left and right rotation values and azimuth angles, respectively, of the mobile terminal, respectively. provides At this time, by using the values of the pitch and roll, it is possible to accurately determine the angles of the front, rear and side surfaces of the touch screen of the mobile terminal, which are the postures used by the mobile terminal, with respect to the ground surface. Here, the front and rear angle means an angle formed by the long longitudinal direction of the touch screen with the ground surface as shown in FIG. 9, and the lateral angle means an angle formed by the short longitudinal direction of the touch screen with the ground surface. Similarly, the gravity sensor measures the acceleration of gravity in the x, y, and z directions. Among them, the posture or angle of the mobile terminal with respect to the ground can be known by using the y and z values. Accordingly, the motion sensor may include a gravity sensor, a direction sensor, a rotation vector sensor, a motion sensor, and the like, which can determine the posture lying on the reference plane of the mobile terminal.

Screen control described in this specification includes any control operation or operation related to content displayed on a touch screen of a mobile terminal. And the screen refers to the content displayed on the touch screen.

3 is a flowchart illustrating a screen control method using a posture of use according to the present invention.

The present invention provides a method for controlling a screen of a mobile terminal 10 including a motion detection sensor and a touch screen 50, the step of detecting a current posture in which the mobile terminal is placed using the motion detection sensor (110) )Wow; Comprising a step 120 of determining whether the mobile terminal is in use by comparing the current posture with the posture used when using the mobile terminal, and wherein the current posture of the mobile terminal is located in the use posture It is characterized in that the touch screen is configured to maintain (140) the use state.

The use state of the touch screen means a state in which the corresponding content is output and displayed on the screen, that is, the touch screen, and the user can view the content. The use state refers to maintaining a state in which the touch screen is continuously used so that the user can continue to use the mobile terminal, in this case, the touch screen outputs related contents to the screen, and the touch screen receives the user's input A state in which work can be performed immediately. 7 shows a screen state in which the mobile terminal performs screen scrolling corresponding to the event in the use state.

The present invention is characterized in that it includes a step of changing the screen to a standby mode when a preset elapsed time has elapsed when the mobile terminal is not positioned in the use posture.

The standby mode is a state in which the touch screen is turned off and waiting to receive a user's input, and in the standby mode, any user who opens the power button or the home button or the mobile terminal cover (not shown) or turns on the touch screen The standby mode may be moved to the lock screen or to the screen just before being turned off by various means such as input.

3, in the present invention, the control unit 20 of the mobile terminal 10 detects 110 the current posture in which the mobile terminal is placed through a motion sensor and determines whether the current posture is located in the used posture ( 120). If the mobile terminal is placed in the use posture, the controller controls the related device to maintain 140 the screen of the mobile terminal in the use state. However, if the current posture of the mobile terminal is not the use posture, the controller may control the touch screen of the mobile terminal to be turned off ( 130 ) if the user does not return to the use posture for a preset time in this state. In this case, the elapsed time may be configured so that the user can change it through a user menu or the like.

In addition, the controller determines whether the touch screen of the mobile terminal is turned on in the off state (150), and when the screen is turned on again, the controller moves back to the step of detecting the posture in which the mobile terminal is placed using the motion sensor. Thus, it can be made to determine whether the mobile terminal is in a posture of use. The control unit 20 receives the output value of the motion sensor and determines whether the mobile terminal is in the use posture. When the mobile terminal is turned on again, it may be changed to a lock mode or a screen immediately before the touch screen is turned off is displayed on the touch screen again.

In the present invention, the current posture and the used posture are characterized in that they include a forward and backward tilt angle or a lateral tilt angle at which the mobile terminal is placed with respect to the reference plane, or both.

4 is a view showing a posture in which the mobile terminal is placed when viewed from the side when the user 200 uses the mobile terminal 10 while standing.

In the present invention, the use posture is position information on which the mobile terminal is placed when the user uses the mobile terminal, and specifically, the controller uses the front and rear and lateral inclination angles formed by the wide surface 210 and the reference plane 211 of the mobile terminal. It can be determined whether or not The figure is an example in which the reference plane is a ground plane. That is, the controller may determine whether the current posture of the mobile terminal is located in the use posture by measuring the front-rear angle or the lateral inclination angle of the large surface of the mobile terminal with respect to the reference plane through the motion sensor. The reference plane may be any plane, but preferably the ground plane.

That is, in the present invention, the posture of use is determined by location information on which the mobile terminal is placed when the user uses the mobile terminal. The present invention takes advantage of the fact that, when a user uses a mobile terminal, the front and rear angles and the lateral angles formed by the wide surface of the mobile terminal, that is, the surface of the touch screen or the rear surface and the ground surface, are similar for almost all users. In addition, this posture of use also has the advantage that there is little difference between individuals. Even if there is a difference in the usage posture for each individual, since the usage posture of a specific individual has almost constant characteristics depending on when using it while standing or lying down, such posture information of the user can be used as the usage posture.

For example, when the user walks while looking at the screen of the mobile terminal, if the walking direction changes, the yaw value of the orientation sensor changes greatly depending on the direction of movement, but the pitch and roll values are on the ground. maintain approximately the same angle with respect to For this reason, the control unit receives the pitch and roll values from the motion sensor to determine the current posture of the mobile terminal in real time.

4 shows _{the front and rear angles 1} of the mobile terminal viewed from the side of the user 200 . At this time, the front and rear inclination angle formed between the wide surface 210 and the ground surface 211 of the mobile terminal is ₁ . In addition, the lateral inclination angle of the mobile terminal with respect to the ground surface 211 is not clearly known in the drawings. However, when the user uses the mobile terminal while standing or sitting, it is common to maintain the lateral tilt angle parallel to the ground surface. can judge

Referring to FIG. 9( a ), the forward and backward tilt of the mobile terminal 10 is specifically _{an angle formed by the long length (L 2} ) direction of the mobile terminal 10 with the reference plane, and the lateral tilt is the short length of the mobile terminal 10 . The length L1 may correspond to an angle formed with the reference plane.

The present invention is characterized in that the use posture includes at least one of when the user uses the mobile terminal standing up or not, or when using the mobile terminal while moving or lying down.

The usage posture when the user stands or sits on the mobile terminal, that is, the forward, backward and lateral inclination angles are almost the same, but when the user uses the mobile terminal while lying in an upright position and when viewing the mobile terminal while lying on the side, the use position is the same as when using it standing Quite different. The storage unit of the present invention stores the usage posture when the user uses the mobile terminal while standing, not standing, or lying down.

In the present invention, the usage posture is collected or preset during use of the mobile terminal, or consists of both, and the collection of the usage posture occurs when a touch event of the touch screen occurs or when the screen is turned on or It is characterized in that at least one of when the mobile terminal is used while maintaining the posture within a preset range for a preset time or longer.

The usage posture according to the present invention may be stored in advance in the storage unit of the mobile terminal or the server connected to the communication network, or both. In addition, when a touch event occurs on the touch screen, when the possibility that the user is using the mobile terminal is very high, or when the screen is turned on, or when using the mobile terminal while maintaining the posture in a preset range for a preset time or longer, etc. It is possible to control to collect the posture of use, and use it to determine the posture of use.

In the present invention, the usage posture includes one or more usage ranges, and when the usage posture is within the usage range, the usage posture is determined.

5 is a view showing the range of use of the posture according to the present invention.

As shown in FIG. 5 , upon receiving the current posture, the control unit may determine whether it is located within the use range, and the use range may be preset or collected during use. The use range means that the front and rear tilt angles or the lateral tilt angles or both are configured in a certain range.

The present invention comprises the steps of: determining an event occurring in at least one of during or when the mobile terminal returns to a position before movement after physical movement by using the motion sensor; and executing a screen control task corresponding to the event.

The event is specifically, an event caused by physical movement of the mobile terminal above a preset threshold value or a threshold change rate or an event returning in the opposite direction after physical movement or returning to a pre-movement position after the physical movement within a preset return time It may be at least one of the upcoming events.

6 is a view showing an event occurrence due to a physical movement of a mobile terminal according to the present invention.

The figure shows that the mobile terminal _{physically moves from s 0} to s ₂ for _{a time t 1} and then returns to the original position s _{0 at} time t _{2 .}

When the control unit receives the output value of the motion detection sensor and the rate of change is greater than a preset threshold rate of change, or when the physical movement distance (s ₁ ) of the mobile terminal moves physically above the threshold value (s ₀ ), or returns When returning to the previous position within time t ₀ , it is possible to determine an event and execute a screen control task corresponding thereto.

_{An event for another physical movement occurring within the return time t 0} after executing the screen task corresponding to the event may be ignored. If an event occurs during time _{t 1} , the event due to physical movement returning within _{the return time t 0 after the event is ignored.} The control unit may monitor the change value of the forward and backward tilt angle or the lateral tilt angle or both of the mobile terminal, and monitor or determine whether the value changes more than a threshold change rate or a threshold value to perform a corresponding task. The physical movement includes parallel movement, rotational movement, or a combination thereof as shown in FIGS. 9 and 10 , and the controller may control to perform another screen control operation when the physical movement is different.

In the present invention, the screen control operation includes at least one of a screen scrolling mode, a screen standby mode, turning on a screen, going back, going to a home, or controlling a video.

When the event is received, the control unit 20 may perform a screen control operation corresponding to the screen scrolling mode or screen standby mode, turning on or going back to the screen, going to the home, controlling a video, or capturing a screen. The screen scroll mode may include at least one of a scroll up, a scroll down, a scroll light, and a scroll left.

7 is a diagram illustrating a screen scroll mode according to a first example of the present invention.

7 shows a screen scroll mode on the home screen of the mobile terminal. FIG. 7(b) is a screen view of the second home screen, and when a scroll left event occurs in this state, the controller receives it and moves it to the first home screen shown in FIG. 7(a). If a scroll light event occurs on the second home screen of FIG. 7(b), the controller receives it and moves it to the third home screen as shown in FIG. 7(c).

The screen standby mode is a standby mode waiting for a user input or an incoming call while the screen is turned off. That is, if a screen standby mode event occurs, the controller turns off the screen of the mobile terminal and controls the mobile terminal to enter the standby mode. In addition, turning on the screen of the present invention performs the operation of turning the screen back on in the screen standby mode to switch to the use state, and in this case, the lock screen or the screen immediately before the standby mode is displayed on the touch screen.

In addition, the back button 81 and the go home button 82 of the mobile terminal 10 shown in FIG. That is, if the control unit receives a go back event, it displays the previous screen, and if the control unit receives a go home event, controls to display the main home screen or a designated screen on the touch screen 50 .

The video control may include control operations such as screen stop, screen playback, moving to the next/previous video, and moving to the previous/next position of the video while the video player is running. The moving to the previous/next position may be moving a video being played back before or after a preset time. The screen capture refers to an operation of storing a screen displayed on a touch screen of a mobile terminal as an image.

In the present invention, the threshold value or the threshold change rate is formed in plurality, and the larger the threshold value or the threshold change rate is, the larger the scrolling amount of the screen scroll mode is.

The present invention provides a method for controlling a screen of a mobile terminal including a motion detection sensor and a touch screen, wherein an application including more information than displayed on one screen is executed on the mobile terminal and the information is displayed on the touch screen being displayed on the ; determining an event that occurs during or when the mobile terminal moves in the opposite direction to the physical movement after the physical movement by using the motion sensor and returns to the position before movement; and executing a screen scrolling mode corresponding to the event in the application, wherein the screen scrolling mode is characterized in that the screen is scrolled within a preset range or another item at a time.

8 is a diagram illustrating a screen scroll mode according to a second example of the present invention.

8(a) and 8(b) show the screens of the mobile terminal before and after scrolling down on the screen, respectively. The screen scroll mode is a function to display information that is not visible on the screen by using screen scrolling when all information cannot be displayed on one screen.

According to the present invention, as shown in FIG. 8 , an arbitrary application is executed on the mobile terminal and displayed on the screen, and the content included in the application includes more information than displayed (displayed) on one screen, allowing the user to view the entire information When screen scrolling is required for this purpose, the controller detects an event caused by physical movement and controls the screen to execute a corresponding screen scroll mode. In the case of the drawing, scroll down is executed, and in this case, the screen below is displayed as much as a preset page. In the example of the drawing, a preset page is a state when one screen is exceeded. Unlike the figure, the screen scroll mode may move to a previous or next position when moving a menu or item.

8 is a case in which the news feed 302 part is displayed on the screen by executing the application on the mobile terminal. In the case of the application shown in the above example, in addition to the news feed 302 , four menus 305 are further included, and a friend menu 303 is included on the right side of the news feed 302 . If a scroll light event occurs in the state of FIG. 8( a ), the screen moves to the friend 303 part in the news feed 302 menu. The one screen refers to the content displayed here when content is displayed in an arbitrary window or area displayed on the touch screen of the mobile terminal.

The event is at least one of detecting that the mobile terminal detects a physical movement greater than or equal to a preset threshold value or a threshold change rate using the motion sensor, or detects returning to a pre-movement position within a preset return time after the physical movement One can trigger an event.

In the present invention, the threshold value or the threshold change rate is plural, and when the threshold value or the threshold change rate is different, the preset range of the screen scroll mode is further different.

If an event occurs during the return to the pre-movement position, the event due to physical movement occurring after the event occurs and during the return to the pre-movement position may be ignored. For example, when an event due to the physical movement occurs, the screen scroll mode is executed in response to the first event occurring within the set return time, and if another event occurs within the return time afterward, it is ignored or the same event occurs. In the case of consecutive occurrences, the event that occurred later is ignored. The reason for doing this is that, since the physical movement returns to the original position, there is no need to perform a specific operation in the event caused by the physical movement occurring during the return.

For example, the control unit may determine the pre-movement position by detecting a position at a time point equal to or greater than a threshold value or a threshold change rate or more, or may integrate an output value of a motion sensor to determine the pre-movement position. In this case, when the event occurs, the controller stores the location information and compares the location information with the current location information to determine whether or not to return to the previous location. As another example, in the present invention, the control unit does not determine the location before movement, but performs a screen control operation corresponding to the event caused by the physical movement and ignores the event due to the physical movement during the return time.

The present invention is characterized in that it further includes a selection button 301 for selecting activation and deactivation of an event by physical movement, as shown in FIG. 8 . The selection button may alternately select activation and deactivation by a toggle method.

In the present invention, the physical movement includes parallel movement, rotational movement, shaking, or a combination thereof, and the other physical movement is characterized by an event executing another screen scroll mode.

9 and 10 are diagrams illustrating a method for physically moving a mobile terminal according to the present invention.

9 is a view showing a method of moving by rotation of a mobile terminal according to the present invention.

As shown in Figure 9 (a), the rotation of the mobile terminal is a short length (L ₁ ), a long length (L ₂ ), or a corner (P ₀ ) in front of the mobile terminal as an axis to rotate the mobile terminal. Figure 9 (a) is a short-length and long-length axis of rotation (L ₁ , in the front of the mobile terminal) L ₂ ) is shown. Figure 9 (b) is a state in which the mobile terminal _{rotates about the short length (L 1} ) of the mobile terminal as a rotation axis, and Figure 9 (c) is a state in _{which the mobile terminal rotates with the corner (P 0} ) of the mobile terminal as the rotation axis am. At this time, in the example of the figure, the mobile terminal returns to the starting position again after physically moving _{from the starting position (S 0} ) to the _{position S 1 .} If the mobile terminal rotates in the lateral direction, the long length (L ₂ ) is rotated as an axis.

10 shows a diagram when a mobile terminal moves in parallel.

10 (a) shows an example in which the mobile terminal returns to its original position after parallel movement downward from the user's point of view, and FIG. 10 (b) shows an example in which it returns to its original position after parallel movement to the left.

The controller of the mobile terminal may detect in real time that the mobile terminal moves in a parallel or rotational direction or in an arbitrary direction using a motion sensor, and may control to perform another scroll mode for the physical movement. For example, the control unit scrolls up when the mobile terminal rotates or moves up the short length shown in FIG. 9 on the axis, scrolls down when rotated or moved down, and scroll left when the long length is rotated or moved to the left on the axis. Controls to perform a scroll light when rotated to the right.

For example, the position immediately before the physical movement of the mobile terminal above the threshold value or the threshold rate of change can be determined as the original position, and as another example, when the physical movement exceeds the threshold value or the threshold rate of change, the method of integrating the output value of the motion sensor or the first There are various methods, such as generating an event at the first occurrence of the threshold value or the threshold change rate and ignoring the physical movement that occurs within a preset recovery time. The present invention includes all of them, and any method is possible as long as the operation returns to the original position when a specific event is generated in the mobile terminal from the user's point of view. For this example, FIG. 10 shows that the user physically moves the mobile terminal from the use position and then returns to the original use position. The shaking moves in both directions around the original position and then returns to the original position.

The present invention provides a method for controlling a screen of a mobile terminal including a proximity sensor, a motion sensor, and a touch screen, wherein the proximity event is released within a preset time after the proximity event by the proximity sensor occurs ) determining the event to be; and executing a screen control task corresponding to the release event.

11 is a diagram illustrating a state in which a proximity event according to the present invention is generated.

In the figure, the control unit receives a proximity event when the user's hand 201 approaches the proximity sensor 31 of the mobile terminal as shown in FIG. When it detects that the proximity event is released by moving and controls to perform a screen control operation corresponding to the scroll down operation, FIG. 11 ( b ) shows the screen after scrolling down.

That is, in the present invention, as shown in the figure, the controller of the mobile terminal determines whether the proximity event is released within a preset time after the proximity event is generated by the proximity sensor 31, and performs a screen control operation corresponding thereto. .

The proximity sensor may be the proximity sensor 31 shown in FIG. 2, a gesture sensor, an optical sensor, or any sensor capable of determining proximity without contacting any object.

The present invention is characterized in that it further comprises the step of detecting a physical movement through the motion sensor before the proximity event occurs.

12 is a diagram illustrating a process in which a proximity event is generated after a mobile terminal physically moves according to the present invention.

As shown in the figure, the control unit receives the proximity event by the proximity sensor after the user detects a physical movement in the posture of using the mobile terminal. At this time, the mobile terminal physically moves to generate a proximity event, and then returns to its original location. At this time, the present invention may detect at least a proximity event and execute a screen control task corresponding thereto.

In the present invention, the proximity event occurs more than once within a preset time,

It is characterized in that the screen control operation is different according to the number of occurrences of the proximity event.

In FIG. 12 , the proximity event may be continuously generated one or more times, and in this case, a different screen control operation may be performed according to the number of occurrences of the proximity event. That is, when the proximity event generated through the proximity sensor is released after being continuously generated one or more times within a preset time, the controller of the present invention may recognize the different events according to the number of the generated proximity events. In this case, one or more of the proximity events may be generated within a preset time.

In addition, the control unit according to the present invention may recognize a short interval and a long interval between the events, or a combination thereof, when there are a plurality of events generated through the proximity sensor, and perform different screen control tasks for them. . In this case, the short price and the long interval may be determined as a preset reference time.

In the present invention, the screen control operation includes at least one of a screen scrolling mode, a screen standby mode, turning on a screen, going back, going to a home, or a screen capture or video control, and the screen scrolling mode is a preset range once. is scrolled, and the moving picture control includes moving before or after a preset time when the moving picture is played on the screen of the mobile terminal, and includes playing or stopping or replaying.

The screen scrolling mode, the screen standby mode, turning on the screen, going back, or going to the home may be the same as described above.

The present invention provides a method for controlling a screen of a mobile terminal including a proximity sensor, a motion sensor, and a touch screen. detecting at least one of the generated proximity events; including a selection mode including a plurality of items and including a selection item in which one item is selected, and performing an operation on the selection mode in response to the event, wherein the operation includes: It is characterized in that at least one of moving a selection item to another item, displaying the sub-content by selecting the selection item, or executing the selection item is included.

13 to 15 are diagrams showing the operation of the selection mode and the non-selection mode according to the present invention.

13 is a diagram illustrating movement and selection of a selection item when an application running in a mobile terminal is in a selection mode. 13( a ) shows a screen of a mobile terminal when the first item is a selection item in the selection mode of the application. FIG. 13(b) shows the screen of the mobile terminal when the selection item is moved to the second item in response to the event in the state of FIG. 13(a). FIG. 13( c ) is a view showing a screen state of sub-contents by selecting a selection item of FIG. 13( b ).

When the selection item is selected in FIG. 13(b), sub-content is displayed. In this case, the sub-content may include arbitrary details or items or lists or various types of content. When another physical movement is performed as described above in FIGS. 9 and 10 , another screen control operation corresponding thereto can be performed.

The present invention is characterized in that it further includes a non-selection mode in which the selection mode is deactivated.

14 is a view showing a screen of a mobile terminal in a selection mode and a non-selection mode according to the present invention.

The present invention can be changed to a selection mode or a non-selection mode in response to a corresponding event as shown in the drawings. At this time, the selection mode or the non-selection mode may be changed to a toggle method. That is, in the toggle method, the selection mode is changed to the selection mode when the corresponding event occurs first, and the selection mode is changed to the non-selection mode when the corresponding event occurs again.

14 (a) shows a screen image when an application including a plurality of items is running and the item is in a non-selection mode, and FIG. As the selection mode changes to the selection mode, the screen in which the first item 330 becomes the selection item is displayed. And, FIG. 14(c) shows that when the selection item is selected in the state of FIG. 14(b), the first sub-menu 331 is moved to the first sub-menu 331 among the contents of the selection item.

15 is a view showing a screen state when a shortcut icon is changed from a non-selection mode to a selection mode on the home screen and the selection mode is executed.

Fig. 15 (a) is a view showing a screen state where the shortcut icon 55 of the non-selection mode is located on the home screen, and Fig. 15 (b) is a view of the occurrence of a corresponding event in the non-selection mode of Fig. 15 (a). It is a screen in which the selection mode is changed to the selection mode, and FIG. 15(c) shows a screen in which a corresponding event occurs in FIG. 15(b) and the shortcut icon 56 in the selected state is executed.

The event is an event in which the mobile terminal detects an event in which a physical movement exceeds a preset threshold value or a threshold change rate or returns to the opposite direction after physical movement, or returns to a pre-movement position after the physical movement within a preset return time It may be at least one of the upcoming events. When the mobile terminal moves, different events may occur according to rotational movement, movement direction, or parallel movement.

The present invention provides a method for controlling a screen of a mobile terminal including a motion sensor and a touch screen, the method comprising the steps of: executing an application for taking a picture in the mobile terminal; detecting an event caused by the physical movement of the mobile terminal using the motion sensor; and executing a photo taking task in the application in response to the event.

Users are increasingly taking pictures of themselves using a so-called selfie stick, which is a tool, and a selfie stick, which takes a picture of the user using a mobile terminal. The selfie stick is connected to the mobile terminal by wire or wireless, and the mobile terminal takes a picture by pressing a button mounted on the selfie stick. Here, selfie is an abbreviation for self-camera, and refers to a user taking a picture of himself or herself.

However, such a selfie stick is not only expensive, including a wireless device, but also has a disadvantage in that it is difficult to carry and carry because the weight of the device is heavy due to the weight of the battery.

The present invention can overcome this disadvantage, and when a user takes a picture by himself or a selfie stick, the control unit detects an event caused by the physical movement of the mobile terminal and takes a picture corresponding to the event. The application may be any program that can be executed in the mobile terminal to take pictures.

In the present invention, the photographing operation is characterized in that it includes at least one of starting photographing, restarting photographing, or canceling photographing.

In the present invention, when the photographing starts, the control unit controls the photographing to be performed after a preset waiting time.

The waiting time is preset, or the user can change the waiting time arbitrarily through a menu or the like. When a photo taking is started in response to a corresponding event, the controller may control the decrease of the waiting time by displaying it on the screen so that the user can see it. The cancellation of taking the picture may be performed when a corresponding event occurs after the start of the picture taking is started.

In the present invention, the physical movement is characterized in that it includes a shaking operation or a returning operation to the original position.

The shaking operation may be performed one or more times in which the mobile terminal returns to its original position after movement. The returning to the original position may be an operation of returning to the original position after the mobile terminal moves. The shaking operation and the returning operation to the original position may include parallel movement, rotational movement, or movement of the mobile terminal in an arbitrary direction as shown in FIGS. 9 and 10. In this case, the physical movement is a threshold value set by the mobile terminal. Alternatively, it may include an event in which an event of physical movement exceeding a threshold change rate is detected, or an event of returning in the opposite direction after physical movement.

It is characterized in that it is a computer-readable storage medium in which a program capable of executing the method for controlling a screen according to the present invention is recorded.

The present invention may be implemented by any computing device and may be implemented in the form of program instructions and recorded in a computer-readable storage medium. The computer-readable storage medium may consist of program instructions, data files, data structures, etc. alone or in combination thereof, and may be formed in any form or configuration as long as it is configured to store and execute program instructions. In addition, the computer-readable storage medium may be stored and executed in the form of computer-readable code in a distributed manner in an independent or network-connected computer system. Therefore, such a program may be transferred electronically through any storage medium such as a communication signal transmitted through a wired or wireless connection, and the present invention may suitably include the equivalent thereof.

It can be seen that the storage unit included in the mobile terminal is an example of a machine-readable storage medium suitable for storing any program or programs including instructions for implementing embodiments of the present invention. Any such program, for example, whether erasable or rewritable, may be stored in a volatile or non-volatile storage device such as a ROM, or a memory such as a RAM, a memory chip, device or integrated circuit, or for example It may be stored in a storage medium that is both optically or magnetically recordable and machine (eg, computer) readable storage medium, such as a CD, DVD, magnetic disk, or magnetic tape.

The present invention is characterized in that the mobile terminal includes the storage medium that is machine-readable and records a method for controlling the screen.

The present invention may include a program including code for implementing the method or apparatus described in the claims, and a machine-readable storage medium storing the program. Embodiments of the present invention can be implemented in hardware or software, or a combination thereof.

On the other hand, although operations are depicted in the drawings in a specific order in the present invention, it should not be understood that such operations must be performed in the specific order illustrated or all illustrated operations must be performed in order to obtain a desired result.

The present invention described above, for those of ordinary skill in the art to which the present invention pertains, various substitutions, modifications and changes are possible within the place without departing from the technical spirit of the present invention, so the above-described embodiments and accompanying It is not limited by the drawing. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all modifications, equivalents and substitutions included in the spirit and scope of the present invention.

10: mobile terminal, 20: control unit, 30: sensor module, 31: motion detection sensor, 50: touch screen, 55: shortcut icon, 56: selected shortcut icon, 60: communication module, 70: storage, 80: input/output module , 81: back button, 82: home button, 90: power supply, 200: user, 201: user's hand, 210: wide surface, 211: reference plane (ground surface), 301: selection button, 302: news feed menu, 303: friends menu, 305: menu, 330: first item, 331: first sub-menu

Claims (22)

In the method of controlling a screen of a mobile terminal including a motion detection sensor and a touch screen,
detecting a current posture in which the mobile terminal is placed using the motion sensor;
Comprising the step of determining whether the mobile terminal is in use by comparing the current posture and the posture when using the mobile terminal,
When the current posture of the mobile terminal is located in the use posture, the touch screen is made to maintain the use state,
The usage posture is
collected during use of the mobile terminal,
The collection of the usage posture, characterized in that at least one of when a touch event occurs on the touch screen, when the screen is turned on, or when using the mobile terminal while maintaining the posture in a preset range for a preset time or longer , how to control the screen. According to claim 1, wherein the current posture or the use posture,
A method for controlling a screen, characterized in that the forward and backward tilt angle or lateral tilt angle or all of them are included with respect to the reference plane where the mobile terminal is placed The method of claim 1
The usage posture is
A method of controlling a screen, characterized in that the posture is when the user uses the mobile terminal while lying down. delete According to claim 1, wherein the use posture,
A method for controlling a screen, comprising one or more use ranges, and determining that the position is located in the use posture when the use posture is within the use range delete In the method of controlling a screen of a mobile terminal including a motion detection sensor and a touch screen,
An event that occurs in any one of when the mobile terminal physically moves above a preset threshold value or a threshold change rate using the motion sensor, and when the mobile terminal returns to the pre-movement position within a preset return time after the physical movement determining; and
including; executing a screen control task corresponding to the event;
The method of controlling a screen, characterized in that after executing the screen task corresponding to the event, other events occurring within the preset return time are ignored. The method of claim 7, wherein the screen control operation comprises:
A method for controlling a screen, comprising at least one of a screen scrolling mode or a screen standby mode, or turning on or going back to a screen or going to a home or controlling a video A method of controlling a screen of a mobile terminal including a motion detection sensor and a touch screen, the method comprising:
an application including information exceeding that displayed on one screen is executed in the mobile terminal and the information is displayed on the touch screen;
An event that occurs in any one of when the mobile terminal physically moves above a preset threshold value or a threshold change rate using the motion sensor, and when the mobile terminal returns to its pre-movement position within a preset return time after the physical movement determining;
Including; executing the screen scroll mode corresponding to the event in the application;
Ignoring other events that occurred within the preset return time after executing the screen scroll mode corresponding to the event,
The screen scrolling mode is a method of controlling a screen, characterized in that the screen is scrolled in a preset range or another item at a time. 10. The method of claim 9,
The physical movement is
A method for controlling a screen, characterized in that it is a translational movement or a rotational movement or a shaking or a combination thereof. delete delete delete delete delete delete delete delete delete delete delete delete

Images