WO2016131274A1

WO2016131274A1 - Method, device and terminal for controlling terminal display

Info

Publication number: WO2016131274A1
Application number: PCT/CN2015/090955
Authority: WO
Inventors: 梁震
Original assignee: 中兴通讯股份有限公司
Priority date: 2015-07-16
Filing date: 2015-09-28
Publication date: 2016-08-25
Also published as: CN106354246A

Abstract

Disclosed are a method, device and terminal for controlling a terminal display, the method comprising: acquiring a holding manner for a user upon currently using a terminal; dividing, according to the holding manner, a display region of the terminal into a touchable region and a non-touchable region; detecting an operation intention of the user; and controlling, according to the operation intention, a content display of the non-touchable region.

Description

Terminal display control method, device and terminal

Technical field

This application relates to, but is not limited to, the field of display control.

Background technique

At present, the screen of handheld electronic devices on the market is getting bigger and bigger. The advantage is that it brings a better user experience to the user, can display more content at the same time, and obtain a larger and more comfortable view, but the disadvantages also follow. In terms of operation, because of the ever-increasing screen, many functions cannot be completed by one hand, especially the buttons/buttons on the opposite side of the screen and the opposite side of the hand must be coordinated by both hands. . In this way, for handheld electronic devices, there will be a lack of ease of use, resulting in inconvenient operation and affecting the user experience.

Therefore, how to provide a terminal display control method that can satisfy the one-hand operation of the user is a technical problem to be solved by those skilled in the art.

Summary of the invention

The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.

The present invention provides a terminal display control method, device and terminal to solve the problem that the large-screen mobile phone user of the related technology cannot operate with one hand.

A terminal display control method includes: acquiring a holding mode when a user currently uses a terminal; dividing the display area of the terminal into an accessible area and an inaccessible area according to the holding manner; detecting a user's operation intention; controlling according to an operation intention The content of the inaccessible area is displayed.

Optionally, the operation intention includes: the user wants to operate the reachable area, or the user wants to operate the unreachable area; and controlling the display of the terminal according to the operation intention includes: if the user wishes to operate the accessible area, the content of the control untouchable area is restored to normal. Display; if the user wishes to operate the unreachable area, the control terminal displays the content of the unreachable area in the accessible area.

Optionally, the content that the control terminal displays the inaccessible area in the accessible area includes: controlling the terminal Only the content of the inaccessible area is displayed in the accessible area, or the content of the inaccessible area is displayed through the floating window, or the content of the accessible area and the unreachable area is simultaneously displayed.

Optionally, the manner of holding the user when using the terminal currently includes: detecting a pressure distribution when the user uses the terminal by using a pressure sensor, determining a holding manner of the user according to the pressure distribution, or contacting the position and contacting the touch screen itself. Area detection determines the way the user's hand is held.

Optionally, dividing the display area of the terminal into the accessible area and the inaccessible area according to the holding manner includes: determining a handheld position of the user according to the holding manner, and obtaining an operation range of the thumb when the user is in the handheld position, and the operation range is within the operation range. The display area is an accessible area, and the display area outside the operation range is regarded as an inaccessible area.

Optionally, detecting the user's operation intention includes: detecting a change in pressure/temperature/contact area when the user uses the terminal, or a distribution of 3D objects around the terminal, or a human brain consciousness activity of the user, or selecting a user's operation area. As a result, the operation intention is determined.

Optionally, after the control terminal displays the content of the inaccessible area in the accessible area, the method further includes: detecting whether the operation of the content of the inaccessible area is completed, and if yes, controlling the content of the unreachable area to resume normal display.

Optionally, detecting whether the operation of the content of the inaccessible area is completed includes: detecting whether the user receives the operation of the content of the unreachable area, and if yes, performing an operation, and controlling the content of the unreachable area to resume normal display; or The detection control terminal displays whether the duration of the content of the inaccessible area in the accessible area is greater than a threshold, and if so, controls the content of the unreachable area to resume normal display.

A terminal display control device, comprising: an obtaining module, configured to: acquire a holding mode when the user currently uses the terminal; and the dividing module is configured to: divide the display area of the terminal into an accessible area and cannot be touched according to the holding manner The detection module is configured to: detect a user's operation intention; and the control module is configured to: control content display of the unreachable area according to the operation intention.

Optionally, the operation intention comprises: the user wants to operate the accessible area, or the user wants to operate the untouchable area; the control module is configured to control the content of the untouchable area to resume normal display if the user wishes to operate the accessible area; If it is desired to operate the unreachable area, the control terminal is accessible The content of the inaccessible area is displayed in the area.

Optionally, the control module is configured to: the control terminal displays only the content of the inaccessible area in the accessible area, or displays the content of the inaccessible area through the floating window, or simultaneously displays the content of the accessible area and the untouchable area; .

Optionally, the obtaining module is configured to: detect a pressure distribution when the user uses the terminal by using a pressure sensor, determine a holding manner of the user according to the pressure distribution, or determine the user by detecting the contact position and the contact area by the touch screen itself. The way the hand is held.

Optionally, the dividing module is configured to: determine a handheld position of the user according to the holding manner, obtain an operating range of the thumb when the user is in the handheld position, and use the display area within the operating range as the accessible area, and display the display outside the operating range The area acts as an inaccessible area.

Optionally, the detecting module is configured to: detect a change in pressure/temperature/contact area when the user uses the terminal, or a distribution of 3D objects around the terminal, or a human brain consciousness activity of the user, or a user operation area selection result. To determine the intent of the operation.

Optionally, the control module is further configured to: after the control terminal displays the content of the unreachable area in the accessible area, detect whether the operation of the content of the unreachable area is completed, and if yes, control the content of the untouchable area to resume normal display. .

Optionally, the control module is configured to: detect whether the user receives the content of the untouchable area, and if yes, perform an operation, and control the content of the untouchable area to resume normal display; or, the detection control terminal is in the accessible area. Whether the duration of the content of the untouchable area is greater than the threshold is displayed, and if so, the content of the unreachable area is controlled to resume normal display.

A terminal includes a terminal display control device provided by an embodiment of the present invention, and controls display of the terminal by the terminal display control device.

A computer readable storage medium storing computer executable instructions for performing the method of any of the above.

The embodiment of the invention provides a new terminal display control method, which divides the display screen into an accessible area and an inaccessible area according to the user's holding manner, and on the basis of the detection, according to the user's operation intention, the control is untouchable. How the content of the area is displayed, for example, when the user needs to operate When the zone is in use, the content of the inaccessible zone is directly displayed in the accessible area, so that the user does not have to change hands or operate the terminal with both hands, and can perform full-screen operation in the one-hand accessible area, and solve the related technology of the large-screen mobile phone. The problem that the user cannot operate with one hand enhances the user experience.

Other aspects will be apparent upon reading and understanding the drawings and detailed description.

BRIEF abstract

1 is a schematic structural diagram of a terminal display control apparatus according to a first embodiment of the present invention;

2 is a flowchart of a terminal display control method according to a second embodiment of the present invention;

3 is a flowchart of a terminal display control method according to a third embodiment of the present invention;

4a is a schematic diagram of a terminal holding manner in a third embodiment of the present invention;

4b is a schematic diagram of a display screen division according to a third embodiment of the present invention;

4c is a schematic diagram of a terminal display before a user operates according to a third embodiment of the present invention;

4d is a schematic diagram of a terminal display after a user operates in a third embodiment of the present invention.

Embodiments of the invention

The embodiments of the present invention will now be described with reference to the accompanying drawings.

First embodiment:

1 is a schematic structural diagram of a terminal display control apparatus according to a first embodiment of the present invention. As shown in FIG. 1, in the embodiment, the terminal display control apparatus 1 provided by the embodiment of the present invention includes:

The obtaining module 11 is configured to: acquire a holding mode when the user currently uses the terminal;

The dividing module 12 is configured to: divide the display area of the terminal into an accessible area and an inaccessible area according to the holding manner;

The detecting module 13 is configured to: detect a user's operation intention;

The control module 14 is configured to control the content display of the inaccessible area according to the operation intention.

In some embodiments, the operations in the above embodiments are intended to include: the user wishes to operate the accessible area, or the user wishes to operate the inaccessible area; the control module 14 is configured to, if the user wishes When the touchable area is operated, the content of the control unreachable area is restored to the normal display; if the user wishes to operate the unreachable area, the control terminal displays the content of the untouchable area in the accessible area.

In some embodiments, the control module 14 in the above embodiment is configured to: control the terminal to display only the content of the inaccessible area in the accessible area, or display the content of the inaccessible area through the floating window, or display simultaneously Access to the area and the content of the unreachable area.

In some embodiments, the obtaining module 11 in the above embodiment is configured to detect a pressure distribution when the user uses the terminal by using a pressure sensor, determine a holding manner of the user according to the pressure distribution, or contact the position by the touch screen itself. The detection of the contact area, etc., determines the holding manner of the user's hand, and the like.

In some embodiments, the dividing module 12 in the above embodiment is configured to: determine the handheld position of the user according to the holding manner, obtain the operating range of the thumb when the user is in the handheld position, and make the display area within the operating range as accessible. The area, the display area outside the operating range is regarded as an inaccessible area.

In some embodiments, the detection module 13 in the above embodiment is configured to detect a change in pressure/temperature/contact area when the user uses the terminal, or a distribution of 3D objects around the terminal, or a human brain consciousness activity of the user. Or the user's operating area selection result determines the operation intent.

In some embodiments, the control module 14 in the above embodiment is further configured to: after the control terminal displays the content of the inaccessible area in the accessible area, detect whether the operation of the content of the inaccessible area is completed, and if so, control The content of the unreachable area is restored to normal display.

In some embodiments, the control module 14 in the above embodiment is configured to: detect whether the user receives the content of the untouchable area, and if so, perform an operation, and control the content of the unreachable area to resume normal display; or And detecting, by the control terminal, whether the duration of displaying the content of the inaccessible area in the accessible area is greater than a threshold, and if so, controlling the content of the unreachable area to resume normal display.

Correspondingly, the embodiment of the present invention provides a terminal, which includes the terminal display control device 1 provided by the embodiment of the present invention, and controls the display of the terminal through the device 1.

Second embodiment:

2 is a flowchart of a terminal display control method according to a second embodiment of the present invention. As shown in FIG. 2, in the embodiment, the terminal display control method provided by the embodiment of the present invention includes the following steps:

S201: Obtain a holding manner when the user currently uses the terminal;

S202: Divide the display area of the terminal into an accessible area and an inaccessible area according to the holding manner;

S203: detecting a user's operation intention;

S204: Control the content display of the inaccessible area according to the operation intention.

In some embodiments, the operation in the above embodiment is intended to include: the user wishes to operate the accessible area, or the user wishes to operate the inaccessible area; controlling the display of the terminal according to the operation intention includes: if the user wishes to operate the accessible area, then controlling The content of the inaccessible area returns to the normal display; if the user wishes to operate the unreachable area, the control terminal displays the content of the unreachable area in the accessible area.

In some embodiments, the controlling terminal in the above embodiment displays the content of the inaccessible area in the accessible area, including: the control terminal displays only the content of the inaccessible area in the accessible area, or displays the unreachable area through the floating window. The content, or both, shows the content of the accessible area and the unreachable area.

In some embodiments, the manner of grasping when the user currently uses the terminal in the foregoing embodiment includes: detecting, by using a pressure sensor, a pressure distribution when the user uses the terminal, determining a holding manner of the user according to the pressure distribution; or The touch screen itself detects the contact position, the contact area, and the like, and determines the holding manner of the user's hand.

In some embodiments, the dividing the display area of the terminal into the accessible area and the inaccessible area according to the holding manner in the foregoing embodiment includes: determining a handheld position of the user according to the holding manner, and acquiring a thumb of the user when the position is in the handheld position. The operating range is such that the display area within the operating range is an accessible area, and the display area outside the operating range is regarded as an inaccessible area.

In some embodiments, detecting the user's operational intent in the above embodiment includes: detecting a change in pressure/temperature/contact area when the user uses the terminal, or a 3D object distribution around the terminal, or a human brain consciousness activity of the user Or the user's operating area selection result determines the operation intent.

In some embodiments, after the controlling terminal displays the content of the inaccessible area in the accessible area, the foregoing embodiment further includes: detecting whether the operation of the content of the inaccessible area is completed, and if yes, Controls the content of the inaccessible area to return to normal display.

In some embodiments, the detecting, in the above embodiment, whether the operation of the content of the inaccessible area is completed comprises: detecting whether the user's operation of the content of the unreachable area is received, and if so, performing an operation and controlling the unreachable area The content is restored to the normal display; or, the detection control terminal displays whether the duration of the content of the untouchable area in the accessible area is greater than a threshold, and if so, the content of the control unreachable area is restored to the normal display.

The embodiments of the present invention will be described in conjunction with application scenarios.

Third embodiment:

In this embodiment, the user uses the mobile phone in the right hand as an example for interpretation.

FIG. 3 is a flowchart of a terminal display control method according to a third embodiment of the present invention. As shown in FIG. 3, in the embodiment, the terminal display control method provided by the embodiment of the present invention includes the following steps:

S301: The user uses the mobile phone with one hand.

S302: The terminal detects a user's holding manner.

As shown in FIG. 4a, the terminal determines that the user's holding mode is according to the pressure state detected by the display screen: the right hand is operated by one hand, and is located in the lower right corner of the display screen.

S303: The terminal divides the display area into an accessible area and an inaccessible area.

As shown in FIG. 4b, the terminal divides the area in the lower right corner of the display screen into an accessible area (shaded area) according to the holding manner, and divides the other area into an inaccessible area (white area).

S304: The terminal monitors a user's operation intention.

At present, most of the capacitive multi-touch screens realize the detection of the contact area of each contact point. In the future, there will be more forms of touch screens to support the detection of parameters such as contact pressure, so that the user is in the normal operation process. The way the terminal is held, when the user tries to extend the finger (in most cases, the thumb) to touch the "non-accessible area", the thumb finger and other 4 fingers will have a significant contact with the phone and the screen. Change, therefore, the user's operational intent can be detected by the software system. While reporting the contact coordinates, the touch screen will report the contact area parameters of each contact operation contact to the system, including sizeX and sizeY, both of which have a decimal range of 0-1, indicating horizontal and vertical. The relative value of the contact area of the two aspects. When the user operates normally, the user clicks and touches with the fingertip, and the value of the value generally reported is less than 0.2, when the user uses the finger This value is usually greater than 0.2 when the abdomen, thumb finger root, etc. are in contact with an abnormally operated area. (Note that 0.2 is an example value and a relative value.) Therefore, by combining the contact point coordinates and the contact point size, it is possible to detect whether the user's motion is a "thumb root touches the edge of the screen" and passes the action. Occurs, it is considered that the user has generated an intention to touch the content of the opposite operation.

Of course, with the advancement of sensing technology, the contact pressure, temperature, the overall holding mode of the device and the contact area and pressure, or the distribution of objects in the 3D space around the device, or even when it is active on the human brain After the identification is more accurate, a special consciousness detection module can also be added for the user operation intention detection in the method to achieve a more accurate result of the method execution.

When the operation intention is that the user needs to operate the inaccessible area, step S305 is performed; otherwise, the normal display, that is, full screen display.

S305: Display the content of the inaccessible area in the accessible area according to the operation intention.

As shown in FIG. 4c, the terminal displays the content of the inaccessible area and the content of the accessible area in the accessible area, and displays in a scaled manner.

S306: After detecting that the user operation is completed, the normal display is performed.

As shown in FIG. 4d, after the user operates, the user completes the operation of the inaccessible area, and the content of the inaccessible area is normally displayed.

In this embodiment, the combination of the universal operation detection and the user intention detection is realized, which greatly simplifies the operation steps of the user, reduces the complexity of the system configuration, and saves the cost of specifically setting the mode switching unit (switch button, etc.). The embodiments of the present invention focus on the subconscious and unconscious actions of the user, and do not require the user to actively specify a specific action or preset a fixed action.

In practical applications, when the normal click operation of the user is detected (ie, the contact contact area parameter is small), the interface performs a normal response; when the user's thumb finger pressure is detected to the edge of the screen, the interface is reduced to the figure. The area shown by 4c is for the user to operate, and the action of clicking the target button can be continued in the case where the user's palm does not leave the edge, that is, the desired operation is completed in one step instead of being divided into two steps. The detection method is as follows: a contact action in which the contact area parameter is greater than 0.2 is detected in the edge region (reported contact x coordinate > screen width pixel number * 90% or x coordinate < screen width pixel number * 10%).

Of course, in some embodiments, a spatial position sensor can be employed to detect user operations and operational intent, including:

The touch display screen detects a user's touch operation; the finger space position sensor detects a moving object near the screen; and the pressure sensor detects the pressure generated by the hand grip of the mobile phone edge;

When it is detected that the user's thumb extends to a position where the top is difficult to touch, and the grip edge pressure is greater than a certain value, it can be determined that the user is trying to touch a certain position at the top, and the current interface is reduced to the area shown in FIG. 4c. For the user to operate, and the action of clicking the target button can be continued without the user's palm leaving the edge, that is, the required operation is completed in one step instead of being divided into two steps.

One of ordinary skill in the art will appreciate that all or a portion of the steps of the above-described embodiments can be implemented using a computer program flow, which can be stored in a computer readable storage medium, such as on a corresponding hardware platform (eg, The system, device, device, device, etc. are executed, and when executed, include one or a combination of the steps of the method embodiments.

Alternatively, all or part of the steps of the above embodiments may also be implemented by using an integrated circuit. These steps may be separately fabricated into individual integrated circuit modules, or multiple modules or steps may be fabricated into a single integrated circuit module. achieve.

The devices/function modules/functional units in the above embodiments may be implemented by a general-purpose computing device, which may be centralized on a single computing device or distributed over a network of multiple computing devices.

When the device/function module/functional unit in the above embodiment is implemented in the form of a software function module and sold or used as a stand-alone product, it can be stored in a computer readable storage medium. The above mentioned computer readable storage medium may be a read only memory, a magnetic disk or an optical disk or the like.

Industrial applicability

According to the embodiment of the present invention, the display screen is divided into an accessible area and an inaccessible area according to the user's holding manner, and based on the detection, the user's operation intention is detected to control the content of the untouchable area. The display mode, for example, when the user needs to operate the inaccessible area, directly displays the content of the inaccessible area in the accessible area, so that the user can perform full screen in the one-hand accessible area without having to change hands or operate the terminal with both hands. The operation solves the problem that the large-screen mobile phone user of the related technology cannot operate with one hand, and enhances the user experience. Moreover, the user does not have to perform the switching of the one-handed and non-single-handed modes of operation before performing the desired operation, but the device automatically switches to the one-handed operation when the device automatically senses the user's need for one-handed operation. Mode, so that the same number of steps as normal operation and one-hand mode can be used naturally and automatically without knowing that one-hand mode can be switched.

Claims

A terminal display control method includes:

Obtain the holding mode when the user currently uses the terminal;

Dividing the display area of the terminal into an accessible area and an inaccessible area according to the holding manner;

Detecting the user's operational intent;

The content display of the inaccessible area is controlled according to the operation intent.
The terminal display control method according to claim 1, wherein the operation intention comprises: a user desires to operate the accessible area, or a user desires to operate the unreachable area; and the controlling the operation according to the operation intention The displaying of the terminal includes: if the user wishes to operate the accessible area, controlling the content of the inaccessible area to resume normal display; if the user wishes to operate the unreachable area, controlling the terminal in the accessible area The content of the inaccessible area is displayed.
The terminal display control method according to claim 2, wherein the controlling the terminal to display the content of the inaccessible area in the accessible area comprises: controlling the terminal to display only in the accessible area The content of the inaccessible area, or the content of the inaccessible area is displayed through a floating window, or the content of the accessible area and the inaccessible area is simultaneously displayed.
The terminal display control method according to claim 1, wherein the grasping manner when the user currently uses the terminal comprises: detecting, by a pressure sensor, a pressure distribution when the user uses the terminal, determining according to the pressure distribution situation The user's holding mode, or the detection of the contact position and the contact area by the touch screen, determines the holding manner of the user's hand.
The terminal display control method according to claim 1, wherein the dividing the display area of the terminal into the accessible area and the inaccessible area according to the holding manner comprises: determining the handheld of the user according to the holding manner a position, the operating range of the thumb when the user is in the handheld position, the display area within the operating range as the accessible area, and the display area outside the operating range as the inaccessible area.
The terminal display control method according to claim 1, wherein the detecting the user's operation intention comprises: detecting a change in pressure/temperature/contact area when the user uses the terminal, or a distribution of 3D objects around the terminal, Or the human brain consciousness activity of the user, or the said The user's operation area selection result determines the operation intention.
The terminal display control method according to any one of claims 1 to 6, wherein after controlling the terminal to display the content of the inaccessible area in the accessible area, the method further comprises: detecting whether the completion of the The operation of the content of the inaccessible area, and if so, controls the content of the unreachable area to resume normal display.
The terminal display control method according to claim 7, wherein the detecting whether the operation of the content of the inaccessible area is completed comprises: detecting whether a user's operation of the content of the inaccessible area is received, and if so, Performing an operation, and controlling the content of the inaccessible area to resume normal display; or detecting whether the duration of displaying the content of the inaccessible area in the accessible area by the terminal is greater than a threshold, and if so, controlling the location The contents of the unreachable area are restored to normal display.
A terminal display control device includes:

The obtaining module is set to: obtain a holding mode when the user currently uses the terminal;

The dividing module is configured to: divide the display area of the terminal into an accessible area and an inaccessible area according to the holding manner;

The detecting module is configured to: detect a user's operation intention;

And a control module configured to: control content display of the inaccessible area according to the operation intention.
The terminal display control device according to claim 9, wherein the operation intention comprises: the user desires to operate the accessible area, or the user wishes to operate the unreachable area; the control module is set to if the user Desiring to operate the accessible area, controlling the content of the inaccessible area to resume normal display; if the user wishes to operate the unreachable area, controlling the terminal to display the inaccessible area in the accessible area content.
The terminal display control device according to claim 10, wherein the control module is configured to: control the terminal to display only the content of the inaccessible area in the accessible area, or display the content through a floating window The content of the inaccessible area is displayed, or the content of the accessible area and the inaccessible area is simultaneously displayed.
The terminal display control device according to claim 9, wherein said acquisition module is provided The pressure sensor is used to detect the pressure distribution when the user uses the terminal, determine the user's holding manner according to the pressure distribution, or determine the contact position of the user's hand through the touch screen to detect the contact position and the contact area. the way.
The terminal display control device according to any one of claims 9 to 12, wherein the control module is further configured to: after controlling the terminal to display the content of the inaccessible area in the accessible area, detecting Whether the operation of the content of the inaccessible area is completed, and if so, the content of the unreachable area is controlled to resume normal display.
A terminal comprising the terminal display control device according to any one of claims 9 to 13, wherein the display of the terminal is controlled by the terminal display control device.
A computer readable storage medium storing computer executable instructions for performing the method of any of claims 1-8.