CN108390961B - Touch response method and device, readable storage medium and mobile terminal - Google Patents

Touch response method and device, readable storage medium and mobile terminal Download PDF

Info

Publication number
CN108390961B
CN108390961B CN201810074499.9A CN201810074499A CN108390961B CN 108390961 B CN108390961 B CN 108390961B CN 201810074499 A CN201810074499 A CN 201810074499A CN 108390961 B CN108390961 B CN 108390961B
Authority
CN
China
Prior art keywords
sensor
touch
sliding
time
touch area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810074499.9A
Other languages
Chinese (zh)
Other versions
CN108390961A (en
Inventor
巫吉辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qiku Internet Technology Shenzhen Co Ltd
Original Assignee
Qiku Internet Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qiku Internet Technology Shenzhen Co Ltd filed Critical Qiku Internet Technology Shenzhen Co Ltd
Priority to CN201810074499.9A priority Critical patent/CN108390961B/en
Publication of CN108390961A publication Critical patent/CN108390961A/en
Application granted granted Critical
Publication of CN108390961B publication Critical patent/CN108390961B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/02—Constructional features of telephone sets
    • H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026—Details of the structure or mounting of specific components
    • H04M1/0266—Details of the structure or mounting of specific components for a display module assembly
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/02—Constructional features of telephone sets
    • H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026—Details of the structure or mounting of specific components
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/02—Constructional features of telephone sets
    • H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026—Details of the structure or mounting of specific components
    • H04M1/0264—Details of the structure or mounting of specific components for a camera module assembly
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/12—Details of telephonic subscriber devices including a sensor for measuring a physical value, e.g. temperature or motion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/22—Details of telephonic subscriber devices including a touch pad, a touch sensor or a touch detector

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a touch response method, a touch response device, a readable storage medium and a mobile terminal, wherein the method comprises the following steps: when a user slides in the non-touch area, controlling the work of the sensor, acquiring sensing data detected by the sensor and recording corresponding time; determining the sliding direction of the user sliding in the non-touch area according to the sensing data and the corresponding time; executing corresponding sliding operation according to the sliding direction; wherein, the work of control sensor, before the step of obtaining the sensing data that the sensor detected and recording corresponding time, still include: receiving touch operation acting on a touch area; judging whether the direction of the touch operation faces a non-touch area; if so, timing is started when the touch signal of the touch screen is lost, the work of the sensor is controlled within a preset time range, the sensing data detected by the sensor is obtained, and the corresponding time is recorded. According to the touch response method, the touch sliding effect in the non-touch area can be realized.

Description

Touch response method and device, readable storage medium and mobile terminal
Technical Field
The present invention relates to the field of mobile terminal technologies, and in particular, to a touch response method and apparatus, a readable storage medium, and a mobile terminal.
Background
With the progress of science and technology, mobile terminals with touch functions are rapidly developed and widely applied, for example, smart touch phones or smart touch tablet computers bring great convenience to life, entertainment and learning of people, wherein the smart touch phones are electronic products indispensable to daily life of people.
In the mobile terminal, the screen occupation ratio is a relative ratio of the screen area and the front panel area, the larger the screen occupation ratio is, the narrower the frame representing the mobile terminal is, and the more the whole volume of the mobile terminal can be reduced on the premise of a certain screen area, so that the requirement of portability of the mobile terminal is met. At present, the full-screen has a very large screen occupation ratio, so that the full-screen can give a very large visual impact to consumers, and is the mainstream direction of the development of the mobile terminal at present.
However, due to the limited process, in the prior art, some mobile phones with a full screen cannot achieve a real full screen, but on the basis of the existing touch screen, some non-touch areas for placing parts such as a camera, a receiver, a light sensation sensor, a distance sensor and the like are arranged, so that the area occupied by the non-touch areas is reduced as much as possible, for example, the non-touch areas are arranged in the middle of the top of the touch screen, which results in that the full screen is actually a special-shaped touch screen. When a user uses the full-screen, if the user slides to the non-touch areas, the response cannot be realized, and the sliding is discontinuous, for example, when the user uses a mobile phone to watch a movie to fast forward, if the user touches the non-touch areas, the continuous fast speed cannot be realized; for another example, when a user uses a mobile phone to play a game, if the user touches the non-touch areas, the corresponding game action cannot be realized, and the use experience of the user is finally affected.
Disclosure of Invention
Therefore, an embodiment of the invention provides a touch response method, which solves the problem that a user cannot realize response when sliding in a non-touch area of a full screen.
The touch response method according to an embodiment of the present invention is applied to a mobile terminal having a touch screen, wherein the touch screen includes a touch area and a non-touch area, and the non-touch area is provided with at least one sensor, and the method includes:
when a user slides in the non-touch area, controlling the work of the sensor, acquiring sensing data detected by the sensor and recording corresponding time;
determining the sliding direction of the user sliding in the non-touch area according to the sensing data and the corresponding time;
executing corresponding sliding operation according to the sliding direction;
before the step of controlling the operation of the sensor, acquiring sensing data detected by the sensor and recording corresponding time, the method further comprises:
receiving a touch operation firstly acting on the touch area;
judging whether the touch operation direction faces the non-touch area;
if so, starting timing when the touch signal of the touch screen is lost, controlling the work of the sensor within a preset time range, acquiring the sensing data detected by the sensor and recording the corresponding time.
According to the touch response method provided by the embodiment of the invention, when a user slides in the non-touch area, the sliding direction of the user sliding in the non-touch area can be determined by acquiring the sensing data detected by the sensor arranged in the non-touch area and the corresponding time, and finally, the corresponding sliding operation is executed according to the sliding direction, so that the touch sliding effect in the non-touch area can be realized, namely, the sliding response is realized when the non-touch area of the user slides, and the use experience of the user is improved.
In addition, the sliding response method according to the above embodiment of the present invention may further have the following additional technical features:
further, in an embodiment of the present invention, the step of determining whether the touch operation is directed to the non-touch area includes:
acquiring a displacement vector of the touch operation in a coordinate system of the touch screen;
judging whether an included angle between the displacement vector and a reference line is smaller than a preset angle, wherein the reference line is a coordinate axis which is overlapped with the non-touch area more in the coordinate system;
and if the included angle is smaller than a preset angle, determining that the touch operation direction is towards the non-touch area.
Further, in an embodiment of the present invention, before the step of controlling the operation of the sensor, acquiring sensing data detected by the sensor and recording a corresponding time when the user slides in the non-touch area, the method further includes:
judging whether the mobile terminal is in a horizontal screen state or not;
and if the mobile terminal is in a horizontal screen state, controlling the work of the sensor when a user slides in the non-touch area, acquiring sensing data detected by the sensor and recording corresponding time.
Further, in one embodiment of the present invention, the method further comprises:
when a user slides in the non-touch area, controlling the work of at least one camera in the sensor;
controlling the camera to cache at least two images according to the time sequence;
determining the sliding direction of the user in the non-touch area according to the image cached by the camera;
and executing corresponding sliding operation according to the sliding direction.
Further, in an embodiment of the present invention, after the step of controlling the operation of at least one camera in the sensor, the method further includes:
judging whether the brightness value detected by the camera is greater than a first brightness threshold value;
and if the brightness value is larger than a first brightness threshold value, controlling the camera to cache at least two images according to the time sequence.
Further, in an embodiment of the present invention, before the step of determining the sliding direction corresponding to the touch operation according to the image cached by the camera, the method further includes:
judging whether the action generated by the sliding of the user in the non-touch area is effective sliding;
and if the action is effective sliding, determining the sliding direction corresponding to the touch operation according to the image cached by the camera.
Further, in an embodiment of the present invention, the step of determining whether the action generated by the user sliding in the non-touch area is an effective sliding comprises:
acquiring displacement information and corresponding speed information of a target object of two adjacent images in the at least two images;
calculating the average speed of the speed information of all the two adjacent images;
judging whether the average speed is greater than a speed threshold value;
if the average speed is greater than the speed threshold, determining the action to be effective slip.
Further, in an embodiment of the present invention, the step of acquiring displacement information and corresponding speed information of the target object in two adjacent images of the at least two images includes:
and acquiring displacement information and corresponding speed information of the target object of two adjacent frames of images in the at least two images.
Further, in an embodiment of the present invention, before controlling the camera to cache the at least two images according to a time sequence, the method includes:
and fixing the frame rate and the photosensitive value of the camera. Further, in one embodiment of the present invention, the method further comprises:
when a user slides in the non-touch area, controlling the work of a first sensor and a second sensor in the sensors, wherein the first sensor and the second sensor are positioned at different positions in the non-touch area;
acquiring first sensing data detected by the first sensor and recording corresponding first time, and acquiring second sensing data detected by the second sensor and recording corresponding second time;
determining a sliding direction of a user sliding in the non-touch area according to the first sensing data, the first time, the second sensing data and the second time;
and executing corresponding sliding operation according to the sliding direction.
Further, in an embodiment of the present invention, the first sensing data is any one of a light sensor, a distance sensor, and a camera, and the second sensing data is any one of a light sensor, a distance sensor, and a camera.
Further, in an embodiment of the present invention, before the step of determining a sliding direction of the user sliding on the non-touch area according to the first sensing data, the first time, the second sensing data, and the second time, the method further includes:
judging whether the action generated by the sliding of the user in the non-touch area is effective sliding;
if the action is effective sliding, determining the sliding direction of the user sliding in the non-touch area according to the first sensing data, the first time, the second sensing data and the second time.
Further, in an embodiment of the invention, the first time is earlier than the second time, and the step of determining whether the action generated by the user sliding in the non-touch area is a valid sliding comprises:
at the first time, judging whether the occlusion generated by the user during the operation of the first sensor is effective occlusion according to the data detected by the first sensor;
at a second time, judging whether the occlusion generated by the user during the operation of the first sensor is effective occlusion according to the data detected by the second sensor;
if the two shelters are both effective shelters, the action generated by the sliding of the user in the non-touch area is judged to be effective sliding.
Further, in an embodiment of the present invention, the first sensor is a light sensor, and the step of determining whether the occlusion generated by the user during the operation of the first sensor is a valid occlusion according to the data detected by the first sensor includes:
acquiring the change of the brightness value detected by the light sensor and the corresponding brightness change time;
judging whether the change of the brightness value detected by the light sensor is greater than a second brightness threshold value or not and whether the brightness change time is less than a time threshold value or not;
and if the change of the brightness value detected by the light sensor is greater than the second brightness threshold value and the brightness change time is less than the time threshold value, judging that the occlusion generated by the user during the operation of the first sensor is effective occlusion.
Further, in an embodiment of the present invention, the second sensor is a distance sensor, and the step of determining whether the occlusion generated by the user during the operation of the second sensor is a valid occlusion according to the data detected by the second sensor includes:
acquiring a displacement value of a target object detected by the distance sensor and corresponding displacement change time;
judging whether the displacement value is larger than a displacement threshold value or not and whether the displacement change time is smaller than a time threshold value or not;
and if the displacement value is larger than the displacement threshold value and the displacement change time is smaller than the time threshold value, judging that the occlusion generated by the user during the operation of the second sensor is effective occlusion.
Another embodiment of the present invention provides a touch response device, which solves the problem that a user cannot respond when sliding in a non-touch area of a full-screen.
The touch response device according to the embodiment of the invention is applied to a mobile terminal with a touch screen, wherein the touch screen comprises a touch area and a non-touch area, and the non-touch area is provided with at least one sensor, and the device is characterized by comprising:
the control acquisition module is used for controlling the work of the sensor when a user slides in the non-touch area, acquiring sensing data detected by the sensor and recording corresponding time;
the direction determining module is used for determining the sliding direction of the user in the non-touch area according to the sensing data and the corresponding time;
and the sliding execution module is used for executing corresponding sliding operation according to the sliding direction. Another embodiment of the invention also proposes a readable storage medium on which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned method.
Another embodiment of the present invention also provides a mobile terminal, which includes a touch screen, a memory, a processor, and a computer program stored on the memory and executable on the processor, and the processor implements the above method when executing the program.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The above and/or additional aspects and advantages of embodiments of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a flow chart of a slip response method according to a first embodiment of the present invention;
FIG. 2 is a flow chart of a slip response method according to a second embodiment of the present invention;
FIG. 3 is a detailed flowchart of step S202 in FIG. 2;
FIG. 4 is a schematic diagram of a coordinate system of a touch screen in a sliding response method according to a second embodiment of the invention;
FIG. 5 is a flow chart of a slip response method according to a third embodiment of the present invention;
fig. 6 is a schematic structural diagram of a cellular phone in a slip response method according to a third embodiment of the present invention;
FIG. 7 is a flow chart of a slip response method according to a fourth embodiment of the present invention;
FIG. 8 is a flow chart of a slip response method according to a fifth embodiment of the present invention;
fig. 9 is a schematic structural diagram of a cellular phone in a slip response method according to a fifth embodiment of the present invention;
fig. 10 is three images cached by the camera in the sliding response method according to the fifth embodiment of the present invention;
FIG. 11 is a flow chart of a slip response method according to a sixth embodiment of the present invention;
fig. 12 is a detailed flowchart of step S603 in fig. 11;
fig. 13 is a schematic structural view of a slide responding apparatus according to a seventh embodiment of the present invention;
fig. 14 is a schematic structural view of a slide responding apparatus according to an eighth embodiment of the present invention;
fig. 15 is a schematic structural view of a slip response device according to a ninth embodiment of the invention;
fig. 16 is a schematic structural view of a slip response device according to a tenth embodiment of the present invention;
fig. 17 is a schematic structural view of a slip response device according to an eleventh embodiment of the present invention;
fig. 18 is a schematic structural view of a slide responding apparatus according to a twelfth embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a sliding response method according to a first embodiment of the present invention is applied to a mobile terminal having a touch screen, where the touch screen includes a touch area and a non-touch area, and at least one sensor is disposed in the non-touch area, and the method includes:
s101, when a user slides in the non-touch area, controlling the work of the sensor, acquiring sensing data detected by the sensor and recording corresponding time;
in this embodiment, the mobile terminal is described by taking a mobile phone as an example. The mobile phone may be a smart phone with an IOS or Android system, and is not limited herein. The mobile phone is a full-screen with a non-touch area, and comprises a touch area and the non-touch area, wherein the touch area can be an area with a capacitive touch unit, the non-touch area does not have the capacitive touch unit and does not have a touch response function, but at least one sensor is arranged in the non-touch area, and the sensor is a camera, a light sensor, a distance sensor and the like. When a user slides in the non-touch area, the sensor in the non-touch area is controlled to work, sensing data detected by the sensor is obtained, and corresponding time is recorded.
S102, determining the sliding direction of the user in the non-touch area according to the sensing data and the corresponding time;
the sliding direction of the user in the non-touch area can be judged according to the sensing data detected by the sensor and the corresponding time, and by taking the sensor as a camera as an example, the sliding direction of the user in the non-touch area can be obtained by caching a plurality of pictures generated by the user in the non-touch area.
And S103, executing corresponding sliding operation according to the sliding direction.
After the sliding direction of the user is acquired, the touch screen of the mobile phone can be controlled to execute corresponding sliding operation along the sliding direction, that is, sliding response in a non-touch area is realized, the sliding operation can be the sliding operation of the user in the touch area, that is, the finally realized sliding response is the same as the sliding response of the sliding operation of the user in the touch area, specifically, for an application environment in which the user watches a video by using the mobile phone for fast forwarding, if the user slides in the non-touch area, the fast forwarding of the video can also be realized; for an application environment in which a user browses a webpage by using a mobile phone, if the user slides in a non-touch area, the webpage can be moved; for the application environment that the user plays games by using the mobile phone, if the user slides in the non-touch area, corresponding control actions in the games can be realized.
In addition, it can be understood that, in the specific implementation, in addition to implementing the corresponding sliding operation according to the sliding direction, the response result may be pre-stored in the mobile terminal, where the response result includes starting some pre-stored application software, starting some pre-stored settings, and the like, and for example, after obtaining the sliding direction of the user, a specific chat interface or a dial interface may be opened, so as to further enrich the application range of the present invention and improve the interactivity.
According to the touch response method provided by the embodiment of the invention, when a user slides in the non-touch area, the sliding direction of the user sliding in the non-touch area can be determined by acquiring the sensing data detected by the sensor arranged in the non-touch area and the corresponding time, and finally, the corresponding sliding operation is executed according to the sliding direction, so that the touch sliding effect in the non-touch area can be realized, namely, the sliding response is realized when the non-touch area of the user slides, and the use experience of the user is improved.
Furthermore, as a specific example, in this embodiment, before step S101, the method may further include:
judging whether the mobile terminal is in a horizontal screen state or not;
and if the mobile terminal is in a horizontal screen state, controlling the work of the sensor when a user slides in the non-touch area, acquiring sensing data detected by the sensor and recording corresponding time.
Since many application environments requiring a non-touch area to have a sliding response are established when the mobile phone is in a landscape state, such as watching a video, playing a game, and the like, in order to reduce false triggering, whether the mobile phone is in the landscape state or not can be detected by a gravity sensor in the mobile phone, and the method provided by the embodiment is executed only when the mobile phone is in the landscape state, so that the practicability is improved.
Referring to fig. 2, a sliding response method according to a second embodiment of the present invention is applied to a mobile terminal having a touch screen, where the touch screen includes a touch area and a non-touch area, and at least one sensor is disposed in the non-touch area, and the method includes:
s201, receiving a touch operation firstly acting on the touch area;
in this embodiment, the mobile terminal is also described by taking a mobile phone as an example. The touch operation in this step is an operation that occurs in the touch area first, and in specific implementation, whether the touch operation applied to the touch area is received or not can be determined by a change in capacitance in the touch area.
S202, judging whether the touch operation direction faces the non-touch area;
referring to fig. 3, in the specific implementation, the following method may be adopted for determination:
s2021, obtaining a displacement vector of the touch operation in a coordinate system of the touch screen;
a coordinate system of the touch screen is shown in fig. 4, the coordinate system has a touch area and a non-touch area, and displacement vectors of a touch operation in the coordinate system are, for example, a vector a and a vector b.
S2022, judging whether an included angle between the displacement vector and a reference line is smaller than a preset angle, wherein the reference line is a coordinate axis which is overlapped with the boundary of the non-touch area more in the coordinate system;
in this embodiment, the coordinate system has two coordinate axes, i.e., an x axis and a y axis, and the x axis overlaps with the boundary of the non-touch area more than the two coordinate axes, so that the reference line is also the x axis, the angle between the vector a and the reference line is α, and the angle between the vector b and the reference line is β.
S2023, if the included angle is smaller than a preset angle, determining that the touch operation direction is toward the non-touch area.
If the angle α between the vector a and the reference line c is smaller than θ, and the angle β between the vector b and the reference line c is larger than θ, it can be determined that the direction of the touch operation corresponding to the vector a is toward the non-touch area, and the direction of the touch operation corresponding to the vector b is not toward the non-touch area.
S203, if the touch operation direction is towards the non-touch area, timing is started when a touch signal of the touch screen is lost, and in a preset time range, when a user slides in the non-touch area, the work of the sensor is controlled, sensing data detected by the sensor is obtained, and corresponding time is recorded;
if the touch operation direction is towards the non-touch area, timing is started when a touch signal of the touch screen is lost, that is, timing is started when a touch is made to an intersection of the non-touch area and the non-touch area, where a preset time range is 3s, for example, within 3s, when a user slides in the non-touch area, the camera is controlled to cache at least two images according to a time sequence, that is, the method in the first embodiment is started. Correspondingly, if the time exceeds 3s, the user still does not slide in the non-touch area, and the process is ended. In other embodiments, when the timing is started when the touch signal of the touch screen is lost, the sensor is controlled to be started to work correspondingly, so as to avoid energy consumption caused by long-time work of the sensor.
S204, determining the sliding direction of the user in the non-touch area according to the sensing data and the corresponding time;
and S205, executing corresponding sliding operation according to the sliding direction.
The method provided by the embodiment can judge the touch operation generated by the user in the touch area, and only when the touch operation is performed towards the non-touch area, the touch response is performed on the sliding in the non-touch area, so that the misoperation can be effectively eliminated, the practicability of the method is improved, the continuity of the touch response of the user when the user touches the touch screen of the mobile terminal can be ensured, and the use experience of the user is ensured.
It should be noted that the present embodiment focuses on differences from the previous embodiment, similar parts between the embodiments are not repeatedly described, and may refer to each other, and technical features between the embodiments may be selectively combined.
Referring to fig. 5, a sliding response method according to a third embodiment of the present invention is applied to a mobile terminal having a touch screen, where the touch screen includes a touch area and a non-touch area, and the non-touch area includes two sensors disposed therein, and the method includes:
s301, when a user slides in the non-touch area, controlling the work of a first sensor and a second sensor in the sensors, wherein the first sensor and the second sensor are located at different positions in the non-touch area;
in this embodiment, the mobile terminal is described by taking a mobile phone as an example. The mobile phone may be a smart phone with an IOS or Android system, and is not limited herein. Referring to fig. 6, the mobile phone includes a touch area 11 and a non-touch area 12, in some embodiments, the area of the non-touch area 12 is much smaller than the area of the touch area 11 to ensure that the mobile phone has a larger screen occupation ratio, and the non-touch area 12 may be specifically disposed in a "concave" semi-enclosed area beside the touch area 11, for example, in this embodiment, the non-touch area 12 is specifically disposed in a middle position of the top of the touch area 11, and in other embodiments, the non-touch area 12 may also be disposed in other positions of the top of the touch area 11 or in a middle position of the bottom of the touch area 11, and the like, which is not limited herein.
A first sensor 121 and a second sensor 122 are disposed in the non-touch area 12, and the first sensor 121 and the second sensor 122 are located at different positions in the non-touch area 12, wherein the first sensor 121 may be any one of a light sensor, a distance sensor and a camera, and correspondingly, the second sensor 122 may also be any one of a light sensor, a distance sensor and a camera. In this embodiment, the first sensor 121 is taken as a light sensor, and the second sensor 122 is specifically taken as a camera for illustration. When the user slides on the non-touch area 12, the first sensor 121 and the second sensor 122 are first controlled to be turned on.
S302, acquiring first sensing data detected by the first sensor and recording corresponding first time, and acquiring second sensing data detected by the second sensor and recording corresponding second time;
after the first sensor 121 and the second sensor 122 are turned on, sensing data and corresponding time detected by the first sensor 121 and the second sensor 122 can be acquired. For example, it is obtained that the first sensor 121 (i.e., the light sensor) detects that the light intensity is decreased from the first intensity when just turned on to the second intensity within the first time range, and then is increased from the second intensity to the third intensity, that is, the target object slides on the first sensor 121, so that the data detected by the first sensor 121 undergoes a strong-weak-strong change; subsequently, in a second time zone, the second sensor 122 (i.e., the camera) detects that the light intensity is decreased from the fourth intensity at the time of just turning on to the fifth intensity, and then is increased from the fifth intensity to the sixth intensity, that is, the light intensity data detected by the second sensor 121 also undergoes a strong-weak-strong change; wherein the first time range is earlier than the second time range.
In other embodiments, to further avoid the false detection, the light intensity variation of the second sensor may be detected simultaneously in the first time region, and the detection of the sensor data in the second time region is performed when the light intensity variation of the second sensor 122 is not large and the data detected by the first sensor 121 undergoes a strong-weak-strong variation. Alternatively, when the sensor data in the second time zone is detected, the step S303 may be executed only when the light intensity of the first sensor 121 does not change greatly and the data detected by the second sensor 122 undergoes a strong-weak-strong change. In other embodiments, when the first sensor 121 and the second sensor 122 are respectively other types of sensors, for example, the first sensor 121 is a camera and the second sensor is a light sensor, the above process may be also used, and the sensor data that changes first at the first time is detected, and then the sensor data that changes after the light intensity data is detected at the second time is detected, so as to perform the subsequent determination of the sliding direction.
S303, determining the sliding direction of the user sliding in the non-touch area according to the first sensing data, the first time, the second sensing data and the second time;
here, since the first sensor 121 first detects that the sensing data has changed from strong to weak to strong in the time sequence, it can be determined that the sliding direction of the user sliding on the non-touch area 12 is from the first sensor 121 to the second sensor 122.
And S304, executing corresponding sliding operation according to the sliding direction.
Since the sliding direction of the user is obtained in step S102, the touch screen of the mobile phone is controlled to execute a corresponding sliding operation along the sliding direction, that is, a sliding response is realized, where the sliding operation may be a sliding operation of a simulated user in the touch area 11, that is, the finally realized sliding response is the same as the sliding response of the sliding operation of the user in the touch area 11, specifically, for an application environment where the user watches a video using the mobile phone for fast forwarding, if the user slides in the non-touch area 12, the video can also be fast forwarded; for an application environment in which a user browses a webpage by using a mobile phone, if the user slides in the non-touch area 12, the webpage can be moved as well; for an application environment in which a user plays a game using a mobile phone, if the user slides in the non-touch area 12, a corresponding control action in the game can be realized.
According to the touch response method provided by the embodiment of the invention, when a user slides in the non-touch area, the change of the sensing data and the corresponding time are detected by the two sensors arranged at different positions in the non-touch area, the sliding direction of the user sliding in the non-touch area can be determined according to the time sequence, and finally the corresponding sliding operation is executed according to the sliding direction, so that the touch sliding effect in the non-touch area can be realized, namely, the sliding response is realized when the non-touch area of the user slides, and the use experience of the user is improved.
Referring to fig. 7, a sliding response method according to a fourth embodiment of the present invention is applied to a mobile terminal having a touch screen, where the touch screen includes a touch area and a non-touch area, and the method includes:
s401, when a user slides in the non-touch area, controlling the work of a first sensor and a second sensor in the sensors, wherein the first sensor and the second sensor are located at different positions in the non-touch area;
s402, acquiring first sensing data detected by the first sensor and recording corresponding first time, and acquiring second sensing data detected by the second sensor and recording corresponding second time;
in this embodiment, the first time is earlier than the second time, that is, in this embodiment, if the target object slides in the non-touch area, because the first time is earlier than the second time, the first sensor will detect the blockage of the target object first, and then the second sensor will detect the blockage of the target object, and through the determination of the time sequence of this embodiment, the occurrence of some non-sliding misoperation can be effectively avoided.
S403, judging whether the action generated by the sliding of the user in the non-touch area is effective sliding;
for convenience of description, the first sensor is taken as a light sensor, and the second sensor is taken as a distance sensor for example:
at a first time, acquiring the change of the brightness value detected by the light sensor and the corresponding brightness change time;
judging whether the change of the brightness value detected by the light sensor is greater than a second brightness threshold value or not and whether the brightness change time is less than a time threshold value or not;
wherein, the change of the brightness value detected by the light sensor is delta luma, and the corresponding brightness change time is delta T; further, the second luminance threshold value luma _ th and the time threshold value T _ th may be stored in the memory of the mobile terminal in advance, and then Δ luma and luma _ th may be compared, and Δ T and T _ th may be compared, respectively.
If the change of the brightness value detected by the light sensor is greater than the second brightness threshold value, and the brightness change time is less than the time threshold value, that is, Δ luma > luma _ th & Δ T < T _ th, it is determined as one effective occlusion.
Similarly, next to the second time, the displacement value of the target object detected by the distance sensor and the corresponding displacement change time are obtained;
the displacement value detected by the distance sensor is delta distance, and the corresponding brightness change time is delta T; further, the displacement threshold s _ th and the time threshold T _ th may be stored in the memory of the mobile terminal in advance, and then Δ distance and s _ th may be compared, and Δ T and T _ th may be compared, respectively.
Judging whether the displacement value is larger than a displacement threshold value or not and whether the displacement change time is smaller than a time threshold value or not;
and if the displacement value is larger than the displacement threshold value and the displacement change time is smaller than the time threshold value, namely delta distance > s _ th & delta T < T _ th, determining the effective occlusion as one time.
If the results judged by the first sensor (namely, the light sensor) and the second sensor (namely, the distance sensor) are both effective shielding, judging whether the action generated by the sliding of the user in the non-touch area is effective sliding;
it should be noted that, in this embodiment, the first sensor is taken as a light sensor, the second sensor is taken as a distance sensor for illustration, and for other combinations, for example, the first sensor is taken as a distance sensor, the second sensor is taken as a light sensor, or both the first sensor and the second sensor are taken as light sensors, or both the first sensor and the second sensor are taken as distance sensors, a person skilled in the art may perform transformation by combining the above determination methods, and if the results of the determination by the first sensor and the second sensor are both effective occlusion, it may be determined that the motion generated by the sliding of the user in the non-touch area is effective sliding. In addition, in the case where the non-touch area has three or more sensors, as long as the determination results of at least two sensors are effectively blocked, it is also possible to determine that the motion generated by the user sliding in the non-touch area is effective sliding.
S404, if the action is effective sliding, determining the sliding direction of the user in the non-touch area according to the first sensing data, the first time, the second sensing data and the second time;
and S405, executing corresponding sliding operation according to the sliding direction.
In the method provided in this embodiment, on the basis of the second embodiment, it is determined whether the motion generated by the user when sliding in the non-touch area is an effective sliding motion, and only when the motion is an effective sliding motion, the corresponding sliding response is performed, so that the accuracy can be improved, and the occurrence of false triggering can be avoided to the maximum extent.
It should be noted that the present embodiment focuses on differences from the previous embodiment, similar parts between the embodiments are not repeatedly described, and may refer to each other, and technical features between the embodiments may be selectively combined.
Referring to fig. 8, a sliding response method according to a fifth embodiment of the present invention is applied to a mobile terminal having a touch screen, where the touch screen includes a touch area and a non-touch area, and the non-touch area is provided with at least one sensor, and the method includes:
s501, when a user slides in the non-touch area, controlling the work of at least one camera in the sensor;
in this embodiment, the mobile terminal is described by taking a mobile phone as an example. The mobile phone may be a smart phone with an IOS or Android system, and is not limited herein. Referring to fig. 9, the mobile phone includes a touch area 11 and a non-touch area 12, and at least one camera 13 is disposed in the non-touch area 12. The area of the non-touch area 12 is much smaller than the area of the touch area 11 to ensure that the mobile phone has a larger screen area, and the non-touch area 12 may be specifically disposed in a semi-enclosed area of a "recess" beside the touch area 11, for example, in this embodiment, the non-touch area 12 is specifically disposed in a middle position of the top of the touch area 11, in other embodiments, the non-touch area 12 may also be disposed in other positions of the top or middle position of the bottom of the touch area 11, and the like, which is not limited herein.
In this embodiment, the non-touch area 12 includes a sensor, i.e., a camera 13, disposed therein. When the user slides in the non-touch area 12, the work of the camera 13 is controlled.
S502, controlling the camera to cache at least two images according to the time sequence;
in specific implementation, after step S501 and before step S502, the method may further include:
judging whether the brightness value detected by the camera is greater than a first brightness threshold value;
and if the brightness value is larger than a first brightness threshold value, controlling the camera to cache at least two images according to the time sequence. That is, only when the above conditions are satisfied, the camera 13 buffers at least two images according to the time sequence, so as to improve the accuracy and prevent the camera 13 from being in the working open state all the time. In addition, in some more specific embodiments, the above basis may be combined, and meanwhile, the judgment may be performed by combining that the touch area 11 does not detect any touch signal, specifically, if the brightness value detected by the camera is greater than the first brightness threshold value, and meanwhile, the touch area 11 does not detect any touch signal, the camera 13 may cache at least two images according to the time sequence, so as to further improve the accuracy.
In this embodiment, the camera 13, for example, caches three images a, b, and c in fig. 10, and a, b, and c are respectively arranged according to the time sequence.
S503, determining the sliding direction of the user in the non-touch area according to the image cached by the camera;
in this embodiment, in a specific implementation, an image recognition technology and an image comparison technology may be adopted, and a target object in each image is first extracted, and for three images a, b, and c in fig. 10 in this embodiment, a finger in each image is extracted, and then the fingers in the three images are compared, so that a moving direction of the finger is obtained, that is, the sliding direction of the user in the non-touch area 12 is determined.
And S504, executing corresponding sliding operation according to the sliding direction.
In step S503, the sliding direction of the user is obtained, so that the touch screen of the mobile phone is controlled to execute a corresponding sliding operation along the sliding direction, that is, a sliding response is realized, where the sliding operation may be a sliding operation that simulates the user in the touch area 11, that is, the finally realized sliding response is the same as the sliding response of the sliding operation of the user in the touch area 11, specifically, for an application environment in which the user watches a video using the mobile phone for fast forwarding, if the user slides in the non-touch area 12, the video can also be fast forwarded; for an application environment in which a user browses a webpage by using a mobile phone, if the user slides in the non-touch area 12, the webpage can be moved as well; for an application environment in which a user plays a game using a mobile phone, if the user slides in the non-touch area 12, a corresponding control action in the game can be realized.
According to the touch response method provided by the embodiment of the invention, when a user slides in the non-touch area, at least two images are cached by the camera arranged in the non-touch area according to the time sequence, the sliding direction of the touch operation acting on the non-touch area can be determined by the images cached by the camera, and finally the corresponding sliding operation is executed according to the sliding direction, so that the touch sliding effect in the non-touch area can be realized, namely, the sliding response is realized when the non-touch area of the user slides, and the use experience of the user is improved.
It should be noted that, in the embodiment, the case that one camera is disposed in the non-touch area is taken as an example for description, and for the case that two or more cameras are disposed in the non-touch area, or one camera and one other sensor (for example, a light sensor or a distance sensor) are disposed in the non-touch area, a person skilled in the art may combine the technical solutions in the above embodiments reasonably, and the present invention is not limited thereto.
Referring to fig. 11, a sliding response method according to a sixth embodiment of the present invention is applied to a mobile terminal having a touch screen, where the touch screen includes a touch area and a non-touch area, and the non-touch area is provided with at least one sensor, and the method includes:
s601, when a user slides in the non-touch area, controlling the work of at least one camera in the sensor;
s602, controlling the camera to cache at least two images according to the time sequence;
s603, judging whether the action generated by the sliding of the user in the non-touch area is effective sliding;
referring to fig. 12, the steps specifically include:
s6031, acquiring displacement information and corresponding speed information of the target object of two adjacent images in the at least two images;
wherein, the two adjacent images may be specifically two adjacent frame images. Still taking the three images in fig. 10 of the fourth embodiment as an example to illustrate the image cached by the camera in this embodiment, the target object in the image is a finger of the images a, b, and c, the displacement information of the finger in the image can be obtained by performing correlation operation on two adjacent frames of images, that is, performing correlation operation on a, b, and c, respectively, for example, the displacement information of the finger between the image a and the image b is Δ s1, the displacement information of the finger between the image b and the image c is Δ s2, and the corresponding speed information can be calculated according to the time difference of the three frames of images.
It should be noted that, since the user slides in the non-touch area, the finger is very close to the camera, in order to make the displacement information of the finger in the acquired image more accurate, before controlling the camera to perform caching, the frame rate and the photosensitive value (ISO) of the camera may be fixed in advance, where the frame rate refers to the number of photos taken in a unit time, and the frame rate is fixed, and the time interval of each frame is fixed; and the fixed photosensitive value can reduce the influence of high noise caused by high ISO on the contrast between the later images.
S6032, calculating the average speed of the speed information of all the two adjacent images;
here, the average speed Δ V ═ Σ Δ V.
S6033, judging whether the average speed is greater than a speed threshold value;
wherein the velocity threshold V _ th may be stored in the memory of the mobile terminal in advance, and then Δ V may be compared with V _ th.
S6034, if the average speed is greater than the speed threshold, determining that the motion is a valid slip.
Wherein if Δ V > V _ th, the action is determined to be an effective slip.
S604, if the action is effective sliding, determining a sliding direction corresponding to the touch operation according to the image cached by the camera;
and S605, executing corresponding sliding operation according to the sliding direction.
In the method provided by this embodiment, on the basis of the previous embodiment, it is determined whether the motion generated by the user when sliding in the non-touch area is an effective sliding motion, and only when the motion is an effective sliding motion, the corresponding sliding response is performed, so that the accuracy can be improved, and the occurrence of false triggering can be avoided to the maximum extent.
It should be noted that the present embodiment focuses on differences from the previous embodiment, and the same and similar parts between the embodiments are not described repeatedly, and may be referred to each other.
Referring to fig. 13, based on the same inventive concept, a sliding response apparatus according to a seventh embodiment of the present invention is applied to a mobile terminal having a touch screen, where the touch screen includes a touch area and a non-touch area, and the non-touch area is provided with at least one sensor, and the apparatus includes:
the control acquisition module 10 is configured to control the sensor to work when a user slides in the non-touch area, acquire sensing data detected by the sensor, and record corresponding time;
a direction determining module 20, configured to determine a sliding direction of the user sliding in the non-touch area according to the sensing data and the corresponding time;
and a sliding executing module 30, configured to execute a corresponding sliding operation according to the sliding direction.
According to the touch response device provided by the embodiment of the invention, when a user slides in the non-touch area, the sliding direction of the user sliding in the non-touch area can be determined by acquiring the sensing data detected by the sensor arranged in the non-touch area and the corresponding time, and finally, the corresponding sliding operation is executed according to the sliding direction, so that the touch sliding effect in the non-touch area can be realized, namely, the sliding response is realized when the non-touch area of the user slides, and the use experience of the user is improved.
Other technical features and technical effects of the sliding response device provided by the embodiment of the present invention are the same as those of the method provided by the first embodiment of the present invention, and are not described herein again.
Referring to fig. 14, based on the same inventive concept, a sliding response apparatus according to an eighth embodiment of the present invention is applied to a mobile terminal having a touch screen, where the touch screen includes a touch area and a non-touch area, and the non-touch area is provided with at least one sensor, and the apparatus includes:
a receiving module 10, configured to receive a touch operation that first acts on the touch area;
a determining module 20, configured to determine whether the touch operation direction is toward the non-touch area;
the timing control module 30 is configured to start timing when a touch signal of the touch screen is lost when the touch operation direction faces the non-touch area, and control the operation of the sensor to acquire sensing data detected by the sensor and record corresponding time when a user slides in the non-touch area within a preset time range;
a direction determining module 40, configured to determine a sliding direction of the user sliding in the non-touch area according to the sensing data and the corresponding time;
and a sliding executing module 50, configured to execute a corresponding sliding operation according to the sliding direction.
Other technical features and technical effects of the sliding response device provided in the embodiment of the present invention are the same as those of the method provided in the second embodiment of the present invention, and are not described herein again.
Referring to fig. 15, based on the same inventive concept, a sliding response apparatus according to a ninth embodiment of the present invention is applied to a mobile terminal having a touch screen, where the touch screen includes a touch area and a non-touch area, and the non-touch area is provided with a first sensor and a second sensor, and the apparatus includes:
the control acquisition module 10 is configured to control operations of a first sensor and a second sensor of the sensors when a user slides in the non-touch area, where the first sensor and the second sensor are located at different positions in the non-touch area;
the control acquisition module 10 is further configured to acquire first sensing data detected by the first sensor and record corresponding first time, and acquire second sensing data detected by the second sensor and record corresponding second time;
a direction determining module 30, configured to determine a sliding direction of the user sliding in the non-touch area according to the first sensing data, the first time, the second sensing data, and the second time;
and the sliding executing module 40 is configured to execute a corresponding sliding operation according to the sliding direction.
Other technical features and technical effects of the sliding response apparatus according to the embodiment of the present invention are the same as those of the method according to the third embodiment of the present invention, and are not described herein again.
Referring to fig. 16, based on the same inventive concept, a sliding response apparatus according to a tenth embodiment of the present invention is applied to a mobile terminal having a touch screen, where the touch screen includes a touch area and a non-touch area, and the non-touch area is provided with a first sensor and a second sensor, and the apparatus includes:
the control acquisition module 10 is configured to control operations of a first sensor and a second sensor of the sensors when a user slides in the non-touch area, where the first sensor and the second sensor are located at different positions in the non-touch area;
a control acquisition module 10, configured to acquire first sensing data detected by the first sensor and record corresponding first time, and acquire second sensing data detected by the second sensor and record corresponding second time;
a judging module 30, configured to judge whether an action generated by a user sliding in the non-touch area is an effective sliding;
a direction determining module 40, configured to determine, when the determination result of the determining module 30 is yes, a sliding direction of the user sliding in the non-touch area according to the first sensing data, the first time, the second sensing data, and the second time;
and a sliding executing module 50, configured to execute a corresponding sliding operation according to the sliding direction.
Other technical features and technical effects of the sliding response apparatus according to the embodiment of the present invention are the same as those of the method according to the fourth embodiment of the present invention, and are not described herein again.
Referring to fig. 17, based on the same inventive concept, a sliding response apparatus according to an eleventh embodiment of the present invention is applied to a mobile terminal having a touch screen, where the touch screen includes a touch area and a non-touch area, and the non-touch area is provided with at least one camera, and the apparatus includes:
the control acquisition module 10 is used for controlling the work of at least one camera in the sensor when a user slides in the non-touch area;
the cache module 20 is configured to control the camera to cache at least two images according to a time sequence;
a direction determining module 30, configured to determine, according to the image cached by the camera, a sliding direction in which the user slides in the non-touch area;
and the sliding executing module 40 is configured to execute a corresponding sliding operation according to the sliding direction.
Other technical features and technical effects of the sliding response apparatus according to the embodiment of the present invention are the same as those of the method according to the fifth embodiment of the present invention, and are not described herein again.
Referring to fig. 18, based on the same inventive concept, a sliding response apparatus according to a twelfth embodiment of the present invention is applied to a mobile terminal having a touch screen, where the touch screen includes a touch area and a non-touch area, and the non-touch area is provided with at least one camera, and the apparatus includes:
the control acquisition module 10 is configured to control the operation of at least one camera in the sensor when a user slides in the non-touch area;
the cache module 20 is configured to control the camera to cache at least two images according to a time sequence;
a judging module 30, configured to judge whether an action generated by a user sliding in the non-touch area is an effective sliding;
and a direction determining module 40, configured to determine, when the determination result of the determining module 30 is yes, a sliding direction corresponding to the touch operation according to the image cached by the camera.
And a sliding executing module 50, configured to execute a corresponding sliding operation according to the sliding direction.
Other technical features and technical effects of the sliding response apparatus according to the embodiment of the present invention are the same as those of the method according to the sixth embodiment of the present invention, and are not described herein again.
Furthermore, an embodiment of the present invention also proposes a readable storage medium, on which a computer program is stored, which when executed by a processor implements the steps of the above-mentioned method.
Furthermore, an embodiment of the present invention further provides a mobile terminal, which includes a touch screen, a memory, a processor, and a computer program stored on the memory and executable on the processor, and the processor implements the above method when executing the program.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
While embodiments of the invention have been shown and described, it will be understood by those of ordinary skill in the art that: various changes, modifications, substitutions and alterations can be made to the embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the claims and their equivalents.

Claims (28)

1. A touch response method is applied to a mobile terminal with a touch screen, wherein the touch screen comprises a touch area and a non-touch area, and the non-touch area is provided with at least one sensor, and the method is characterized by comprising the following steps:
when a user slides in the non-touch area, controlling the work of the sensor, acquiring sensing data detected by the sensor and recording corresponding time;
determining the sliding direction of the user sliding in the non-touch area according to the sensing data and the corresponding time;
executing corresponding sliding operation according to the sliding direction;
before the step of controlling the operation of the sensor, acquiring the sensing data detected by the sensor and recording the corresponding time, the method further comprises:
receiving touch operation acting on the touch area;
judging whether the touch operation direction faces the non-touch area;
if so, starting timing when the touch signal of the touch screen is lost, controlling the work of the sensor within a preset time range, acquiring the sensing data detected by the sensor and recording the corresponding time.
2. The touch-responsive method of claim 1, further comprising:
when a user slides in the non-touch area, controlling the work of at least one camera in the sensor;
controlling the camera to cache at least two images according to the time sequence;
determining the sliding direction of the user in the non-touch area according to the image cached by the camera;
and executing corresponding sliding operation according to the sliding direction.
3. The touch-responsive method of claim 2, further comprising:
judging whether the action generated by the sliding of the user in the non-touch area is effective sliding;
and if the action is effective sliding, determining the sliding direction corresponding to the touch operation according to the image cached by the camera.
4. The touch response method of claim 3, wherein the step of determining whether the action generated by the user sliding in the non-touch area is a valid sliding comprises:
acquiring displacement information and corresponding speed information of a target object of two adjacent images in the at least two images;
calculating the average speed of the speed information of all the two adjacent images;
judging whether the average speed is greater than a speed threshold value;
if the average speed is greater than the speed threshold, determining the action to be effective slip.
5. The touch response method according to claim 4, wherein the step of acquiring displacement information and corresponding velocity information of the target object of two adjacent images of the at least two images comprises:
and acquiring displacement information and corresponding speed information of the target object of two adjacent frames of images in the at least two images.
6. The touch response method according to claim 4, wherein before controlling the camera to buffer the at least two images in chronological order, the method comprises:
and fixing the frame rate and the photosensitive value of the camera.
7. The touch-responsive method of claim 1, further comprising:
when a user slides in the non-touch area, controlling the work of a first sensor and a second sensor in the sensors, wherein the first sensor and the second sensor are positioned at different positions in the non-touch area;
acquiring first sensing data detected by the first sensor and recording corresponding first time, and acquiring second sensing data detected by the second sensor and recording corresponding second time;
determining a sliding direction of a user sliding in the non-touch area according to the first sensing data, the first time, the second sensing data and the second time;
and executing corresponding sliding operation according to the sliding direction.
8. The touch response method according to claim 7, wherein the first sensor is any one of a light sensor, a distance sensor, and a camera, and the second sensor is any one of a light sensor, a distance sensor, and a camera.
9. The touch-responsive method of claim 7, further comprising:
judging whether the action generated by the sliding of the user in the non-touch area is effective sliding;
if the action is effective sliding, determining the sliding direction of the user sliding in the non-touch area according to the first sensing data, the first time, the second sensing data and the second time.
10. The touch response method of claim 9, wherein the first time is earlier than the second time, and the step of determining whether the action generated by the user sliding in the non-touch area is a valid sliding comprises:
judging whether the occlusion of the target object generated during the operation of the first sensor is effective occlusion according to the data detected by the first sensor at the first time;
judging whether the occlusion of the target object generated during the operation of the second sensor is effective occlusion according to the data detected by the second sensor at the second time;
if the two shelters are both effective shelters, the action generated by the sliding of the user in the non-touch area is judged to be effective sliding.
11. The touch response method of claim 10, wherein the first sensor is a light sensor, and the step of determining whether the occlusion of the object caused by the operation of the first sensor is a valid occlusion based on the data detected by the first sensor at the first time comprises:
acquiring the change of the brightness value detected by the light sensor and the corresponding brightness change time;
judging whether the change of the brightness value detected by the light sensor is greater than a second brightness threshold value or not and whether the brightness change time is less than a time threshold value or not;
and if the change of the brightness value detected by the light sensor is greater than the second brightness threshold value and the brightness change time is less than the time threshold value, judging that the occlusion generated by the user during the operation of the first sensor is effective occlusion.
12. The touch response method of claim 10, wherein the second sensor is a distance sensor, and the step of determining whether the occlusion generated by the user during the operation of the second sensor is a valid occlusion according to the data detected by the second sensor at the second time comprises:
acquiring a displacement value of a target object detected by the distance sensor and corresponding displacement change time;
judging whether the displacement value is larger than a displacement threshold value or not and whether the displacement change time is smaller than a time threshold value or not;
and if the displacement value is larger than the displacement threshold value and the displacement change time is smaller than the time threshold value, judging that the occlusion generated by the user during the operation of the second sensor is effective occlusion.
13. A touch response device is applied to a mobile terminal with a touch screen, wherein the touch screen comprises a touch area and a non-touch area, and the non-touch area is provided with at least one sensor, and the device is characterized by comprising:
the control acquisition module is used for controlling the work of the sensor when a user slides in the non-touch area, acquiring sensing data detected by the sensor and recording corresponding time; the direction determining module is used for determining the sliding direction of the user in the non-touch area according to the sensing data and the corresponding time;
the sliding execution module is used for executing corresponding sliding operation according to the sliding direction;
wherein the apparatus further comprises: the receiving module is used for receiving touch operation acting on the touch area; the judging module is used for judging whether the direction of the touch operation faces the non-touch area; and the timing control module is used for starting timing when a touch signal of the touch screen is lost when the touch operation direction faces the non-touch area, controlling the work of the sensor when a user slides in the non-touch area within a preset time range, acquiring the sensing data detected by the sensor and recording the corresponding time.
14. The touch-responsive apparatus of claim 13, wherein the apparatus further comprises:
the control module is used for controlling the work of at least one camera in the sensor when a user slides in the non-touch area;
the cache module is used for controlling the camera to cache at least two images according to the time sequence;
the direction determining module is used for determining the sliding direction of the user in the non-touch area according to the image cached by the camera.
15. The touch-responsive device of claim 14,
the judging module is also used for judging whether the action generated by the sliding of the user in the non-touch area is effective sliding;
and the direction determining module is used for determining the sliding direction corresponding to the touch operation according to the image cached by the camera when the action is effective sliding.
16. The touch-responsive device of claim 15, wherein the determining module is configured to:
acquiring displacement information and corresponding speed information of a target object of two adjacent images in the at least two images;
calculating the average speed of the speed information of all the two adjacent images;
judging whether the average speed is greater than a speed threshold value;
if the average speed is greater than the speed threshold, determining the action to be effective slip.
17. The touch-responsive device of claim 13,
the control acquisition module is used for controlling the work of a first sensor and a second sensor in the sensors when a user slides in the non-touch area, and the first sensor and the second sensor are positioned at different positions in the non-touch area; the control acquisition module is further used for acquiring first sensing data detected by the first sensor and recording corresponding first time, and acquiring second sensing data detected by the second sensor and recording corresponding second time;
the direction determining module is used for determining the sliding direction of the user sliding in the non-touch area according to the first sensing data, the first time, the second sensing data and the second time;
and the sliding execution module is used for executing corresponding sliding operation according to the sliding direction.
18. The touch-responsive device of claim 17,
the judging module is used for judging whether the action generated by the sliding of the user in the non-touch area is effective sliding;
the direction determining module is configured to determine a sliding direction of the user sliding in the non-touch area according to the first sensing data, the first time, the second sensing data, and the second time if the motion is effective sliding.
19. The touch response device of claim 16, wherein the determination module is specifically configured to:
and acquiring displacement information and corresponding speed information of the target object of two adjacent frames of images in the at least two images.
20. The touch-responsive device of claim 16, wherein the frame rate and exposure values of the camera are fixed before the buffer module buffers the at least two images.
21. The touch-responsive device of claim 13,
the control acquisition module is used for acquiring first sensing data detected by a first sensor and recording corresponding first time, and acquiring second sensing data detected by a second sensor and recording corresponding second time;
the direction determining module is used for determining the sliding direction of the user sliding in the non-touch area according to the first sensing data, the first time, the second sensing data and the second time;
the sliding execution module is used for executing corresponding sliding operation according to the sliding direction.
22. The touch-responsive device of claim 17 or 21, wherein the first sensor is any one of a light sensor, a distance sensor, and a camera, and the second sensor is any one of a light sensor, a distance sensor, and a camera.
23. The touch-responsive device of claim 21,
the direction determining module is used for determining the sliding direction of the user sliding in the non-touch area according to the first sensing data, the first time, the second sensing data and the second time.
24. The touch-responsive device of claim 17 or 21, wherein the first time is earlier than the second time, and wherein the determining module is configured to:
judging whether the occlusion of the target object generated during the operation of the first sensor is effective occlusion according to first sensing data detected by the first sensor at the first time;
judging whether the occlusion generated by the target object in the operation of the second sensor is effective occlusion according to second sensing data detected by the second sensor at the second time;
if the two shelters are both effective shelters, the action generated by the sliding of the user in the non-touch area is judged to be effective sliding.
25. The touch-responsive device of claim 22, wherein the determining module is configured to:
acquiring the change of the brightness value detected by the light sensor and the corresponding brightness change time;
judging whether the change of the brightness value detected by the light sensor is greater than a second brightness threshold value or not and whether the brightness change time is less than a time threshold value or not;
and if the change of the brightness value detected by the light sensor is greater than the second brightness threshold value and the brightness change time is less than the time threshold value, judging that the occlusion generated by the user during the operation of the first sensor is effective occlusion.
26. The touch-responsive device of claim 22, wherein the second sensor is a distance sensor, and wherein the determining module is configured to:
acquiring a displacement value of a target object detected by the distance sensor and corresponding displacement change time;
judging whether the displacement value is larger than a displacement threshold value or not and whether the displacement change time is smaller than a time threshold value or not;
and if the displacement value is larger than the displacement threshold value and the displacement change time is smaller than the time threshold value, judging that the occlusion generated by the user during the operation of the second sensor is effective occlusion.
27. A readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-12.
28. A mobile terminal comprising a touch screen, a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the method according to any of claims 1 to 12 when executing the program.
CN201810074499.9A 2018-01-25 2018-01-25 Touch response method and device, readable storage medium and mobile terminal Active CN108390961B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810074499.9A CN108390961B (en) 2018-01-25 2018-01-25 Touch response method and device, readable storage medium and mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810074499.9A CN108390961B (en) 2018-01-25 2018-01-25 Touch response method and device, readable storage medium and mobile terminal

Publications (2)

Publication Number Publication Date
CN108390961A CN108390961A (en) 2018-08-10
CN108390961B true CN108390961B (en) 2020-06-26

Family

ID=63076467

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810074499.9A Active CN108390961B (en) 2018-01-25 2018-01-25 Touch response method and device, readable storage medium and mobile terminal

Country Status (1)

Country Link
CN (1) CN108390961B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110825254B (en) * 2018-08-13 2021-12-07 中兴通讯股份有限公司 Touch device and interaction method thereof
CN109358765A (en) * 2018-08-20 2019-02-19 中兴通讯股份有限公司 Terminal, the method, apparatus and storage medium for executing operation at the terminal
CN109117240A (en) * 2018-09-25 2019-01-01 维沃移动通信有限公司 A kind of method of controlling operation thereof and mobile terminal
CN112579416B (en) * 2020-12-11 2023-01-31 广州品唯软件有限公司 Page loading duration statistical method, terminal and readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101729669A (en) * 2008-10-15 2010-06-09 Lg电子株式会社 Portable terminal and method for controlling output thereof
CN103109249A (en) * 2010-09-06 2013-05-15 三星电子株式会社 Method of operating mobile device by recognizing user's gesture and mobile device using the method
CN103348311A (en) * 2010-10-01 2013-10-09 Flex Electronics ID Co.,Ltd. Long drag gesture in user interface
US8643628B1 (en) * 2012-10-14 2014-02-04 Neonode Inc. Light-based proximity detection system and user interface
CN103780761A (en) * 2014-01-23 2014-05-07 深圳市欧珀通信软件有限公司 Infrared equipment control method and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101729669A (en) * 2008-10-15 2010-06-09 Lg电子株式会社 Portable terminal and method for controlling output thereof
CN103109249A (en) * 2010-09-06 2013-05-15 三星电子株式会社 Method of operating mobile device by recognizing user's gesture and mobile device using the method
CN103348311A (en) * 2010-10-01 2013-10-09 Flex Electronics ID Co.,Ltd. Long drag gesture in user interface
US8643628B1 (en) * 2012-10-14 2014-02-04 Neonode Inc. Light-based proximity detection system and user interface
CN103780761A (en) * 2014-01-23 2014-05-07 深圳市欧珀通信软件有限公司 Infrared equipment control method and device

Also Published As

Publication number Publication date
CN108390961A (en) 2018-08-10

Similar Documents

Publication Publication Date Title
US20230280793A1 (en) Adaptive enclosure for a mobile computing device
CN108390961B (en) Touch response method and device, readable storage medium and mobile terminal
CN107493495B (en) Interactive position determining method, system, storage medium and intelligent terminal
US10788978B2 (en) Method and apparatus for displaying interface and storage medium
KR102121592B1 (en) Method and apparatus for protecting eyesight
CN105898143B (en) A kind of grasp shoot method and mobile terminal of moving object
WO2017124773A1 (en) Gesture recognition method and device
US20170192500A1 (en) Method and electronic device for controlling terminal according to eye action
US9912853B2 (en) Switching between cameras of an electronic device
US10212386B2 (en) Method, device, terminal device, and storage medium for video effect processing
KR102488747B1 (en) Video recording method and electronic device
WO2021103737A1 (en) Photographing method and electronic device
KR20100122383A (en) Method and apparatus for display speed improvement of image
CN111083417B (en) Image processing method and related product
TW200941313A (en) Apparatus and methods for a touch user interface using an image sensor
US9535604B2 (en) Display device, method for controlling display, and recording medium
CN104902186A (en) Method for fast starting camera program and mobile terminal using the method
CN111050109B (en) Electronic equipment control method and electronic equipment
CN111385415B (en) Shooting method and electronic equipment
CN110769174B (en) Video viewing method and electronic equipment
WO2020113901A1 (en) Shooting control method and apparatus in soccer game, and computer device and storage medium
EP4231625A1 (en) Photographing method and apparatus, and electronic device
CN113873151A (en) Video recording method and device and electronic equipment
CN111918099A (en) Video processing method and device, electronic equipment and storage medium
CN109361864B (en) Shooting parameter setting method and terminal equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant