WO2017096958A1 - Human-computer interaction method, apparatus, and mobile device - Google Patents

Abstract

The present application relates to a human-computer interaction method, apparatus, and mobile device. The human-computer interaction method comprises: receiving sense information of a mobile device with respect to a user movement, said sense information comprising touch sense information generated by a touch sensor located on the edge of said mobile device; analyzing said sense information to learn the current hand-gesture movement of the user; in the stored correlation between usage context and hand-gesture movement, searching for a usage context matching said current hand-gesture movement; providing a service corresponding to the found usage context. In the present application, it is possible to "understand" the intention of a user's operation and quickly and accurately provide a response, such that the mobile device is more intelligent and more human-like, improving user experience.

Description

Human-computer interaction method and device, mobile device

Cross-reference to related applications

The present application claims priority to Chinese Patent Application No. 201510920862.0, entitled "Human Machine Interaction Method and Apparatus, Mobile Device", filed on December 11, 2015, the entire contents of which are incorporated herein by reference. In the application.

Technical field

The present application relates to the field of communications, and in particular, to a human-computer interaction method and device, and a mobile device.

Background technique

Mobile devices such as mobile phones and tablets play an important role in people's daily lives. In particular, mobile phones, as the main means of people's long-distance communication, are almost indispensable personal items for everyone. With the continuous development of mobile phone technology, the human-computer interaction of mobile phones has become more and more intelligent. From the initial buttons to the current touch screen, engineers have been working to make machine interaction more convenient and more user-friendly.

In a related art, human-computer interaction is realized by a user operating a touch screen. The way to interact is to provide some operation portals (such as drawing a button or icon) on the interface through a software program. The user can "understand" the user's intention by clicking the corresponding icon or position on the touch screen. Thereby achieving the purpose of human-computer interaction. In this kind of human-computer interaction mode, the steps that the user needs to open the camera to capture are: pull out the phone; press the power button; pull up or pull down to find the camera icon; click the camera icon to start the camera; Scenes. Although the touch screen has considerable convenience, it also has the following defects: due to different operation interfaces provided by different interfaces, the operation entrance is difficult to find; it is prone to false touch; the finger blocks the screen during operation, affecting the line of sight; The screen of the control screen is getting bigger and bigger. When one-handed operation, the finger leaves the frame of the mobile phone, and the process of moving to the screen of the mobile phone is likely to cause the mobile phone to fall.

In another related art, voice recognition technology is used to acquire a user's instruction, and then the machine is used. The user's instructions act. The drawback of this method is that the correct recognition rate of speech recognition is low due to the strange accent of the user; the algorithm is complicated, the software development cost is high, and the processor overhead is large.

Summary of the invention

The purpose of the application is to provide a human-computer interaction method and device, and a mobile device, which improve the intelligence of the mobile device and improve the user experience.

To achieve the above objective, the embodiment of the present application provides a human-computer interaction method, including:

Receiving, by the mobile device, sensing information of a user action, where the sensing information includes touch sensing information generated by a touch sensor located at a border of the mobile device;

Analyzing the sensing information to obtain a current gesture action of the user;

Searching for a usage scenario that matches the current gesture action from a correspondence between the saved usage scenario and the gesture action;

Provide the service corresponding to the found usage scenario.

Further, the above method includes:

When the usage scenario matching the current gesture action is not found in the corresponding relationship between the saved usage scenario and the gesture action, the usage scenario actively activated by the user under the current gesture action is recorded;

Binding the actively enabled usage scenario to the current gesture action into a set of correspondences, added to the corresponding relationship between the usage scenario and the gesture action.

Further, the sensing information includes any one or more of rotational angular velocity information, distance information, and fingerprint information, and the touch sensing information includes finger coordinate information and/or pressure information.

Further, the mobile device is a mobile phone.

The human-computer interaction method of the embodiment of the present application can actively "understand" the user's operation intention, give a quick and accurate response, make the mobile device smarter and more human, and improve the user experience.

To achieve the above objective, the embodiment of the present application further provides a human-machine interaction device, including:

a receiving module, configured to receive, by the mobile device, sensing information of a user action, where the sensing information includes touch sensing information generated by a touch sensor located at a border of the mobile device;

An analysis module, configured to analyze the sensing information received by the receiving module, and obtain a current gesture of the user action;

a matching module, configured to search for a usage scenario that matches a current gesture action learned by the analysis module from a correspondence between the saved usage scenario and the gesture action;

The service module is configured to provide a service corresponding to the usage scenario found by the matching module.

Further, the above device comprises:

a recording module, configured to record a usage scenario actively activated by the user under the current gesture action when a usage scenario matching the current gesture action is not found in the corresponding relationship between the saved usage scenario and the gesture action;

The adding module is configured to bind the actively enabled usage scenario and the current gesture action into a set of correspondences, and add to the corresponding relationship between the usage scenario and the gesture action.

Further, the sensing information includes any one or more of rotational angular velocity information, distance information, and fingerprint information, and the touch sensing information includes finger coordinate information and/or pressure information.

Further, the mobile device is a mobile phone.

The human-machine interaction device of the embodiment of the present application can actively "understand" the user's operation intention, give a quick and accurate response, make the mobile device smarter and more human, and improve the user experience.

In order to achieve the above object, an embodiment of the present application further provides a mobile device, including a touch sensor located on a border of the mobile device, and the human-machine interaction device according to any one of the preceding items, wherein:

The touch sensor is configured to sense a touch of a user, generate touch sensing information, and send the touch sensing information to the human-machine interaction device;

The human-machine interaction device is configured to receive sensing information of the mobile device on the user action, and provide a corresponding service according to the sensing information, where the sensing information includes the touch sensing information.

Further, the mobile device is a mobile phone.

To achieve the above objective, an embodiment of the present application further provides an electronic device, including:

At least one processor; and,

a memory communicatively coupled to the at least one processor; wherein

The memory stores instructions executable by the one processor, the instructions being Executing by a processor to enable the at least one processor to:

Receiving sensing information of the electronic device on the user action, where the sensing information includes touch sensing information generated by a touch sensor located on the border of the electronic device;

Analyzing the sensing information to obtain a current gesture action of the user;

Searching for a usage scenario that matches the current gesture action from a correspondence between the saved usage scenario and the gesture action;

Provide the service corresponding to the found usage scenario.

To achieve the above objective, the embodiment of the present application further provides a non-volatile computer storage medium storing computer executable instructions, and the computer executable instructions are set as:

Receiving sensing information of the electronic device on the user action, where the sensing information includes touch sensing information generated by a touch sensor located on the border of the electronic device;

Analyzing the sensing information to obtain a current gesture action of the user;

Searching for a usage scenario that matches the current gesture action from a correspondence between the saved usage scenario and the gesture action;

Provide the service corresponding to the found usage scenario.

To achieve the above object, an embodiment of the present application further provides a computer program product, the computer program product comprising a computing program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions When the program instructions are executed by a computer, the computer is caused to execute the human-computer interaction method described in any of the above embodiments.

The mobile device in the embodiment of the present application can actively "understand" the user's operation intention, give a quick and accurate response, make the mobile device smarter and more human, and improve the user experience.

DRAWINGS

The one or more embodiments are exemplified by the accompanying drawings in the accompanying drawings, and FIG. The figures in the drawings do not constitute a scale limitation unless otherwise stated.

1 is a flowchart of a human-computer interaction method in Embodiment 1 of the present application;

2 is a flowchart of a human-computer interaction method in Embodiment 2 of the present application;

3 is a structural block diagram of a human-machine interaction device in Embodiment 3 of the present application;

4 is a structural block diagram of a human-machine interaction device in Embodiment 4 of the present application;

5 is a structural block diagram of a mobile device according to Embodiment 5 of the present application;

FIG. 6 is a structural block diagram of an electronic device according to Embodiment 6 of the present application.

detailed description

The principles and features of the present application are described in the following with reference to the accompanying drawings, which are only used to explain the present application and are not intended to limit the scope of the application. All the embodiments obtained according to the spirit of the present application are within the protection scope of the present application without any creative work.

FIG. 1 is a flowchart of a human-computer interaction method in Embodiment 1 of the present application. As shown in FIG. 1 , in this embodiment, the human-computer interaction method may include the following steps:

Step S101: Receive sensing information of a mobile device on a user action, where the sensing information includes touch sensing information generated by a touch sensor located on a border of the mobile device;

It should be noted that the user here refers to the user of the mobile device, that is, the mobile device user.

The mobile device may be a mobile phone or other smart device that can be operated by one hand. The mobile device is provided with a gyroscope, a fingerprint sensor, a distance sensor, and a touch sensor located on the border of the mobile device.

The sensing information may include any one or more of rotational angular velocity information, distance information, fingerprint information, and the like, and the touch sensing information may include one or both of finger coordinate information and pressure information. Wherein, the rotational angular velocity information is generated by the gyroscope, the fingerprint information is generated by the fingerprint sensor, and the distance information is generated by the distance sensor.

Touch-sensing information is generated by a touch sensor located on the border of the mobile device. A touch sensor can be placed on all four borders of the mobile device. The touch sensor can sense the touch of the user's finger, generate finger coordinate information, pressure information, and the like.

Based on information generated by the touch sensor and other sensing information of the mobile device on the user's motion, To analyze the user's current gestures.

Step S102, analyzing the sensing information received in step S101, and knowing the current gesture action of the user;

Each gesture action of the user usually corresponds to some relatively fixed sensing information generated by the mobile device. For example, when the user walks with the mobile phone with one hand, the frame of the mobile phone generates finger coordinate information (generated by the touch sensor located on the border of the mobile phone), and the gyro in the mobile phone senses the swing of the mobile phone due to the shaking of the mobile phone while walking, thereby generating rotation. Angular velocity information. Therefore, if the received sensing information is "rotation angular velocity information + finger coordinate information", then it can be known that the corresponding user gesture action is to walk with the mobile phone with one hand.

Step S103: Searching for a usage scenario that matches the current gesture action from the corresponding relationship between the saved usage scenario and the gesture action;

The correspondence between the usage scene and the gesture action is preset in the mobile device. For example, the above example of the user walking with the mobile phone with one hand is taken as an example. In the correspondence between the preset use scene and the gesture action in the mobile phone, the use scene corresponding to the gesture action with one hand holding the mobile phone is walking.

Step S104, providing a service corresponding to the found usage scenario.

For example, if the service corresponding to the scene "walking" is used, the mobile phone is put into deep sleep. Therefore, when the found usage scene is walking, the application automatically causes the mobile phone to enter deep sleep to reduce the power consumption of the mobile phone, without requiring the user to manually set the mobile phone to enter deep sleep.

The human-computer interaction method of the present application is further described in detail below through specific application examples.

Example one

When the user takes the mobile phone with two hands, the sensing information received by the mobile phone includes the finger coordinate information generated by the mobile phone frame, the pressure information, and the distance information generated by the distance sensor in the mobile phone (the mobile phone is blocked from no cover) and the fingerprint sensor generates Fingerprint information;

By analyzing the above sensing information, it is known that the user's current gesture action is to take the mobile phone with two hands;

From the corresponding relationship between the saved use scene and the gesture action, the use scene matching the gesture action of the two hand-held mobile phones is captured;

The service corresponding to the capture is to turn on the camera. Therefore, after finding the usage scene as a snapshot, the camera is automatically turned on, so that the mobile phone is in a state capable of capturing.

It can be seen that, through the human-computer interaction method of the present application, the user only needs to make two actions of holding the mobile phone, and can automatically switch to the camera mode, without the need to find the camera icon and click the camera icon to open the camera function. It simplifies the user's operation and improves the user experience. This is due to the fact that the human-computer interaction method of the present application can actively "understand" the characteristics of the user's intention.

Example two

When the user slides up and down the border of the mobile phone with the thumb, receiving pressure information (generated by the touch sensor), finger acceleration information (generated by the gyroscope), finger fingerprint information (generated by the fingerprint sensor) from the frame of the mobile phone;

By analyzing the touch sensing information, it is learned that the current gesture motion of the user is that the thumb slides up and down the border of the mobile phone;

From the corresponding relationship between the saved use scene and the gesture action, searching for the use scene matching the gesture of the thumb sliding up and down the border of the mobile phone is browsing the content on the screen of the mobile phone;

Provides the service corresponding to the function of browsing the content on the screen of the mobile phone, that is, scrolling up and down according to the thumb on the border of the mobile phone to scroll the content on the screen of the mobile phone.

In this example, the user can scroll the content on the screen of the mobile phone without scrolling the finger to the screen, thereby avoiding the inconvenience caused by the finger blocking the screen.

The human-computer interaction method of the embodiment of the present application can actively "understand" the user's operation intention, quickly and accurately give a response, and quickly switch the mobile device to the user's desired use scene mode, so that the mobile device is more human and more intelligent. Moreover, in the human-computer interaction method of the embodiment of the present application, many operations that can only be performed on the touch screen or the physical button can be completed on the border of the mobile device without blocking the screen, and the finger does not need to be moved a lot. Can greatly enhance the user experience.

FIG. 2 is a flowchart of a human-computer interaction method in Embodiment 2 of the present application. As shown in FIG. 2, in this embodiment, the human-computer interaction method may include the following steps:

Step S201: Receive sensing information of a mobile device on a user action, where the sensing information includes touch sensing information generated by a touch sensor located on a border of the mobile device;

Step S202, analyzing the sensing information to obtain the current gesture action of the user;

Step S203, determining whether there is a usage scenario that matches the current gesture action in the corresponding relationship between the saved usage scenario and the gesture action, if yes, executing step 204, otherwise performing step 206;

Step S204: Searching for a usage scenario that matches the current gesture action from the corresponding relationship between the saved usage scenario and the gesture action;

Step S205, providing a service corresponding to the found usage scenario, and ending;

Step S206, recording a usage scenario that the user actively activates under the current gesture action;

Step S207: Bind the actively activated usage scenario and the current gesture action into a set of correspondences, add to the corresponding relationship between the usage scenario and the gesture action, and end.

In step S207, the user's custom gesture and the use scenario enabled in the custom gesture can be recorded. When the user makes the custom gesture, the mobile phone can automatically start the corresponding use scenario without using the user initiative. To start the usage scenario.

The human-computer interaction method of the embodiment of the present application can actively "understand" the user's operation intention, quickly and accurately give a response, and quickly switch the mobile device to the user's desired use scene mode, so that the mobile device is more human and more Smart; many current operations that can only be done on the touch screen or physical buttons can be done on the border of the mobile device without blocking the screen, and do not need to move the finger a lot, which can greatly enhance the user experience. Moreover, the human-computer interaction method in the embodiment of the present application can establish a correspondence between the user's custom gesture and the usage scenario, so that the next time the user uses the gesture according to the user's habit, the user can switch to the corresponding usage scene mode to implement the personality that conforms to the user's personal habits. Operation to improve user satisfaction.

FIG. 3 is a structural block diagram of a human-machine interaction apparatus according to Embodiment 3 of the present application. The human-machine interaction device of the embodiment shown in FIG. 3 can be used to implement the human-computer interaction method of the embodiment shown in FIG. 1.

As shown in FIG. 3, in this embodiment, the human-machine interaction apparatus 300 can include a receiving module 310, an analysis module 320, a matching module 330, and a service module 340. The receiving module 310 is configured to receive sensing information of the mobile device on the user action, where the sensing information includes touch sensing information generated by a touch sensor located on the border of the mobile device. The analysis module 320 is configured to analyze the sensing information received by the receiving module 310 to learn the current gesture action of the user. The matching module 330 is configured to search for a usage scenario that matches the current gesture action learned by the analysis module 320 from the corresponding relationship between the saved usage scenario and the gesture action. The service module 340 is configured to provide a service corresponding to the usage scenario found by the matching module 330.

The mobile device may be a mobile phone or other smart device that can be operated by one hand.

The sensing information may include any one or more of rotational angular velocity information, distance information, fingerprint information, and the like, and the touch sensing information may include one of finger coordinate information and pressure information. Or all.

The human-machine interaction device of the embodiment of the present application can actively "understand" the user's operation intention, give a quick and accurate response, and quickly switch the mobile device to the user-used use scene mode, so that the mobile device is more human and more intelligent. Moreover, in the human-computer interaction method of the embodiment of the present application, many operations that can only be performed on the touch screen or the physical button can be completed on the border of the mobile device without blocking the screen, and the finger does not need to be moved a lot. Can greatly enhance the user experience.

4 is a structural block diagram of a human-machine interaction device in Embodiment 4 of the present application. The human-machine interaction device of the embodiment shown in FIG. 4 can be used to implement the human-computer interaction method of the embodiment shown in FIG. 2.

As shown in FIG. 4, in this embodiment, the human-machine interaction apparatus 300 may include a receiving module 310, an analysis module 320, a matching module 330, a service module 340, a recording module 350, and an adding module 360. The functions of the receiving module 310, the analyzing module 320, the matching module 330, and the service module 340 are the same as those of the corresponding modules in the foregoing embodiment shown in FIG. 3, and details are not described herein again. The recording module 350 is configured to record a usage scenario that is actively activated by the user under the current gesture action when the usage scenario that matches the current gesture action learned by the analysis module 320 is not found in the corresponding relationship between the saved usage scenario and the gesture action. The adding module 360 is configured to bind the user-activated usage scenario recorded by the recording module 350 to the current gesture action into a set of correspondences, and add to the corresponding relationship between the usage scenario and the gesture action.

The sensing information may include any one or more of rotational angular velocity information, distance information, fingerprint information, and the like, and the touch sensing information may include one or both of finger coordinate information and pressure information.

The mobile device may be a mobile phone or other smart device that can be operated by one hand.

The human-machine interaction device of the embodiment of the present application can actively "understand" the user's operation intention, quickly and accurately give a response, and quickly switch the mobile device to the user-used use scene mode, so that the mobile device is more human and more Smart; many current operations that can only be done on the touch screen or physical buttons can be done on the border of the mobile device without blocking the screen, and do not need to move the finger a lot, which can greatly enhance the user experience. Moreover, the human-machine interaction device of the embodiment of the present application can establish a correspondence relationship between the user's custom gesture and the usage scenario, so that the user can switch to the corresponding usage scene mode according to the user's customary gesture at the next use, thereby realizing the personality conforming to the user's personal habits. Operation to improve user satisfaction.

FIG. 5 is a structural block diagram of a mobile device according to Embodiment 5 of the present application. As shown in FIG. 5, in this embodiment, the mobile device 500 includes a touch sensor 400 and a human-machine interaction device 300 located at a border of the mobile device. The human-machine interaction device 300 can be any one of the foregoing embodiments of the present application. The touch sensor 400 is configured to sense a user's touch, generate touch sensing information, and transmit the touch sensing information to the human interaction device 300. The human-machine interaction device 300 is configured to receive sensing information of the mobile device for the user action, and provide a corresponding service according to the sensing information, where the sensing information includes touch sensing information generated by the touch sensor 400.

More specifically, the human-machine interaction device 300 can be configured to receive touch sensing information of a mobile device frame, wherein the touch sensing information is generated by the touch sensor 400 located at the border of the mobile device; analyzing the received touch sensing information to know the current gesture of the user An action; searching for a usage scenario that matches the current gesture action from the corresponding relationship between the saved usage scenario and the gesture action; providing a service corresponding to the found usage scenario.

The mobile device can be a mobile phone or other smart device that can be operated by one hand.

The mobile device of the embodiment of the present application can actively "understand" the user's operation intention, quickly and accurately give a response, and quickly switch the mobile device to the user's desired use scene mode, so that the mobile device is more human and smarter. Moreover, in the mobile device of the embodiment of the present application, many operations that can only be performed on the touch screen or the physical button can be completed on the border of the mobile device, and the screen is not blocked, and the finger does not need to be moved a lot, thereby being able to greatly Improve the user experience.

FIG. 6 is a structural block diagram of an electronic device according to Embodiment 6 of the present application. As shown in FIG. 6, the electronic device 600 includes:

One or more processors 610 and memory 620, one processor 610 is taken as an example in FIG.

The electronic device 600 executing the human-computer interaction method may further include: a touch sensor 400.

The processor 610, the memory 620, and the touch sensor 400 may be connected by a bus or other means, as exemplified by a bus connection in FIG.

The memory 620 is a non-volatile computer readable storage medium, and can be used for storing a non-volatile software program, a non-volatile computer executable program, and a module, such as a program corresponding to the human-computer interaction method in the embodiment of the present application. The instruction/module (for example, the receiving module 310 of the human-machine interaction device 300 shown in FIG. 3, the analysis module 320, the matching module 330, and the service module 340; and the receiving module 310 of the human-machine interaction device 300 shown in FIG. 4, analyzes Module 320, matching module 330, service module 340, recording module 350, and adding module 360). The processor 610 runs the non-stored memory 620 Volatile software programs, instructions, and modules, thereby performing various functional applications and data processing of the electronic device 600, that is, implementing the human-computer interaction method of the above-described method embodiments and the functions of the various modules of the above-described device embodiments.

Memory 620 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, memory 620 can optionally include memory remotely located relative to processor 610, which can be coupled to processor 610 via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The touch sensor 400 is configured to sense a user's touch, generate touch sensing information, and send the touch sensing information to the processor 610.

The program instructions/modules are stored in the memory 620, and when executed by the one or more processors 610, the human-computer interaction method in any of the above method embodiments may be performed, for example, performing the above described FIG. The method steps S101 to S104 in the method, and the method steps S201 to S207 in FIG. 2; the functions of the modules 310-340 in FIG. 3 and the modules 310-360 in FIG. 4 can also be implemented.

The electronic device 600 of the embodiment of the present application exists in various forms, including but not limited to:

(1) Mobile communication devices: These devices are characterized by mobile communication functions and are mainly aimed at providing voice and data communication. Such terminals include: smart phones (such as iPhone), multimedia phones, functional phones, and low-end phones.

(2) Ultra-mobile personal computer equipment: This type of equipment belongs to the category of personal computers, has computing and processing functions, and generally has mobile Internet access. Such terminals include: PDAs, MIDs, and UMPC devices, such as the iPad.

(3) Portable entertainment devices: These devices can display and play multimedia content. Such devices include: audio, video players (such as iPod), handheld game consoles, e-books, and smart toys and portable car navigation devices.

(4) Other electronic devices with data interaction functions.

Embodiment 7 of the present application provides a non-volatile computer storage medium storing computer-executable instructions executed by one or more processors, such as a processor 610, Having the one or more processors described above perform any of the methods described above The human-computer interaction method in the example, for example, performs the method steps S101 to S104 in FIG. 1 described above, and the method steps S201 to S207 in FIG. 2; the modules 310-340 and the diagram in FIG. 3 can also be implemented. The function of modules 310-360 in 4.

The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located A place, or it can be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

Through the description of the above embodiments, those skilled in the art can clearly understand that the various embodiments can be implemented by means of software plus a general hardware platform, and of course, by hardware. A person skilled in the art can understand that all or part of the process of implementing the above embodiments can be completed by a computer program to instruct related hardware, and the program can be stored in a computer readable storage medium. When executed, the flow of an embodiment of the methods as described above may be included. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, and are not limited thereto; in the idea of the present application, the technical features in the above embodiments or different embodiments may also be combined. The steps may be carried out in any order, and there are many other variations of the various aspects of the present application as described above, which are not provided in the details for the sake of brevity; although the present application has been described in detail with reference to the foregoing embodiments, The skilled person should understand that the technical solutions described in the foregoing embodiments may be modified, or some of the technical features may be equivalently replaced; and the modifications or substitutions do not deviate from the embodiments of the present application. The scope of the technical solution.

Claims (13)

A human-computer interaction method, which is characterized in that it is applied to a mobile device, including: Receiving, by the mobile device, sensing information of a user action, where the sensing information includes touch sensing information generated by a touch sensor located at a border of the mobile device; Analyzing the sensing information to obtain a current gesture action of the user; Searching for a usage scenario that matches the current gesture action from a correspondence between the saved usage scenario and the gesture action; Provide the service corresponding to the found usage scenario. The human-computer interaction method according to claim 1, further comprising: When the usage scenario matching the current gesture action is not found in the corresponding relationship between the saved usage scenario and the gesture action, the usage scenario actively activated by the user under the current gesture action is recorded; Binding the actively enabled usage scenario to the current gesture action into a set of correspondences, added to the corresponding relationship between the usage scenario and the gesture action. The human-computer interaction method according to claim 1, wherein the sensing information comprises any one or more of rotational angular velocity information, distance information, and fingerprint information, and the touch sensing information includes finger coordinate information and/or Or pressure information. The human-computer interaction method according to claim 1, wherein the mobile device is a mobile phone. A human-machine interaction device, comprising: a receiving module, configured to receive, by the mobile device, sensing information of a user action, where the sensing information includes touch sensing information generated by a touch sensor located at a border of the mobile device; An analysis module, configured to analyze the sensing information received by the receiving module, and learn the current gesture action of the user; a matching module, configured to search for a usage scenario that matches a current gesture action learned by the analysis module from a correspondence between the saved usage scenario and the gesture action; The service module is configured to provide a service corresponding to the usage scenario found by the matching module. The human-machine interaction device according to claim 5, further comprising: a recording module, configured to record a usage scenario actively activated by the user under the current gesture action when a usage scenario matching the current gesture action is not found in the corresponding relationship between the saved usage scenario and the gesture action; The adding module is configured to bind the actively enabled usage scenario and the current gesture action into a set of correspondences, and add to the corresponding relationship between the usage scenario and the gesture action. The human-machine interaction device according to claim 5, wherein the sensing information comprises any one or more of rotational angular velocity information, distance information, and fingerprint information, and the touch sensing information includes finger coordinate information and/or Or pressure information. The human-machine interaction device according to claim 5, wherein the mobile device is a mobile phone. A mobile device, comprising: a touch sensor located at a border of the mobile device; and the human-machine interaction device according to any one of claims 5 to 8, wherein: The touch sensor is configured to sense a touch of a user, generate touch sensing information, and send the touch sensing information to the human-machine interaction device; The human-machine interaction device is configured to receive sensing information of the mobile device on the user action, and provide a corresponding service according to the sensing information, where the sensing information includes the touch sensing information. The mobile device of claim 9, wherein the mobile device is a mobile phone. An electronic device comprising: At least one processor; and, a memory communicatively coupled to the at least one processor; wherein The memory stores instructions executable by the one processor, the instructions being executed by the at least one processor to enable the at least one processor to: Receiving sensing information of the electronic device on the user action, where the sensing information includes touch sensing information generated by a touch sensor located on the border of the electronic device; Analyzing the sensing information to obtain a current gesture action of the user; Searching for a usage scenario that matches the current gesture action from a correspondence between the saved usage scenario and the gesture action; Provide the service corresponding to the found usage scenario. A non-volatile computer storage medium storing computer executable instructions, the computer executable instructions being set to: Receiving sensing information of the electronic device on the user action, where the sensing information includes touch sensing information generated by a touch sensor located on the border of the electronic device; Analyzing the sensing information to obtain a current gesture action of the user; Searching for a usage scenario that matches the current gesture action from a correspondence between the saved usage scenario and the gesture action; Provide the service corresponding to the found usage scenario. A computer program product comprising a computing program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions, when the program instructions are executed by a computer, causing the computer The method of any of claims 1-4.

Images