WO2019233249A1

WO2019233249A1 - Electronic device and multi-touch method, multi-touch unit, and memory for same

Info

Publication number: WO2019233249A1
Application number: PCT/CN2019/086783
Authority: WO
Inventors: 张晓峰; 程立新
Original assignee: 中兴通讯股份有限公司
Priority date: 2018-06-07
Filing date: 2019-05-14
Publication date: 2019-12-12
Also published as: CN108920049A

Abstract

Disclosed are a multi-touch method, an electronic device, and a multi-touch unit for the electronic device. The method comprises: when an electronic device senses touch operations performed on at least two touch devices, regarding touch trajectories on touch regions of the at least two touch devices as one set of touch operations and performing and displaying the set of touch operations (S60). The method can achieve joint operations across multiple touch devices.

Description

Electronic device and multi-touch method, multi-touch unit and memory of the electronic device

This application claims priority from Chinese patent application CN201810580588.0 entitled "An electronic device and a multi-touch method, a multi-touch unit, and a memory of the electronic device" filed on June 7, 2018. Incorporated herein by reference.

Technical field

The present invention relates to an electronic device and a control method thereof, a multi-touch unit and a memory, and in particular to an electronic device and a multi-touch method, a multi-touch unit and a memory of the electronic device.

Background technique

As mobile terminals enter the era of smart phones, the functions and performance of mobile phones become more and more powerful, and mobile phones bring more choices and convenience to users. The user obtains various display information through the screen, and touch becomes more and more an indispensable control portal for the terminal. The user issues various instructions to the terminal through various operations such as clicking, double-clicking, long-pressing, and sliding. Kinds of functions.

In some cases, the single-screen terminal generally operates the terminal through a single touch device, and the dual-screen mobile phone performs the corresponding screen operation through its respective touch device.

Summary of the Invention

The main object of the present invention is to provide an electronic device and a multi-touch method, a multi-touch unit and a memory of the electronic device, so that a user can perform joint control through multiple touch devices.

To achieve the above object, the present invention provides an electronic device including a processor, a memory, at least one display device, and at least two touch devices. The memory stores program instructions, and the processor runs the program instructions to Perform the following steps: when the electronic device senses a touch operation on the at least two touch devices, use the touch track on the touch area of the at least two touch devices as a group of touch operations Perform display.

The invention also proposes a multi-touch method, which includes: when the electronic device senses that there is a touch operation on at least two touch devices, touching the touch area on the touch areas of the at least two touch devices Tracks are displayed as a set of touch operations.

The present invention also proposes a multi-touch unit, which is applied to an electronic device. The multi-touch unit includes a joint module configured to use the touch trajectories on the touch areas of at least two touch devices as a group. Touch operation performs display.

The present invention also provides a memory, where the memory includes a stored program, wherein the method is executed when the program is run.

According to the technical solution of the present invention, through the joint operation of multiple touch devices, users can operate the same and different display areas; solve the problem of interoperability between multi-touch areas, so that users can easily achieve multi-display interaction. Operation; At the same time, users can directly interoperate between multiple terminals, which is more convenient and quick to use.

BRIEF DESCRIPTION OF THE DRAWINGS

The drawings are used to provide a further understanding of the technical solution of the present invention, and constitute a part of the specification. Together with the embodiments of the present application, the drawings are used to explain the technical solution of the present invention, and do not constitute a limitation on the technical solution of the present invention.

1-a is a hardware architecture diagram of an electronic device including at least two display devices according to an embodiment of the present invention;

1-b is a hardware architecture diagram of an electronic device including at least one display device according to an embodiment of the present invention;

1-c is a hardware architecture diagram of multiple electronic devices according to an embodiment of the present invention;

2 is a functional module diagram of a multi-touch unit according to an embodiment of the present invention;

3 is a flowchart of a multi-touch method of an electronic device according to an embodiment of the present invention;

4 is a schematic diagram of a mapping relationship between a touch device and a display device of an electronic device according to an embodiment of the present invention;

FIG. 5-a is a schematic diagram of a group of sliding touch operations on a touch track on a touch area of an electronic device according to an embodiment of the present invention; FIG.

FIG. 5-b is a schematic diagram of a group of multi-touch operations on a touch track on a touch area of an electronic device according to an embodiment of the present invention; FIG.

FIG. 6 is a flowchart of steps in which a touch track is a group of touch operation displays in a multi-touch method of an electronic device according to an embodiment of the present invention.

Detailed ways

In order to make the objectives, technical solutions, and advantages of the present invention clearer, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be arbitrarily combined with each other. In the following, the embodiment is described by using a dual touch device, and touch methods for more touch devices also fall within the protection scope of the present invention.

As shown in FIG. 1-a, it is a hardware architecture diagram of an electronic device 1 according to an embodiment of the present invention. The electronic device 1 includes at least one display device. The electronic device 1 may be a mobile phone, a game machine, a tablet, a television, or the like. In this embodiment, two display devices are taken as an example to describe the present invention. As shown in FIG. 1-a, the electronic device 1 includes a first display device 10 and a second display device 11. The electronic device 1 further includes at least two touch devices, the at least two touch devices are used to receive user input, and the at least one display device is used to display operation content corresponding to the user input. In this embodiment, two touch devices are taken as an example to describe the present invention. As shown in FIG. 1-a, the electronic device 1 includes a first touch device 12 and a second touch device 13. The connection relationship between the first touch device 12 and the second touch device 13 includes, but is not limited to, a physical connection mode or a network connection mode. Physical connection methods include, but are not limited to, hinges, gluing, etc., and network connection methods include, but are not limited to, Bluetooth, WIFI, NFC near-field connection, etc.

The electronic device 1 further includes a processor 14 and a memory 15. The memory 15 may be used to store computer programs, for example, software programs and modules of application software, such as computer programs corresponding to the multi-touch method of the electronic device 1 according to the embodiment of the present invention. The processor 14 is stored in the memory 15 by running. The computer program inside, thereby executing various functional applications as well as data processing, implements the method described above. The memory 15 may include a high-speed random access memory, and may further include a non-volatile memory, such as one or more magnetic storage devices, a flash memory, or other non-volatile solid-state memory. In some examples, the memory 15 may further include memories remotely provided with respect to the processor 16, and these remote memories may be connected to the electronic device 1 through a network. Examples of the above network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof. The memory 15 includes a multi-touch unit 150. The multi-touch unit 150 is configured to jointly operate the at least two touch devices, so as to display the operation content corresponding to the joint operation on the at least one display device. A plurality of scenes are stored in the memory 15, and the plurality of scenes may be a variety of application programs. The memory 15 also stores an area mapping algorithm corresponding to each scene, and is configured to change the display area of the at least one display device. Establish a mapping relationship with the touch areas of the at least two touch devices. In another embodiment, a display device is taken as an example to illustrate the present invention. As shown in FIG. 1-b, the electronic device 1 includes a display device 10, and the display device 10 is configured to display the at least two touch screens. The operation content corresponding to the user input received by the control device.

In another embodiment, as shown in FIG. 1-c, there are multiple electronic devices 1, and each electronic device 1 includes a display device 10, a touch device 11, a memory 15, and a processor 16. The memory 15 includes a multi-touch unit 150. The multi-touch unit 150 is configured to jointly operate a user input received by the touch device 11 in each of the electronic devices 1, and is operated on the display device 10. Display the operation content corresponding to the joint operation.

The electronic device 1 includes two display devices and two touch devices as examples to illustrate the present invention. The hardware architecture diagram shown in FIG. 1-a is shown below.

As shown in FIG. 2, it is a functional block diagram of the multi-touch unit 150 in the embodiment of the present invention. The multi-touch unit 150 includes:

The configuration module 20 is configured to initialize and configure the first touch device 12 and the second touch device 13. The configuration includes a touch area configuration, which includes, but is not limited to, the size of the touch area, the starting position of the touch area, the operation delay of the touch area, and the like. The touch area configuration allows the first touch device 12 and the second touch device 13 to be used as multi-touch in the present invention within a certain area. The operation delay of the touch area refers to an allowable time interval between touch points. In this operation delay interval, touch operations in the touch area are considered to be simultaneous or continuous in the touch area. On the control area. For example, the sliding operation on the touch area is constituted by the user's operation of multiple touch points in succession. The time interval between the multiple touch points is within the set operation delay range, so the multiple The operation corresponding to each touch point is considered a sliding operation. For another example: the multi-touch operation on the touch area is constituted by the user's operation of multiple touch points that are not connected in succession, and the time interval between the multiple touch points is within the set operation delay range Here, the operation corresponding to the multiple touch points is a multi-touch operation.

The selection module 21 is configured to receive a scene selected by a user. The electronic device 1 may provide a user with multiple scenes, and the scenes may be application programs.

After the user selects a scene, the mapping module 22 is configured to call an area mapping algorithm corresponding to the scene in the memory 15 and use the area mapping algorithm to map the first touch device 12 and the second touch device 13 The touch area establishes a mapping relationship with the display areas of the first display device 10 and the second display device 11. As shown in FIG. 4, the mapping module 22 is configured to establish a mapping relationship between the touch area 120 and the touch area 130 and the display area 100 and the display area 110.

The receiving module 23 is configured to receive a touch track of a user on a touch area of the first touch device 12 and the second touch device 13. In this embodiment, the touch track may be formed by continuous touch operations, or may be formed by multi-touch point operations. As shown in FIG. 5-a, the user performs continuous touch operations, such as a slide operation, on the touch area 120 of the first touch device 12 and the touch area 130 of the second touch device 13. The touch track 50 on the touch area 120 and the touch track 51 on the touch area 130 are touch tracks formed by a user's continuous touch operations. As shown in FIG. 5-b, the user performs a multi-touch point operation on the touch area 120 of the first touch device 12 and the touch area 130 of the second touch device 13, and the touch area 120 The touch track 52 on the touch screen 53 and the touch track 53 on the touch area 130 are two-point operations performed by the user.

The judging module 24 is configured to judge that the touch track exists only on one touch area. In this embodiment, the determination module 24 determines that the touch trace exists only on the touch area 120 or the touch area 130.

When the touch track exists only on the touch area 120 or the touch area 130, the control module 25 is configured to perform an operation corresponding to the touch track according to the mapping relationship, and the touch track will exist. The display area corresponding to the touch area displays the operation content of the touch track corresponding operation.

When the touch track exists on the touch area 120 of the first touch device 12 and the touch area 130 of the second touch device 13, the combination module 26 is configured to use the first touch The touch trajectory on the touch area 120 of the device 12 and the touch area 130 of the second touch device 13 serves as a group of touch operations. In this embodiment, the group of touch operations means that the time interval between the touch points corresponding to the operation track is within the operation delay range of the configured touch area. The control operation includes a sliding operation or a multi-touch operation. As shown in FIG. 5-a, the touch tracks on the touch area 120 and the touch area 130 are used as a group of sliding operations. As shown in FIG. 5-b, the touch tracks on the touch area 120 and the touch area 130 are used as a group of multi-touch operations.

The control module 25 is configured to execute the group of touch operations according to the configured mapping relationship, and display the operation content corresponding to the group of touch operations on a corresponding display area.

For example, the mapping relationship configured by the mapping module 22 is: when the touch track on the touch area 120 and the touch area 130 is a slide operation, the corresponding display area is the display area 100, and a slide is set The operation content corresponding to the operation is unlocking the screen on the display area 100. Then, when the determination module 24 determines that the touch track is on the first touch area 120 and the second touch area 130, the combination module 26 combines the first touch area 120 and all the touch areas The touch track on the second touch area 130 is used as a group of sliding operations (as shown in FIG. 5-a), and the control module 25 unlocks the screen of the display area 100 according to the mapping relationship.

As shown in FIG. 3, it is a flowchart of a multi-touch method of the electronic device 1 according to an embodiment of the present invention. The method mainly includes steps S30 to S37.

In step S30, the configuration module 20 initializes and configures each of the at least two touch devices. In this embodiment, the configuration module 20 initializes and configures the first touch device 12 and the second touch device 13. The configuration includes a touch area configuration, which includes, but is not limited to, the size of the touch area, the starting position of the touch area, the operation delay of the touch area, and the like. The touch area configuration allows the first touch device 12 and the second touch device 13 to be used as multi-touch in the present invention within a certain area. The operation delay of the touch area refers to an allowable time interval between touch points. In this operation delay interval, touch operations in the touch area are considered to be simultaneous or continuous in the touch area. On the control area. For example, the sliding operation on the touch area is constituted by the user's operation of multiple touch points in succession. The time interval between the multiple touch points is within the set operation delay range, so the multiple The operation corresponding to each touch point is considered a sliding operation. For another example: the multi-touch operation on the touch area is constituted by the user's operation of multiple touch points that are not connected in succession, and the time interval between the multiple touch points is within the set operation delay range Here, the operation corresponding to the multiple touch points is a multi-touch operation.

In step S31, the selection module 21 receives the scene selected by the user. The electronic device 1 may provide a user with multiple scenes, and the scenes may be application programs.

In step S32, the mapping module 22 calls an area mapping algorithm corresponding to the scene in the memory 15, and uses the area mapping algorithm to associate the touch area of the at least two touch devices with the display area of the at least one display device. Establish a mapping relationship. In this embodiment, the mapping module 22 displays the touch areas of the first touch device 12 and the second touch device 13 with the display of the first display device 10 and the second display device 11. Regions are mapped. As shown in FIG. 4, the mapping module 22 establishes a mapping relationship between the touch area 120 and the touch area 130 and the display area 100 and the display area 110.

In step S33, when the user performs a touch operation on the at least two touch devices, the receiving module 23 receives a touch track of the user on the at least two touch devices. In this embodiment, the receiving module 23 receives a user's touch track on the touch areas of the first touch device 12 and the second touch device 13. In this embodiment, the touch track may be formed by continuous touch operations, or may be formed by multi-touch point operations. As shown in FIG. 5-a, the user performs continuous touch operations, such as a slide operation, on the touch area 120 of the first touch device 12 and the touch area 130 of the second touch device 13. The touch track 50 on the touch area 120 and the touch track 51 on the touch area 130 are touch tracks formed by a user's continuous touch operations. As shown in FIG. 5-b, the user performs a multi-touch point operation on the touch area 120 of the first touch device 12 and the touch area 130 of the second touch device 13, and the touch area 120 The touch track 52 on the touch screen 53 and the touch track 53 on the touch area 130 are two-point operations performed by the user.

In step S34, the determination module 24 determines whether the touch track exists only on one touch area. In this embodiment, the determination module 24 determines whether the touch trace exists only on the touch area 120 or the touch area 130. When the touch track exists only on one touch area, step S35 is performed. When the touch track exists on the touch areas of at least two touch devices, step S36 is performed.

In step S35, the control module 25 executes the operation corresponding to the touch track according to the mapping relationship, and displays the operation corresponding to the touch track on the display area corresponding to the touch area where the touch track exists. content.

In step S36, the cooperation module 26 uses the touch trajectories on the touch areas of the at least two touch devices as a group of touch operations. In this embodiment, when the touch track exists on the touch area 120 of the first touch device 12 and the touch area 130 of the second touch device 13, the combination module 26 will The touch track on the touch area 120 of the first touch device 12 and the touch area 130 of the second touch device 13 are described as a group of touch operations. In this embodiment, the group of touch operations means that the time interval between the touch points corresponding to the operation track is within the operation delay range of the configured touch area. The control operation includes a sliding operation or a multi-touch operation. As shown in FIG. 5-a, the touch tracks on the touch area 120 and the touch area 130 are used as a group of sliding operations. As shown in FIG. 5-b, the touch tracks on the touch area 120 and the touch area 130 are used as a group of multi-touch operations.

In step S37, the control module 25 executes the group of touch operations according to the configured mapping relationship, and displays the operation content corresponding to the group of touch operations on the corresponding display area.

Another embodiment of the present invention provides a multi-touch method. As shown in FIG. 6, the multi-touch method includes step S60.

In step S60, when the electronic device senses a touch operation on at least two touch devices, the touch track on the touch area of the at least two touch devices is displayed as a set of touch operations.

Although the embodiments disclosed in the present invention are as described above, the content described is only an embodiment adopted for facilitating understanding of the present invention, and is not intended to limit the present invention. Any person skilled in the art to which this invention pertains may make any modifications and changes in the form and details of implementation without departing from the spirit and scope disclosed by this invention, but the scope of patent protection of this invention must still be Subject to the scope defined by the appended claims.

Claims

An electronic device includes a processor, a memory, at least one display device, and at least two touch devices, characterized in that the memory stores program instructions, and the processor runs the program instructions to perform the following steps:

When the electronic device senses that there is a touch operation on the at least two touch devices, the touch track on the touch area of the at least two touch devices is displayed as a set of touch operations.
The electronic device according to claim 1, wherein the processor further runs the program instructions to perform the following steps:

Before the electronic device senses that there is a touch operation on the at least two touch devices, initialize and configure each of the at least two touch devices.
The electronic device according to claim 2, wherein the processor further executes the program instructions to perform the following steps:

After initializing and configuring each of the at least two touch devices, a scene selected by a user is received, and an area mapping algorithm corresponding to the scene is called according to the scene selected by the user.
The electronic device according to claim 3, wherein the processor further runs the program instructions to perform the following steps:

The invoking an area mapping algorithm corresponding to the scene includes establishing a mapping relationship between the touch areas of the at least two touch devices and the display areas of the at least one display device.
The electronic device according to claim 4, wherein the processor further executes the program instructions to perform the following steps:

After establishing a mapping relationship between the touch areas of the at least two touch devices and the display area of the at least one display device, a touch track on each touch device is received.
The electronic device according to claim 1, wherein the processor further runs the program instructions to perform the following steps:

When the electronic device senses that the touch track exists on only one touch area, it performs an operation corresponding to the touch area where the touch track is located for display.
A multi-touch method includes:

When the electronic device senses that there is a touch operation on the at least two touch devices, the touch track on the touch area of the at least two touch devices is displayed as a set of touch operations.
The multi-touch method according to claim 7, before the electronic device senses that there is a touch operation on at least two touch devices, further comprising:

Initialize and configure each of the at least two touch devices.
The multi-touch method according to claim 8, wherein after initializing and configuring each of the at least two touch devices, further comprising:

Receiving a scene selected by a user, and calling an area mapping algorithm corresponding to the scene according to the scene selected by the user.
The multi-touch method according to claim 9, wherein the calling an area mapping algorithm corresponding to the scene comprises:

A mapping relationship is established between the touch areas of the at least two touch devices and the display area of at least one display device.
The multi-touch method according to claim 10, wherein establishing a mapping relationship between the touch areas of the at least two touch devices and the display area of at least one display device comprises:

Receive touch trajectories on each touch device.
The multi-touch method according to claim 7, further comprising:

When the electronic device senses that the touch track exists on only one touch area, it performs an operation corresponding to the touch area where the touch track is located for display.
A multi-touch unit applied to an electronic device is characterized in that the multi-touch unit includes:

A combination module configured to execute a touch track on a touch area of the at least two touch devices as a group of touch operations when the electronic device senses a touch operation on the at least two touch devices. display.
The multi-touch unit according to claim 13, wherein the multi-touch unit further comprises:

A configuration module is configured to initialize and configure each of the at least two touch devices.
The multi-touch unit according to claim 14, wherein the multi-touch unit further comprises:

A selection module is used to receive a scene selected by a user.
The multi-touch unit according to claim 15, wherein the multi-touch unit further comprises:

The mapping module is configured to call an area mapping algorithm corresponding to the scene according to the scene selected by the user.
The multi-touch unit according to claim 16, wherein the region mapping algorithm corresponding to invoking the scene comprises:

A mapping relationship is established between the touch areas of the at least two touch devices and the display area of at least one display device.
The multi-touch unit according to claim 17, wherein the multi-touch unit further comprises:

The receiving module is configured to connect a touch track on each touch device.
The multi-touch unit according to claim 18, wherein the multi-touch unit further comprises:

The judging module is configured to judge whether the touch track exists only on one touch area.
The multi-touch unit according to claim 17, wherein the multi-touch unit further comprises: a control module, configured to perform an operation corresponding to the touch trajectory and display the corresponding display according to the established mapping relationship. Area.