TW201504925A - Method for operating user interface and electronic device - Google Patents

Abstract

A method for operating a user interface and an electronic device are provided, the electronic device has a touch screen, and the touch screen displays the user interface. The method includes: defining a touch operating region and a motion mapping region on a touch surface of the touch screen; detecting a touch operation activated on the touch screen within the touch operating region by the touch screen, and detecting a body motion above the touch surface and the body motion is not contact with the touch surface; operating the user interface within the touch operating region according to the touch operation, and operating the user interface within the motion mapping region according to the body motion.

Description

User interface operation method and electronic device

The present invention relates to an electronic device, and more particularly to a method and an electronic device for operating a user interface.

In order to meet the user's demand for large-size screens, the touch screen size of portable electronic devices such as smart phones or tablets on the market is also growing. Taking smart phones as an example, the touch screen size of many smart phones has exceeded 5 inches, not to mention the tablet. Some touch screens of touch screens are even close to or exceeding 10 inches.

However, for a portable electronic device having a large-footprint touch screen, unless the user has a sufficiently long finger (especially a thumb), it is almost impossible for a general user to operate with a single hand. The portable electronic device of the touch screen.

In view of this, the present invention provides a user interface operation method and an electronic device, which allows most users to complete the complete manipulation of the user interface of the electronic device with one hand.

The invention provides a user interface operation method, which is suitable for an electronic device with a touch screen, and the touch screen displays a user interface. The operation method of the electronic device includes: defining a contact on the touch surface of the touch screen The operation area and the integrated sensing area; the touch operation detects the contact operation in the contact operation area, and the motion sensor disposed on the electronic device detects the touch surface and does not touch the touch surface The somatosensory action; the user interface covered in the contact operation area is operated according to the touch operation, and the user interface included in the somatosensory map area is operated according to the somatosensory action.

The invention further provides an electronic device comprising a motion sensor, a touch screen and a processor. The motion sensor is disposed on the electronic device. The touch screen is used to display the user interface. The processor is coupled to the touch screen and the motion sensor, and is configured to define a contact operation area and a body sense mapping area on the touch surface of the touch screen. The touch screen is further configured to detect a touch operation acting on the touch operation area, and the motion sensor is further configured to detect a body motion that is located above the touch surface and does not touch the touch surface. The processor is further configured to operate the user interface covered in the contact operation area according to the touch operation, and operate the user interface included in the somatosensory map area according to the somatosensory action.

Based on the above, the present invention provides a user interface operation method and an electronic device, and an action sensor is additionally disposed on an electronic device having a touch screen. To capture the somatosensory motion that appears above the touch screen without touching the touch screen, and to operate a portion of the touch screen that the user cannot operate with one hand, according to the captured somatosensory motion.

The above described features and advantages of the invention will be apparent from the following description.

10, 50, 60‧‧‧ electronic devices

12, 222, 224, 562, 564‧‧‧ motion sensors

14‧‧‧ touch screen

16‧‧‧ Processor

21, 51‧‧‧ touch surface

212, 214, 216, 218‧‧ ‧ side of the touch surface

23, 53‧‧‧Contact operation area

232, 234‧‧‧Contact the side of the operating area

24‧‧‧virtual line segments

25, 55‧‧‧ Somatosensory mapping area

252, 254‧‧ ‧ side of the somatosensory mapping area

31, 312, 314, 52‧‧‧ virtual body surface

412, 414‧‧‧ virtual body sense coordinates

452, 454‧‧‧ mapping coordinates

63, 65‧‧‧ areas

S702, S704, S706‧‧‧ steps of the operation method of the user interface in an embodiment of the present invention

FIG. 1 is a schematic diagram of an electronic device according to an embodiment of the invention.

FIG. 2 is a schematic diagram of defining a contact operation area and a somatosensory mapping area and configuring a motion sensor according to an embodiment of the invention.

FIG. 3 is a schematic diagram of a virtual body sensing surface according to an embodiment of the invention.

FIG. 4 is a schematic diagram of converting virtual body sensation coordinates into mapping coordinates according to an embodiment of the invention.

FIG. 5 is a schematic diagram of an electronic device according to another embodiment of the invention.

FIG. 6 is a schematic diagram of an electronic device according to still another embodiment of the present invention.

FIG. 7 is a flow chart of a method for operating a user interface according to an embodiment of the invention.

FIG. 1 is a schematic diagram of an electronic device according to an embodiment of the invention. Referring to FIG. 1 , the electronic device 10 is, for example, an electronic device such as a smart phone, a game machine, or a tablet computer that allows a user to hold a single device.

The electronic device 10 includes a motion sensor 12, a touch screen 14 and a processor 16. The motion sensor 12 is disposed on the electronic device 10, and the motion sensor 12 has a sensing lens. The sensing lens of the motion sensor 12 may include a sensing lens composed of various photosensitive elements, an infrared light sensor, and the like to detect the position and the moving track of the object within the detection range thereof. Moreover, the present invention does not limit the number of motion sensors 12. For example, in the present embodiment, the number of motion sensors 12 may be two. However, in another embodiment, the number of motion sensors 12 may also be one or more than three, depending on practical requirements.

The touch screen 14 is, for example, a resistive touch panel, a capacitive touch panel, an optical touch panel, an acoustic wave touch panel, or an electromagnetic touch. Panels and the like are not limited herein. The touch screen 14 has a touch surface. When the user performs a touch operation such as clicking, sliding or dragging on the touch surface by using an input device such as a finger or a stylus, the touch screen 14 can generate a corresponding touch. Signal.

The processor 16 is coupled to the motion sensor 12 and the touch screen 14, and the processor 16 can be a micro-controller, an embedded controller, or a central processing unit (CPU). And the like, and is not limited to the above. The processor 16 can run one or more operating systems and touch the flash Curtain 14 may display the user interface provided by one or more operating systems. Then, when the touch screen 14 generates a touch signal according to the touch operation, the processor 16 can determine whether to generate a corresponding input command to operate the user interface according to the touch signal.

In particular, in the embodiment, the processor 16 defines a contact operation area and a somatosensory mapping area on the touch surface of the touch screen 14. The touch screen 14 is responsible for detecting a touch operation acting on the touch operation area, and the motion sensor 12 is responsible for detecting a body motion that is located above the touch surface of the touch screen 14 and does not touch the touch surface. Then, the processor 16 can operate the user interface covered in the contact operation area according to the touch operation detected by the touch screen 14 and operate according to the somatosensory action detected by the motion sensor 12 User interface within the somatosensory mapping area. However, although the processor 16 can operate the user interface included in the somatosensory mapping area according to the somatosensory motion detected by the motion sensor 12, since the touch screen 14 itself can detect the user acting throughout The contact operation is performed at almost all positions on the touch surface, so the touch screen 14 can actually detect the contact operation acting on the somatosensory mapping area (or not in the contact operation area), and the processor 16 can also be based on the touch The touch signal of the screen 14 is controlled to operate the entire user interface including the somatosensory mapping area.

For convenience of explanation, the electronic device 10 will be described below for a user who is accustomed to holding the electronic device with his left hand and operating the touch screen of the electronic device with the thumb of the left hand.

For example, FIG. 2 is a diagram illustrating an embodiment of the present invention. A schematic diagram of contacting the operation area and the somatosensory mapping area and configuring the motion sensor. Referring to FIG. 2 , the processor 16 can define a contact operation area 23 and a somatosensory mapping area 25 on the touch surface 21 of the touch screen 14 . For example, in the present embodiment, the processor 16 may divide the touch surface 21 into the touch operation area 23 and the somatosensory map area 25 at the virtual line segment 24. As shown in FIG. 2, it is assumed that the touch surface 21 has a side edge 212, a side edge 214, a side edge 216 and a side edge 218. The contact operation area 23 has a side edge 232 and a side edge 234, and the body sense mapping area 25 has side edges. 252 and the side 254, the side 232 of the touch surface 21 is adjacent to or close to the side 212 of the touch surface 21, and the side 252 of the somatosensory map area 25 is adjacent to the side 214 of the touch surface 21 Or abutting, and the side 234 of the contact operating area 23 is adjacent or abutting the side 254 of the somatosensory mapping area 25.

In particular, in the present embodiment, since the area and shape of the touch operation area 23 and the body sense map area 25 are completely the same, the virtual line segment 24 extends from the middle point of the side 216 of the touch surface 21 to the touch surface, for example. The middle point of the side 218 of 21. However, the area and/or shape of the touch operation area 23 and the somatosensory map area 25 can also be adaptively adjusted for different electronic devices with different touch screen sizes. For example, in an embodiment, if the size of the touch screen is less than a lower limit of one foot, or the distance between the side 212 of the touch surface 21 and the side 214 is less than a lower limit of the distance, the virtual line segment 24 can be made to be relatively touched. The side 212 of the control surface 21 is closer to the side 214 and the area of the contact operating area 23 is made larger than the area of the somatosensory mapping area 25. Alternatively, in another embodiment, if the size of the touch screen is greater than the upper limit of one foot, or the distance between the side 212 of the touch surface 21 and the side 214 is greater than an upper limit of the distance, the virtual line segment 24 may be relative to The side 214 of the touch surface 21 is closer to the side 212 and is connected The area of the touch operation area 23 is smaller than the area of the somatosensory map area 25.

In addition, for convenience of explanation, the motion sensor 12 mentioned in FIG. 1 is exemplified by the motion sensor 222 and the motion sensor 224 in FIG. 2, but is not limited thereto. For example, in an embodiment, the electronic device 10 may also include only one of the motion sensor 222 and the motion sensor 224 or other motion sensors, depending on practical requirements.

In this embodiment, the motion sensor 222 and the motion sensor 224 are disposed adjacent to the touch surface 21 of the touch screen 16 , and since the contact operation area 23 is adjacent to the side 212 of the touch surface 21 , and the body sense mapping area 25 is adjacent to the side 214 of the touch surface 21 , so the motion sensor 222 and the motion sensor 224 can be closer to the side 214 of the touch surface 21 relative to the side 212 of the touch surface 21 , and the motion sense The sensing lenses of the detector 222 and the motion sensor 224 are respectively directed toward the side 212 of the touch surface 21 . In addition, to expand the detectable range of the motion sensor 224 and the motion sensor 222 , the motion sensor 224 is closer to the side 218 of the touch surface 21 relative to the side 216 of the touch surface 21 , and The motion sensor 222 is closer to the side 216 of the touch surface 21 than the side 218 of the touch surface 21, but is not limited thereto.

In this embodiment, the sensing sensors 222 and the sensing lenses of the motion sensor 224 are not parallel to the touch surface 21, respectively, or are respectively captured above the touch surface 21 and are not in contact with the touch. The somatosensory action of the face 21 is determined by, for example, at least one virtual body surface as a reference for the coordinates and the movement trajectory.

For example, FIG. 3 is a virtual diagram according to an embodiment of the invention. Schematic diagram of the somatosensory surface. Referring to FIG. 2 and FIG. 3 , in the embodiment, the sensing lenses of the motion sensor 222 and the motion sensor 224 are both oriented in the direction of the side 212 of the touch surface 21 and are not parallel to the touch. The surface 21, therefore, the motion sensor 222 and the sensing lens of the motion sensor 224 can form a virtual body surface 31 on the touch surface 21. For example, the virtual body surface 31 may be composed of a virtual body surface 312 that is closer to the motion sensor 222 and a virtual body surface 314 that is closer to the motion sensor 224. The virtual body surface 312 is used by the motion sensor 222. The sensing reference for sensing the somatosensory motion is used, and the virtual somatosensory surface 314 is a sensing reference for the motion sensor 224 to sense the somatosensory motion.

However, in an embodiment, if the electronic device 10 includes only one of the motion sensor 222 and the motion sensor 224, the sensing lens of the motion sensor 222 or the motion sensor 224 can also be adjusted. The orientation or angle is formed to form a complete or partial virtual body surface 31. In addition, since the virtual body sensing surface 31 is not parallel to the touch surface 21, the virtual body sensing surface 31 and the touch surface 21 may have an interplanar angle θ, and the inter-plane angle θ may be 10 degrees to 90 degrees. Any value, depending on the actual needs. That is, the virtual body surface 31 is substantially perpendicular or nearly perpendicular to the touch surface 21, depending on the orientation or angle of the motion sensor 222 and the sensing lens of the motion sensor 224. In addition, the intersection of the virtual body surface 31 (or the extension of the virtual body surface 31 to the touch surface 21) and the touch surface 21 may be used, for example, to divide the contact operation area 23 and the body sense map area 25 in FIG. The virtual line segments 24 overlap.

In detail, the processor 16 can obtain the virtual body sense coordinates corresponding to the virtual body feeling surface of the somatosensory motion, and convert the virtual body feeling coordinates into the somatosensory motion corresponding The mapping coordinates are covered on the user interface within the somatosensory mapping area. Processor 16 can then operate the user interface within the somatosensory mapping area in accordance with the mapping coordinates.

For example, FIG. 4 is a schematic diagram of converting virtual body sensation coordinates into mapping coordinates according to an embodiment of the invention. Referring to FIG. 4, it is assumed that the user holds the electronic device 10 with the left hand, and in the grip state, the user's left thumb can touch the touch surface 21 covered in the contact operation area 23, but the touch is not The touch surface 21 included in the somatosensory mapping area 25 is included. At this time, if the user wants to operate the user interface included in the somatosensory mapping area 25, the user can perform a somatosensory action such as moving the left thumb without using the left thumb to touch the touch surface 21. For example, the user can move the thumb of the left hand to correspondingly generate a somatosensory action on the virtual body surface 31 to click the position of the virtual body sense coordinate 412, and then click on the position of the virtual body sense coordinate 414, or The position of the virtual somatosensory coordinate 412 is moved to the somatosensory action of the position of the virtual somatosensory coordinate 414. If the left thumb of the user continues to be within the detection range of the motion sensor 222 and/or the motion sensor 224 during the above process, the motion sensor 222 and the motion sensor 224 may be detected separately or simultaneously. The somatosensory action, and the processor 16 can obtain the virtual sense of the somatosensory motion corresponding to the virtual somatosensory surface 31 according to the somatosensory motion detected by the motion sensor 222 and/or the motion sensor 224. The coordinates 412, the virtual somatosensory coordinates 414, and the user's left thumb correspond to somatosensory motion information such as clicks or movement trajectories on the virtual body sensing surface 31.

Then, the processor 16 can separately obtain the obtained virtual image according to the mapping algorithm. The somatosensory coordinates 412, the virtual somatosensory coordinates 414, and the left thumb of the user correspond to the somatosensory motion information such as clicks or movement trajectories on the virtual body sensing surface 31, and the somatosensory motion corresponding to the somatosensory mapping region 25 is included. The mapping coordinates 452, the mapping coordinates 454, and the click or movement trajectory corresponding to the touch surface 21 are displayed on the user interface. In particular, as is clear from FIG. 4, in the present embodiment, the virtual body-sensing coordinates 412 are closer to the touch surface 21 with respect to the virtual body-sensing coordinates 414, and after the coordinate conversion is completed, the processor 16 can obtain The mapping coordinates 452 and mapping coordinates 454 on the touch surface 21 are shown. The mapping coordinates 452 are converted from the virtual body sensation coordinates 412, the mapping coordinates 454 are converted from the virtual body sensation coordinates 414, and the mapping coordinates 452 are closer to the contact operation area 23 than the mapping coordinates 454. Thereby, the processor 16 can operate the user interface included in the somatosensory mapping area 25 according to the mapping coordinates 452 and the mapping coordinates 454 without using the right hand of the user.

It should be noted that, referring again to FIG. 1 , in an embodiment, the user may also select whether to activate the motion sensor 12 . For example, when the user wants to operate the electronic device 10 with both hands, the motion sensor 12 does not need to be activated. On the other hand, if the user wants to use only one hand to operate the electronic device 10, the user can send a trigger signal to the processor 16 through the touch screen 14 or send it by pressing a physical button on the electronic device 10. This trigger signal is sent to the processor 16. When the processor 16 receives the trigger signal, the processor 16 activates the motion sensor 12.

In addition, the present invention is also directed to a user who is accustomed to holding an electronic device with his right hand, and a user who operates the touch screen of the electronic device with the thumb of the right hand proposes a corresponding embodiment.

For example, FIG. 5 is a schematic diagram of an electronic device according to another embodiment of the invention. Referring to FIG. 5 , the electronic device 50 is configured with a motion sensor 562 and a motion sensor 564 . The processor of the electronic device 50 can define a touch operation area 53 and a body sense mapping area on the touch surface 51 of the touch screen. 55, and the motion sensor 562 and the motion sensor 564 can form a virtual body surface 52 corresponding to the somatosensory mapping area 55 on the touch surface 51. Thereby, as shown in FIG. 5, when the user holds the electronic device 50 with the right hand and the touch screen of the electronic device 50 is operated by the thumb of the right hand, even if the user's right hand thumb cannot be touched, the sense of body is covered. In the touch surface 51 of the mapping area 55, the user can directly send an operation command through the virtual body surface 52 having an inter-plane angle θ with the touch surface 51 to operate in the somatosensory mapping area 55. user interface.

In other words, the motion sensor, the contact operation area, and the body-sensing map area in the embodiment of the present invention can adjust the configuration position according to actual requirements, and are not limited to the above. In addition, in an embodiment, the motion sensor can also be disposed above and below the boundary between the contact operation area and the body sense mapping area, and can selectively detect the user by adjusting the lens orientation of the motion sensor. The left thumb or the right thumb corresponds to the movement trajectory on the virtual body surface.

In addition, FIG. 6 is a schematic diagram of an electronic device according to still another embodiment of the present invention. Referring to FIG. 6 , the operation device 222 , the motion sensor 224 , the motion sensor 562 , and the motion sensor 564 are disposed on the electronic device 60 . In this embodiment, the processor of the electronic device 60 can adjust the activation or deactivation action sensor 222, the motion sensor 224, the motion sensor 562, and the motion sensing according to the user's settings. One of the devices 564 or a combination thereof. For example, the user can simultaneously activate all the motion sensors 222, the motion sensor 224, the motion sensor 562, and the motion sensor 564 to simultaneously detect the somatosensory motion of the user's left thumb and right thumb. Alternatively, the user may only activate the motion sensor 222 and the motion sensor 224 or the motion sensor 562 and the motion sensor 564, which is not limited by the present invention. When the user operates the electronic device 60 with the left hand, the processor of the electronic device 60 can define the region 63 as a somatosensory mapping region, and according to the somatosensory action detected by the motion sensor 222 and the motion sensor 224. The operation covers the user interface within area 63. When the user operates the electronic device 60 with the right hand, the processor of the electronic device 60 can define the region 65 as a somatosensory mapping region, and according to the motion sense detected by the motion sensor 562 and the motion sensor 564. The operation covers the user interface within the area 65.

Alternatively, in an embodiment, the processor of the electronic device 60 can also be detected by one or a combination of the motion sensor 222, the motion sensor 224, the motion sensor 562, and the motion sensor 564. And determining that the user currently holds the electronic device 60 with the left or right hand, for example, determining which motion sensor has detected the user's thumb. If the processor of the electronic device 60 determines that the user is currently holding and operating the electronic device 60 with the left hand, for example, the motion sensor 222 and/or the motion sensor 224 detects the user's thumb, the electronic device 60 The processor may define the region 63 as a somatosensory mapping region and operate the user interface within the region 63 in accordance with the somatosensory motion detected by the motion sensor 222 and the motion sensor 224. In addition, when the processor of the electronic device 60 determines that the user is currently holding and operating the electronic device 60 with the left hand, the processor of the electronic device 60 can also selectively turn off the motion sensor 562. And motion sensor 564. If the processor of the electronic device 60 determines that the user is currently holding the electronic device 60 with the right hand, for example, the motion sensor 562 and/or the motion sensor 564 detects the user's thumb, the processing of the electronic device 60 The region 65 can be defined as a somatosensory mapping region, and the user interface encompassed within the region 65 is operated in accordance with the somatosensory motion detected by the motion sensor 562 and the motion sensor 564. In addition, when the processor of the electronic device 60 determines that the user is currently holding and operating the electronic device 60 with the right hand, the processor of the electronic device 60 can also selectively turn off the motion sensor 222 and the motion sensor 224. .

However, some implementation details regarding the embodiments of FIGS. 5 and 6 can also be derived from the description of FIGS. 1 through 4.

FIG. 7 is a flow chart of a method for operating a user interface according to an embodiment of the invention. Referring to FIG. 1 and FIG. 7 simultaneously, in step S702, the processor 16 defines a contact operation area and a somatosensory mapping area on the touch surface of the touch screen 14. Then, in step S704, the processor 16 detects the contact operation in the contact operation area through the touch screen 14, and detects that it is located above the touch surface through the motion sensor 12 disposed on the electronic device 10. Touching the somatosensory action of the touch surface. Then, in step S706, the processor 16 operates the user interface covered in the contact operation area according to the touch operation, and operates the user interface included in the somatosensory map area according to the somatosensory action.

However, detailed implementation details of the above-described user interface operation method have been described in detail above, and thus will not be described herein. In addition, the operation method of the user interface may be performed by the processor of the electronic device 10, the electronic device 50 or the electronic device 60 (for example, One or more hardware circuits in the processor 16) are respectively executed. Alternatively, in one embodiment, one or more software or firmware modules may be stored in the hard disk or the memory of the electronic device 10, the electronic device 50, or the electronic device 60. When the software or the body module is loaded into the electronic device 10, the electronic device 50, or the processor of the electronic device 60 (for example, the processor 16), the software or the body module can be implemented in the above method. Each step.

In summary, the present invention provides a user interface operation method and an electronic device, and an action sensor is additionally disposed on an electronic device having a touch screen to capture a touch screen that does not touch the touch screen. Controlling the somatosensory motion of the screen, and operating a part of the touch screen that the user cannot operate with one hand according to the captured somatosensory motion.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the present invention, and any one of ordinary skill in the art can make some changes and refinements without departing from the spirit and scope of the present invention. The scope of the invention is defined by the scope of the appended claims.

S702, S704, S706‧‧‧ user interface operation method steps

Claims (10)

A user interface operation method is applicable to an electronic device having a touch screen, and the user interface is displayed through the touch screen. The operation method of the electronic device includes: a touch surface of the touch screen Defining a contact operation area and an integrated sensing area; detecting a contact operation in the contact operation area through the touch screen, and detecting, by the at least one motion sensor disposed on the electronic device An integral sensing action on the touch surface without contacting the touch surface; and operating the user interface covered in the contact operation area according to the contact operation, and operating according to the somatosensory action The user interface within the mapping area. The method of operating a user interface according to claim 1, wherein a first side of the contact operating area is adjacent to a first side of the touch surface, and the first part of the body sense mapping area is One side is adjacent to a second side of the touch surface, and the second side of the touch operation area is adjacent to the second side of the body sensing map area, wherein the at least one motion sensing The second side of the touch surface is closer to the first side of the touch surface, and the sensing lens of the at least one motion sensor faces the first side of the touch surface And the sensing lens of the at least one motion sensor is not parallel to the touch surface. The method of operating the user interface as described in claim 2, The at least one motion sensor includes a first motion sensor and a second motion sensor, and the first motion sensor is closer to the touch with respect to a third side of the touch surface. a fourth side of the control surface, and the second motion sensor is closer to the third side of the touch surface relative to the fourth side of the touch surface. The method of operating a user interface according to claim 1, wherein the step of operating the user interface included in the somatosensory mapping area according to the somatosensory action comprises: obtaining the somatosensory action corresponding to at least At least one virtual body sense coordinate on a virtual body surface, wherein the at least one virtual body surface is not parallel to the touch surface; converting the at least one virtual body sense coordinate to the body motion corresponding to the At least one mapping coordinate on the touch surface in the somatosensory mapping area; and operating the user interface included in the somatosensory mapping area according to the at least one mapping coordinate. The method of operating a user interface according to claim 4, wherein the at least one virtual body sense coordinate is converted to the body motion corresponding to the touch surface included in the body sense map area. The at least one mapping of the coordinates includes: converting a first virtual body sensation coordinate and a second virtual body sensation coordinate in the at least one virtual body sensation coordinate to the body sensation action corresponding to the body sensation mapping area a first mapping coordinate and a second mapping coordinate of the at least one mapping coordinate on the touch surface, wherein the first virtual body sensing coordinate is closer to the touch surface than the second virtual body sensing coordinate, And the first mapping coordinate is closer to the second mapping coordinate than the second mapping coordinate Contact the operating area. An electronic device includes: a touch screen; at least one motion sensor disposed on the electronic device; and a processor coupled to the touch screen and configured to display a user interface through the touch screen The processor is further configured to define a module for contacting the operation area and the integrated mapping area on a touch surface of the touch screen, wherein the processor is further configured to act on the touch screen through the touch screen Contacting a contact operation in the operation area, and detecting, by the at least one motion sensor, an integrated motion that is located above the touch surface and does not contact the touch surface, wherein the processor is further configured to operate according to the contact The user interface included in the contact operation area is operated, and the user interface included in the somatosensory map area is operated according to the somatosensory action. The electronic device of claim 6, wherein a first side of the contact operating area is adjacent to a first side of the touch surface, and a first side of the body sensing map area is A second side of the touch surface is adjacent, and the second side of the touch operation area is adjacent to the second side of the body sensing map area, wherein the at least one motion sensor is opposite to the second side The first side of the touch surface is closer to the second side of the touch surface, and the sensing lens of the at least one motion sensor faces the first side of the touch surface, and the The sensing lenses of at least one motion sensor are not parallel to the touch surface. The electronic device of claim 7, wherein the at least one motion sensor comprises a first motion sensor and a second motion sensor, and the first motion sensor is opposite to the touch a third side of the surface is closer to a fourth side of the touch surface, and the second motion sensor is closer to the touch surface than the fourth side of the touch surface The third side of the. The electronic device of claim 6, wherein the processor is further configured to obtain at least one virtual body sense coordinate corresponding to the at least one virtual body surface, wherein the at least one virtual body surface The processor is further configured to convert the at least one virtual body sense coordinate to at least one mapping of the body motion corresponding to the touch surface included in the body sense mapping area. a coordinate, wherein the processor is further configured to operate the user interface included in the somatosensory mapping area according to the at least one mapping coordinate. The electronic device of claim 9, wherein the processor is further configured to convert a first virtual body sense coordinate and a second virtual body touch coordinate in the at least one virtual body sense coordinate to the body respectively. The sensing action corresponds to a first mapping coordinate and a second mapping coordinate of the at least one mapping coordinate of the touch surface included in the somatosensory mapping area, wherein the first virtual body sensing coordinate is opposite to the first mapping The second virtual body sensation is closer to the touch surface, and the first mapping coordinate is closer to the contact operation area relative to the second mapping coordinate.