TW201324239A - Method for identifying dual-screen operation and electronic device using the same - Google Patents

Abstract

An electronic device and a method for identifying a dual-screen operation are presented. The method includes the following steps. Detect a first touch through a first touch panel, and identify if the first touch keeps existing or not. When the first touch disappears when it is near a first edge of the first touch panel, send a virtual signal to an operation system of an electronic device continuously. Identify if a second touch panel detects a second touch near a second edge thereof in a specific time or not. If so, stop sending the virtual signal and send a touch signal in response to the second touch to the operation system. Determine a dual-screen operation from the first touch panel to the second touch panel is generated by the operation system.

Description

Cross-screen operation identification method and electronic device

The present invention relates to an operation recognition method for an electronic device, and more particularly to a method for recognizing a cross-screen operation and an electronic device using the same.

Nowadays, touch technology is a common user interface on mobile electronic devices or home electronic devices, and the electronic device can be operated through a touch user interface. For example, use a touch interface to operate a notebook or a desktop computer. When an electronic device that touches the user interface is operated, the icon displayed on the screen is usually clicked by a finger to perform an execution instruction corresponding to the illustration. If you want to move an object on the screen, use your finger to continuously touch the position in the screen corresponding to the object, and then drag to the target position to complete the movement of the object.

However, if you want to drag objects in a multi-screen system. For example, dragging objects on a multi-screen video wall. When you want to drag an object across the screen, the trailing path passes through the edge of the screen. At this time, since the edge of the general screen cannot be reflected by the touch, when the object is dragged to the edge of the screen, the edge of the screen cannot detect that the user has failed to perform the drag.

The invention provides a cross-screen operation identification method for recognizing a cross-screen touch operation performed by a user.

The present invention provides an electronic device that can recognize and perform a cross-screen touch operation of a user.

The present invention provides a method for recognizing a cross-screen operation for an electronic device having a first touch screen and a second touch screen, wherein a first edge of the first touch screen is adjacent to the second touch screen a second edge. The above method includes the following steps. First, detecting a first touch through the first touch screen and determining whether the first touch persists. Second, when the first touch disappears near the first edge, a virtual signal is continuously sent to an operating system of the electronic device for a specific time. Third, it is determined whether a second touch near the second edge is detected by the second touch screen within a certain time. Fourth, if yes, the virtual signal is stopped and a touch signal corresponding to the second touch is sent to the operating system. Fifth, it is determined by the operating system to generate a cross-screen operation across the first touch screen and the second touch screen.

In an embodiment of the present invention, the method for identifying the cross-screen operation described above further includes the following steps. When the last detected distance of the first touch and the first edge are less than a first preset value, it is determined that the first touch disappears near the first edge.

The present invention provides an electronic device including an operating system, a first touch screen, a second touch screen, and a multi-screen control module. The first touch screen has a first edge. The second touch screen has a second edge and the second edge is adjacent to the first edge. The multi-screen control module is coupled to the first touch screen, the second touch screen and the operating system. When the first touch screen continuously detects a first touch, the multi-screen control module continuously sends a virtual signal to the job within a certain time when it is determined that the first touch disappears near the first edge. The system, and when the second touch screen detects a second touch close to the second edge within a certain time, the multi-screen control module stops emitting the virtual signal, and the touch signal corresponding to the second touch Sending to the operating system to determine, by the operating system, a cross-screen operation across the first touch screen and the second touch screen.

Based on the above, the present invention provides a method for recognizing a cross-screen operation and an electronic device using the same, which utilizes a transmission virtual signal to enable the operating system to effectively recognize the user's cross-screen operation without requiring additional software or electronic installation on the electronic device. Is to modify the operating system.

The above described features and advantages of the present invention will be more apparent from the following description.

FIG. 1 is a schematic diagram of an electronic device 100 according to an embodiment of the invention. Referring to FIG. 1 , the electronic device 100 includes a first touch screen 110 , a second touch screen 120 , a multi-screen control module 130 , and an operating system 140 . The first touch screen 110 has a first edge adjacent to the second edge of the second touch screen 120. In detail, the first touch screen 110 and the second touch screen 120 can be coupled to each other by a connecting member such as a pivot or a rotating shaft, so that the first edge is adjacent to the second edge. Alternatively, the first touch screen 110 and the second touch screen 120 may not be coupled to each other, but when the user puts the first touch screen 110 and the second touch screen 120 into a side-by-side state, the first The edge is adjacent to the second edge.

For example, the first touch screen 110 and the second touch screen 120 can each display a portion of the same window screen, and the first edge of the first touch screen 110 and the second edge of the second touch screen 120 After being arranged side by side, the window picture can constitute a complete picture extending continuously from the first touch screen 110 to the second touch screen 120. In another example, the first touch screen 110 and the second touch screen 120 can each display different working windows, but can be operated by the user, so that two different windows have an interactive relationship. For example, the object of the window of the first touch screen 110 is moved into the window of the second touch screen 120.

In addition, the multi-screen control module 130 is coupled to the first touch screen 110 and the second touch screen 120 . The multi-screen control module 130 is configured to transmit a touch signal that the user touches to the operating system 140 or transmit the virtual signal to the operating system 140 under appropriate conditions.

The operating system 140 is a program for managing the hardware and software of the electronic device 100. The main functions include configuring internal memory, determining the priority of system resource allocation, controlling input and output devices, operating the network, and managing the file system. In addition, the operating system 140 also provides an operation interface for the user to interact with the electronic device 100, so that the user can manipulate the electronic device 100 by a touch operation on the operation interface. In particular, in the present embodiment, the operating system 140 can determine whether the user makes a touch operation across the screen according to the signal transmitted from the multi-screen control module 130.

In order to further explain the detailed operation of the electronic device 100, the present invention will be described below with reference to another embodiment.

2 is a flow chart of a method for identifying a cross-screen operation according to an embodiment of the invention. Referring to FIG. 1 and FIG. 2 together, first, the first touch is detected through the first touch screen 110 (step S210). Then, as shown in step S220, the multi-screen control module 130 repeatedly determines whether the first touch persists. In detail, as long as the first touch screen 110 detects the user's touch, the first touch screen 110 transmits the touch signal corresponding to the touch to the multi-screen control module 130. Therefore, the multi-screen control module 130 can determine whether the user continues to touch the first touch screen 110 by using a finger (or an input tool) by continuously receiving the touch signal.

Once the multi-screen control module 130 determines that the first touch disappears, then as shown in step S225, the multi-screen control module 130 determines whether the first touch disappears near the first edge.

If the multi-screen control module 130 determines that the first touch does not disappear near the first edge, the flow of the identification method of the cross-screen operation of the embodiment is ended.

If the multi-screen control module 130 determines that the first touch disappears near the first edge, the multi-screen control module 130 continues to send the virtual signal to the operating system 140 of the electronic device 100 for a specific time as shown in step S230. . In this step, the multi-screen control module 130 obtains the screen coordinate position of the first touch on the first touch screen 110 when the first touch screen 110 detects the first touch for the first time (hereinafter referred to as For the first screen coordinate position). In detail, since the first touch screen 110 continuously (for example, every predetermined period), the touch signal corresponding to the user touch is transmitted to the multi-screen control module 130, and the touch signal includes The location of the screen coordinates touched by the user. Therefore, when the multi-screen control module 130 does not receive the touch signal for more than the preset period, the first touch screen 110 does not detect any touch. The multi-screen control module 130 defines the position of the screen coordinate included in the last received touch signal as the first screen coordinate position. In the present embodiment, the virtual signal sent to the operating system 140 will include the first screen coordinate position. In this case, since the operating system 140 continues to receive the virtual signal, the operating system 140 will still believe that there is still an object continuously touching the first screen coordinate position of the first touch screen 110, so it will still be on the first screen. The coordinate position responds accordingly. For example, if the user previously selects an object (eg, an application icon) through the first touch screen 110 and then drags it to the first screen coordinate position, the operating system 140 will cause the virtual signal to continue to be received during the continuous receipt of the virtual signal. The object remains in the selected state.

Next, as shown in step S240, the multi-screen control module 130 determines whether a second touch near the second edge is detected by the second touch screen 120 within a certain time. It is determined whether the user touches the edge of the second touch screen 120 adjacent to the first touch screen 110 within a certain time. If the second touch screen 120 does not detect the second touch near the second edge within a certain time, the operating system 140 determines that the user has not performed a touch operation across the screen. At this time, the flow of the recognition method of the cross-screen operation of the present embodiment is ended.

If the determination result in the step S240 is YES, the multi-screen control module 130 stops sending the virtual signal and sends the touch signal corresponding to the second touch to the operating system 140 as shown in step S250. That is, in this step, the signal received by the operating system 140 will be converted from a virtual signal to a touch signal that is responsive to the second touch. Next, in step S260, the operating system 140 determines to generate a cross-screen operation across the first touch screen 110 and the second touch screen 120. In other words, in the perspective of the operating system 140, the user is considered to have touched the first touch screen 110 as a starting point and performs a cross-screen operation from the first touch screen 110 to the second touch screen 120. The operating system 140 performs an action corresponding to the cross-screen operation on the electronic device 100. For example, if the user has dragged an object to the first screen coordinate position of the first touch screen 110, the operating system 140 will drag the object from the first touch screen 110 to the second touch screen 120 by dragging. Further, since the touch signal transmitted by the multi-screen control module 130 to the operating system 140 in step S250 includes the second touch screen position on the second touch screen 120, the operating system 140 The above position displays an object that is dragged to the second touch screen 120.

In the above embodiment, the specific time may be 1 second, but the invention is not limited thereto. Further, the specific time is, for example, an average time required for a general user to perform a cross-screen operation, which can be obtained through experiments or statistics, and stored in advance in the electronic device 100. In other embodiments, the user may also define the length of time for a particular time according to personal habits.

3A, FIG. 3A illustrates how the multi-screen control module 130 determines whether the first touch is disappearing near the first edge, and how the multi-screen control module 130 determines the second touch screen according to FIG. 3B and FIG. 3C. 120 detects whether a second touch is near the second edge.

As shown in FIG. 3A, the first edge FEG of the first touch screen 110 is adjacent to the second edge SEG of the second touch screen 120. It is assumed that the first touch screen 110 detects the position of the first touch for the last time as indicated by the finger FGR. Since the shortest distance between the finger FGR and the first edge FEG is smaller than the first preset value FP, the multi-screen control module 130 It is determined that the first touch disappears near the first edge FEG, and then the virtual signal is transmitted to the operating system 140 within a certain time. In other words, when the first touch screen 110 can no longer detect the first touch, the multi-screen control module 130 determines whether the shortest distance between the position of the finger FGR and the first edge FEG is less than the first pre-detection. Set the value FP. If so, it is determined that the first touch disappears near the first edge FEG.

3B and 3C are definitions of two specific regions, respectively.

As shown in FIG. 3B, the specific area 123 (indicated by oblique lines in FIG. 3B) is a rectangular area having the same length as the second edge SEG and having a width of the second preset value SP. In this embodiment, when the multi-screen control module 130 has to determine whether a second touch near the second edge SEG is detected by the second touch screen 120 within a certain time, it is determined whether it is at a specific time. A second touch located in the specific area 123 is detected by the second touch screen 120. The second touch located in the specific area 123 indicates that the shortest distance from the second edge SEG is smaller than the second preset value SP.

In the embodiment of FIG. 3C, the specific area 123 (indicated by oblique lines in FIG. 3C) is a rectangular area having a length smaller than the length of the second edge SEG but having a width of the second preset value SP. The rectangular area mentioned above is close to the position of the first touch screen 110 before the last touch. That is, the height of the center of the rectangular area is the same as the height of the first touch screen 110 before the last touch. Further, the multi-screen control module 130 obtains the first screen coordinate position of the first touch when the first touch screen 110 detects the first touch, and then obtains the proximity on the second touch screen 120. The second screen coordinate position of the first screen coordinate position (for example, the heights of the two coordinate positions are equal), and a specific area including the second screen coordinate position is defined on the second touch screen 120. As in the embodiment of FIG. 3B, in the embodiment, the multi-screen control module 130 also determines whether the second touch located in the specific area 123 is detected by the second touch screen 120 within a certain time. Moreover, the second touch located in the specific area 123 indicates that the shortest distance from the second edge SEG is smaller than the second preset value SP.

For example, the first preset value FP and the second preset value SP are about 50 pixels in length. However, the values of the first preset value FP and the second preset value SP may be determined according to the size of the first touch screen 110 and the second touch screen 120, but the first preset value FP and the second preset of the present invention. The set value SP is not limited to 50 pixels. It should be particularly noted that the specific area 123 of the embodiment of the present invention is close to the first screen coordinate position, but the shape size can be customized by the user, and is not limited to the above range.

Embodiments of the multi-screen control module 130 of the electronic device 100 will be described below with reference to FIGS. 4 and 5.

As shown in FIG. 4, the multi-screen control module 130 of this embodiment includes a control unit 431 and a driver 433. The control unit 431 is coupled to the first touch screen 110 and the second touch screen 120 , and the driver 433 is coupled to the control unit 431 and the operating system 140 . Referring to FIG. 2 and FIG. 4 together, when step S225 of FIG. 2 is performed, the present embodiment determines whether the first touch disappears near the first edge by the control unit 431. When the control unit 431 determines that the first touch disappears near the first edge, the virtual signal transmitted to the operating system 140 is also continuously generated by the control unit 431 for a specific time. Alternatively, in another embodiment, when the control unit 431 determines that the first touch disappears near the first edge, the driver 433 continues to generate the virtual signal transmitted to the operating system 140 for a specific time. When the step S240 of FIG. 2 is performed, the control unit 431 determines whether the second touch screen 120 detects the second touch near the second edge within a specific time. When the control unit 431 determines that the second touch screen 120 detects the second touch near the second edge within a certain time, the control unit 431 or the driver 433 that generates the virtual signal performs the steps. The action of S250, that is, stop generating virtual signals.

As shown in FIG. 5, the multi-screen control module 130 of the present embodiment includes a first screen control unit 535, a second screen control unit 537, and a driver 533. The first screen control unit 535 is coupled to the first touch screen 110, the second screen control unit 537 is coupled to the second touch screen 120, and the driver 533 is coupled to the first screen control unit 535, the second screen control unit 537, and Operating system 140. Please refer to FIG. 2 and FIG. 5 together. In step S225, it is determined by the first screen control unit 535 whether the first touch disappears near the first edge. If the first screen control unit 535 determines that the first touch disappears near the first edge, the driver 533 continues to generate the virtual signal transmitted to the operating system 140 for a specific time. When the process proceeds to step S240, the second screen control unit 537 determines whether the second touch screen 120 detects the second touch near the second edge within a certain time. Next, when the second screen control unit 537 determines that the second touch screen 120 detects the second touch near the second edge within a certain time, the process proceeds to step S250, and the driver 533 stops generating the virtual signal.

In summary, the present invention provides a method for identifying a cross-screen operation and an electronic device using the same. The identification method is to use the electronic device to record the first screen coordinates when the user's touch disappears on the edge of the screen. And the virtual signal is continuously sent for a certain period of time, so that the operating system responds to the virtual signal and continues the original corresponding touch action. On the other hand, if the electronic device detects the user's touch on another screen within the specified time, the virtual signal is stopped and the actual touch signal is sent to the operating system. At this time, the operating system determines that the user performs the cross-screen operation, and continues to perform the corresponding cross-screen operation on the electronic device through the internal touch operation mechanism. Accordingly, it is avoided that the user's finger can not continue to detect the touch because the user's finger slides out of the edge of the screen, causing the operating system to misjudge the touch operation to stop. Therefore, the cross-screen recognition method and the electronic device of the present invention can effectively recognize the operation of the user across the screen. Further, the multi-screen touch operation problem can be solved without additional software installation or changing the operating system.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the invention, and any one of ordinary skill in the art can make some modifications and refinements without departing from the spirit and scope of the invention. The scope of the invention is defined by the scope of the appended claims.

100. . . Electronic device

110. . . First touch screen

120. . . Second touch screen

130. . . Multi-screen control module

140. . . working system

S210~S260. . . step

123. . . Specific area

FEG. . . First edge

SEG. . . Second edge

FP. . . First preset value

SP. . . Second preset value

FGR. . . finger

431. . . control unit

433, 533. . . Driver

535. . . First screen control unit

537. . . Second screen control unit

FIG. 1 is a schematic diagram of an electronic device according to an embodiment of the invention.

2 is a flow chart of a method for identifying a cross-screen operation according to an embodiment of the invention.

3A-3C are schematic diagrams showing a cross-screen operation according to an embodiment of the invention.

4 is a schematic diagram of an electronic device according to another embodiment of the present invention.

FIG. 5 is a schematic diagram of an electronic device according to still another embodiment of the present invention.

S210~S260. . . step

Claims (10)

A cross-screen operation identification method for an electronic device having a first touch screen and a second touch screen, wherein a first edge of the first touch screen is adjacent to one of the second touch screens The second edge, the method includes: detecting a first touch through the first touch screen, and determining whether the first touch persists; when the first touch disappears near the first edge, Continuously sending a virtual signal to an operating system of the electronic device for a specific time; determining whether a second touch close to the second edge is detected by the second touch screen during the specific time; if Stopping the sending of the virtual signal, and transmitting a touch signal corresponding to the second touch to the operating system; and determining, by the operating system, a span across the first touch screen and the second touch screen Screen operation. The method of claim 1, further comprising: determining that the first detected position of the first touch and the shortest distance of the first edge are less than a first preset value A touch disappears near the first edge. The method of claim 1, wherein the step of determining whether the second touch is detected by the second touch screen during the specific time comprises: determining whether the specific The second touch screen detects that the shortest distance from the second edge is less than a second preset value by the second touch screen. The method of claim 1, wherein the step of determining whether the second touch is detected by the second touch screen during the specific time comprises: obtaining the first touch a first screen coordinate position of the first touch when the first touch is detected by the control screen; obtaining a second screen coordinate position adjacent to the first screen coordinate position on the second touch screen Determining, on the second touch screen, a specific area including the position of the second screen coordinate; and determining whether the second touch is located in the specific area by the second touch screen during the specific time . An electronic device comprising: an operating system; a first touch screen having a first edge; a second touch screen having a second edge, the second edge being adjacent to the first edge; and a The multi-screen control module is coupled to the first touch screen, the second touch screen, and the operating system; wherein, when the first touch screen continuously detects a first touch, the multi-screen control mode After determining that the first touch disappears near the first edge, the group continuously sends a virtual signal to the operating system for a specific time, and detects that the second touch screen detects the proximity within the specific time. When the second edge of the second edge is touched, the multi-screen control module stops sending the virtual signal, and sends a touch signal corresponding to the second touch to the operating system for determination by the operating system. A cross-screen operation spanning the first touch screen and the second touch screen. The electronic device of claim 5, wherein when the first touch screen last detects that the position of the first touch and the shortest distance of the first edge are less than a first preset value The multi-screen control module determines that the first touch disappears near the first edge. The electronic device of claim 5, wherein the multi-screen control module determines whether the second touch screen is detected during the specific time after the virtual signal is sent to the operating system. The shortest distance of the two edges is less than the second touch of the second preset value. The electronic device of claim 5, wherein the multi-screen control module obtains a first screen coordinate position of the first touch when the first touch screen detects the first touch Obtaining a second screen coordinate position adjacent to the first screen coordinate position on the second touch screen, and defining a specific area including the second screen coordinate position on the second touch screen; the multi-screen After the virtual signal is sent to the operating system, the control module determines whether the second touch screen detects the second touch in the specific area within the specific time. The electronic device of claim 5, wherein the multi-screen control module comprises: a control unit coupled to the first touch screen and the second touch screen to determine whether the first touch is Disappearing near the first edge, and determining whether the second touch screen detects the second touch close to the second edge within the specific time; and a driving program coupling the control unit with the An operating system, wherein when the control unit determines that the first touch disappears near the first edge, one of the control unit and the driver continuously generates the virtual signal sent to the operating system during the specific time And when the control unit determines that the second touch screen detects the second touch close to the second edge within the specific time, stopping generating the virtual signal. The electronic device of claim 5, wherein the multi-screen control module comprises: a first screen control unit coupled to the first touch screen to determine whether the first touch is close to the first A second screen control unit is coupled to the second touch screen to determine whether the second touch screen detects the second touch near the second edge within the specific time; And a driver coupled to the first screen control unit, the second screen control unit, and the operating system; wherein when the first screen control unit determines that the first touch disappears near the first edge, the The driver continuously generates the virtual signal sent to the operating system during the specific time, and determines, by the second screen control unit, that the second touch screen detects the second edge that is close to the second edge. When the two touches, the driver stops generating the virtual signal.