TWI636382B - Touch sensitive electronic system, processing apparatus and method thereof for simulating stylus as joystick - Google Patents

Abstract

A touch processing method for simulating a stylus as a joystick includes: maintaining a mode parameter to record an operation mode of the stylus; detecting the stylus relative to the touch panel through a touch panel a position, a stylus axial direction and an inclination angle; and when the mode parameter is a rocker mode, converting the stylus axial direction and the inclination angle into a first axis inclination angle and a second axis Inclining angle, and transmitting the first axis tilt angle and the second axis tilt angle to an application through a rocker driver, and when the mode parameter is a stylus mode, transmitting the position to a touch driver The joystick driver, the touch driver and the application are all run under a working system executed by a central processor of a host.

Description

 Touch electronic system, touch processing device and method for simulating stylus as rocker  

The present invention relates to a touch system, and more particularly to a touch system capable of detecting a tilt angle and an axial direction of a touch pen corresponding to the touch pen, so as to use the touch pen as a rocker. .

More and more modern electronic devices use touch panels or touch screens as the primary input/output device. Instead of just using finger input, the touch panel/screen can also detect the stylus. Since the tip of the stylus is thinner than the finger, the position can be input more accurately.

Some applications require the use of another input device: a joystick, such as a Computer-Aided Design (CAD) software, a flight simulation game, or other games. In the case of a flight simulation game, the joystick can be used to control both the roll and pitch axes of the aircraft. Combined with other input devices such as a keyboard or touch panel to control the yaw axis and throttle, the aircraft's motion in three dimensions can be fully simulated.

Figure 1 is a Figure 7 of U.S. Patent No. 6,429,849, which is a schematic view of a conventional rocker. It can be seen that there is a complicated mechanism under the rocker handle 123 for detecting and outputting the roll amount of the X roll axis, the Y roll axis and the Z roll axis. Accordingly, the axial direction and the inclination angle of the handle 123 can be derived. For the sake of convenience, when the handle 123 is not subjected to any force, the roll amount of the X roll axis, the Y roll axis and the Z roll axis is zero, and the handle 123 should be parallel to the Z axis and perpendicular to XY plane.

When the handle 123 is forced to the F direction, there is a roll amount of the X roll shaft. When the handle 123 is forced to the L direction, there is a roll amount of the Y roll axis. When the amount of rolling of at least one of the X or Y rolling axes is not zero, the handle 123 and the XY plane have an inclination angle and an axial direction. In other words, the amount of rolling of the X and Y rolling shafts can be converted into the inclination angle and the axial direction of the handle 123. On the other hand, knowing the inclination angle and the axial direction of the handle 123, the amount of rolling of the X and Y rolling shafts can also be converted.

As can be seen from Figure 1, the conventional rocker has a very large number of mechanical parts. Due to the large number of movable parts, and the fact that the user may treat the rocker rudely, the failure rate of the conventional rocker is very high. Moreover, because the price of the joystick is not high, the chance of direct discarding after a failure is greatly increased. Therefore, there is a need in the market for a touch system that can use the stylus as a joystick, allowing the user to have a variety of input experiences using a single device, and different types of control methods can be implemented.

According to an embodiment of the invention, an electronic system is provided for simulating a stylus as a joystick, comprising: a host, a stylus, a touch panel, and a touch processing device. The host computer includes a memory and a central processing unit connected to the memory, the central processor is configured to execute an operating system, a joystick driver and a touch driver running under the operating system, and connected to the An app for the joystick driver. The touch processing device is connected to the touch panel and the central processing unit for detecting a position of the stylus relative to the touch panel, a stylus axial direction and a tilt angle through the touch panel. The touch processing device maintains a mode parameter to record an operation mode of the stylus. When the mode parameter is a rocker mode, the touch processing device converts the stylus axial direction and the tilt angle into one a first axis inclination angle and a second axis inclination angle, and transmitting the first axis inclination angle and the second axis inclination angle to the application through the rocker driver, when the mode parameter is a stylus mode, the touch The control processing device transmits the position to the touch driver.

According to an embodiment of the invention, a touch processing device is provided for simulating a stylus as a joystick, comprising: a touch panel interface for connecting electrodes of a touch panel; a host interface, a central processing unit connected to a host computer for executing an operating system, a joystick driver and a touch driver running under the operating system, and an application connected to the joystick driver And a microprocessor connected to the touch panel interface and the host interface for detecting a position of the stylus relative to the touch panel through the touch panel, a stylus axial direction and a a tilt angle, wherein the microprocessor maintains a mode parameter to record an operation mode of the stylus. When the mode parameter is a rocker mode, the microprocessor converts the stylus axial direction and the tilt angle to a first axis tilt angle and a second axis tilt angle, and the first axis tilt angle and the second axis tilt angle are transmitted to the application through the rocker driver, when the mode parameter is a stylus mode, Micro processing The location of touch transmitted to the driver.

According to an embodiment of the invention, a stylus is provided for simulating a stylus as a rocker, comprising: a first end; and a second end opposite to the first end, wherein the first end Having a different touch area, shape, or directionality with the second end, such that the touch processing device is aware that the stylus contacts the touch panel with the first end or the second end, when the first When one end touches the touch panel, the stylus is simulated as a rocker.

According to an embodiment of the present invention, a stylus is provided for simulating a stylus as a joystick, including: a first end; and a second end opposite to the first end, wherein the stylus The first end and the second end emit different electrical signals, so that a touch processing device can know that the stylus contacts the touch panel with the first end or the second end, when the first end When the touch panel is touched, the stylus is simulated as a rocker.

According to an embodiment of the present invention, a touch processing method for simulating a stylus as a joystick includes: maintaining a mode parameter to record an operation mode of a stylus; detecting the stylus through a touch panel a position of the stylus relative to the touch panel, a stylus axial direction and an oblique angle; and when the mode parameter is a rocker mode, converting the stylus axial direction and the tilt angle into one a first axis inclination angle and a second axis inclination angle, and transmitting the first axis inclination angle and the second axis inclination angle to an application through a rocker driver, when the mode parameter is a stylus mode, The position is transmitted to a touch driver, wherein the joystick driver, the touch driver and the application are all run under a working system executed by a central processor of one of the hosts.

According to an embodiment of the present invention, a stylus control method is provided for simulating a stylus as a joystick, the stylus including a first end and a second end opposite to the first end, The control method includes: transmitting a first electrical signal through the first end; and transmitting a second electrical signal through the second end, wherein the first electrical signal is different from the second electrical signal, such that the touch processing device It is known that the stylus contacts the touch panel with the first end or the second end. When the first end contacts the touch panel, the stylus is simulated as a rocker.

According to the touch electronic system, the touch processing device and the method provided by the present invention, and the stylus and the control method thereof, the stylus can be simulated as a joystick, and the user has multiple input experiences using the same device. Different kinds of control methods can be implemented. In particular, the user can use the stylus that touches the touch panel as a rocker.

700‧‧‧Touch Electronic System

701‧‧‧First stylus

702‧‧‧second stylus

710‧‧‧ touch panel

711‧‧‧First rocker area

712‧‧‧Second rocker area

720‧‧‧ touch processing device

721‧‧‧Touch panel interface

722‧‧‧Microprocessor

723‧‧‧Host interface

730‧‧‧Host

740‧‧‧Operating system

741‧‧‧Touch Driver

742‧‧‧Joystick driver

750‧‧‧Application

800‧‧‧ stylus

810‧‧‧ first end

820‧‧‧ second end

910~950‧‧‧Steps

1010~1020‧‧‧Steps

Figure 1 is Figure 7 of U.S. Patent No. 6,429,849.

2A-2C are three views of a tilt angle and an axial direction of a touch pen corresponding to a touch panel according to an embodiment of the invention.

3 is a schematic diagram of a stylus controlling a three-dimensional object model roll in a rocker mode according to an embodiment of the invention.

4 is a schematic diagram of a stylus controlling a three-dimensional object model roll in a rocker mode according to an embodiment of the invention.

FIG. 5 is a schematic diagram of a stylus controlling the movement of a three-dimensional object model in a rocker mode according to an embodiment of the invention.

6 is a schematic diagram of a stylus controlling a three-dimensional object model scaling or a viewing angle zoom in a rocker mode according to an embodiment of the invention.

FIG. 7 is a block diagram of an electronic system in accordance with an embodiment of the invention.

FIG. 8 is a schematic diagram of the appearance of a stylus according to an embodiment of the invention.

FIG. 9 is a schematic flow chart of a touch processing method according to an embodiment of the invention.

FIG. 10 is a schematic flow chart of a method for controlling a stylus according to an embodiment of the invention.

The invention will be described in detail below with some embodiments. However, the invention may be applied to other embodiments in addition to the disclosed embodiments. The scope of the present invention is not limited by the embodiments, which are subject to the scope of the claims. To provide a clearer description and to enable those skilled in the art to understand the invention, the various parts of the drawings are not drawn according to their relative dimensions, and the ratio of certain dimensions to other related dimensions will be highlighted. The exaggerated and irrelevant details are not completely drawn to illustrate the simplicity of the illustration.

The present application mainly relates to a touch system capable of detecting a tilt angle and an axial direction of a touch pen corresponding to the touch panel, so as to use the touch pen as a rocker. The user can use the stylus that touches the touch panel as a rocker, and the touch system can regard the tilt angle and the axial direction of the stylus as the axial and tilt angles of the rocker.

The touch system in the present application basically comprises three components: a stylus, a touch panel and a touch processing device connected to the touch panel. The touch panel can be a traditional touch panel or a touch screen. The touch processing device can use the touch panel to detect the tilt angle and the axial direction of the touch pen corresponding to the touch panel, and the position of the touch pen corresponding to the touch panel. In addition to detecting the stylus, the touch system can also detect external conductive objects that do not actively emit electrical signals, such as fingers and palms. However, the present application does not limit how the touch system detects the position, tilt angle and axial direction of the stylus, and more than one mechanism can be used to detect the stylus and/or the external conductive object.

The touch processing device can be implemented by using a software, a hardware, or a combination of software and hardware. It may include an analog circuit, a digital circuit, and a digital signal processor and/or an embedded processor for executing the firmware to calculate the position, tilt angle, and axial direction described above. Since the touch processing device must be connected to the touch panel and perform special functions to obtain the tilt angle, the axial direction, and the spin angle of the stylus. Therefore, the touch processing device is not only a generic computer, but only provides general computer functions. The touch processing device may include an analog front end (AFE) and a digital back-end. The analog front end can include, but is not limited to, special circuits such as multiplexers, integrating circuits, and signal amplifiers. The digital back end can include, but is not limited to, a special circuit such as a digital signal processor (DSP), an accumulator, a multiplier, and a digital clock generator. In order to maintain a certain reporting rate of touch events, the touch processing device must include the above special circuit to speed up the processing, and can not be realized by simply using general computer functions. As far as the Applicant is aware, all touch processing devices currently on the market are not implemented using only general-purpose computer functions. As for the stylus and the touch panel, it is not a component that can be realized by simply using a general computer function.

Please refer to FIG. 2A to FIG. 2C , which are three views of a tilt angle and an axial direction of a touch pen corresponding to a touch panel according to an embodiment of the invention. The touch panel can be regarded as an XY plane, the stylus is indicated by a bold arrow, and the arrow end is a pen tip. 2A is a perspective view of the XY plane, the axial direction of the stylus is directed to the left of the XY plane, that is, parallel to the X-axis. The axial direction referred to in the present application generally refers to the direction in which the pen shaft of the stylus is projected on the plane of the touch panel, as shown in FIG. 2A.

2B is a schematic view projected on the XZ plane, wherein the stylus can be seen at an angle of 60 degrees to the touch panel on the XZ plane. Therefore, the angle between the stylus and the Z axis is 30 degrees. Since the pen body axis of the stylus is parallel to the X axis, the angle between the stylus and the touch panel is also 60 degrees. 2C is a schematic view projected on the YZ plane, and the angle between the stylus and the touch panel on the YZ plane is 90 degrees. Therefore, the angle between the stylus and the Z axis is 0 degrees.

The tilt angle referred to in the present application may refer to the angle between the body axis of the stylus pen and the touch panel, and may also refer to the angle between the body axis of the stylus pen and the Z axis. One of ordinary skill in the art will appreciate that the two can be easily extrapolated from each other.

It can be seen from the examples in FIGS. 2A-2C that when the touch system regards the stylus as the rocker of FIG. 1, the 90 degree of FIG. 2C can be regarded as the roll amount of the X roll axis, and FIG. 2B 60 degrees is regarded as the amount of roll of the Y roll axis. When the touch system measures the tilt angle of the stylus, the roll amount of the X roll axis and the roll amount of the Y roll axis can be converted. The two pieces of information are then transferred to the operating system or application, and the stylus can be simulated as a joystick.

In one embodiment, the touch system can be coupled to the joystick driver in the operating system to report the amount of roll of the X roll shaft and the roll amount of the Y roll axis to the joystick driver. It is then reported by the joystick driver to the application that subscribes to the software interrupt service. In another embodiment, the touch system can be modeled as a joystick driver and reported to an application that subscribes to the software interrupt service.

In an embodiment, the joystick driver can provide more parameters, such as a report rate reported several times per second, a roll rate derived from the roll amount, a rocker number, and various senses on the joystick. State of the device, etc. Among them, various sensors include buttons, multi-segment knobs, stepless knobs, pressure sensing values, and even another small rocker on the rocker. When there is a corresponding sensor on the stylus, the status of the sensors and the battery level and/or stylus code can also be passed back to the real or analog joystick driver.

In the conventional rocker diagram of Fig. 1, the amount of rolling of the Z roll axis can be detected. When comparing to the stylus, it can be interpreted as the amount of roll of the remote control pen around the pen axis. If the touch system can detect the amount of roll of the remote control pen around the pen shaft, it can also be regarded as the roll amount of the Z roll axis of the conventional rocker.

In some embodiments, the tip of the stylus has a pressure sensor that detects the pressure applied by the tip to the touch panel. When corresponding to certain applications, the pressure value can be used to correspond to the rate of movement of the manipulated object. For example, the traditional rocker controls the character movement of the video game by using the roll amount of the X and Y roll axes to control the direction in which the character moves. The stylus shown in Figures 2A~2C can control the person to move to the left or right of the screen. In some examples, the tilt angle can be utilized to control the rate at which a person moves. For example, the closer the stylus is to vertical, the smaller the moving rate, and vice versa. However, the pressure value can also be used to regulate the rate at which the character moves. For example, the greater the pressure, the faster the rate of movement, and vice versa, the smaller the rate of movement.

In other embodiments, the tilt angle can be utilized to control the movement of the window content. As shown in the stylus of Figure 2, the content of the window can be controlled to scroll to the left or right. The pressure value can be used to adjust the rate at which the window content scrolls, for example to control the rate of movement of the file. In another example, the pressure value can be used to adjust the magnification of the window content. For example, the greater the pressure, the greater the magnification, and vice versa. In one example, when the stylus is perpendicular to the touch panel, the pressure value is used to adjust the magnification of the window content. When the stylus is not perpendicular to the touch panel, the pressure value is used to adjust the scrolling rate of the window content.

In another example, when the tilt angle of the stylus is maintained for a certain period of time, but the nib position is moved, all or a portion of the window content can be arbitrarily dragged. In this example, the above function can be activated when the pressure value is greater than a certain threshold. It is also possible to maintain the above-mentioned function in the axial direction for a certain period of time.

The application does not limit the connection manner of the stylus and the touch processing device, and the two can be connected by wire, for example, through a dedicated interface or an industrial interface such as USB. It is also possible to connect wirelessly, for example via an industrial interface such as a proprietary interface or Bluetooth. The signal can also be sent through the tip of the stylus, and the touch processing device receives the signals through the touch panel. The touch processing device can also send signals through the touch panel, so that the stylus receives the signals through the pen tip segment, thereby achieving the process of communicating with each other. These signals can be modulated in analogy or digitally. In the embodiment described above, at least the sensor state on the stylus can be transmitted to the touch processing device.

In some embodiments, the stylus includes not only the sensor or input device described above, but also an output device such as an audio, video or tactile output device. For example, the application can use the driver to cause the touch processing device to cause the stylus to emit sound, light and/or vibration to prompt certain state changes of the application.

The present application does not limit when the touch processing device should use the stylus related information as a joystick related message output. In one embodiment, the touch processing device has a mode parameter corresponding to each stylus. The mode parameter may indicate that the stylus is in the stylus mode or in the joystick mode.

In an embodiment, the stylus may include a button or input device. The user can use the button or the input device to switch the stylus to the rocker mode or the stylus mode. In another embodiment, when the user touches the touch panel with the first end of the stylus, the stylus mode is set. When the user touches the touch panel with the second end of the stylus, the rocker mode is set. For example, the first end and the second end of the stylus have different touch areas, shapes, or directionalities, so that the touch processing device knows that the stylus contacts the touch panel with the first end or the second end. In a further embodiment, the stylus can be set by using a software to set a mode of a stylus through an application or an operating system setting option. In an embodiment, the stylus used by the electronic device can be switched into a rocker mode or a stylus mode by using a button or an input device of the electronic device.

In one embodiment, the tip or first end of the stylus includes a pressure sensing element. The stylus itself may include a pressure calculation device that measures the pressure experienced by the pressure sensing element, and the pressure calculation device transmits the measured pressure value to the touch processing device. For example, after the pressure value is modulated, the touch processing device demodulates the pressure value of the detected electrical signal through the touch panel through the electrical signal emitted by the pen tip. Or transmit the pressure value to the touch processing device using a wired or wireless communication protocol. The stylus may also include a pressure calculation device that measures the pressure of the pressure sensing component, but transmits the electrical signal through the inactive component to adjust the pressure value, and the touch processing device transmits the electrical signal through the touch panel. The pressure value in the signal is demodulated back. Or the touch panel and the touch processing device include a pressure sensing function, and the pressure value between the stylus and the touch panel can be directly perceived without installing a pressure sensing component on the stylus or sending any pressure-related signal. . Regardless of the method of knowing the pressure value, when the touch processing device detects that the pressure value exceeds a certain threshold value, the stylus is switched to the rocker mode.

In one embodiment, the first end of the stylus has a mechanical structure, such as a cassette or switch. The mechanical structure is fixed to an activated state or a second state when subjected to a pressure greater than a threshold value. When again subjected to a pressure greater than another or the same threshold value, the mechanical structure returns to the relaxed state or the first state. The stylus can transmit the state of the mechanical structure back to the touch processing device in any form. The touch processing device can switch the stylus to the rocker mode or the stylus mode according to the state of the mechanical structure.

In an embodiment, the mechanical structure can be a button that functions like a button on a mouse. The mechanical structure records an action and can be considered as a button or click. The mechanical structure records two consecutive actions and is considered a double button or double click. When pressed, the mechanical structure records the action of pressing the pressed. The stylus can transmit the state of the mechanical structure back to the touch processing device in any form. The touch processing device can switch the stylus to the rocker mode or the stylus mode according to the state of the mechanical structure. For example, the action of a click or double click can be switched in the joystick mode or the stylus mode. Alternatively, after pressing for a while, you can switch between the joystick mode or the stylus mode.

In an embodiment, a certain area of the touch panel can be set as a rocker area. When the tip position of the stylus enters the rocker area, the touch processing device sets the stylus to the rocker mode. When the nib position is away from the rocker area, the touch processing device returns the stylus to the stylus mode. In another embodiment, the range of the rocker area can be controlled by the operating system or application. In a further embodiment, the touch panel can include a plurality of rocker areas, each of which can accommodate a stylus.

One difference between the stylus and the joystick is that the contact position of the stylus with the touch panel is not fixed, and the rocker has a fixed fulcrum. Therefore, it is more difficult for the user to use the stylus as a joystick. In some cases, you can limit the stylus's rocker mode to the output of the 壹 dimension. For example, the amount of roll of the X roll axis of the stylus can be neglected, and only the roll amount of the Y roll axis can be output. It is also possible to ignore the amount of roll of the Y roll axis of the stylus and output only the roll amount of the X roll axis. It is also possible to synthesize the roll amount of the X and Y roll axes into a roll vector and output the synthesized roll vector. These methods are used to reduce the difficulty of simulating the joystick. For example, in a simulated flight game, the left stylus is used as a throttle that can only be scrolled back and forth, and the stylus on the right can be used as a two-dimensional scroll. Controller. Or in the game of simulating the chariot driving, the stylus on the left and right sides respectively control the crawler belts on the left and right sides, and the two analog rockers can only roll back and forth.

In the touch system provided by the present application, the user can use the stylus to manipulate a three-dimensional object model in an application, such as a three-dimensional object model in a Computer-Aided Design application, and three-dimensional printing. Models in the application, etc.

In one embodiment, the user may first associate the cursor or indicator to an object or collection of objects in the stylus mode. After correlating to an object or collection of objects, the user controls the axial direction of the stylus in the rocker mode to control the direction of rotation of the object. For example, as shown in FIG. 3, when the user tilts the stylus to the right, the tip of the pen points axially to the left of the touch panel. Then the related object rolls to the right. Similarly, when the user tilts the stylus up and the tip axis points below the touch panel, the related object rolls up.

As shown in FIG. 4, when the user twists the stylus along the axial direction of the stylus pen shaft, the related object will roll along an axial direction. In the embodiment of FIG. 4, the axial direction is the Z axis perpendicular to the XY plane of the touch panel.

As shown in FIG. 5, the related object can be dragged in the stylus mode or in the joystick mode. The user can also drag the relevant object while pressing or pressing a button.

With the embodiment of Figure 3, the first and second axes of the three-dimensional object model can be controlled to roll. With the embodiment of Figure 4, the third axis roll can be controlled. Therefore, the user can control the three-axis roll of the three-dimensional object by using the rocker mode. With the embodiment of FIG. 5, the three-dimensional object model can be moved in the three-axis space to control the three-axis roll and three-axis movement of the object.

In addition, as shown in FIG. 6, when the user can control the pen tip pressure of the stylus, one of the following actions or any combination thereof can be performed: zooming the object, controlling the viewing angle of the viewing object, and controlling the viewing angle of the viewing object. .

For how the touch system detects the tilt angle and the axial direction of the active stylus relative to the touch panel, reference may be made to the applicant's three applications, such as the application of the US Provisional Case 62/251, 205, 105136061, claiming the United States. The application of the provisional case No. 62/334,668, 106,107,665, and the application of the U.S. Provisional Publication No. 62/338,671, 105,144,061.

In an embodiment of the invention, the stylus includes a plurality of electrodes, and the electrodes are used to generate electrical signals, and the electrical signals can be modulated in timing, frequency, electrical signal strength, etc., so that the touch processing device The position of the stylus relative to the touch panel, the axial direction, the tilt angle, the spin angle, the pressure of the stylus tip, and/or the state of each sensor on the stylus are obtained through the touch panel. . In this embodiment, the touch processing device can also detect the external conductive object that does not actively emit an electrical signal through the touch panel by using a self-capacitance and/or mutual capacitance detection manner.

Please refer to FIG. 7, which is a block diagram of an electronic system 700 in accordance with an embodiment of the invention. The electronic system 700 includes a touch system including a first stylus 701, a second stylus 702, a touch panel 710, and a touch processing device 720. The touch processing device 720 is connected to a host 730. The host 730 includes at least a central processing unit and a memory for executing an operating system 740 to control the electronic system 700, and a touch driver 741 and a joystick driver 742 executed in the operating system environment. An application 750 that subscribes to the joystick driver 742. The present invention does not limit how the touch processing device 720 is connected to the host 730. For example, an industrial interface such as UART, USB, PCI-E, SATA, or a dedicated interface can be used to connect the touch processing device 720 and the host 730. The host 730 may be an Intel x86 or x64 architecture, or an ARM architecture of the company, or other computer architecture. The operating system 740 can be a Windows series operating system, a UNIX series of various operating systems, or other operating systems.

The touch processing device 720 further includes a touch panel interface 721 and a host interface 723 connected to the touch panel 710 and the central processing unit, respectively. The touch processing device 720 further includes a microprocessor 722 connected to the touch panel interface 721 and the host interface 723 for detecting the first stylus 701 and the touch through the touch panel 710. The position of the pen 702 relative to the touch panel 710, the stylus axial direction and the tilt angle. The touch processing device 720 maintains a mode parameter for each stylus 701 and 702 to record an operation mode of the related stylus, such as a first mode parameter and a second mode parameter to record the stylus 701 respectively. Operating mode with 702. When the first mode parameter is a rocker mode, the touch processing device 720 converts the axial direction and the tilt angle of the first stylus 701 into a first axis tilt angle and a second axis tilt angle, and The first axis tilt angle and the second axis tilt angle are transmitted to the application 750 through the rocker driver 742. When the first mode parameter is a stylus mode, the touch processing device 720 transmits the position to the Touch driver 741.

In order to switch the operation mode of the stylus, in an embodiment, when the position of the first stylus 701 is in a first rocker area 711 of the touch panel 710, the touch processing device 720 The first mode parameter is set to the rocker mode. When the position of the first stylus 701 is not in the first rocker area 711, the touch processing device 720 sets the first mode parameter to the touch. Pen mode.

In order to switch the operation mode of the stylus, in an embodiment, the first stylus 701 includes an input device for the user to set the first mode parameter by using the input device, the first stylus 701 The state of the input device is transmitted to the touch processing device 720. In an example, in order to facilitate the user to easily switch the operation mode, the input device includes a mechanical structure of a first end of the first stylus 701, and the mechanical structure is subjected to a pressure greater than a first threshold value. Forming into a first state, when the pressure is greater than a second threshold value, the mechanical structure is changed to a second state, wherein the first state corresponds to the rocker mode, and the second state corresponds to the touch Pen mode. The first end can be the tip of the pen or the other end of the tip of the pen. In an example, in order to facilitate the user to easily switch the operation mode, the input device further includes a button of the first stylus 701. When the button detects a trigger event, the first stylus 701 will The state of the input device is transmitted to the touch processing device 720, wherein the trigger event includes one of the following events: one button; two buttons; and a long button.

In order to switch the operation mode of the stylus, in a certain embodiment, when a first end of the first stylus 701 contacts the touch panel 710, the touch processing device 720 sets the first mode parameter. For the rocker mode, when a second end of the first stylus 701 contacts the touch panel 710, the touch processing device 720 sets the first mode parameter to the stylus mode. In this way, the user can easily know whether the first stylus 701 is currently in the rocker mode. In an example, in order to facilitate the touch processing device 720 to distinguish the mode setting of the first stylus 701, the first end and the second end of the first stylus 701 have different touch areas, shapes, or The directionality is such that the touch processing device 720 knows that the first stylus 701 is in contact with the touch panel 710 with the first end or the second end. In an example, in order to facilitate the touch processing device 720 to distinguish the mode setting of the first stylus 701, the first end of the first stylus 701 and the second end emit different electrical signals, so that the touch The processing device 720 is aware that the first stylus 701 contacts the touch panel 710 with the first end or the second end.

In order to switch the operation mode of the stylus, in an embodiment, the central processing unit is further configured to execute a setting program in the environment of the operating system 740, the setting program is configured to receive an input of the user to set the touch. The first or second mode parameter within the processing device 720 is controlled. The input here can be through an input device such as a keyboard, a mouse or a touch screen.

In order to enhance the user experience of the stylus simulation as a rocker, in one embodiment, the second axis tilt angle is a fixed value. The application 750 only receives the change value of the first axis tilt angle, that is, the steering direction of the first stylus pen 701 is only the first axis, and does not affect the second axis.

In order to simulate a scenario in which a plurality of joysticks are simultaneously operated, the electronic system 700 further includes a second stylus 702. The touch processing device 720 maintains a second mode parameter to record the operation mode of the second stylus 702. When the second mode parameter is the rocker mode, the touch processing device 720 controls the second touch. An axial direction and an inclination angle of the pen 702 relative to the touch panel 710 are converted into a first axis second inclination angle and a second axis second inclination angle, and the first axis second inclination angle and the second axis The two tilt angles are transmitted to the application 750 through the rocker driver 742. When the second mode parameter is the stylus mode, the touch processing device 720 transmits the position to the touch driver 741.

In an embodiment, the second axis tilt angle is a fixed value, and the first axis second tilt angle is the fixed value. The application 750 only receives the change value of the first axis tilt angle of the first stylus pen 701, that is, the steering direction of the first stylus pen 701 is only the first axis, and does not affect the second axis. The application 750 only receives the change value of the second tilt angle of the second axis of the second stylus 702, that is, the steering direction of the second stylus 702 is only the second axis, and does not affect the first axis.

In order to enhance the user experience of the stylus simulation as a plurality of joysticks, when the position of the second stylus 702 is in a second rocker region 712 of the touch panel 710, the touch processing device 720 The second mode parameter is set to the rocker mode. When the position of the second stylus 702 is not in the second rocker area 712, the touch processing device 720 sets the second mode parameter to the touch. A pen control mode, wherein the second rocker region 712 is different from the first rocker region 710.

In order to enhance the user experience of the stylus simulation as a joystick, the touch processing device 720 can further detect the first stylus 701 relative to the touch through the touch panel 710. When the first mode parameter is the rocker mode, the touch processing device 720 transmits the spin angle to the application 750 through the joystick driver 742.

Please refer to FIG. 8 , which is a schematic diagram of the appearance of a stylus according to an embodiment of the invention. The stylus 800 can be the first stylus 701 or the second stylus 702 of FIG. The stylus 800 has a first end 810 and a second end 820 opposite to the first end 810. Between the two ends is a stylus pen. The first end 810 and the second end 820 have different touch areas, shapes, or directionalities, so that a touch processing device can know that the stylus 800 is in contact with the first end 810 or the second end 820. A touch panel is simulated as a rocker when the first end 810 contacts the touch panel.

In another embodiment, the first end 810 of the stylus 800 and the second end 820 emit different electrical signals, so that a touch processing device knows that the stylus 800 is the first end 810. Or the second end 820 is in contact with a touch panel. When the first end 810 contacts the touch panel, the stylus 800 is simulated as a rocker.

Please refer to FIG. 9 , which is a schematic flowchart of a touch processing method according to an embodiment of the invention. The touch processing method can be applied to the touch processing device 720 of FIG. In an embodiment, it can be applied to the microprocessor 722 of the touch processing device 720. For example, the touch processing method can be implemented as a software or a firmware, and is executed by the microprocessor 722. The invention allows for the insertion of additional steps between steps and steps. The present invention does not limit the order of execution between steps unless a causal relationship is specifically indicated.

Step 910: Maintain a mode parameter to record an operation mode of the stylus.

Step 920: Detecting a position of the stylus relative to the touch panel, a stylus axial direction and an inclination angle through a touch panel.

Step 930: What is the mode parameter? When the mode parameter is a rocker mode, step 940 is performed. When the mode parameter is a stylus mode, step 950 is performed.

Step 940: Converting the stylus axial direction and the tilt angle into a first axis tilt angle and a second axis tilt angle, and transmitting the first axis tilt angle and the second axis tilt angle to the rocker driver through a rocker driver application.

Step 950: Transfer the location to a touch driver.

The joystick driver, the touch driver and the application are all run under a working system executed by a central processor of a host.

In an embodiment, the touch processing method further includes: when the position of the stylus is in a rocker area of the touch panel, setting the mode parameter to The rocker mode; and when the position of the stylus is not in the rocker area, setting the mode parameter to the stylus mode. In order to facilitate the user to easily switch the operation mode, in an example, the stylus includes an input device for the user to set the mode parameter by using the input device. The touch processing method further includes: receiving a state of the input device from the stylus; and setting the mode parameter according to a state of the input device. In an example, the input device further includes a button of the stylus, and the touch processing method further includes: when the button detects a trigger event, the touch The stylus receives the trigger event; and sets the mode parameter according to the trigger event, wherein the trigger event includes one of the following events: one button; two buttons; and a long button.

In an embodiment, the touch processing method further includes: when detecting that a first end of the stylus contacts the touch panel, setting the mode parameter to the a rocker mode; and when detecting that a second end of the stylus contacts the touch panel, setting the mode parameter to the stylus mode. In this way, the user can easily know whether the stylus is currently in the rocker mode. In an example, in order to facilitate the touch processing device to distinguish the mode setting of the stylus, the touch processing method further includes: different touch areas and shapes according to the first end and the second end of the stylus Or directionality, determining that the stylus contacts the touch panel with the first end or the second end. In another example, in order to facilitate the touch processing device to distinguish the mode setting of the stylus, the touch processing method further includes: determining, according to different electrical signals emitted by the first end and the second end of the stylus The stylus contacts the touch panel with the first end or the second end.

In an embodiment, the touch processing method further includes: receiving a user input from a setting program in the operating system environment to set the mode parameter.

In an embodiment, the touch processing method further includes: setting the second axis tilt angle to a fixed value.

In order to enhance the user experience of the stylus simulation as a joystick, the user can add a control factor. The touch processing method further includes: detecting, by the touch panel, a stylus relative to the touch panel The spin angle; and when the mode parameter is the rocker mode, the spin angle is transmitted to the application through the joystick driver.

Please refer to FIG. 10 , which is a schematic flowchart of a method for controlling a stylus according to an embodiment of the invention. The control method of FIG. 10 can be applied to the stylus pen 800 shown in FIG. The invention allows for the insertion of additional steps between steps and steps. The present invention does not limit the order of execution between steps unless a causal relationship is specifically indicated. Step 1010: Send a first electrical signal through the first end 810. Step 1020: Send a second electrical signal through the second end 820, wherein the first electrical signal is different from the second electrical signal, so that a touch processing device is aware that the stylus is the first end or the The second end contacts a touch panel. When the first end contacts the touch panel, the stylus is simulated as a rocker.

According to the touch electronic system, the touch processing device and the method provided by the present invention, and the stylus and the control method thereof, the stylus can be simulated as a joystick, and the user has multiple input experiences using the same device. Different kinds of control methods can be implemented. In particular, the user can use the stylus that touches the touch panel as a rocker.

Claims (40)

 An electronic system for simulating a stylus as a joystick includes: a host computer including a memory and a central processor coupled to the memory, the central processor configured to execute an operating system in the operating system a joystick driver and a touch driver, and an application connected to the joystick driver; a stylus; a touch panel; and a touch processing device connected to the touch The central processing unit is configured to detect a position of the stylus relative to the touch panel, a stylus axial direction and an oblique angle through the touch panel, wherein the touch processing device maintains a mode The parameter is used to record the operation mode of the stylus. When the mode parameter is a rocker mode, the touch processing device converts the stylus axial direction and the tilt angle into a first axis tilt angle and a second axis. Inclining, and transmitting the first axis tilt angle and the second axis tilt angle to the application through the rocker driver, when the mode parameter is a stylus mode, the touch processing device transmits the position to the Touch driver Style.    The electronic system of claim 1, wherein when the position of the stylus is in a rocker area of the touch panel, the touch processing device sets the mode parameter to the rocker mode. When the position of the stylus is not in the rocker area, the touch processing device sets the mode parameter to the stylus mode.    The electronic system of claim 1, wherein the stylus includes an input device for allowing a user to set the mode parameter by using the input device, and the stylus transmits the state of the input device to the touch Processing device.    The electronic system of claim 3, wherein the input device comprises a mechanical structure of a first end of the stylus, and when subjected to a pressure greater than a first threshold, the mechanical structure changes to a first state When the pressure is greater than a second threshold value, the mechanical structure changes to a second state, wherein the first state corresponds to the rocker mode, and the second state corresponds to the stylus mode.    The electronic system of claim 4, wherein the input device further comprises a button of the stylus, and when the button detects a trigger event, the stylus transmits the state of the input device to the touch The control device, wherein the trigger event comprises one of the following events: one button; two buttons; and a long button.    The electronic system of claim 1, wherein when the first end of the stylus contacts the touch panel, the touch processing device sets the mode parameter to the rocker mode, when the touch When a second end of the pen contacts the touch panel, the touch processing device sets the mode parameter to the stylus mode.    The electronic system of claim 6 , wherein the first end and the second end of the stylus have different touch areas, shapes, or directionalities, so that the touch processing device is aware of the touch The pen contacts the touch panel with the first end or the second end.    The electronic system of claim 6, wherein the first end of the stylus and the second end emit different electrical signals, so that the touch processing device knows that the stylus is the first end Or the second end contacts the touch panel.    The electronic system of claim 1, wherein the central processing unit is further configured to execute a setting program in the operating system environment, the setting program is configured to receive an input of the user to set the touch processing device. The mode parameter.    The electronic system of claim 1, wherein the touch processing device is further configured to receive a pressure value between the stylus and the touch panel, and when the pressure value is greater than a threshold, the touch The processing device sets the mode parameter to the rocker mode. When the pressure value is less than the threshold value, the touch processing device sets the mode parameter to the stylus mode.    The electronic system of claim 1, wherein the second axis inclination is a fixed value.    The electronic system of claim 1 further includes a second stylus, wherein the touch processing device maintains a second mode parameter to record an operation mode of the second stylus when the second mode parameter In the rocker mode, the touch processing device converts an axial direction and an inclination angle of the second stylus relative to the touch panel into a first axis second inclination angle and a second axis second inclination angle And transmitting the first tilt angle of the first axis and the second tilt angle of the second axis to the application through the rocker driver, when the second mode parameter is the stylus mode, the touch processing device This location is transferred to the touch driver.    The electronic system of claim 12, wherein the second axis tilt angle is a fixed value, and the first axis second tilt angle is the fixed value.    The electronic system of claim 12, wherein when the position of the second stylus is in a second rocker area of the touch panel, the touch processing device sets the second mode parameter to the In the rocker mode, when the position of the second stylus is not in the second rocker area, the touch processing device sets the second mode parameter to the stylus mode, wherein the second rocker area Different from the rocker area.    The electronic system of claim 1, wherein the touch processing device detects a spin angle of the stylus relative to the touch panel through the touch panel, and the mode parameter is the rocker mode. The touch processing device transmits the spin angle to the application through the joystick driver.    A touch processing device for simulating a stylus as a joystick includes: a touch panel interface for connecting electrodes of a touch panel; a host interface for connecting a central processor of a host The central processing unit is configured to execute an operating system, a joystick driver running under the operating system, a touch driver, and an application connected to the joystick driver; and a microprocessor connected The touch panel interface and the host interface are configured to detect a position of the stylus relative to the touch panel, a stylus axial direction and an oblique angle through the touch panel, wherein the microprocessor maintains a mode parameter for recording an operation mode of the stylus. When the mode parameter is a rocker mode, the microprocessor converts the stylus axial direction and the tilt angle into a first axis tilt angle and a second Shaft angle, and transmitting the first shaft inclination angle and the second shaft inclination angle to the application through the rocker driver, when the mode parameter is a stylus mode, the microprocessor transmits the position to the Touch driver Program.    The touch processing device of claim 16, wherein when the position of the stylus is in a rocker area of the touch panel, the touch processing device sets the mode parameter to the rocker mode. When the position of the stylus is not in the rocker area, the touch processing device sets the mode parameter to the stylus mode.    The touch processing device of claim 16 , wherein the stylus includes an input device for allowing a user to set the mode parameter by using the input device, and the stylus transmits the state of the input device to the a touch processing device that sets the mode parameter according to a state of the input device.    The touch processing device of claim 18, wherein the input device further comprises a button of the stylus, and when the button detects a trigger event, the stylus transmits the state of the input device to The touch processing device sets the mode parameter according to the trigger event, wherein the trigger event includes one of the following events: one button; two buttons; and a long button.    The touch processing device of claim 16 , wherein when the touch processing device detects that a first end of the stylus contacts the touch panel, the touch processing device sets the mode parameter In the rocker mode, when the touch processing device detects that a second end of the stylus contacts the touch panel, the touch processing device sets the mode parameter to the stylus mode.    The touch processing device of claim 20, wherein the first end and the second end of the stylus have different touch areas, shapes, or directionalities, so that the touch processing device is aware of the The stylus contacts the touch panel with the first end or the second end.    The touch processing device of claim 20, wherein the first end of the stylus and the second end emit different electrical signals, so that the touch processing device knows that the stylus is the first One end or the second end contacts the touch panel.    The touch processing device of claim 16, wherein the central processing unit is further configured to execute a setting program in the operating system environment, the setting program is configured to receive an input of the user to set the touch processing. This mode parameter within the device.    The touch processing device of claim 16 is further configured to receive a pressure value between the stylus and the touch panel. When the pressure value is greater than a threshold, the touch processing device The mode parameter is set to the rocker mode, and when the pressure value is less than the threshold value, the touch processing device sets the mode parameter to the stylus mode.    The touch processing device of claim 16, wherein the second axis tilt angle is a fixed value.    The touch processing device of claim 16 , wherein the touch processing device further detects a spin angle of the stylus relative to the touch panel through the touch panel, when the mode parameter is the shake In the lever mode, the touch processing device transmits the spin angle to the application through the joystick driver.    A stylus for simulating a stylus as a rocker, comprising: a first end; and a second end opposite to the first end, wherein the first end and the second end have different touches Controlling the area, shape, or directionality, such that the touch processing device is aware that the stylus contacts the touch panel with the first end or the second end, and when the first end contacts the touch panel, The stylus is simulated as a rocker.    A stylus for simulating a stylus as a rocker, comprising: a first end; and a second end opposite to the first end, wherein the first end and the second end of the stylus Transmitting a different electrical signal to enable the touch processing device to know that the stylus contacts the touch panel with the first end or the second end, and when the first end contacts the touch panel, the touch The pen control is a rocker.    A touch processing method for simulating a stylus as a joystick includes: maintaining a mode parameter to record an operation mode of the stylus; detecting the stylus relative to the touch panel through a touch panel a position, a stylus axial direction and an inclination angle; and when the mode parameter is a rocker mode, converting the stylus axial direction and the inclination angle into a first axis inclination angle and a second axis Inclining angle, and transmitting the first axis tilt angle and the second axis tilt angle to an application through a rocker driver, and when the mode parameter is a stylus mode, transmitting the position to a touch driver The joystick driver, the touch driver and the application are all run under a working system executed by a central processor of a host.    The touch processing method of claim 29, further comprising: when the position of the stylus is in a rocker area of the touch panel, setting the mode parameter to the rocker mode; When the position of the stylus is not in the rocker area, the mode parameter is set to the stylus mode.    The touch processing method of claim 29, wherein the stylus includes an input device for allowing a user to set the mode parameter by using the input device, and the touch processing method further comprises: from the stylus Receiving a state of the input device; and setting the mode parameter according to a state of the input device.    The touch processing method of claim 31, wherein the input device further comprises a button of the stylus, the touch processing method further comprises: when the button detects a trigger event, the touch The pen receives the trigger event; and sets the mode parameter according to the trigger event, wherein the trigger event includes one of the following events; one button; two buttons; and a long button.    The touch processing method of claim 29, further comprising: when detecting that a first end of the stylus contacts the touch panel, setting the mode parameter to the rocker mode; When it is detected that a second end of the stylus contacts the touch panel, the mode parameter is set to the stylus mode.    The touch processing method of claim 33, further comprising: determining the stylus according to different touch areas, shapes, or directionalities of the first end and the second end of the stylus The first end or the second end is in contact with the touch panel.    The touch processing method of claim 33, further comprising: determining, according to different electrical signals emitted by the first end and the second end of the stylus, the stylus is the first end or The second end contacts the touch panel.    The touch processing method of claim 29, further comprising: receiving a user input from a setting program in the operating system environment to set the mode parameter.    The touch processing method of claim 29, further comprising: receiving a pressure value between the stylus and the touch panel; when the pressure value is greater than a threshold, setting the mode parameter to the a rocker mode; and when the pressure value is less than the threshold value, setting the mode parameter to the stylus mode.    The touch processing method of claim 29, further comprising: setting the second axis tilt angle to a fixed value.    The touch processing method of claim 29, further comprising: detecting, by the touch panel, a spin angle of the stylus relative to the touch panel; and when the mode parameter is the rocker mode The spin angle is transmitted to the application through the joystick driver.    A stylus control method for simulating a stylus as a joystick, wherein the stylus includes a first end and a second end opposite to the first end, the control method includes: transmitting the a first electrical signal is emitted from one end; and a second electrical signal is sent through the second end, wherein the first electrical signal is different from the second electrical signal, so that a touch processing device is aware that the stylus is The first end or the second end contacts a touch panel. When the first end contacts the touch panel, the stylus is simulated as a rocker.