TW201715339A - Method for achieving guiding function on a mobile terminal through a panoramic database - Google Patents

Abstract

A method for achieving guide function on a mobile terminal through a panoramic database comprises the following steps: connecting a mobile terminal to a panoramic database corresponding to a guided space, wherein the panoramic database comprises a plurality of panoramic images and a plurality of routes, and a ordinal relationship between each of panoramic images is build according to the routes; the mobile terminal receiving one of the panoramic images as a current panoramic image; the mobile terminal generating a sensing data by sensing a first action of an user, and displaying one of viewpoints of the panoramic image according to the sensing data; and the mobile terminal generating a switching data by sensing a second action of the user, and receiving and switching to display the adjacent panoramic image with same viewpoint as a new current panoramic image according to the switching data.

Description

Method for realizing mobile terminal navigation according to panoramic database

The present invention relates to a method for implementing mobile terminal navigation based on a panoramic database.

Virtual Reality (VR) interacts with the operation of the tracking controller on the head mounted display (HMD) to allow the user to integrate into the virtual reality. In response to the craze of virtual reality head-mounted displays, the promotion of panoramic applications has entered another peak. However, virtual reality head-mounted displays are inconvenient and expensive compared to current mobile terminals, such as smart phones and tablets. Compared with the effect of virtual reality, the panoramic navigation is more suitable for mobile terminals (such as mobile phones, tablets, etc.) for users to watch and interact.

The panoramic tour of the mobile terminal has a variety of applications, one of which can be used to buy or sell or rent a home. At present, buyers or renters want to know the actual housing situation of a house to be sold or a house to be rented. Apart from on-site visits, they can only first understand the condition of the house through photos of houses on the Internet. If you want to know the condition of the house through photos, you can only see the information of the house photographed from the perspective of the photographer because the photographer wants to rent the house, if the photographer does not have problems in the house (such as water leaks, walls) Cancer, etc.), if you want to rent a house or want to buy a house, you can't know the real condition of the house. Therefore, how to enable the renter to pass through the mobile terminal through the panoramic navigation of the real environment. It is one of the focuses of the present invention to observe the real condition of the house in any orientation or angle, and to fully understand the information of the house without having to visit the site to solve the problem of time and region.

In order to clearly show the true condition of the house, the panoramic image resolution requirements provided are relatively higher. However, when the panoramic image resolution is high and the entire panoramic image database needs to be downloaded at one time, relatively large downloading traffic and long downloading time are required, and the entire panoramic image database is also included. The user does not need to see the panoramic image, so it is not economical. As a result, users who have certain download traffic restrictions will also become a big burden.

In order to solve the above problems and achieve the above object, one aspect of the present invention is to provide a method for implementing mobile terminal navigation according to a panoramic database, which can enhance the interaction mode of the user in the panoramic navigation, so that the user has an immersive manner. Feel, you can directly experience the sense of space in the panoramic virtual reality. According to a specific embodiment, the method for implementing mobile terminal navigation according to the panoramic database comprises the steps of: connecting, by a mobile terminal, a panoramic database corresponding to a desired navigation space, the panoramic database comprising more than one panorama An image and one or more routes, the panoramic images being distributed on the routes, and according to one or more routes, each of the panoramic images has a route and has a certain order relationship; the mobile terminal receives the panoramas One of the images acts as a current panoramic image; the mobile terminal generates a sensing material according to the first action of one of the users, and displays a viewing field of view (FOV) in the current panoramic image according to the sensing data; and, moves When the terminal generates a switching data according to the second action of the user, and receives and switches to the panoramic image located adjacent to the current panoramic image according to the switching data, the terminal uses the same field of view as the new current panoramic image for display. .

The mobile terminal can selectively display the panoramic image of the adjacent order of the current panoramic image in the same viewing field.

Each route may optionally include at least one divergence point, and a plurality of movement directions are generated according to the relationship between the divergence point and the adjacent divergence point. When the current panoramic image is located at the divergence point, the mobile terminal determines and proceeds to the moving direction according to the switching data, and receives and switches to the panoramic image located in the adjacent direction in the moving direction.

The mobile terminal can optionally include an electronic sensor that senses motion of the mobile terminal to generate sensing material. The electronic sensor can optionally include a gyroscope, a direction meter and an accelerator respectively sensing the movement, direction and inclination of the mobile terminal, and the electronic sensor generates the sensing data according to the results of the accelerator, the direction meter and the gyroscope sensing.

The mobile terminal can optionally include an electronic sensor. When the mobile terminal is in an automatic navigation mode, the electronic sensor senses movement of the mobile terminal to generate switching information. The electronic sensor can optionally include a gyroscope, a directional meter and an accelerator directional meter respectively sensing the movement, direction and inclination of the mobile terminal, and the electronic sensor generates switching data according to the result of the accelerator and the gyro sensing.

The mobile terminal can optionally include a touch screen. When the mobile terminal is in a manual navigation mode, the mobile terminal generates a sensing data according to a first touch command sensed by the touch screen. The first touch command may include one of a click position, a click pressure, and a sliding direction.

The mobile terminal can include a touch screen. When the mobile terminal is in a manual navigation mode, the mobile terminal generates a switching data according to a second touch command sensed by the touch screen. The second touch command includes one of a click position, a click pressure, and a sliding direction.

The invention allows the user to navigate the space through the mobile terminal, and does not need to download the entire panoramic image database at one time, and can observe the real situation of the space from any orientation or angle, thereby having low cost and strong realism. The advantage of a small amount of data. The invention can enhance the interaction mode of the user in the panoramic navigation, so that the user has an immersive feeling, and can directly experience the spatial sense of the panoramic virtual reality.

S1~S4‧‧‧ steps

1 is a schematic plan view of a space to be navigated in an embodiment in accordance with the present invention.

2 is a schematic diagram showing a panoramic image according to an embodiment of the present invention.

3 is a flow chart showing a method in accordance with an embodiment of the present invention.

FIG. 4 is a schematic diagram of application to a mobile phone according to an embodiment of the present invention.

Figure 5 is a schematic diagram showing the operation of an embodiment of the present invention.

The method for realizing the navigation of the mobile terminal according to the panoramic database provided by the invention can realize the layout of the space to be navigated through the panoramic navigation through the mobile terminal such as a smart phone, a tablet computer, a palmtop computer or an HMD.

Referring to FIG. 1 and FIG. 2, FIG. 1 is a schematic plan view showing a navigation space according to an embodiment of the present invention, and FIG. 2 is a schematic diagram showing a panoramic image according to an embodiment of the present invention. In this embodiment, the space to be rented may be a house to be rented or sold, but not limited thereto. In practical applications, it may also be a space for schools, museums, art galleries, shopping malls, and the like. In this embodiment, the seller can separately capture the panoramic images of the locations in the pre-planned node locations (node 1 to node 25) in the house to be rented through the 3D camera and store them to A panoramic database located on the cloud. As shown in FIG. 2, the panoramic image is a continuous image within a 360-degree space, but in order to be expressed by a graphic, the panoramic image provided here is to convert the three-dimensional panoramic image into a two-dimensional panoramic image. Schematic of the image. In practical applications, the panoramic image viewed by the user on the mobile terminal is a three-dimensional panoramic image. The panoramic database may include more than one panoramic image and one or more routes, and the one or more panoramic images are distributed in more than one route, and each of the panoramic images has a certain sequential relationship according to the route. In this embodiment, the route is a moving line in the space, which may be composed of a plurality of nodes as shown in FIG. 1, and each panoramic image is located on a different node, so that the panoramic images located on each node have Order relationship.

Referring to FIG. 3, FIG. 3 is a flow chart showing a method according to an embodiment of the present invention. In the embodiment, the present invention provides a method for implementing mobile terminal navigation according to a panoramic database, which comprises the following four steps: (S1) connecting, by the mobile terminal, a panoramic database corresponding to the navigation space to be browsed.

In an embodiment, the renter can connect to a panoramic database stored in the cloud, such as a mobile phone, an HMD, or the like, which is a panoramic database corresponding to the house to be rented.

(S2) The mobile terminal receives one of the panoramic images as the current panoramic image.

In an embodiment, the renter can set a panoramic image as a starting point, as shown in FIG. 1, corresponding to the panoramic image of the node 1 at the gate position, but not limited thereto, in practical applications, A random selection method can be adopted to select a panoramic image as a starting point. When the renter connects to the panoramic database on the cloud, the cloud transmits the panoramic image of the panoramic database as the starting point to the renter's mobile phone. When the renter receives the panoramic image on the phone After that, the phone will display this panoramic image as the current panoramic image.

(S3) The mobile terminal can generate the sensing data according to the first action of the user, and display the viewing field of view (FOV) in the current panoramic image according to the sensing data.

In an embodiment, the mobile terminal can include an electronic sensor that senses motion of the mobile terminal to generate sensing data. In this embodiment, the mobile terminal can be a mobile phone, and the electronic sensor can include a gyroscope, a direction meter, and an accelerator, which can sense the movement, direction, and inclination of the mobile phone, and generate an induction according to the result of the sensing. data. When the mobile phone is in the automatic navigation mode, the mobile phone can display the action of the top, bottom, left and right, back and forth movement, rotation or/and rotation of the panoramic image according to the sensing data sensed by the electronic sensor. The automatic navigation mode described herein means that the user can input a command to control the panoramic navigation movement to the mobile phone by moving the mobile phone or changing the inclination thereof, etc., so that the current panoramic image can be observed by the mobile phone. Any angle of view. The mobile terminal is not limited to the mobile phone. In another embodiment, the mobile terminal can also be an HMD. The HMD can sense the user to move forward, backward, left, right, clockwise, and counterclockwise. Operate to allow the panoramic image to display the corresponding action.

Next, the following examples will be further described with respect to the step (S3). In the first example, the first action of the user may be an action of rotating the mobile phone to the right, using the amount of change generated by the accelerator as a command to turn the right image to the mobile phone to enable the mobile phone to perform the current panorama. Like the display to the right. Similarly, the first action may also be an action of rotating the mobile phone to the left as a command to input a control panoramic image to the left to the mobile phone, so that the mobile phone can display the current panoramic image to the left. In the second example, the first action of the user may also be an action of tilting the mobile phone forward, using the sensing of the gyroscope as a command to control the forward movement of the panoramic image to the mobile phone, so that the mobile phone can perform the current panoramic view. Like the display of moving forward. Similarly, the first An action can also be an action of tilting the mobile phone backward, as a command to input a control to move the panoramic image backwards to the mobile phone, so that the mobile phone can perform a display for moving the current panoramic image backward. In the third example, the first action of the user may also be to rotate the mobile phone as a command to control the rotation of the panoramic image to the mobile phone, so that the mobile phone can display the current panoramic image.

However, the mobile phone model is not limited to the automatic navigation mode, and the mobile phone can also be in the manual navigation mode. In an embodiment, the mobile terminal can include a screen that can display a panoramic image of a certain space, and can also be operated by the user on the touch. The mobile terminal can be a mobile phone, but not limited thereto. In actual application, it can also be a tablet computer. The mobile phone screen described in this embodiment may be a touch screen. When the mobile phone is in the manual navigation mode, the mobile phone can generate the sensing data according to the first touch command sensed by the touch screen. The first touch command may include one of a click position, a click pressure, and a sliding direction. In an embodiment, the mobile phone can rotate the sliding touch to the right as a command to input a control panoramic image to the right. However, the first touch command is not limited to the above, and can be used according to the use. The user needs to adjust, as long as it can control the touch of the panoramic image display up, down, left and right, back and forth movement, rotation or / and rotation.

The manual navigation mode described herein means that the user cannot input a command to control the panoramic navigation movement to the mobile phone by moving the mobile phone or changing the inclination thereof; in the manual navigation mode, the user uses the manual navigation mode. Only by performing different touch operations on the touch screen can be used as a command to control the panoramic navigation movement to the mobile phone to control the viewing angle of the current panoramic image.

In an embodiment, the mobile terminal may further include a controller, wherein the mobile terminal may be a mobile phone, but not limited thereto, and may also be a tablet computer or the like in actual application. The controller allows the user to switch between automatic mode or manual mode. In an embodiment, the controller can For a button on the phone, the user can switch between the automatic mode or the manual mode according to the needs of the user through the button click.

(S4) the mobile terminal can generate the switching data according to the second action of the user, and receive and switch to the panoramic image located adjacent to the current panoramic image according to the switching data as the new current panoramic image for display. .

In an embodiment, when the mobile terminal receives the handover data, the panoramic image located adjacent to the current panoramic image is further received. Therefore, it is possible to avoid the problem that the entire panoramic image database (including the panoramic image that the user does not need to see) is downloaded at one time, and the download amount is too large or the memory space in the mobile terminal is occupied.

In another embodiment, the mobile terminal can display a panoramic image of the adjacent order of the current panoramic image in the same viewing field. In this embodiment, the mobile terminal can only display the panoramic image data having the same field of view through the fixed field of view, and the data in the field of view is not transmitted to the user according to further operations or settings of the user. Mobile terminals, in this way, can better save transmission traffic.

In an embodiment, the mobile terminal can include an electronic sensor that senses motion of the mobile terminal to generate switching data. In this embodiment, the mobile terminal can be a mobile phone, and the electronic sensor can include a gyroscope, a direction meter, and an accelerator, which can sense the movement, direction, and tilt of the mobile phone, and generate a switch according to the result of the sensing. data. When the mobile phone is in the automatic navigation mode, the mobile phone can receive and switch to the panoramic image located adjacent to the current panoramic image according to the switching data sensed by the electronic sensor, as a new current panoramic image for performing display. The automatic navigation mode described herein refers to that the user can control the input of panoramic image switching to the mobile phone by moving the mobile phone or changing the inclination thereof to reach a predetermined threshold. A panoramic image of a different location (such as a porch, gate, living room, porch, bedroom, etc.) is observed by the mobile phone.

Next, the steps (S4) are further explained in the following enumerated examples. In an example, the second action of the user may be an action of tilting the mobile phone forward, using the sensing of the gyroscope as a panoramic image that receives the input to the mobile phone and switches to the adjacent panoramic image of the current panoramic image (eg, The command of the current panoramic image before the order). When the mobile phone receives and switches to the new panoramic image according to the above command, the mobile phone will use this new panoramic image as the current panoramic image. Similarly, the second action may also be an action of tilting the mobile phone backwards as a panoramic image (for example, a current position below the current panoramic image) that is received by the mobile phone and switched to the adjacent panoramic image of the current panoramic image. command. When the mobile phone receives and switches to the new panoramic image according to the above command, the mobile phone will use this new panoramic image as the current panoramic image. In another embodiment, the mobile phone can display the panoramic image of the adjacent panoramic image of the current panoramic image in the same viewing field, but the actual application is not limited to the same viewing field, and can be made according to the design or user requirements. Adjustment.

However, the mobile phone model is not limited to the automatic navigation mode, and the mobile phone can also be in the manual navigation mode. In an embodiment, the mobile terminal can include a touch screen, and the mobile terminal can be a mobile phone, but not limited thereto. In actual applications, the mobile terminal can also be a tablet computer or the like. When the mobile phone is in the manual navigation mode, the mobile phone can generate a switching data according to the second touch command sensed by the touch screen. The second touch command includes one of a click position, a click pressure, and a sliding direction. In an embodiment, the mobile phone can be used as a peripheral image that receives the input to the mobile phone and switches to the adjacent panoramic image of the current panoramic image according to the user's forward sliding touch (such as a previous position of the current panoramic image). The command, but the second touch command is not limited to the above, and can be adjusted according to the user's needs, as long as it can control the switching between the current panoramic image and the adjacent panoramic image. In another embodiment, the mobile phone can be used as a mobile phone according to the user's forward sliding touch. A panoramic image that is received and switched to an adjacent sequence of the current panoramic image, wherein the mobile phone displays the same panoramic view of the adjacent panoramic image of the current panoramic image.

In an embodiment, in the automatic navigation mode, if the electronic sensor reacts too sensitively, when the user performs a panoramic image browsing process, even if the user does not intend to switch to the next panoramic image. Demand, the electronic sensor will still generate a switch data due to the user's action. Therefore, in this embodiment, the mobile phone may further include a delay device, that is, when the mobile phone operates through the user for a predetermined time or longer, a corresponding switching command is generated, thereby solving the electronic sensor response. Sensitive question. However, in another embodiment, the user can also switch from the automatic mode to the manual mode to prevent the mobile phone from switching to the current panorama due to the user action under non-user requirements. A panoramic image like the adjacent order. In this way, the manual mode is used to control the switching between the panoramic images, so as to avoid switching to the next panoramic image by overreacting the user's motion.

However, the method of using the delay device is not limited. Please refer to FIG. 4, which is a schematic diagram of the application to the mobile phone according to an embodiment of the present invention. A panoramic image and its corresponding movable direction (forward, right, left) are displayed on the phone. The movable direction is displayed in the form of an arrow indicator, but it is not limited to the indicator shown in Figure 4. In actual application, it can also be adjusted according to user requirements. In this embodiment, regardless of whether the mobile phone is in the automatic mode or the manual mode, only when the mobile phone displays the movable direction indicator in the panoramic image, the mobile phone generates the switching data according to the user's motion; if the mobile phone does not appear When moving the indicator of the movable direction, the mobile terminal only generates the sensing data according to the action of the user. In this way, it is also possible to avoid the problem that the mobile phone switches to the panoramic image located adjacent to the current panoramic image by the user's action due to the user's action.

Next, please refer to FIG. 5, which is a schematic diagram showing the operation of an embodiment according to the present invention. As shown in Figure 5, all panoramic images are numbered (Figure 1-7), and the direction and order of movement of each image and other images are listed according to the corresponding relationship between the figure and the figure. In an embodiment, the mobile phone receives the panoramic image (1) transmitted by the cloud and the movable direction (forward, rightward, leftward) corresponding to the panoramic image (1), and This panoramic image (1) serves as the current panoramic image. The movable direction can be represented by an indicator on the screen. In this embodiment (as shown in FIG. 5), the indicator can be an arrow, but not limited thereto. In an embodiment, when the mobile phone is in the automatic mode, the electronic sensor can sense the movement of the mobile phone to generate the switching data, and determine the next received panoramic image and the viewing field according to the switching data. Then the above data is transmitted to the cloud, and after receiving the data of the mobile phone, the cloud transmits the corresponding panoramic image and the controllable direction to the mobile phone. In this embodiment, when the electronic sensor senses that the motion of the mobile phone is a rightward motion, it determines that the next received and switched panoramic image is a panoramic image (6), and the mobile phone further receives the transmitted by the cloud. A panoramic image (6) and a controllable direction (to the right) corresponding to the panoramic image (6). The current panoramic image displayed in the phone is switched from the panoramic image (1) to the panoramic image (6). In an embodiment, when the mobile phone is in the manual mode, the mobile phone can generate a switching data according to the touch command sensed by the touch screen, and determine the next received panoramic image according to the switching data. Then the above data is transmitted to the cloud, and after receiving the data of the mobile phone, the cloud transmits the corresponding panoramic image and the controllable direction to the mobile phone. In this embodiment, when the mobile phone senses that the touch command touched by the touch screen is a right-sliding touch, the next received panoramic image is determined as a panoramic image (6), and the mobile phone further receives the touch image. A panoramic image (6) transmitted from the cloud and a controllable direction (to the right) corresponding to the panoramic image (6). The current panoramic image displayed in the phone is switched from the panoramic image (1) to the panoramic image (6).

In an embodiment, each route may include at least one divergence point, and a plurality of movement directions are generated according to the relationship between the divergence point and the adjacent route. When the current panoramic image is located at the divergence point, the mobile terminal can determine and go to the moving direction according to the switching data, and receive and switch to the panoramic image located in the adjacent direction in the moving direction. As shown in Figure 1, in one embodiment, the divergence point (node 14) has six movable directions. When the mobile phone is in the automatic mode, the electronic sensor in the mobile phone can determine the direction of the movement according to the action of the user and generate corresponding switching data according to the direction, and then the mobile phone receives and switches to the current panoramic image according to the switching data. A panoramic image of adjacent orders. In an embodiment, if the mobile phone is currently displayed as a panoramic image at the position of the divergence point (node 14), the electronic sensor in the mobile phone determines the next moving direction as the direction of the node 14 to the node 6 according to the action of the user. The handset will further receive and switch to the panoramic image located at node 6.

In addition, when the mobile phone is in the manual mode, the mobile phone can determine the direction of the mobile according to the second touch command sensed by the touch screen and generate corresponding switching data according to the direction, and then the mobile phone receives and switches to the location according to the switching data. A panoramic image of the adjacent order of the current panoramic image. In an embodiment, if the mobile phone is currently displayed as a panoramic image at the position of the divergence point (node 14), when the touch screen of the mobile phone senses the touch from the node 14 to the direction of the node 15, the mobile phone further Receiving and switching to the panoramic image located at the node 15; however, in the actual application, when the touch screen of the mobile phone senses the click touch at the position of the node 15, the touch can also be determined by the touch method. The next direction of movement is the direction of node 14 to node 15, and the handset then receives and switches to the panoramic image at node 15. In addition, in an embodiment, the route of the house may be set in advance not including the route through the wall, and then the order relationship between the panoramic images is established by the routes. Because the route does not contain routes that traverse the wall (such as by nodes) 14 traverses to node 16), such that the movable direction of the divergence point (node 14) does not include the direction that needs to cross the wall (such as node 14 to node 16), thereby avoiding the occurrence of wall penetration during the navigation process. situation.

The invention allows a renter or a house purchaser to navigate the house through the mobile terminal, and does not need to download the entire panoramic image database at one time, and can observe the real condition of the house from any orientation or angle, thereby having a low cost. , the sense of realism, the small amount of data. Therefore, the present invention can avoid the problem that the download amount is too large or occupies too much memory space in the mobile terminal due to downloading the entire panoramic image database at one time (including the panoramic image that the user does not need to see).

In addition, the present invention uses the existing electronic sensor in the mobile phone as an input device for the user to interact with the panoramic virtual reality, so that the user can quickly get started without learning. In addition, the user can use the mobile terminal (such as a mobile phone) as a remote navigation grip or a joystick for panoramic navigation, so that the user can directly move the experience of playing mobile games or mobile racing to the interactive mode of the panoramic navigation. On the top, you can let the user not change the original habits, but can feel the same experience. The invention can enhance the interaction mode of the user in the panoramic navigation, so that the user has an immersive feeling, and can directly experience the spatial sense of the panoramic virtual reality.

S1~S4‧‧‧ steps

Claims (11)

A method for implementing mobile terminal navigation according to a panoramic database, comprising the steps of: connecting, by a mobile terminal, a panoramic database corresponding to a desired navigation space, the panoramic database comprising more than one panoramic image and one or more routes And the panoramic images are distributed on the routes, and each of the panoramic images has a certain sequential relationship according to the routes; the mobile terminal receives one of the panoramic images as one a current panoramic image; the mobile terminal generates a sensing data according to a first action of a user, and displays a view field of view (FOV) in the current panoramic image according to the sensing data; and the mobile terminal is based on the user When the second action generates a switching data, and receives and switches to the panoramic image located adjacent to the current panoramic image according to the switching data, as a new current panoramic image for display. The method of claim 1, wherein the mobile terminal displays the panoramic image of the adjacent sequence of the current panoramic image in the same viewing field. The method of claim 1, wherein each of the routes includes at least one divergence point, and a plurality of movement directions are generated according to the relationship between the divergence point and the adjacent route, when the current panoramic image is located at the bifurcation point The mobile terminal determines and proceeds to the moving direction according to the switching data, and receives and switches to the panoramic image located in the adjacent direction in the moving direction. The method of claim 1, wherein the mobile terminal comprises an electronic sensor that senses motion of the mobile terminal to generate the sensing data. The method of claim 4, wherein the electronic sensor comprises a gyroscope, A direction sensor and an accelerator respectively sense the movement, direction and inclination of the mobile terminal, and the electronic sensor generates the sensing data according to the result of the accelerator and the gyroscope sensing. The method of claim 1, wherein the mobile terminal comprises an electronic sensor, and when the mobile terminal is in an automatic navigation mode, the electronic sensor senses movement of the mobile terminal to generate the switching data. The method of claim 6, wherein the electronic sensor comprises a gyroscope, a direction meter and an accelerator, the accelerator and the gyroscope sense movement, direction and inclination of the mobile terminal, the electronic induction The switching data is generated according to the accelerator and the result of the gyroscope sensing. The method of claim 1, wherein the mobile terminal comprises a touch screen, and when the mobile terminal is in a manual navigation mode, the mobile terminal senses a first touch according to the touch screen. Command to generate the sensing data. The method of claim 8, wherein the first touch command comprises one of a click position, a click pressure, and a sliding direction. The method of claim 1, wherein the mobile terminal comprises a touch screen, and when the mobile terminal is in a manual navigation mode, the mobile terminal senses a second touch according to the touch screen. Command to generate the switching data. The method of claim 10, wherein the second touch command comprises one of a click position, a click pressure, and a sliding direction.