Disclosure of Invention
The invention provides a stylus, a controlled device matched with the stylus and a human-computer interaction system, which solve the technical problems of single function and troublesome use of the existing stylus or touch pen.
In order to achieve the above purpose, the embodiment of the invention adopts the following technical scheme:
the pen-type terminal provided by the invention comprises a pen-shaped pen shell, a track recording module, a mode switching module, a key function module, a pen end transceiving module, a switching key exposed out of the pen shell and at least two function keys, wherein the track recording module, the mode switching module, the key function module, the pen end transceiving module, the switching key and the at least two function keys are arranged in the pen shell, and the pen-type terminal comprises:
the track recording module is used for generating track data corresponding to the moving track of the nib part of the pen shell in real time when the nib part of the pen shell moves, and outputting the track data through the pen end transceiver module;
the mode switching module is used for selecting one type of mode data from at least two types of mode data according to a preset sequence when the switching key is triggered, and outputting the selected mode data through the pen end transceiver module, wherein the types of the mode data comprise a conventional mode and a handwriting mode;
and the key function module is used for outputting the triggered position information or serial number of the function key through the pen end transceiving module.
The controlled device matched with the pen-type terminal provided by the invention comprises a controlled end transceiver module, a control module, a controlled end storage module and a display screen;
the controlled end transceiving module is used for receiving the data output by the pen end transceiving module, processing the data into a format which can be identified by the control module and then sending the data to the control module;
the control module is used for identifying the position information or the serial number of the triggered function key and identifying, controlling a cursor on the display screen to move to a position corresponding to the track data in real time when the type of the mode data is a conventional mode, performing left-click operation on the position pointed by the cursor when a first function key is triggered, and performing right-click operation on the position pointed by the cursor when a second function key is triggered;
the control module is further used for triggering and opening handwriting input software when the type of the mode data is a handwriting mode, controlling the handwriting input software to record and display a picture or a character corresponding to the track data on the display screen in real time, and/or the control module is further used for storing the picture or the character recorded by the handwriting input software when the first function key is triggered and deleting the picture or the character recorded by the handwriting input software when the second function key is triggered when the type of the mode data is the handwriting mode.
The man-machine interaction system comprises the pen-type terminal and the controlled device, wherein:
the mode switching module is further used for sending the mode data once at a preset time interval before the switching key is triggered again; or,
the control module is further configured to update the type of the previously recorded pattern data after identifying a new type of the pattern data.
Compared with the prior art, any one of the technical schemes provided by the invention has the following advantages:
because the pen-type terminal of the invention can select and send one type of mode data from at least two types of mode data according to the preset sequence (such as the mode of first conventional mode and then handwriting mode or the mode of first handwriting mode and then conventional mode) by triggering the switch key, and further change the working mode of the pen-type terminal by sending different types of analog signals, namely change the functions which can be realized when each function key on the pen-type terminal is triggered, when the type of the mode data is the conventional mode, the control module in the controlled device used in cooperation with the pen-type terminal can perform left-click operation on the position pointed by the cursor when the first function key (specifically, which function key is the first function key, and which is the second function key which can be arbitrarily set manually) on the pen-type terminal is triggered, and when the second function key is triggered, the right click operation is carried out on the position pointed by the cursor, so that the pen-type terminal can realize the function of a common mouse;
meanwhile, the control module in the controlled device used in cooperation with the pen-type terminal can also automatically open the handwriting input software when the type of the mode data is a handwriting mode, control the handwriting input software to record and display the picture or character corresponding to the track data on the display screen in real time, and/or store the picture or character recorded by the handwriting input software when the first function key is triggered, and delete the picture or character recorded by the handwriting input software when the second function key is triggered, so that the handwriting input can be directly performed in the handwriting input software or the content of the handwriting input can be directly stored or deleted only by triggering the switching key to select and send the mode data with the type of the handwriting mode, therefore, the pen-type terminal has the function of quickly starting the handwriting input software and/or quickly storing or deleting the content of the handwriting input, when the pen-type terminal is used for handwriting input, the operation that handwriting input software is selected and clicked manually or a cursor is controlled to click a storage or deletion button in the prior art can be omitted, compared with the method that the storage button on the handwriting input software is searched and clicked to store or a picture or a character is selected and then the deletion button on the handwriting input software is searched and clicked to delete, which is generally adopted in the prior art, the method is quicker and more convenient, and the technical problems that the existing handwriting pen or touch pen is single in function and troublesome to use are solved.
Detailed Description
The technical solutions in the present invention will be described clearly and completely with reference to the accompanying drawings, and it is obvious that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention provides a handwriting pen with rich functions, convenient operation and use, a controlled device matched with the handwriting pen and a human-computer interaction system.
As shown in fig. 1, a pen-type terminal 1 provided by the present invention includes a pen-shaped pen housing, a track recording module 11 disposed in the pen housing, a mode switching module 12, a key function module 13, a pen end transceiver module 14, a switch key 15 exposed out of the pen housing, and at least two function keys 16, wherein:
the track recording module 11 is configured to generate track data corresponding to a moving track of the nib part of the pen casing in real time when the nib part of the pen casing moves, and output the track data through the pen end transceiver module 14;
a mode switching module 12, configured to select one type of mode data from at least two types of mode data according to a preset sequence when the switch key 15 is triggered, and send the selected mode data through the pen transceiver module 14, where the type of mode data includes a normal mode and a handwriting mode;
and the key function module 13 is used for outputting the position information or the number of the triggered function key 16 through the pen-end transceiver module 14.
In the embodiment, the track recording module 11 may use a photosensor used in an existing optical mouse, or may use a ball used in a conventional mouse, and preferably uses a photosensor.
The number of types of the mode data can be preset according to actual needs, and the number of types of the mode data can be two, three or more.
The order of arranging the different pattern data may be set manually, and it is preferable to arrange them in descending order according to the frequency of use, for example, the most frequently used pattern data is set at the most front position. Each time the switch key 15 is triggered, the mode switching module 12 sequentially selects and sends out one type of mode data through the pen-end transceiver module 14 according to a preset sequence, for example, the switch key 15 is triggered for the first time, the mode switching module 12 sends out mode data of a normal mode, the switch key 15 is triggered for the second time, and the mode switching module 12 sends out mode data of a handwriting mode.
In this embodiment, the physical structure of the switch key 15 or the function key 16 may be configured to be similar to the structure of the left key or the right key of the mouse, and the switch key 15 or the function key 16 may be triggered by pressing the switch key 15 or the function key 16 once, or may be configured to press the switch key 15 or the function key 16 twice or more within a certain time period to trigger the switch key 15 or the function key 16 once.
The controlled device 2 shown in fig. 2 is used by matching with the pen-type terminal 1 shown in fig. 1 provided by the invention, and comprises a controlled end transceiver module 23, a control module 24, a controlled end storage module 25 and a display screen 26;
the controlled end transceiver module 23 is configured to receive the data output by the pen end transceiver module 14, process the data into a format that can be recognized by the control module 24, and send the processed data to the control module 24;
the control module 24 is configured to identify position information or a number of the triggered function key 16 and a type of the mode data, control a cursor on the display screen 26 to move to a position corresponding to the trajectory data in real time when the type of the mode data is a normal mode, perform a left-click operation on a position pointed by the cursor when the first function key 161 is triggered, and perform a right-click operation on a position pointed by the cursor when the second function key 162 is triggered;
the control module 24 is further configured to open the handwriting input software when the type of the mode data is the handwriting mode, control the handwriting input software to record and display a picture or a character corresponding to the trajectory data on the display screen 26 in real time, and/or the control module 24 is further configured to store the picture or the character recorded by the handwriting input software when the first function key 161 is triggered and delete the picture or the character recorded by the handwriting input software when the second function key 162 is triggered when the type of the mode data is the handwriting mode.
As can be seen from the above, when the type of the mode data is the conventional mode, the pen-type terminal 1 of the present invention can implement the function of the mouse in the prior art, the first function button 161 implements the function of the left button on the mouse, and the second function button 162 implements the function of the right button on the mouse. When the type of the mode data is the handwriting mode, the pen-type terminal 1 of the present invention does not need to enter the conventional mode first, and then the left key function of the first function key 161 is used to open the handwriting input software, and the handwriting input operation can be performed directly after entering the handwriting mode.
When the system is used specifically, a pen-type terminal 1 driving program and application software corresponding to functions which can be realized by the pen-type terminal 1 are installed in the controlled device 2 in advance, and the controlled terminal transceiver module 23 on the controlled device 2 can accurately capture wireless signal data sent by the pen-end transceiver module 14 of the pen-type terminal 1, so that various control operations of the pen-type terminal 1 on the controlled device 2 are supported.
As shown in fig. 3, the human-computer interaction system provided by the present invention includes the pen-type terminal 1 provided by the present invention and the controlled device 2 provided by the present invention.
In the pen-type terminal 1 of the present invention, one type of mode data can be selected and sent out from at least two types of mode data according to a preset sequence (for example, a normal mode and a handwriting mode or a handwriting mode and a normal mode) by triggering the switch key 15, and further, the operating mode of the pen-type terminal 1 is changed by sending out different types of analog signals, that is, the function that can be realized when each function key 16 on the pen-type terminal 1 is triggered is changed, when the type of the mode data is the normal mode, the control module 24 in the controlled device 2 used in cooperation with the pen-type terminal 1 can perform a left-click operation on the position pointed by the cursor when the first function key 161 (specifically, which function key 16 is the first function key and which is the second function key can be arbitrarily set manually) on the pen-type terminal 1 is triggered, when the second function key 162 is triggered, the right click operation is performed on the position pointed by the cursor, so that the pen-type terminal 1 of the present invention can realize the function of a common mouse;
meanwhile, the control module 24 in the controlled device 2 used in cooperation with the pen-based terminal 1 can also automatically open the handwriting input software when the type of the mode data is the handwriting mode, control the handwriting input software to record and display the picture or character corresponding to the track data on the display screen 26 in real time, and/or store the picture or character recorded by the handwriting input software when the first function key 16 is triggered, and delete the picture or character recorded by the handwriting input software when the second function key 16 is triggered, so that the handwriting input can be directly performed in the handwriting input software only by triggering the switch key 15 to select and send the mode data with the handwriting mode type, or directly store or delete the content of the handwriting input, therefore, the pen-based terminal 1 has the function of quickly starting the handwriting input software and/or quickly storing or deleting the content of the handwriting input, when the pen-type terminal 1 is used for handwriting input, the operation of manually selecting and clicking handwriting input software or controlling a cursor to click a storage or deletion button in the prior art can be omitted, compared with the method which is generally adopted in the prior art of searching and clicking the storage button on the handwriting input software for storage or selecting a picture or a character and then searching and clicking the deletion button on the handwriting input software for deletion operation, the method is quicker and more convenient, and the technical problems of single function and troublesome use of the existing handwriting pen or touch pen are solved.
As shown in fig. 3, the pen-end transceiver module 14 in this embodiment is configured to perform data interaction with the controlled-end transceiver module 23 in a manner of transmitting a wireless signal or receiving a wireless signal. The pen end transceiver module 14 and the controlled end transceiver module 23 can both implement frame sealing and frame removing operations of data, and the controlled end transceiver module 23 sends the data subjected to frame sealing in a wireless signal form through an antenna, and then sends the data to the controlled end transceiver module 23, and sends the data received by the antenna after frame removing to the control module 24.
The pen-type terminal 1 can be used more conveniently because the wireless signal is transmitted or received without passing through a data line and is not limited by the length of the data line and the space around the data line, thereby not only realizing the function of the existing wireless mouse, but also being convenient to carry about and being beneficial to controlling different controlled devices 2 by using the pen-type terminal 1. Of course, in this embodiment, the pen end transceiver module 14 of the pen terminal 1 may also use a data line to perform data interaction with the controlled end transceiver module 23 of the controlled device 2, so as to also implement control of the pen terminal 1 on the controlled device 2, and the data line may be disposed at an end of the pen terminal 1 that is far away from the tip portion, so that the pen terminal 1 is more convenient to use.
The mode switching module 12 in this embodiment is further configured to send mode data once every predetermined period of time (preferably 500ms) before the switch key 15 is activated again. In this way, the control module 24 can know the latest type of the mode data, so that after the switch 15 is activated again, the control module 24 can avoid controlling the controlled device 2 with the mode data before the switch 15 is activated again. Since the time interval between two clicks of the switching key 15 by a human finger does not exceed 50ms as a rule, issuing pattern data during this time can inform the control module 24 of the latest type of pattern data.
In this embodiment, the control module 24 is further configured to update the type of the recorded pattern data after identifying the type of the new pattern data. This approach also allows the control module 24 to know the latest type of pattern data, avoiding malfunction.
As shown in fig. 4 or fig. 5, as a further improvement of the present invention, the man-machine interaction system of this embodiment includes two controlled devices 2, the type of the mode data further includes a data transmission mode, the pen-based terminal 1 further includes a data transmission function module 17 and a pen-end storage module 18, wherein:
the control module 24 of the first controlled device 21 is further configured to, when the type of the mode data sent by the mode switching module 12 is the data transmission mode, control the cursor on the display screen 26 of the first controlled device 21 to move to a position corresponding to the trajectory data, select the file pointed by the cursor when the first function key 161 is triggered, deselect the file when the second function key 162 is triggered, and send the file to the pen-end transceiver module 14 through the controlled-end transceiver module 23 of the first controlled device 21 when the third function key 163 is triggered;
the pen-end transceiver module 14 is configured to process the file into a format that can be recognized by the data transmission function module 17, and output the file to the data transmission function module 17;
the data transmission function module 17 is configured to store the file in the pen-end storage module 18, and when the third function key 163 shown in fig. 4 is triggered for the second time or when the fourth function key 16 shown in fig. 5 is triggered, send the file to the controlled-end transceiver module 23 of the second controlled device 22 through the pen-end transceiver module 14;
the control module 24 of the second controlled device 22 is configured to store the file in the controlled-end storage module 25 of the second controlled device 22.
As can be seen from the above, the pen-based terminal 1 of the present invention can implement temporary storage of data between two controlled devices 2, and the pen-based terminal 1 can first store the data in the first controlled device 21 in the pen-end storage module 18, and then send the data stored in the pen-end storage module 18 to the second controlled device 22. Of course, in this embodiment, the pen terminal 1 may also store the data in the first controlled device 21 in the pen-end storage module 18 for a period of time, and then return the data stored in the pen-end storage module 18 to the first controlled device 21 for the second time. Thus, the pen-type terminal 1 of the present invention functions as a mobile hard disk or a U disk.
As shown in fig. 4, which function key 16 is the first function key 161, which is the second function key 162, the third function key 163, or the fourth function key 16 shown in fig. 5 can be set manually. Of course, the first function key 161 and the second function key 162 may be set as the same function key 16, and the first function key 161 is considered to be triggered when the function key 16 is pressed once, and the second function key 162 is considered to be triggered when the function key 16 is pressed for the second time or when the function key 16 is continuously pressed twice within a period of time.
The data transmission function module 17 in this embodiment is further configured to clear the file stored in the pen-end storage module 18 after the file stored in the pen-end storage module 18 is sent to the controlled-end transceiver module 23 of the second controlled device 22 through the pen-end transceiver module 14. In this way, the pen-end storage module 18 may be enabled to maintain sufficient storage space for storing new files again.
The control module 24 in the first controlled device 21 in this embodiment is further configured to, when the type of the mode data is the data transmission mode and the third function key 163 is triggered, determine the size of the data volume of the file or calculate the time that the controlled-end transceiver module 23 in the first controlled device 21 needs to consume for sending the file, and when the data volume or the time that needs to consume exceeds a preset value, establish an FTP data transmission service process through the controlled-end transceiver module 23 in the first controlled device 21 and send the storage path of the file and the IP address of the first controlled device 21 to the pen-end transceiver module 14;
the pen-end transceiver module 14 is configured to process a storage path of the file and an IP address of the first controlled device 21 into a format that can be recognized by the data transmission function module 17, and output the processed storage path and the IP address to the data transmission function module 17;
the data transmission function module 17 is configured to store the storage path of the file processed by the pen-end transceiver module 14 and the IP address of the first controlled device 21 in the pen-end storage module 18, and when the third function key 163 is triggered for the second time or when the fourth function key 16 shown in fig. 5 is triggered, send the storage path of the file and the IP address of the first controlled device 21 to the controlled-end transceiver module 23 in the second controlled device 22 through the pen-end transceiver module 14;
the controlled end transceiver module 23 in the second controlled device 22 is configured to establish an FTP client process according to the storage path of the file and the IP address of the first controlled device 21, establish an FTP data transmission channel with the controlled end transceiver module of the first controlled device, and download the file from the FTP data transmission channel and store the file in the controlled end storage module 25 in the second controlled device 22.
The technical scheme of the invention can make up for the defects of insufficient storage space of the pen-end storage module 18 in the pen-type terminal 1 and unsmooth data transmission path between the pen-end transceiver module 14 and the controlled-end transceiver module 23, and is suitable for transmitting files with larger data volume.
In this embodiment, the control module 24 of the first controlled device 21 is further configured to, when the type of the mode data is the data transmission mode, select a character or picture selected by the cursor when the first function key 161 is triggered, cancel the selection of the character or picture when the second function key 162 is triggered, and send the character or picture and the type of the file in which the character or picture is located and the status information of the file to the pen end transceiver module 14 through the controlled end transceiver module 23 of the first controlled device 21 when the third function key 163 is triggered;
a pen-end transceiver module 14, configured to process the type of the character or the drawing and the file (e.g., Word, drawing tool of Windows, etc.) in which the character or the drawing is located and the state information of the file into a format that can be recognized by the data transmission function module 17, and output the processed information to the data transmission function module 17;
a data transmission function module 17, configured to store the character or picture and the type of the file in which the character or picture is located and the state information of the file in the pen-end storage module 18, and send the character or picture and the type of the file in which the character or picture is located and the state information of the file to the controlled-end transceiver module 23 of the second controlled device 22 through the pen-end transceiver module 14 when the third function key 163 is triggered for the second time or when the fourth function key 16 shown in fig. 5 is triggered;
the control module 24 of the second controlled device 22 is used for opening the software corresponding to the type of the document where the character or drawing is located to the same state as the state of the document where the character or drawing is located according to the type of the document where the character or drawing is located and the state information of the document, and loading the character or drawing into the software.
By the technical scheme provided by the invention, when the character or the picture which is being edited in the software in the first controlled device 21 needs to be used in the second controlled device 22, the whole character or picture to be edited can be directly copied from the first controlled device 21 to the software for editing the character or the picture in the second controlled device 22, the software for editing the character or the picture does not need to be manually opened, and the character or the picture is copied in, so that the scheme has higher automation degree and is more convenient to use.
The control module 24 in the first controlled device 21 in this embodiment is further configured to determine, when the type of the mode data is a data transmission mode, and the third function key 163 is activated, the data size of the character or drawing and the type of the file where the character or drawing is located and the status information of the file are determined, or the time required for the controlled terminal transceiver module 23 in the first controlled device 21 to transmit the character or drawing and the type of the file where the character or drawing is located and the status information of the file is calculated, when the data volume or the time consumed exceeds the preset value, the FTP data transmission service process is established through the controlled terminal transceiver module 23 in the first controlled device 21, and sends the storage path of the character or picture, the type of the file where the character or picture is located, the attribute data of the state information of the file, and the IP address of the first controlled device 21 to the pen-end transceiver module 14;
the pen-end transceiver module 14 is configured to process the received storage path and attribute data and the IP address of the first controlled device 21 into a format that can be recognized by the data transmission functional module 17, and output the format to the data transmission functional module 17;
the data transmission function module 17 is configured to store the storage path and the attribute data, and the IP address of the first controlled device 21 in the pen-end storage module 18, and when the third function key 163 is triggered for the second time or when the fourth function key 16 is triggered, send the storage path and the attribute data, and the IP address of the first controlled device 21 to the controlled-end transceiver module 23 in the second controlled device 22 through the pen-end transceiver module 14;
the controlled end transceiver module 23 in the second controlled device 22 is configured to establish an FTP client process according to the storage path and the attribute data, and the IP address of the first controlled device 21, establish an FTP data transmission channel with the controlled end transceiver module of the first controlled device, download the characters or pictures and the types of files where the characters or pictures are located, and the state information of the files from the FTP data transmission channel, open the software corresponding to the types of the files where the characters or pictures are located to the same state as the state of the files where the characters or pictures are located, and load the characters or pictures into the software.
The technical scheme is suitable for occasions with characters or pictures, the types of the files in which the characters or the pictures are located and the data volume of the state information of the files are large, and the technical effect is similar to that generated by the transmission of the files with large data volume, and the technical effect is not repeated; meanwhile, the above technical solution also has the function of high automation degree, and is more convenient for the second controlled device 22 to use the characters or pictures being edited on the first controlled device 21.
In this embodiment, the control module 24 is further configured to determine the spatial position of the nib part of the pen casing according to the trajectory data, determine whether the spatial position of the nib part of the pen casing is within a preset effective spatial region, and determine the position of the triggered function key 16 and the type of the mode data when the spatial position of the nib part of the pen casing is within the preset effective spatial region.
The effective space area is used for limiting the farthest distance between the position of the pen-type terminal 1 and the controlled device 2 when the pen-type terminal 1 controls the controlled device 2, so that the situation that when a plurality of controlled devices 2 exist, the plurality of controlled devices 2 which can all receive the mode data and the position information or the serial number of the triggered function key 16 cannot distinguish whether the controlled devices are controlled by the pen-type terminal 1 or not is avoided, and the plurality of controlled devices 2 are disordered.
In this embodiment, the controlled terminal transceiver module 23 and the controlled device 2 may be detachably connected. Thus, when the pen-based terminal 1 of the present invention is required to control the controlled device 2, the controlled terminal transceiving module 23 can be mounted on the controlled device 2, and conversely, the controlled terminal transceiving module 23 can be detached from the controlled device 2. When there are a plurality of controlled devices 2, it is necessary to control which controlled device 2, and then install the controlled terminal transceiver module 23 on which controlled device 2.
In this embodiment, the controlled end transceiver module 23 and the pen end transceiver module 14 conform to IEEE802.11WIFI standard, IEEE802.15 bluetooth standard or infrared wireless signal transceiver standard. The above standards all have the advantages of fast data transmission speed and convenient setting of required hardware, so that the standard is suitable for being applied to the controlled end transceiver module 23 and the pen end transceiver module 14 provided by the invention. Of course, the controlled end transceiver module 23 and the pen end transceiver module 14 in this embodiment may also conform to other wireless signal transceiving standards other than the above standards, for example: infrared (IrDA), ZigBee (IEEE 802.15.4).
In this embodiment, the track recording module 11 is a photoelectric sensor, and the controlled device 2 is a tablet computer, a notebook computer, or a desktop computer.
The photoelectric sensor has the advantage of high sensitivity. Since the pen terminal 1 of the present embodiment has a pen-shaped pen housing, the pen terminal 1 can also be used as a touch pen when the controlled device 2 is a tablet computer. The display screen 26 of the tablet computer is preferably a touch screen. When the display screen 26 of the tablet computer is a capacitive touch screen, the pen case can be made of a conductor material because the capacitive touch screen works by using current induction of a human body, so that a closed loop is formed by the human body and the capacitive touch screen.
In summary, the pen-type terminal 1 provided in the embodiment of the present invention not only has the functions of the conventional stylus pen and the touch pen, but also can realize the function of the wireless mouse, and can perform a mobile operation on a terminal device such as a tablet computer; in addition, the pen-type terminal 1 provided by the embodiment of the invention can realize convenient and barrier-free data interaction of service data of any size and selective data (for example, data to be edited) in software on a plurality of controlled devices 2 (for example, terminal devices such as desktop computers or tablet computers) and realize data copying and pasting, so that better human-computer interaction experience can be provided for users.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.