CN112835457A - 3D magic pen, display system based on 3D magic pen and use method of display system - Google Patents
3D magic pen, display system based on 3D magic pen and use method of display system Download PDFInfo
- Publication number
- CN112835457A CN112835457A CN202110165046.9A CN202110165046A CN112835457A CN 112835457 A CN112835457 A CN 112835457A CN 202110165046 A CN202110165046 A CN 202110165046A CN 112835457 A CN112835457 A CN 112835457A
- Authority
- CN
- China
- Prior art keywords
- pen
- magic pen
- magic
- trigger
- chip
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 15
- 239000011521 glass Substances 0.000 claims abstract description 33
- 238000004891 communication Methods 0.000 claims description 21
- 230000009977 dual effect Effects 0.000 claims description 2
- 230000002452 interceptive effect Effects 0.000 abstract description 8
- 230000009471 action Effects 0.000 abstract description 5
- 230000003993 interaction Effects 0.000 description 10
- 238000004898 kneading Methods 0.000 description 10
- 238000005516 engineering process Methods 0.000 description 5
- 238000013459 approach Methods 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 210000004556 brain Anatomy 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 210000000080 chela (arthropods) Anatomy 0.000 description 1
- 238000005094 computer simulation Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03545—Pens or stylus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Position Input By Displaying (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The utility model provides a 3D magic pen, 3D magic pen includes a body, a control switch and a trigger at least, be equipped with control switch on the body, the tip of body is equipped with the trigger, control switch is used for controlling the trigger state of trigger. Simultaneously this application still relates to XR system based on this 3D magic pen, and the method of use of this system. The invention provides a 3D magic pen based on XR glasses, a system and a method, which can be well matched with the conventional operation habits of human hands, simulate the pinching action of human fingers, trigger corresponding interactive operation, conveniently perform 2D/3D interactive operation in a virtual scene and have high precision.
Description
Technical Field
The invention belongs to the field of intelligent interaction equipment, and particularly relates to a 3D magic pen based on XR glasses, a display system based on the 3D magic pen, and a use method of the system.
Background
The development of virtual reality technology (VR), mixed reality technology (MR), augmented reality technology (AR), collectively referred to as XR technology, which may be associated with a variety of applications including immersive, highly visualized, computer simulated environments that may simulate the physical presence of a user in the real or imagined world, in which computer simulation may render/render 2D/3D graphical images by means of graphical displays, displayed in head mounted displays (XR glasses), is growing.
In the prior art, CN110888530A discloses an electronic map-based 3D visualization editor and an editing method, which at least include an XR glasses, where the XR glasses are at least used for displaying an electronic map of a spatial range, at least one landmark point is marked on the electronic map, at least one virtual electronic tag is created on the landmark point, and at least one editable information related to the landmark point is added in the virtual electronic tag. In the 3D era, 3D has brought a series of changes, 3D display, 3D interaction, and 3D editing. The 3D visual editor based on the electronic map can effectively improve the efficiency and effect of space three-dimensional editing, and enables only a few people to enjoy convenience brought by the editing state in the brain. CN110956702A discloses a 3D visual editor and an editing method based on a time axis, which at least comprises an XR glasses, wherein the XR glasses are used for displaying at least one time axis, at least one time node is marked on the time axis, at least one virtual electronic tag is created on the time node, and at least one editable message related to the time node is added in the virtual electronic tag. In the 3D era, 3D has brought a series of changes, 3D display, 3D interaction, and 3D editing. The 3D visual editor based on the time axis can effectively improve the efficiency and effect of space three-dimensional editing, and enables only a few people to enjoy convenience brought by the editing state presented in the brain. It can be seen that the operation of bare hands or intelligent gloves in such a large-scene and large-span operation space is very limited by distance, but the operation of the control handle is difficult to accurately and precisely send out operation instructions similar to left and right mouse buttons, especially operation instructions in a 3D space with higher complexity such as dragging and turning.
In the prior art, a user can hold an operation handle for operation, or identify a bare hand and a smart glove for operation, and construct a virtual object or perform virtual operation in a virtual environment through a space positioning technology, such as performing virtual drawing, virtual calligraphy, virtual games and the like. The operation handle is not intuitive in the interactive operation mode, the precision is not enough in the interactive operation mode by bare hands, and the identification device with limited use space range is easy to generate the phenomena of misjudgment and the like.
Therefore, based on the problems, a better interaction tool and an interaction method are designed.
Disclosure of Invention
Aiming at the defects in the prior art, the invention provides the 3D magic pen based on the XR glasses, which can well simulate the kneading action of human fingers and trigger corresponding interactive operation, and also relates to an XR system based on the 3D magic pen and a using method of the system.
In order to solve the above technical problems, the present invention is solved by the following technical solutions.
The utility model provides a 3D magic pen, 3D magic pen includes a body, a control switch (can be controller or control button according to concrete implementation mode) and a trigger at least, be equipped with control switch on the body, the tip of body is equipped with the trigger, control switch is used for controlling the trigger state of trigger.
In a preferred embodiment, the pen body is of a structure with a changeable length, such as a cylindrical sleeve rod type structure, a folding type structure, a scissor type structure, a sliding sheet type structure, a telescopic type structure and the like.
In a preferred embodiment, the pen body is at least one of a nested cylindrical rod, a folding rod, a sliding shaft, a handle rod, a worm, a scissor rod or a rack, and the length of the pen body can be adjusted to perform kneading operation.
In a preferred embodiment, the control switch is at least one of a press controller, a pinch controller or a press controller, and can sense the press operation of a human finger to generate a corresponding command.
In a preferred embodiment, the trigger is at least one of a sliding contact piece, a contact piece or a double space positioning sensor, and when the trigger touches or approaches each other, the pinching operation of human fingers can be simulated.
In a preferred embodiment, the 3D magic pen further includes a communication module and a spatial position sensor.
In a preferred embodiment, the pen body of the 3D magic pen is composed of two pen holders, and the two pen holders are not connected, or the two pen holders are cross-fixedly connected at the middle section, or the two pen holders are shaft-fixedly connected at the end parts.
In a preferred embodiment, the body of the 3D magic pen is composed of two pen holders, the two pen holders are fixedly connected at the ends, and the two pen holders are made of a flexible material, or the two pen holders are connected at the ends by an elastic member.
In a preferred embodiment, the dual spatial locator sensor is located at a fixed distance from the pen tip.
In a preferred embodiment, the communication module transmits the spatial position information of the pen point (pen point)/the pen body to an XR device.
In a preferred embodiment, when the triggers are in contact with each other or approach a distance threshold, the trigger state is determined, and a corresponding instruction is generated.
In a preferred embodiment, the communication module transmits the state information of the trigger to an XR device.
In a preferred embodiment, the holder of the 3D magic pen is further provided with at least one control button and/or at least one control ring, preferably two control buttons, which can be operated by a left button and a right button of the mouse.
In a preferred embodiment, the communication module transmits control information of the controller to an XR device.
In a preferred embodiment, the spatial position sensor is at least one of an IMU sensor, a UWB sensor, a micro-structured light camera, or a micro TOF camera.
In a preferred embodiment, the communication module is at least one of a bluetooth chip, a zigbee chip, an IR chip, an RFID chip, a baseband chip, a WIFI chip, an LIFI chip, or a microwave communication chip.
In this application, a display system based on 3D magic pen, display system includes planar display equipment, XR glasses and foretell 3D magic pen at least.
In a preferred embodiment, the XR glasses are at least provided with a computing unit, a storage unit and a communication unit, and the 3D magic pen is in communication connection with the flat display device and the XR glasses in a wireless or wired manner.
In a preferred embodiment, the communication unit obtains spatial position information of a pen body/a pen point of the 3D magic pen, control information of a controller and/or status information of a contactor, and the XR glasses are at least provided with the calculation unit for the communication module to calculate the spatial position information of the pen point according to the spatial position information of the pen body.
The application provides a display system use method based on a 3D magic pen, which comprises any one of the following steps: determining the pen point spatial position of the 3D magic pen according to the spatial position information of the pen point of the 3D magic pen; judging the space position of a pen point of the 3D magic pen according to the space position information of the pen body of the 3D magic pen; judging the contact condition of a contact piece of the 3D magic pen and the pressing condition of a left key and a right key according to the control information of the 3D magic pen; and judging any state of left/right clicking, sliding, hovering, double clicking or long pressing of the 3D magic pen according to the triggering state information of the 3D magic pen.
In a preferred embodiment, the display system displays continuous/discontinuous strokes, straight strokes, curved strokes, parabolas simulating shooting or right-click menus in the spatial display of the XR system according to any one of the states of left/right clicking, crossing, hovering, double-clicking or long-pressing of the 3D magic pen.
In a preferred embodiment, a display method based on a 3D magic pen includes any one of the following steps:
and determining the pen point spatial position of the 3D magic pen according to the spatial position information of the pen point of the 3D magic pen, and displaying the triggered 2D/3D display content of the 3D magic pen in a 2D/3D display device according to the control information and the position information of the 3D magic pen.
Compared with the prior art, the invention has the following beneficial effects: the utility model provides a 3D magic pen based on XR glasses, the action of kneading of the fine simulation people's finger in the 3D space to trigger corresponding interactive operation, make mouse control command under the similar 2D plane operation, this kind of 3D magic pen has prolonged people's arm and finger effectively, can freely carry out some operation, line operation, face operation or multiple spot operation in the space (use 2 3D magic pens at least, both hands two pens interoperation). Meanwhile, the invention also relates to an XR system or plane display based on the 3D magic pen, namely stroke in a 3D space and display in a 2D plane, and a using method of the system.
Drawings
Fig. 1 is a schematic view of a 3D magic pen according to a first embodiment of the present invention.
Fig. 2 is a schematic view of a 3D magic pen according to a second embodiment of the present invention.
Fig. 3 is a schematic view of a 3D magic pen according to a third embodiment of the present invention.
Fig. 4 is a schematic view of a 3D magic pen according to a fourth embodiment of the present invention.
Fig. 5 is a schematic view of a 3D magic pen according to a fifth embodiment of the present invention.
Fig. 6 is a schematic view of a 3D magic pen according to a sixth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and specific embodiments.
The embodiments described below by referring to the drawings, in which the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout, are exemplary only for explaining the present invention, and are not construed as limiting the present invention.
In this application, a 3D magic pen based on XR glasses, 3D magic pen includes a body, a control switch and a trigger at least, be equipped with control switch on the body, the tip of body is equipped with the trigger, control switch is used for controlling the trigger state of trigger.
In the application, the pen body is a structure with changeable length, such as at least one of a nested cylindrical rod, a folding rod, a sliding shaft/rod, a handle rod, a worm, a scissor rod or a rack rod, and the length of the pen body can be adjusted to perform kneading operation.
In this application, control switch is at least one in the formula controller of withholding, the clamp holds pressure formula controller or push type controller, can the perception people press the operation of finger, produces corresponding instruction. The trigger is at least one of a sliding contact piece, a contact piece or a double-space positioning sensor, when the trigger touches or approaches each other to reach a distance threshold value, the pinch operation of a human finger can be simulated, and the double-space positioning sensor is arranged at a position with a fixed distance from the pen point.
In addition, in this application, 3D magic pen still includes communication module and an at least spatial position sensor. And the communication module transmits the spatial position information of the pen point/pen body, the state information of the trigger and the control information of the controller to XR equipment. Preferably, the spatial position sensor is at least one of an IMU sensor, a UWB sensor, a micro-structured light camera, or a micro TOF camera. The communication module is at least one of a Bluetooth chip, a Zigbee chip, an IR chip, an RFID chip, a baseband chip, a WIFI chip, an LIFI chip or a microwave communication chip.
In the application, the pen holder of the 3D magic pen is further provided with at least one control button and/or at least one control ring, preferably two, and the control buttons can be correspondingly operated by a left mouse button and a right mouse button.
In this application, a display system based on 3D magic pen, display system includes planar display equipment, XR glasses and foretell 3D magic pen at least. XR glasses are equipped with computational element, memory cell and communication unit at least, and 3D magic pen is connected through wireless or wired mode communication with plane display device or XR glasses.
In addition, in the display system, the communication unit obtains spatial position information of a pen body/a pen point of the 3D magic pen, control information of a controller and/or state information of a contactor, and the XR glasses are at least provided with the calculation unit, so that the communication module can calculate the spatial position information of the pen point according to the spatial position information of the pen body.
The application provides a display system use method based on a 3D magic pen, which comprises any one of the following steps: determining the pen point spatial position of the 3D magic pen according to the spatial position information of the pen point of the 3D magic pen; judging the space position of a pen point of the 3D magic pen according to the space position information of the pen body of the 3D magic pen; judging the contact condition of a contact piece of the 3D magic pen and the pressing condition of a left key and a right key according to the control information of the 3D magic pen; and judging any state of left/right clicking, sliding, hovering, double clicking or long pressing of the 3D magic pen according to the triggering state information of the 3D magic pen.
Preferably, the display system displays a continuous/discontinuous stroke, a straight stroke, a curved stroke, a parabola simulated by shooting or a right-click menu in the space of the display system according to any one state of left/right clicking, crossing, hovering, double-clicking or long-pressing of the 3D magic pen.
The following are specific examples of the present application.
Example one：
Referring to fig. 1, the 3D magic pen has a chopstick-shaped pen body 21, a clamping and pressing type (ring) controller 22 is arranged on the chopstick-shaped pen body 21, and the clamping and pressing type controller 22 is sleeved on the chopstick-shaped pen body 21 and can be rotated and adjusted in a direction perpendicular to the pen holder 21, so that the operating habits of different people can be adapted. The front end of the chopstick-shaped pen body 21 is provided with a contact piece 1, the chopstick pen body can be separated and not connected, or can be connected, and the rear end of the chopstick-shaped pen body 21 is provided with a flexible connecting piece or an elastic connecting piece 3. Can be held by the front hand or the back hand.
When the 3D magic pen in this embodiment is used, the user wears the XR glasses and then uses the 3D magic pen like chopsticks. In operation, the pressing operation of the finger can be recognized by the pressing sensor in the pinch-grip controller 22, and the signal is transmitted to the flat panel display device, the XR glasses, the XR device, the router or the network device (including the server), so as to generate operations of left-click, right-click, long-press, dragging and the like of the mouse, and interact with the virtual 3D space. When the user made the front end contact with operation 3D magic pen, two contact piece 1 mutual contacts produced the signal, and this signal is discerned for kneading the operation, can carry out the corresponding operation in the virtual scene, and it is more convenient to make virtual interaction, and the precision is high when just operating.
Example two：
Referring to fig. 2, the 3D magic pen has a tweezer-shaped pen body 24, at least one pressing/contact controller 22 is provided on (both sides of) the tweezer-shaped pen body 24, a contact piece 1 is provided at the front end of the tweezer-shaped pen body 24, and the rear ends of the tweezer-shaped pen body 24 are connected together, as with conventional tweezers.
When the 3D magic pen in this embodiment is used, the user takes the XR glasses and then uses the 3D magic pen like tweezers. During operation, the pressing operation of the finger can be recognized by a pressing sensor in the pressing controller, and the signal is transmitted to XR glasses or XR equipment, so that the mouse can be left-clicked, right-clicked, long-pressed, dragged and the like, and the interaction with the virtual 3D space is realized. When the user made the front end contact with operation 3D magic pen, two contact piece 1 mutual contacts produced the signal, and this signal is discerned for kneading the operation, can carry out the corresponding operation in the virtual scene, and it is more convenient to make virtual interaction, and the precision is high when just operating.
EXAMPLE III：
Referring to fig. 3, the 3D magic pen has a pincer-shaped pen body 25, a contact piece 1 is disposed at the front end of the pincer-shaped pen body 25, a hand-held operation portion 251 is disposed at the rear end of the pincer-shaped pen body 25, and a pressing type controller is disposed on the hand-held operation portion 251 in the same manner as a conventional pincer.
When the 3D magic pen in this embodiment is used, the user takes the XR glasses and then uses the 3D magic pen like using pliers. During operation, the pressing operation of the hand can be recognized by a pressing sensor in the pressing controller, and the signal is transmitted to XR glasses or XR equipment, so that the mouse can be left-clicked, right-clicked, long-pressed, dragged and the like, and the mouse can interact with the virtual 2D interface/3D space. When the user made the front end contact with operation 3D magic pen, two contact piece 1 mutual contacts produced the signal, and this signal is discerned for kneading the operation, can carry out the corresponding operation in the virtual scene, makes virtual meeting/each other more convenient, and the precision is high during the operation.
Example four：
Referring to fig. 4, the 3D magic pen has a clamp-shaped pen body 26, one end of the clamp-shaped pen body 26 is a clamp end 261, the ends of two clamping rods on the clamp end 261 are provided with contact pieces 1, the other end of the clamp-shaped pen body 26 is an operation end 27 on which a holding rod 271 is arranged, and a pressing type controller is arranged on the holding rod 271 in the same operation manner as a conventional clamp.
When the 3D magic pen in this embodiment is used, the user takes the XR glasses and then uses the 3D magic pen like a conventional jig. During operation, the pressing operation on the grip 271 can be recognized by a pressing sensor in the pressing controller, and the signal is transmitted to the XR glasses or XR equipment, so as to generate operations of left-click, right-click, long-press, dragging and the like of the mouse, and interact with the virtual 3D space. When the user made the front end contact with operation 3D magic pen, two contact piece 1 mutual contacts produced the signal, and this signal is discerned for kneading the operation, can carry out the corresponding operation in the virtual scene, and it is more convenient to make virtual interaction, and the precision is high when just operating.
Besides various operations of a simulated mouse, the 3D magic pen can simulate long/short gun operation, a space sensor is respectively arranged at a pen point and a pen body, such as an IMU (inertial measurement unit), when a user flatly holds a 'pistol' or a pen holder after the flatly holds the extension (a long gun state), the orientation of a 'gun rod' can be determined by the system according to the space position information of the front IMU and the back IMU, and when the user presses a pressing type controller on the holding rod 271 (when a trigger), the virtual system can trigger the launching of a virtual bullet or a missile guidance curve of a crossbow arrow. Therefore, the applicable scenes of the 3D pen can be enriched. Such as in CS game scenes, flat screen or VR glasses scenes.
EXAMPLE five：
Referring to fig. 5, the 3D magic pen has an extruding slide bar-shaped pen body including a fixing rod 51 and a slide bar 52, one end of the fixing rod 51 and one end of the slide bar 52 are provided with a contact piece 1, the other end of the fixing rod 51 and the other end of the slide bar 52 are connected through an elastic body 55, the slide bar 52 has a deformable structure, and the slide bar 52 can be pressed down and reset under the action of its own elasticity or the elastic force of the elastic body 55. When the slide bar 52 is pushed down, the contact piece 1 at the end thereof is brought close to the contact piece 1 on the fixing lever 51 and brought into contact therewith. The fixing lever 51 is provided with a finger operation unit 53 in which a pressing sensor is provided.
When the 3D magic pen in this embodiment is used, the user takes the XR glasses and then presses/squeezes the 3D magic pen. During operation, the pressing operation on the grip 271 can be recognized by a pressing sensor in the pressing controller, and the signal is transmitted to the XR glasses or XR equipment, so as to generate operations of left-click, right-click, long-press, dragging and the like of the mouse, and interact with the virtual 2D interface/3D space. When the user made the front end contact with operation 3D magic pen, two contact piece 1 mutual contacts produced the signal, and this signal is discerned for kneading the operation, can carry out the corresponding operation in the virtual scene, and it is more convenient to make virtual interaction, and the precision is high when just operating.
Besides various operations of a mouse, the 3D magic pen can also simulate long/short gun operation, a space sensor is respectively arranged at a pen point and a pen body, such as an IMU (inertial measurement unit), when a user flatly holds a 'pistol' or a pen holder with a flatly extended flat end (a long gun state), the system can determine the orientation of a 'gun rod' according to the space position information of the front IMU and the back IMU, and when the user presses a trigger of the finger operation unit 53, the virtual system can trigger the launching of a virtual bullet or a missile guidance curve of a crossbow arrow. Therefore, the applicable scenes of the 3D pen can be enriched.
From the above description and the embodiments, it can be seen that the invention provides the XR glasses-based 3D magic pen, the XR glasses-based system and the XR glasses-based 3D magic pen method, which can well match the conventional operation habits of human hands, simulate the pinching action of human fingers, trigger corresponding interactive operation, conveniently perform interactive operation of virtual scenes, and have high precision.
Example six:
referring to fig. 6, the 3D magic pen has a pistol-shaped pen body 28, one end of the pistol-shaped pen body 28 is a scissor mechanism 281, an end of the scissor mechanism 281 is provided with a pair of pliers 282, end portions of two clamping pieces on the pliers 282 are provided with contact pieces 1, the pistol-shaped pen body 28 includes a handle portion 284, a press-fit controller 283 is arranged on the handle portion 25, a press sensor is arranged on the handle portion, operation is the same as that of a conventional pistol, when a user presses, the scissor mechanism 281 is extended, and the two contact pieces 1 on the pliers 282 are close to contact, and a kneading operation is triggered.
In addition to simulating various operations of a mouse, the 3D magic pen can also simulate gun operations, a space sensor such as an IMU is respectively arranged at a pen point (a clamp 282) and a pen body, when a user flatly holds a 'pistol', the system can determine the orientation of a 'gun rod' according to the space position information of two IMUs at the front and the back, and when the user presses a trigger of a press-button controller 283, the virtual system can trigger the launch of a virtual bullet or a missile-guided curve of a crossbow arrow. Therefore, the applicable scenes of the 3D pen can be enriched.
The scope of the present invention includes, but is not limited to, the above embodiments, and the present invention is defined by the appended claims, and any alterations, modifications, and improvements that may occur to those skilled in the art are all within the scope of the present invention.
Claims (9)
1. The utility model provides a 3D magic pen, its characterized in that, 3D magic pen includes a body, a control switch and a trigger at least, be equipped with control switch on the body, the tip of body is equipped with the trigger, control switch is used for controlling the trigger state of trigger.
2. The 3D magic pen according to claim 1, wherein the pen body is a length-changeable structure.
3. The 3D magic pen of claim 2, wherein the pen body is at least one of a nested cylindrical rod, a folding rod, a sliding shaft, a handle rod, a worm, a scissor rod or a rack.
4. The 3D magic pen of claim 1, wherein the control switch is at least one of a button-press type controller, a clip-grip type controller or a press type controller.
5. The 3D magic pen of claim 1, wherein the trigger is at least one of a sliding contact strip, a contact strip or a dual spatial location sensor.
6. The 3D magic pen according to claim 1, wherein the 3D magic pen further comprises a communication module and a spatial position sensor.
7. The 3D magic pen according to claim 6, wherein the communication module is at least one of a Bluetooth chip, a Zigbee chip, an IR chip, an RFID chip, a baseband chip, a WIFI chip, a LIFI chip or a microwave communication chip.
8. A display system based on a 3D magic pen, characterized in that the display system comprises at least a planar display device or XR glasses and the 3D magic pen according to any one of claims 1 to 5.
9. A use method of a display system based on a 3D magic pen is characterized by comprising any one of the following steps:
determining the pen point spatial position of the 3D magic pen according to the spatial position information of the pen point of the 3D magic pen;
judging the space position of a pen point of the 3D magic pen according to the space position information of the pen body of the 3D magic pen;
judging the contact condition of a contact piece of the 3D magic pen and the pressing condition of a left key and a right key according to the control information of the 3D magic pen;
and judging any state of left/right clicking, sliding, hovering, double clicking or long pressing of the 3D magic pen according to the triggering state information of the 3D magic pen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110165046.9A CN112835457A (en) | 2021-02-06 | 2021-02-06 | 3D magic pen, display system based on 3D magic pen and use method of display system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110165046.9A CN112835457A (en) | 2021-02-06 | 2021-02-06 | 3D magic pen, display system based on 3D magic pen and use method of display system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112835457A true CN112835457A (en) | 2021-05-25 |
Family
ID=75932433
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110165046.9A Pending CN112835457A (en) | 2021-02-06 | 2021-02-06 | 3D magic pen, display system based on 3D magic pen and use method of display system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112835457A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116092362A (en) * | 2023-04-10 | 2023-05-09 | 南昌嘉研科技有限公司 | Forceps clamping training system and method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103513771A (en) * | 2013-10-09 | 2014-01-15 | 深圳先进技术研究院 | System and method for using intelligent glasses in cooperation with interactive pen |
| CN106648161A (en) * | 2015-11-04 | 2017-05-10 | 群光电子股份有限公司 | Stylus structure |
| CN107783674A (en) * | 2016-08-27 | 2018-03-09 | 杨博 | A kind of augmented reality exchange method and action induction felt pen |
| CN110764633A (en) * | 2019-11-11 | 2020-02-07 | 上海海洋大学 | Gesture control pen-shaped mouse |
| CN110794958A (en) * | 2018-08-03 | 2020-02-14 | 罗技欧洲公司 | Stylus device and input device for use in augmented/virtual reality environments |
| CN112074802A (en) * | 2018-05-18 | 2020-12-11 | 株式会社和冠 | Position pointing device and information processing device |
-
2021
- 2021-02-06 CN CN202110165046.9A patent/CN112835457A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103513771A (en) * | 2013-10-09 | 2014-01-15 | 深圳先进技术研究院 | System and method for using intelligent glasses in cooperation with interactive pen |
| CN106648161A (en) * | 2015-11-04 | 2017-05-10 | 群光电子股份有限公司 | Stylus structure |
| CN107783674A (en) * | 2016-08-27 | 2018-03-09 | 杨博 | A kind of augmented reality exchange method and action induction felt pen |
| CN112074802A (en) * | 2018-05-18 | 2020-12-11 | 株式会社和冠 | Position pointing device and information processing device |
| CN110794958A (en) * | 2018-08-03 | 2020-02-14 | 罗技欧洲公司 | Stylus device and input device for use in augmented/virtual reality environments |
| CN110764633A (en) * | 2019-11-11 | 2020-02-07 | 上海海洋大学 | Gesture control pen-shaped mouse |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116092362A (en) * | 2023-04-10 | 2023-05-09 | 南昌嘉研科技有限公司 | Forceps clamping training system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103336575B (en) | The intelligent glasses system of a kind of man-machine interaction and exchange method | |
| CN104769522B (en) | The remote controllers with gesture identification function are pointed to 3D | |
| KR101705924B1 (en) | Spatial, Multi-Modal Control Device for Use with Spatial Operating System | |
| CN102193631A (en) | Wearable three-dimensional gesture interaction system and using method thereof | |
| CN106445118B (en) | Virtual reality exchange method and device | |
| WO2018196552A1 (en) | Method and apparatus for hand-type display for use in virtual reality scene | |
| KR102021851B1 (en) | Method for processing interaction between object and user of virtual reality environment | |
| KR20120126508A (en) | method for recognizing touch input in virtual touch apparatus without pointer | |
| CN108159685A (en) | Virtual sort of rocker control method and system and its medium and equipment based on gyroscope | |
| Issartel et al. | A tangible volume for portable 3D interaction | |
| CN110543230A (en) | Stage lighting element design method and system based on virtual reality | |
| CN105224089A (en) | Gesture operation method and device, mobile terminal | |
| CN112835457A (en) | 3D magic pen, display system based on 3D magic pen and use method of display system | |
| JP2015135572A (en) | Information processing apparatus and control method of the same | |
| US20240134461A1 (en) | Gesture interaction method and system based on artificial reality | |
| WO2019150430A1 (en) | Information processing device | |
| TW201325101A (en) | Distant multipoint remote control device and system | |
| WO2023227072A1 (en) | Virtual cursor determination method and apparatus in virtual reality scene, device, and medium | |
| CN104820584A (en) | Natural control 3D gesture interface and system facing hierarchical information | |
| CN105955488B (en) | A kind of method and apparatus of operation control terminal | |
| CN116721580A (en) | Virtual instrument setting method and instrument simulation system | |
| CN108205373B (en) | Interaction method and system | |
| Darbar et al. | Text selection in ar-hmd using a smartphone as an input device | |
| Yıldıran et al. | AiRType: an air-tapping keyboard for augmented reality environments | |
| CN106020468A (en) | Glove controlled augmented reality system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210525 |
|
| RJ01 | Rejection of invention patent application after publication |