CN107122109A - A kind of multi-channel adaptive operating method towards three-dimensional pen-based interaction platform - Google Patents
A kind of multi-channel adaptive operating method towards three-dimensional pen-based interaction platform Download PDFInfo
- Publication number
- CN107122109A CN107122109A CN201710402142.4A CN201710402142A CN107122109A CN 107122109 A CN107122109 A CN 107122109A CN 201710402142 A CN201710402142 A CN 201710402142A CN 107122109 A CN107122109 A CN 107122109A
- Authority
- CN
- China
- Prior art keywords
- pen
- msub
- based interaction
- interaction
- mrow
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
The present invention relates to a kind of multi-channel adaptive operating method towards three-dimensional pen-based interaction platform, belong to field of human-computer interaction.Including：The three-dimensional coordinate information of the empty nib of book is obtained using ultrasonic wave three-dimensional high-precision wireless location technology, using accelerometer and the angle of pitch and azimuth information of the empty pen of gyroscope information acquisition book, calculate the maximum nib distance change amount of the empty pen of corresponding book and a figure state variable quantity, and the distance threshold and posture threshold value set based on user's self attributes, carry out user view analysis, the adaptive switching of pen type passage and voice channel is completed, and performs the operation corresponding to adaptively selected passage.The present invention to pen-based input and the natural interactive mode of two kinds of phonetic entry by carrying out the accurate manipulation that adaptive switching completes virtual target object.
Description
Technical field
The invention belongs to field of human-computer interaction, three-dimensional pen-based interaction field is referred in particular to, and in particular to a kind of towards three-dimensional
The multi-channel adaptive operating method of pen-based interaction platform.
Background technology
With the development in the fields such as wearable device, smart home, Internet of Things, make comprehensively it is intelligentized life into
For ensuing study hotspot, and how to make that the mode of man-machine interaction is more natural, smooth just become realizes these technologies
Key link.Pen-based interaction is increasingly valued by people as a kind of natural interactive mode, is field of human-computer interaction
One study hotspot.At present, the interactive mode based on paper pen metaphor achieves good development in two dimensional surface interaction,
If the pen-based interaction that traditional two-dimentional pen-based interaction is expanded under three dimensions, Consumer's Experience can be not only allowed more to enrich
Interactive mode, bring more enjoyment, but also bigger valency can have been given play in fields such as education, remote interaction, meetings
Value.
In order that three-dimensional pen type or the interaction of hand formula with other interactive modes more naturally, generally merged.Wherein, in
State's patent " a kind of multichannel precision target localization method towards touch control device " (application number 201110445164.1) is disclosed
A kind of precision target localization method towards touch control device, the blending algorithm with phonetic entry is inputted using touch-control, obtains accurate
Target positioning.But this method is only applicable to plane interaction, and be not suitable for and three-dimensional manipulating.Chinese patent " is based on voice
With the multi-modal non-tactile man-machine interaction method and system of gesture identification " (application number CN201510396954.3) disclose one kind
Voice and the interactive mode of gesture fusion, on the basis of basic speech recognition, gesture identification, by defining voice and gesture
Combination semantic improve interactive efficiency.But this method limits the right that user oneself selects exchange channels, so exists
The drawbacks of there is certain under some specific interactive occasions.So the wish according to people in interaction realizes exchange channels
Natural switching then seem extremely important so as to coordinate user to complete more accurate operation.
The content of the invention
The present invention provides a kind of multi-channel adaptive operating method towards three-dimensional pen-based interaction platform, it is therefore intended that utilize
Multichannel is inputted, so as to complete the accurate manipulation to virtual target object using the advantage of different passages.
The present invention is adopted the technical scheme that, is comprised the following steps：
(1), user is integrated in the exchange channels in pen when being interacted using pen-based interaction platform and dummy object
Data are sent to processing unit by input block with certain frequency collection style of brushwork input information and speech input information；
(2), by analyzing the spatial positional information (x, y, z) and spatial attitude information (α, β) of pen, multichannel is utilized
Blending algorithm realizes that user view is analyzed, and completes the natural switching of pen-based interaction passage and interactive voice passage；
(3), according to selected exchange channels, using corresponding channel operation algorithm, perform to virtual target object
Operational transformation.
Pen-based interaction platform of the present invention include the empty pattern of three-dimensional book interaction pen external member and electronic whiteboard or
The main frame external member such as LCD screen.User is when virtual target object is interacted in using pen and interactive interface, the space bit of pen
Confidence ceases and attitude information can pass through the ultrasonic sensor and accelerometer gyroscope in pen-based interaction passage respectively
Obtain in real time, the voice messaging of user can be obtained by the microphone being integrated on pen.For the ease of being deposited to interaction data
The data of the two exchange channels are carried out time sharing sampling, are integrated into and are located together by storage, transmission and processing, the present invention
Reason.
Multichannel fusion algorithm in step (2) of the present invention, comprises the following steps：
(1), the sampled point gathered in pen-based interaction passage is sequentially stored in the storage queue that length is N；
(2), this N number of groups of samples is gathered into two, positional information set A={ a0…ai…aN-1, attitude information collection
Close B={ b0…bi…bN-1, wherein the sampled point that numbering is N-1 is the sampled point at nearest moment；
(3) point of each in location sets, is calculated relative to a0Variable quantity △ D, and obtain maximum △ therein
Dmax；Each attitude angle is calculated in attitude angle set relative to b0Variable quantity △ θ, and obtain maximum △ therein
θmax；
(4), judging distance knots modification △ DmaxWith distance threshold △ Dth, angulation change amount △ θmaxWith angle threshold △ θth
Magnitude relationship, if △ DmaxWith △ θmaxRespective threshold value is respectively smaller than, then judges user view as interactive voice, is switched naturally
The operation corresponding to interactive voice is performed to interactive voice passage and to dummy object；Otherwise judge that the interaction of user is intended to pen
Formula is interacted, and pen-based interaction passage is switched to naturally and the operation corresponding to pen-based interaction is performed to dummy object.
In Multichannel fusion algorithm in step (2) of the present invention, the queue stores pen in interaction respectively
Position and attitude information, wherein the computational methods apart from knots modification are：
The computational methods of posture knots modification are：With interactive continuous progress, team
Data in row are also constantly updated, and the state of user's pen in interaction can be thus detected in real time, so that it is determined that with
The interaction intention at family, and it is switched to the corresponding operation of corresponding exchange channels execution.
Further, by pen-based input passage obtain pen position and attitude information, including coordinate data (x, y, z) with
And angle-data (α, β), according to a series of amount of state variation of current time and last moment sampled point either sampled points
Variation tendency is mapped to the control method to destination object；Speech data information is obtained by phonetic entry passage, language is utilized
Sound recognizes engine to recognize described speech data information, and is mapped to the control method to destination object.
In actual mechanical process, it is possible to use patent of the present invention is realized to the continuous of some property values of virtual target object
Manipulation, such as manipulate a cube by pen-based interaction passage, makes it that corresponding rotation occur with the attitudes vibration begun to write；
The discrete manipulation to some property values of virtual target object can also be realized, such as by speech control this cube make its to
Upper 1 degree of rotation, by this method, is just solved in pen-based interaction mode produced by the natural shake of hand, the position error of pen
The not accurate problem of operation, and the problem of can not embody operating process in interactive voice mode.
Present invention utilizes pen-based interaction mode and interactive voice mode：Realized by pen-based interaction to virtual target pair
As the continuous manipulation of some property values, the discrete manipulation to some property values of virtual target object is realized by interactive voice.Profit
Both interactive modes are combined with the natural handoff algorithms of multichannel, both advantages can be combined, realize more accurately
Manipulation.
The present invention has the advantage that as follows with good effect compared with prior art：
1) the natural switching of passage is completed by adaptive handoff algorithms, controls, makes without using hardware configurations such as buttons
It must interact more natural.
2) by combining the advantage of two kinds of passages, the continuous or discrete behaviour to some property values of virtual target object is completed
Control so that interaction effect is more accurate.
Brief description of the drawings
Fig. 1 is the structured flowchart of pen-based interaction platform of the present invention；
Fig. 2 is to showing that virtual target object is accurately manipulated under pen-based interaction platform of the invention three-dimensional using multichannel
It is intended to；
Fig. 3 is the schematic diagram of Multichannel fusion algorithm of the present invention；
Fig. 4 is the calculation flow chart of distance change amount of the present invention.
Embodiment
Comprise the following steps：
(1), user is integrated in the exchange channels in pen when being interacted using pen-based interaction platform and dummy object
Data are sent to processing unit by input block with certain frequency collection style of brushwork input information and speech input information；
(2), by analyzing the spatial positional information (x, y, z) and spatial attitude information (α, β) of pen, multichannel is utilized
Blending algorithm realizes that user view is analyzed, and completes the natural switching of pen-based interaction passage and interactive voice passage；
(3), according to selected exchange channels, using corresponding channel operation algorithm, perform to virtual target object
Operational transformation.
Pen-based interaction platform of the present invention include the empty pattern of three-dimensional book interaction pen external member and electronic whiteboard or
The main frame external member such as LCD screen.User is when virtual target object is interacted in using pen and interactive interface, the space bit of pen
Confidence ceases and attitude information can pass through the ultrasonic sensor and accelerometer gyroscope in pen-based interaction passage respectively
Obtain in real time, the voice messaging of user can be obtained by the microphone being integrated on pen.For the ease of being deposited to interaction data
The data of the two exchange channels are carried out time sharing sampling, are integrated into and are located together by storage, transmission and processing, the present invention
Reason.
Multichannel fusion algorithm in step (2) of the present invention, comprises the following steps：
(1), the sampled point gathered in pen-based interaction passage is sequentially stored in the storage queue that length is N；
(2), this N number of groups of samples is gathered into two, positional information set A={ a0…ai…aN-1, attitude information collection
Close B={ b0…bi…bN-1, wherein the sampled point that numbering is N-1 is the sampled point at nearest moment；
(3) point of each in location sets, is calculated relative to a0Variable quantity △ D, and obtain maximum △ therein
Dmax；Each attitude angle is calculated in attitude angle set relative to b0Variable quantity △ θ, and obtain maximum △ therein
θmax；
(4), judging distance knots modification △ DmaxWith distance threshold △ Dth, angulation change amount △ θmaxWith angle threshold △ θth
Magnitude relationship, if △ DmaxWith △ θmaxRespective threshold value is respectively smaller than, then judges user view as interactive voice, is switched naturally
The operation corresponding to interactive voice is performed to interactive voice passage and to dummy object；Otherwise judge that the interaction of user is intended to pen
Formula is interacted, and pen-based interaction passage is switched to naturally and the operation corresponding to pen-based interaction is performed to dummy object.
In Multichannel fusion algorithm in step (2) of the present invention, the queue stores pen in interaction respectively
Position and attitude information, wherein the computational methods apart from knots modification are：
The computational methods of posture knots modification are：With interactive continuous progress, team
Data in row are also constantly updated, and the state of user's pen in interaction can be thus detected in real time, so that it is determined that with
The interaction intention at family, and it is switched to the corresponding operation of corresponding exchange channels execution.
Further, by pen-based input passage obtain pen position and attitude information, including coordinate data (x, y, z) with
And angle-data (α, β), according to a series of amount of state variation of current time and last moment sampled point either sampled points
Variation tendency is mapped to the control method to destination object；Speech data information is obtained by phonetic entry passage, language is utilized
Sound recognizes engine to recognize described speech data information, and is mapped to the control method to destination object.
To enable objects, features and advantages of the present invention to become apparent, below by instantiation, and with reference to accompanying drawing,
More detailed explanation is made to the present invention.
1st, interactive interface 11 and empty 10 liang of the pen of three-dimensional book such as including electronic whiteboard of the pen-based interaction platform described in this method
Individual part, Fig. 1 is pen type interactive system structured flowchart of the present invention, and the empty pen 10 of three-dimensional book is by microphone 101, Bluetooth communication
Module 102, MEMS six-axle accelerations/gyroscope 103, button 104 and PVDF ultrasonic membranes 105 are constituted, and interactive screen 11 is by showing
Show that interface 110 and ultrasonic sensor 111 are constituted.Microphone 101 mainly collects the data of interactive voice, MEMS in interaction pen 10
Six-axle acceleration/gyroscope 103 is used for obtaining the angle of pitch α and azimuthal angle beta of pen, and button 104 can pass through different combination shapes
Formula realizes different functions, and PVDF ultrasonic membranes 105 send ultrasonic signal, combined with the ultrasonic sensor 111 of interactive screen 11
Complete positioning function of the pen in three dimensions.Interactive system is interacted logical by certain frequency to interactive voice passage and the style of brushwork
Road is sampled, and obtained voice messaging, the locus of pen and attitude information is sent to by bluetooth communication 102 is
System, completes further processing.
2nd, there is provided pen is utilized in a kind of three-dimensional pen-based interaction platform to target pair using multi-modal interaction technology by the present invention
Method as accurately being manipulated, the entire block diagram as shown in Figure 2 20 of this method.Pen-based input is gathered using pen-based interaction passage
Information 201, successional feature is had according to the change of the locus of pen and attitude information, with pen-based interaction realize pair
The continuous manipulation of destination object, and then realize the consecutive variations of some property values of destination object, such as manipulating one by pen stands
Cube, makes it that corresponding rotation occur with the attitudes vibration begun to write；The information of phonetic entry is gathered using interactive voice passage
202, the control information realized according to voice has discreteness, deterministic feature, although can not realize some of destination object
Property value consecutive variations, but this property value can be made to occur the change of a determination, such as by speech control, one is stood
Cube makes it rotate up 1 degree.In actual mechanical process, because the presence that hand shakes error factors naturally causes individually
There is certain shake in the data of pen-based interaction channel reception, and individually speech control can not be realized to having during manipulation
Body step shows, and then is difficult to the manipulation effect for reaching that user wants.Therefore using Multichannel fusion algorithm 205, by pen type
Interaction is combined with interactive voice, and the continuous manipulation to destination object is realized using pen-based interaction, is realized using interactive voice to mesh
The accurate manipulation of object is marked, good mutual supplement with each other's advantages effect is formed, interactive efficiency is improved.
3rd, in the accurate control method of above-mentioned multichannel, the natural handoff algorithms as shown in Figure 3 30 of described multichannel, it has
Body step is：
(1) sampled point gathered in pen-based interaction passage is sequentially stored in the storage queue that length is N；
(2) this N number of groups of samples is gathered into two, positional information set A={ a0…ai…aN-1, attitude information set
B={ b0…bi…bN-1, wherein the sampled point that numbering is N-1 is the sampled point at nearest moment；
(3) point of each in location sets is calculated relative to a0Location variation △ D, and obtain maximum therein
△Dmax；Each attitude angle is calculated in attitude angle set relative to b0Attitudes vibration amount △ θ, and obtain maximum therein
Value △ θmax；
(4) judging distance knots modification △ DmaxWith distance threshold △ Dth, angulation change amount △ θmaxWith angle threshold △ θth's
Magnitude relationship, if △ DmaxWith △ θmaxRespective threshold value is respectively smaller than, then judges that user view, as interactive voice, is switched to naturally
Interactive voice passage simultaneously performs the operation corresponding to interactive voice to dummy object；Otherwise judge that the interaction of user is intended to pen type
Interaction, is switched to pen-based interaction passage and performs the operation corresponding to pen-based interaction to dummy object naturally；
In above-mentioned algorithm, the maximum △ D of location variationmaxThe 303 and maximum △ θ of attitudes vibration amountmax304
Computational methods it is as follows：
1) the ultimate range variable quantity △ D of the three-dimensional empty pen of book in regulation sampled point N are calculatedmax303, it is necessary to the ginseng used
Number has the initial coordinate (x of pen0,y0,z0), and other N-1 pen movement locus coordinate (xi,yi,zi), setpoint distance threshold value
△Dth, specific calculating process as shown in Figure 4 40, its step is as follows：
Calculate the relative changing value of X-axis | xi-x0|2[401], the relative changing value of Y-axis is calculated | yi-y0|2[402], Z is calculated
The relative changing value of axle | zi-z0|2[403]；Calculate i-th point of distance relative to the 0th point
[408]；Calculate △ DiMiddle maximum △ DmaxAnd with distance threshold △ DthContrasted, if more than △ Dth, then user view is recognized
Operate and input for pen type, otherwise carry out the calculating of attitudes vibration amount.
2) the maximum attitudes vibration amount △ θ of the three-dimensional empty pen of book in regulation sampled point N are calculatedmax, it is necessary to which the parameter used has
Initial attitude (the α of pen0,β0), and other N-1 posture (αi,βi), wherein α is the angle of pitch, and β is azimuth, set angle
Threshold value △ θth；Specific calculation procedure is as follows：
Calculate the relative changing value of the angle of pitch | αi-α0|2, the relative changing value of computer azimuth angle | βi-β0|2, calculate at i-th point
Attitudes vibration amount relative to the 0th pointCalculate △ θiMiddle maximum △ θmax304 and with
Angle threshold △ θthContrasted, if more than △ θth, then it is that pen type operates input to recognize user view, otherwise judges that user anticipates
Figure is phonetic entry.
The natural handoff algorithms of multichannel of the present invention are described in detail above by example, but the present invention
The form of implementing is not limited thereto.Those of ordinary skill in the art, can be in the essence without departing substantially from the method for the invention
Various apparent changes and modification are carried out to it in the case of god and principle.Protection scope of the present invention should be with claims
It is described to be defined.
Claims (5)
1. a kind of multi-channel adaptive operating method towards three-dimensional pen-based interaction platform, it is characterised in that comprise the following steps：
(1), user is integrated in the exchange channels input in pen when being interacted using pen-based interaction platform and dummy object
Data are sent to processing unit by unit with certain frequency collection style of brushwork input information and speech input information；
(2), by analyzing the spatial positional information (x, y, z) and spatial attitude information (α, β) of pen, Multichannel fusion is utilized
Algorithm realizes that user view is analyzed, and completes the natural switching of pen-based interaction passage and interactive voice passage；
(3), according to selected exchange channels, using corresponding channel operation algorithm, the operation to virtual target object is performed
Conversion.
2. a kind of multi-channel adaptive operating method towards three-dimensional pen-based interaction platform according to claim 1, it is special
Levy and be：Described pen-based interaction platform includes the interaction pen external member and electronic whiteboard or LCD screen of the empty pattern of three-dimensional book
Main frame external member.
3. a kind of multi-channel adaptive operating method towards three-dimensional pen-based interaction platform according to claim 1, it is special
Levy and be：Multichannel fusion algorithm in the step (2), comprises the following steps：
(1), the sampled point gathered in pen-based interaction passage is sequentially stored in the storage queue that length is N；
(2), this N number of groups of samples is gathered into two, positional information set A={ a0…ai…aN-1, attitude information set B=
{b0…bi…bN-1, wherein the sampled point that numbering is N-1 is the sampled point at nearest moment；
(3) point of each in location sets, is calculated relative to a0Variable quantity △ D, and obtain maximum △ D thereinmax；Meter
Each attitude angle is calculated in attitude angle set relative to b0Variable quantity △ θ, and obtain maximum △ θ thereinmax；
(4), judging distance knots modification △ DmaxWith distance threshold △ Dth, angulation change amount △ θmaxWith angle threshold △ θthSize
Relation, if △ DmaxWith △ θmaxRespective threshold value is respectively smaller than, then judges that user view, as interactive voice, is switched to voice naturally
Exchange channels simultaneously perform the operation corresponding to interactive voice to dummy object；Otherwise judge that the interaction of user is intended to pen type friendship
Mutually, pen-based interaction passage is switched to naturally and the operation corresponding to pen-based interaction is performed to dummy object.
4. a kind of multi-channel adaptive operating method towards three-dimensional pen-based interaction platform according to claim 3, it is special
Levy and be, in the Multichannel fusion algorithm in the step (2), the queue stores the position of pen in interaction respectively
And attitude information, wherein the computational methods apart from knots modification are：
<mrow>
<msub>
<mi>&Delta;D</mi>
<mi>i</mi>
</msub>
<mo>=</mo>
<msqrt>
<mrow>
<msup>
<mrow>
<mo>(</mo>
<msub>
<mi>x</mi>
<mi>i</mi>
</msub>
<mo>-</mo>
<msub>
<mi>x</mi>
<mn>0</mn>
</msub>
<mo>)</mo>
</mrow>
<mn>2</mn>
</msup>
<mo>+</mo>
<msup>
<mrow>
<mo>(</mo>
<msub>
<mi>y</mi>
<mi>i</mi>
</msub>
<mo>-</mo>
<msub>
<mi>y</mi>
<mn>0</mn>
</msub>
<mo>)</mo>
</mrow>
<mn>2</mn>
</msup>
<mo>+</mo>
<msup>
<mrow>
<mo>(</mo>
<msub>
<mi>z</mi>
<mi>i</mi>
</msub>
<mo>-</mo>
<msub>
<mi>z</mi>
<mn>0</mn>
</msub>
<mo>)</mo>
</mrow>
<mn>2</mn>
</msup>
</mrow>
</msqrt>
<mo>,</mo>
</mrow>
The computational methods of posture knots modification are：With interactive continuous progress, in queue
Data also constantly update, the state of user's pen in interaction can be thus detected in real time, so that it is determined that user
Interaction is intended to, and is switched to the corresponding operation of corresponding exchange channels execution.
5. a kind of multi-channel adaptive operating method towards three-dimensional pen-based interaction platform according to claim 4, it is special
Levy and be, position and the attitude information of pen, including coordinate data (x, y, z) and angle-data are obtained by pen-based input passage
(α, β), according to a series of variation tendency of the amount of state variation of current time and last moment sampled point either sampled points come
It is mapped to the control method to destination object；Speech data information is obtained by phonetic entry passage, speech recognition engine is utilized
To recognize described speech data information, and it is mapped to the control method to destination object.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710402142.4A CN107122109A (en) | 2017-05-31 | 2017-05-31 | A kind of multi-channel adaptive operating method towards three-dimensional pen-based interaction platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710402142.4A CN107122109A (en) | 2017-05-31 | 2017-05-31 | A kind of multi-channel adaptive operating method towards three-dimensional pen-based interaction platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107122109A true CN107122109A (en) | 2017-09-01 |
Family
ID=59729061
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710402142.4A Pending CN107122109A (en) | 2017-05-31 | 2017-05-31 | A kind of multi-channel adaptive operating method towards three-dimensional pen-based interaction platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107122109A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109782914A (en) * | 2019-01-13 | 2019-05-21 | 吉林大学 | The selection method of target in virtual three-dimensional scene based on pen device axial-rotation |
| CN111580686A (en) * | 2020-05-10 | 2020-08-25 | 吉林大学 | Three-dimensional stroke recognition method integrating ultrasonic positioning and inertial measurement unit |
| CN111857370A (en) * | 2020-07-27 | 2020-10-30 | 吉林大学 | Multichannel interactive equipment research and development platform |
| CN112328107A (en) * | 2021-01-04 | 2021-02-05 | 江西科骏实业有限公司 | Wireless transmission space positioning pen based on virtual coordinates |
| CN112711392A (en) * | 2020-12-15 | 2021-04-27 | 南京理工大学 | Confidence coefficient calculation method of multi-channel interactive system channel |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102339129A (en) * | 2011-09-19 | 2012-02-01 | 北京航空航天大学 | Multichannel human-computer interaction method based on voice and gestures |
| CN103701981A (en) * | 2012-09-27 | 2014-04-02 | 中兴通讯股份有限公司 | Method and device for implementing voice recognition function |
| CN104965592A (en) * | 2015-07-08 | 2015-10-07 | 苏州思必驰信息科技有限公司 | Voice and gesture recognition based multimodal non-touch human-machine interaction method and system |
| CN106157359A (en) * | 2015-04-23 | 2016-11-23 | 中国科学院宁波材料技术与工程研究所 | A kind of method for designing of virtual scene experiencing system |
| CN106598293A (en) * | 2016-12-14 | 2017-04-26 | 吉林大学 | Three-dimensional large-space multi-channel pen-based interaction system |
| CN106648152A (en) * | 2016-12-14 | 2017-05-10 | 吉林大学 | Rotary angle and distance-based three-dimensional pen interaction interface zooming method |
-
2017
- 2017-05-31 CN CN201710402142.4A patent/CN107122109A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102339129A (en) * | 2011-09-19 | 2012-02-01 | 北京航空航天大学 | Multichannel human-computer interaction method based on voice and gestures |
| CN103701981A (en) * | 2012-09-27 | 2014-04-02 | 中兴通讯股份有限公司 | Method and device for implementing voice recognition function |
| CN106157359A (en) * | 2015-04-23 | 2016-11-23 | 中国科学院宁波材料技术与工程研究所 | A kind of method for designing of virtual scene experiencing system |
| CN104965592A (en) * | 2015-07-08 | 2015-10-07 | 苏州思必驰信息科技有限公司 | Voice and gesture recognition based multimodal non-touch human-machine interaction method and system |
| CN106598293A (en) * | 2016-12-14 | 2017-04-26 | 吉林大学 | Three-dimensional large-space multi-channel pen-based interaction system |
| CN106648152A (en) * | 2016-12-14 | 2017-05-10 | 吉林大学 | Rotary angle and distance-based three-dimensional pen interaction interface zooming method |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109782914A (en) * | 2019-01-13 | 2019-05-21 | 吉林大学 | The selection method of target in virtual three-dimensional scene based on pen device axial-rotation |
| CN111580686A (en) * | 2020-05-10 | 2020-08-25 | 吉林大学 | Three-dimensional stroke recognition method integrating ultrasonic positioning and inertial measurement unit |
| CN111580686B (en) * | 2020-05-10 | 2021-07-20 | 吉林大学 | Three-dimensional stroke recognition method integrating ultrasonic positioning and inertial measurement unit |
| CN111857370A (en) * | 2020-07-27 | 2020-10-30 | 吉林大学 | Multichannel interactive equipment research and development platform |
| CN111857370B (en) * | 2020-07-27 | 2022-03-15 | 吉林大学 | Multichannel interactive equipment research and development platform |
| CN112711392A (en) * | 2020-12-15 | 2021-04-27 | 南京理工大学 | Confidence coefficient calculation method of multi-channel interactive system channel |
| CN112711392B (en) * | 2020-12-15 | 2022-09-27 | 南京理工大学 | Confidence coefficient calculation method for channels of multi-channel interactive system |
| CN112328107A (en) * | 2021-01-04 | 2021-02-05 | 江西科骏实业有限公司 | Wireless transmission space positioning pen based on virtual coordinates |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107122109A (en) | A kind of multi-channel adaptive operating method towards three-dimensional pen-based interaction platform | |
| Bowman et al. | An introduction to 3-D user interface design | |
| Kumar et al. | Hand data glove: a wearable real-time device for human-computer interaction | |
| Bruder et al. | Arch-explore: A natural user interface for immersive architectural walkthroughs | |
| TWI569176B (en) | Method and system for identifying handwriting track | |
| EP2795835B1 (en) | System with sensor fusion interface for multiple sensor input and method therefor | |
| CN102810008B (en) | A kind of air input, method and input collecting device in the air | |
| CN105359054B (en) | Equipment is positioned and is orientated in space | |
| CN104331154B (en) | Realize the man-machine interaction method and system of non-contact type mouse control | |
| CN106796789A (en) | Interacted with the speech that cooperates with of speech reference point | |
| US8963834B2 (en) | System and method for implementing 3-dimensional user interface | |
| CN105929940A (en) | Rapid three-dimensional dynamic gesture recognition method and system based on character value subdivision method | |
| CN107633551B (en) | The methods of exhibiting and device of a kind of dummy keyboard | |
| Smith et al. | Digital foam interaction techniques for 3D modeling | |
| CN113221726A (en) | Hand posture estimation method and system based on visual and inertial information fusion | |
| CN103049266A (en) | Mouse operation method of Delta 3D (Three-Dimensional) scene navigation | |
| Su et al. | Natural multimodal interaction in immersive flow visualization | |
| Prasad et al. | A wireless dynamic gesture user interface for HCI using hand data glove | |
| CN107957847A (en) | Touch track display method, device, equipment and storage medium | |
| Bai et al. | Asymmetric Bimanual Interaction for Mobile Virtual Reality. | |
| Sung et al. | Motion quaternion-based motion estimation method of MYO using K-means algorithm and Bayesian probability | |
| Ferscha et al. | Orientation sensing for gesture-based interaction with smart artifacts | |
| KR102322968B1 (en) | a short key instruction device using finger gestures and the short key instruction method using thereof | |
| Wu et al. | Hand motion-based remote control interface with vibrotactile feedback for home robots | |
| KR101835793B1 (en) | Auxiliary input device for map making |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170901 |
|
| WD01 | Invention patent application deemed withdrawn after publication |