CN110489026A - A kind of handheld input device and its blanking control method and device for indicating icon - Google Patents
A kind of handheld input device and its blanking control method and device for indicating icon Download PDFInfo
- Publication number
- CN110489026A CN110489026A CN201910603013.0A CN201910603013A CN110489026A CN 110489026 A CN110489026 A CN 110489026A CN 201910603013 A CN201910603013 A CN 201910603013A CN 110489026 A CN110489026 A CN 110489026A
- Authority
- CN
- China
- Prior art keywords
- input device
- handheld input
- screen
- image
- mapping
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04812—Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
A kind of blanking control method of the instruction icon of handheld input device includes: to establish mapping model, the mapping model is used to for the direction of the handheld input device being mapped as the display position of the instruction icon, in the mapping model, the range of the direction of handheld input device includes the first direction range, when the direction of the handheld input device is changed in the first direction range with arbitrary trajectory, the display position of the instruction icon is all within the scope of preset screen edge;The display position of the instruction icon is determined according to the mapping model;When the instruction icon moves within the scope of the screen edge, the display position for detecting the instruction icon is in the duration within the scope of the screen edge greater than preset first threshold, then indicates icon described in blanking.
Description
Technical field
The application belongs to handheld input device field more particularly to a kind of handheld input device and its indicates the blanking of icon
Control method and device.
Background technique
Handheld input device, can be by operator's hand-held, and passes through and control its direction on three-dimensional space, makes one
A instruction icon moves on the graphic user interface (GUI) of display screen.
A kind of specific product of handheld input device is air mouse.For air mouse, above-mentioned instruction icon is mouse
Mark cursor.Different from desktop mouse, air mouse does not need supporting plane, and operator can hold air mouse control cursor and exist
It is moved on graphic user interface.Another application of handheld input device is digital radio demonstration device.Wireless demo device is meeting
An important equipment in room gives top priority to what is the most important content for speaker when explaining the data such as PPT.The master of wireless demo device at present
Wanting category is laser demonstration device, also referred to as laser pen, and speaker presses activation key triggering laser, utilizes laser facula screen illuminating
Upper key content, achievees the purpose that the content that gives top priority to what is the most important.The price of LCD/LED large-size screen monitors is lower and lower in recent years, relative to projection
Machine, brightness is high, contrast is big, color rendition degree is more preferable, and therefore, more and more meeting rooms and Classroom start using LCD/
LED large-size screen monitors.Since the surface of LCD/LED large-size screen monitors is mirror-reflection to laser, cause incident direction hot spot very dark, and exit direction
Hot spot it is excessively bright, therefore laser demonstration device is not suitable for LCD/LED large-size screen monitors.Digital radio demonstration device can solve the above problem,
The cursor of mouse that the ratio of the instruction icon design controlled is traditional is more eye-catching, is such as designed as highlighted red round spot, i.e.,
It can reach the effect similar to laser facula, prominent mark carried out to the key content of speech.
For desktop mouse, there is a supporting plane, when stop operation need to only loose one's grip, and instruction icon can be fixed on screen
A position on.And handheld input device is by operator's hand-held, indicating can be always with operator after icon activation
Activity and move, therefore, handheld input device need it is a kind of indicate icon blanking control method.
It is existing instruction icon blanking method it is usual are as follows: 1, when instruction icon less than one threshold speed of movement speed hold
Blanking when continuous a period of time, due to being also required to refer to when handheld input device does certain operations (as indicated explanation against key content)
Diagram mark is substantially at stationary state, it is therefore desirable to the time threshold of triggering blanking is arranged it is very long, such as 5 seconds.It is this
Blanking method is not suitable for needing the application scenarios of quickly-blanking instruction icon, for example, when being given a lecture with digital radio demonstration device,
It needs that instruction icon is quickly activated to indicate key content, generally requires rapidly blanking after having explained one section of key content
Indicate icon;2, a key is set on handheld input device, according to just activation indicates icon when the key, unclamps the key and disappears
Hidden instruction icon.The problem of this blanking method is that operator needs to be easy to cause finger fatigue, separately according to key for a long time
Outside, other keypress functions cannot be triggered during control instructions icon is mobile according to activation key due to finger again;3, hand
One key of setting on input equipment is held, push button exciting instruction icon is clicked, again taps on blanking instruction icon.This mode
The problem of be operator need active click keys go blanking indicate icon, it is cumbersome, especially when handheld input device is used as
When digital radio demonstration device, speaker may forget that blanking instruction icon is turned round and explain back to screen, can lead at this time
Instruction icon is caused as the gesture of speaker is shaken, to influence effect of giving a lecture on the screen.
Summary of the invention
In view of this, the embodiment of the present application provides a kind of handheld input device and its indicates the blanking control method of icon
And device, with solve the prior art instruction icon blanking control method in, need for a long time according to key control instructions figure
Finger fatigue problem caused by mark display, or need caused by active click keys control icon blanking it is cumbersome,
Indicate the problem of icon shakes.
The first aspect of the embodiment of the present application provides a kind of blanking control method of the instruction icon of handheld input device,
The blanking control method of the instruction icon of the handheld input device includes:
Mapping model is established, the mapping model is used to the direction of the handheld input device being mapped as the instruction figure
Target display position, wherein in the mapping model, the range of the direction of the handheld input device includes the first direction model
It encloses, when the direction of the handheld input device is changed in the first direction range with arbitrary trajectory, the instruction icon
Display position all within the scope of preset screen edge;
The display position of the instruction icon is determined according to the mapping model;
When the instruction icon moves within the scope of the screen edge, the display position for detecting the instruction icon is in
Whether the duration within the scope of the screen edge is greater than preset first threshold, if the duration is greater than described the
One threshold value then indicates icon described in blanking.
With reference to first aspect, in the first possible implementation of first aspect, the parameter of the mapping model includes
First is directed toward, maps origin and mapping coefficient.
The possible implementation of with reference to first aspect the first, in second of possible implementation of first aspect, institute
State the first direction for being oriented to handheld input device when establishing the mapping model, the direction packet of the handheld input device
Include the yaw angle and pitch angle of the handheld input device;
The mapping origin is preset screen position;
The mapping coefficient determines at a distance from screen by preset value or according to the handheld input device.
The possible implementation of with reference to first aspect the first, in the third possible implementation of first aspect, institute
Stating the step of establishing the mapping model includes:
The first image that the handheld input device is directed toward is acquired, the characteristics of image of the first image is extracted, it will be described
The characteristics of image of first image is matched with the screen characteristics prefetched, identifies the screen imaging area in the first image
Domain.
The parameter of the mapping model is determined according to the screen imaging region, wherein described first is oriented to acquisition institute
The direction of handheld input device when the first image is stated, the direction of the handheld input device includes the handheld input device
Yaw angle and pitch angle, it is described mapping origin according to the screen imaging region in the first image position institute really
Fixed, the mapping coefficient is true according to the field angle institute of the screen imaging region and the photographing module of acquisition the first image
It is fixed.
The third possible implementation with reference to first aspect, in the 4th kind of possible implementation of first aspect, institute
State the step of establishing mapping model further include:
The second image of acquisition display on the screen;
Extract the characteristics of image of second image, wherein the characteristics of image of second image is the screen prefetched
Curtain feature.
The possible implementation of with reference to first aspect the first, in the 5th kind of possible implementation of first aspect, institute
Stating the step of determining the display position of the instruction icon according to the mapping model includes:
Determine currently pointing to for the handheld input device;
Work as according to the angle offset for currently pointing to be directed toward relative to described first and mapping coefficient determination
It is preceding to be directed toward the corresponding positional shift be directed toward position and be directed toward corresponding direction position relative to described first;
Corresponding finger is currently pointed to according to what the positional shift and the mapping origin determined the handheld input device
To position;
According to the display position for currently pointing to corresponding direction position and determining the instruction icon, wherein if institute
Currently pointing in the first direction range for handheld input device is stated, then the display position is in screen edge model
In enclosing.
The second aspect of the embodiment of the present application provides a kind of blanking control device of the instruction icon of handheld input device,
The blanking control device of the instruction icon of the handheld input device includes:
Mapping model establishes unit, and for establishing mapping model, the mapping model is used for the handheld input device
Direction be mapped as it is described instruction icon display position, wherein in the mapping model, the direction of the handheld input device
Range include first be directed toward range, when the handheld input device direction it is described first be directed toward range in arbitrary trajectory
When change, the display position of the instruction icon is all within the scope of preset screen edge;
Display position determination unit, for determining the display position of the instruction icon according to the mapping model;
Blanking control unit, for detecting the instruction when the instruction icon moves within the scope of the screen edge
Whether the duration that the display position of icon is within the scope of the screen edge is greater than preset first threshold, if described
Duration is greater than the first threshold, then indicates icon described in blanking.
In conjunction with second aspect, in the first possible implementation of second aspect, the parameter of the mapping model includes
First is directed toward, maps origin and mapping coefficient.
In conjunction with the first possible implementation of second aspect, in second of possible implementation of second aspect, institute
It states mapping model and establishes unit and include:
First is directed toward setting subelement, described hand-held when being arranged to set up the mapping model for being directed toward described first
The direction of input equipment, the direction of the handheld input device include the yaw angle and pitch angle of the handheld input device;
It maps origin and subelement is set, for setting preset screen position for the mapping origin;
Subelement is arranged in mapping coefficient, for setting preset value for the mapping coefficient, or according to it is described hold it is defeated
Enter equipment and determines the mapping coefficient at a distance from screen.
In conjunction with the first possible implementation of second aspect, in the third possible implementation of second aspect, institute
It states mapping model and establishes unit and include:
Screen imaging region recognition subelement, the first image being directed toward for acquiring the handheld input device, extracts institute
The characteristics of image for stating the first image matches the characteristics of image of the first image with the screen characteristics prefetched, and identification exists
Screen imaging region in the first image.
Parameter determines subelement, for determining the parameter of the mapping model according to the screen imaging region, wherein institute
State the first direction for being oriented to handheld input device when acquisition the first image, the direction packet of the handheld input device
The yaw angle and pitch angle of the handheld input device are included, the mapping origin is according to the screen imaging region described first
Position in image is determined that the mapping coefficient is according to the screen imaging region and the camera shooting mould for acquiring the first image
The field angle of block is determined.
In conjunction with the third possible implementation of second aspect, in the 4th kind of possible implementation of second aspect, institute
It states mapping model and establishes unit further include:
Second Image Acquisition subelement, for acquiring the second image of display on the screen;
Screen characteristics extract subelement, for extracting the characteristics of image of second image, wherein second image
Characteristics of image is the screen characteristics prefetched.
In conjunction with the first possible implementation of second aspect, in the 5th kind of possible implementation of second aspect, institute
Stating display position determination unit includes:
It currently points to determine subelement, for determining currently pointing to for the handheld input device;
Positional shift determines subelement, for currently pointed to according to relative to it is described first be directed toward angle offset and
The mapping coefficient currently points to corresponding direction position relative to the corresponding direction position of first direction described in determining
Positional shift;
It is directed toward position and determines subelement, for determining the hand-held input according to the positional shift and the mapping origin
Equipment currently points to corresponding direction position;
Display position determines subelement, determines the instruction icon for currently pointing to corresponding direction position according to
Display position, wherein if the handheld input device currently point to it is described first be directed toward range in, the display
Position is within the scope of the screen edge.
The third aspect of the embodiment of the present application provides a kind of handheld input device, including memory, processor and deposits
The computer program that can be run in the memory and on the processor is stored up, the processor executes the computer journey
The step of blanking control method of instruction icon of the handheld input device as described in any one of first aspect is realized when sequence.
The fourth aspect of the embodiment of the present application provides a kind of computer readable storage medium, the computer-readable storage
Media storage has computer program, which is characterized in that realizes that first aspect such as is appointed when the computer program is executed by processor
The step of blanking control method of the instruction icon of one handheld input device.
Existing beneficial effect is the embodiment of the present application compared with prior art:
The mapping model that the direction of handheld input device is mapped as to the display position of instruction icon is established, in the mapping mould
In type, the range of the direction of handheld input device includes the first direction range, when the direction of handheld input device is directed toward first
It when changing in range with arbitrary trajectory, indicates that the display position of icon is within the scope of screen edge, passes through detection instruction figure
When the duration being marked within the scope of screen edge is greater than preset first threshold, the instruction icon blanking is controlled.Described
One direction range generally include speaker's hand it is sagging when or handheld input device when turning round back to screen direction.Cause
This, the blanking control method of the instruction icon based on the application, speaker does not need for a long time according to key control instructions icon
Display need to only click activation key triggering display instruction icon, when no longer needing to show instruction icon, it is only necessary to which subordinate hangs down
Can blanking indicate icon, or turn round towards spectators can blanking instruction icon, blanking control it is unsophisticated, will not because accidentally grasp
Work causes to indicate that icon arbitrarily shakes, and does not also need long-time key, meets the operating habit of handheld input device, is conducive to mention
High user experience.
Detailed description of the invention
It in order to more clearly explain the technical solutions in the embodiments of the present application, below will be to embodiment or description of the prior art
Needed in attached drawing be briefly described, it should be apparent that, the accompanying drawings in the following description is only some of the application
Embodiment for those of ordinary skill in the art without any creative labor, can also be according to these
Attached drawing obtains other attached drawings.
Fig. 1 is a kind of realization of the blanking control method of the instruction icon of handheld input device provided by the embodiments of the present application
Flow diagram;
Fig. 2 is the schematic diagram of the direction control instructions icon provided by the embodiments of the present application by handheld input device;
Fig. 3 is a kind of implementation process schematic diagram of mapping model method for building up provided by the embodiments of the present application;
Fig. 4 is a kind of schematic diagram of the first image of handheld input device acquisition provided by the embodiments of the present application;
Fig. 5 is the implementation process schematic diagram of the display position of determining instruction icon provided by the embodiments of the present application;
Fig. 6 is a kind of structure of the blanking control device of the instruction icon of handheld input device provided by the embodiments of the present application
Schematic diagram;
Fig. 7 is the schematic diagram of handheld input device provided by the embodiments of the present application.
Specific embodiment
In being described below, for illustration and not for limitation, the tool of such as particular system structure, technology etc is proposed
Body details, so as to provide a thorough understanding of the present application embodiment.However, it will be clear to one skilled in the art that there is no these specific
The application also may be implemented in the other embodiments of details.In other situations, it omits to well-known system, device, electricity
The detailed description of road and method, so as not to obscure the description of the present application with unnecessary details.
In order to illustrate technical solution described herein, the following is a description of specific embodiments.
Fig. 1 is a kind of realization of the blanking control method of the instruction icon of handheld input device provided by the embodiments of the present application
Flow diagram, details are as follows:
In step s101, mapping model is established, the mapping model is for reflecting the direction of the handheld input device
It penetrates as the display position of the instruction icon.
Handheld input device in the application can be air mouse, digital radio demonstration device or other types of defeated
Enter equipment, usual handheld input device is equipped with key, and operator can activate instruction icon or triggering by key command
Other operations.
By operator's hand-held, operator passes through the hand-held input of control in use and sets the handheld input device
Standby one instruction icon of motion control in three dimensions moves on the screen of a display device, wherein the instruction icon
It is a Drawing Object on computer graphic user interface, can is the icon of a pointer shape, such as cursor of mouse.Work as behaviour
After author's control Drawing Object moves to target position, it can be triggered by the function button on handheld input device corresponding
Operation.The display equipment can be any display equipment such as projector, LCD/LED display.
Blanking control method described herein can be run in triggering when operator activates the instruction icon, can also be with
Operation is just triggered when the instruction icon is in hidden state, for example, can trigger at once after handheld input device power-up
Operation, or the triggering operation when the pitch angle of handheld input device is greater than preset angle.
Fig. 2 show an application scenarios of handheld input device, and handheld input device is held by operator, the ash in figure
Color region is screen 201, and the screen 201 includes but is not limited to electronic wall screen, indicator screen or projection screen etc..Hand
Input equipment direction screen 201 is held to be operated.As shown in Fig. 2, the movement of handheld input device in three dimensions can be used
The variation of the direction D of handheld input device indicates.
A mapping model is established, the mapping model is used to the direction of handheld input device being mapped as the instruction figure
Target display position.By the mapping model, the direction D of handheld input device is mapped as the one of screen reference plane 202 first
A direction position, and the display position for indicating icon is determined according to the direction position, operator, which can pass through, manipulates hand-held input
The direction D control instructions icon of equipment moves on screen 201.
The screen reference plane 202 can be determined according to the surface of screen.If showing that the screen surface of equipment is flat
Face, it is preferred that as shown in Fig. 2, the screen reference plane 202 is set as plane where screen, wherein dark gray areas is screen
201.If screen surface is curved surface, screen projection surface approximate representation screen 201 can be used, and screen reference plane 202 is screen
Plane or screen reference plane 202 where projection surface are also possible to curved surface.It is noted that screen 201 shown in Fig. 2 is
Rectangle, actually screen 201 can be other arbitrary shapes, can also be made of several isolated sub-screens, and abnormity is shielded
Curtain with rectangular screen is identical in principle when establishing mapping model.Without loss of generality, the application is by taking rectangular screen as an example
Discuss the establishment process of mapping model.
It is noted that the direction position of the direction D mapped screen reference plane of the handheld input device and holds
The position that input equipment is actually pointed to is different concept, the position being directed toward position and may being actually pointed to handheld input device
It sets and is consistent, it is also possible to and there is deviation in the position that handheld input device is actually pointed to.For example, as shown in Fig. 2, if hand-held input is set
The standby intersection point P for being directed toward D mapped and being directed toward direction line 204 and screen reference plane 202 that position is handheld input device, then refer to
Position is directed toward to D mapped to be consistent with the position that handheld input device is actually pointed to;If the direction D institute of handheld input device
The direction position of mapping is P1, then being directed toward D mapped and being directed toward the position that position and handheld input device are actually pointed to has deviation.
The direction of the handheld input device is mapped as screen reference first by the mapping model established according to the application
Then the direction position in face 202 determines the display position of instruction icon according to the direction position.In the mapping model, institute
The range for stating the direction of handheld input device includes the first direction range, when the direction of the handheld input device is described first
When being changed in direction range with arbitrary trajectory, the display position of the instruction icon is all within the scope of preset screen edge.
There are many embodiments for the mapping model.
Mapping model embodiment one:
The parameter of the present embodiment mapping model includes the first direction, mapping origin and mapping coefficient.
There are many methods of determination for the parameter of mapping model embodiment one.In one embodiment, the mapping model
Determination method for parameter includes:
Step S1: described first is oriented to the direction of handheld input device when establishing the mapping model, the hand
The direction for holding input equipment includes the yaw angle and pitch angle of the handheld input device;
In the mapping model of the present embodiment, the hand-held input is set with the yaw angle and pitch angle of handheld input device
Standby direction is modeled.As shown in Fig. 2, being accustomed to according to the description of attitude of flight vehicle, if the direction D of handheld input device is machine
Head direction, then RY axis is pitch axis, RZ axis is yaw axis, when handheld input device is rotated around pitch axis RY, is directed toward
Position P is moved up and down on the screen, and when handheld input device is rotated around yaw axis RZ, the position P being directed toward is on the screen
It moves left and right.As it can be seen that the yaw angle and pitch angle of handheld input device can be natural and effectively to the fingers of handheld input device
To being modeled.
Inertia motion sensor, including accelerometer and gyroscope are set in handheld input device, and the inertia motion passes
The acceleration information and gyro data of sensor acquisition handheld input device.It can according to the acceleration information and gyro data
To calculate the pitch angle and yaw angle of handheld input device, the i.e. finger of handheld input device in the present embodiment mapping model
To.Calculating the attitude angle of handheld input device according to acceleration information and gyro data is a kind of known method, such as expansion card
Kalman Filtering algorithm, the application repeat no more.
Determine that hand-held input is set when establishing mapping model according to the acceleration information of handheld input device and gyro data
Standby pitch angle and yaw angle obtains described first and is directed toward.
Step S2: the mapping origin is set as preset screen position.
The physical significance of the mapping origin is the described first direction position for being directed toward the reference plane of mapped screen.At this
In the mapping model of embodiment, as shown in Fig. 2, screen reference plane 202 is a plane, it is arranged one for screen reference plane 202
Cartesian coordinate system, without loss of generality, the coordinate system is using the top left corner apex O of screen 201 as origin, with screen X-axis for its X
Axis, with screen Y-axis for its Y-axis.Any point of screen reference plane 202 can be set as mapping origin, it is preferred that mapping is former
Point is set as a preset screen position, such as the center of screen 201 or the position of instruction icon last time blanking.
Step S3: the mapping coefficient is set as preset value, or according to the handheld input device at a distance from screen
It determines.
The physical meaning of the mapping coefficient is the corresponding screen reference plane in every degree angle of the yaw angle of handheld input device
X-axis picture point number and handheld input device pitch angle the corresponding screen reference plane in every degree angle Y-axis picture point number.It can be with
A preset constant is set by mapping coefficient S, alternatively, a range sensor is arranged on handheld input device, is such as swashed
To perceive handheld input device at a distance from screen mapping coefficient S is arranged, for example, distance in ligh-ranging sensor according to this distance
Remoter set S value is bigger.
It is noted that the mapping origin is preset screen in the mapping model parameter that above-mentioned steps S1-S3 is determined
Position is usually not arranged on the direction line 204 of handheld input device and the intersection point P of screen reference plane 202, i.e., described first
It is directed toward the position that mapped direction position is actually pointed to handheld input device not being inconsistent, therefore subsequent handheld input device
Direction mapped to be directed toward the position that position and handheld input device are actually pointed to be generally also not to be inconsistent, it means that according to
The position that the display position for being directed toward the instruction icon that position determines and handheld input device are actually pointed to is inconsistent.
In another embodiment, the parameter of the mapping model is determined based on image analysis technology, can make to indicate icon
Display position and the position consistency that is actually pointed to of handheld input device, step it is as shown in Figure 3, comprising:
In step S301, the first image that the handheld input device is directed toward is acquired, the figure of the first image is extracted
As feature, the characteristics of image of the first image is matched with the screen characteristics prefetched, is identified in the first image
Screen imaging region;
As shown in Fig. 2, being equipped with photographing module 203 in the handheld input device, the shooting of photographing module 203 holds defeated
Enter the image of equipment direction, which is the first image 401 as shown in Figure 4.Preferably, the installation side of photographing module 203
Formula can be with are as follows: handheld input device is directed toward line 204 perpendicular to the photosensitive sensor array plane of photographing module 203 and crosses wherein
Heart point.Using this preferred embodiment, the intersection point P for being directed toward line 204 and screen reference plane 202 of handheld input device is in the first image
Imaging point in 401 is the central point IP of the first image 401, conducive to the calculating of the parameter of mapping model.
After obtaining the first image 401, the first image 401 is analyzed, the figure of the first image is extracted
As feature, the characteristics of image of the first image is matched with the screen characteristics prefetched, is identified in the first image 401
In screen imaging region 402.The screen characteristics prefetched are the characteristics of image of screen 201 for identification.Characteristics of image
Analysis and matching algorithm are known technologies, are repeated no more.It is noted that actual imaging area of the screen 201 in the first image
Domain is usually to have deformation, can be corrected to it according to the image-forming principle of video camera, obtain the screen of rule as shown in Figure 4 at
As region 402.
Prefetching the screen characteristics, there are many embodiments, comprising:
Mode one: hardware identification device being arranged on the display device, such as multiple infrared LEDs are arranged in 201 surrounding of screen,
Prefetch LED quantity and LED spacing and be used as screen characteristics, extract highlighted luminous point in the first image 401, by the luminous point according to
LED quantative attribute and LED pitch characteristics are matched, it may be determined that the screen imaging region 402.
Mode two: when the first image 401 of acquisition, one is shown on the specific position (such as screen center) of screen 201
Or multiple special Drawing Objects, the characteristics of image for extracting these Drawing Objects in advance are used as screen characteristics.
Mode three: while acquiring the first image or before, acquire the second image for being shown on screen 201, extract
The characteristics of image of second image is used as screen characteristics.A kind of implementation for acquiring the second image can be independent hard using one
Part device, the device are connected to smart machine and show in the image data transmission channel between equipment, should such as HDMI wire road
Device intercepts and captures the second image of smart machine output.Another implementation for acquiring the second image is software screen mode, In
One software of installation on the smart machine of the second image is exported, which exports to the second figure of display equipment
Picture.Employing mode three does not need that special hardware device is arranged, applicability is good relative to aforesaid way one;Relative to above-mentioned side
Formula two will not often show Drawing Object for identification on screen, influence user's perception.
Handheld input device reality may be implemented in the parameter that the present embodiment mapping model is determined according to screen imaging region 402
The consistency of the display position of position and instruction icon that border is directed toward.
In step s 302, determine the first direction, described first when being oriented to acquisition the first image it is described hold it is defeated
Enter the direction of equipment, wherein the direction of the handheld input device includes the yaw angle and pitch angle of the handheld input device;
The direction of the handheld input device is identical with the direction of handheld input device described in above-mentioned steps S1, root
The direction of handheld input device when acquiring the first image is determined according to the acceleration information and gyro data of handheld input device,
Described first is obtained to be directed toward.
In step S303, mapping origin is determined according to position of the screen imaging region in the first image.
As shown in Figure 2 and Figure 4, in the first image 401, the top left corner apex IO in screen imaging region 402 is screen 201
The imaging point of top left corner apex O, point IP are the imaging point for the position P that handheld input device is directed toward, and point IP is located at the first image 401
Central point.
In the mapping model of the present embodiment, screen reference plane 202 is a plane, is arranged one for screen reference plane 202
Cartesian coordinate system, without loss of generality, the coordinate system is using the top left corner apex O of screen 201 as origin, with screen X-axis for its X
Axis, with screen Y-axis for its Y-axis.
Position according to the central point IP of the first image 401 relative to point IO can calculate handheld input device reality
Coordinate shift of the position P of direction relative to the top left corner apex O of screen 201, to obtain position P in screen reference plane 202
In coordinate, which is the mapping origin (VX0,VY0).Calculation formula is as follows:
VX0=(CX/SW) * MaxX, VY0=(CY/SH) * MaxY (1)
Wherein, CX and CY is respectively the horizontal picture point number and vertical picture point number of point IP corresponding point IO;SW and SH is respectively to shield
The horizontal picture point number and vertical picture point number in screen imaging region 402;MaxX and MaxY is the horizontal picture point number of screen 201 respectively and hangs down
Straight picture point number, for example, setting the screen resolution of screen 201 as 1920x1080, then MaxX is 1920, MaxY 1080.
It is worth noting that the mapping origin is the described first direction position for being directed toward corresponding screen reference plane 202,
If handheld input device is directed toward the position in screen when shooting the first image 401, maps origin and be located in screen 201, it is no
Then, mapping origin is located at outside screen 201.
In step s 304, according to the field angle in the screen imaging region and the photographing module of acquisition the first image
Determine mapping coefficient.
The physical meaning of the mapping coefficient is the corresponding screen reference plane in every degree angle of the yaw angle of handheld input device
X-axis picture point number and handheld input device pitch angle the corresponding screen reference plane in every degree angle Y-axis picture point number.
There are many embodiments for the determination of the mapping coefficient, in one embodiment, the calculation formula of mapping coefficient S
Are as follows:
S=MaxX/ (Φ * SW/PicX) (2)
Wherein, as shown in Figure 2 and Figure 4, Φ is the horizontal field of view angle of photographing module, and MaxX is the horizontal picture point of screen 201
Number, SW are the horizontal picture point number in screen imaging region 402, and PicX is the horizontal picture point number of the first image 401.
It is noted that the mapping coefficient that formula (2) determine is simplified, can make to calculate simpler.In fact, working as
When handheld input device is directed toward different location, the yaw angle or the corresponding screen of the identical angle of pitching angular variation of handheld input device
The offset of the picture point number of curtain reference plane is different.It in another embodiment, is hand according to the image-forming principle of known video camera
It holds being differently directed for input equipment and determines corresponding mapping coefficient.In this embodiment, determining mapping coefficient can be one
The function for inputting the direction that parameter is handheld input device, is also possible to a discrete sheet, and each single item in table is a section
Handheld input device direction corresponding to mapping coefficient.
It is noted that the precision of consumer level inertia motion sensor is lower, accumulated error can be generated, is periodically required to adopt
Collection the first image and the parameter for updating mapping model.
According to mapping model described in mapping model embodiment one, the handheld input device is currently pointed to be mapped as
The step of indicating the display position of icon is as shown in Figure 5, comprising:
In step S501, currently pointing to for the handheld input device is determined according to the mapping model.
Working as the handheld input device can be determined according to the acceleration information of handheld input device and gyro data
Preceding direction, it is described currently point to include handheld input device current pitch angle PAnWith current yaw angle YAn.Its calculation method with
It is identical to calculate the method that described first is directed toward.
In step S502, it is according to the angle offset for currently pointing to be directed toward relative to described first and the mapping
Number currently points to the positional shift that corresponding direction position is directed toward relative to described first in corresponding direction position described in determining.
The calculation formula of the positional shift is as follows:
d_VXn=(YAn-YA0) * S, d_VYn=(PAn-PA0)*S
Wherein, (d_VXn,d_VYn) it is the positional shift, PAnAnd YAnThe respectively described pitch angle currently pointed to and
Yaw angle, PA0And YA0Respectively described first pitch angle being directed toward and yaw angle, S are mapping coefficient.
It is noted that mapping coefficient S is the constant that formula (2) obtain in above-mentioned formula, if handheld input device
It is differently directed different mapping coefficients, then above-mentioned formula is an integral formula or cumulative formula.
In step S503, the current of the handheld input device is determined according to the positional shift and the mapping origin
It is directed toward corresponding direction position;
The calculation formula for currently pointing to corresponding direction position is as follows:
VXn=VX0+d_VXn, VYn=VY0+d_VYn
Wherein, (VXn,VYn) it is the direction position, (VX0,VY0) it is the mapping origin, (d_VXn,d_VYn) for institute
State positional shift.
In step S504, the display position of the instruction icon is determined according to the direction position, wherein if described
Handheld input device currently points to be directed toward in range described first, then the display position is in screen edge range
It is interior.
The display position of display icon is determined according to the region where being directed toward position.If the direction position is located at screen
In 201, the position in corresponding screen is arranged in the display position of the instruction icon;Otherwise, by the instruction icon
Display position is arranged within the scope of preset screen edge.
Since instruction icon has a certain size, if the display position of 32x32 picture point, the instruction icon is instruction
The position of the reference point of icon, the geometric center point that usually can choose instruction icon is reference point.If being directed toward position (VXn,
VYn) meet condition: 0≤VXn< MaxX and 0≤VYn< MaxY, then the direction position is located in screen 201, according to the direction position
There are many embodiments for the display position of determining instruction icon.A kind of embodiment is that will indicate the display position setting of icon
For the direction position, i.e., instruction icon is directly shown on being directed toward position.Another embodiment is that corresponding stabilization is arranged
Rule, anti-misoperation rule and error range restrictive rule etc. are directed toward position and before one in conjunction with current time
Or multiple display positions be directed toward position and determine instruction icon, realize stabilization, anti-misoperation etc..
If the direction position (VXn,VYn) meet condition:: VXn< 0 or VXn>=MaxX or VYn< 0 or VYn>=MaxY,
Then the direction position is located at outside screen 201, and the display position of the instruction icon is arranged within the scope of preset screen edge.
By the display position setting of the instruction icon, there are many embodiments within the scope of preset screen edge:
In a kind of embodiment, preset screen edge range is screen edge, wherein the coordinate (X, Y) at screen edge
Meet condition: X=0 or X=MaxX-1 or Y=0 or Y=MaxY-1.Control instructions icon it is stationary on screen edge or
As the direction of handheld input device is slided on screen edge.
In another embodiment, the screen area of several picture points of pre-determined distance screen edge is screen edge range,
For example, screen area of the setting one apart from 10 picture points in screen edge is screen edge range, i.e., coordinate range is X ∈
The screen area of [0,9] or X ∈ [MaxX -10, MaxX-1] or Y ∈ [0,9] or Y ∈ [MaxY -10, MaxY-1].When direction position
When setting remoter apart from screen 201, the display position of set instruction icon is closer to screen edge.Under this embodiment,
When the direction of handheld input device is far from or close to screen, instruction icon moves within the scope of the screen edge, reminds operation
The direction of person's handheld input device is far from being also proximate to screen.
Behind the display position that instruction icon has been determined according to above-mentioned steps, which can send smart machine to
Operating system, shown on the display position by operating system instruction icon, can also send on smart machine using soft
Part is shown instruction icon on the display position by the application software, or can also use other way, and the application does not limit
It is fixed.
The yaw angle of handheld input device and the range of pitch angle are 0-360 degree, by step S501-step S503 in Fig. 5
Shown in screen reference plane direction position calculating step it is found that if the direction of two moment handheld input devices is identical,
So, direction position corresponding to the direction of the two moment handheld input devices is identical, and holding between the two moment is defeated
The motion track for entering equipment is unrelated.According to this characteristic range can be divided for the direction of handheld input device.It is described hold it is defeated
The range for entering the direction of equipment includes the first direction range, when the direction of the handheld input device is directed toward range described first
Interior when being changed with arbitrary trajectory, the display position of the instruction icon is all within the scope of preset screen edge.
Without loss of generality, if mapping coefficient S is formula (2) resulting constant, then meet the hand-held input of following condition
The direction of equipment belongs to described first and is directed toward range:
PA<PA0-VY0/ S or PA >=PA0+(MaxY-VY0)/S, alternatively,
YA<YA0-VX0/ S or YA >=YA0+(MaxX-VX0)/S(3)
It is noted that the range of the yaw angle PA and pitch angle YA of handheld input device are 0-360 degree, in order to make to express
Formula is concise, does not handle the boundary condition for 0 ° and 360 ° in above-mentioned expression formula.
Step S501-step S503 according to Fig.5, the direction in the first direction range shown in formula (3) are reflected
The range for the direction position penetrated are as follows: VX<0 or VX>=MaxX or VY<0 or VY>=MaxY, it is seen that be entirely located in outside screen, according to step
The display position of rapid S504, the first corresponding instruction icon of direction being directed toward in range are all disposed within preset screen edge range
It is interior.Therefore, when the direction of the handheld input device is changed in the first direction range with arbitrary trajectory, the instruction
The display position of icon will not remove preset screen edge range.
It is worth noting that the first direction range generally comprises the direction of most of handheld input device, wherein packet
Include direction when direction and operator when handheld input device is directed toward ground are turned round back to screen.
Mapping model embodiment two:
The mapping model of the present embodiment is a threedimensional model.The position of screen in three dimensions and hand-held input are set
Standby direction in three dimensions carries out three-dimensional modeling, which is the mapping model of the present embodiment.For establishing three
The data of dimension module can be the first image of the direction of the handheld input device as captured by the photographing module of handheld input device;
Photographic device can also be set in the external environment of handheld input device, shoot the direction of handheld input device for establishing three
Dimension module.There are many known three-dimensional modeling methods, such as monocular vision three-dimensional modeling, binocular vision 3 D modeling or depth to take the photograph
As head three-dimensional modeling etc., repeat no more.
In the three-dimensional model, curved surface can be modeled, therefore screen reference plane 202 can be plane, be also possible to
Curved surface, can get the intersection point of the direction line 204 and screen reference plane 202 of handheld input device according to threedimensional model, which is
For the direction position of screen reference plane corresponding to the direction, the intersection point for being directed toward line 204 and screen reference plane is located at outside screen 201
Direction belong to the first direction range.
The mapping model of the present embodiment can model curve screens, but more demanding to the calculated performance of system, fit
For the handheld input device that computing capability is strong and battery capacity is big.
In step s 102, the display position of instruction icon is determined according to the mapping model.
According to mapping model disclosed in the present application, step, handheld input device can be currently pointed to according to Fig.5,
It is mapped as the display position of instruction icon.In the mapping model, the range of the direction of handheld input device includes the first finger
To range.If handheld input device currently points to belong to the first direction range, corresponding instruction figure is currently pointed to
Target display position is located within the scope of preset screen edge.
In step s 103, when the instruction icon moves within the scope of the screen edge, the instruction icon is detected
Duration for being within the scope of the screen edge of display position whether be greater than preset first threshold, if described lasting
Time is greater than the first threshold, then indicates icon described in blanking.
According to the mapping model, if the direction of handheld input device moves into described first outside the first direction range
It is directed toward in range, then the instruction icon moves within the scope of preset screen edge, and the direction of handheld input device refers to first
Changed into range with arbitrary trajectory, instruction icon all remains displayed within the scope of the screen edge, when detecting the instruction
The display position of icon is in the duration within the scope of the screen edge greater than preset first threshold, such as 1.5 seconds, then
Icon is indicated described in blanking.
In the blanking control method of the instruction icon of the application, a mapping model is established, it can according to the mapping model
The direction of handheld input device is mapped as to the display position of instruction icon.In the mapping model, handheld input device
The range of direction includes the first direction range, is directed toward the display position of the direction mapped instruction icon in range all first
, which means that the direction of handheld input device is directed toward in range first with any rail within the scope of preset screen edge
Mark changes, and instruction icon can remain displayed within the scope of preset screen edge.This point is the instruction icon of the application
Display position determine that the display position of the cursor of mouse of method and the prior art determines the fundamental difference point of method.The prior art
The display position of cursor of mouse determine method are as follows: move mouse along a direction, cursor of mouse made to move to screen edge, after
Continuous to move mouse along the direction, cursor of mouse can remain displayed in screen edge, but when mouse moves in opposite direction,
Cursor of mouse can move in screen at once.Therefore, method, hand are determined according to the display position of the instruction icon of conventional mouse
The all possible control instructions icon of all directions for holding input equipment moves in screen, can make to indicate that icon is protected there is no one
Hold the direction range within the scope of screen edge.Method is determined using the display position of the instruction icon of the application, holds input
The range of the direction of equipment include first be directed toward range, wherein first direction range generally include speaker's hand it is sagging or turn
Carry the direction of handheld input device when to screen on the body, therefore, in operation, it is aobvious that speaker need to only click activation key triggering
Show instruction icon, when no longer needing to show instruction icon, subordinate is hung down or is turned round towards spectators, indicates that icon can keep aobvious
Show within the scope of screen edge, when reaching time-out time, such as 1.5 seconds, it can blanking instruction icon.The blanking control of the application
Especially suitable for digital radio demonstration device, speaker does not need to continue push button exciting instruction icon method processed during speech,
It indicates that the blanking control of icon is unsophisticated, meets the motor habit of speaker in speech, be conducive to improve user experience.
It should be understood that the size of the serial number of each step is not meant that the order of the execution order in above-described embodiment, each process
Execution sequence should be determined by its function and internal logic, the implementation process without coping with the embodiment of the present application constitutes any limit
It is fixed.
Fig. 6 is a kind of structure of the blanking control device of the instruction icon of handheld input device provided by the embodiments of the present application
Schematic diagram.Wherein, the blanking control device of the instruction icon of the handheld input device includes:
Mapping model establishes unit 601, and for establishing mapping model, the mapping model is used to set the hand-held input
Standby direction is mapped as the display position of the instruction icon, wherein in the mapping model, the finger of the handheld input device
To range include first be directed toward range, when the handheld input device direction it is described first be directed toward range in any rail
When mark changes, the display position of the instruction icon is all within the scope of preset screen edge;
Display position determination unit 602, for determining the display position of the instruction icon according to the mapping model;
Blanking control unit 603, for detecting the finger when the instruction icon moves within the scope of the screen edge
Whether the duration that diagram target display position is within the scope of the screen edge is greater than preset first threshold, if institute
The duration is stated greater than the first threshold, then indicates icon described in blanking.
Preferably, the parameter of the mapping model includes the first direction, mapping origin and mapping coefficient.
Preferably, the mapping model establishes unit 601 and includes:
First is directed toward setting subelement, described hand-held when being arranged to set up the mapping model for being directed toward described first
The direction of input equipment, the direction of the handheld input device include the yaw angle and pitch angle of the handheld input device;
It maps origin and subelement is set, for setting preset screen position for the mapping origin;
Subelement is arranged in mapping coefficient, for setting preset value for the mapping coefficient, or according to it is described hold it is defeated
Enter equipment and determines the mapping coefficient at a distance from screen.
Preferably, the mapping model establishes unit 601 and includes:
Screen imaging region recognition subelement, the first image being directed toward for acquiring the handheld input device, extracts institute
The characteristics of image for stating the first image matches the characteristics of image of the first image with the screen characteristics prefetched, and identification exists
Screen imaging region in the first image.
Parameter determines subelement, for determining the parameter of the mapping model according to the screen imaging region, wherein institute
State the first direction for being oriented to handheld input device when acquisition the first image, the direction packet of the handheld input device
The yaw angle and pitch angle of the handheld input device are included, the mapping origin is according to the screen imaging region described first
Position in image is determined that the mapping coefficient is according to the screen imaging region and the camera shooting mould for acquiring the first image
The field angle of block is determined.
Preferably, the mapping model establishes unit 601 further include:
Second Image Acquisition subelement, for acquiring the second image of display on the screen;
Screen characteristics extract subelement, for extracting the characteristics of image of second image, wherein second image
Characteristics of image is the screen characteristics prefetched.
Preferably, the display position determination unit 602 includes:
It currently points to determine subelement, for determining currently pointing to for the handheld input device;
Positional shift determines subelement, for currently pointed to according to relative to it is described first be directed toward angle offset and
The mapping coefficient currently points to corresponding direction position relative to the corresponding direction position of first direction described in determining
Positional shift;
It is directed toward position and determines subelement, for determining the hand-held input according to the positional shift and the mapping origin
Equipment currently points to corresponding direction position;
Display position determines subelement, determines the instruction icon for currently pointing to corresponding direction position according to
Display position, wherein if the handheld input device currently point to it is described first be directed toward range in, the display
Position is within the scope of the screen edge.
The blanking control device of the instruction icon of handheld input device described in Fig. 6, the finger with handheld input device described in Fig. 1
Diagram target blanking control method is corresponding.
The electronic equipment that herein described blanking control method is related to has handheld input device, smart machine and display to set
It is standby, it is also possible to have other electronic equipments, the data processing equipment such as between smart machine and display equipment.It is herein described to disappear
Hidden control method can be implemented by the operating system or application program of above-mentioned associated electronic device, can also be by portable
Storage equipment stores the program of the control method, when the portable memory apparatus is connected to above-mentioned relevant device, triggering
The program that above-mentioned relevant device executes the control method is implemented.Above-mentioned smart machine can be desktop computer, mobile phone, plate electricity
The electronic equipments such as brain, embedded device and cloud computing equipment.
The modules of herein described blanking control device are in above-mentioned handheld input device, smart machine, display equipment
And the specific deployment way in data processing equipment, the application are not construed as limiting.At above-mentioned smart machine, display equipment and data
Reason equipment can be independent equipment, be also possible to integrated integration apparatus.Connection type between above equipment can be
Wired connection is also possible to be wirelessly connected.
Fig. 7 is the schematic diagram for the handheld input device that one embodiment of the application provides.As shown in fig. 7, the hand of the embodiment
Input equipment 7 is held to include: processor 70, memory 71 and be stored in the memory 71 and can be on the processor 70
The computer program 72 of operation, such as the blanking for indicating icon of handheld input device control program.The processor 70 executes
It is realized when the computer program 72 in the blanking control method embodiment of instruction icon of above-mentioned each handheld input device
Step.Alternatively, the processor 70 realizes each module/unit in above-mentioned each Installation practice when executing the computer program 72
Function.
Illustratively, the computer program 72 can be divided into one or more module/units, it is one or
Multiple module/units are stored in the memory 71, and are executed by the processor 70, to complete the application.Described one
A or multiple module/units can be the series of computation machine program instruction section that can complete specific function, which is used for
Implementation procedure of the computer program 72 in the handheld input device 7 is described.For example, the computer program 72 can be with
It is divided into:
Mapping model establishes unit, and for establishing mapping model, the mapping model is used for the handheld input device
Direction be mapped as it is described instruction icon display position, wherein in the mapping model, the direction of the handheld input device
Range include first be directed toward range, when the handheld input device direction it is described first be directed toward range in arbitrary trajectory
When change, the display position of the instruction icon is all within the scope of preset screen edge;
Display position determination unit, for determining the display position of the instruction icon according to the mapping model;
Blanking control unit, for detecting the instruction when the instruction icon moves within the scope of the screen edge
Whether the duration that the display position of icon is within the scope of the screen edge is greater than preset first threshold, if described
Duration is greater than the first threshold, then indicates icon described in blanking.
The handheld input device may include, but be not limited only to, processor 70, memory 71.Those skilled in the art can
To understand, Fig. 7 is only the example of handheld input device 7, does not constitute the restriction to handheld input device 7, may include ratio
More or fewer components are illustrated, certain components or different components are perhaps combined, such as the handheld input device may be used also
To include input-output equipment, network access equipment, bus etc..Handheld input device can be an equipment, can also be by one
A above sub- equipment composition separated, such as handheld input device includes two sub- equipment, one of them sub- equipment is by operator
Hand-held, another sub- equipment are used for the analysis of the first image, and two sub- equipment rooms are realized with wireless telecommunications and connected.
Alleged processor 70 can be central processing unit (Central Processing Unit, CPU), can also be
Other general processors, digital signal processor (Digital Signal Processor, DSP), specific integrated circuit
(Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field-
Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic,
Discrete hardware components etc..General processor can be microprocessor or the processor is also possible to any conventional processor
Deng.
The memory 71 can be the internal storage unit of the handheld input device 7, such as handheld input device 7
Hard disk or memory.The memory 71 is also possible to the External memory equipment of the handheld input device 7, for example, it is described hold it is defeated
Enter the plug-in type hard disk being equipped in equipment 7, intelligent memory card (Smart Media Card, SMC), secure digital (Secure
Digital, SD) card, flash card (Flash Card) etc..Further, the memory 71 can also both include described hand-held
The internal storage unit of input equipment 7 also includes External memory equipment.The memory 71 is for storing the computer program
And other programs and data needed for the handheld input device.The memory 71 can be also used for temporarily storing
Output or the data that will be exported.
It is apparent to those skilled in the art that for convenience of description and succinctly, only with above-mentioned each function
Can unit, module division progress for example, in practical application, can according to need and by above-mentioned function distribution by different
Functional unit, module are completed, i.e., the internal structure of described device is divided into different functional unit or module, more than completing
The all or part of function of description.Each functional unit in embodiment, module can integrate in one processing unit, can also
To be that each unit physically exists alone, can also be integrated in one unit with two or more units, it is above-mentioned integrated
Unit both can take the form of hardware realization, can also realize in the form of software functional units.In addition, each function list
Member, the specific name of module are also only for convenience of distinguishing each other, the protection scope being not intended to limit this application.Above system
The specific work process of middle unit, module, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, is not described in detail or remembers in some embodiment
The part of load may refer to the associated description of other embodiments.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure
Member and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually
It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician
Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed
Scope of the present application.
In embodiment provided herein, it should be understood that disclosed device/terminal device and method, it can be with
It realizes by another way.For example, device described above/terminal device embodiment is only schematical, for example, institute
The division of module or unit is stated, only a kind of logical function partition, there may be another division manner in actual implementation, such as
Multiple units or components can be combined or can be integrated into another system, or some features can be ignored or not executed.Separately
A bit, shown or discussed mutual coupling or direct-coupling or communication connection can be through some interfaces, device
Or the INDIRECT COUPLING or communication connection of unit, it can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list
Member both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated module/unit be realized in the form of SFU software functional unit and as independent product sale or
In use, can store in a computer readable storage medium.Based on this understanding, the application realizes above-mentioned implementation
All or part of the process in example method, can also instruct relevant hardware to complete, the meter by computer program
Calculation machine program can be stored in a computer readable storage medium, the computer program when being executed by processor, it can be achieved that on
The step of stating each embodiment of the method.Wherein, the computer program includes computer program code, the computer program generation
Code can be source code form, object identification code form, executable file or certain intermediate forms etc..The computer-readable medium
It may include: any entity or device, recording medium, USB flash disk, mobile hard disk, magnetic that can carry the computer program code
Dish, CD, computer storage, read-only memory (ROM, Read-Only Memory), random access memory (RAM,
Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium etc..It should be noted that described
The content that computer-readable medium includes can carry out increasing appropriate according to the requirement made laws in jurisdiction with patent practice
Subtract, such as in certain jurisdictions, according to legislation and patent practice, computer-readable medium do not include be electric carrier signal and
Telecommunication signal.
Embodiment described above is only to illustrate the technical solution of the application, rather than its limitations;Although referring to aforementioned reality
Example is applied the application is described in detail, those skilled in the art should understand that: it still can be to aforementioned each
Technical solution documented by embodiment is modified or equivalent replacement of some of the technical features;And these are modified
Or replacement, the spirit and scope of each embodiment technical solution of the application that it does not separate the essence of the corresponding technical solution should all
Comprising within the scope of protection of this application.
Claims (14)
1. a kind of blanking control method of the instruction icon of handheld input device, which is characterized in that the handheld input device
Indicate icon blanking control method include:
Mapping model is established, the mapping model is used to for the direction of the handheld input device being mapped as the instruction icon
Display position, wherein in the mapping model, the range of the direction of the handheld input device includes the first direction range, when
When the direction of the handheld input device is changed in the first direction range with arbitrary trajectory, the display of the instruction icon
Position is all within the scope of preset screen edge;
The display position of the instruction icon is determined according to the mapping model;
When the instruction icon moves within the scope of the screen edge, the display position for detecting the instruction icon is in described
Whether the duration within the scope of screen edge is greater than preset first threshold, if the duration is greater than first threshold
Value, then indicate icon described in blanking.
2. the blanking control method of the instruction icon of handheld input device according to claim 1, which is characterized in that described
The parameter of mapping model includes the first direction, mapping origin and mapping coefficient.
3. the blanking control method of the instruction icon of handheld input device according to claim 2, which is characterized in that described
First is oriented to the direction of handheld input device when establishing the mapping model, and the direction of the handheld input device includes
The yaw angle and pitch angle of the handheld input device;
The mapping origin is preset screen position;
The mapping coefficient determines at a distance from screen by preset value or according to the handheld input device.
4. the blanking control method of the instruction icon of handheld input device according to claim 2, which is characterized in that described
The step of establishing the mapping model include:
The first image that the handheld input device is directed toward is acquired, the characteristics of image of the first image is extracted, by described first
The characteristics of image of image is matched with the screen characteristics prefetched, identifies the screen imaging region in the first image.
The parameter of the mapping model is determined according to the screen imaging region, wherein described first is oriented to acquisition described the
The direction of handheld input device when one image, the direction of the handheld input device include the inclined of the handheld input device
Boat angle and pitch angle, the mapping origin determined according to position of the screen imaging region in the first image, institute
Mapping coefficient is stated to be determined according to the field angle in the screen imaging region and the photographing module of acquisition the first image.
5. the blanking control method of the instruction icon of handheld input device according to claim 4, which is characterized in that described
The step of establishing mapping model further include:
The second image of acquisition display on the screen;
Extract the characteristics of image of second image, wherein the characteristics of image of second image is that the screen prefetched is special
Sign.
6. the blanking control method of the instruction icon of handheld input device according to claim 2, which is characterized in that according to
The mapping model determines that the step of display position of the instruction icon includes:
Determine currently pointing to for the handheld input device;
The current finger is determined according to the angle offset and the mapping coefficient for currently pointing to be directed toward relative to described first
The corresponding positional shift for being directed toward position is directed toward relative to described first to corresponding direction position;
Corresponding direction position is currently pointed to according to what the positional shift and the mapping origin determined the handheld input device
It sets;
According to the display position for currently pointing to corresponding direction position and determining the instruction icon, wherein if the hand
Hold input equipment currently point to it is described first be directed toward range in, then the display position is in screen edge range
It is interior.
7. a kind of blanking control device of the instruction icon of handheld input device, which is characterized in that the handheld input device
Indicate icon blanking control device include:
Mapping model establishes unit, and for establishing mapping model, the mapping model is used for the finger of the handheld input device
To the display position for being mapped as the instruction icon, wherein in the mapping model, the model of the direction of the handheld input device
It encloses and is directed toward range including first, when the direction of the handheld input device is changed in the first direction range with arbitrary trajectory
When, the display position of the instruction icon is all within the scope of preset screen edge;
Display position determination unit, for determining the display position of the instruction icon according to the mapping model;
Blanking control unit, for detecting the instruction icon when the instruction icon moves within the scope of the screen edge
Duration for being within the scope of the screen edge of display position whether be greater than preset first threshold, if described lasting
Time is greater than the first threshold, then indicates icon described in blanking.
8. the blanking control device of the instruction icon of handheld input device according to claim 7, which is characterized in that described
The parameter of mapping model includes the first direction, mapping origin and mapping coefficient.
9. the blanking control device of the instruction icon of handheld input device according to claim 8, which is characterized in that described
Mapping model establishes unit
First is directed toward setting subelement, hand-held input when being arranged to set up the mapping model for being directed toward described first
The direction of equipment, the direction of the handheld input device include the yaw angle and pitch angle of the handheld input device;
It maps origin and subelement is set, for setting preset screen position for the mapping origin;
Subelement is arranged in mapping coefficient, sets for setting preset value for the mapping coefficient, or according to the hand-held input
It is standby that the mapping coefficient is determined at a distance from screen.
10. the blanking control device of the instruction icon of handheld input device according to claim 8, which is characterized in that institute
It states mapping model and establishes unit and include:
Screen imaging region recognition subelement, the first image being directed toward for acquiring the handheld input device extract described the
The characteristics of image of one image matches the characteristics of image of the first image with the screen characteristics prefetched, identifies described
Screen imaging region in first image.
Parameter determines subelement, for determining the parameter of the mapping model according to the screen imaging region, wherein described
One is oriented to the direction of handheld input device when acquisition the first image, and the direction of the handheld input device includes institute
The yaw angle and pitch angle of handheld input device are stated, the mapping origin is according to the screen imaging region in the first image
In position determined that the mapping coefficient is according to the photographing module in the screen imaging region and acquisition the first image
Field angle is determined.
11. the blanking control device of the instruction icon of handheld input device according to claim 10, which is characterized in that institute
It states mapping model and establishes unit further include:
Second Image Acquisition subelement, for acquiring the second image of display on the screen;
Screen characteristics extract subelement, for extracting the characteristics of image of second image, wherein the image of second image
Feature is the screen characteristics prefetched.
12. the blanking control device of the instruction icon of handheld input device according to claim 8, which is characterized in that institute
Stating display position determination unit includes:
It currently points to determine subelement, for determining currently pointing to for the handheld input device;
Positional shift determines subelement, the angle offset and described for currently pointing to be directed toward relative to described first according to
Mapping coefficient currently points to the position that corresponding direction position is directed toward relative to described first in corresponding direction position described in determining
Offset;
It is directed toward position and determines subelement, for determining the handheld input device according to the positional shift and the mapping origin
Currently point to corresponding direction position;
Display position determines subelement, determines the aobvious of the instruction icon for currently pointing to corresponding direction position according to
Show position, wherein if the handheld input device currently points to be directed toward in range described first, the display position
Within the scope of the screen edge.
13. a kind of handheld input device, including memory, processor and storage are in the memory and can be in the processing
The computer program run on device, which is characterized in that the processor realizes such as claim 1 when executing the computer program
To the instruction icon of any one of 6 handheld input devices blanking control method the step of.
14. a kind of computer readable storage medium, the computer-readable recording medium storage has computer program, and feature exists
In the instruction of realization handheld input device as described in any one of claim 1 to 6 when the computer program is executed by processor
The step of blanking control method of icon.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910603013.0A CN110489026A (en) | 2019-07-05 | 2019-07-05 | A kind of handheld input device and its blanking control method and device for indicating icon |
PCT/CN2020/100299 WO2021004413A1 (en) | 2019-07-05 | 2020-07-04 | Handheld input device and blanking control method and apparatus for indication icon of handheld input device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910603013.0A CN110489026A (en) | 2019-07-05 | 2019-07-05 | A kind of handheld input device and its blanking control method and device for indicating icon |
Publications (1)
Publication Number | Publication Date |
---|---|
CN110489026A true CN110489026A (en) | 2019-11-22 |
Family
ID=68546629
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910603013.0A Pending CN110489026A (en) | 2019-07-05 | 2019-07-05 | A kind of handheld input device and its blanking control method and device for indicating icon |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN110489026A (en) |
WO (1) | WO2021004413A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2021004412A1 (en) * | 2019-07-05 | 2021-01-14 | 深圳市格上格创新科技有限公司 | Handheld input device, and method and apparatus for controlling display position of indication icon thereof |
WO2021004413A1 (en) * | 2019-07-05 | 2021-01-14 | 深圳市格上格创新科技有限公司 | Handheld input device and blanking control method and apparatus for indication icon of handheld input device |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101075173A (en) * | 2006-09-14 | 2007-11-21 | 腾讯科技(深圳)有限公司 | Display device and method |
CN101606120A (en) * | 2007-12-07 | 2009-12-16 | 索尼株式会社 | Control device, input media, control system, control method and hand-held device |
CN103425408A (en) * | 2012-05-23 | 2013-12-04 | 深圳富泰宏精密工业有限公司 | Mouse and keyboard sharing method and system |
CN103902061A (en) * | 2012-12-25 | 2014-07-02 | 华为技术有限公司 | Air mouse cursor display method, device and system |
CN106774868A (en) * | 2016-12-06 | 2017-05-31 | 杨超峰 | A kind of wireless demo device |
CN108848374A (en) * | 2018-08-08 | 2018-11-20 | 京东方科技集团股份有限公司 | Display parameters measurement method and its device, storage medium and measuring system |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101398721A (en) * | 2007-09-26 | 2009-04-01 | 昆盈企业股份有限公司 | Control method for moving speed of cursor of air mouse |
US20100182232A1 (en) * | 2009-01-22 | 2010-07-22 | Alcatel-Lucent Usa Inc. | Electronic Data Input System |
JP2010282408A (en) * | 2009-06-04 | 2010-12-16 | Sony Corp | Control device, input device, control system, hand-held device, and control method |
CN110489027B (en) * | 2019-07-05 | 2021-07-23 | 深圳市格上格创新科技有限公司 | Handheld input device and display position control method and device of indication icon of handheld input device |
CN110489026A (en) * | 2019-07-05 | 2019-11-22 | 深圳市格上格创新科技有限公司 | A kind of handheld input device and its blanking control method and device for indicating icon |
-
2019
- 2019-07-05 CN CN201910603013.0A patent/CN110489026A/en active Pending
-
2020
- 2020-07-04 WO PCT/CN2020/100299 patent/WO2021004413A1/en active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101075173A (en) * | 2006-09-14 | 2007-11-21 | 腾讯科技(深圳)有限公司 | Display device and method |
CN101606120A (en) * | 2007-12-07 | 2009-12-16 | 索尼株式会社 | Control device, input media, control system, control method and hand-held device |
CN103425408A (en) * | 2012-05-23 | 2013-12-04 | 深圳富泰宏精密工业有限公司 | Mouse and keyboard sharing method and system |
CN103902061A (en) * | 2012-12-25 | 2014-07-02 | 华为技术有限公司 | Air mouse cursor display method, device and system |
CN106774868A (en) * | 2016-12-06 | 2017-05-31 | 杨超峰 | A kind of wireless demo device |
CN108848374A (en) * | 2018-08-08 | 2018-11-20 | 京东方科技集团股份有限公司 | Display parameters measurement method and its device, storage medium and measuring system |
Non-Patent Citations (1)
Title |
---|
肖波: "《电脑常用小技巧(上)》", 《第二课堂:初中版》 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2021004412A1 (en) * | 2019-07-05 | 2021-01-14 | 深圳市格上格创新科技有限公司 | Handheld input device, and method and apparatus for controlling display position of indication icon thereof |
WO2021004413A1 (en) * | 2019-07-05 | 2021-01-14 | 深圳市格上格创新科技有限公司 | Handheld input device and blanking control method and apparatus for indication icon of handheld input device |
Also Published As
Publication number | Publication date |
---|---|
WO2021004413A1 (en) | 2021-01-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108525298B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
KR100851977B1 (en) | Controlling Method and apparatus for User Interface of electronic machine using Virtual plane. | |
CN110456907A (en) | Control method, device, terminal device and the storage medium of virtual screen | |
CN110489027A (en) | Handheld input device and its display position control method and device for indicating icon | |
US20150062004A1 (en) | Method and System Enabling Natural User Interface Gestures with an Electronic System | |
WO2021097600A1 (en) | Inter-air interaction method and apparatus, and device | |
JP6390799B2 (en) | Input device, input method, and program | |
US8416189B2 (en) | Manual human machine interface operation system and method thereof | |
JP2016194799A (en) | Image analyzer and image analysis method | |
TWI701941B (en) | Method, apparatus and electronic device for image processing and storage medium thereof | |
JP6344530B2 (en) | Input device, input method, and program | |
CN104081307A (en) | Image processing apparatus, image processing method, and program | |
US20220317776A1 (en) | Methods for manipulating objects in an environment | |
US20180032139A1 (en) | Interactive system control apparatus and method | |
US11188144B2 (en) | Method and apparatus to navigate a virtual content displayed by a virtual reality (VR) device | |
TW201737023A (en) | Information processing system, information processing device, control method, and program | |
CN109992175B (en) | Object display method, device and storage medium for simulating blind feeling | |
US8643679B2 (en) | Storage medium storing image conversion program and image conversion apparatus | |
CN113538696A (en) | Special effect generation method and device, storage medium and electronic equipment | |
CN107797648B (en) | Virtual touch system, image recognition positioning method and computer-readable storage medium | |
CN110489026A (en) | A kind of handheld input device and its blanking control method and device for indicating icon | |
CN110908517B (en) | Image editing method, image editing device, electronic equipment and medium | |
CN106569716B (en) | Single-hand control method and control system | |
CN105302310B (en) | A kind of gesture identifying device, system and method | |
CN109816723A (en) | Method for controlling projection, device, projection interactive system and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191122 |