CN110489026A - A kind of handheld input device and its blanking control method and device for indicating icon - Google Patents

A kind of handheld input device and its blanking control method and device for indicating icon Download PDF

Info

Publication number
CN110489026A
CN110489026A CN201910603013.0A CN201910603013A CN110489026A CN 110489026 A CN110489026 A CN 110489026A CN 201910603013 A CN201910603013 A CN 201910603013A CN 110489026 A CN110489026 A CN 110489026A
Authority
CN
China
Prior art keywords
input device
handheld input
screen
image
mapping
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910603013.0A
Other languages
Chinese (zh)
Inventor
杨超峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Geshangge Innovation Technology Co Ltd
Original Assignee
Shenzhen Geshangge Innovation Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Geshangge Innovation Technology Co Ltd filed Critical Shenzhen Geshangge Innovation Technology Co Ltd
Priority to CN201910603013.0A priority Critical patent/CN110489026A/en
Publication of CN110489026A publication Critical patent/CN110489026A/en
Priority to PCT/CN2020/100299 priority patent/WO2021004413A1/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04812Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A kind of blanking control method of the instruction icon of handheld input device includes: to establish mapping model, the mapping model is used to for the direction of the handheld input device being mapped as the display position of the instruction icon, in the mapping model, the range of the direction of handheld input device includes the first direction range, when the direction of the handheld input device is changed in the first direction range with arbitrary trajectory, the display position of the instruction icon is all within the scope of preset screen edge;The display position of the instruction icon is determined according to the mapping model;When the instruction icon moves within the scope of the screen edge, the display position for detecting the instruction icon is in the duration within the scope of the screen edge greater than preset first threshold, then indicates icon described in blanking.

Description

A kind of handheld input device and its blanking control method and device for indicating icon
Technical field
The application belongs to handheld input device field more particularly to a kind of handheld input device and its indicates the blanking of icon Control method and device.
Background technique
Handheld input device, can be by operator's hand-held, and passes through and control its direction on three-dimensional space, makes one A instruction icon moves on the graphic user interface (GUI) of display screen.
A kind of specific product of handheld input device is air mouse.For air mouse, above-mentioned instruction icon is mouse Mark cursor.Different from desktop mouse, air mouse does not need supporting plane, and operator can hold air mouse control cursor and exist It is moved on graphic user interface.Another application of handheld input device is digital radio demonstration device.Wireless demo device is meeting An important equipment in room gives top priority to what is the most important content for speaker when explaining the data such as PPT.The master of wireless demo device at present Wanting category is laser demonstration device, also referred to as laser pen, and speaker presses activation key triggering laser, utilizes laser facula screen illuminating Upper key content, achievees the purpose that the content that gives top priority to what is the most important.The price of LCD/LED large-size screen monitors is lower and lower in recent years, relative to projection Machine, brightness is high, contrast is big, color rendition degree is more preferable, and therefore, more and more meeting rooms and Classroom start using LCD/ LED large-size screen monitors.Since the surface of LCD/LED large-size screen monitors is mirror-reflection to laser, cause incident direction hot spot very dark, and exit direction Hot spot it is excessively bright, therefore laser demonstration device is not suitable for LCD/LED large-size screen monitors.Digital radio demonstration device can solve the above problem, The cursor of mouse that the ratio of the instruction icon design controlled is traditional is more eye-catching, is such as designed as highlighted red round spot, i.e., It can reach the effect similar to laser facula, prominent mark carried out to the key content of speech.
For desktop mouse, there is a supporting plane, when stop operation need to only loose one's grip, and instruction icon can be fixed on screen A position on.And handheld input device is by operator's hand-held, indicating can be always with operator after icon activation Activity and move, therefore, handheld input device need it is a kind of indicate icon blanking control method.
It is existing instruction icon blanking method it is usual are as follows: 1, when instruction icon less than one threshold speed of movement speed hold Blanking when continuous a period of time, due to being also required to refer to when handheld input device does certain operations (as indicated explanation against key content) Diagram mark is substantially at stationary state, it is therefore desirable to the time threshold of triggering blanking is arranged it is very long, such as 5 seconds.It is this Blanking method is not suitable for needing the application scenarios of quickly-blanking instruction icon, for example, when being given a lecture with digital radio demonstration device, It needs that instruction icon is quickly activated to indicate key content, generally requires rapidly blanking after having explained one section of key content Indicate icon;2, a key is set on handheld input device, according to just activation indicates icon when the key, unclamps the key and disappears Hidden instruction icon.The problem of this blanking method is that operator needs to be easy to cause finger fatigue, separately according to key for a long time Outside, other keypress functions cannot be triggered during control instructions icon is mobile according to activation key due to finger again;3, hand One key of setting on input equipment is held, push button exciting instruction icon is clicked, again taps on blanking instruction icon.This mode The problem of be operator need active click keys go blanking indicate icon, it is cumbersome, especially when handheld input device is used as When digital radio demonstration device, speaker may forget that blanking instruction icon is turned round and explain back to screen, can lead at this time Instruction icon is caused as the gesture of speaker is shaken, to influence effect of giving a lecture on the screen.
Summary of the invention
In view of this, the embodiment of the present application provides a kind of handheld input device and its indicates the blanking control method of icon And device, with solve the prior art instruction icon blanking control method in, need for a long time according to key control instructions figure Finger fatigue problem caused by mark display, or need caused by active click keys control icon blanking it is cumbersome, Indicate the problem of icon shakes.
The first aspect of the embodiment of the present application provides a kind of blanking control method of the instruction icon of handheld input device, The blanking control method of the instruction icon of the handheld input device includes:
Mapping model is established, the mapping model is used to the direction of the handheld input device being mapped as the instruction figure Target display position, wherein in the mapping model, the range of the direction of the handheld input device includes the first direction model It encloses, when the direction of the handheld input device is changed in the first direction range with arbitrary trajectory, the instruction icon Display position all within the scope of preset screen edge;
The display position of the instruction icon is determined according to the mapping model;
When the instruction icon moves within the scope of the screen edge, the display position for detecting the instruction icon is in Whether the duration within the scope of the screen edge is greater than preset first threshold, if the duration is greater than described the One threshold value then indicates icon described in blanking.
With reference to first aspect, in the first possible implementation of first aspect, the parameter of the mapping model includes First is directed toward, maps origin and mapping coefficient.
The possible implementation of with reference to first aspect the first, in second of possible implementation of first aspect, institute State the first direction for being oriented to handheld input device when establishing the mapping model, the direction packet of the handheld input device Include the yaw angle and pitch angle of the handheld input device;
The mapping origin is preset screen position;
The mapping coefficient determines at a distance from screen by preset value or according to the handheld input device.
The possible implementation of with reference to first aspect the first, in the third possible implementation of first aspect, institute Stating the step of establishing the mapping model includes:
The first image that the handheld input device is directed toward is acquired, the characteristics of image of the first image is extracted, it will be described The characteristics of image of first image is matched with the screen characteristics prefetched, identifies the screen imaging area in the first image Domain.
The parameter of the mapping model is determined according to the screen imaging region, wherein described first is oriented to acquisition institute The direction of handheld input device when the first image is stated, the direction of the handheld input device includes the handheld input device Yaw angle and pitch angle, it is described mapping origin according to the screen imaging region in the first image position institute really Fixed, the mapping coefficient is true according to the field angle institute of the screen imaging region and the photographing module of acquisition the first image It is fixed.
The third possible implementation with reference to first aspect, in the 4th kind of possible implementation of first aspect, institute State the step of establishing mapping model further include:
The second image of acquisition display on the screen;
Extract the characteristics of image of second image, wherein the characteristics of image of second image is the screen prefetched Curtain feature.
The possible implementation of with reference to first aspect the first, in the 5th kind of possible implementation of first aspect, institute Stating the step of determining the display position of the instruction icon according to the mapping model includes:
Determine currently pointing to for the handheld input device;
Work as according to the angle offset for currently pointing to be directed toward relative to described first and mapping coefficient determination It is preceding to be directed toward the corresponding positional shift be directed toward position and be directed toward corresponding direction position relative to described first;
Corresponding finger is currently pointed to according to what the positional shift and the mapping origin determined the handheld input device To position;
According to the display position for currently pointing to corresponding direction position and determining the instruction icon, wherein if institute Currently pointing in the first direction range for handheld input device is stated, then the display position is in screen edge model In enclosing.
The second aspect of the embodiment of the present application provides a kind of blanking control device of the instruction icon of handheld input device, The blanking control device of the instruction icon of the handheld input device includes:
Mapping model establishes unit, and for establishing mapping model, the mapping model is used for the handheld input device Direction be mapped as it is described instruction icon display position, wherein in the mapping model, the direction of the handheld input device Range include first be directed toward range, when the handheld input device direction it is described first be directed toward range in arbitrary trajectory When change, the display position of the instruction icon is all within the scope of preset screen edge;
Display position determination unit, for determining the display position of the instruction icon according to the mapping model;
Blanking control unit, for detecting the instruction when the instruction icon moves within the scope of the screen edge Whether the duration that the display position of icon is within the scope of the screen edge is greater than preset first threshold, if described Duration is greater than the first threshold, then indicates icon described in blanking.
In conjunction with second aspect, in the first possible implementation of second aspect, the parameter of the mapping model includes First is directed toward, maps origin and mapping coefficient.
In conjunction with the first possible implementation of second aspect, in second of possible implementation of second aspect, institute It states mapping model and establishes unit and include:
First is directed toward setting subelement, described hand-held when being arranged to set up the mapping model for being directed toward described first The direction of input equipment, the direction of the handheld input device include the yaw angle and pitch angle of the handheld input device;
It maps origin and subelement is set, for setting preset screen position for the mapping origin;
Subelement is arranged in mapping coefficient, for setting preset value for the mapping coefficient, or according to it is described hold it is defeated Enter equipment and determines the mapping coefficient at a distance from screen.
In conjunction with the first possible implementation of second aspect, in the third possible implementation of second aspect, institute It states mapping model and establishes unit and include:
Screen imaging region recognition subelement, the first image being directed toward for acquiring the handheld input device, extracts institute The characteristics of image for stating the first image matches the characteristics of image of the first image with the screen characteristics prefetched, and identification exists Screen imaging region in the first image.
Parameter determines subelement, for determining the parameter of the mapping model according to the screen imaging region, wherein institute State the first direction for being oriented to handheld input device when acquisition the first image, the direction packet of the handheld input device The yaw angle and pitch angle of the handheld input device are included, the mapping origin is according to the screen imaging region described first Position in image is determined that the mapping coefficient is according to the screen imaging region and the camera shooting mould for acquiring the first image The field angle of block is determined.
In conjunction with the third possible implementation of second aspect, in the 4th kind of possible implementation of second aspect, institute It states mapping model and establishes unit further include:
Second Image Acquisition subelement, for acquiring the second image of display on the screen;
Screen characteristics extract subelement, for extracting the characteristics of image of second image, wherein second image Characteristics of image is the screen characteristics prefetched.
In conjunction with the first possible implementation of second aspect, in the 5th kind of possible implementation of second aspect, institute Stating display position determination unit includes:
It currently points to determine subelement, for determining currently pointing to for the handheld input device;
Positional shift determines subelement, for currently pointed to according to relative to it is described first be directed toward angle offset and The mapping coefficient currently points to corresponding direction position relative to the corresponding direction position of first direction described in determining Positional shift;
It is directed toward position and determines subelement, for determining the hand-held input according to the positional shift and the mapping origin Equipment currently points to corresponding direction position;
Display position determines subelement, determines the instruction icon for currently pointing to corresponding direction position according to Display position, wherein if the handheld input device currently point to it is described first be directed toward range in, the display Position is within the scope of the screen edge.
The third aspect of the embodiment of the present application provides a kind of handheld input device, including memory, processor and deposits The computer program that can be run in the memory and on the processor is stored up, the processor executes the computer journey The step of blanking control method of instruction icon of the handheld input device as described in any one of first aspect is realized when sequence.
The fourth aspect of the embodiment of the present application provides a kind of computer readable storage medium, the computer-readable storage Media storage has computer program, which is characterized in that realizes that first aspect such as is appointed when the computer program is executed by processor The step of blanking control method of the instruction icon of one handheld input device.
Existing beneficial effect is the embodiment of the present application compared with prior art:
The mapping model that the direction of handheld input device is mapped as to the display position of instruction icon is established, in the mapping mould In type, the range of the direction of handheld input device includes the first direction range, when the direction of handheld input device is directed toward first It when changing in range with arbitrary trajectory, indicates that the display position of icon is within the scope of screen edge, passes through detection instruction figure When the duration being marked within the scope of screen edge is greater than preset first threshold, the instruction icon blanking is controlled.Described One direction range generally include speaker's hand it is sagging when or handheld input device when turning round back to screen direction.Cause This, the blanking control method of the instruction icon based on the application, speaker does not need for a long time according to key control instructions icon Display need to only click activation key triggering display instruction icon, when no longer needing to show instruction icon, it is only necessary to which subordinate hangs down Can blanking indicate icon, or turn round towards spectators can blanking instruction icon, blanking control it is unsophisticated, will not because accidentally grasp Work causes to indicate that icon arbitrarily shakes, and does not also need long-time key, meets the operating habit of handheld input device, is conducive to mention High user experience.
Detailed description of the invention
It in order to more clearly explain the technical solutions in the embodiments of the present application, below will be to embodiment or description of the prior art Needed in attached drawing be briefly described, it should be apparent that, the accompanying drawings in the following description is only some of the application Embodiment for those of ordinary skill in the art without any creative labor, can also be according to these Attached drawing obtains other attached drawings.
Fig. 1 is a kind of realization of the blanking control method of the instruction icon of handheld input device provided by the embodiments of the present application Flow diagram;
Fig. 2 is the schematic diagram of the direction control instructions icon provided by the embodiments of the present application by handheld input device;
Fig. 3 is a kind of implementation process schematic diagram of mapping model method for building up provided by the embodiments of the present application;
Fig. 4 is a kind of schematic diagram of the first image of handheld input device acquisition provided by the embodiments of the present application;
Fig. 5 is the implementation process schematic diagram of the display position of determining instruction icon provided by the embodiments of the present application;
Fig. 6 is a kind of structure of the blanking control device of the instruction icon of handheld input device provided by the embodiments of the present application Schematic diagram;
Fig. 7 is the schematic diagram of handheld input device provided by the embodiments of the present application.
Specific embodiment
In being described below, for illustration and not for limitation, the tool of such as particular system structure, technology etc is proposed Body details, so as to provide a thorough understanding of the present application embodiment.However, it will be clear to one skilled in the art that there is no these specific The application also may be implemented in the other embodiments of details.In other situations, it omits to well-known system, device, electricity The detailed description of road and method, so as not to obscure the description of the present application with unnecessary details.
In order to illustrate technical solution described herein, the following is a description of specific embodiments.
Fig. 1 is a kind of realization of the blanking control method of the instruction icon of handheld input device provided by the embodiments of the present application Flow diagram, details are as follows:
In step s101, mapping model is established, the mapping model is for reflecting the direction of the handheld input device It penetrates as the display position of the instruction icon.
Handheld input device in the application can be air mouse, digital radio demonstration device or other types of defeated Enter equipment, usual handheld input device is equipped with key, and operator can activate instruction icon or triggering by key command Other operations.
By operator's hand-held, operator passes through the hand-held input of control in use and sets the handheld input device Standby one instruction icon of motion control in three dimensions moves on the screen of a display device, wherein the instruction icon It is a Drawing Object on computer graphic user interface, can is the icon of a pointer shape, such as cursor of mouse.Work as behaviour After author's control Drawing Object moves to target position, it can be triggered by the function button on handheld input device corresponding Operation.The display equipment can be any display equipment such as projector, LCD/LED display.
Blanking control method described herein can be run in triggering when operator activates the instruction icon, can also be with Operation is just triggered when the instruction icon is in hidden state, for example, can trigger at once after handheld input device power-up Operation, or the triggering operation when the pitch angle of handheld input device is greater than preset angle.
Fig. 2 show an application scenarios of handheld input device, and handheld input device is held by operator, the ash in figure Color region is screen 201, and the screen 201 includes but is not limited to electronic wall screen, indicator screen or projection screen etc..Hand Input equipment direction screen 201 is held to be operated.As shown in Fig. 2, the movement of handheld input device in three dimensions can be used The variation of the direction D of handheld input device indicates.
A mapping model is established, the mapping model is used to the direction of handheld input device being mapped as the instruction figure Target display position.By the mapping model, the direction D of handheld input device is mapped as the one of screen reference plane 202 first A direction position, and the display position for indicating icon is determined according to the direction position, operator, which can pass through, manipulates hand-held input The direction D control instructions icon of equipment moves on screen 201.
The screen reference plane 202 can be determined according to the surface of screen.If showing that the screen surface of equipment is flat Face, it is preferred that as shown in Fig. 2, the screen reference plane 202 is set as plane where screen, wherein dark gray areas is screen 201.If screen surface is curved surface, screen projection surface approximate representation screen 201 can be used, and screen reference plane 202 is screen Plane or screen reference plane 202 where projection surface are also possible to curved surface.It is noted that screen 201 shown in Fig. 2 is Rectangle, actually screen 201 can be other arbitrary shapes, can also be made of several isolated sub-screens, and abnormity is shielded Curtain with rectangular screen is identical in principle when establishing mapping model.Without loss of generality, the application is by taking rectangular screen as an example Discuss the establishment process of mapping model.
It is noted that the direction position of the direction D mapped screen reference plane of the handheld input device and holds The position that input equipment is actually pointed to is different concept, the position being directed toward position and may being actually pointed to handheld input device It sets and is consistent, it is also possible to and there is deviation in the position that handheld input device is actually pointed to.For example, as shown in Fig. 2, if hand-held input is set The standby intersection point P for being directed toward D mapped and being directed toward direction line 204 and screen reference plane 202 that position is handheld input device, then refer to Position is directed toward to D mapped to be consistent with the position that handheld input device is actually pointed to;If the direction D institute of handheld input device The direction position of mapping is P1, then being directed toward D mapped and being directed toward the position that position and handheld input device are actually pointed to has deviation.
The direction of the handheld input device is mapped as screen reference first by the mapping model established according to the application Then the direction position in face 202 determines the display position of instruction icon according to the direction position.In the mapping model, institute The range for stating the direction of handheld input device includes the first direction range, when the direction of the handheld input device is described first When being changed in direction range with arbitrary trajectory, the display position of the instruction icon is all within the scope of preset screen edge.
There are many embodiments for the mapping model.
Mapping model embodiment one:
The parameter of the present embodiment mapping model includes the first direction, mapping origin and mapping coefficient.
There are many methods of determination for the parameter of mapping model embodiment one.In one embodiment, the mapping model Determination method for parameter includes:
Step S1: described first is oriented to the direction of handheld input device when establishing the mapping model, the hand The direction for holding input equipment includes the yaw angle and pitch angle of the handheld input device;
In the mapping model of the present embodiment, the hand-held input is set with the yaw angle and pitch angle of handheld input device Standby direction is modeled.As shown in Fig. 2, being accustomed to according to the description of attitude of flight vehicle, if the direction D of handheld input device is machine Head direction, then RY axis is pitch axis, RZ axis is yaw axis, when handheld input device is rotated around pitch axis RY, is directed toward Position P is moved up and down on the screen, and when handheld input device is rotated around yaw axis RZ, the position P being directed toward is on the screen It moves left and right.As it can be seen that the yaw angle and pitch angle of handheld input device can be natural and effectively to the fingers of handheld input device To being modeled.
Inertia motion sensor, including accelerometer and gyroscope are set in handheld input device, and the inertia motion passes The acceleration information and gyro data of sensor acquisition handheld input device.It can according to the acceleration information and gyro data To calculate the pitch angle and yaw angle of handheld input device, the i.e. finger of handheld input device in the present embodiment mapping model To.Calculating the attitude angle of handheld input device according to acceleration information and gyro data is a kind of known method, such as expansion card Kalman Filtering algorithm, the application repeat no more.
Determine that hand-held input is set when establishing mapping model according to the acceleration information of handheld input device and gyro data Standby pitch angle and yaw angle obtains described first and is directed toward.
Step S2: the mapping origin is set as preset screen position.
The physical significance of the mapping origin is the described first direction position for being directed toward the reference plane of mapped screen.At this In the mapping model of embodiment, as shown in Fig. 2, screen reference plane 202 is a plane, it is arranged one for screen reference plane 202 Cartesian coordinate system, without loss of generality, the coordinate system is using the top left corner apex O of screen 201 as origin, with screen X-axis for its X Axis, with screen Y-axis for its Y-axis.Any point of screen reference plane 202 can be set as mapping origin, it is preferred that mapping is former Point is set as a preset screen position, such as the center of screen 201 or the position of instruction icon last time blanking.
Step S3: the mapping coefficient is set as preset value, or according to the handheld input device at a distance from screen It determines.
The physical meaning of the mapping coefficient is the corresponding screen reference plane in every degree angle of the yaw angle of handheld input device X-axis picture point number and handheld input device pitch angle the corresponding screen reference plane in every degree angle Y-axis picture point number.It can be with A preset constant is set by mapping coefficient S, alternatively, a range sensor is arranged on handheld input device, is such as swashed To perceive handheld input device at a distance from screen mapping coefficient S is arranged, for example, distance in ligh-ranging sensor according to this distance Remoter set S value is bigger.
It is noted that the mapping origin is preset screen in the mapping model parameter that above-mentioned steps S1-S3 is determined Position is usually not arranged on the direction line 204 of handheld input device and the intersection point P of screen reference plane 202, i.e., described first It is directed toward the position that mapped direction position is actually pointed to handheld input device not being inconsistent, therefore subsequent handheld input device Direction mapped to be directed toward the position that position and handheld input device are actually pointed to be generally also not to be inconsistent, it means that according to The position that the display position for being directed toward the instruction icon that position determines and handheld input device are actually pointed to is inconsistent.
In another embodiment, the parameter of the mapping model is determined based on image analysis technology, can make to indicate icon Display position and the position consistency that is actually pointed to of handheld input device, step it is as shown in Figure 3, comprising:
In step S301, the first image that the handheld input device is directed toward is acquired, the figure of the first image is extracted As feature, the characteristics of image of the first image is matched with the screen characteristics prefetched, is identified in the first image Screen imaging region;
As shown in Fig. 2, being equipped with photographing module 203 in the handheld input device, the shooting of photographing module 203 holds defeated Enter the image of equipment direction, which is the first image 401 as shown in Figure 4.Preferably, the installation side of photographing module 203 Formula can be with are as follows: handheld input device is directed toward line 204 perpendicular to the photosensitive sensor array plane of photographing module 203 and crosses wherein Heart point.Using this preferred embodiment, the intersection point P for being directed toward line 204 and screen reference plane 202 of handheld input device is in the first image Imaging point in 401 is the central point IP of the first image 401, conducive to the calculating of the parameter of mapping model.
After obtaining the first image 401, the first image 401 is analyzed, the figure of the first image is extracted As feature, the characteristics of image of the first image is matched with the screen characteristics prefetched, is identified in the first image 401 In screen imaging region 402.The screen characteristics prefetched are the characteristics of image of screen 201 for identification.Characteristics of image Analysis and matching algorithm are known technologies, are repeated no more.It is noted that actual imaging area of the screen 201 in the first image Domain is usually to have deformation, can be corrected to it according to the image-forming principle of video camera, obtain the screen of rule as shown in Figure 4 at As region 402.
Prefetching the screen characteristics, there are many embodiments, comprising:
Mode one: hardware identification device being arranged on the display device, such as multiple infrared LEDs are arranged in 201 surrounding of screen, Prefetch LED quantity and LED spacing and be used as screen characteristics, extract highlighted luminous point in the first image 401, by the luminous point according to LED quantative attribute and LED pitch characteristics are matched, it may be determined that the screen imaging region 402.
Mode two: when the first image 401 of acquisition, one is shown on the specific position (such as screen center) of screen 201 Or multiple special Drawing Objects, the characteristics of image for extracting these Drawing Objects in advance are used as screen characteristics.
Mode three: while acquiring the first image or before, acquire the second image for being shown on screen 201, extract The characteristics of image of second image is used as screen characteristics.A kind of implementation for acquiring the second image can be independent hard using one Part device, the device are connected to smart machine and show in the image data transmission channel between equipment, should such as HDMI wire road Device intercepts and captures the second image of smart machine output.Another implementation for acquiring the second image is software screen mode, In One software of installation on the smart machine of the second image is exported, which exports to the second figure of display equipment Picture.Employing mode three does not need that special hardware device is arranged, applicability is good relative to aforesaid way one;Relative to above-mentioned side Formula two will not often show Drawing Object for identification on screen, influence user's perception.
Handheld input device reality may be implemented in the parameter that the present embodiment mapping model is determined according to screen imaging region 402 The consistency of the display position of position and instruction icon that border is directed toward.
In step s 302, determine the first direction, described first when being oriented to acquisition the first image it is described hold it is defeated Enter the direction of equipment, wherein the direction of the handheld input device includes the yaw angle and pitch angle of the handheld input device;
The direction of the handheld input device is identical with the direction of handheld input device described in above-mentioned steps S1, root The direction of handheld input device when acquiring the first image is determined according to the acceleration information and gyro data of handheld input device, Described first is obtained to be directed toward.
In step S303, mapping origin is determined according to position of the screen imaging region in the first image.
As shown in Figure 2 and Figure 4, in the first image 401, the top left corner apex IO in screen imaging region 402 is screen 201 The imaging point of top left corner apex O, point IP are the imaging point for the position P that handheld input device is directed toward, and point IP is located at the first image 401 Central point.
In the mapping model of the present embodiment, screen reference plane 202 is a plane, is arranged one for screen reference plane 202 Cartesian coordinate system, without loss of generality, the coordinate system is using the top left corner apex O of screen 201 as origin, with screen X-axis for its X Axis, with screen Y-axis for its Y-axis.
Position according to the central point IP of the first image 401 relative to point IO can calculate handheld input device reality Coordinate shift of the position P of direction relative to the top left corner apex O of screen 201, to obtain position P in screen reference plane 202 In coordinate, which is the mapping origin (VX0,VY0).Calculation formula is as follows:
VX0=(CX/SW) * MaxX, VY0=(CY/SH) * MaxY (1)
Wherein, CX and CY is respectively the horizontal picture point number and vertical picture point number of point IP corresponding point IO;SW and SH is respectively to shield The horizontal picture point number and vertical picture point number in screen imaging region 402;MaxX and MaxY is the horizontal picture point number of screen 201 respectively and hangs down Straight picture point number, for example, setting the screen resolution of screen 201 as 1920x1080, then MaxX is 1920, MaxY 1080.
It is worth noting that the mapping origin is the described first direction position for being directed toward corresponding screen reference plane 202, If handheld input device is directed toward the position in screen when shooting the first image 401, maps origin and be located in screen 201, it is no Then, mapping origin is located at outside screen 201.
In step s 304, according to the field angle in the screen imaging region and the photographing module of acquisition the first image Determine mapping coefficient.
The physical meaning of the mapping coefficient is the corresponding screen reference plane in every degree angle of the yaw angle of handheld input device X-axis picture point number and handheld input device pitch angle the corresponding screen reference plane in every degree angle Y-axis picture point number.
There are many embodiments for the determination of the mapping coefficient, in one embodiment, the calculation formula of mapping coefficient S Are as follows:
S=MaxX/ (Φ * SW/PicX) (2)
Wherein, as shown in Figure 2 and Figure 4, Φ is the horizontal field of view angle of photographing module, and MaxX is the horizontal picture point of screen 201 Number, SW are the horizontal picture point number in screen imaging region 402, and PicX is the horizontal picture point number of the first image 401.
It is noted that the mapping coefficient that formula (2) determine is simplified, can make to calculate simpler.In fact, working as When handheld input device is directed toward different location, the yaw angle or the corresponding screen of the identical angle of pitching angular variation of handheld input device The offset of the picture point number of curtain reference plane is different.It in another embodiment, is hand according to the image-forming principle of known video camera It holds being differently directed for input equipment and determines corresponding mapping coefficient.In this embodiment, determining mapping coefficient can be one The function for inputting the direction that parameter is handheld input device, is also possible to a discrete sheet, and each single item in table is a section Handheld input device direction corresponding to mapping coefficient.
It is noted that the precision of consumer level inertia motion sensor is lower, accumulated error can be generated, is periodically required to adopt Collection the first image and the parameter for updating mapping model.
According to mapping model described in mapping model embodiment one, the handheld input device is currently pointed to be mapped as The step of indicating the display position of icon is as shown in Figure 5, comprising:
In step S501, currently pointing to for the handheld input device is determined according to the mapping model.
Working as the handheld input device can be determined according to the acceleration information of handheld input device and gyro data Preceding direction, it is described currently point to include handheld input device current pitch angle PAnWith current yaw angle YAn.Its calculation method with It is identical to calculate the method that described first is directed toward.
In step S502, it is according to the angle offset for currently pointing to be directed toward relative to described first and the mapping Number currently points to the positional shift that corresponding direction position is directed toward relative to described first in corresponding direction position described in determining.
The calculation formula of the positional shift is as follows:
d_VXn=(YAn-YA0) * S, d_VYn=(PAn-PA0)*S
Wherein, (d_VXn,d_VYn) it is the positional shift, PAnAnd YAnThe respectively described pitch angle currently pointed to and Yaw angle, PA0And YA0Respectively described first pitch angle being directed toward and yaw angle, S are mapping coefficient.
It is noted that mapping coefficient S is the constant that formula (2) obtain in above-mentioned formula, if handheld input device It is differently directed different mapping coefficients, then above-mentioned formula is an integral formula or cumulative formula.
In step S503, the current of the handheld input device is determined according to the positional shift and the mapping origin It is directed toward corresponding direction position;
The calculation formula for currently pointing to corresponding direction position is as follows:
VXn=VX0+d_VXn, VYn=VY0+d_VYn
Wherein, (VXn,VYn) it is the direction position, (VX0,VY0) it is the mapping origin, (d_VXn,d_VYn) for institute State positional shift.
In step S504, the display position of the instruction icon is determined according to the direction position, wherein if described Handheld input device currently points to be directed toward in range described first, then the display position is in screen edge range It is interior.
The display position of display icon is determined according to the region where being directed toward position.If the direction position is located at screen In 201, the position in corresponding screen is arranged in the display position of the instruction icon;Otherwise, by the instruction icon Display position is arranged within the scope of preset screen edge.
Since instruction icon has a certain size, if the display position of 32x32 picture point, the instruction icon is instruction The position of the reference point of icon, the geometric center point that usually can choose instruction icon is reference point.If being directed toward position (VXn, VYn) meet condition: 0≤VXn< MaxX and 0≤VYn< MaxY, then the direction position is located in screen 201, according to the direction position There are many embodiments for the display position of determining instruction icon.A kind of embodiment is that will indicate the display position setting of icon For the direction position, i.e., instruction icon is directly shown on being directed toward position.Another embodiment is that corresponding stabilization is arranged Rule, anti-misoperation rule and error range restrictive rule etc. are directed toward position and before one in conjunction with current time Or multiple display positions be directed toward position and determine instruction icon, realize stabilization, anti-misoperation etc..
If the direction position (VXn,VYn) meet condition:: VXn< 0 or VXn>=MaxX or VYn< 0 or VYn>=MaxY, Then the direction position is located at outside screen 201, and the display position of the instruction icon is arranged within the scope of preset screen edge. By the display position setting of the instruction icon, there are many embodiments within the scope of preset screen edge:
In a kind of embodiment, preset screen edge range is screen edge, wherein the coordinate (X, Y) at screen edge Meet condition: X=0 or X=MaxX-1 or Y=0 or Y=MaxY-1.Control instructions icon it is stationary on screen edge or As the direction of handheld input device is slided on screen edge.
In another embodiment, the screen area of several picture points of pre-determined distance screen edge is screen edge range, For example, screen area of the setting one apart from 10 picture points in screen edge is screen edge range, i.e., coordinate range is X ∈ The screen area of [0,9] or X ∈ [MaxX -10, MaxX-1] or Y ∈ [0,9] or Y ∈ [MaxY -10, MaxY-1].When direction position When setting remoter apart from screen 201, the display position of set instruction icon is closer to screen edge.Under this embodiment, When the direction of handheld input device is far from or close to screen, instruction icon moves within the scope of the screen edge, reminds operation The direction of person's handheld input device is far from being also proximate to screen.
Behind the display position that instruction icon has been determined according to above-mentioned steps, which can send smart machine to Operating system, shown on the display position by operating system instruction icon, can also send on smart machine using soft Part is shown instruction icon on the display position by the application software, or can also use other way, and the application does not limit It is fixed.
The yaw angle of handheld input device and the range of pitch angle are 0-360 degree, by step S501-step S503 in Fig. 5 Shown in screen reference plane direction position calculating step it is found that if the direction of two moment handheld input devices is identical, So, direction position corresponding to the direction of the two moment handheld input devices is identical, and holding between the two moment is defeated The motion track for entering equipment is unrelated.According to this characteristic range can be divided for the direction of handheld input device.It is described hold it is defeated The range for entering the direction of equipment includes the first direction range, when the direction of the handheld input device is directed toward range described first Interior when being changed with arbitrary trajectory, the display position of the instruction icon is all within the scope of preset screen edge.
Without loss of generality, if mapping coefficient S is formula (2) resulting constant, then meet the hand-held input of following condition The direction of equipment belongs to described first and is directed toward range:
PA<PA0-VY0/ S or PA >=PA0+(MaxY-VY0)/S, alternatively,
YA<YA0-VX0/ S or YA >=YA0+(MaxX-VX0)/S(3)
It is noted that the range of the yaw angle PA and pitch angle YA of handheld input device are 0-360 degree, in order to make to express Formula is concise, does not handle the boundary condition for 0 ° and 360 ° in above-mentioned expression formula.
Step S501-step S503 according to Fig.5, the direction in the first direction range shown in formula (3) are reflected The range for the direction position penetrated are as follows: VX<0 or VX>=MaxX or VY<0 or VY>=MaxY, it is seen that be entirely located in outside screen, according to step The display position of rapid S504, the first corresponding instruction icon of direction being directed toward in range are all disposed within preset screen edge range It is interior.Therefore, when the direction of the handheld input device is changed in the first direction range with arbitrary trajectory, the instruction The display position of icon will not remove preset screen edge range.
It is worth noting that the first direction range generally comprises the direction of most of handheld input device, wherein packet Include direction when direction and operator when handheld input device is directed toward ground are turned round back to screen.
Mapping model embodiment two:
The mapping model of the present embodiment is a threedimensional model.The position of screen in three dimensions and hand-held input are set Standby direction in three dimensions carries out three-dimensional modeling, which is the mapping model of the present embodiment.For establishing three The data of dimension module can be the first image of the direction of the handheld input device as captured by the photographing module of handheld input device; Photographic device can also be set in the external environment of handheld input device, shoot the direction of handheld input device for establishing three Dimension module.There are many known three-dimensional modeling methods, such as monocular vision three-dimensional modeling, binocular vision 3 D modeling or depth to take the photograph As head three-dimensional modeling etc., repeat no more.
In the three-dimensional model, curved surface can be modeled, therefore screen reference plane 202 can be plane, be also possible to Curved surface, can get the intersection point of the direction line 204 and screen reference plane 202 of handheld input device according to threedimensional model, which is For the direction position of screen reference plane corresponding to the direction, the intersection point for being directed toward line 204 and screen reference plane is located at outside screen 201 Direction belong to the first direction range.
The mapping model of the present embodiment can model curve screens, but more demanding to the calculated performance of system, fit For the handheld input device that computing capability is strong and battery capacity is big.
In step s 102, the display position of instruction icon is determined according to the mapping model.
According to mapping model disclosed in the present application, step, handheld input device can be currently pointed to according to Fig.5, It is mapped as the display position of instruction icon.In the mapping model, the range of the direction of handheld input device includes the first finger To range.If handheld input device currently points to belong to the first direction range, corresponding instruction figure is currently pointed to Target display position is located within the scope of preset screen edge.
In step s 103, when the instruction icon moves within the scope of the screen edge, the instruction icon is detected Duration for being within the scope of the screen edge of display position whether be greater than preset first threshold, if described lasting Time is greater than the first threshold, then indicates icon described in blanking.
According to the mapping model, if the direction of handheld input device moves into described first outside the first direction range It is directed toward in range, then the instruction icon moves within the scope of preset screen edge, and the direction of handheld input device refers to first Changed into range with arbitrary trajectory, instruction icon all remains displayed within the scope of the screen edge, when detecting the instruction The display position of icon is in the duration within the scope of the screen edge greater than preset first threshold, such as 1.5 seconds, then Icon is indicated described in blanking.
In the blanking control method of the instruction icon of the application, a mapping model is established, it can according to the mapping model The direction of handheld input device is mapped as to the display position of instruction icon.In the mapping model, handheld input device The range of direction includes the first direction range, is directed toward the display position of the direction mapped instruction icon in range all first , which means that the direction of handheld input device is directed toward in range first with any rail within the scope of preset screen edge Mark changes, and instruction icon can remain displayed within the scope of preset screen edge.This point is the instruction icon of the application Display position determine that the display position of the cursor of mouse of method and the prior art determines the fundamental difference point of method.The prior art The display position of cursor of mouse determine method are as follows: move mouse along a direction, cursor of mouse made to move to screen edge, after Continuous to move mouse along the direction, cursor of mouse can remain displayed in screen edge, but when mouse moves in opposite direction, Cursor of mouse can move in screen at once.Therefore, method, hand are determined according to the display position of the instruction icon of conventional mouse The all possible control instructions icon of all directions for holding input equipment moves in screen, can make to indicate that icon is protected there is no one Hold the direction range within the scope of screen edge.Method is determined using the display position of the instruction icon of the application, holds input The range of the direction of equipment include first be directed toward range, wherein first direction range generally include speaker's hand it is sagging or turn Carry the direction of handheld input device when to screen on the body, therefore, in operation, it is aobvious that speaker need to only click activation key triggering Show instruction icon, when no longer needing to show instruction icon, subordinate is hung down or is turned round towards spectators, indicates that icon can keep aobvious Show within the scope of screen edge, when reaching time-out time, such as 1.5 seconds, it can blanking instruction icon.The blanking control of the application Especially suitable for digital radio demonstration device, speaker does not need to continue push button exciting instruction icon method processed during speech, It indicates that the blanking control of icon is unsophisticated, meets the motor habit of speaker in speech, be conducive to improve user experience.
It should be understood that the size of the serial number of each step is not meant that the order of the execution order in above-described embodiment, each process Execution sequence should be determined by its function and internal logic, the implementation process without coping with the embodiment of the present application constitutes any limit It is fixed.
Fig. 6 is a kind of structure of the blanking control device of the instruction icon of handheld input device provided by the embodiments of the present application Schematic diagram.Wherein, the blanking control device of the instruction icon of the handheld input device includes:
Mapping model establishes unit 601, and for establishing mapping model, the mapping model is used to set the hand-held input Standby direction is mapped as the display position of the instruction icon, wherein in the mapping model, the finger of the handheld input device To range include first be directed toward range, when the handheld input device direction it is described first be directed toward range in any rail When mark changes, the display position of the instruction icon is all within the scope of preset screen edge;
Display position determination unit 602, for determining the display position of the instruction icon according to the mapping model;
Blanking control unit 603, for detecting the finger when the instruction icon moves within the scope of the screen edge Whether the duration that diagram target display position is within the scope of the screen edge is greater than preset first threshold, if institute The duration is stated greater than the first threshold, then indicates icon described in blanking.
Preferably, the parameter of the mapping model includes the first direction, mapping origin and mapping coefficient.
Preferably, the mapping model establishes unit 601 and includes:
First is directed toward setting subelement, described hand-held when being arranged to set up the mapping model for being directed toward described first The direction of input equipment, the direction of the handheld input device include the yaw angle and pitch angle of the handheld input device;
It maps origin and subelement is set, for setting preset screen position for the mapping origin;
Subelement is arranged in mapping coefficient, for setting preset value for the mapping coefficient, or according to it is described hold it is defeated Enter equipment and determines the mapping coefficient at a distance from screen.
Preferably, the mapping model establishes unit 601 and includes:
Screen imaging region recognition subelement, the first image being directed toward for acquiring the handheld input device, extracts institute The characteristics of image for stating the first image matches the characteristics of image of the first image with the screen characteristics prefetched, and identification exists Screen imaging region in the first image.
Parameter determines subelement, for determining the parameter of the mapping model according to the screen imaging region, wherein institute State the first direction for being oriented to handheld input device when acquisition the first image, the direction packet of the handheld input device The yaw angle and pitch angle of the handheld input device are included, the mapping origin is according to the screen imaging region described first Position in image is determined that the mapping coefficient is according to the screen imaging region and the camera shooting mould for acquiring the first image The field angle of block is determined.
Preferably, the mapping model establishes unit 601 further include:
Second Image Acquisition subelement, for acquiring the second image of display on the screen;
Screen characteristics extract subelement, for extracting the characteristics of image of second image, wherein second image Characteristics of image is the screen characteristics prefetched.
Preferably, the display position determination unit 602 includes:
It currently points to determine subelement, for determining currently pointing to for the handheld input device;
Positional shift determines subelement, for currently pointed to according to relative to it is described first be directed toward angle offset and The mapping coefficient currently points to corresponding direction position relative to the corresponding direction position of first direction described in determining Positional shift;
It is directed toward position and determines subelement, for determining the hand-held input according to the positional shift and the mapping origin Equipment currently points to corresponding direction position;
Display position determines subelement, determines the instruction icon for currently pointing to corresponding direction position according to Display position, wherein if the handheld input device currently point to it is described first be directed toward range in, the display Position is within the scope of the screen edge.
The blanking control device of the instruction icon of handheld input device described in Fig. 6, the finger with handheld input device described in Fig. 1 Diagram target blanking control method is corresponding.
The electronic equipment that herein described blanking control method is related to has handheld input device, smart machine and display to set It is standby, it is also possible to have other electronic equipments, the data processing equipment such as between smart machine and display equipment.It is herein described to disappear Hidden control method can be implemented by the operating system or application program of above-mentioned associated electronic device, can also be by portable Storage equipment stores the program of the control method, when the portable memory apparatus is connected to above-mentioned relevant device, triggering The program that above-mentioned relevant device executes the control method is implemented.Above-mentioned smart machine can be desktop computer, mobile phone, plate electricity The electronic equipments such as brain, embedded device and cloud computing equipment.
The modules of herein described blanking control device are in above-mentioned handheld input device, smart machine, display equipment And the specific deployment way in data processing equipment, the application are not construed as limiting.At above-mentioned smart machine, display equipment and data Reason equipment can be independent equipment, be also possible to integrated integration apparatus.Connection type between above equipment can be Wired connection is also possible to be wirelessly connected.
Fig. 7 is the schematic diagram for the handheld input device that one embodiment of the application provides.As shown in fig. 7, the hand of the embodiment Input equipment 7 is held to include: processor 70, memory 71 and be stored in the memory 71 and can be on the processor 70 The computer program 72 of operation, such as the blanking for indicating icon of handheld input device control program.The processor 70 executes It is realized when the computer program 72 in the blanking control method embodiment of instruction icon of above-mentioned each handheld input device Step.Alternatively, the processor 70 realizes each module/unit in above-mentioned each Installation practice when executing the computer program 72 Function.
Illustratively, the computer program 72 can be divided into one or more module/units, it is one or Multiple module/units are stored in the memory 71, and are executed by the processor 70, to complete the application.Described one A or multiple module/units can be the series of computation machine program instruction section that can complete specific function, which is used for Implementation procedure of the computer program 72 in the handheld input device 7 is described.For example, the computer program 72 can be with It is divided into:
Mapping model establishes unit, and for establishing mapping model, the mapping model is used for the handheld input device Direction be mapped as it is described instruction icon display position, wherein in the mapping model, the direction of the handheld input device Range include first be directed toward range, when the handheld input device direction it is described first be directed toward range in arbitrary trajectory When change, the display position of the instruction icon is all within the scope of preset screen edge;
Display position determination unit, for determining the display position of the instruction icon according to the mapping model;
Blanking control unit, for detecting the instruction when the instruction icon moves within the scope of the screen edge Whether the duration that the display position of icon is within the scope of the screen edge is greater than preset first threshold, if described Duration is greater than the first threshold, then indicates icon described in blanking.
The handheld input device may include, but be not limited only to, processor 70, memory 71.Those skilled in the art can To understand, Fig. 7 is only the example of handheld input device 7, does not constitute the restriction to handheld input device 7, may include ratio More or fewer components are illustrated, certain components or different components are perhaps combined, such as the handheld input device may be used also To include input-output equipment, network access equipment, bus etc..Handheld input device can be an equipment, can also be by one A above sub- equipment composition separated, such as handheld input device includes two sub- equipment, one of them sub- equipment is by operator Hand-held, another sub- equipment are used for the analysis of the first image, and two sub- equipment rooms are realized with wireless telecommunications and connected.
Alleged processor 70 can be central processing unit (Central Processing Unit, CPU), can also be Other general processors, digital signal processor (Digital Signal Processor, DSP), specific integrated circuit (Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field- Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic, Discrete hardware components etc..General processor can be microprocessor or the processor is also possible to any conventional processor Deng.
The memory 71 can be the internal storage unit of the handheld input device 7, such as handheld input device 7 Hard disk or memory.The memory 71 is also possible to the External memory equipment of the handheld input device 7, for example, it is described hold it is defeated Enter the plug-in type hard disk being equipped in equipment 7, intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card, flash card (Flash Card) etc..Further, the memory 71 can also both include described hand-held The internal storage unit of input equipment 7 also includes External memory equipment.The memory 71 is for storing the computer program And other programs and data needed for the handheld input device.The memory 71 can be also used for temporarily storing Output or the data that will be exported.
It is apparent to those skilled in the art that for convenience of description and succinctly, only with above-mentioned each function Can unit, module division progress for example, in practical application, can according to need and by above-mentioned function distribution by different Functional unit, module are completed, i.e., the internal structure of described device is divided into different functional unit or module, more than completing The all or part of function of description.Each functional unit in embodiment, module can integrate in one processing unit, can also To be that each unit physically exists alone, can also be integrated in one unit with two or more units, it is above-mentioned integrated Unit both can take the form of hardware realization, can also realize in the form of software functional units.In addition, each function list Member, the specific name of module are also only for convenience of distinguishing each other, the protection scope being not intended to limit this application.Above system The specific work process of middle unit, module, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, is not described in detail or remembers in some embodiment The part of load may refer to the associated description of other embodiments.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure Member and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed Scope of the present application.
In embodiment provided herein, it should be understood that disclosed device/terminal device and method, it can be with It realizes by another way.For example, device described above/terminal device embodiment is only schematical, for example, institute The division of module or unit is stated, only a kind of logical function partition, there may be another division manner in actual implementation, such as Multiple units or components can be combined or can be integrated into another system, or some features can be ignored or not executed.Separately A bit, shown or discussed mutual coupling or direct-coupling or communication connection can be through some interfaces, device Or the INDIRECT COUPLING or communication connection of unit, it can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme 's.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list Member both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated module/unit be realized in the form of SFU software functional unit and as independent product sale or In use, can store in a computer readable storage medium.Based on this understanding, the application realizes above-mentioned implementation All or part of the process in example method, can also instruct relevant hardware to complete, the meter by computer program Calculation machine program can be stored in a computer readable storage medium, the computer program when being executed by processor, it can be achieved that on The step of stating each embodiment of the method.Wherein, the computer program includes computer program code, the computer program generation Code can be source code form, object identification code form, executable file or certain intermediate forms etc..The computer-readable medium It may include: any entity or device, recording medium, USB flash disk, mobile hard disk, magnetic that can carry the computer program code Dish, CD, computer storage, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium etc..It should be noted that described The content that computer-readable medium includes can carry out increasing appropriate according to the requirement made laws in jurisdiction with patent practice Subtract, such as in certain jurisdictions, according to legislation and patent practice, computer-readable medium do not include be electric carrier signal and Telecommunication signal.
Embodiment described above is only to illustrate the technical solution of the application, rather than its limitations;Although referring to aforementioned reality Example is applied the application is described in detail, those skilled in the art should understand that: it still can be to aforementioned each Technical solution documented by embodiment is modified or equivalent replacement of some of the technical features;And these are modified Or replacement, the spirit and scope of each embodiment technical solution of the application that it does not separate the essence of the corresponding technical solution should all Comprising within the scope of protection of this application.

Claims (14)

1. a kind of blanking control method of the instruction icon of handheld input device, which is characterized in that the handheld input device Indicate icon blanking control method include:
Mapping model is established, the mapping model is used to for the direction of the handheld input device being mapped as the instruction icon Display position, wherein in the mapping model, the range of the direction of the handheld input device includes the first direction range, when When the direction of the handheld input device is changed in the first direction range with arbitrary trajectory, the display of the instruction icon Position is all within the scope of preset screen edge;
The display position of the instruction icon is determined according to the mapping model;
When the instruction icon moves within the scope of the screen edge, the display position for detecting the instruction icon is in described Whether the duration within the scope of screen edge is greater than preset first threshold, if the duration is greater than first threshold Value, then indicate icon described in blanking.
2. the blanking control method of the instruction icon of handheld input device according to claim 1, which is characterized in that described The parameter of mapping model includes the first direction, mapping origin and mapping coefficient.
3. the blanking control method of the instruction icon of handheld input device according to claim 2, which is characterized in that described First is oriented to the direction of handheld input device when establishing the mapping model, and the direction of the handheld input device includes The yaw angle and pitch angle of the handheld input device;
The mapping origin is preset screen position;
The mapping coefficient determines at a distance from screen by preset value or according to the handheld input device.
4. the blanking control method of the instruction icon of handheld input device according to claim 2, which is characterized in that described The step of establishing the mapping model include:
The first image that the handheld input device is directed toward is acquired, the characteristics of image of the first image is extracted, by described first The characteristics of image of image is matched with the screen characteristics prefetched, identifies the screen imaging region in the first image.
The parameter of the mapping model is determined according to the screen imaging region, wherein described first is oriented to acquisition described the The direction of handheld input device when one image, the direction of the handheld input device include the inclined of the handheld input device Boat angle and pitch angle, the mapping origin determined according to position of the screen imaging region in the first image, institute Mapping coefficient is stated to be determined according to the field angle in the screen imaging region and the photographing module of acquisition the first image.
5. the blanking control method of the instruction icon of handheld input device according to claim 4, which is characterized in that described The step of establishing mapping model further include:
The second image of acquisition display on the screen;
Extract the characteristics of image of second image, wherein the characteristics of image of second image is that the screen prefetched is special Sign.
6. the blanking control method of the instruction icon of handheld input device according to claim 2, which is characterized in that according to The mapping model determines that the step of display position of the instruction icon includes:
Determine currently pointing to for the handheld input device;
The current finger is determined according to the angle offset and the mapping coefficient for currently pointing to be directed toward relative to described first The corresponding positional shift for being directed toward position is directed toward relative to described first to corresponding direction position;
Corresponding direction position is currently pointed to according to what the positional shift and the mapping origin determined the handheld input device It sets;
According to the display position for currently pointing to corresponding direction position and determining the instruction icon, wherein if the hand Hold input equipment currently point to it is described first be directed toward range in, then the display position is in screen edge range It is interior.
7. a kind of blanking control device of the instruction icon of handheld input device, which is characterized in that the handheld input device Indicate icon blanking control device include:
Mapping model establishes unit, and for establishing mapping model, the mapping model is used for the finger of the handheld input device To the display position for being mapped as the instruction icon, wherein in the mapping model, the model of the direction of the handheld input device It encloses and is directed toward range including first, when the direction of the handheld input device is changed in the first direction range with arbitrary trajectory When, the display position of the instruction icon is all within the scope of preset screen edge;
Display position determination unit, for determining the display position of the instruction icon according to the mapping model;
Blanking control unit, for detecting the instruction icon when the instruction icon moves within the scope of the screen edge Duration for being within the scope of the screen edge of display position whether be greater than preset first threshold, if described lasting Time is greater than the first threshold, then indicates icon described in blanking.
8. the blanking control device of the instruction icon of handheld input device according to claim 7, which is characterized in that described The parameter of mapping model includes the first direction, mapping origin and mapping coefficient.
9. the blanking control device of the instruction icon of handheld input device according to claim 8, which is characterized in that described Mapping model establishes unit
First is directed toward setting subelement, hand-held input when being arranged to set up the mapping model for being directed toward described first The direction of equipment, the direction of the handheld input device include the yaw angle and pitch angle of the handheld input device;
It maps origin and subelement is set, for setting preset screen position for the mapping origin;
Subelement is arranged in mapping coefficient, sets for setting preset value for the mapping coefficient, or according to the hand-held input It is standby that the mapping coefficient is determined at a distance from screen.
10. the blanking control device of the instruction icon of handheld input device according to claim 8, which is characterized in that institute It states mapping model and establishes unit and include:
Screen imaging region recognition subelement, the first image being directed toward for acquiring the handheld input device extract described the The characteristics of image of one image matches the characteristics of image of the first image with the screen characteristics prefetched, identifies described Screen imaging region in first image.
Parameter determines subelement, for determining the parameter of the mapping model according to the screen imaging region, wherein described One is oriented to the direction of handheld input device when acquisition the first image, and the direction of the handheld input device includes institute The yaw angle and pitch angle of handheld input device are stated, the mapping origin is according to the screen imaging region in the first image In position determined that the mapping coefficient is according to the photographing module in the screen imaging region and acquisition the first image Field angle is determined.
11. the blanking control device of the instruction icon of handheld input device according to claim 10, which is characterized in that institute It states mapping model and establishes unit further include:
Second Image Acquisition subelement, for acquiring the second image of display on the screen;
Screen characteristics extract subelement, for extracting the characteristics of image of second image, wherein the image of second image Feature is the screen characteristics prefetched.
12. the blanking control device of the instruction icon of handheld input device according to claim 8, which is characterized in that institute Stating display position determination unit includes:
It currently points to determine subelement, for determining currently pointing to for the handheld input device;
Positional shift determines subelement, the angle offset and described for currently pointing to be directed toward relative to described first according to Mapping coefficient currently points to the position that corresponding direction position is directed toward relative to described first in corresponding direction position described in determining Offset;
It is directed toward position and determines subelement, for determining the handheld input device according to the positional shift and the mapping origin Currently point to corresponding direction position;
Display position determines subelement, determines the aobvious of the instruction icon for currently pointing to corresponding direction position according to Show position, wherein if the handheld input device currently points to be directed toward in range described first, the display position Within the scope of the screen edge.
13. a kind of handheld input device, including memory, processor and storage are in the memory and can be in the processing The computer program run on device, which is characterized in that the processor realizes such as claim 1 when executing the computer program To the instruction icon of any one of 6 handheld input devices blanking control method the step of.
14. a kind of computer readable storage medium, the computer-readable recording medium storage has computer program, and feature exists In the instruction of realization handheld input device as described in any one of claim 1 to 6 when the computer program is executed by processor The step of blanking control method of icon.
CN201910603013.0A 2019-07-05 2019-07-05 A kind of handheld input device and its blanking control method and device for indicating icon Pending CN110489026A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201910603013.0A CN110489026A (en) 2019-07-05 2019-07-05 A kind of handheld input device and its blanking control method and device for indicating icon
PCT/CN2020/100299 WO2021004413A1 (en) 2019-07-05 2020-07-04 Handheld input device and blanking control method and apparatus for indication icon of handheld input device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910603013.0A CN110489026A (en) 2019-07-05 2019-07-05 A kind of handheld input device and its blanking control method and device for indicating icon

Publications (1)

Publication Number Publication Date
CN110489026A true CN110489026A (en) 2019-11-22

Family

ID=68546629

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910603013.0A Pending CN110489026A (en) 2019-07-05 2019-07-05 A kind of handheld input device and its blanking control method and device for indicating icon

Country Status (2)

Country Link
CN (1) CN110489026A (en)
WO (1) WO2021004413A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021004412A1 (en) * 2019-07-05 2021-01-14 深圳市格上格创新科技有限公司 Handheld input device, and method and apparatus for controlling display position of indication icon thereof
WO2021004413A1 (en) * 2019-07-05 2021-01-14 深圳市格上格创新科技有限公司 Handheld input device and blanking control method and apparatus for indication icon of handheld input device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101075173A (en) * 2006-09-14 2007-11-21 腾讯科技(深圳)有限公司 Display device and method
CN101606120A (en) * 2007-12-07 2009-12-16 索尼株式会社 Control device, input media, control system, control method and hand-held device
CN103425408A (en) * 2012-05-23 2013-12-04 深圳富泰宏精密工业有限公司 Mouse and keyboard sharing method and system
CN103902061A (en) * 2012-12-25 2014-07-02 华为技术有限公司 Air mouse cursor display method, device and system
CN106774868A (en) * 2016-12-06 2017-05-31 杨超峰 A kind of wireless demo device
CN108848374A (en) * 2018-08-08 2018-11-20 京东方科技集团股份有限公司 Display parameters measurement method and its device, storage medium and measuring system

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101398721A (en) * 2007-09-26 2009-04-01 昆盈企业股份有限公司 Control method for moving speed of cursor of air mouse
US20100182232A1 (en) * 2009-01-22 2010-07-22 Alcatel-Lucent Usa Inc. Electronic Data Input System
JP2010282408A (en) * 2009-06-04 2010-12-16 Sony Corp Control device, input device, control system, hand-held device, and control method
CN110489027B (en) * 2019-07-05 2021-07-23 深圳市格上格创新科技有限公司 Handheld input device and display position control method and device of indication icon of handheld input device
CN110489026A (en) * 2019-07-05 2019-11-22 深圳市格上格创新科技有限公司 A kind of handheld input device and its blanking control method and device for indicating icon

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101075173A (en) * 2006-09-14 2007-11-21 腾讯科技(深圳)有限公司 Display device and method
CN101606120A (en) * 2007-12-07 2009-12-16 索尼株式会社 Control device, input media, control system, control method and hand-held device
CN103425408A (en) * 2012-05-23 2013-12-04 深圳富泰宏精密工业有限公司 Mouse and keyboard sharing method and system
CN103902061A (en) * 2012-12-25 2014-07-02 华为技术有限公司 Air mouse cursor display method, device and system
CN106774868A (en) * 2016-12-06 2017-05-31 杨超峰 A kind of wireless demo device
CN108848374A (en) * 2018-08-08 2018-11-20 京东方科技集团股份有限公司 Display parameters measurement method and its device, storage medium and measuring system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
肖波: "《电脑常用小技巧(上)》", 《第二课堂:初中版》 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021004412A1 (en) * 2019-07-05 2021-01-14 深圳市格上格创新科技有限公司 Handheld input device, and method and apparatus for controlling display position of indication icon thereof
WO2021004413A1 (en) * 2019-07-05 2021-01-14 深圳市格上格创新科技有限公司 Handheld input device and blanking control method and apparatus for indication icon of handheld input device

Also Published As

Publication number Publication date
WO2021004413A1 (en) 2021-01-14

Similar Documents

Publication Publication Date Title
CN108525298B (en) Image processing method, image processing device, storage medium and electronic equipment
KR100851977B1 (en) Controlling Method and apparatus for User Interface of electronic machine using Virtual plane.
CN110456907A (en) Control method, device, terminal device and the storage medium of virtual screen
CN110489027A (en) Handheld input device and its display position control method and device for indicating icon
US20150062004A1 (en) Method and System Enabling Natural User Interface Gestures with an Electronic System
WO2021097600A1 (en) Inter-air interaction method and apparatus, and device
JP6390799B2 (en) Input device, input method, and program
US8416189B2 (en) Manual human machine interface operation system and method thereof
JP2016194799A (en) Image analyzer and image analysis method
TWI701941B (en) Method, apparatus and electronic device for image processing and storage medium thereof
JP6344530B2 (en) Input device, input method, and program
CN104081307A (en) Image processing apparatus, image processing method, and program
US20220317776A1 (en) Methods for manipulating objects in an environment
US20180032139A1 (en) Interactive system control apparatus and method
US11188144B2 (en) Method and apparatus to navigate a virtual content displayed by a virtual reality (VR) device
TW201737023A (en) Information processing system, information processing device, control method, and program
CN109992175B (en) Object display method, device and storage medium for simulating blind feeling
US8643679B2 (en) Storage medium storing image conversion program and image conversion apparatus
CN113538696A (en) Special effect generation method and device, storage medium and electronic equipment
CN107797648B (en) Virtual touch system, image recognition positioning method and computer-readable storage medium
CN110489026A (en) A kind of handheld input device and its blanking control method and device for indicating icon
CN110908517B (en) Image editing method, image editing device, electronic equipment and medium
CN106569716B (en) Single-hand control method and control system
CN105302310B (en) A kind of gesture identifying device, system and method
CN109816723A (en) Method for controlling projection, device, projection interactive system and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20191122