CN110502130A

CN110502130A - Input unit and the method for controlling demo system and its shown label with input unit

Info

Publication number: CN110502130A
Application number: CN201910418802.7A
Authority: CN
Inventors: 让-克里斯托佩·黑梅斯; 帕特里克·萨拉明; 克里斯·马斯林; 奥利维耶·泰塔斯
Original assignee: Logitech Europe SA
Current assignee: Logitech Europe SA
Priority date: 2018-05-18
Filing date: 2019-05-20
Publication date: 2019-11-26
Also published as: DE102019113133A1

Abstract

This disclosure relates to input unit and the method for controlling demo system and its shown label with input unit.Describe a kind of for controlling by the input unit of the label shown in demo system, which includes: device housing；Wireless communication unit is configured to establish radio communication channel between input unit and demo system；Inertial sensor is configured to monitor rotation of the input unit relative to the inertial reference system by orthogonal first axle, the second axis and third axis limit；And processor, it is configured to the generating for being transmitted to demo system by wireless communication unit to adjust the signal of the attribute of label when rotating more than threshold value around first axle when input unit, and wherein threshold value is changed based on what is detected relative to the rotation amount of the second axis and third axis.

Description

Input unit and the method for controlling demo system and its shown label with input unit

Cross reference to related applications

The application is non-provisional application, and requires the U.S. non-provisional application the 15/th submitted on December 22nd, 2016 389, No. 232 equity and priority, this application require entitled " the HAND-HELD INPUT submitted on December 16th, 2016 U.S. Provisional Application No. 62/435,378 priority of DEVICE ", entire contents are incorporated herein by reference to be used for All purposes.

Technical field

The various aspects of present disclosure relate generally to input unit, more particularly, to control the hand of the various aspects of demonstration Hold input unit.

Background technique

In decades, the demonstration based on lantern slide is always the mainstay of office space.Technology is from the rotation of early stage Rotatable slide projector and single page transparent projection instrument develop into using contemporary software such asDeng modern digital demonstration.

Up to date, most of demonstrations need people to keep the desktop computer or meter on knee that are bound by operation demoware Calculation machine, with using input unit (for example, computer mouse, touch tablet, arrow key etc.) manually control demonstration process (for example, Forward, suspend or return to previous lantern slide).This may have an adverse effect to the quality and dynamic of good demonstration, because It can not get around for demonstrator and sufficiently be interacted with spectators.Even if in second people's operating software and demonstrator can be freely In the case where walking about in the room, often have to remind operator that change lantern slide may strangle continuity and may make Viewer diverts one's attention.

Newer exploitation includes Multifunctional demonstration device (for example, hand-held input device), can enable demonstrator Execute simple functions such as lantern slide advance, laser alignment and long range.However, many devices in these devices are with non-straight The interface of sight or confusion, cumbersome button arrangement, complicated programming protocol or compatibility issue.Need preferably hand-held input dress It sets.

Summary of the invention

In some embodiments, a method of computer implementation includes: detection just in the display of host computing device The first window of upper display；Detect the graphical content on first window；The second window is generated on the display of host computing device (coating), wherein coating is configured in the Window layer above first window；And based on the first window detected Graphical content changes the graphical quality of coating.The graphical quality of coating may include the shape, size, face of coating At least one of color, transparency or opacity.This method can also include: the movement of reception and cursor on first window Corresponding input data；The first transparency is set by the transparency in the region around cursor；And by coating remaining Partial transparency is set as the second transparency, so that the region around cursor seems to highlight the figure on first window The corresponding region of content.

In some embodiments, this method can also comprise determining that associated with the graphical content on first window Color；Contrastive colours are determined based on determining color；And set true for at least part of color in the region around cursor Fixed contrastive colours.Alternatively or in addition, this method may include: that reception is corresponding with movement of the cursor on first window Input data；Limit the region around cursor；Determine one kind associated with the graphical content in the limited area around cursor Or more color；Determine one or more of colors associated with the graphical content outside the limited area around cursor；Really Associated one or more colors of the graphical content in limited area around fixed and cursor and and cursor around restriction The associated visibility factor of difference between the associated one or more of colors of graphical content outside region；And it is based on The color in the region in limited area around determining visibility factor setting cursor.

In some implementations, this method may include: the optional element in test pattern content；Determine optional element Shape；The first transparency is set by the transparency in the region around optional element；And by the rest part of coating Transparency is set as the second transparency, so that the region around optional element seems to be highlighted.In some cases, may be used Element is selected to can be the first optional element, and this method can also include: the second optional element in test pattern content；It connects Receive input data corresponding with movement of the cursor on first window；And the first optional element of mobile selection based on cursor Or second one of the optional element, wherein by selected first optional element or second optional yuan is applied to the setting of transparency Element.Alternatively or in addition, optional element can be the first optional element, and this method can also include: in test pattern The second optional element in appearance；Determine the position of the first optional element and the second optional element；It receives and cursor is in first window On the corresponding input data of movement；Determine cursor and the distance between the first optional element and the second optional element；And The first optional element or the second optional element are selected based on the respective distance of the first optional element and the second optional element and cursor One of.

In some embodiments, this method may include: the optional element in test pattern content；Detection is included in can Select the daughter element in element；Determine the shape of daughter element；Is set by the transparency in the region on coating around daughter element One transparency；And the second transparency is set by the transparency of the rest part of coating, so that the region around daughter element Seem to be highlighted.This method can also comprise determining that the shape of optional element；Input data is received from input unit； And switched between optional element and daughter element based on the received input data of institute from input unit highlighting, wherein When optional element is highlighted, this method may include that the transparency in the region on coating around optional element is arranged For the first transparency, and the second transparency is set by the transparency of the rest part of coating, so that around optional element Region seems to be highlighted.

In some embodiments, daughter element can be the first daughter element, and this method can also include: that detection is optional Second daughter element of element；Receive input data corresponding with movement of the cursor on first window；And based on cursor Mobile selection one of the first daughter element or the second daughter element, wherein by selected first son member is applied to the setting of transparency Element or the second daughter element.Alternatively or in addition, this method may include detecting the second daughter element of optional element；It is filled from input Set reception input data；And it is cut between the first daughter element or the second daughter element based on the input data from input unit It changes, wherein by selected first daughter element or the second daughter element is applied to the setting of transparency.

In some embodiments, a kind of for establishing the computer implemented system being wirelessly connected with mobile input device It include: one or more processors and one or more non-transient computer readable storage mediums, this is one or more Non-transient computer readable storage medium includes to be configured to that one or more processors is made to execute the following instruction operated, behaviour Work includes: the first window that detection is just being shown on the display of host computing device；Detect the graphical content on first window；In The second window (coating) is generated on the display of host computing device, wherein coating is configured in the window above first window On layer；And the graphical content based on the first window detected changes the graphical quality of coating.The graphical quality of coating It may include at least one of shape, size, color, transparency or the opacity of coating.Alternatively or in addition, one A or more non-transient computer readable storage medium also includes to be configured to keep one or more processors execution following The instruction of operation, operation include: reception input data corresponding with movement of the cursor on first window；Around cursor The transparency in region is set as the first transparency；And the second transparency is set by the transparency of the rest part of coating, So that the region around cursor seems to highlight the corresponding region of the graphical content on first window.Instruction can also be matched Being set to makes one or more processors execute following operation, and operation includes: the optional element in test pattern content；Determination can Select the shape of element；The first transparency is set by the transparency in the region around optional element；And by coating remaining Partial transparency is set as the second transparency, so that the region around optional element seems to be highlighted.

In other embodiment, it is a kind of visibly implement it is non-transient in machine readable non-transient storage media Computer program product may include the instruction for being configured to perform the following operation one or more processors: detection is just The first window shown on the display of host computing device；Detect the graphical content on first window；In host computing device The second window (coating) is generated on display, wherein coating is configured in the Window layer above first window；And base Change the graphical quality of coating in the graphical content of the first window detected.The graphical quality of coating may include covering At least one of shape, size, color, transparency or the opacity of layer.Instruction can be configured to make one or more Multiple processors execute following operation: receiving input data corresponding with movement of the cursor on first window；By cursor week The transparency in the region enclosed is set as the first transparency；And by the transparency of the rest part of coating to set second transparent Degree, so that the region around cursor seems to highlight the corresponding region of the graphical content on first window.As an alternative or separately Other places, instruction can be configured to perform the following operation one or more processors: optional in test pattern content Element；Determine the shape of optional element；The first transparency is set by the transparency in the region around optional element；And it will cover The transparency of the rest part of cap rock is set as the second transparency so that the region around optional element seem to be highlighted it is aobvious Show.

In some embodiments, a kind of input unit may include following: wireless communication unit is configured to defeated Enter and establishes radio communication channel between device and demo system for controlling vision demonstration；Inertial sensor is configured to Monitor rotation of the input unit relative to the inertial reference system by orthogonal first axle, the second axis and third axis limit；Processor, It is configured in response to input unit and is more than threshold value around the rotation of first axle and generates the first signal, which is used for Demo system is transmitted to by wireless communication unit to adjust by the perceptual property of the display label of input unit control, threshold value is based on What is detected changes relative to the rotation amount of the second axis or third axis, and processor is further configured to when being less than threshold value Second signal is generated, which is used to be transmitted to the demo system for controlling vision demonstration by wireless communication unit, with According to around the position of the second axis and the rotation adjustment display label of third axis；And device housing, surround wireless communication part Part, inertial sensor and processor.

In other embodiment, a kind of side for using input unit control by the label shown in demo system Method, this method comprises: establishing radio communication channel between input unit and demo system；At the user control of input unit Receive user's input；First control signal is sent to demo system to change the size of label；Continue to receive at user control User's input；And second control signal is sent to demo system and is being shown with changing in response to the threshold value for reaching user's input The type of the label shown.

In some embodiments, a method of for controlling demo system using input unit, comprising: filled in input It sets and establishes radio communication channel between demo system；In response to the rotation of input unit, the display across demo system is transferred The label for highlighting region of display including demo system；And make in response to receiving input at user control The position marked on display is freezed, so that no longer across the display transfer label of the rotation of input unit.

Detailed description of the invention

Detailed description is illustrated referring to attached drawing.

Figure 1A to Fig. 1 D shows the view of the different embodiments of ambulatory handheld input unit.

Fig. 2 shows the ambulatory handhelds for being configured for carrying out multi-connection with multiple master devices according to certain embodiments Input unit.

Fig. 3 is the various aspects that the method being wirelessly connected is established with mobile input device shown according to certain embodiments Simplified flowchart.

Fig. 4 is shown according to certain embodiments for operating the side of the ambulatory handheld input unit with power saving features The flow chart of the various aspects of method.

Fig. 5 shows the various aspects for not interrupting display according to certain embodiments.

Fig. 6 shows the aspect of the level of display window on the configuration display according to certain embodiments.

Fig. 7 is the various aspects for showing the method for the level of display window on the configuration computing device according to certain embodiments Simplified flowchart.

Fig. 8 A shows the various aspects for highlighting function in the demonstration application according to certain embodiments.

Fig. 8 B shows the various aspects of the zoom function in the demonstration application according to certain embodiments.

Fig. 9 A shows automatically configuring for the input unit of the content based on display according to certain embodiments.

Fig. 9 B shows automatically configuring for the input unit of the content based on display according to certain embodiments.

Figure 10 is the side that input unit is automatically configured for the content based on display shown according to certain embodiments The simplified flowchart of the various aspects of method.

Figure 11 is shown according to certain embodiments for highlighting function based on the content modification on display The simplified flowchart of the various aspects of method.

Figure 12 is shown according to certain embodiments for highlighting function based on the content modification on display The simplified flowchart of the various aspects of the method for color.

Figure 13 A shows the various aspects for highlighting function in the demonstration application according to certain embodiments.

Figure 13 B shows the detection according to certain embodiments and highlights each side of the optional element on display Face.

Figure 13 C shows the detection according to certain embodiments and highlights each side of the optional element on display Face.

Figure 14 shows the detection according to certain embodiments and highlights the various aspects of the daughter element on display.

Figure 15 A show according to the determinations of certain embodiments will highlighted optional element over the display each side Face.

Figure 15 B show according to the determinations of certain embodiments will highlighted optional element over the display each side Face.

Figure 16 A, which is shown, can make input unit 100 enclose the axis rotated about.

Figure 16 B shows the exemplary control scheme being used together with input unit.

Figure 17 A shows description for adjusting ginseng associated with spotlight label by the rotation for measuring input unit The block diagram of several methods.

Figure 17 B to Figure 17 D shows the mode that input unit can be rotated around the longitudinal axis of input unit.

Figure 18 A to Figure 18 D, which is shown, can manipulate the various of spotlight label after freezing spotlight label original place Mode.

Figure 19 shows the system for operating host computing device according to certain embodiments.

Figure 20 shows the system for operation input device according to certain embodiments.

Specific embodiment

The various aspects of present disclosure relate generally to input unit, more particularly to according to certain embodiments for controlling The hand-held input device of the various aspects of demonstration.

In the following description, the various embodiments of hand-held input device will be described.For illustrative purposes, spy is elaborated Fixed configuration and details are in order to provide the thorough understanding to embodiment.However, to those skilled in the art will be apparent It is that can be practiced or carried out certain embodiments in the case where not disclosed each details.Furthermore, it is possible to be omitted or simplified Well-known feature, to prevent from obscuring any of novel feature described herein.

Some aspects of the invention include the graphical content on display and being highlighted for identification using input unit The method of the various aspects of graphical content.For example, user can be used demoware (for example,) and demonstration dress (for example, " clicker ") is set to give a lecture.Need not installation of driver software access each type of application currently in use, Each aspect of the present invention can not other software, driver or other may be cumbersome or because other modes are not available defeated Enter in the case where device configuration via image procossing determine on display the various aspects of graphical content and highlight it is various right As (for example, optional element, daughter element etc.) is enabled a user to realizing the plug-and-play apparatus experience of height adaptive It is executed fast and reliablely in the case where the setting of no any special software and highlights that (and other are special with enlarging function Sign).In some embodiments, the method for realizing these features may include: just aobvious on the display for detect host computing device The first window shown detects the graphical content on first window, the second window (coating is generated on the display of host computing device (overlay)), wherein coating is configured in the Window layer above first window, and based on the first window detected The graphical quality of graphical content change coating.The graphical quality of coating may include shape, size, color, the transparency of coating Or at least one of opacity.This method can also include: that reception is corresponding with movement of the cursor on first window The transparency in the region around cursor is set the first transparency by input data, and by the transparent of the rest part of coating Degree is set as the second transparency, so that the region around cursor seems to highlight the respective area of graphical content on first window Domain.

Figure 1A shows the ambulatory handheld input unit 100 according to certain embodiments.Ambulatory handheld input unit is (" defeated Enter device ") it 100 may include shell 110, input interface 120 and receiver 130.Shell 110 is illustrated as in top plan view Meet can cosily being held by the hand of user for ergonomics with elliptic cross-section and rounded rectangle shape to promote to be formed It holds, manipulate and the input unit of interface.As one of ordinary skill in the art will appreciate, shell 110 can be by any suitable Material is formed, including metal (for example, aluminium, stainless steel, alloy etc.), plastics, rubber or mixing material.Shell 110 can also wrap Including improves user to the non-slip feature of the grasping of input unit 100, such as slip prevention part 140, can be by any suitable Anti-slip material (for example, rubber, plastics, knurled metal etc.) is constituted.Input unit 100 can also with any shape factor (for example, Shape, size etc.) realize, including wearable device (for example, smartwatch, glasses etc.), smart phone or other preferably move Dynamic device.In some embodiments, input unit 100 can be operated by the system 1700 of Figure 17.

Input interface 120 may include any suitable user interface, including but not limited to one or more buttons, touching It touches part and/or motion sensor, user control (for example, control stick, TrackPoint, trace ball etc.), facilitate speech recognition and order The microphone etc. of identification.Those skilled in the art will appreciate that its many variations, modification and alternative embodiment.

A referring to Fig.1, according to certain embodiments, input interface 120 may include top button 122, center button 124 With lower button 126.The arrangement of button 122 to 126 can be advantageous, because it can provide errorless navigation and control. For example, center button 124 is greater than top button 122 and lower button 126, to allow user in the feelings for not needing visual confirmation Which button is readily determined under condition just by interface.In some cases, the surface of button can be modified to have different Surface shape (for example, convex surface, concave surface), different material (for example, rubber, plastics, metal etc.), different surface type (examples Such as, smooth, coarse, patterned) etc..Each button can be (or the keeping factory default setting) of user-programmable to include Any amount of function can be fixed (for example, keeping being arranged until being reprogrammed) or be configurable to be based on Context use dynamically changes.For example, button can be programmed dynamically and automatically with specific unreal in demoware Lamp piece generates broadcasting/pause command when including the audio or video link of insertion.In another case, one or more buttons The control in spreadsheet application operation can be automatically configured to roll, or include certain font sizes on lantern slide Amplification characteristic is provided when (for example, less than 10 pounds).Those skilled in the art will appreciate that its many variation, modification and alternative are real Apply mode.

In some embodiments, top button 122 may be configured to cursor button, may be used as mouse so that clicking Left button is clicked, and is pressed and kept can control the cursor movement in respective display or highlight function.Center button 124 may be configured to be used as Next button, order and press and keep can so that clicking and generating " next lantern slide " Function is highlighted to execute, or as an alternative, volume control, rolling, translation, customized keystroke or other suitable functions. Lower button 126 may be configured to be used as " retrogressings " button so that click generate " previous lantern slide " order and press with Holding can execute focusing screen function, or as an alternative, volume control, rolling, translation, customized keystroke or other are suitable Function.In some embodiments, center button 124 may be used as " left click " button, and double-clicking center button 124 can be switched to Highlight mode and pressing/holding center button 124 can move cursor or realize and highlight function, it is such as following into One step discussion.In some implementations, top button 122 may be configured to click and generate next unreal in response to single Lamp piece order, or in response to pressing and keeping order and " F.F. " passes through lantern slide and can be reprogrammed so that screen Blank executes volume, rolling and/or translation control, or generates customized keystroke.In some embodiments, lower button 126 May be configured in response to single clicing on and execute " previous lantern slide " order, or in response to pressing and keep order and " rewind " passes through, and makes screen blank, executes volume, rolling and/or translation control, or generate customized keystroke.This field is common The skilled person will understand that its many variations, modification and alternative embodiment.

In some embodiments, the movement of input unit may be configured to certain features on control display.It can To use one or more accelerometers, gyroscope or other Inertial Measurement Units in three-dimensional (for example, in cartesian coordinate system X, y, z dimension) in tracking input unit it is mobile.In some cases, up/down (for example, the direction z) movement can control Volume, rolling document, the contrast for adjusting image or brightness of media player etc..Alternatively or in addition, left and right is (for example, x Direction) the mobile media playback point or operation mode of can control be (for example, audio/mute, into/out document is (for example, browsing The electrical form of insertion), monophonic broadcasting/played in stereo etc.) between circulation.Those skilled in the art will appreciate that sharp It is real with the mobile many modifications, modification and alternative to control the embodiment of the content on display of the three-dimensional (3D) of input unit Apply mode.

Receiver 130 can be the wireless transceiver that can be communicatively coupled to input unit 100.Receiver 130 can be with Realize the two-way communication between input unit 100 and host computing device (not shown), host computing device such as desktop computer, knee Laptop computer, tablet computer etc..In some embodiments, receiver 130 can be with the nothing operated with 2.4GHz The softdog of line communication protocol.Alternatively or in addition, receiver 130 can be operated with other frequencies, such as the common skill in this field Art personnel will be understood that.Receiver 130 may be configured to be assemblied in it is intracavitary in shell 110, as shown in Figure 1A, and can be with Including band 132, ontology 134 and insertion section 136.Band 132 is coupled to receiver ontology 134 and can be complete when receiver 130 It is prominent from shell 110 when being inserted into cavities, to provide the method for taking out receiver 130 from chamber.Insertion section 136 is illustrated as general string The interface of any suitable type can be used to be coupled to the port of host computing device in row bus (USB)-C style interface (for example, parallel/serial, firewire (FireWire) etc.).

Figure 1B shows the side cross-sectional view of the input interface 120 according to section line A-A.In some embodiments, defeated Incoming interface 120 may include dome switch 142, for providing clearly to the user of one of actuating button 122,124 and 126 Machine feedback.Although center button 124 also includes dome switch 142, in some embodiments, including permission center is pressed The mechanism of the other function of button 124 is also possible to beneficial.For example, spring structure can be added in parallel with dome switch 142 Part 144, to press center button 124 enough far to provide obviously harder response after contact with dome switch 142 in user Power.The top surface of dome switch 142 may include electrical contacts 146, which is configured in center button 124 and electricity Electric signal is generated when contacting between contact portion 146.In this way, center button 124 may include in button 124 and electrical contact Once the second input that the first input after the contact between portion 146 is fully actuated with then dome switch 142.Shown Configuration in, button 122 and 126 has the available single input accessed by compressing associated dome switch 142；However, Button 122 and 126 can also be equipped with the multi-input switch for being similar to center button 124.Button 122,124 and 126 can also be with Including other actuating mechanisms.For example, button 124 may include pressure sensor, which can be in the pressure of threshold quantity Power provides a user touch feedback when being applied to button 124.When the power of sufficient amount has been received and it is qualified as certain kinds When the input of type, touch feedback alerts user.The button that pressure sensor input also allows that there is analog type to input, to permit Perhaps even larger range of input.In this way, button 124 can receive two or more different input types, from And allow dramatically increasing for the input quantity from single button.In some embodiments, button 122 and 126 also can wrap The button arrangement of button 124 is included, to provide other input options to the user of input unit 100.In some embodiments, Button 122 to 126 can be user-programmable, be enable to different function distributions to different buttons and input Type.

Fig. 1 C shows the side cross-sectional view of the alternative structure for showing bearing input interface 120 according to section line A-A.In In some embodiments, input interface 120 may include dome switch 142, for actuating button 122,124 and 126 in it One user provides clearly machine feedback.Although top button 122 also includes dome switch 142, in some embodiment party It is beneficial including allowing the mechanism of other function of top button 122 to be also possible in formula.For example, can be with dome switch 142 in parallel add spring member 144, with user press top button 122 enough far to be engaged with dome switch 142 after Obvious harder response power is provided.The top surface of dome switch 142 may include electrical contacts 146, which is configured Electric signal is generated at when contacting between top button 122 and electrical contacts 146.In this way, top button 122 can wrap Once after including the contact between top button 122 and electrical contacts 146 first input and and then dome switch 142 it is complete The second input activated entirely.In the configuration shown in, button 122 and 126 has is visited by compressing associated dome switch 142 The available single input asked；However, button 122 and 126 can also be equipped with the multi-input switch for being similar to center button 124. Button 122,124 and 126 also may include other actuating mechanisms.For example, top button 122 may include pressure sensor, it should Pressure sensor can provide a user touch feedback when the pressure of threshold quantity is applied to button 124.When sufficient amount power When being received and being qualified as certain types of input, touch feedback alerts user.Pressure sensor input also allows to have The button for thering is analog type to input, to allow even larger range of input.In this way, button 124 can receive two Kind or more different input type, to allow dramatically increasing for the input quantity from single button.

Fig. 1 D shows the side cross-sectional view of other alternative structures of the bearing input interface 120 according to section line A-A.It is special Not, center button 124 and lower button 126 all include as described above for detecting the machine of a variety of different types of inputs Structure.Top button 122 also may include the mechanism of the same type used by button 124 and 126, or can alternatively include The volume of air of 122 lower section of top button is isolated in containment member 148 as shown in the figure, containment member.In this way, when pressing When the button 122 of top, the pressure in the volume of air for the pressure sensor monitoring generation being arranged in volume of air can be passed through Increase, to provide the number or analog feedback of the variation according to pressure.For example, between top button 122 and electrical contacts 146 The first signal can be generated in contact, and the second letter can be generated in the pressure sensor in the volume of air limited by sealing element Number.Second signal can the generation when reaching threshold pressure, or can based on current pressure measurement how and change.Some In embodiment, second signal just only can be generated when top button 122 and electrical contacts 146 contact.

Multi-connection

In some embodiments, ambulatory handheld input unit may be configured to and have any suitable operating system It is coupled with any kind of host computing device of wireless communication protocol, as discussed further below.It in some cases, can be with Establish communication connection level, wherein when may be coupled to first device, compared to the second host computing device (for example, using BLE or other standards communication protocol), input unit will be alternatively coupled to the first host computing device (for example, using receiver 130 (for example, softdog) is used as wireless communication protocol).When the first host computing device is not detected or is unavailable, input unit It is communicatively connected to the second host computing device.In some embodiments, when input unit is connected to the second host computing device When, once input unit detects that the first host computing device can be used for connecting, then input unit will automatically be communicated connection from Second host computing device is switched to the first host computing device.The various aspects of these connection level concepts are below referring for example to Fig. 2 It is presented to Fig. 4.It will be appreciated that though discussing two devices in many embodiments of present disclosure, but input Device may be configured to be connected to three or more master computers (for example, comparing with any suitable connection level scheme In the second master computer or wireless connection type, the first master computer or wireless connection type are automatically selected, and compared to Three master computers or wireless connection type select the second master computer or wireless connection type etc.).Those of ordinary skill in the art It will be understood that its many variations, modification and alternative embodiment.

Fig. 2 shows the ambulatory handheld input units 200 with multi-connection ability according to certain embodiments.Input dress Setting 200 can be communicatively coupled in receiver 230 (being couple to master computer 210) or host computing device 220,240 or 250 Any one.Receiver 230 can be the wireless transceiver with 2.4GHz or the operation of other suitable frequencies.Host computing device 210, 220,240 and 250 are illustrated as laptop computer, desktop computer, tablet computer and the knee based on Mac based on PC respectively Laptop computer, but can be can also comprise net book, smart phone, intelligent wearable device (for example, intelligent hand Table, glasses) etc. any suitable computing device.Host computing device 210,220,240 and 250 can operate any suitable behaviour Make system, including but not limited toDeng. Each master device can operate any suitable wireless communication protocol, including but not limited toBLE、 Wi-Fi(IEEE 802.11)、Thread、Agreement etc., as those skilled in the art will manage Solution.Referring to Fig. 2, host computing device 210 is usedProprietary 2.4GHz wireless communication protocol, and host computing device 220,240 and 250 BLE (operating with 2.4GHz) is used.

In some embodiments, input unit 200 can have two or more radio communication channels.Previous In example, individual channel can be switched between host computing device and corresponding wireless communication protocol based on preference level (below It is further discussed in Fig. 3 into Fig. 4).Alternatively or in addition, other channel can be used to keep being communicatively coupled to one A or more other device.In this case, input unit function (for example, cursor is mobile, button control etc.) can be with It is limited to primary single host computing device.One advantage of more hosts connection simultaneously is can be quickly (for example, 10ms or more It is short) switch between host computing device, because input unit 200 need not be spent any time or resource re-establishes and target The wireless connection of host computing device.

In some implementations, above-mentioned connection level can be user-programmable.For example, factory default setting can be with Receiver 230 is paid the utmost attention to as the primary selection for establishing wireless connection, followed by BLE or other suitable wireless communications are assisted View.User, which can choose to be switched to, pays the utmost attention to BLE compared to receiver 230, or compared to both receiver 230 and BLE Pay the utmost attention to another communication protocol.Those skilled in the art will be understood that its many variations, modification and alternative embodiment.

Alternatively or in addition, can be started between master computer by the movement and/or orientation of input unit 200 Switching.Input unit 200 may include one or more accelerometers, gyroscope or other be suitably based on inertia measurement list The system of first (IMU) detects the movement and/or orientation, such as following referring to Fig.1 shown in 0 and described.In some embodiments In, make input unit 200 be switched to the specific analytic accounting being just pointed in the direction that input unit 200 is directed toward host computing device Calculate device.In such a case, it is possible to which the characteristic (for example, signal strength) based on corresponding wireless communication protocol is each to determine The position of host computing device.In some cases, user can be by being directed to host computing device for input unit 200 and inciting somebody to action Directional data (for example, input unit 200 towards direction) it is associated with each specific host computing device come manual setting it is each The position of host computing device.Then, user can by input unit 200 be directed toward target host computing device and start switching (for example, It is pressed in conjunction with specific button).As an alternative, host computing device can be established as described in U.S. Patent Application No. 15/226,770 Between " flowing " type configuration (for example, switching between two of different host computer hands- operations demonstrations).This field it is general Lead to the skilled person will understand that its many variations, modification and alternative embodiment.

Fig. 3 is shown according to certain embodiments for establishing the method 300 being wirelessly connected with mobile input device The simplified flowchart of various aspects.Method 300 (and method 400,700 and 1000 to 1200) can be executed by processing logic, should Processing logic may include hardware (circuit, special logic etc.), the software that operates on suitable hardware (such as general-purpose computations system System or special purpose machinery), firmware (embedded software) or any combination thereof.In some embodiments, method 300 can be by system 1700 processor 1710 executes, as below with reference to shown in Figure 17 and described.

In step 310, method 300 may include the receiver that search has activity and available first wireless communication protocol 230.Receiver 230 can be couple to any suitable host computing device, including desktop computer, laptop computer, plate Any one of computer, smart phone, intelligent wearable device etc., as further described above.In some embodiment party In formula, receiver 230 can be the softdog with 2.4GHz or the operation of other suitable frequencies.Step 310 can also include determining Whether receiver 230, which can be used for, connects.In some cases, receiver 230 can be matched from different input units, so that connecing Device 230 is received to be not useable for connecting with input unit 200.

(the step 320) when detecting receiver 230, method 300 may include being connected automatically to connect by input unit 200 Receive 230 (step 330) of device.(the step 320) when receiver 230 is not detected, method 300 may include search have activity and Master computer (the step 340) of available second wireless communication protocol.In some cases, input unit 200 can continue to connect Continuous ground periodically searches for receiver 230 (for example, every 100 milliseconds, 1 second, 10 seconds or any suitable time quantum inspection reception 230 availability of device).Alternatively or in addition, input unit 200 can be when receiving user's input whenever input unit 200 230 availability of search receiver.For example, whenever user's push button (for example, ceiling button 122) or its subset are (for example, every 10 A user's input).In some cases, the first wireless communication protocol can be different from the second wireless communication protocol.Such as this field Ordinarily skilled artisan will understand that, the second wireless communication protocol can beBLE、 Any one of Wi-Fi (IEEE 802.11), Thread etc..

In step 350, method 300 may include that will input when receiver 230 (or being not useable for connecting) is not detected Device 200 is connected to the master computer with the second wireless communication protocol.In step 360, method 300 may include filling in input 200 are set when being connected to the master computer with the second wireless communication protocol and continues searching 230 availability of receiver.In step 370, When the holding of receiver 230 is not detected and/or is not useable for connection, method 300 may include connecting in input unit 200 To with the second wireless communication protocol master computer when continue searching 230 availability (step 360) of receiver.In step 370, When detecting receiver 230 and receiver can be used for connecting, method 300 may include automatically by the nothing of input unit 200 Line connection is switched to 230 (step 330) of receiver from the master computer with the second wireless communication protocol.

It should be appreciated that specific steps shown in Fig. 3 are provided according to certain embodiments for filling with mobile input Set up the ad hoc approach 300 of vertical wireless connection.According to alternative embodiment, other sequence of steps can also be executed.For example, alternative Embodiment can be executed in different order the step of being outlined above.In addition, each step shown in Fig. 3 may include more Sub-steps, these sub-steps can be executed with the various sequences for being suitable for each step.

In addition, depending on specific application, additional step can be added or removed.For example, some embodiments may include Input is received input unit 200 to be powered, in response to receiving user's input by the operation mode of input unit 200 from low Power sleep mode is switched to activity pattern, and the channel radio of receiver and Second Type is not detected in response to determination (1) Believe agreement, (2) in threshold time (for example, 1 minute, 5 minutes, 30 minutes or any suitable time range) not in movement Input is received on input unit, the wireless communication protocol of Second Type is lost and is not detected in the connection of (3) and receiver, Or the connection of the wireless communication protocol of (4) and Second Type lose and be not detected receiver and by operation mode from movable mold Formula is switched to low-power mode.In another example, method 300 can also include when the operation mode of mobile input device is low When power sleep mode, user's input is received on mobile input device, wherein user's input corresponds to one or more individuals Machine interface arrangement (HID), and in response to receiving user's input when mobile input device is in sleep pattern, mould will be operated Formula is switched to activity pattern from sleep pattern, and generates one or more corresponding HID orders.

In other embodiment, method 300 may include when mobile input device and receiver or having the second nothing Touch feedback is provided on mobile input device when the master computer connection of line communication protocol.When mobile input device and receiver When 230 connection, touch feedback can be the touch feedback (for example, the first pulse mode and/or frequency) of the first kind, and work as When input unit 200 is connect with the master computer with the second wireless communication protocol, touch feedback can be the touching of Second Type Feel feedback (for example, the first pulse mode and/or frequency).Those skilled in the art will recognize and appreciate that method 300 Many variations, modification and alternative.

Fig. 4 shows showing for operating the ambulatory handheld input unit with power saving features according to certain embodiments Method 400 various aspects flow chart.In some embodiments, method 400 can be by the processor 1710 of system 1700 It executes, shown in following referring to Fig.1 7 with as described in.

In step 410, input unit 200 may be at sleep mode of operation.Sleep pattern can be low-power operation shape State, use less power when being in normal manipulation mode than input unit 200.In a sleep mode, can by one or More modules, function, circuit etc. are closed or are placed under low power state.In step 420, in response on input unit 200 Input signal (for example, button press, touch sensor input etc.) is received, input unit 200 is switched to normal manipulation mode (for example, all modules, function and circuit return to normal operating state) or " open mode ".

In some embodiments, user inputs (for example, button press) and can be stored in storage buffer and defeated Enter after device 200 establishes connection and is sent to host computing device.For example, user's input is (for example, in slide presentation application " next lantern slide " function button press) can execute two functions: operation is to return input unit 200 from sleep pattern Normal manipulation mode is returned to, and is clicked with button and executes expectation function (for example, issuing " next lantern slide " order).

In step 425, in response to received during third threshold value timeout period user's input specific combination (for example, Keep two or more buttons up to 1 second simultaneously or the longer time), or when no known receiver and input unit 200 (step 440) when associated, input unit 200 can be attempted to be communicably connected to new connect during first threshold timeout period Device 230 (that is, not previously known or be not attached to) is received, BLE advertisement is then carried out during second threshold timeout period.Show at this Example in, BLE is secondary wireless communication protocol, but can be used any suitable communication protocol (for example,Wi-Fi(IEEE 802.11)、Thread、Agreement etc.).One In a little embodiments, the first threshold time be can be 1 second, and the second threshold time can be 3 minutes, but when other can be used Between be spaced, as one of ordinary skill in the art will appreciate.It can be from sleep pattern (step 410) and " open mode " (step It is rapid 420) to reach step 425.It cannot be obtained from new receiver or from BLE when during threshold value timeout period (for example, 3 minutes) When connection, input unit 200 may return to sleep pattern (step 410).

In step 430, the trial of input unit 200 connection (for example, sending connection request) is arrived known prewired to receiver. If prewired available to receiver, input unit 200 establishes communication connection (step 450).Once connected, if with connecing The connection for receiving device then loses or goes beyond the scope, then, can before input unit 200 is returned to sleep pattern (step 410) It is attempted with occurring to reconnect during a period of time (for example, 1 second).Alternatively or in addition, if in a period of time (example Such as, 30 minutes) during be not received by user's input (for example, click button), then input unit 200 may return to sleep mould Formula (step 410).If user's input is received on input unit 200 after losing the connection with receiver 230, such as If fruit is available, input unit 200 can be reset with BLE (or other suitable communication protocols).

In step 450, in response to receiving the specific combination of user's input (for example, keeping two or more to press simultaneously Button is up to 1 second or for more time), input unit 200 can be attempted to be communicably connected to during first threshold timeout period new Receiver 230 (that is, not previously known or not connected) then carries out BLE advertisement (step during second threshold timeout period 470).When during threshold value timeout period (for example, 3 minutes) connection cannot be obtained from new receiver or from BLE, input dress Setting 200 may return to sleep pattern (step 410).

Referring back to step 430, if it is known that it is prewired receiver is currently unavailable, then input unit 200 search BLE host computing device (the step 455) known.As noted above, it is to be understood that any suitable wireless communication protocol can be used Instead of BLE.In addition, the prewired reference to receiver should be understood that mean receiver be couple to host computing device and with Host computing device carries out electronic communication.In step 455, if available without known BLE host computing device, input unit 200 can back into sleep pattern (step 410).If it is known that BLE host computing device it is available, then input unit 200 can With attempt at any suitable time interval be connected to the known BLE host computing device, and at the same time still check with it is known The prewired connection availability (step 460) to receiver.For example, input unit 200 can attempt to connect to BLE in 5 seconds Then host computing device attempts to connect to known prewired to receiver in 1 second.

In step 460, be once connected to BLE host computing device, if connection then lose or go beyond the scope, make it is defeated Enter device 200 to return to before sleep pattern (step 410), input unit 200 can be tasted within a period of time (for example, 5 seconds) Examination reconnects.Alternatively or in addition, if BLE host computing device is unavailable within a period of time (for example, 5 seconds), That knows is prewired unavailable within a period of time (for example, 1 second) to receiver, if arriving the known prewired connection to receiver It loses or goes beyond the scope, or if be not received by user's input, input unit within a period of time (for example, 30 minutes) 200 may return to sleep pattern (step 410).

Referring again to step 460, in some embodiments, each user on input unit 200 input (or user Other intervals of input) after, input unit 200 can check prewired docking known to (ping) between BLE grouping sending Device (step 480) is received, as one of ordinary skill in the art will appreciate.When it is known it is prewired receiver is made available by when, Input unit 200 can be disconnected with BLE host and is connected to known prewired to receiver (step 490).

In response to special user's input condition from any one of step 460,480,485 or 490 (for example, input Inputted while two or more buttons on device 200), as above with reference to step 425 similarly described in, input unit 200 can attempt to be communicably connected to during first threshold timeout period new receiver (that is, not previously known or not connected ), BLE advertisement (step 485) is then carried out during second threshold timeout period.In step 485, if in a period of time Available without connection in (for example, 3 minutes), then input unit 200 may return to sleep pattern (step 410).Referring back to Step 490, if losing or going beyond the scope with the prewired connection to receiver, input unit 200 can be in a period of time (example Such as, 1 second) in attempt reconnect or on the contrary return to sleep pattern (step 410).Alternatively or in addition, if at one section User's input is not received by time (for example, 30 minutes), then input unit 200 may return to sleep pattern (step 410)。

It should be appreciated that specific steps shown in Fig. 4, which are provided, has power saving for operating according to certain embodiments The ad hoc approach 400 of the ambulatory handheld input unit 200 of feature.According to alternative embodiment, other step sequences can also be executed Column.For example, alternate embodiments can be executed in different order the step of being outlined above.In addition, each step shown in Fig. 4 It suddenly may include multiple sub-steps, these sub-steps can be executed with the various sequences for being suitable for each step.In addition, depending on Other step can be added or be removed to the specific application of method 400.Those skilled in the art side of will recognize and appreciate that Many variations, modification and the alternative of method 400.

Demonstrate enhancing-interruption-free feature

Some aspects of the invention include operating software to prevent pop-up window, notice or other systems message from appearing in phase It answers and obtains the method that improved demonstration is experienced on display to ensure unbroken user conversation.Non-limiting embodiment party below Formula presents the various implementations of the design.

Fig. 5 shows the various aspects for not interrupting display 500 according to certain embodiments.Such as the ordinary skill of this field What personnel will be understood that, display 500 can be operated by any suitable host computing device (not shown), such as desktop computer, Laptop computer, tablet computer etc..In some embodiments, display 500 and operate corresponding demoware not in The software of disconnected operation can be operated by the system 1600 of Figure 16.

Display 500 shows not interrupt images 510 of lantern slide, and lantern slide can be grasped by any suitable demoware Make, such asGoogleDeng.The pop-up notification being prevented from 520 in fig. 5 it is shown that still actually it is invisible on display 500.Image 510 can be with the image phase of any display Association, and it is not limited to demoware.For example, image 510 can be with the phases such as webpage, word processor, spreadsheet software Association.Those skilled in the art will be understood that its many variations, modification and alternative embodiment.

During demonstrating at the scene there is unbroken display may be particularly advantageous.It is popped up by system or application level The attention that possible dispersed audience is interrupted caused by message, negatively affects the validity and continuity of the demonstration of speaker, or Even cause personal information (for example, personal email notice) middle display in public places.In some embodiments, pass through Operation does not interrupt display to realize below: operation can capture the software of the image of the display generated by demoware and will figure As placing on the cover layer, which is configured to reside in higher than every other layer (including system-level pop-up window or logical Know) top display layer on.Coating software can be with any system Seamless integration-, and will not interfere may be different because of machine Any operating system (OS) setting, other software applications run simultaneously or other operations.In some embodiments, it can catch Obtain the image that demoware is shown and with 25-30 frame/second (fps) covering to capture video, GIF etc., as discussed further below 's.In some embodiments, can " interruption-free " feature at user option by enabled/disabled to switch do not interrupt display Feature, as discussed further below.

Fig. 6 shows each side of the level for configuring shown window 610 on display 600 according to certain embodiments Face.Windows 610 is logical including operating system (OS) desktop window 620, demonstration window 630, applicative notifications window 640, system Know window 650 and coating window 660.In the specific arrangements of Fig. 6, coating 660 presses system notification window 650, applicative notifications The sequence of window 640, demonstration window 630 and desktop window 620 is configured in above these described windows.It is common such as this field The skilled person will understand that, other window levels are possible, and some windows can be not present, and can add additional window Mouth layer etc..Fig. 6 can be operated by the various aspects of the system 1600 of Figure 16.

In some embodiments, OS manage various Window layers and according to scheduled level on corresponding display to it Be ranked up, as described above.In some embodiments, transparent covering window (" coating ") 660 can be located at level In the superlative degree.Notify (for example, system notification window 650, applicative notifications window 640 etc.) usually with than demonstration window 630 (or Other software application widget) higher priority is configured, to allow pop-up window and other notices as it can be seen that but being below covering Layer 660.In some cases, coating 660 can send " focusing " for incoming event (for example, keyboard and mouse input) Demonstration application, to allow any application interface (for example, applying user's input) below user and coating 660.

In some embodiments, coating software can execute several functions, including highlight function (below into one Step discusses), hide notice (as mentioned above) and provide additional relevant information (for example, present battery level etc., as it is following into One step discussion).About hiding notice, coating software can set coating 660 to opaque to hide any lower layer Notice.In order to show demo content (such as lantern slide) simultaneously and hide notice, the duplication of coating software (" crawl " or " is caught Obtain ") content of demonstration window and it will be shown on coating 660.Content is this shared from a window to another window It can be occurred with any suitable frequency.In the case where video or fast-changing image is presented, frequency should be sufficiently high, makes It obtains image to look like continuously, does not suspend from the perspective of viewer or shake (normally about 25-30fps).

Sizable processing and image rendering abilities can be utilized by capturing display data with high fps rate, this may cause certain A little processes (for example, cursor is mobile) seem slow or discontinuous in certain systems.Similarly, the cursor fast moved is captured And/or execute the operation for including to highlight, amplify (further described below) etc. process resource can also be applied bear and Cause visible shake or the delay on coating 660 in certain systems.In some embodiments, coating 660 is operated Software, which can detecte user and when be carrying out, may cause slow specific function (for example, mobile cursor), in the period Period stopping continues to show on coating 660 from 630 capture content of demonstration window and during this time to be recently captured Image.After specific function stops, 25fps capture and display process can continue as usual.For faster system, user can be with It selects to disable the process, so that capture and display process continue, but regardless of any ongoing cursor movement, highlights function Energy is equal.

Therefore, in some embodiments, when starting demoware (for example, with full screen), " exempt to beat when having disabled Disturb " mode when, application or system notice can occur on the screen.When enabling " interruption-free " feature, the choosing of coating software The demonstration window 630 of present convergence is selected, its content is captured with specific frequency (for example, 25fps) and on opaque coating 660 Show content.

Fig. 7 is each side for showing the method for the level for configuring display window on the computing device according to certain embodiments The simplified flowchart in face.Method 700 can be executed by the processor 1602 of system 1600, as below with reference to shown in Figure 16 and described 's.

In step 710, method 700 may include being shown just on the display of host computing device by the detection of the first software application The first window shown.First software application (" coating software "), which can be, can be generated coating 660 and can be by inputting The software that device 200 is controlled and/or worked together with input unit 200.For example, coating software can be based on from input dress The input (for example, cursor is mobile) for setting 200 enables or disables " interruption-free " function.First window may include from the second software Using (for example, demoware, such asDeng) demo content or other are suitable Software application, as described above.

In step 720, method 700 may include by the image of graphical content on coating software capture first window.Example Such as, coating software can capture the image of lantern slide on (for example, duplication) demoware.

In step 730, method 700 may include that the second window is generated on the display of host computing device by coating software Mouth (for example, coating 660).In step 740, method 700 includes the top window being configured to coating 660 on display Mouthful, so that the window below coating 660 occurs for subsequent applications grade and system-level window pop-up (or other notice/pop-up windows) On mouth layer.

In step 750, method 700 may include shown on coating 660 by coating software capture (for example, multiple System) image of graphical content.Capture (step 720) and display (step 740) can be occurred with any suitable rate.One In a little embodiments, rate is usually 25-30fps.In some cases, coating 660 can be opaque, so that lower layer (for example, window) is invisible over the display, but regardless of the content on coating 660 how.

It should be appreciated that specific steps shown in fig. 7 are provided according to certain embodiments for configuring computing device On display window level ad hoc approach 700.According to alternative embodiment, other sequence of steps can also be executed.For example, Alternative embodiment can be executed in different order the step of being outlined above.In addition, each step shown in Fig. 4 can wrap Multiple sub-steps are included, these sub-steps can be executed with the various sequences for being suitable for each step.In addition, depending on specific answer With can add or remove other step.For example, in some embodiments, method 700 may include from input unit 200 receive input data (for example, input data corresponds to selection demonstration window with the input number in " focusing " certain window According to), subsequent input data (for example, button click, cursor moving command etc.) is received from input unit 200, and when the second window When mouth (coating 660) is shown as the top window on display, subsequent input data is applied on first window Second applies (for example, demoware).In some cases, demonstration window may have been chosen to " focus " layer, so that appointing What received input data is applied to demonstration application.

In another example, method 700 may include: to keep coverage diagram 660 transparent by coating software, so that working as from defeated Enter demonstration window when device 200 receives input data to be visible；It is no longer filled from input when in threshold time (for example, 1 second) It sets when receiving input data, by the image of the update of the graphical content on coating software capture demonstration window；And by covering Cap rock software shows the image of the update of captured graphical content on coating 660.

Some embodiments can using highlight and/or zoom function come enhance demonstration.For example, received input number According to the movement for the cursor that can correspond on first window (for example, demonstration window), and method 700 can also include being based on light The mobile opacity to change the second transparent window of target.More specifically, the opacity of the second transparent window can be with Be changed in the region around cursor, to highlight the corresponding region of the graphical content on first window, such as referring to Fig. 8 A is further discussed.Those skilled in the art will recognize and appreciate that many variations, modification and the alternative of method 700 Scheme.

As described above, the movement of input unit 100/200 can be converted to cursor over the display by some embodiments Movement, or be converted to specific function associated with the content on display (for example, the sound of mobile control media player Amount, scroll file etc.).The calculating conversion of the movement being moved on two dimensional display in 3d space can be by input unit (example Such as, by processor 1710), the master computer by being couple to input unit (for example, processor 1602), by a combination thereof or by third Square device (for example, computing device in cloud) executes, as one of ordinary skill in the art will appreciate.

It highlights, scale, intelligent ON/OFF, media control and without sleep function

Fig. 8 A shows the various aspects for highlighting function in the demonstration application according to certain embodiments.In display Image 810 (for example, presentation slides) are shown on the demonstration window 630 on 800.Display 800 further includes being configured to be higher than The semitransparent layer 820 (for example, coating 660) of demonstration window 630, as above for described in Fig. 6 (note: coating 660 exists It is opaque in the embodiment of Fig. 6).Semitransparent layer can be made by making lantern slide " graying " (" graying out ") Whole image is dimmed, so that non-" graying " region 830 provides the appearance for highlighting effect.The movement of region 830 can correspond to By the movement for the cursor that input unit 200 controls.

In some embodiments, it highlights effect to occur on demonstration window 630, as described above.One the disadvantage is that It is still likely to occur pop-up window in this configuration.Alternatively or in addition, highlighting function can be on coating 660 Occur.Coating software can capture the image of demonstration window 630 and show them on opaque coating 660.In order to Creation highlights effect, entire coating can be kept dimmed other than not dimmed region 830, this can create prominent aobvious Show effect.These embodiments still can operate under " interruption-free " setting and keep the benefit for not interrupting demonstration.Region 830 It can be any suitable shape or size and may or may not directly move tracking cursor, cursor movement can be by defeated Enter the movement of device in the 3 d space to control, as described above.Those skilled in the art will be understood that its many variation, repair Change and alternative embodiment.

Fig. 8 B shows the various aspects of the zoom function in the demonstration application according to certain embodiments.In display 800 On demonstration window 630 on image 810 (for example, presentation slides) are shown.Region 840 shows the amplification or " contracting of image 810 Put " part.The movement in region 840 can correspond to the movement of the cursor controlled by input unit 200.

In some embodiments, by the way that image 810 is captured and shown on coating 660 and by about region 840 Amplification factor (for example, 1.5x, 2x, 10x etc.) amplification (for example, scaling) image 810 realize zooming effect.Region 840 can To be any suitable shape or size, and may or may not directly move tracking cursor.The ordinary skill people of this field Member is it will be understood that its many variations, modification and alternative embodiment.

In some embodiments, input unit 200 may include intelligent ON/OFF feature, the intelligence ON/OFF characteristic response In receive user input (for example, button press) and make automatically input unit 200 be powered and (again) establish and host computer The connection of machine (for example, master computer, BLE host etc. with receiver 230).In some cases, can to save user defeated Enter (for example, in storage buffer) and is inputted after establishing wireless connection using user.Therefore, single user's input can So that input unit 200 (for example, in a sleep mode) is powered on and user's input is applied to focus window (for example, demonstration window Mouthful 630), this can simplify connection procedure, thus allow user to be simply plugged into receiver 230 or pressing key to start demonstration and There is no any troublesome connection procedure.

In some embodiments, the software installed on a host computer can be operated together with input unit 200 with true Determine the content in certain window.More specifically, can scan and detect whether can be in selected (" focusing ") window for some embodiments Play medium (for example, audio or video link, player etc.) is accessed on mouth (such as presentation slides).Software can should Information is relayed to input unit 200, so that input unit automatically configures input interface 120 (for example, button 122-126) with automatic Media data is played, without the movement of such as cursor and selection media links or media player.Alternatively or in addition, it rings Ying Yu detects certain contents on display, and the movement of input unit can be mapped to certain functions (for example, control media Volume on player).In some cases, multiple mappings can be configured in response to detecting single content.For example, detection One or more buttons can be made to be assigned to media transmission control (for example, playing, pause), and input to media play The mobile detection of device is assigned to control volume.These designs are further discussed referring to Fig. 9 A and 9B.In some embodiment party In formula, the coating software of Fig. 6 can be the same software for controlling Media Survey and detection on selected window.

In other embodiment, " no sleep " function may be implemented to prevent master computer from entering in input unit 200 Sleep pattern.For example, demonstrator may rest on specific lantern slide in long period during slide demonstration, to ring It should be inputted in lacking user in the long period and so that screen is become blank and/or host computing device is made to enter low-power operation mould Formula.Input unit 200 can be by continually sending commands to keep master computer " waking " to master computer, to prevent from sleeping The generation of mode.For example, can during no user inputs movable period at regular intervals (for example, every 10 seconds) by people Machine interface arrangement (HID) order is sent to corresponding master computer.HID order can execute any function, it is preferred that not Interference display is to prevent any interruption during demonstration.Those skilled in the art will be understood that its many variation, modification With alternative embodiment.

Fig. 9 A shows matching automatically for the input unit 900 of the content based on display 910 according to certain embodiments It sets.Display 910 be illustrated as presentation slides (for example,Lantern slide,Lantern slide etc.), But it can be any suitable image.Can by any suitable host computing device (for example, host computing device 210,220, The system 1600 etc. of 240 or 250, Figure 16) operate display 910.Display 910 includes 915 He of media player of insertion Alphanumeric text.Input unit 900 includes ceiling button 922, middle button 924 and bottom button 926.As further above Discuss, be similar to input unit 100/200, input unit 900 may include any amount of input interface control (for example, Button, touch sensitive surface, microphone etc.).Input unit 900 can also include one or more IMU to track in 3d space Mobile 928, as further discussed above.

In some embodiments, host computing device (for example, processor 1602) can detecte one on display 910 Or more Graph Control element, determine their type and generate configuration control number automatically configure accordingly on input unit one A or more input element (for example, button 922 to 926, mobile 928 etc.), with usual and corresponding control element function Relevant one or more mode controls figure control element.Match referring to Fig. 9 A in response to detecting media player 915 Setting control data can make input unit 900 that the control of such as media transmission is distributed to button 922 to 926 (for example, F.F., broadcasting Put/suspend, refund), volume control is distributed to the movement of input unit 900 (for example, up/down movement can control Volume) or input combination to control corresponding control element.For example, when push button (for example, button 922) and receiving When mobile data 928 (for example, movement upward in generally/lower section), the volume control of media player 915 may be implemented. Those skilled in the art will be understood that its many modification, modification and alternative embodiment.

Fig. 9 B shows matching automatically for the input unit 950 of the content based on display 960 according to certain embodiments It sets.Display 960 be illustrated as presentation slides (for example,Lantern slide,Lantern slide etc.), But it can be any suitable image.Can by any suitable host computing device (for example, host computing device 210,220, The system 1600 etc. of 240 or 250, Figure 16) operate display 960.Display 960 includes the electrical form 970 of insertion, is based on The hyperlink 980 and alphanumeric text of network.Electrical form 970 includes expanding to sightless multiple pages on single picture The text in face, the text can be accessed by manipulation scroll bar 975.In some cases, text may be very small and difficult To read.It is therefore possible to use enlarging function 990, as shown in the figure.Input unit 950 may include ceiling button 982, centre Button 984 and bottom button 986.As further discussed above, it is similar to input unit 100/200/900, input unit 950 It may include any amount of input interface control (for example, button, touch sensitive surface, microphone etc.).Input unit 950 can be with Including one or more IMU to track the movement 988 in 3d space, as further discussed above.

In some embodiments, host computing device (for example, processor 1602) can detecte one on display 960 Or more Graph Control element, determine their type and generate configuration control number automatically configure accordingly on input unit one A or more input element (for example, button 982 to 986, mobile 988 etc.), with usual and corresponding control element function Relevant one or more mode controls figure control element.Referring to Fig. 9 B, in response to detecting electrical form 970 and hyperlink 980 are connect, configuration control number evidence can make input unit 900 distribute such as hyperlink button (for example, middle button 984) with automatic Starting hyperlink 980 (for example, selecting hyperlink 980 without using cursor) and distribution " crawl " button are rolled with automatically grabbing Item 975 (or other can manipulating objects), and distribution mobile 988 with control the text on electrical form 970 rolling (for example, When also selection " crawl " function), such as in response to detecting movement of the input unit 950 on direction up and/or down And scroll up and scroll down through (or paging up and downward page turning).In some cases, master computer can detecte electricity Text in sub-table at or below some font point size (for example, being lower than 8 fonts) and distributes enlarging function 990 To button 982.In some embodiments, multiple push button can switch certain functions.For example, push button 982 can be with In enlarging function and highlight switching between function (as above with reference to being further discussed Fig. 8 A and 8B).This field it is common The skilled person will understand that its many modification, modification and alternative embodiment.

Figure 10 is the side that input unit is automatically configured for the content based on display shown according to certain embodiments The simplified flowchart of the various aspects of method 1000.Method 1000 can be executed by the processor 1602 of system 1600, such as referring to What Figure 16 showed and described.

At step 1010, according to certain embodiments, method 1000 may include by the processor on host computing device Graph Control element in test pattern user interface.Graph Control element may include media playing apparatus (for example, video, Audio etc.), hyperlink, word processor documents, electronic form document, alphanumeric text or display be (for example, presentation slide On piece) on any item, as one of ordinary skill in the art understand.

At step 1020, method 1000 may include that the type of Graph Control element is determined by processor.As described above, According to certain embodiments, the type of control element can be on display it is any can manipulating objects (for example, media play Device, hyperlink, electrical form etc.).

At step 1030, according to certain embodiments, method 1000 may include generating configuration control number by processor Make one or more input elements on input unit configuration input unit to execute the type with Graph Control element accordingly Corresponding function.As one of ordinary skill in the art understand, one or more input elements may include button, touching Touch at least one of sensor, motion sensor or other input elements.Input unit can be apparatus for demonstrating, smart phone Or one of wearable intelligent apparatus.In some embodiments, configuration control number evidence can be applied and be broadcast with video or audio frequency media The corresponding function of device is put, the function includes at least one of media transmission control function or volume control, and wherein media pass Defeated control function can be associated with one or more buttons on input unit, and volume control can be with input unit Movement it is associated.In some cases, function corresponding with word processing file, electronic form document or alphanumeric text It may include at least one of amplification or page scroll, wherein amplification control can be with the button and movement the two of input unit It is associated, and page scroll can be associated with the movement of input unit.In some embodiments, configuration control number evidence can So that input unit configures at least two in one or more input elements to execute the type pair with Graph Control element The function of answering, at least two in one of them or more input element can be associated from different functions.

At step 1040, method 1000 may include sending input unit for configuration control number evidence by processor.In Under some cases, input unit can separate with host computing device and be communicatively coupled to host computing device (for example, input dress Set can not be with host computing device it is same, such as the touch screen of tablet computer and it).

It should be appreciated that specific steps shown in Figure 10 are provided according to certain embodiments for based on display Content automatically configures the ad hoc approach 1000 of input unit.According to alternative embodiment, other sequence of steps can also be performed.Example Such as, alternative embodiment can be executed in different order the step of being outlined above.In addition, each step can shown in Figure 10 To include multiple sub-steps, these sub-steps can be executed with the various sequences for being suitable for each step.In addition, depending on specific Using can add or remove other step.Above with respect to method 1000 (or method 300,400,700 and 1100 to 1200) Any aspect of description can be applied to any input unit, host computing device etc. described in present disclosure.This field Those of ordinary skill will recognize and appreciate that many modifications, modification and the alternative of method 1000.

Figure 11 is shown according to certain embodiments for highlighting function based on the content modification on display The simplified flowchart of the various aspects of method.Method 1100 can be executed by the processor 1902 of system 1900, such as referring to figure 19 show and describe.For purposes of illustration, in being described below of method 1100 reference to input unit 200 and host computer The description of device 1300.It should be appreciated that as one of ordinary skill in the art understand, can be used and be described herein Any input unit and/or host computing device.

At step 1110, according to certain embodiments, method 1100 may include detecting the display of host computing device First window 1310 (" lantern slide 1310 ") on 1300.Detection can be executed by the first software application (" coating software "), First software application can be controlled by input unit 200 and/or be worked together with input unit 200.In subsequent embodiment party In formula, first window may include from the second software application (for example, demoware is for exampleDeng) or other suitable software applications (for example, MSMS Deng) demo content, as described above.

At step 1120, according to certain embodiments, method 1100 may include in the figure detected on first window Hold.Graphical content may include optional element, such as icon, interactive object (for example, media player, electrical form, scroll bar Deng), link (for example, hyperlink), alphanumeric text etc..As one of ordinary skill in the art understand, it detects Graphical content can be widely varied, and is not limited to the example provided herein.

It can test pattern content in a number of different ways.It is had for example, it is contemplated that operation is demonstrated and shown at an angle Insertion electrical form (for example,) lantern slide, show at another angle media player and in the third angle Place display hyperlink demoware (for example,) (see, for example, Figure 15 A).A kind of mode of detection content It is to pass through image procossing.This may be advantageous in some cases, because it is interior to determine to may not be needed access specific software Hold.On the contrary, can determine certain objects (for example, optional element) by checking their shape and characteristics of image.For example, electric Sub-table usually has lattice, which has with structuring and spatial organization and/or symmetrical configuration (example Such as, cell, row, column etc.) come the alphanumeric text that configures.Image processing techniques (for example, combination processing device 1602 executes) It can identify cell usually associated with spreadsheet software, structure and pattern, and so characterize it.Once by table Sign, so that it may determine shape and/or color, and can identify and highlight as described herein entire element or its portion Point.

The media player of insertion can have the certain common traits that can be detected by image procossing.For example, media Player often has the frame of square or rectangular shape, this may be contrasted with its boundary background.In addition, media play Device usually has the Play button in central area, and may include having certain color combinations (for example, being usually Red and white) " broadcasting " icon (for example, transverse triangle shape).Some media players may include at other positions Media transmission control, the data shown on certain positions are (for example, title, file size or other positioned at specific location Data) or other common traits usually associated with media player.Image processing techniques can identify these features and phase Characterize media player with answering.Once being characterized, so that it may determine shape and/or color and can be as described herein Identification and highlight entire element or part thereof.

Hyperlink (for example, web browser can be made to open the optional element of specific web page) usually has certain common Feature.For example, hyperlink is usually shown as the alphanumeric text with underscore, may include domain name (for example, " .com, .net .gov .edu etc. " country code etc.) and can be shown with specific scheme of colour (such as blue text).At image Reason technology can identify these features and correspondingly characterize hyperlink.Once being characterized, so that it may determine shape and/or color simultaneously And such as identification described herein and hyperlink can be highlighted.Image procossing can be used for not only simply just identifying Electrical form, media player and hyperlink further include certain objects, as word processing file, PDF document, figure, table, .jpg .gif .mp3 player .mp4 player .wav file etc..Each type of object usually has specific to its file The common trait of type, the common trait can identify by image processing techniques, as described above.This field it is general Lead to the skilled person will understand that its many modification, modification and alternative embodiment.

Machine learning (for example, being operated by the coating software operated in system 1600) can be used for identifying object, change Into Object identifying and reduce wrong report identification.For example, certain objects may be confirmed as certain types of element (for example, media are broadcast Put device), and actually they are not.This may be due to the fact that image processing software (for example, coating software) can be with Identification may be only certain feature (examples that the user on lantern slide or document may not want that independent highlighted background graphics Such as, the text with underscore, cell or row/column etc..User can be to include but is not limited to provide user's input (for example, pressing Pressure input unit 200 on button) any amount of mode indicate identified element be actually not optional element or Indicate that identified element is not the element (for example, when creating lantern slide on demoware) using software interface.Certain In the case of, wrong report elemental recognition can be automatically.For example, in the element from un-activation wrong identification (for example, not occurring can be with The movement of identification such as webpage is being opened, and media start to play etc.) or in the case that cursor is seldom engaged with element, this can It can indicate that it is not element (for example, if media player never played or hyperlink never (or seldom) and input (example Such as, button is clicked) associated).When specific user continues to use coating software, it is special that various users can be modified at any time Sign, the element determined etc. are to improve accuracy.Those skilled in the art will be understood that its many modification, modification and alternative are real Apply mode.

In some embodiments, user can be used such as coating software instruction and highlight element or not dash forward Display elements out.For example, coating software can indicate to be determined as to protrude aobvious on certain window (for example, lantern slide) The optional element shown.User can verify or refute the determination, this can increase true elemental recognition.

Alternatively or in addition, which member is the accessible specific software of some embodiments include to determine in certain window Element.For example, accessible demoware in each specific lantern slide of determination include which, such as those skilled in the art Understood, each specific lantern slide is easy to get and easily accessed.It should be appreciated that referring to Fig.1 1 description recognition element it is each Kind method can be applied to any attached drawing, embodiment, system or method for being described herein etc., such as the common skill of this field Art personnel are understood.

Referring back to Figure 11, at step 1130, method 1100 may include raw in Window layer above first window At the second window (coating), as above with reference to Fig. 8 A to Fig. 8 B similarly described in.In addition to other any kind of spies It levies except (for example, color, shape etc.), the second layer can be transparent, translucent, opaque etc..The transparent second layer It can permit user and see following window in the clear.Semitransparent layer can be operated so that entire bottom layer image becomes Secretly.In order to create highlighted effect, coating may include transparent region (for example, region of tracking cursor movement) and half Transparent region (for example, remaining area) is so that window " graying " other than transparent region.

At step 1140, according to certain embodiments, method 1100 may include based on the graphical content detected come Change the graphical quality of coating.In some cases, the graphical quality of coating can be with combination from the defeated of input unit It is similar with amplification characteristic to enter highlighting for data (for example, mobile data), such as shows and describes above with reference to Fig. 8 A and Fig. 9 B 's.In some implementations, certain graphical contents can be highlighted but regardless of input data (for example, button press, mobile number According to) how.For example, the object (for example, optional element) detected, such as the electricity of the insertion in demonstration application can be highlighted Sub-table (for example, with reference to Figure 13 B).Alternatively or in addition, daughter element can be identified and highlight, such as referring to figure What 13C further showed and discussed.

It should be appreciated that specific steps shown in Figure 11 are provided according to certain embodiments for based on display Content modify the ad hoc approach 1100 for highlighting function.According to alternative embodiment, other step sequences can also be performed Column.For example, alternative embodiment can be executed in different order the step of being outlined above.In addition, each shown in Figure 11 Step may include multiple sub-steps, these sub-steps can be executed with the various sequences for being suitable for each step.

Furthermore, it is possible to which other step is added or removed according to specific application.For example, some embodiments may include Additionally below the step of: (i) receives input data corresponding with movement of the cursor on first window, and (ii) will be around cursor The transparency in region is set as the first transparency, and (iii) and sets for the transparency of the remainder of coating Two transparencies, so that the region around cursor seems to highlight the corresponding region of the graphical content on first window.This example As shown in figure 13a.

In some embodiments, method 1100 can also include: the optional element in (i) test pattern content, (ii) Determine the shape of optional element, the transparency in the region around optional element is set the first transparency, and (iv) by (iii) The second transparency is set by the transparency of the rest part of coating, so that the region around optional element seems to be highlighted Display.For example, optional element can be built-in the electrical form on demoware (for example, with reference to Figure 13 B).In the situation Under, it can determine shape (for example, rectangular shape that electrical form can be particular size), and the graphical quality of coating can It is transparent to be configured so that coating above optional element, and dimmed in the rest part of coating or part thereof (for example, " graying ").Those skilled in the art will appreciate that its many variations, modification and alternative embodiment.

In some embodiments, method 1100 can also include: the second optional element in (i) test pattern content, (ii) corresponding with movement of the cursor on first window input data is received, and the mobile selection of (iii) based on cursor the One of one optional element or the second optional element, wherein by the setting of transparency be applied to selected first optional element or Selected second optional element.For example, electrical form (optional element) and media player (second can be detected on window Optional element) the two (for example, with reference to Figure 15 A).As below with reference to Figure 14 A and Figure 14 B show and described in, the shifting based on cursor It is dynamic (for example, the degree of closeness and/or the button press on input unit, cursor of cursor and each optional element be located at which as Limit etc.), one of optional element or the second optional element can be highlighted.

In other embodiment, as below with reference to Figure 13 C show and described in, method 1100 may include detection can Select the daughter element in element.For example, method 1100 can be the following steps are included: (i) optional element in test pattern content (for example, image of input unit 1390), (ii) detection include the daughter element (for example, button 1392) in optional element, (iii) shape of daughter element is determined, it is transparent that (iv) by the transparency in the region around supratectal daughter element sets first It spends (for example, transparent), and (v) sets the second transparency (for example, dimmed, line for the transparency of the rest part of coating Physical and chemical, " graying " etc.) so that the region above daughter element seems to be highlighted.In some cases, user can be based on It will highlight from the received input data of input unit from optional element and be switched to one or more corresponding daughter elements.Example Such as, continuous button press can recycle between optional element and daughter element.Similarly, (or other are suitable for continuous button press Input) can trigger and recycled between the daughter element of optional element.In some implementations, method 1100 can also wrap Include: (i) detects the second daughter element of optional element, and (ii) receives input number corresponding with movement of the cursor on first window According to, and (iii) select one of the first daughter element or the second daughter element based on the movement of cursor, wherein by being set to transparency It sets and is applied to selected first daughter element or selected second daughter element.Alternatively or in addition, method 1100 can wrap It includes and is switched between the first daughter element or the second daughter element based on the input data from input unit, wherein will be to transparent The setting of degree is applied to selected first daughter element or selected second daughter element.Therefore, such as ordinary skill people What member was understood, certain embodiments can carry out between optional element in response to receiving mobile data from input unit Switching, and in response to receiving the non-moving number including button press, touch sensor pressing or other suitable input types According to switching between the daughter element in optional element.Any aspect in aspect described above with respect to method 1100 can To be applied to any input unit, host computing device described in present disclosure etc..Those of ordinary skill in the art will recognize that And many modifications, modification and the alternative of understanding method 1100.

Figure 12 is shown according to certain embodiments for highlighting function based on the content modification on display The simplified flowchart of the various aspects of the method 1200 of color.Method 1200 can be by showing and what is described is below with reference to Figure 19 The processor 1902 of system 1900 executes.For illustrative purpose, defeated to describing and quoting in being described below of method 1200 Enter device 200 and host computing device 210.It should be appreciated that as one of ordinary skill in the understanding, can be used and retouch herein Any input unit and/or host computing device stated.

In some embodiments, the feature described herein that highlights is being applied to the window with certain schemes of colour It is likely difficult to see when (for example, presentation slides) or occurs " fading ".For example, if presentation slides, which have, has multiple ashes The various images of shade are spent, then there is the coating of gray tone obscure underlying graphics content and may no longer may be used for application The point seen.By checking the color content of lantern slide, and more specifically checks and highlight color content within and outside the region, it can To use improved scheme of colour is highlighted to ensure during execution highlights function almost without lower layer's graphical content It is obscured.

According to certain embodiments, at step 1210, method 1200 may include reception and cursor on first window The corresponding input data of movement.For example, as one of ordinary skill in the understanding, input data can be input unit 200, computer mouse, track ball controller etc..

At step 1220, method 1200 may include the region limited around cursor.For example, as shown in following FIG. 13 A, Region around cursor can be with predetermined radii (for example, 1 inch or for example related to monitor dots per inch (dpi) Connection other measurement units) circle.As one of ordinary skill in the understanding, region can be any size or shape. In some cases, region can be fixed, user-programmable or dynamic allow to based on corresponding graphical content Size changes shape (for example, change radius).For example, if most of graphical contents include relatively small optional element, Limited area around cursor can be small.Similarly, if graphical content tends to that big limited area can be used greatly.This Field is ordinarily skilled artisan will understand that its many modification, modification and alternative embodiment.

According to certain embodiments, at step 1230, method 1200 be can include determining that and the restriction area around cursor The associated one or more of colors of graphical content in domain.For example, can detecte mass-tone (for example, in limited area most Universal color), it can detecte some or all of colors in limited area, can detecte overall color, or can be by this Other appropriate methods that field those of ordinary skill is understood.

According to certain embodiments, at step 1240, method 1200 be can include determining that and the restriction area around cursor The associated one or more of colors of overseas graphical content.For example, can detecte mass-tone (for example, outside limited area most Universal color), it can detecte some or all of colors outside limited area, can detecte overall color, or can be by this Other appropriate methods that field those of ordinary skill is understood.In some embodiments, such as those of ordinary skill in the art institute Understand, can detecte outside limited area but away from one kind in limited area certain distance dpi or other measurement units Or more color.

According to certain embodiments, at step 1250, method 1200 can include determining that visibility factor, the visibility The factor with and cursor around limited area in the associated one or more of colors of graphical content and and cursor around The difference between the associated one or more of colors of graphical content outside limited area is associated.In other words, in step At 1250, method 1200 can determine whether such as default color collection (for example, grey coating) " will rinse " or cover Any underlying graphics content on one window.Apply when highlighting effect and color of underlying graphics content, it is seen that property because Son can be the score based on the comparison color characteristic of coating or determine value (for example, 0 to 10, wherein the top end in scale can Opinion property height).As one of ordinary skill in the understanding, any suitable methods of marking can be used.As an alternative or in addition Ground, adjustable brightness is to ensure good contrast to improve the visibility of graphical content.

At step 1260, method 1200 may include the limit being arranged around cursor based on identified visibility factor Determine the color in the region in region.Graphical content above wherein on first window mainly includes in the example of gray characteristics, Coating can use the gray background of different brightness or different colours weaken region outside limited area or dimmed, but not Cover graphical content.

It should be appreciated that specific steps shown in Figure 12 are provided according to certain embodiments for based on display Content modification highlight function color ad hoc approach 1200.Other steps can also be executed according to alternative embodiment Rapid sequence.For example, alternative embodiment can be executed in different order the step of being outlined above.In addition, shown in Figure 12 Each step may include multiple sub-steps, and multiple sub-steps can be executed with being suitble to the various sequences of each step.It is some More or less steps can be used in embodiment.For example, in some embodiments, method 1200 can have less Step, the step include that (i) determines color associated with the graphical content on first window, and (ii) is based on identified face Color determines that at least part of color of cursor peripheral region is set identified contrastive colours by contrastive colours, and (iii). Those of ordinary skill in the art understand its many modification, modification and alternative embodiment.Above with respect to (or the method for method 1200 300,400,700,1000 and 1100) description aspect in any aspect can be applied to it is any described in present disclosure Input unit, host computing device etc..Those of ordinary skill in the art will recognize and appreciate that many modifications of method 1200, modification and Alternative.

It in some embodiments, can not when the color for the content being distributed across lantern slide or contrast scheme change Method 1200 is executed together.For example, when the first part of lantern slide than lantern slide second part secretly much when, cursor visibility It can be greatly to change in first area or in the second area according to cursor.In some embodiments, area is limited The color in the region in domain can change according to the position of cursor relative to lantern slide color/contrast scheme.For example, In When loading slide, one or more boundaries can be limited, so that when cursor passes through boundary, region in limited area Color change is to keep visibility of the cursor on lantern slide.In other embodiments, system may be configured to by fixed The color in the region come around continuously updated cursor is sampled to phase to the color in the region around cursor of lantern slide.

Figure 13 A shows the various aspects for highlighting function in the demonstration application according to certain embodiments.It is showing Presentation slides 1310 are shown on device 1300, presentation slides 1310 have the electrical form being embedded on lantern slide 1310 It 1320 and highlights a part of electrical form 1320 and highlights region 1330.Highlighting region 1330 can be interchanged Ground is referred to as " spotlight ".The circle that region 1330 is shown to have specific region is highlighted, however any conjunction can be used Conformal shape or size highlight region 1330.It can be by recognition element (for example, as above for the use described in Figure 11 Image procossing or access software) and the transparency of coating is set highlights region 1330 to generate.In some cases, may be used Region 1330 is highlighted to control based on the movement of cursor.For example, being moved with highlighting mode on lantern slide 1310 Cursor causes the corresponding movement for highlighting region 1330.In some embodiments, when selection highlight function (for example, Button press on input unit 200) when, cursor can be it is sightless, only leave highlight region with prevent cover appoint What lower layer's graphical content.In some cases, cursor may be visible.Those skilled in the art will appreciate that its many change Type, modification and alternative embodiment.

Figure 13 B shows the detection according to certain embodiments and highlights each side of the optional element on display Face.In some embodiments, object (for example, optional element) can be highlighted rather than the region around cursor.That is, generation Move the cursor to that designated position --- it may or may not dash forward completely for the region highlighted around cursor and manually Show special object (for example, electrical form) out, entire optional element or part thereof can be highlighted --- its can or It can not be direct associated with cursor movement.3B referring to Fig.1 highlights optional element (for example, electrical form) (for example, covering Cap rock is transparent in the overlying regions for being identified as optional element 1360), and lantern slide 1350 rest part it is dimmed with Generate comparison (highlighting) effect.It, can be with according to certain embodiments although individual element is illustrated as highlighting Highlight multiple elements.For example, all dvielements can be highlighted when highlighting mutually similar element for the moment (for example, electrical form .jpg, hyperlink etc.) (or its subset).Those skilled in the art will appreciate that its many modification, repairing Change and alternative embodiment.

Figure 13 C shows the detection according to certain embodiments and highlights the various aspects of the daughter element on display. Display 1370 shows that lantern slide 1380, the display lantern slide 1340 include input unit (for example, input unit 200) and various The image of host computing device.As described above, element 1390 (for example, input unit 200) can be identified as by image processing software It can be with highlighted discrete element.In addition, image processing software can be with the shape in element (that is, daughter element) that recognition detection arrives Shape and feature are for highlighting.3C referring to Fig.1, element 1390 include several buttons comprising button 1392 (for example, circle Circle), 1394 buttons 1392 are highlighted using coating as further described above.In some cases, as above into one What step discussed, multiple daughter elements can be highlighted based on class or other measurements.In some implementations, such as below with reference to What Figure 14 was further discussed, user can be by providing input (for example, the button press of input unit 200 on the input device Or mobile) switch between optional element or daughter element.

In some embodiments, spotlight can be changed based on different standards (for example, highlighted region 1330) size.For example, working as cursor under the relatively large some cases of graphic element (for example, text block, image etc.) wherein When hovering on spotlight, the size (for example, radius, region etc.) of spotlight can increase.Similarly, if graphic element Small, then spotlight size can correspondingly reduce.In some embodiments, the size of spotlight can at least partially due to The movement of input unit and change.For example, simultaneously hold button 122 can be such that spotlight occurs (for example, highlighting for pressing 1330), and the movement of input unit 100 can change the size of spotlight.For example, the half of spotlight can be made by moving up Diameter increases, and moving down can be such that the radius of spotlight reduces.In another example, it presses and hold button is (for example, press Button 122) and (for example, as described in the mobile tracing system block 1730 about Figure 17 via one or more gyroscopes, Accelerometer) detect that rotating clockwise for input unit 100 can be such that the radius of spotlight increases, and rotating counterclockwise can be with Reduce radius.Those skilled in the art will appreciate that many modifications, modification and alternative embodiment.

Figure 14 shows the detection according to certain embodiments and highlights the various aspects of the daughter element on display.It is aobvious Show that device 1400 may include the presentation slide with electrical form (that is, optional element 1420), various texts and hyperlink 1470 Piece 1410.Electrical form includes multiple daughter elements, and multiple daughter elements include row, column and cell.Row 1430, column 1440 and unit Lattice 1450 are shown as highlighting, and cell 1450 is further magnified 1460.It, can as described in above for Figure 11 Select element 1420 and its daughter element that can identify via image procossing or user's identification.Although multiple elements are shown in Figure 14 To highlight, but it is to be understood that in this particular example, they are discussed and are handled as they are by independent prominent aobvious Show (for example, not highlighting other elements or daughter element) with simplify explanation, however, some embodiments can use it is polynary Element highlights scheme.Those skilled in the art will appreciate that its many modification, modification and alternative embodiment.

In some embodiments, user can be by providing input to input unit (for example, input unit 200) Switch between optional element.For example, user can control the movement of cursor and by clicking element (for example, distributing to protrusion The button of display function) select one in several elements.In some cases, button or button group can be in optional members It is recycled between plain (for example, optional element 1420 and 1470).Referring to Fig.1 4, user can by mobile input device 200 and/or Pressing is programmed to the button recycled between daughter element to recycle between daughter element 1430 to 1450.For example, user can be with By selecting electricity towards the mobile cursor of electrical form (or mobile without cursor) and far from hyperlink (for example, optional element 1470) Sub-table (for example, optional element 1420).Once user can be via corresponding button press (for example, being designated as by selecting In the button for being recycled between highlighted optional element/daughter element) or input unit it is mobile to be followed between daughter element Ring.In the case where wherein selecting and highlighting row 1430, subsequent button press can be switched to column 1440, be then responding to Cell 1450 is switched in third button press.In some embodiments, once having selected row 1430, subsequent movement Other rows can be highlighted.The design can be applied to column and cell selection.

It in some embodiments, can be by multiple functional applications in specific optional element.For example, working as coating software When determining that optional element 1420 is electrical form and further identifies each row, column and cell, corresponding text can analyze Size and also allow to be more easily seen small text using amplification characteristic (1460) automatically other than highlighting And details.In some cases, multiple functions can be configured with automatic or manual.Those skilled in the art will appreciate that it is many Modification, modification and alternative embodiment.

In some embodiments, image procossing can be in real time and/or dynamic is handled.For example, electrical form can have There are hundreds of row data, wherein only occurring small subset on lantern slide at a specific time.Coating software can detecte use When family for example rolls the electrical form of insertion, this causes the change of image.As indicated above, in function spreadsheet application In, electrical form can be identified as by coating software can independent highlighted multiple identifiable shapes and sizes --- Not necessarily it is identified as cell.Therefore, when rolling, which can be the optional element of identification and the shape of daughter element Variation, image procossing can more new images and its corresponding element/daughter element.Can in real time, regularly, in response to detection To the variation of image or with any suitable frequency or in response to any event, to execute identification.Ordinary skill people Member is it will be understood that its many modification, modification and alternative embodiment.

In the presence of can choose optional element to carry out highlighted a variety of methods.For example, user can be (via covering Layer software is identified by image procossing) optional element top (for example, via input unit 200) moves cursor and selection can Select element.Alternatively or in addition, user can be mobile towards optional element by cursor, and coating software can determine use In highlighted expected element.Figure 15 A and Figure 15 B show according to the selection of certain embodiments for it is highlighted can Select two kinds of distinct methods of element.

Figure 15 A show according to the determinations of certain embodiments will highlighted optional element over the display each side Face.Display 1500 includes the window 1510 (for example, presentation slides) for being divided into four quadrant I to IV.Implement shown in In mode, optional element 1530 is the electrical form in quadrant I, and optional element 1550 is the media player in quadrant II, can Select that element 1535 is chart in quadrant III and optional element 1540 is the hyperlink in quadrant IV.It can be by by cursor Particular quadrant is moved to select optional element to be highlighted.For example, if cursor movement is highly sensitive (example Such as, quickly move) or if element is very small and be difficult to be selected with cursor, this can be advantageous.Reference Figure 15 A, cursor 1560 is moved to quadrant II from quadrant IV by user, and media player is automatically highlighted 1552.In Under some cases, if cursor is located at any position of quadrant, the corresponding optional element in the quadrant can be highlighted. There may be multiple optional elements to be located at the situation in single quadrant.In this case, it may be implemented with circulation (referring to upper Face description as described in Figure 14) combine quadrant selection.Those skilled in the art will appreciate that its many modification, modifying and replacing Select embodiment.

Figure 15 B show according to the determinations of certain embodiments will highlighted optional element over the display each side Face.Optional element can be selected for highlighting based on the relative distance of optional element and cursor.For example, can choose most Close optional element (or daughter element) is for highlighting.5B referring to Fig.1, display 1500 include having optional element 1530,1535,1540 and 1550 window 1510 (for example, presentation slides).Cursor 1560 is located at away from hyperlink (optional element 1540) at the second distance 1572 at first distance 1570, away from media player (optional element 1550), away from electrical form At the third distance 1574 of (for example, optional element 1530) and at the 4th distance 1576 away from chart (optional element 1535). As one of ordinary skill in the understanding, it can be used including DPI or other any suitable measurements suitably measured Unit measures distance.Cursor 1560 is correspondingly highlighted near hyperlink, the hyperlink and (highlights 1552).Though So there has been described it is determined that highlight the two methods of which element, but any suitable highlight can be used Algorithm.In some embodiments in embodiment shown in various figures, the scheme of highlighting conforms to highlight Optional element or daughter element shape.In some cases, it highlights and can have circular edge, sharpened edge, or It can be the shape different from the selected element of lower layer.It can be used including its shape, size, color, texture (for example, pattern) Deng any type of highlight.Those skilled in the art will appreciate that its many modification, modification and alternative embodiment.

As one of ordinary skill in the understanding, although many embodiment general descriptions described herein such as The input unit and personal computer (for example, host computing device 210) of demonstration device (for example, input unit 200), but it is various general Thought can be applied to other kinds of input unit and computing device.For example, the various aspects of system 1700 are (for example, operation input Device 200) can be included in computer mouse, track ball controller, PlayStation 3 videogame console/PS3, remote controllers (for example, with In TV) or other suitable devices in.Host computing device 210 can be home entertainment system or any suitable system (example Such as, it is operated by the various aspects of system 1600).In embodiments described herein some embodiments describe use button, movement Detection and/or touch detection realize some functions in functions described herein (for example, highlight, amplify), however Other input methods, such as voice control can be used.Some embodiments can combine one in functions described in this article A little functions.For example, the button on push input device 200 can make master computer play media file on the media player. However, pressing and keeping same button that the volume control function for example, by moving up and down the modulation of input unit 200 may be implemented. Similarly, push button can choose image (for example.jpg), and press and keep to show with screen mode toggle image, and And application scales and highlights feature.In some cases, highlighted size or amplification quantity can be based on graphical content Feature and change.Very small text may include high magnifying power, and big text may include relatively small magnifying power. Some embodiments in amplification (for example, amplification quantity) mode or can highlight mode (for example, highlighting the shape in region Shape/size/color) between switch.Some highlight may include bounds (for example, solid line), soft-sided circle (for example, gradually light Or ramp edge), dynamic effect (for example, animation when image is switched to screen mode toggle from normal mode) etc..This field Ordinarily skilled artisan will understand that its many modification, modification and alternative embodiment, and present disclosure should never limit possibility Myriad applications, regardless of whether being expressly recited.

Figure 16 A shows the reference axis that inertial reference system is limited relative to input unit 100, and input unit 100 can be Rotation in the inertial reference system.In some embodiments, the sensor of such as gyroscope and/or magnetometer can be positioned in To track one or more movements of the input unit 100 in shown axis 1602,1604 and 1606 in device 100.It is defeated Entering device can be used for that cursor or spotlight is guided to mark the shifting across demonstration display around the rotary motion of axis 1602 and 1604 It is dynamic, and input unit 100 can be used for adjusting another operating parameter of input unit 100 around the rotation of axis 1606.Some In embodiment, when input unit 100 is sensed and generally higher than around other two axis around the rotation of axis 1606 When any rotation, then it can ignore input unit 100 and surround any accidental movement of other two axis, to prevent cursor or poly- The undesirable movement of light beacon light note.

Figure 16 B shows the exemplary control scheme being used together with input unit 100.Center button 124 and lower part are pressed Button 126 can operate in a similar way.Demonstration can be made to push ahead a lantern slide for example, clicking center button 124, and And click lower button 126 can will demonstration retreat a lantern slide.Similarly, double-click button 124 or 126 can will demonstration to The lantern slide of preceding mobile predetermined quantity or the end for being moved to demonstration always.Press and keep center button 124 can increase with The value of the related context property of the present mode of input unit 100.Similarly, it presses and keeps lower button 126 that can subtract The value of small context property.In some embodiments, it can be rotated by pressing and hold button and around specific axis defeated Enter device 100 to change attribute.In such a configuration, variable quantity can depend on the rotation amount detected.Context property It can take various forms.For example, attribute can be cursor associated with the movement of input unit 100 or spotlight label Size and/or shape.The setting can also refer to the material amount selected on the screen.For example, thinking that user attempts to select in system In the case where particular item on screen, center button 124 or lower button 126 is kept to can reduce or increase just in choice area domain Size.Attribute can also be related with the opacity that cursor or spotlight mark.

Figure 16 B also shows the different modes that center button 124 can be operated with it.Clicking top button 122 can select Select the object shown on demonstration display or hyperlink.Double-clicking top button 122 can be used between different operation modes Circulation.For example, operation mode may include cursor mode and spotlight mode.Under spotlight mode, label can be using tool There is round, rectangle or other polygonal shapes the form for highlighting region.User, which can be used, highlights region by force Adjust or highlight the various pieces of lantern slide.In some embodiments, when entering spotlight mode, the label of spotlight It can seem the side for being frozen in the present slide shown on such as screen or the remote location in corner.Pressing is simultaneously It keeps center button 124 to can permit user to pass through around one or both of axis 1602 and 1604 rotation input device 100 Carry out across screen transfer spotlight label.It should be noted that axis 1602 and 1604 limits inertial reference system relative to input unit 100 Reference axis.

Once spotlight label is located in desired position by user, user can discharge top button 122, gather at this time Light beacon light note keeps freezing on the spot.Once user discharges top button 122, user can surround 1606 rotation input device of axis 100 to influence the setting of other contexts.For example, if the size of pressing and the adjustment spotlight label of hold button 124 and 126, It then can be used for adjusting color, opacity and/or the contrast of spotlight label around the rotation of axis 1606.In some implementations In mode, spotlight marks the only appearance when pressing and keeping top button 122, and optically focused can be made by discharging top button 122 Beacon light note disappears and input unit 100 returns to cursor mode.In some embodiments, when user keeps input unit Relatively it is stable reach predetermined amount of time when, can freeze spotlight label.For example, not detecting any of input unit 100 After essence rotation 3 seconds, spotlight label can freeze on the spot in presentation screen.

Figure 16 B also shows the top button 122 (for example, with reference to Fig. 1 C to Fig. 1 D) with a variety of input types can be as What improves function.For example, clicking for only engaging with the first contact portion of top button 122 can be used for selecting under cursor mode Select object, and can be with by clicking of being engaged with both the first contact portion and the second contact portion of pressing top button 122 completely Start the activation of object.In some embodiments, it presses and keeps top button 122 that can activate optically focused up to predetermined amount of time Lamp mode, user can freely transfer spotlight label in display screen periphery at this time.Once it is fixed that user marks spotlight In desired position, user can press top button 122 more at full tilt to engage the second of top button 122 the contact for position Portion, to make spotlight, original place is freezed on a display screen.Once freezing, label associated with input unit 100 can restore To cursor mode.In some embodiments, temporarily actuating top button 122 can release the spotlight label freezed again. In some embodiments, cursor can be used for adjusting some aspects of the spotlight label freezed.In some embodiments, Once spotlight label is frozen, so that it may which different attribute is distributed to the different rotary axis of input unit 100.For example, can be with Change mark size by the rotation around axis 1606, and can be by around corresponding axis 1602 and 1604 rotation input dress Set 100 come adjust opacity, contrast and such as shape other label association attributes.

It include the implementation for being capable of providing the pressure sensor of pressure-sensitivity feedback of wide scope in wherein top button 122 In mode, other input schemes may be implemented.For example, spotlight mode can be activated to the light press of top button 122, and by Gradually heavier input can gradually decrease the speed that spotlight label is advanced relative to the rotation of input unit 100 across screen.In Demonstrator wish by spotlight mark it is briefly stable above the specific part of display without fully charge spotlight mark In the case where, gradually decreasing for speed can be advantageous.The movement to slow down gradually may also help in demonstrator and freeze completely Accurate position is limited before tying spotlight label for spotlight label.In some embodiments, when sensing and freeze completely When tying spotlight and marking corresponding threshold pressure, haptic system associated with top button 122 can be with one or more Vibration input alerts user.It should be noted that various vibration modes can be associated from different input type and threshold value.Some In embodiment, top button 122 be may be configured so that when top button 122 is fully actuated with engaging electrical contact portion When, the first input signal is generated, and be also configured such that, when providing the pressure of sufficient amount, haptic system provides positive feedback The second input signal has been generated to alert user.In other embodiments, when more and more high-caliber power is applied to When portion's button 122, the amount of touch feedback can be increased.

Figure 17 A shows description for adjusting ginseng associated with spotlight label by the rotation for measuring input unit The block diagram of several methods.At 1702, the inertial sensor in input unit 100 may be configured to measurement around 3 or more The rotation of any one of multiple rotary shafts.Specifically, these axis may include axis 1602,1604 and 1606.In some realities It applies in mode, in order to continue this method, the threshold quantity of rotation should be measured before proceeding to 1704.At 1704, if Not enabled spotlight mode, then input unit 100 can ignore the rotation detected and continue to monitor.In some embodiments In, it is necessary to it enables spotlight mode and spotlight label must be freezed to proceed to 1706.At 1706, surrounded when detecting When such as the rotation of the axis of axis 1606 and the rotation are more than threshold value, method can continue.In some embodiments, threshold value can To be dynamic threshold.For example, being detected if detecting a large amount of rotations (referring to Figure 16 A) around axis 1602 and 1604 It can be generally higher than around the threshold value of the rotation of axis 1606 and detect the very small rotation for surrounding axis 1602 and 1604 or do not having There is the threshold value of the rotation in the case where rotating.At 1708, in order to measure detected rotation amount, can establish with reference to orientation with Determine the amount and type of variation.In some embodiments, when starting spotlight mode, input unit 100 can be saved Initial orientation.Then can be used spotlight activation when the initial orientation come measure the user of input unit 100 wish how Change special parameter.When parameter is related to the size or scaling of spotlight label, rotating clockwise can be with the size phase of increase It is associated with and rotation can be associated with reduced size counterclockwise.In some embodiments, 45 degree are rotated from initial orientation It can star the activation of size variation.Rotation between 45 degree and 90 degree can increase or decrease the rate of size variation generation. By input unit 100 back to neutral position can cause size be for good and all set as spotlight label select recently it is big It is small.

Figure 17 B to Figure 17 D shows the mode that input unit 100 can be rotated around the longitudinal axis 1710.Although the institute from Figure 17 B The rotation of rotation position shown in the neutral position shown to Figure 17 C will not generate the rotation only around the longitudinal axis 1710, but should Migration is dynamic to be mainly aligned with the longitudinal axis 1710.Similarly, input unit is in opposite direction from position shown in Figure 17 B to Figure 17 D Shown in the rotation of position be also limited primarily to the movement around the longitudinal axis 1710.In some embodiments, user can be by hand Position shown in Figure 17 C or Figure 17 D is maintained at until reaching desired parameter or attribute value, user can return to hand at this time To position shown in Figure 17 B.In other embodiments, it may be necessary to which input unit 100 surrounds the continuous rotation of its longitudinal axis To adjust certain devices or label relevant parameter.

Figure 18 A to Figure 18 D is shown can manipulate spotlight label after freezing 1802 original place of spotlight label 1802 various modes.Figure 18 A shows the most spotlight label 1802 for occupying lantern slide 1804.Figure 18 B is shown By adjusting spotlight label 1802 around rotary shaft rotation input device 100 associated with size or scale attributes How the size of spotlight label 1802 can be reduced after size attribute.It is more than threshold value that Figure 18 C, which shows input unit 100, The patterns of change that how can cause that spotlight label 1802 is made to become laser facula label 1806 further rotated.Some In embodiment, laser facula label 1806 can be virtual and mobile in a manner of identical with spotlight 1802 and behaviour Make.In some embodiments, laser can be indicated by shiny red.In some embodiments, the conversion of mode can cause The activation of the visible spectrum laser of input unit 100.In any configuration, the size for increasing spotlight 1802 can be by laser shape The spotlight 1802 of formula changes back to spotlight label.However, in some embodiments and as shown in Figure 18 D, once place Under virtual laser mode, the adjustable laser size of the increase of size is until reaching maximum laser spot size value.Once reaching It arrives, so that it may restore spotlight label.In other embodiments, once receiving the increase of mark size, so that it may again Enable spotlight mode.Although giving the example for changing size attribute by rotation, but it is to be understood that other can be used Button and type of user interface realize described adjustment.

Realize the exemplary computing system of embodiment herein

Figure 19 is shown according to certain embodiments for operating one or more elements as demo system The system of host computing device.Computer system (" system ") 1900 can be used to implement appointing above for Fig. 1 to Figure 15 discussion What host computing device.Computer system 1900 may include one or more processors 1902, one or more place Reason device 1902 can be communicated via bus subsystem 1904 with many peripheral units (for example, input unit).These peripheries Device may include storage subsystem 1906 (including memory sub-system 1908 and file storage subsystem 1910), user interface Input unit 1614, user interface output device 1916 and network interface subsystem 1912.

In some instances, internal bus subsystem 1904 can provide the various parts for making computer system 1900 The mechanism communicated with each other as expected with subsystem.Although internal bus subsystem 1904 is schematically depicted as single total Line, but the alternative embodiment of bus subsystem can use multiple buses.In addition, network interface subsystem 1912 can be used Act on the interface that data are transmitted between computer system 1900 and other computer systems or network.Network interface subsystem 1912 embodiment may include wireline interface (for example, Ethernet, CAN, RS232, RS485 etc.) or wireless interface (for example,BLE、Wi-Fi, cellular protocol etc.).

In some cases, user interface input unit 1914 may include demonstration device (for example, input unit 100/ 200), keyboard, fixed-point apparatus (for example, mouse, trace ball, touch tablet etc.), the touch screen being integrated in display, audio input Device (for example, speech recognition system, microphone etc.), man-machine interface (HMI) and other kinds of input unit.In general, using Term " input unit " be intended to include all possible types for entering information into computer system 1900 device and Mechanism.In addition, user interface output device 1916 may include display subsystem, printer or non-vision display, such as sound Frequency output device etc..Display subsystem can be the display device of any known type.In general, using term " output device " purport It is including device and mechanism for all possible types from 1900 output information of computer system.For example, display device can To be the independent subsystem carried out wireless communication with the processing unit of computing system.As an alternative, computing system can be knot Close the single device of built-in display device subsystem.

Storage subsystem 1906 may include memory sub-system 1908 and file storage subsystem 1910.Subsystem 1908 Non-transient computer readable storage medium is indicated with 1910, can store the function for the embodiment that present disclosure is provided Program code and/or data.In some embodiments, memory sub-system 1908 may include multiple memories, described more A memory includes the main random access memory (RAM) (RAM) 1918 for the instruction and data during storing program execution and can To store the read-only memory (ROM) 1920 of fixed instruction.File storage subsystem 1610 can mention for program and data files It for lasting (that is, non-volatile) storage, and may include magnetic or solid hard disk drive, optical drive and phase Associated removable media (for example, CD-ROM, DVD, blue light etc.), the driver based on removable flash memory or card and/or ability Other kinds of storage medium known to domain.Storage subsystem 1906 can store soft about the various masters of Fig. 1 to Figure 18 D description Part is (for example, the coating software such as further discussed above, software, media detection software, protrusion for " no sleep " function Show software etc.) it realizes.

It should be appreciated that computer system 1900 is embodiment party that is illustrative and being not intended to limit this disclosure content Formula.It is also possible with many other configurations than the more or fewer components of system 1600.Various embodiments can be with It is realized in various operating environments, the operating environment may include that can be used for operating multiple answer in some cases One or more subscriber computers, computing device or the processing unit of any application in.User apparatus or client dress Setting may include any general purpose personal computer in multiple general purpose personal computers, such as operation standard or non-standard operation system The desktop computer or laptop computer of system, and run mobile software and can support multiple network and messaging protocol Cellular devices, wireless device and hand-held device.For the purpose such as developed with data base administration, such system can also be wrapped Include the multiple work stations for running any various commercially available operating systems and other known applications.These devices may be used also To include other electronic devices, such as virtual terminal, thin-client, game system and its that can be communicated via network His device.

Most cases are supported using at least one network familiar to those skilled in the art using any various The communication of commercially available agreement such as TCP/IP, UDP, OSI, FTP, UPnP, NFS, CIFS etc..Network can be for example It is local area network, wide area network, Virtual Private Network, internet, Intranet, extranet, Public Switched Telephone Network, infrared network, wireless Network and any combination of them.

In the embodiment using network server, network server can run any various servers or middle layer Using, including HTTP server, ftp server, CGI server, data server, java server and service application service Device.Server can also be able to respond for example to be executed by executing one or more applications in the request from user apparatus Program or script, one or more feet that one or more application may be implemented as writing with any programming language This or program, the programming language include but is not limited toC, times of C# or C++ or such as Perl, Python or TCL What scripting language and combinations thereof.Server can also include database server, including but not limited to fromWithCommercially available database server.

Such device can also include computer-readable storage media reader, communication device (for example, modulation /demodulation Device, network interface card (wirelessly or non-wirelessly), infrared communications set etc.) and working storage as described above.Computer-readable storage medium Matter reader can be connect with non-transient computer readable storage medium, or be configured to accommodate that non-transient computer is readable deposits Storage media, the non-transient computer readable storage medium indicate remote storage, local storage, fixed-storage device And/or removable storage device and computer-readable for provisionally and/or more permanently including, storing, transmit and retrieve The storage medium of information.System and various devices usually will also include multiple soft at least one working storage device Part application, module, service or other elements, at least one working storage device includes operating system and such as client is answered With or browser application program.It should be appreciated that alternative embodiment can have perhaps compared with implementations described above Multiple changing type.For example, it is also possible to which it is (including portable to be implemented in hardware, software using the hardware and/or particular element of customization Formula software, such as applet) or the two in.Furthermore, it is possible to using with such as network inputs/output of other computing devices The connection of device.

The example of system for operation input device

Figure 20 is the simplification frame according to the system 2000 for being configured to operation input device 100/200 of certain embodiments Figure.System 2000 includes processor 2010, operation logic 2020, mobile tracing system 2930, communication system 2040, input detection System 2050 and electric power management system 2060.It is logical that each of system block 2020 to 2060 piece can carry out electricity with processor 2010 Letter.System 2000 can also include being not shown or being discussed to prevent the addition line for obscuring novel feature described herein System.

In some embodiments, processor 2010 may include one or more microprocessors (μ C) and can be by It is configured to the operation of control system 2000.As an alternative, as one of ordinary skill in the understanding, processor 2010 can wrap Include one or more microcontrollers with the hardware and/or firmware (for example, memory, programmable I/O etc.) supported (MCU), digital signal processor (DSP) etc..As an alternative, MCU, μ C, DSP etc. can be configured in the other systems of system 1700 In block.For example, operation logic block may include for control automatic receptor described herein/BLE connection procedure (for example, Referring to Fig. 3 to Fig. 4), overlay process (for example, with reference to Fig. 5 to the native processor of Fig. 7) etc..In some embodiments, more A processor can provide the performance of enhancing in terms of 1700 speed of system and bandwidth.Although should be noted that multiple processors can To improve 1700 performance of system, but multiple processors are not required for the standard operation of embodiment described herein.

As above for described in Fig. 1 to Figure 18 D, operation logic 2020 may include that can execute and input unit 100/200 associated various steps, any combination of the software of operations and functions, firmware or hardware.For example, such as above for Described in Fig. 2 to Fig. 4, operation logic 2020 can control the layering connection scheme of input unit 100/200.Operation logic 2020 can control the various embodiments and in this disclosure above for Fig. 5 to Fig. 7 covering layer function described It is described and/or support any other function (for example, highlight, scale, intelligent ON/OFF, without sleep pattern etc.).Operation Logic 2020 can be stored in the program code and/or data that can store the function for the embodiment for providing present disclosure Any suitable non-transient computer readable storage medium in.That is, can store will be by processor (example for operation logic 2020 Such as, processor 2010) execute one or more software programs.It should be appreciated that " software " may refer to instruction sequence, it is described Instruction sequence makes certain of the execution software program of system 2000 when being executed by processing unit (for example, processor, processing unit etc.) A little operations.Instruction can be stored as the firmware resided in read-only memory (ROM) and/or be stored in medium storage device The application that can be read into memory to be handled by processing unit.Software may be implemented as single program or list The set of only program, and can be stored in non-volatile memory device, and all or part of during program executes Ground is copied to volatile working memory.Processing unit can retrieve the program instruction for execution from storage subsystem, To execute various operations as described in this article (for example, automatic coupling --- Fig. 3 to Fig. 4).In some embodiments, with The associated memory of operation logic 2020 may include RAM, ROM, solid-state memory, based on magnetically or optically storage system, Removable media (for example, " thumb actuator ", SD card, device based on flash memory) known in the art other kinds of is deposited Storage media.Those skilled in the art will appreciate that its many modification, modification and alternative embodiment.

Mobile tracing system 2030 may be configured to the movement of tracking input unit 100.In some embodiments, may be used To use one or more accelerometers to carry out mobile detection.Accelerometer can be configured to measure acceleration (for example, Static force and dynamic force) electromechanical assembly (for example, MEMS (MEMS) device).One or more accelerometers can be with For detecting three-dimensional (3D) positioning.For example, 3D tracking can use three axis accelerometer or two twin-axis accelerometers.Acceleration Meter can provide may include input unit 100 speed, the mobile data of physical orientation and acceleration.For example, as closed above It is discussed in Fig. 5 to Fig. 8, mobile tracing system 2030 can provide mobile data to master computer to control the light on screen Mark.In some embodiments, gyroscope can substitute accelerometer and use or be used in combination with accelerometer, to determine movement Or input unit orientation.Mobile tracing system 2030 can report mobile message to processor 2010.

According to certain embodiments, communication system 2040 may be configured to provide input unit 100/200 and host computer Wireless communication between device.Communication system 2040 can use any suitable wireless communication protocol --- and it is any suitable logical Believe that agreement includes but is not limited to be based onCommunication protocol (for example, BLE), IR, Wi-Fi(IEEE 802.11)、Thread、Agreement or other suitable communication technologys --- to promote input unit Nothing between 100/200 and host computing device (for example, any host computing device in host computing device 210,220,240,250) Line two-way communication.System 2000 can be optionally included to be connect with the hardwire of host computing device.For example, input unit 100 can To be configured to accommodate universal serial bus (for example, USB-C) cable to realize between input unit 100 and host computing device Two-way electronic communication.Some embodiments can use different types of cable or connection protocol standard to establish and other entities Hard-wired communications.

As further described above for Fig. 1, input detection systems 2050 may be configured to detection input unit 100 On one or more buttons, the touch on touch sensitive surface etc. or touch posture.As understood by those of ordinary skill in the art , input detection systems 2050 may include one or more touch sensitive surfaces, touch sensor, button, control or other use Family interface.Touch sensor generally includes to be adapted to detect for signal such as directly contact, electromagnetic field or electrostatic field or electromagnetic radiation beam Sensing element.Touch sensor may be configured to detect the variation of signal, the presence of signal or the signal received not At least one of in the presence of.

Electric power management system 2060 may be configured to the electric power distribution of management input unit 100, recharge, electrical efficiency Deng.In some embodiments, electric power management system 2060 may include battery (not shown), for battery based on USB's It is used for each subsystem in recharging system (not shown), electrical management device and system 2000 (for example, accelerometer, top Spiral shell instrument etc.) power grid of electric power is provided.In some embodiments, the function of being provided by electric power management system 2060 can be combined Into processor 2010.Power supply can be replaceable battery, rechargeable energy storage means (for example, supercapacitor, lithium are poly- Close object battery, NiMH, NiCd) or corded power feeding mechanism (for example, via the port USB-C --- referring to Fig. 1).This field is general Lead to the skilled person will understand that its many modification, modification and alternative embodiment.

It should be appreciated that system 2000 is illustrative and variants and modifications are possible.System 2000 can have this Locate other not specifically described abilities (for example, mobile phone, global positioning system (GPS), electrical management, one or more Photographic device, various connectivity ports for connecting external device (ED) or accessory etc.).Although in addition, being described referring to specific piece and being System 2000, but it is to be understood that these blocks define in order to facilitate description, and are not intended to imply that the specific of component part Physical layout.In addition, these blocks not necessarily correspond to physically different components.Block may be configured to for example by processor Control circuit appropriate is programmed or provided to execute various operations, and depends on how to obtain initial configuration, it is various Block can be or can not be reconfigurable.Embodiments of the present invention can include using any of circuit and software It combines and is realized in the various equipment for the electronic device realized.In addition, the various aspects of system 2000 and/or part can be according to designs It needs to combine with other subsystems or by other subsystem operations.For example, operation logic 2020 can in processor 2010 into Row operates rather than is used as individual entity.Aforementioned embodiments are not intended to restrictive, and ordinary skill people Member is under the benefit of present disclosure it will be understood that myriad applications and possibility.

Other modifications are in the spirit of present disclosure.Therefore, although disclosed technology allows various modifications and alternative Construction, but its certain illustrative embodiment is shown in the accompanying drawings and has been described above and is described in detail.However, It should be understood that, it is not intended to present disclosure is limited to disclosed (one or more) particular form, on the contrary, the present invention will It covers all modifications fallen into the spirit and scope of present disclosure as defined by the appended claims, alternative constructions and waits Jljl.

It is unless otherwise indicated or clearly contradicted by context, otherwise in the upper of the disclosed embodiment of description Hereinafter (especially in the context of appended claims) term " one ", "one" is with "the" and similar deictic words makes It is both singular and plural with that should be interpreted to cover.Unless otherwise noted, otherwise term " includes ", " having ", "comprising" and " contain Have " it should be interpreted open-ended term (i.e., it is intended that " including but not limited to ").Even if term " connection " is also answered there are intermediary In being interpreted to be partially or fully contained in, it is attached to or is bonded together.Phrase " being based on " should be understood it is open and And it is not limited in any way, and be intended to be explained or be otherwise read as " at least partly in appropriate situations Ground is based on ".Unless otherwise indicated, otherwise numberical range herein is enumerated to be intended merely as relating separately to and is fallen in range Each individual value stenography method, and herein each individual value be integrated into this specification, as it is independent It enumerates the same.It is unless otherwise indicated herein or clearly contradicted by context, otherwise it can execute in any suitable order All methods described herein.Unless stated otherwise, otherwise any and all examples or exemplary language (example provided herein Such as, " such as ") use be meant only to that the embodiment of present disclosure is better described, without to scope of the present disclosure structures At limitation.Language in specification be not necessarily to be construed as indicating any element being not claimed to practice present disclosure must not It can lack.

Claims

1. a kind of input unit, comprising:

Wireless communication unit is configured in the input unit establish between the demo system for controlling vision demonstration Radio communication channel；

Inertial sensor is configured to monitor the input unit relative to by orthogonal first axle, the second axis and third axis The rotation of the inertial reference system of restriction；

Processor is configured in response to the input unit and is more than threshold value around the rotation of the first axle and generates first Signal, first signal are used to be transmitted to the demo system by the wireless communication unit to adjust by the input unit The perceptual property of the display label of control, the threshold value is based on the rotation relative to second axis or the third axis detected Turn amount and change, and the processor is further configured to generate second signal when being less than the threshold value, second letter Number for by the wireless communication unit being transmitted to the demo system for controlling the vision demonstration, with according to surrounding institute State the position of the rotation adjustment display label of the second axis and the third axis；And

Device housing surrounds the wireless communication unit, the inertial sensor and the processor.

2. input unit according to claim 1 further includes user interface, the user interface includes first discrete pressing Button, the second discrete buttons and third discrete buttons.

3. input unit according to claim 1, wherein the threshold value is 30 degree.

4. input unit according to claim 1, wherein the perceptual property is the size of the display label.

5. input unit according to claim 1, wherein the input unit is hand-held apparatus for demonstrating, and described is drilled Show that system includes display device.

6. input unit according to claim 1, wherein the first axle is aligned with the longitudinal axis of described device shell.

7. input unit according to claim 6, wherein adjusting the perceptual property includes in response to described device shell It is rotated along first direction around the first axle and increases the perceptual property, and wherein, adjusting the perceptual property includes In response to described device shell along second direction opposite to the first direction around described in first axle rotation and reduction Perceptual property.

8. a kind of method for using input unit control by the label shown in demo system, which comprises

Radio communication channel is established between the input unit and the demo system；

User's input is received at the user control of the input unit；

First control signal is sent to the demo system to change the size of the label；

Continue to receive user's input at the user control；And

Second control signal is sent to the demo system and is being shown with changing in response to reaching the threshold value of user's input The type of the label shown.

9. according to the method described in claim 8, wherein, reaching described by pressing the user control up to predetermined time amount Threshold value.

10. according to the method described in claim 8, wherein, the user control is discrete buttons.

11. according to the method described in claim 10, wherein, being more than first pressure amount in response to user input and sending institute First control signal is stated, and wherein, is more than the second pressure amount bigger than the first pressure amount in response to user input And send the second control signal.

12. according to the method for claim 11, wherein the discrete buttons include for measure be applied to it is described it is discrete by The pressure sensor of amount of pressure on button.

13. according to the method for claim 11, wherein the discrete buttons include for sense the first pressure amount and The first contact portion and the second contact portion of the second pressure amount.

14. a kind of method for using input unit control demo system, which comprises

In response to the rotation of the input unit, it includes described in the demo system that the display across the demo system, which is transferred, The label for highlighting region of display；And

Freeze the position of the label on the display in response to receiving input at user control, so that described defeated The rotation for entering device no longer transfers the label across the display.

15. according to the method for claim 14, wherein the user control is discrete buttons.

16. according to the method for claim 15, wherein the input is the first input, and the method also includes sound Ying Yu receives the second input at the discrete buttons, and the operation mode of the input unit is switched to from first mode Two modes.

17. according to the method for claim 16, wherein in the second mode, the label includes cursor, the light Mark the element for being configured to select to be shown by the display of the demo system.

18. according to the method for claim 14, further includes:

When the position of the label is frozen on the display, adjusted in response to the rotation of the input unit The perceptual property of the label.

19. according to the method for claim 18, wherein the perceptual property is the size of the label.

20. according to the method for claim 14, wherein the input is the second input, and second input includes The user control is discharged, and wherein, the method also includes in response to receiving the first input at the user control And the operation mode of the input unit is switched to second mode from first mode, first input includes keeping pressing institute State user control.