TWI602092B - Calibration of an input device to a display using the input device - Google Patents

Description

Technique for calibrating the input device with a display using an input device

The present invention relates to techniques for calibrating an input device to a display using an input device.

An input device (eg, a digital pen, a mouse, an indicator, etc.) can be used in conjunction with a display device (eg, a touch screen device) for controlling an computing device. For example, a user can manipulate a digital pen to input information to an computing device (eg, a laptop computer, a desktop computer, a tablet computer, a mobile device (eg, a smart phone), etc.). In some examples, the user can gesture or move the digital pen to create a corresponding media, text, message, command, and the like. The input device can detect or retrieve its movements (example handwriting, strokes, etc.) due to the user to convert information corresponding to the movement (eg, text, graphics, commands, etc.) into digital data.

According to an embodiment of the present invention, an apparatus is specifically provided, comprising: a position detector for determining a geometric position of a coded film of one of the display devices of one of the computing devices relative to a pixel array of the display; a geometric position; an offset calculator that determines a position between the positioning code film and the geometric position of the pixel array And an interface manager that calculates a calibration transition to be used by the device to control the computing device based on the offset.

100‧‧‧ computing system

110‧‧‧Input device

112‧‧‧ Calibrator

114‧‧‧Sensor

116‧‧‧Input controller

118‧‧‧Device indicator

120‧‧‧ arithmetic device

122‧‧‧ display

210‧‧‧ position detector

220‧‧‧ offset calculator

230‧‧‧Interface Manager

240‧‧‧Communication bus

310‧‧‧Sensor Controller

320‧‧‧film type analyzer

330‧‧‧Pixel Analyzer

420‧‧‧ Positioning code film

422‧‧‧Location points

424‧‧‧Area

430‧‧‧pixel array

432‧‧‧ reference pixels

434‧‧‧Information

500,600‧‧‧ procedures

510~540, 610~630‧‧‧ program block

700‧‧‧ Processor Platform

712‧‧‧ processor

714‧‧‧Electrical memory

716‧‧‧ Non-electrical memory

718‧‧ ‧ busbar

720‧‧‧Interface circuit

722‧‧‧ input device

724‧‧‧Output device

726‧‧‧Network

728‧‧‧Many storage devices

732‧‧‧ coding instructions

1 is a schematic diagram of an exemplary computing system that can implement an exemplary input device that includes a calibrator constructed in accordance with the teachings of the present disclosure.

2 is a block diagram of an exemplary calibrator that can be used to implement the calibrator of FIG. 1 in accordance with the teachings of the present disclosure.

3 is a block diagram of an exemplary position detector that can be implemented by the calibrator of FIG. 2 in accordance with the teachings of the present disclosure.

4A and 4B are diagrams showing exemplary images of a display of the computing system of FIG. 1 , which may be by the exemplary input device of FIG. 1 , the exemplary calibrator of FIG. 2 , or the exemplary position detector of FIG. 3 . The analysis is used to calibrate the display device to the display in accordance with the teachings of the present disclosure.

5 is a flow diagram representation of one illustrative machine readable instruction that can be executed to implement the calibrator of FIG. 2 in accordance with one aspect of the present disclosure.

6 is a flowchart representation of one other exemplary machine readable instruction that can be executed to implement the calibrator of FIG. 2 in accordance with one aspect of the present disclosure.

7 is a block diagram of an exemplary processor platform capable of executing the instructions of FIG. 5 or FIG. 6 to implement the calibrator of FIG.

The drawings are not drawn to scale. When possible, the same Reference numerals will be used throughout the drawings and the accompanying written description to mean the same or similar parts. When any portion (eg, a layer, film, region, or plate) recited in this patent is positioned (eg, positioned, positioned, disposed on, or formed on) another portion in any manner, it is meant that the reference portion and the other portion Contact, or the reference portion is located above the other portion, at least one intermediate portion being located between the two portions. The statement that any part is in contact with another part means that there is no intermediate part between the two parts.

An example disclosed herein relates to calibrating an input device to a display using one of the computing devices of an input device. In the examples disclosed herein, the input device can detect the positioning of the encoded film and one of the pixel arrays of the display with respect to one of the displays using a sensor. The input device can identify a misalignment between the positioning code film of the display and the pixel array of the display and interpret the misalignment by calculating a calibration transition to be used to control the computing device.

A positioning code film on a display of a computing device (eg, a laptop computer, a desktop computer, a tablet computer, etc.) can be used by an input device (eg, a digital pen) to determine its relative to a The location of the display. The position-coding film includes a position-coding pattern (eg, an identifiable or detectable point, a mark, etc.) having one of the anchor points. These anchor points may not be detectable to the human eye and thus do not affect viewing the display. For example, the anchor points may include infrared (IR) ink or near IR ink that can be detected by an IR sensor or a camera capable of detecting IR light. An input device can be continuous or continuous Emulating the IR light and capturing the image of the positioning code film (and the reflected IR light), and analyzing the images based on the geometric positions of the captured image and the input device 110 (using any suitable technique) To determine the position of the input device relative to the positioning code film.

In some examples, a positioning code film may not be properly positioned on a display and may not properly correspond to one of the displays. In other words, the positioning code film may not be properly aligned with the display. This can result in manufacturing errors, user placement errors, sliding of the positioning code film over time, and the like. For example, the film may be offset from the center or axis of the display, causing the computing device to be uncontrollable or properly operated because the input device "thinks" that its position on the display is different from the actual position. The examples disclosed herein can be used to calibrate an input device for use with a positioning film and a display using one of the computing devices of the input device itself. The examples disclosed herein are used to improve the accuracy of an input device (e.g., within 300 microns) when calibrating the input device to a display.

An exemplary apparatus disclosed herein includes a position detector for determining a first coordinate of a positioning code film and a second coordinate of a pixel array, the first coordinates corresponding to a display of the device relative to an arithmetic device a position of the positioning code film, the second coordinates corresponding to a position of the device relative to a pixel layer of the display, the device further comprising an offset calculator, the offset calculator determining that the first A first offset between the coordinates and the second coordinates, and the device includes an interface manager that calculates a calibration transition based on the first offset for controlling the computing device.

One exemplary method disclosed herein includes determining a first coordinate of the positioning code film based on a first positioning point of a positioning code film, the first coordinates corresponding to the positioning of an input device relative to a display of an computing device a position of the encoded film; determining a second coordinate of the pixel array based on the first reference pixel of the display, the second coordinates corresponding to the position of the input device relative to the pixel array of the display; Positioning a first offset between the first coordinates of the encoded film and the second coordinates of the array of pixels; and calculating a calibration transition based on the first offset to control the computing device.

1 is a schematic diagram of an exemplary computing system 100 that includes an input device 110 constructed in accordance with the teachings of the present disclosure. The exemplary computing system 100 includes an input device 110 and an arithmetic device 120. In the example disclosed herein, input device 110 is used to control computing device 120 of FIG. The input device 110 of FIG. 1 can be communicatively coupled to the computing device 120 via a wireless communication link (eg, Bluetooth, Wi-Fi, etc.) or a wired communication link (eg, a universal serial bus (USB)).

In the example shown in FIG. 1, input device 110 is a digital pen, but input device 110 can be implemented by other types of input devices (eg, a mouse, a pointer remote, etc.). Input device 110 facilitates user control of computing device 120. For example, the user can use the input device 110 to draw an image on the display 122, write text, select an item (eg, by displaying a portion of the icon associated with the item by touching the display 122, or pressing the input device 122). One button). The exemplary input device 110 includes a sensor 114 that reads in accordance with the teachings of the present disclosure. The items on display 122 (eg, location information, reference pixels, etc.) are taken or detected. The illustrated detector 114 of Figure 1 can be implemented by a camera or other type of optical sensor, such as an infrared (IR) sensor.

The input device 110 of FIG. 1 includes a device indicator 118. Device indicator 118 of exemplary input device 110 can be in physical contact with display 122 to control computing device 120. The input device 110 of FIG. 1 includes an input controller 116 (which may be implemented, in part or in whole, by the processor platform 700 of FIG. 7) that facilitates control of the input device 110 or computing device 120. Therefore, the input controller 116 can control the power setting, control settings, communication settings, user interaction, and the like of the input device 110. For example, input controller 116 can detect contact with display 122 via device indicator 118 and control computing device 120 based on this contact with the screen. The exemplary input device 110 can also include a position sensor such as an accelerometer that monitors, measures, or determines the orientation or movement of the input device 110. The exemplary input controller 116 can control the input device 110 or the computing device 120 based on the measurements of the positioning sensors.

The input device 110 of the example shown in Figure 1 includes a calibrator 112. The exemplary calibrator 112 of FIG. 1 can be used to calibrate the input device 110 to control the computing device 120 in accordance with the teachings of the present disclosure. The calibrator 112 of FIG. 1 uses the positioning information detected or captured by the sensor 114 (as disclosed below) to adjust the settings of the input device 110 or computing device 120 to control or calibrate the input device 110 or computing device 120. An illustrative implementation of one of the calibrators 112 is disclosed below with reference to FIG.

The exemplary computing device 120 of Figure 1 can be any type of transport Computing device (such as a laptop, a desktop computer, a tablet computer, etc.). The computing device 120 of FIG. 1 includes a display 122. The exemplary display 122 of FIG. 1 can be a liquid crystal display (LCD), a light emitting diode (LED) display, or any other type of display. Thus, the exemplary display 122 of FIG. 1 includes a pixel array including LCD pixels, LED pixels, and the like. In some examples, display 122 of FIG. 1 is a touch screen that facilitates receiving user input by using input device 110 or with one hand or finger touch (or any other touch of a user) display 122. In the examples disclosed herein, display 122 can be used to calibrate input device 110 to display 122 in accordance with input device 110 to enhance control of computing device 120 when input device 110 is used (eg, by boosting input device on detection display 122) 110 touch position accuracy).

The exemplary display 122 of FIG. 1 includes a positioning code pattern of one of the positioning points (please refer to FIG. 4) to enable the input device 110 to determine (eg, during calibration, during operation, etc.) relative to the display 122 or relative to the display The position of the layers. The exemplary positioning code pattern can be included in one of the display 122 to position a coded film or layer (eg, one of the outer surfaces of the display 122 (eg, a cover glass) to position the coded film, one of the cover plates 122 and the cover glass A layer of alignment between one of the pixel layers of the display is encoded on the film, etc.). The exemplary positioning code film can be attached to the display 122 during or after manufacture. For example, the positioning code film can be a removable film that can be replaced or adjusted on display 122. The locating points of the locating code pattern of the locating coded film may include points, marks, etc. that are identifiable or detectable (eg, via IR light), as described above. Therefore, the display 122 of FIG. 1 is used for It is pointed out that the positioning of the input device 110 relative to one of the displays 122 and the positioning of one of the pixel arrays of the display facilitates control of the computing device 120.

In some examples disclosed herein, a holder can be used to maintain input device 110 statically positioned above display 122 of computing device 120. For example, such a holder can be attached to computing device 120 or display 122 to enhance the stability of input device 110 relative to display 122 or computing device 120.

2 is a block diagram of an exemplary calibrator 112 that can be used to implement the calibrator 112 of FIG. The exemplary calibrator 112 of FIG. 2 includes a position detector 210, an offset calculator 220, and an interface manager 230. The calibrator 112 of the example shown in FIG. 2 includes a communication bus 240 that facilitates communication between the position detector 210, the offset calculator 220, and the interface manager 230.

The exemplary position detector 210 of FIG. 2 controls a sensor (eg, sensor 114) of an input device (eg, input device 110) to determine a calibration point for the input device in accordance with the teachings of the present disclosure. A calibration point, as used herein, is a location of an input device (e.g., input device 110) relative to an operational device (e.g., one of display 122 or one of display 122) during calibration of input device 110 and display 122. In other words, when a calibration point is to capture the image of the positioning code film and the pixel array for calibrating the input device 110 to the display 122, the display device 110 (or part of the input device, such as the device indicator 118) is on the display 122. One of the positioning or location. Position detector 210 of FIG. 2 (eg, based on a reference pixel or a plurality of reference pixels at one of the locations of one of the positioning code films) to determine one of the displays 122 A geometric position of the code film relative to one of the geometric positions of one of the pixel arrays of display 122. In some examples, position detector 210 detects the pattern of the positioning code film of display device 122 to determine a position of the input device relative to the positioning code film of display 122. The position detector 210 of FIG. 2 can also detect the position of the reference pixel presented on the display 122 to determine a position of the input device 110 relative to a pixel array of the display 122, or a geometric position of the positioning code film relative to the pixel array. . In the example disclosed herein, the position detector 210 determines, at each calibration point, the location of the positioning device 110 relative to one of the display 122 for positioning the encoded film, and the pixel of the input device 110 relative to the display 122, in accordance with the teachings of the present disclosure. A positioning of the array. An exemplary implementation of position detector 210 is disclosed below with reference to FIG.

The exemplary offset calculator 220 of FIG. 2 calculates an offset between a position of the input device 110 relative to one of the display 122 and a position of the input device relative to a pixel array of the display 122. Therefore, the offset calculator 220 can receive positioning information of the input device 110 relative to the positioning code film (xy coordinates of the positioning code film), and positioning information of the input device 110 relative to a pixel array of the display 122 (eg, the pixel) The xy coordinates of the array). Based on the positioning information (eg, x-y coordinates), the offset calculator 220 can determine an offset (eg, a positioning difference) between the positioning coded film of the display 122 and one of the pixel arrays of the display 122.

In some examples, offset calculator 220 of FIG. 2 calculates a plurality of offsets between a plurality of locations of input device 110 and corresponding locations of the positioning code film and pixel array. Therefore, the offset calculator 220 can repeatedly calculate the positioning code film and the pixel determined by the input device 110 between the display 122. The offset between the arrays. For example, a first offset can be calculated for one of the first calibration points located near one of the first locations of the display 122 (eg, the upper left corner), and can be located near a second location of the display 122 (eg, a lower right corner) One of the second calibration points calculates a second offset. The exemplary offset calculator 220 provides an offset calculation to the interface manager 230 for calibrating the input device 110 to control the computing device 120.

The exemplary interface manager 230 of FIG. 2 calculates a calibration transition based on the determined offset or the determined offset calculated by the offset calculator 220 for controlling an arithmetic device (eg, computing device 120). For example, based on the calculated offsets, the interface manager 230 can determine that one of the displays 122 is positioned to rotate, translate, scale, distort, etc. the encoded film. In this example, based on the determined characteristics of the display device 122 (eg, the geometric position of the positioning code film), the interface manager 230 can be instructed to adjust the control settings for the computing device 120 based on the calibration transition. . More specifically, when the device indicator 118 contacts the display 122 at a particular location, the input device 110 can provide control coordinates for the touch location that are different from calculating the calibration transition and adjusting the control settings based on the calibration transition. The control coordinates provided. Thus, in the example disclosed herein, the calibrator 112 of the input device 110 calibrates the input device 110 with the display 122 to enhance control (eg, accuracy improvement) of the computing device 120.

Although FIG. 2 illustrates one exemplary manner of implementing the calibrator 112 of FIG. 1, at least one of the components, programs, or devices illustrated in FIG. 2 can be combined, distinguished, rearranged, omitted, eliminated in any other manner. Or implementation. Furthermore, the position detector 210, the offset calculator 220, and the interface manager of FIG. The 230 or more general exemplary calculator 112 can be implemented by any combination of hardware or hardware and executable instructions, such as software or firmware. Thus, for example, any of position detector 210, offset calculator 220, interface manager 230, or more exemplary calibrator 112 can be implemented by an analog or digital circuit, a logic circuit, At least one of a planning processor, an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a programmable logic device (FPLD) is implemented. At least one of the position detector 210, the offset calculator 220, or the interface manager 230 is clarified in this document when reading any of the patented device or system claims to cover a pure software or firmware implementation. Defined to include a tangible computer readable storage device or storage disk storing such executable instructions, such as a memory, a digitally diverse optical disc (DVD), a compact disc (CD), a Blu-ray disc, and the like. Still further, the exemplary calibrator 112 of FIG. 2 may include at least one component, program, or device in addition to or as shown in FIG. 2, or may include more than one Any or all of the components, programs, and devices.

3 is a block diagram of an exemplary position detector 210 that can be used to implement position detector 210 of calibrator 112 of FIG. The exemplary position detector 210 of FIG. 3 includes a sensor controller 310, a film pattern analyzer 320, and a pixel analyzer 330. The exemplary position detector 210 of FIG. 3 determines the position of an input device (eg, input device 110) by analyzing an image of a positioning code film and a reference pixel of a pixel array. In the example disclosed herein, position detector 210 of FIG. 3 may be offset from one of an input device (eg, input device 110), such as calibrator 112 (eg, offset calculator 220). Or other components connected to help one A display, such as display 122, calibrates the input device.

The exemplary sensor controller 310 of FIG. 3 controls a sensor 114 (eg, a camera or other optical sensor) of the input device 110 to capture an image of the display 122 of the computing device 120. The sensor controller 310 can adjust the settings of the sensor 114 to capture the images based on the intended image of the captured image. For example, the first setting can be used to capture an image of the positioning code film (or a positioning code pattern) of the display 122, and the second setting can be used to capture an image of a reference pixel of one of the pixel arrays of the display 122. More specifically, the sensor controller 310 can direct the sensor 114 (eg, using an optical band pass filter) to detect IR light to detect the location of the positioning code film. In this example, the sensor controller 310 can also control one of the IR emitters of the sensor 114 for detecting the positioning points of the positioning code film. Furthermore, the sensor controller 310 of FIG. 3 can instruct the sensor 114 to adjust the settings to detect reference pixels (eg, pixels located at a designated location (eg, a corner, a center, etc.) of the pixel array, such The reference pixels are illuminated for detection by the sensor 114. For example, the sensor controller 310 can implement a near IR filter to capture an image of the pixel array (and reference pixel(s)). More specifically, the sensor controller 310 can adjust the filter of the sensor 114 to detect longer visible wavelength light (eg, "red") emitted by pixels from the reference pixels. In other words, for example, the reference pixels can be red. Moreover, in some examples, to capture images of the pixels or reference pixels, the sensor controller 310 can turn off one of the IR emitters of the sensor 114, turn on the sensor 114 again, and control the image. Capture exposure time, control extended image integration (eg using near IR filters or no near IR filters).

In some examples, the sensor controller 310 can instruct the computing device 120 to present the reference pixel in a particular manner (via the calibrator or an input device communication link with the computing device 120). For example, the sensor controller 310 can request the computing device 120 to maximize one of the reference pixels' brightness or color (eg, red). In such an example, this may increase the amount of light passing through one of the IR filters of the sensor 114. In some examples, when a holder is used, a shutter can be used around the input device 110 to limit the amount of light around one of the to-be-detected. Thus, in such an example, sensor 310 can signal a user via calibrator 112, input device 110, or computing device 120 to place input device 110 within a holder or a shadow holder. In some examples, the sensor controller 310 can determine the characteristics of the environment of one of the input device 110 or the display 122 and instruct the user, the computing device 120, or one of the input devices to adjust the respective settings, based on The judged characteristics are used to calibrate the input device 110 to the display 122.

After the sensor controller 310 of FIG. 3 determines or provides the appropriate settings for capturing the image of the display 122 to the sensor 114, the sensor controller 310 receives or retrieves the corresponding image of the display 122. The sensor controller 310 of FIG. 3 forwards the image of the positioning code film of the display 122 to the film pattern analyzer 320 and forwards the image of the reference pixels or pixel array of the display 122 to the pixel analyzer 330. In some examples, the same image including both the positioning coded film and the (or other) reference pixels can be sent to the film pattern analyzer 320 and the pixel analyzer 330 for analysis. The exemplary film pattern analyzer 320 and the exemplary pixel analyzer 330 can be implemented by an image processor or a plurality of image processors.

The exemplary film pattern analyzer 320 of FIG. 3 identifies one of the positioning code films of the display 122. For example, the film pattern analyzer 320 can identify all or part of the positioning code pattern on the positioning code film that contains one of the positioning points. Thus, the film pattern analyzer 320 can use any suitable image processing technique to analyze the image captured by the sensor 114 and detect the type of location captured by the sensor.

Based on the identified pattern, the film pattern analyzer 320 of FIG. 3 can determine a position of the input device 110 relative to the positioning code film of the display 122. In the examples disclosed herein, the positioning code pattern of the positioning code film may be standard or may be planned for the input device (eg, stored on the input device 110 or one of the computing devices 120). Therefore, the film pattern analyzer 310 can cross-reference the detected pattern with the positioning code pattern of the positioning code film to determine a position of the input device 110 relative to the positioning code film. In some examples, the membrane pattern analyzer 320 can consider one of the orientations of the input device 110 when capturing the images (eg, by retrieving or receiving orientation data/information from one of the input devices 110). Accordingly, the film pattern analyzer 320 can detect (eg, when the input device is positioned perpendicular to the positioning code film) a pattern that exactly matches a portion of the positioning code pattern of the positioning code film, or due to the input device 110 One of the orientations is similar or proportional to one of the positioning coding patterns. Accordingly, pixel analyzer 330 can determine the coordinates of the pixel array that correspond to the location of input device 110 relative to the pixel array of display 122. Therefore, the film pattern analyzer 320 can determine the x-y coordinates of the positioning code film, and the x-y coordinates correspond to the position of the input device 110 relative to the positioning code film of the display 122 (refer to the figure). 4A).

The exemplary pixel analyzer 330 of FIG. 3 identifies one or a plurality of reference pixels in the pixel array of the display 122. In some examples, pixel analyzer 330 can identify one of the corner pixels of the pixel array that the display is receiving from the captured image of sensor controller 310. In some examples, pixel analyzer 330 can detect one of the designated reference pixels in the array of pixels. For example, a designated reference pixel can be detected based on characteristics (eg, color, position, etc.) of the reference pixel. In some examples, a plurality of reference pixels can be used. The pixel analyzer 330 can determine a position of the input device 110 relative to the pixel array of the display 122 based on the position of the detected reference pixel in the captured image. Since the reference pixel is in a fixed or known position, the pixel analyzer 330 can determine the pixel array of the input device 110 relative to the display 122 by determining the distance and direction from the reference pixel (or the set of reference pixels). The location. In some examples, similar to the film pattern analyzer 320, the pixel analyzer 330 can consider one of the orientations of the input device 110 based on the measurements obtained by an accelerometer when capturing the image of the (equal) reference pixel. Accordingly, pixel analyzer 330 can determine the coordinates of the pixel array that correspond to the location of input device 110 relative to the pixel array of display 122 (see FIG. 4B).

Although shown in FIG. 3 as an exemplary manner of implementing the position detector 210 of FIG. 2, at least one of the elements, programs, or devices illustrated in FIG. 3 can be combined, distinguished, rearranged, omitted, in any other manner. Eliminate or implement. Furthermore, the sensor controller 310, the membrane pattern analyzer 320, the pixel analyzer 330, or the more general position detector 210 of FIG. 3 may be by hardware or Hardware is implemented in any combination with executable instructions such as software or firmware. Thus, for example, any of sensor controller 310, membrane pattern analyzer 320, pixel analyzer 330, or more general position detector 210 can be implemented by an analog or digital circuit, a logic circuit, Implemented by at least one of a programmable processor, an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a programmable logic device (FPLD). At least one of the sensor controller 310, the membrane pattern analyzer 320, or the pixel analyzer 330 is in reading any of the patented device or system claims to cover a pure software or firmware implementation. This document is expressly defined to include a tangible computer readable storage device or storage disk storing such executable instructions, such as a memory, a digitally diverse optical disc (DVD), a compact disc (CD), a Blu-ray disc, and the like. Still further, the exemplary position detector 210 of FIG. 3 may include at least one component, program, or device, or may include more than one, in addition to or as shown in FIG. Show any or all of the components, programs, and devices.

4A and 4B illustrate exemplary images of the display 122 of FIG. 1 , which may be analyzed by the input device 110 of FIG. 1 , the calibrator 112 of FIG. 2 , or the position detector 210 of FIG. 3 for The teachings of the present disclosure calibrate the input device 110 to the display 122. FIG. 4A illustrates an exemplary image of a positioning film 420 of one of the displays 122, and FIG. 4B illustrates an exemplary image of a pixel array 430 of the display 122. The exemplary images of the positioning code film 420 and the pixel array 430 can be retrieved during a calibration procedure (sequentially or simultaneously in any order) in accordance with the teachings of the present disclosure. In some examples, input device 110 is in the same orientation relative to display 122 of both Figures 4A and 4B. Or almost the same positioning.

In the example shown in FIG. 4A, the positioning code film 420 of the display 122 can be located above or below one of the cover glasses of the display 122. The exemplary positioning code film 420 includes a plurality of positioning points 422 distributed throughout the positioning code film 420 for forming a positioning code pattern. The exemplary positioning points 422 of FIG. 4A are not evenly distributed such that the input device 110 can identify its position relative to the positioning code film during control operations (ie, to control operation of the computing device 120) and during calibration. Accordingly, the exemplary input device 110 can access the positioning code pattern of the anchor point 422 to determine its position relative to the position encoding film 420. In some examples, the localization code film 420 may only be detectable using IR light. Therefore, the exemplary image of the positioning code film and the positioning point can be regarded as having been taken under infrared light.

In FIG. 4A, exemplary input device 110 can detect an anchor point 422 within an area 424 (shown by a dashed line) to determine a position of input device 110 relative to positioning code film 420. The exemplary region 424 of FIG. 4A can be an area within the range of one of the sensors 114 of the input device 110. Therefore, in FIG. 4A, to determine a position of the input device 110 relative to the positioning code film, the input device 110 can project IR light in the region 424 of the positioning code film and capture an image of the region 424. Based on the detected pattern 426 of the anchor point 422 within the region 424, the input device 110 can determine its position relative to the position encoding film 420 of the display 122. For example, the film pattern analyzer 320 can compare the pattern captured in the region 424 with the one of the positioning code film 420 to store the copy or version of the positioning code pattern to determine the input device 110 relative to the positioning code film 420. The location. By comparing the captured pattern with the storage The (or known) positional coding pattern, the film pattern analyzer 320 uses any suitable image processing and analysis (e.g., orientation analysis of the input device 110) to determine the position of the input device 110.

The exemplary pixel array 430 of Figure 4B is any pixel array (e.g., LCD, LED, etc.) suitable for presenting media, information, applications, etc. to a user via the display. For example, the pixel array 430 can present a desktop, a background image, an application (eg, a calibration application), and the like. In the example shown in FIG. 4B, pixel array 430 of display 122 is presenting to be detected by input device 110 for calibrating one of reference pixels 432 of input device 110 to display 122. In FIG. 4B, pixel array 430 is also presenting a message 434 to a user (a person who calibrates one of input devices 110 to display 122). In some examples, message 434 can direct the user to place input device 110 at a particular location (eg, above reference pixel 432). In the example shown in FIG. 4B, the reference pixel 430 is located in the upper right corner of one of the displays 422. In some examples, reference pixel 432 can be an actual corner pixel (eg, the upper right pixel of display 122) or any other positioned pixel located in pixel array 430. In some examples, display 122 can present reference pixels 432 having certain characteristics (eg, color, brightness, etc.) such that input device 110 can detect reference pixels 432. Additionally or alternatively, a plurality of reference pixels similar to reference pixels 432 may be present (eg, to present a particular shape or pattern on display 122). In some examples, input device 110 or computing device 120 can transmit settings or instructions for rendering or detecting reference pixels 432.

In FIG. 4B, the exemplary input device 110 is at the reference pixel location. The reference pixel 432 is detected during an image capture region 434 of the sensor 114 (eg, located in an area similar to region 424). For example, the sensor 114 can capture an image of the pixel array 430 within the region 434 where the reference pixel 432 is intended or desired (eg, an area below the input device 110). After capturing an image of the reference pixel 432 (eg, using the specific settings of the sensor 114 to detect the reference pixel 432), the pixel analyzer 330 of FIG. 3 can determine the input device based on the position of the reference pixel in the image. A position relative to the pixel array 430. For example, using image processing and input device orientation measurements (from an accelerometer), pixel analyzer 330 can determine the distance and direction from reference pixel 432 using any suitable image processing technique.

Thus, using the captured images shown in FIGS. 4A and 4B, the exemplary input device 110 itself can be calibrated to the display 122 in accordance with the teachings of the present disclosure for enhancing control of the computing device 120.

5 and 6 show a flow diagram representative of exemplary machine readable instructions for implementing the calibrator 112 of FIG. In these examples, the machine readable instructions comprise a program(s) executed by a processor, such as in the exemplary processor platform 700 described below with reference to FIG. Processor 712 is shown. The program/program can be embodied as an executable instruction (such as software) stored on a tangible computer readable storage medium, such as a CD-ROM, a soft disk, a hard disk. Machine, a digitally diverse optical disc (DVD), a Blu-ray disc or a memory associated with the processor 712, but the overall program/program or portion thereof may alternatively be executed by a device different from the processor 712 Or specifically implemented as a firmware Or exclusive hardware. Moreover, although the (equal) exemplary program is illustrated with reference to the flowcharts of FIGS. 5 and 6, many other methods of implementing the exemplary calibrator 112 may alternatively be used. For example, the order of execution of the blocks may be changed, or some of the blocks may be changed, eliminated or combined.

The exemplary routine 500 of FIG. 5 begins at the beginning of one of the calibrators 112 (eg, upon startup, upon receipt of an instruction from a user, when a device (eg, input device 110) implementing the calibrator 112 is activated, enters a calibration mode Time, etc.). The routine 500 in the example of FIG. 5 can be performed to determine an offset between a positioning code film and a pixel array of a display, and a calibration transition is calculated based on the offset. The illustrative process 500 of FIG. 5 can be repeated repeatedly. In some examples, the routine 500 can be repeated repeatedly, and an averaging calculation can be performed for determining an offset between the positioning code film and the pixel array.

At block 510 of FIG. 5, the film pattern analyzer 320 of the position detector 210 determines the coordinates of the positioning code film of the display 122, which coordinates correspond to a position of the input device 110. For example, in block 520, the film pattern analyzer 320 can analyze the image of the positioning code film captured by the sensor 114, and compare the images with the positioning code pattern of the positioning code film to determine The coordinates. At block 520, the pixel analyzer 330 of the position detector 210 determines the coordinates of the pixel array, the coordinates corresponding to the location of the input device. For example, in block 520, the pixel analyzer 330 can analyze an image of a reference pixel, and the image is the image taken from the same position as the positioning code film to determine the input device relative to the pixel array. The location.

In FIG. 5, at block 530, offset calculator 220 calculates an offset between the coordinates of the positioning code film and the coordinates of the pixel array. In some examples, at block 530, the offset calculator 220 can calculate a plurality of offsets corresponding to the plurality of calibration points. At block 540, based on the calculated offset, the interface manager 230 calculates a calibration transition to control the computing device based on the offset. For example, at block 540, the interface manager 230 can calculate the rotation, translation, distortion, scaling of the positioning code film relative to one of the pixel arrays for controlling the computing device 120 with the input device 110. At block 540, the routine 500 of FIG. 5 ends. In some examples, after block 540, control may return to block 510 to perform another iteration of block 500 (eg, for another calibration point of input device 110).

The illustrative process 600 of FIG. 5 begins at one of the calibrators 112. The routine 600 in the example of FIG. 6 can be performed to determine an offset between a positioning code film and a pixel array of a display, and a calibration transition is calculated based on the offset. At block 610, the calibrator 112 determines a first offset at a first calibration point of the input device 110 to calibrate the input device to the display 122 of the computing device 120. In some examples, program 500 (or a portion thereof) of FIG. 5 may be performed to implement program 610 of FIG. At block 620, the calibrator 112 calculates a second offset at one of the second calibration points of the input device 110 to calibrate the input device to the display. In some examples, the routine 500 (or portion thereof) of FIG. 5 may be repeatedly executed to implement the program 610 and the program block 620 of FIG. At blocks 610 and 620, the calculator can perform similar operations to calculate the offsets at the respective calibration points. For example, at blocks 610 and 620, calibrator 112 can determine one of display 122 to position the encoded film The coordinates and coordinates of one of the pixel arrays of the display, the coordinates corresponding to one of the input devices 110 (i.e., one of the calibration points). At blocks 610 and 620, the calculator 112 can then calculate the difference between the coordinates of the positioning coded film and the coordinates of the array of pixels to determine the offsets.

At block 630, the calibrator 112 calculates a calibration transition based on the first offset and the second offset. For example, calibrator 112 (eg, via interface manager 230) can calculate that the positioning coded film is rotated relative to one of the pixel arrays, or the positioning coded film is translated relative to one of the pixel arrays. In some examples, a plurality of offsets can be used to calculate the distortion of the positioning coded film relative to the pixel array, or the scaling of the positioning coded film relative to the pixel array. After block 630, the process 600 ends.

As described above, the exemplary programs of FIGS. 5 and 6 can be implemented using coded instructions (eg, computer or machine readable instructions), which can be stored on a tangible computer readable storage medium, such as a hard disk drive, A flash memory, a read-only memory (ROM), a compact disc (CD), a digitally diverse disc (DVD), a cache memory, a random access memory (RAM) or any other The information stores any duration of storage or storage (eg, extended periods, permanent, for short, for temporary buffering, or for caching the information). The term tangible computer readable storage medium, when used herein, is specifically defined to include any type of computer readable storage device or storage disk, and to exclude propagating signals and to exclude transmission media. " Tangible computer readable storage media" and "tangible machine readable storage media" are used interchangeably herein. Additionally or alternatively, the illustrative procedures of Figures 5 and 6 The instructions may be implemented using coded instructions, such as computer or machine readable instructions, which may be stored on a non-transitory computer or machine readable medium, such as a hard disk drive, a flash memory, or a read only Memory, a disc, a digitally diversified disc, a cache memory, a random access memory or any other storage device or storage disc that can store information for any duration (eg extended time, permanent, simple example) For the purpose of temporary buffering, or for caching the information). The term non-transitory computer readable medium, as used herein, is specifically defined to include any type of computer readable storage device or storage disc, and to exclude propagating signals and to exclude transmission media. As used herein, the term "at least" is used as an open term when it is used as a transition in one of the preceding claims. "an" or variations thereof, when used in the context of a particular element, are not necessarily limited to a single element. The word "or" as used herein is used for concatenation and is not considered to be an "exclusive or" unless otherwise indicated.

7 is a block diagram of an exemplary processor platform 700 that is capable of executing the instructions of FIG. 5 or FIG. 6 to implement the calibrator 112 of FIG. 2 or the position detector 210 of FIG. The exemplary processor platform 700 can be any device or can be included in any type of device, such as an input device (eg, input device 110, a digital pen, a mouse, an indicator, etc.), a mobile device (eg, a A mobile phone, a smart phone, a tablet, etc., a PDA, or any other type of computing device.

The processor platform 700 of the example shown in FIG. 7 includes a processor 712. The processor 712 of the illustrated example is hardware. For example, processor 712 It can be implemented by at least one integrated circuit, logic circuit, microprocessor or controller from any desired series or manufacturer.

Processor 712 of the illustrated example includes a region memory 713 (e.g., a cache memory). The processor 712 of the illustrated example is in communication with a main memory including an electrical memory 714 and a non-electrical memory 716 via a bus 718. The power-dependent memory 714 can be implemented by synchronous dynamic random access memory (SDRAM), dynamic random access memory (DRAM), RAMBUS dynamic random access memory (RDRAM), or any other type of random access memory. The device is implemented. The non-electrical memory 716 can be implemented by flash memory or any other type of memory device. Access to the main memory 714, 716 is controlled by a memory controller.

The processor platform 700 of the illustrated example also includes an interface circuit 720. The interface circuit 720 can be implemented by any type of interface standard, such as an Ethernet interface, a universal serial bus (USB), or a high speed peripheral component interconnect (PCI) interface.

In the illustrated example, at least one input device 722 is coupled to interface circuit 720. The input device(s) 722 permit a user to enter data and commands to the processor 712. The input device(s) can be, for example, an audio sensor, a microphone, a camera (still life or video type), a keyboard, a button, a touch screen, and a track-pad. , a trackball, isopoint or a speech recognition system to implement.

At least one output device 724 is also coupled to the interface circuit 720 of the illustrated example. The output device 724 is implemented by a display device (for example, a light emitting diode (LED), an organic light emitting diode (OLED), A liquid crystal display, a touch screen, a tactile output device, a light emitting diode (LED), a printer or a speaker). The interface circuit 720 of the illustrated example may thus include a graphics driver card, a graphics driver chip, or a graphics driver processor.

The interface circuit 720 of the illustrated example also includes a communication device, such as a transmitter, a receiver, a transceiver, a data modem or a network interface card, to facilitate communication via a network 726 (eg, an Ethernet network) A connection, a digitized subscriber line (DSL), a telephone line, a coaxial cable, a cellular telephone system, etc., exchanges data with an external device (eg, any type of computing device).

The processor platform 700 of the illustrated example also includes at least one mass storage device 728 for storing executable instructions (e.g., software) or material. Examples of such a mass storage device 728 include a floppy disk drive, a hard drive drive, a compact disc drive, a Blu-ray disc drive, a RAID system, and a digital versatile compact disc (DVD) drive.

The encoding instructions 732 of FIGS. 5 and 6 can be stored in a plurality of storage devices 728, in the area memory 713, in the electrical memory 714, in the non-electrical memory 716, or in a tangible form such as a CD or DVD. On a computer readable storage medium.

From the foregoing description, it will be appreciated that the methods, apparatus and articles disclosed above enable an input device to be used to calibrate itself with a display of an operational device for enhancing or enhancing the accuracy of controlling the computing device. In the examples disclosed herein, the input device can use one of the input devices to determine its position relative to a display to position the encoded film and the pixel array of one of the displays. The input device can use the feeling The image captured by the detector calculates an offset or a set of offsets due to misalignment of the positioning code film and the pixel array. With a high degree of accuracy (e.g., within 300 microns), the input device can then be calibrated to enhance control of the computing device (e.g., drawing, writing, pressing, etc.). The examples disclosed herein allow the positioning code film of a display to be removable or adjustable, as the input device may itself be calibratable to the adjustable positioning code film.

Although certain exemplary methods, devices, and articles of manufacture have been disclosed herein, the scope of coverage of this patent is not limited thereto. On the contrary, this patent covers all methods, devices, and articles that are within the scope of the patent application.

100‧‧‧ computing system

110‧‧‧Input device

112‧‧‧ Calibrator

114‧‧‧Sensor

116‧‧‧Input controller

118‧‧‧Device indicator

120‧‧‧ arithmetic device

122‧‧‧ display

Claims (14)

A calibration apparatus comprising: a position detector that determines a geometric position of a position of a display device of one of the computing devices relative to a geometrical position of a pixel array of the display, the determination being by Determining a first coordinate of the positioning code film, the first coordinates corresponding to a position of the device relative to the positioning code film; determining a second coordinate of the pixel array, the second coordinates corresponding to the device relative to The position of the pixel array; an offset calculator that determines an offset between the positioning code film and the geometric position of the pixel array; and an interface manager, the interface manager Calculating a calibration transition that is used by the device to control the computing device based on the offset, wherein the offset is determined by a second offset between the first coordinates and the second coordinates . The device of claim 1, wherein the device is a digital pen. The device of claim 1, further comprising a sensor, the sensor capturing a first image of the positioning point of the positioning code film, and capturing a second image of the reference pixel in the pixel array; a film type analyzer that compares the first image of the positioning points with one of the positioning code films to determine the first coordinates; a pixel analyzer that determines the position of the reference pixel in the second captured image to determine the second coordinates. The device of claim 1, further comprising a sensor, wherein the sensor detects the positioning point of the positioning code film by using the first setting, and uses the second setting to detect one of the reference pixels in the pixel array, The detection department uses extended image integration time. The device of claim 4, wherein the first setting comprises using an infrared filter of the sensor and an infrared emitter of the sensor. The device of claim 4, wherein the second setting comprises deactivating one of the infrared filters of the sensor and detecting longer visible wavelength light emitted by pixels from the reference pixel. The device of claim 1, further comprising an image processor, wherein the image processor uses the first setting to detect the positioning point of the positioning code film in an image, and uses the second setting to detect the pixel in the image. One of the array reference pixels. The device of claim 1, wherein the positioning code film is removable and positioned on an outer surface of one of the displays. A calibration method includes: determining a first coordinate of the positioning code film based on a first positioning point of a positioning code film, wherein the first coordinates correspond to the positioning code of an input device relative to a display of an operation device a position of the film; determining a second coordinate of the pixel array based on the first reference pixel of the display, the second coordinates corresponding to the position of the input device relative to the pixel array of the display; Measuring a first offset between the first coordinates of the positioning code film and the second coordinates of the pixel array; and calculating a calibration transition based on the first offset to control the computing device. The method of claim 9, further comprising controlling an aspect of the computing device using the input device based on the calibration conversion. The method of claim 9, further comprising: comparing one of the image of the positioning code film with a positioning code pattern of one of the positioning code films to determine the first coordinates, wherein the image is by the input device A sensor is taken. The method of claim 9, further comprising: determining a position of a reference pixel in an image of the pixel array to determine the second coordinates, wherein the image is captured by one of the input devices . A non-transitory computer readable storage medium comprising instructions for causing a machine to perform at least the following steps during execution: determining a first offset at a first calibration point of an input device for use in an arithmetic device One of the displays calibrates the input device, the first offset being determined by using one of the input devices to determine that one of the display positioning film corresponds to the first position of the input device a first coordinate, using the sensor of the display, determining that a pixel array of the display corresponds to the first position of the first position of the input device Coordinates; and calculating a difference between the first coordinates of the positioning code film and the first coordinates of the pixel array, the difference corresponding to the first offset; determining to be located at one of the second calibration points a second offset for calibrating the input device to the display, wherein the second offset is determined by using the sensor of the input device to determine that the positioning code film of the display corresponds to the input a second coordinate of the second position of the device, using the sensor of the display, determining that the pixel array of the display corresponds to the second coordinate of the second position of the input device; and calculating the positioning code film a difference between the second coordinates and the second coordinates of the pixel array, the difference corresponding to the second offset; and calculating a calibration conversion based on the first offset and the second offset, The calibration switch adjusts the control settings of the input device to control the computing device. The non-transitory computer readable storage medium of claim 13 further comprising instructions for causing the machine to: retrieve the first image using the first setting of the sensor; and use the sensor The second setting captures the second image.