WO2014074811A2 - Key input using an active pixel camera - Google Patents
Key input using an active pixel camera Download PDFInfo
- Publication number
- WO2014074811A2 WO2014074811A2 PCT/US2013/069131 US2013069131W WO2014074811A2 WO 2014074811 A2 WO2014074811 A2 WO 2014074811A2 US 2013069131 W US2013069131 W US 2013069131W WO 2014074811 A2 WO2014074811 A2 WO 2014074811A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- user device
- active pixel
- pixel sensor
- low luminance
- area
- Prior art date
Links
- 230000004075 alteration Effects 0.000 claims abstract description 7
- 238000000034 method Methods 0.000 claims description 32
- 238000001514 detection method Methods 0.000 claims description 10
- 230000015654 memory Effects 0.000 claims description 7
- 238000010079 rubber tapping Methods 0.000 claims description 6
- 230000008569 process Effects 0.000 claims description 5
- 230000007704 transition Effects 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 20
- 230000006870 function Effects 0.000 description 7
- 230000009471 action Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000005057 finger movement Effects 0.000 description 1
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000005291 magnetic effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
- G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
- G06F1/1686—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being an integrated camera
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
- G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
Definitions
- buttons or other controllers capable of providing additional user input beyond the user input captured by the touchscreen display.
- Most modern smartphones may have only buttons for powering on or off the device, volume controls, and perhaps a "home" button designed to allow the user to quickly exit an application and return to a home screen. None of these buttons are typically useful for providing user input to applications, as their default inputs are typically still needed no matter the application (e.g., it is difficult for an application to use the volume buttons as input as the system still needs to control the system volume using those buttons).
- touchscreens certainly allow for a variety of different user inputs, such inputs are limited to the areas which the touchscreen covers, which is a portion of the front of the mobile device. This can be limiting in input-heavy applications, such as games, where a user's hands may get cramped or the user may otherwise find it difficult to control the game via only the front touchscreen. While some applications have been designed to use an accelerometer in a mobile device as an additional user input (e.g., the user could "turn” the mobile device and thereby cause a "turning" user input to, for example, a driving game), there is a need for additional improvements in providing user input beyond the touchscreen or dedicated buttons. BRIEF DESCRIPTION OF DRAWINGS
- FIG. 1 is a network diagram depicting a networked or network based system, according to an example embodiment, having a client-server architecture configured for exchanging data over a network.
- FIGS. 2A and 2B are block diagrams illustrating a user device in accordance with an example embodiment.
- FIGS. 3A and 3B are diagrams illustrating an active pixel sensor in accordance with an example embodiment.
- FIG. 4 is a diagram illustrating a three transistor pixel circuit in accordance with an example embodiment.
- FIGS. 5A-5D are diagrams illustrating the detection of movement in an active pixel sensor in accordance with an example embodiment.
- FIGS. 6A-6F are diagrams illustrating the detection of finger taps in an active pixel sensor in accordance with an example embodiment.
- FIG. 7 is an interaction diagram illustrating a method for navigating on a user device using an active pixel sensor located on the user device in accordance with an example embodiment.
- FIG. 8 is a flow diagram illustrating a method for navigating on a user device using an active pixel sensor located on the user device in accordance with an example embodiment.
- FIG. 9 is a flow diagram illustrating a method for navigating on a user device using an active pixel sensor located on the user device in accordance with an another example embodiment.
- FIG. 10 shows a diagrammatic representation of machine in the example form of a computer system within which a set of instructions, for causing the machine to perform any one or more of the methodologies discussed herein, may be executed.
- an active pixel sensor such as a camera, embedded in a device can be used as an additional input device (beyond its use in capturing images as a camera).
- a user may place a finger over the active pixel sensor, and the sensor may be designed to detect movement, placement, and/or orientation of the finger and translate such information into user input to be fed to an application.
- the active pixel sensor is located on a user device running an auction application.
- This application may be, for example, an application that aids users in listing items for sale in an online auction or other marketplace, or one that aids users in searching for and bidding on/buying items in an online auction or marketplace.
- the user device may act as a client machine in a larger network based system.
- FIG. 1 is a network diagram depicting a networked or network based system, according to an example embodiment, having a client-server architecture configured for exchanging data over a network.
- the network system 100 may include a network-based publisher 102 where clients may communicate and exchange data within the network system 100.
- the data may pertain to various functions (e.g., online item purchases) and aspects (e.g., managing content and user reputation values) associated with the network system 100 and its users.
- client-server architecture as an example, other embodiments may include other network architectures, such as a peer-to-peer or distributed network environment.
- a data exchange platform in an example form of a network- based publisher 102, may provide server-side functionality, via a network 104 (e.g., the Internet) to one or more clients.
- the one or more clients may include users that utilize the network system 100 and more specifically, the network- based publisher 102, to exchange data over the network 104.
- These transactions may include transmitting, receiving (communicating) and processing data to, from, and regarding content and users of the network system 100.
- the data may include, but are not limited to, content and user data such as feedback data; user reputation values; user profiles; user attributes; product and service reviews and information, such as pricing and descriptive information; product, service, manufacture, and vendor recommendations and identifiers; product and service listings associated with buyers and sellers; auction bids; and transaction data, among other things.
- content and user data such as feedback data; user reputation values; user profiles; user attributes; product and service reviews and information, such as pricing and descriptive information; product, service, manufacture, and vendor recommendations and identifiers; product and service listings associated with buyers and sellers; auction bids; and transaction data, among other things.
- the data exchanges within the network system 100 may be dependent upon user-selected functions available through one or more client or user interfaces (Uls).
- the Uls may be associated with a client machine, such as a client machine 1 1 10 using a web client 106.
- the web client 106 may be in communication with the network-based publisher 102 via a web server 1 16.
- the Uls may also be associated with a client machine 112 using a programmatic client 108, such as a client application, or a third party server or a mobile device 130 hosting a third party application 128.
- the client machine 1 10, 1 12, or third party application 128 may be associated with a buyer, a seller, a third party electronic commerce platform, a payment service provider, or a shipping service provider, each in communication with the network-based publisher 102 and optionally each other.
- the buyers and sellers may be any one of individuals, merchants, or service providers, among other things.
- a mobile device 130 may also be in communication with the network-based publisher 102 via a web server 116.
- the mobile device 130 may include a portable electronic device providing at least some of the functionalities of the client machines 1 10 and 12.
- the mobile device 130 may include a third party application 128 (or a web client 106) configured to communicate with application server 1 14.
- a third party application 128 or a web client 106
- mobile device 130 may include plural mobile devices 130, depending on context.
- the mobile device 130 may be referred to as a "user device.” Further, as is well known in the art, the mobile devices 130, and non-mobile devices as well, may be in contact with a GPS (global positioning system) or other suitable technology for determining the location of such devices and the incentives may be based on both the number of mobile devices 130 and non-mobile devices within the geographic locale.
- GPS global positioning system
- an application program interface (API) server 1 14 and a web server 1 16 are coupled to, and provide programmatic and web interfaces respectively to, one or more application servers 1 18.
- the application servers 1 18 host one or more marketplace application (s) 120 and/or payment applications 120.
- the application servers 1 18 are, in turn, shown to be coupled to one or more database server(s) 124 that facilitate access to one or more database(s) 126.
- the web server 1 16 and the API server 1 14 communicate and receive data pertaining to listings, transactions, and feedback, among other things, via various user input tools.
- the web server 1 16 may send and receive data to and from a toolbar or webpage on a browser application (e.g., web client 106) operating on a client machine (e.g., client machine 1 10).
- the API server 1 14 may send and receive data to and from an application (e.g., programmatic client 108 or third party application 128) running on another client machine (e.g., client machine 1 12 or a third party server).
- FIG. 1 also illustrates a third party application 128 that may execute on a third party server and may have programmatic access to the network-based publisher 102 via the programmatic interface provided by the API server 1 14.
- the third party application 128 may use information retrieved from the network-based publisher 102 to support one or more features or functions on a website hosted by the third party.
- the third party website may, for example, provide one or more listing, feedback, publisher or payment functions that are supported by the relevant applications of the network-based publisher 102.
- the network-based publisher 102 may provide a multitude of feedback, reputation, aggregation, and listing and price-setting mechanisms whereby a user may be a seller or buyer who lists or buys goods and/or services (e.g., for sale) published by the network-based publisher 102.
- FIGS. 2A and 2B are block diagrams illustrating a user device in accordance with an example embodiment.
- the user device 200 depicted is a mobile device, such as a smartphone or tablet computer.
- FIG. 2A depicts the front of the user device 200.
- a large portion of the front of the user device 200 is comprised of a touchscreen display 202, which can act as the primary user input device for navigation-based input.
- Navigation-based input is user input that commands the user device 200 to move something on the display 202 (e.g., move a cursor, scroll), or to select something on the display 202 (e.g., press a button).
- navigation-based input may be any input that traditionally would have been received from a navigation-based input device, such as a mouse.
- the user device 200 also has several dedicated buttons 204, 206a,
- buttons 206b, and 208 These dedicated buttons provide dedicated input, meaning that they are designed to perform a fixed command when utilized, and as such are unsuitable for use in additional navigation input (or, at least, beyond the context sensitive fixed command that they have been designed for).
- button 204 may be a "home” button, which is designed to cause the user device 200 to exit any running application and return the graphical user interface to a home screen. Since this button 204 is intended to act in this manner no matter what application is being used, it is unsuitable for use as an additional navigation based input device.
- Buttons 206a and 206b adjust volume up or down, and also are intended to act in this manner no matter what application is being used.
- Button 208 is a power button, intended to power the display and/or device off, and also is intended to act in this manner no matter what application is being used.
- an active-pixel sensor 210 e.g., a camera
- This front facing active-pixel sensor 210 is often used for video-based calling or other camera or video applications where it is desired to capture images of the user him or herself.
- a rear-facing active pixel sensor, which is described later, is often used for camera or video applications when it is desired to capture images of something other than the user him or herself.
- FIG. 2B depicts the back of the user device 200.
- the aforementioned rear- facing active pixel sensor 212 is present on the back of the user device 200.
- it is also often placed near to where a user will traditionally place one or more fingers while holding the user device 200.
- one or more active pixel sensors are provided.
- a user device 200 (e.g., 210, 212) on a user device 200 are used for navigation-based input.
- the user device 200 may have any number of such active pixel sensors, and it is not necessary that the system be designed such that every one of them be capable of providing navigation-based input.
- the system may be designed so that only a rear-facing active pixel sensor 212 provides navigation-based input, while a front- facing active pixel sensor 210 is never used for navigation-based input.
- FIGS. 3A and 3B are diagrams illustrating an active pixel sensor in accordance with an example embodiment. This diagram depicts a
- CMOS Complementary Metal Oxide Semiconductor
- CCD Charge-Couple Device
- the active pixel sensor 300 comprises a number of pixels, also known as a pixel array 302. It should be noted that while the pixel array 302 in this example is depicted as a 500x480 array, different dimensions can be used for the pixel array 302.
- each pixel 304 in the pixel array 302 may be covered by one or more color filters, including, for example, a red, green, and blue light filter (here simply depicted as a generic single color filter 306).
- Photodiodes 308 are set under the filter(s) 306 to detect light signals, and then electronic circuitry 310 amplifies and reads the electrical signal generated by the photodiodes 308.
- FIG. 4 is a diagram illustrating a three transistor pixel circuit in accordance with an example embodiment.
- This three transistor pixel circuit can be used as the electronic circuitry 310 for each pixel 304 in the pixel array 302 of FIG. 3.
- Each pixel 304's electronic circuitry 400 gets a controller 402, a reset voltage 404, an amplification voltage 406, a row controller 408, and as column detector 410.
- the circuit operates as follows. When the device is in darkness, the photodiode 308 is off, and as such only an ignorable dark current can flow through it.
- the controller 402 is then turned on and off, making the voltage on the upper end of the photodiode 308 to be the reset voltage 404, which means no signal.
- part of the charge accumulated on the upper end of the photodiode 308 leaks to the ground and makes the voltage decrease.
- the voltage on the upper end of the photodiode 308 becomes different, causing the resistance Msf to become different.
- the row controller 408 is turned on, and a current is detected on the column detector 410.
- the different resistance of Msf gives a different current, which indicate a different light power.
- directional light differences in an active pixel sensor 300 can be used to determine the position of a finger being placed over the active pixel sensor 300 on a user device. From the position, input events can be assigned to a listening entity.
- the active pixel sensor 300 When the active pixel sensor 300 is located on the back of a mobile device, it also can be placed in a position where the user's finger or fingers would ordinarily fall when holding the device, allowing for easy reach for the user.
- the active pixel sensor 300 often will have a different feel than the surrounding materials, and as such the user can detect the tactile difference between the active pixel sensor 300 and the surrounding material, and thus is able to determine the boundaries of the active pixel sensor 300 and thus orient his or her finger appropriately to cause the proper navigation input to the device, despite not being able to see his or her finger because it is hidden behind the user device 200.
- the entire image from the active pixel sensor 300 is converted to grayscale.
- the darkest regions of the grayscale image then have the most coverage of the finger.
- lighter regions emerge, indicating a directional shift.
- an inverse direction can be applied as input.
- the process of detecting navigation-based input using an active pixel sensor 300 may be initially calibrated when the user places his or her finger over the active pixel sensor 300.
- the beginning position of the finger can be used as a reference point to then determine subsequent movement of the finger.
- the user may be guided by onscreen prompts indicating that the user should place the finger over the sensor 300 for calibration, after which the system could either automatically, or upon selection by the user (such as by pressing an area of the touchscreen with a finger from a different hand, or a voice command), begin the calibration process.
- FIGS. 5A-5D are diagrams illustrating the detection of movement in an active pixel sensor 500 in accordance with an example embodiment.
- the active pixel sensor 500 detects a dark spot 502 in the visible area 504, with a small light spot 506 on the right hand side of the visible area 504. This may indicate that the user's finger is on the left side of the active pixel sensor 500, as depicted in FIG. 5B.
- the user may slide his or her finger, resulting in the luminance pattern depicted in FIG. 5C. This reflects the rightward movement of the user's finger, as depicted in FIG. 5D. Corresponding movement may then be triggered in an application on the user device 200.
- the triggered movement may be the inverse of the detected movement (e.g., the rightward movement depicted results in a leftward movement navigation command being sent to the corresponding application).
- the applicant can provide a configuration interface, allowing a user to determine what actions are triggers by different navigation-based inputs detected by an active pixel sensor, such as active pixel sensor 500.
- Changes to the luminance in different regions can be measured at fixed intervals.
- the active pixel sensor 500 may be examined at 15fps intervals to determine whether the luminance has changed and in which direction it has changed.
- taps may be detected on the active pixel sensor 500 by detecting when the active pixel sensor 500 as a whole is detecting an entirely or near-entirely dark region followed by that region turning light and then turning dark again.
- a single "tap" may actually be composed of three distinct actions or observed state changes (e.g., dark, light, dark).
- a user's finger begins by covering the active pixel sensor 500, then is removed, and then covers it again.
- FIGS. 6A-6F are diagrams illustrating the detection of finger taps in an active pixel sensor 600 in accordance with an example embodiment. In FIG. 6A, it can be seen that the active pixel sensor 600 detects a dark spot 602 in the visible area 604.
- this dark spot 602 is not strictly relevant. As long as enough of the active pixel sensor 600 is dark, it can be assumed that the user's finger is covering the active pixel sensor 600. Thus, it can be assumed that the user's finger may be in the position indicated in FIG. 6B.
- the active pixel sensor 600 detects a large light spot 606 in the visible area 604. This may indicate that the user's finger is no longer covering the active pixel sensor 600, as depicted in FIG. 6D.
- thresholds may be used to determine exactly how much of a dark spot 602 is needed in order for the system to register that the user's finger is covering the active pixel sensor 600, and how much of a light spot is necessary in order for the system to register that the user's finger is no longer covering the active pixel sensor 600 (or at least has been removed enough for purposes of detecting an eventual "tap," since every tap has both a covering and uncovering component). These thresholds may be different.
- the system registers that the user's finger is covering the active pixel sensor 600 if at least 60% of the visible area of the active pixel sensor 600 is dark, whereas the system registers that the user's finger has been lifted if no more than 5% of the visible area of the active pixel sensor 600 is dark.
- FIG. 6E it can be seen that the active pixel sensor 600 detects a dark spot 602 in the visible area 604.
- the system can assume again that the user's finger is over the active pixel sensor 600, as depicted in FIG. 6F.
- the dark spot 602 match the dark spot 602 from FIG. 6A, in either size or position. Indeed, it would be pretty rare that the user would hit the exact same position on the active pixel sensor 600 twice in a row with his finger. It is enough that the threshold for detecting a finger has been reached twice.
- FIG. 7 is an interaction diagram illustrating a method 700 for navigating on a user device 200 using an active pixel sensor 702 located on the user device 200 in accordance with an example embodiment.
- the components depicted in this diagram may all be located on the user device 200.
- the method 700 includes an active pixel sensor 702, which is depicted as being separate from an active pixel sensor monitor 704.
- the active pixel sensor monitor 704 can act to monitor changes in luminance in the active pixel sensor 702. While these components are depicted as separate in this figure, one of ordinary skill in the art will recognize that the active pixel sensor monitor 704 may simply be considered part of the active pixel sensor 702.
- a camera application 706 is any application that operates the active pixel sensor 702 as a camera.
- a non-camera application 708 is any application that does not operate the active pixel sensor 702 as a camera.
- the discussed functions can be incorporated into the operating system of the user device.
- the operating system can provide applications an interface to operate a camera as a camera or as a navigation-based input device, according to the methods discussed herein.
- the camera application sends a command to the active pixel sensor 702 to capture an image.
- this image is returned by the active pixel sensor 702 to the camera application 706.
- this process may be repeated many times in the case of a video, where a series of still images are captured by the active pixel sensor 702 and sent to the camera application 706 (along with audio information from a separate microphone).
- the non-camera application sends a command to the active pixel sensor monitor 704 requesting that the active pixel sensor 702 be placed in a navigation state. In this navigation state, rather than capturing images like a camera, the active pixel sensor 702 will be utilized to detect navigation movements.
- the active pixel sensor monitor 704 detects an area of the active pixel sensor 702 that is capturing low luminance. This may be an area that has luminance values less than a predetermined luminance threshold and having a size greater than or equal to a size threshold.
- the size threshold may be expressed in, for example, a number of pixels, or a percentage of the overall visible area of the active pixel sensor 702.
- the active pixel sensor monitor 704 detects movement of the low luminance area in the active pixel sensor 702.
- the active pixel sensor monitor 704 determines a direction for the movement of the low luminance area. At 722, this direction is translated into navigation input.
- the active pixel sensor monitor 704 sends the translated navigation input to the non-camera application 708.
- the active pixel sensor monitor 704 may further determine a distance of movement of the low luminance area and use the distance of movement when performing the translating. This provides not just movement direction, but movement intensity, allowing a navigation input to have both direction and intensity.
- the speed of movement may also be tracked and used in the translation.
- the active pixel sensor monitor 704 detects another area of the active pixel sensor 702 capturing low luminance.
- the active pixel sensor monitor 704 detects an alteration in this detected area such that the detected area changes from low luminance to high luminance and then back to low luminance within a predetermined time period.
- navigation input is generated indicating the detection of a tapping motion.
- this navigation input is sent to the non-camera application 708.
- FIG. 8 is a flow diagram illustrating a method 800 for navigating on a user device 200 using an active pixel sensor 702 located on the user device 200 in accordance with an example embodiment.
- an area of the active pixel sensor 702 capturing low luminance is detected.
- movement of the low luminance area is detected.
- a direction for the movement of the low luminance area is determined.
- the direction is translated into navigation input for an application running on the user device 200.
- FIG. 9 is a flow diagram illustrating a method 900 for navigating on a user device 200 using an active pixel sensor 702 located on the user device 200 in accordance with an another example embodiment.
- an area of the active pixel sensor 702 capturing low luminance is detected.
- an alteration in the detected area is detected, such that the detected area changes from low luminance to high luminance and then back to low luminance within a predetermined time period.
- user input indicating the detection of a tapping motion is generated to an application running on the user device 200.
- FIG. 10 shows a diagrammatic representation of machine in the example form of a computer system within which a set of instructions, for causing the machine to perform any one or more of the methodologies discussed herein, may be executed.
- the machine operates as a standalone device or may be connected (e.g., networked) to other machines.
- the machine may operate in the capacity of a server or a client machine in server-client network environment, or as a peer machine in a peer-to-peer (or distributed) network environment.
- the machine may be a server computer, a client computer, a personal computer (PC), a tablet PC, a set-top box (STB), a personal digital assistant (PDA), a cellular telephone, a web appliance, a network router, switch or bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine.
- PC personal computer
- PDA personal digital assistant
- STB set-top box
- a cellular telephone a web appliance
- network router switch or bridge
- the example computer system 1000 includes a processor 1002
- the computer system 1000 may further include a video display unit 1010 (e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT)).
- the computer system 1000 also includes an alphanumeric input device 1012 (e.g., a keyboard), a cursor control device 1014 (e.g., a mouse), a disk drive unit 1016, a signal generation device 1018 (e.g., a speaker), and a network interface device 1020.
- a video display unit 1010 e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT)
- the computer system 1000 also includes an alphanumeric input device 1012 (e.g., a keyboard), a cursor control device 1014 (e.g., a mouse), a disk drive unit 1016, a signal generation device 1018 (e.g., a speaker), and a network interface device 1020.
- an alphanumeric input device 1012 e.
- the disk drive unit 1016 includes a machine-readable medium
- the instructions 1024 may also reside, completely or at least partially, within the main memory 1004 and/or within the processor 1002 during execution thereof by the computer system 1000, with the main memory 1004 and the processor 1002 also constituting machine-readable media.
- the instructions 1024 may further be transmitted or received over a network 1026 via the network interface device 1020.
- machine-readable medium 1022 is shown in an example embodiment to be a single medium, the term “machine-readable medium” should be taken to include a single medium or multiple media (e.g., a centralized or distributed database, and/or associated caches and servers) that store the one or more sets of instructions 1024.
- the term “machine-readable medium” shall also be taken to include any medium that is capable of storing, encoding or carrying a set of instructions 1024 for execution by the machine and that cause the machine to perform any one or more of the methodologies described herein.
- the term “machine-readable medium” shall accordingly be taken to include, but not be limited to, solid-state memories, optical and magnetic media, and carrier wave signals.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
Description
Claims
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP13852656.1A EP2917815A4 (en) | 2012-11-10 | 2013-11-08 | Key input using an active pixel camera |
CN201380070014.4A CN104903823A (en) | 2012-11-10 | 2013-11-08 | Key input using an active pixel camera |
KR1020157015342A KR20150082600A (en) | 2012-11-10 | 2013-11-08 | Key input using an active pixel camera |
AU2013342263A AU2013342263A1 (en) | 2012-11-10 | 2013-11-08 | Key input using an active pixel camera |
CA2890705A CA2890705A1 (en) | 2012-11-10 | 2013-11-08 | Key input using an active pixel camera |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/674,004 US9176539B2 (en) | 2012-11-10 | 2012-11-10 | Key input using an active pixel camera |
US13/674,004 | 2012-11-10 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2014074811A2 true WO2014074811A2 (en) | 2014-05-15 |
WO2014074811A3 WO2014074811A3 (en) | 2014-07-10 |
Family
ID=50681240
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2013/069131 WO2014074811A2 (en) | 2012-11-10 | 2013-11-08 | Key input using an active pixel camera |
Country Status (7)
Country | Link |
---|---|
US (2) | US9176539B2 (en) |
EP (1) | EP2917815A4 (en) |
KR (1) | KR20150082600A (en) |
CN (1) | CN104903823A (en) |
AU (1) | AU2013342263A1 (en) |
CA (1) | CA2890705A1 (en) |
WO (1) | WO2014074811A2 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9176539B2 (en) | 2012-11-10 | 2015-11-03 | Ebay Inc. | Key input using an active pixel camera |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101390090B1 (en) * | 2012-09-18 | 2014-05-27 | 한국과학기술원 | Sensing apparatus for user terminal using camera, method for the same and controlling method for the same |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060274038A1 (en) | 2005-05-24 | 2006-12-07 | Lg Electronics Inc. | Menu input apparatus and method using camera of mobile communications terminal |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6057540A (en) * | 1998-04-30 | 2000-05-02 | Hewlett-Packard Co | Mouseless optical and position translation type screen pointer control for a computer system |
JP2000224470A (en) | 1999-02-02 | 2000-08-11 | Minolta Co Ltd | Camera system |
US8026897B2 (en) * | 2004-11-22 | 2011-09-27 | Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. | Cursor motion control of a pointing device |
JP5228439B2 (en) * | 2007-10-22 | 2013-07-03 | 三菱電機株式会社 | Operation input device |
US20100079413A1 (en) * | 2008-09-29 | 2010-04-01 | Denso Corporation | Control device |
US20100138797A1 (en) * | 2008-12-01 | 2010-06-03 | Sony Ericsson Mobile Communications Ab | Portable electronic device with split vision content sharing control and method |
JP2010277197A (en) * | 2009-05-26 | 2010-12-09 | Sony Corp | Information processing device, information processing method, and program |
KR20110107143A (en) * | 2010-03-24 | 2011-09-30 | 삼성전자주식회사 | Method and apparatus for controlling function of a portable terminal using multi-input |
JP2011227574A (en) * | 2010-04-15 | 2011-11-10 | Rohm Co Ltd | Arithmetic apparatus, motion detecting apparatus, electronic device |
US9176539B2 (en) | 2012-11-10 | 2015-11-03 | Ebay Inc. | Key input using an active pixel camera |
-
2012
- 2012-11-10 US US13/674,004 patent/US9176539B2/en not_active Expired - Fee Related
-
2013
- 2013-11-08 AU AU2013342263A patent/AU2013342263A1/en not_active Abandoned
- 2013-11-08 CA CA2890705A patent/CA2890705A1/en not_active Abandoned
- 2013-11-08 KR KR1020157015342A patent/KR20150082600A/en not_active Application Discontinuation
- 2013-11-08 WO PCT/US2013/069131 patent/WO2014074811A2/en active Application Filing
- 2013-11-08 EP EP13852656.1A patent/EP2917815A4/en not_active Withdrawn
- 2013-11-08 CN CN201380070014.4A patent/CN104903823A/en active Pending
-
2015
- 2015-10-30 US US14/927,882 patent/US20160048177A1/en not_active Abandoned
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060274038A1 (en) | 2005-05-24 | 2006-12-07 | Lg Electronics Inc. | Menu input apparatus and method using camera of mobile communications terminal |
Non-Patent Citations (1)
Title |
---|
See also references of EP2917815A4 |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9176539B2 (en) | 2012-11-10 | 2015-11-03 | Ebay Inc. | Key input using an active pixel camera |
Also Published As
Publication number | Publication date |
---|---|
EP2917815A4 (en) | 2016-07-06 |
US20160048177A1 (en) | 2016-02-18 |
US9176539B2 (en) | 2015-11-03 |
CA2890705A1 (en) | 2014-05-15 |
WO2014074811A3 (en) | 2014-07-10 |
US20140132564A1 (en) | 2014-05-15 |
CN104903823A (en) | 2015-09-09 |
AU2013342263A1 (en) | 2015-06-11 |
EP2917815A2 (en) | 2015-09-16 |
KR20150082600A (en) | 2015-07-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11175726B2 (en) | Gesture actions for interface elements | |
JP6999642B2 (en) | Two-dimensional code identification method and device, as well as mobile terminals | |
JP7230055B2 (en) | Application program display adaptation method and device, terminal, storage medium, and computer program | |
US10777226B2 (en) | Selective sharing of body data | |
US8782565B2 (en) | System for selecting objects on display | |
US20160321840A1 (en) | Systems, methods, and computer program products for navigating through a virtual/augmented reality | |
US20130041938A1 (en) | Dynamic Mobile Interaction Using Customized Interfaces | |
US20130342459A1 (en) | Fingertip location for gesture input | |
CN110996111A (en) | Method, device and system for sending order by live broadcast | |
US11150794B2 (en) | Electronic device control in response to finger rotation upon fingerprint sensor and corresponding methods | |
WO2023050737A1 (en) | Resource presentation method based on live streaming room, and terminal | |
CN113407291A (en) | Content item display method, device, terminal and computer readable storage medium | |
CN110751539A (en) | Article information processing method, article information processing device, article information processing terminal, article information processing server, and storage medium | |
CN107656794B (en) | Interface display method and device | |
US9400575B1 (en) | Finger detection for element selection | |
US20130182005A1 (en) | Virtual fashion mirror system | |
JP2017508223A (en) | Page display method and apparatus, and electronic device | |
CN106250503B (en) | Picture processing method and mobile terminal | |
KR20160086132A (en) | Display apparatus and operation method of the same | |
US20160048177A1 (en) | Key input using an active pixel camera | |
CN107395983B (en) | Image processing method, mobile terminal and computer readable storage medium | |
CN115361566A (en) | Live broadcast watching method, device, terminal and storage medium | |
KR20240033226A (en) | Remote landmark rendering for extended reality interfaces | |
CN117593074A (en) | Method, device, equipment and storage medium for displaying commodity display interface | |
CN113420270A (en) | Application program login method and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13852656 Country of ref document: EP Kind code of ref document: A2 |
|
ENP | Entry into the national phase |
Ref document number: 2890705 Country of ref document: CA |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2013852656 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 20157015342 Country of ref document: KR Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2013342263 Country of ref document: AU Date of ref document: 20131108 Kind code of ref document: A |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13852656 Country of ref document: EP Kind code of ref document: A2 |