EP2069890A1 - Procédé et unité d'entrée de données d'affichage - Google Patents

Procédé et unité d'entrée de données d'affichage

Info

Publication number
EP2069890A1
EP2069890A1 EP07838537A EP07838537A EP2069890A1 EP 2069890 A1 EP2069890 A1 EP 2069890A1 EP 07838537 A EP07838537 A EP 07838537A EP 07838537 A EP07838537 A EP 07838537A EP 2069890 A1 EP2069890 A1 EP 2069890A1
Authority
EP
European Patent Office
Prior art keywords
display
key
keys
image
keyboard
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP07838537A
Other languages
German (de)
English (en)
Inventor
Ronald Brown
Daniel Harden
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
United Keys Inc
Original Assignee
United Keys Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by United Keys Inc filed Critical United Keys Inc
Publication of EP2069890A1 publication Critical patent/EP2069890A1/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H01—ELECTRIC ELEMENTS
    • H01H—ELECTRIC SWITCHES; RELAYS; SELECTORS; EMERGENCY PROTECTIVE DEVICES
    • H01H13/00—Switches having rectilinearly-movable operating part or parts adapted for pushing or pulling in one direction only, e.g. push-button switch
    • H01H13/70—Switches having rectilinearly-movable operating part or parts adapted for pushing or pulling in one direction only, e.g. push-button switch having a plurality of operating members associated with different sets of contacts, e.g. keyboard
    • H01H13/83—Switches having rectilinearly-movable operating part or parts adapted for pushing or pulling in one direction only, e.g. push-button switch having a plurality of operating members associated with different sets of contacts, e.g. keyboard characterised by legends, e.g. Braille, liquid crystal displays, light emitting or optical elements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0238—Programmable keyboards
    • H—ELECTRICITY
    • H01—ELECTRIC ELEMENTS
    • H01H—ELECTRIC SWITCHES; RELAYS; SELECTORS; EMERGENCY PROTECTIVE DEVICES
    • H01H2219/00—Legends
    • H01H2219/002—Legends replaceable; adaptable
    • H01H2219/01—Liquid crystal
    • H01H2219/012—Liquid crystal programmable
    • H—ELECTRICITY
    • H01—ELECTRIC ELEMENTS
    • H01H—ELECTRIC SWITCHES; RELAYS; SELECTORS; EMERGENCY PROTECTIVE DEVICES
    • H01H2219/00—Legends
    • H01H2219/036—Light emitting elements
    • H01H2219/037—Light emitting elements using organic materials, e.g. organic LED

Definitions

  • Human input devices are commonly used to enable a user to affect operation of an apparatus that typically is equipped with a processor, storage, and a source or supply of electrical power.
  • Such input devices include text input devices, pointing devices, gaming devices, imaging input devices, video input devices, audio input devices, and the like.
  • text input devices include keyboards, keypads and the like.
  • pointing devices include a mouse, trackball or roller ball, pointing stick, joystick, touchpad, graphics tablet, and the like.
  • gaming devices include a game console, e.g., game pad or joy pad, paddle, joystick, keyboard, remote, and the like.
  • Examples of image and video input devices include a scanner, camera, video recorder, web cam, and the like.
  • Examples of audio input devices include a microphone, recorder, and the like.
  • One aspect of the present invention includes a display key that has an outer keycap that has a top surface equipped with a display window through which a key display can be viewed by a user of a device to which the display key enables data input.
  • the keycap assembles to a key body such that a display assembly or display module is housed inside.
  • the display assembly is manipulated so it is between the body and keycap before snapping the keycap and body together around the display assembly.
  • the display keycap has a top wall dimensionally smaller than that of its open bottom with a plurality of sidewalls that taper inwardly from the bottom to the top wall.
  • the top surface of the top wall is concave and has a window formed in it through which the key display is visible.
  • the keycap top wall and sidewalls are typically opaque.
  • the window can be physically formed, e.g., molded, in the top wall such that it extends completely through the top wall.
  • the keycap top wall that remains borders or frames the display window providing contact surface area that helps transfer force applied against the display key to the keycap and away from the display.
  • a protective layer and/or coating can overlie the key display. Such a protective layer and/or coating can be used to make the region of the top surface of the keycap top wall substantially flush with the top surface of the part of the top wall that borders or frames the display window.
  • One preferred display assembly includes a display circuitry, which can be a module that includes circuitry located onboard a circuit board or the like disposed adjacent the display key body when the display key has been assembled.
  • the display circuitry includes display driver circuitry and can include a backlighting arrangement where backlighting is desired.
  • the display circuitry can also include display image data memory as well as a processor, such as a microprocessor, microcontroller, or the like.
  • a diffuser is located within the display key between the display circuitry and the display.
  • a link between the display circuitry onboard the display key and the display that includes a cable, such as a multi-conductor ribbon cable, and one or more connectors each of which can include one of a plug and complementary mating socket.
  • link constructed and arranged to communicate key display control signals as well as electrical power to the display assembly/module of the display key.
  • the link is a cable that extends to the outside of the display key and can include one or more electrical connectors.
  • Such a link also includes a like cable and can also include one or more electrical connectors of the same or similar type.
  • control signals are communicated via the plunger, through conductors and/or contacts carried by, embedded in, or otherwise disposed onboard the plunger.
  • each display key is changeable, such as in response to context and situational operations.
  • Software onboard the device to which the display key is linked controls what image is displayed and when, with images being changeable in real time during device operation, including changes being made in response to interaction with the device and/or display key by the user.
  • a plurality of display keys are linked to a device, such as via a display PC keyboard linked to a computer.
  • Display image data can be provided to a display key that causes its display to show a letter, a number, a plurality of letters and/or numbers, alphanumeric commands that can include one or more displayed words, a picture, a symbol, an icon, or some other visually perceptible indicia.
  • the advantageous construction of the invention is very different than conventional keyboards equipped with so-called "programmable" keys, which assign one function to a particular programmable key, usually requiring considerable effort on the part of the user to do so.
  • Such software can be configured to directly or indirectly cause the image displayed by one or more display keys to change.
  • display keys can be programmed and/or changed via client software, server software, both, as well as via the Internet, alone or in combination with client software and/or server software.
  • Display key image control software can be in the form of the software program being run by the user, an API that interfaces with the program, a plug-in software module, such as an Active-X plug-in, an add-on, such as a browser add-on, or another type of software that can run in the foreground and/or background.
  • a plug-in software module such as an Active-X plug-in
  • an add-on such as a browser add-on
  • software can be configured to allow a user to create custom display key images as well as to change which display key is assigned which particular function or command.
  • one selection or choice whether it be by pressing a key, including a display key, or on-screen, such as by using a mouse and/or making a menu selection, causes the display of at least one display key to change in anticipation of what selection(s) the user will encounter next or is likely to want available at that point.
  • the present invention is also directed to a display-equipped key assembly well suited for use in a wide variety of processing devices, such as computers, mobile phones, game consoles, and the like, in which the display key housing is of multi-component snap together construction.
  • the housing is formed by a display keycap configured to facilitate image viewing from an image generated by a display, such as an LCD display or the like, that is captive within the display key assembly.
  • the display keycap mates with a key base having an integral key switch actuating plunger that can be of conventional plunger construction for enabling a display key constructed from a display key assembly in accordance with the invention to be used with existing key switch designs, including those which include a membrane (not shown) or the like.
  • the keycap and base are configured so as to snap together around the display while including onboard integral structure that helps orient and/or locate the display.
  • the base includes an integral cradle in which display components seat within the housing formed from assembly of the keycap and base.
  • the keycap and base include integrally formed interlocking engagement structure enabling them to snap together to form a display key assembly that is of simple, economical, durable and robust construction.
  • the display key assembly includes onboard circuitry including one or more of a display driver, display controller, transducer, backlight or another component that is retained along with the display captive between the keycap and base when the keycap and based are assembled.
  • an integral seat formed in the base receives a circuit board carrying one of the driver, controller, transducer or backlight with the seat locating the circuit board and display within the display key assembly formed by engaging the keycap with the base.
  • a cable such as a ribbon cable, extends from a display module to the onboard circuit board.
  • a second cable can extend from the circuit board to an off-board controller, e.g., controller circuit board, of the data input device or the processing device to which the data input device is linked.
  • a display PC keyboard constructed in accordance with the invention is able to take advantage of existing product form factors, standardization, because people are already familiar with using keyboards, and user familiarity.
  • a display key and/or key display that is well suited for numerous applications, including for example Internet navigation and contingent changing of key display images based thereon, and devices, such as personal computers, PDAs, mobile phones, e.g., cellular phones, notebook computers, sub-mini computers, satellite radio, satellite controlled/interactive appliances, on-board vehicle user control panels (e.g. to control heat, radio, seat settings, vehicle operation, etc.), etc.
  • a display PC keyboard can be provided where the displays of the display keys can be configured to display a plurality of different languages such as via selecting a different language in the device operating system, via user selection, via software program control, etc.
  • logos can be displayed on key displays of display keys for advertising purposes, to be directed to the company associated with a particular key- displayed logo by sending the user to their website, etc.
  • key display image data and/or display key configuration data can be provided over the Internet, via a network, via a software program currently being executed by a user, via interface software, such as an API, that communicates with a current user executed software program, via SMS, via HTML, via XML, via ASP, via ULTRA- WIDEBAND wireless communication, via BLUETOOTH, via a SMARTCARD, via a MEMORY STICK, via an SD card, via an XD card, via a cellular network, via satellite communication, via RF-ID or an RF-ID reader, etc.
  • interface software such as an API
  • Objects, features and advantages include at least one of the following: providing a display key, data input device and device controlled thereby that is simple to implement, quick, labor-efficient, economical, and which requires relatively simple skills to perform.
  • Fig. 1 is a perspective view of a data entry keyboard typically used with personal computers and the like;
  • Fig. 2 is an enlarged fragmentary perspective view of a plurality of pairs of display- equipped keys of the keyboard of Fig. 1;
  • Fig. 3 is an enlarged fragmentary perspective view of a plurality of pairs of display- equipped keys of the keyboard of Fig. 1 with the keyboard configured so as to include non- display equipped keys;
  • Fig. 4 is a fragmentary perspective view of a preferred embodiment of a display key
  • Fig. 8 is an exploded side elevation view of another preferred embodiment of a display key assembly
  • Fig. 1 1 is a drawing showing a top view of a preferred embodiment of a display key assembly overlying a cross sectional view of the display key assembly assembled to a portion of a keyboard or the like;
  • DOC / ⁇ Fig. 12 depicts a front view and a side view of a preferred cable arrangement used to convey electronic signals to and/or from the display of the display key;
  • Fig. 13 illustrates a side view of a PC keyboard equipped with at least one display key having a portion of the keyboard housing broken away to show components of the display key;
  • Fig. 14 is similar to Fig. 12 except that it shows additional drawings that help better illustrate a preferred embodiment of how such a display key and display key switch can be mounted to or carried by a data entry device such as a PC keyboard or the like;
  • Fig. 15 illustrates a top plan view of a PC keyboard equipped with a plurality of pairs of function keys each being of display key and display key switch construction;
  • Fig. 16 illustrates an exploded view of another preferred embodiment of a display key assembly
  • Fig. 17 is a top view of a display key constructed in accordance with that depicted in Fig. 16 showing the key display removed;
  • Fig. 18 is a top view of the display key of Fig. 17 showing the key display;
  • Fig. 19 is a top perspective view of the display key of Fig. 16;
  • Fig. 20 is a side perspective view of the display key of Fig. 16;
  • Fig. 21 is a perspective cross section view of the display key cap of Fig. 16;
  • Fig. 22 is a cross sectional view of the display key cap of Fig. 16;
  • Fig. 23 is a bottom plan view of the display key cap of Fig. 16;
  • Fig. 24 is an enlarged fragmentary bottom perspective view of the display key cap of Fig. 16;
  • Fig. 25 is a top perspective view of the top of the body of the display key assembly shown in Fig. 16;
  • Figure 26 is a side perspective view of the body of the display key assembly of Fig.
  • Fig. 27 is a second side perspective view of the body of the display key assembly of Fig. 16;
  • DOC/ ⁇ Fig. 28 is a top perspective view of the top of the body of the display key assembly of Fig. 16;
  • Fig. 29 is a second top perspective view of the top of the body of the display key assembly of Fig. 16;
  • Fig. 30 illustrates a side perspective view of the body;
  • Fig. 31 is a schematic of a preferred display data input device controller arrangement
  • Fig. 32 is a perspective view of a display key equipped game controller
  • Fig. 33 is a screen shot of a preferred embodiment of a display key layout image editor and image display editor; and Fig. 34 is a screen shot of a software representation of a display keyboard configured in accordance with the present invention.
  • DOC 1 ⁇ like in accordance with such disclosed herein can be used in devices such as digital cameras, video cameras, PDAs, mice, scanners, drawing pads, game consoles, joy sticks, cell phones, mobile phones, telephones, televisions, video disk players, VCRs, routers, switches, servers, power strips, surge suppressors, power line conditioners, industrial switching and power regulating equipment (e.g.
  • every key is a display key 44 except for example the Tab key, the Caps Lock key, the Shift keys, the Control (Crtl) keys, the Alt keys, the Space key or Spacebar key, the Backspace key, and the Enter keys.
  • other keys such as the Windows key (where so equipped), the menu pull-down key (where so equipped), the Escape key, and/or financial operator keys can be non-display keys.
  • non-alphanumeric keys need not be display equipped. However, it should be kept in mind that one or more of such non-alphanumeric keys can be of display key construction if desired.
  • the keyboard is a display keyboard 40 that has a plurality of rows and columns of display keys 44.
  • the display keyboard has a plurality of pairs of rows and columns of alphanumeric keys being display key equipped (such as shown in Fig. 1).
  • the display keyboard can be configured so that one or more of the key receivers for the non- display keys 46 (Fig. 3) is display key capable or display key enabled.
  • a display keyboard constructed in accordance with the invention can have only its function
  • Fig. 2 illustrates a plurality of pairs of display keys 44 arranged in a row, such as part of the row of function keys disposed along the top of the keyboard shown in Fig. 1.
  • each key 44 is equipped with a display 48 on which a character, symbol, picture, graphic, or other indicia can be shown thereon.
  • the leftmost key is equipped with a display currently configured to show a picture of a fire truck
  • the key adjacent is equipped with a display currently configured to show a picture of a helicopter
  • the next key is equipped with a display currently configured to show a mug or cup
  • the rightmost key is equipped with a display currently configured to show an aircraft or the like.
  • Each key display 48 is carried by part of a key cap of the display key 44.
  • the display 48 is positioned so as to be exteriorly visible to a user via a window in the top surface of the key, which is pressed by the user during selection of that particular key.
  • Each key display 48 can be selectively configured to show such a character, symbol, picture, graphic, or other indicia as desired.
  • each key display 48 is re-configurable, such as where is it is desired to change what is displayed by the key display 48.
  • Each key display 48 has a resolution of at least a plurality of pairs of dots or pixels by at least a plurality of pairs of dots or pixels (i.e. at least 3 x 3 or more). In a preferred embodiment, each key display has a resolution of at least 16 by 16 dots or pixels with each
  • each dot or pixel being of 1 bit (i.e. on or off) depth.
  • each dot or pixel is of at least 6 bit depth and preferably of 8 bit depth thereby being capable of displaying as many as 256 different shades for each dot or pixel of the key display.
  • each dot or pixel preferably is of a color bit depth of 6 bits or greater.
  • a color key display is used that is capable of displaying between 16 million and 16.7 million colors.
  • each key display is a 20 x 20 display that is of LCD construction.
  • the key display 48 is an electronically controllable display panel.
  • the preferred embodiment depicted in Figs. 1-3 has generally rectangular shape and has a substantially flat or planar outer display surface.
  • the key display is of liquid crystal diode construction (LCD) that provides grayscale or monochrome output during operation.
  • the key display is of light emitting diode construction, such as organic light emitting diode (OLED) construction.
  • OLED displays offer advantages that include being inherently more emissive, which can reduce or eliminate the need for backlighting, and need not be flat or planar in shape.
  • an organic light emitting polymer (OLEP) display can also be used as the display.
  • control of what is shown on one or more key displays 48 of one or more display keys 44 is done via software, such as by software being executed by the device being controlled by the keyboard 40.
  • a software program being run by a user controls what is shown on one or more key displays of one or more display keys of the display keyboard. It does so or is capable of doing so for each display key.
  • Such a software program advantageously provides the capability for the user to configure what is displayed on a particular key display of a display key at a particular time, during a particular condition, and/or to control a particular function or selection.
  • the software can also be implemented as a module that interfaces with the software program run by the user.
  • Such interface module software can operate in the background and simply
  • ⁇ OOI46049.DOC I hook with a particular software program run by a user when that particular software program is run by the user.
  • a particular software program designed to hook with or otherwise cooperate with key display configuration interface software is a game, such as DOOM, FAR CRY, SOLDIER OF FORTUNE, HALO, UNREAL, etc.
  • the key display configuration interface software can be configured with default key display configuration data for each display key of the display keyboard that is generally applicable to all software, that is specific to the game being run by the user, and/or which receives key display configuration data from the game during or after it is run by the user.
  • Such software games can be self-contained, such as by being run and played only on a single device. They also can be networked or networkable games, such as games that interface or originate via the Internet.
  • An example of one type of game for which a display keyboard, keypad, game console, and/or joystick equipped with one or more display keys constructed in accordance with the invention is particularly well suited include networked games that include massively multiplayer online role playing games (MMORPG), such as EVERQUEST and the like.
  • MMORPG massively multiplayer online role playing games
  • One or more key displays can be configured and/or otherwise controlled via signals and/or data received via the network via which the networked game is played.
  • Such interaction is not limited only to games as networked and/or networkable applications can also interface and cooperate in like manner with a display keyboard, display keypad, custom configured input console and the like.
  • Such key display configuration data interface software can be implemented as, controlled by or include an application program interface (API). Where implemented in this manner, such key display configuration data interface software exists as a software layer, such as a process or thread, which is between the operating system of the device being controlled by the display keyboard and the application program run by the user.
  • API application program interface
  • Such a display data entry unit API provides an interface between a software application, such as Microsoft Word, a software game, a browser, or the like, and the operating system thereby enabling user interaction with the program to cause a change in the images displayed by one or more display keys 44 of a display-equipped data entry unity, e.g. display key equipped keyboard 40.
  • a software application such as Microsoft Word, a software game, a browser, or the like
  • This same API or a different API can, in turn, receive and interpret key press
  • ⁇ 00146049.DOC l ⁇ data from one or more display equipped keys pressed by a user and carry out a desired function or action. It can also cause a software application with which it interfaces to carry out a desired function or action based upon key press data generated from a user pressing one or more display equipped keys engaged by the user.
  • key display configuration data interface software installs automatically when a display keyboard is attached to a device, such as a computer. Where the device being controlled is plug-and-play compatible or enabled, the key display configuration data interface software installs as part of the display keyboard installation process. In one preferred implementation, this includes installation of a device driver that provides or helps provide such a key display configuration data interface.
  • the key display configuration data interface is installed as a software program that is automatically run when the device being controlled is started, booted up and/or rebooted.
  • driver installation provides a display keyboard driver with a display data entry unit API or installs one or more desired display data entry unit APIs that provide communication between software applications, such as Microsoft Word, Excel, gaming software, a browser or the like, and a display key equipped keyboard connected to the device.
  • the interface can be or include a module, such as a plug-in, macro, or the like, which is specifically tailored for a particular program.
  • the interface can include a VB macro, such as a Word macro or the like.
  • a browser such as Internet Explorer, Mozilla, Firefox, Netscape or the like
  • the interface can be or include a plug-in or browser add-on, such as a browser helper object, a browser extension, or an active- X control.
  • Such an interface is configurable to accept key display data and key display configuration data via the Internet, from a server, such as a network server, or via a network.
  • a browser is executing something in Java, JavaScript, ASP, or the like, either synchronously or asynchronously, it can be configured in a manner that controls what is displayed on a key display of one or more display keys of a display keyboard of the device, e.g., computer, to which the display keyboard is connected.
  • the window 52 in the keycap top surface 56 and/or display 48 of the preferred embodiment depicted in Fig. 5 has a height no greater than about 12.87 mm and a width no greater than about 10.87 mm.
  • the height is at least 6 mm and no greater than 14 mm and a width of at least 6 mm and no greater than 12 mm.
  • the window/display has a height of about 6 mm and a width of about 8 mm within a range of ⁇ 1 mm.
  • one or more of the display-equipped keys 44 can be equipped with a transducer 49 that can emit sound and/or vibrate, such as for providing and/or enhancing tactile feel of the key 44.
  • a transducer 49 can increase its output intensity and/or frequency in response to a given condition occurring, which can be tied to the display of a particular image, one image of a particular image series, the position of a key, including a display key, etc.
  • DOC / ⁇ with a display driver arrangement such as like that depicted in one or more of Figs. 6-9, 11, or 14 that is located onboard a display key 44 to control display key operation.
  • the onboard display key controller processor 144 depicted in Fig. 31 is linked to an onboard key display driver that in turn is linked to the display located onboard that same display key.
  • the processor delivers or coordinates delivery of image display data to the driver which in turn applies electrical power to the display as needed to cause the display to produce the image corresponding to the image data.
  • the display driver includes driver circuitry and/or components that interface with the display onboard the display key in a manner that controls display operation in accordance with signals and/or data received, such as from the display key controller processor.
  • Display key controller processor operation is controlled at least in part by firmware that typically also is disposed onboard the display keyboard. While firmware is preferred, software can be employed instead of or in addition to firmware.
  • the firmware is stored onboard the processor such as in memory located thereon. For example, in one preferred embodiment, the firmware is stored in EEPROM onboard the processor.
  • a first image associated with first in queue image data set Is will be delivered first to bus 158 so it is received and displayed by display key 44e
  • a second image associated with second in queue image data set I 4 will be delivered second to bus 158 so it is received and displayed by display key 44d
  • a third image associated with first in queue image data set I 3 will be delivered third to bus 158 so it is received and displayed by display key 44c
  • a fourth image associated with first in queue image data set h will be delivered fourth to bus 158 so it is received and displayed by display key 44b
  • a fifth image associated with first in queue image data set Ii will be delivered last to bus 158 so it is received and displayed by display key 44a.
  • each display key also includes a keyswitch that is constructed and arranged to cause a signal to be generated when the key is displaced, such as by a sufficient minimum displacement amount, such as when pressed by a user.
  • Each keyswitch of each display key is linked to a keyswitch decoder by a common bus.
  • the keyswitch decoder can be processor equipped where needed and can be liked to the key display controller processor if desired. If desired, the keyswitch decoder can be separate from the display controller processor, such as where the keyboard includes both display and non-display keys.
  • USB interface hardware is provided, preferably onboard the display keyboard, e.g., on a circuit board inside the display keyboard housing, but can be located off-board if desired. Data and/or signals, including key display image data, feedback related to the display thereof as well as keyswitch/key press data are communicated in the desired manner between the devices to which the display keyboard is linked. For example, as shown in Fig.
  • key display image data for a display of display keys is delivered serially to each of the display keys with the display image data for the display key located most downstream being first and the display image data for the closest most upstream located display, i.e. key 1 in Fig. 31, being last in the stream of display image data delivered.
  • each key display image can be represented by a set of data having a link, e.g. software pointer, that enables key display image data for a plurality of display keys to be reordered, selectively removed and replaced, selectively deleted, replaced, etc. for one display key at a time, a plurality of display keys at a time, a plurality of pairs of display keys, etc.
  • a bus constructed in accordance with that disclosed in Fig. 31 advantageously distributes key display image data for each display key desired to be "lit up" in a sequential line of display image data records with one record following another and their order corresponding the order which the key displays are sequentially linked, e.g., daisy chained together.
  • the key display controller preferably has enough onboard memory, such as RAM memory, to store at least one set of key display image data containing key
  • the key switches of the keys are connected via a matrix decoder thereby reducing the number of processor input/output (I/O) lines required.
  • I/O processor input/output
  • the keyswitch circuitry including any decoder, e.g. matrix decoder, used is separate from the key display controller and associated circuitry
  • conventional key switch decoder circuitry can be used that employs a processor, e.g. microprocessor or microcontroller, that is separate from the processor of the key display controller hardware.
  • such key display circuitry, firmware and the like preferably is configured or configurable to permit bi-directional data transfer (digital data) of at least display key related data, including key display image data, to and from the display keyboard, namely the key display controller processor.
  • bi-directional data transfer digital data
  • key display key related data including key display image data
  • the display keyboard namely the key display controller processor
  • the new key display image data is inserted where appropriate and delivered when the key displays are next refreshed, such as preferably during a subsequent clock or timing signal.
  • each key display is assigned a corresponding memory location of the onboard key display memory.
  • Key display image data sent from the host device to the display keyboard for showing on a particular key display is designated for memory storage in the onboard key display image data memory corresponding to that display key.
  • the key display image data is retrieved and sent to the daisy-chained key displays, which then display the image defined by the key display image data received.
  • Key display data is arranged in memory in order corresponding to that of the daisy chained key displays.
  • the key display image data is either stored onboard the host and/or delivered directly to the key display controller, which in turn delivers it to the desired key displays sequentially in a manner in accordance with that previously discussed above.
  • key display image data delivery from the host device may be desired, even advantageous in certain instances.
  • order, image arrangement, etc. of the key display image data can be solely determined by software and/or firmware of the host device, if desired.
  • one or more of the images shown on a corresponding number of display keys 44 correspondingly changes.
  • these game controller display function keys custom tailor them via game and controller input interaction.
  • This method and arrangement can be employed with other types of controllers including a paddle-type controller, a trackball equipped controller, a steering wheel equipped controller and the like.
  • the game player can select, designate or even create images that are always displayed on one or more of the display keys.
  • key display image sets can be designated, designed, selected, or even created by a game player that the game player can selectively cause to display and change as needed in response to the game player selecting a particular set, pre- conditioning displaying the images of a particular set upon occurrence of a particular event, function, condition, or occurrence thereby enabling a game player to custom design and control one or more of the display keys of the game controller.
  • ⁇ 0Q146049.DOC / ⁇ keyboard sequence that lacks any control key, escape key or function key. While the aforementioned method is described for use with a display data entry unit that is a display keyboard 40, it is also well suited for use with a device, such as a computer or game console, that is linked to a game controller 164 the same as or like that shown in Fig. 32.
  • the software application is a browser, such as Internet
  • the API can scan the website cookie or cookies to determine what images to load, with one or more images and display key designations being stored in a cookie.
  • the IP address of the website visited is compared against a lookup table, database or the like of IP addresses of display data entry unit compatible websites.
  • the API loads the image data and display key designation data as to which image is to be displayed on which display key 44 from the table or database or from another table, database or file. Once loaded, the desired image data is transmitted to the display data entry unit where it is displayed as an image on the specific display key 44 designated by the designation data associated with the image data.
  • the display key images including function, context or location based sets of display key images can be developed by users themselves, by system administrators, and/or by software developers. In a preferred implementation of a method, there are three levels of display data entry unit operation customization. First, individual users can create their own icons and functions, using an image editing software application that runs on the host device to which the display key equipped user input device is connected.
  • DOC/ ⁇ communicate with a display data entry unit API configured in accordance with that discussed above.
  • software executable on a host device to which a display key equipped user input device is linked preferably includes an image editor, an image layout editor, and/or an API preferably for third party software developers.
  • Internet applications can be display key user input device configured or configurable by embedding the desired code, preferably HTML or XML code, in web pages and images in web server based image folder.
  • the code e.g., HTML or XML code
  • the host device browses a display key code enabled web page
  • the code e.g., HTML or XML code
  • the host device browses a display key code enabled web page
  • the code e.g., HTML or XML code
  • the host device browses a display key code enabled web page
  • the code e.g., HTML or XML code
  • HTML or XML code is executed either by the web server but more preferably by the host device, causing retrieval and downloading of one or more desired key display images from the server based image folder.
  • XML code is employed.
  • One or more of such images are, in turn, delivered to the display keyboard or display keypad where the display controller processor causes each such image to be displayed on a desired display key.
  • Fig. 33 illustrates a screen shot 176 of a preferred but exemplary implementation of a key display image layout editor, which is used to assign images or image data to a particular display key 44 of a display data entry unit 40. Any changes to the keys 44a-441 in the window 178 at the top immediately show up on the actual key displays 44a-441 (Fig. 1) of the display data entry unit 40. It is easy to drop icons or images into the Gallery 180 at the bottom using a mouse (not shown) or other input device. An integrated file browser (not shown) can be used to load image files, icons and the like into the Gallery 180.
  • DOC / ⁇ macros, and the like can be assigned or otherwise associated with a particular image such that the corresponding function, task, conditional logic, web page link, and/or macro is executed or otherwise carried out when that display key is pressed sufficiently downwardly to cause its keyswitch to generate the corresponding key-press signal or code, e.g., ASCII code, for the display key.
  • a user can select and associate a particular task, function, selection, conditional logic, web page link, macro or other from a drop down menu of the layout editor with an image that can then be assigned to a particular display key, i.e. one of display keys 44a-441, upon which it will then appear.
  • the associated task, function, selection, conditional logic, web page link, macro or other is caused to be executed by the host device.
  • a display editor 182 is used for modifying or creating new images. Again, any change to an image preferably is immediately displayed or displayable on an actual key display, preferably the display designated via the display editor. Functionality can also be assigned in the same manner as can be done as described above.
  • An image converter is also included that converts any image, e.g. bitmap, JPG, TIFF, etc. to a hexadecimal code representative of that image. For example, it does not matter how large the target image is in terms of size, pixels, color, black and white, grayscale, etc.
  • each key display pixel can be assigned a greater number of digits sufficient to desirably represent the target image when the conversion routine is used to crea.te a smaller but representative image from the target image. Thereafter, the resultant smaller key display image produced is converted into digital data and transmitted when desired to the display data entry input for display on at least one display key 44 thereof.
  • Fig. 33 illustrates a preferred but exemplary screen shot of a preferred software implementation of the above-described Layout Editor. The Gallery shown in Fig.
  • a selected image can be edited in the Display Editor, such as by selecting the image using a mouse or the like. Clicking on pixels enables that pixel to be turned on (e.g., darkened or made black) or turned off (e.g., made lighter or transparent) in a desired manner to create a key display image as well as to edit an existing image, including one being configured for display on a display key.
  • the image can be stored and/or dragged and dropped onto a desired display key shown on the display key layout on screen thereby assigning that image to that particular display key.
  • Fig. 33 enables the user to create sets of display key images storable on the host computer which can be called up anytime, including when assigned to automatically do so by being associated with a particular software application,
  • Fig. 34 illustrates a keyboard simulator 184 that displays on the display screen of the host device a visual representation of the input keys of a display key equipped user input with the current display key image that is assigned to each display key being shown on the icon of that display key shown on screen.
  • a user can use their mouse, including right- click functionality, to add, delete, reassign, etc. images to one or more of the display keys.
  • Display key images can be built, such as by using an image editor configured in accordance with the present disclosure, which can be tested using the keyboard simulator. For example, image clarity, image appearance, any function(s) associated with an image, and other parameters can be tested or otherwise simulated before actual use with a real display keyboard constructed in accordance with the present invention.
  • At least one key display compatible image is a grayscale image having a resolution of between 20 pixels by 20 pixels and 256 pixels by 256 pixels that is stored in JPEG, JPG or PNG format.
  • each key display compatible image is a grayscale image having a resolution of between 20 pixels by 20 pixels and 256 pixels by 256 pixels that is stored in JPEG, JPG or PNG format.
  • at least one key display image is a color image, e.g., 24-bit color, having a resolution of between 20 pixels by 20 pixels and 256 pixels by 256 pixels that is stored in JPEG, JPG or PNG format.
  • each key display image is a color image of at least 8-bit color depth that has
  • DOC I a resolution of between 20 pixels by 20 pixels and 256 pixels by 256 pixels that is stored in JPEG, JPG or PNG format.
  • display keys, display key circuitry, and display key software in accordance with that described above include the QWERTY keyboard, the Dvorak keyboard, mini-keyboards ranging in size having anywhere from five keys, twenty keys, thirty-five keys, sixty-five keys, etc. and other types of keyboard type data entry devices traditionally previously limited to text, e.g. ASCII, input. Keypads having a like number of display keys and the like can also be produced.
  • display keys can be configured with icons, text, words, symbols, functions, including mathematical functions, flashing images, moving images, and other types of indicia, including that of non-text nature, to make data entry faster, more efficient, with less effort, and requiring less memorization.
  • interaction with software of the host can effect changing and/or delivery of key display images to one or more display keys of the display keyboard in response to prior user input, feedback or interaction from a network, e.g., the Internet, as well as pressing another key of the keyboard, including a display key.
  • a network e.g., the Internet
  • key display image related data representative of a key displayable image is embedded in the HTML or XML code of a web page.
  • the key display image related data is read and communicated to the display data entry unit where it is displayed or converted and displayed as at least one image on at least one display key 44.
  • the browser is equipped with a plug-in or module, such as a BHO, which is configured to search or otherwise parse the underlying HTML or XML code of the web page being displayed in the window of the browser. Should searching reveal a code having a format that indicates it is key display image related data, the BHO reads the data such that it is downloaded and communicated to the display data entry unit, such as via its USB bus, where it is displayed on
  • the data is converted into a display image data format that is compatible with the display data entry unit 40.
  • the key display image related data that is embedded in the HTML or XML code in a web page is in hexadecimal format being represented by a plurality of pairs of hexadecimal digits arranged in a hexadecimal string as discussed above. If desired, data can be included in the hexadecimal string that provides display key designation information as to which key the display image data resulting from any conversion operation performed on the hexadecimal string being displayed in a specific display key 44 according to the display key designation data.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Input From Keyboards Or The Like (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

L'invention concerne une unité d'entrée de données d'affichage et un procédé de configuration et de fonctionnement d'une unité d'entrée de données d'affichage composée d'une ou de plusieurs entrées de données contenant un affichage qui, dans un mode de réalisation préféré, comporte une ou plusieurs touches enfonçables équipées d'un affichage. L'unité peut s'interfacer avec une interface de programmation d'application (API) qui change des images représentées sur des touches d'affichage et les fonctions exécutables associées selon une interaction contextuelle d'utilisateur avec une application logicielle exécutée sur le dispositif auquel l'unité est reliée. Dans une mise en œuvre préférée, un module de navigateur ou plugiciel est employé, lequel surveille des sites Internet et provoque des changements de fonctions exécutables et d'images correspondantes sur une ou plusieurs des touches d'affichage de l'unité selon le site Internet consulté. Dans une mise en œuvre préférée, le module de navigateur ou plugiciel analyse chaque page Web visitée par un navigateur et amène de tels changements à se produire automatiquement selon un contenu de page Internet.
EP07838537A 2006-09-18 2007-09-18 Procédé et unité d'entrée de données d'affichage Withdrawn EP2069890A1 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US84537306P 2006-09-18 2006-09-18
US84636506P 2006-09-20 2006-09-20
PCT/US2007/020344 WO2008036338A1 (fr) 2006-09-18 2007-09-18 Procédé et unité d'entrée de données d'affichage

Publications (1)

Publication Number Publication Date
EP2069890A1 true EP2069890A1 (fr) 2009-06-17

Family

ID=39200810

Family Applications (1)

Application Number Title Priority Date Filing Date
EP07838537A Withdrawn EP2069890A1 (fr) 2006-09-18 2007-09-18 Procédé et unité d'entrée de données d'affichage

Country Status (2)

Country Link
EP (1) EP2069890A1 (fr)
WO (2) WO2008036338A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2110833A1 (fr) * 2007-01-17 2009-10-21 Industrias Lorenzo, SA Disposition d'ensembles de commutation a touche

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB0801626D0 (en) * 2008-01-30 2008-03-05 Lancaster University Adaptive keyboard
ES1069701Y (es) * 2009-01-27 2009-08-10 Lorenzo Ind Sa Dispositivo conmutador de pulsador con pantalla oled
CN107924773B (zh) * 2015-07-31 2020-10-30 英特尔公司 带有有源元件的键帽

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0425124U (fr) * 1990-06-26 1992-02-28
JPH0648133U (ja) * 1992-12-02 1994-06-28 エスエムケイ株式会社 キーボードスイッチ
KR20000045664A (ko) * 1998-12-30 2000-07-25 강병호 액정표시장치를 이용한 키입력장치 및 그 키입력방법
US6401065B1 (en) * 1999-06-17 2002-06-04 International Business Machines Corporation Intelligent keyboard interface with use of human language processing
CN1246158C (zh) * 2000-06-07 2006-03-22 联合基斯股份有限公司 具有可变可视指示器的控制单元
JP2002354079A (ja) * 2001-05-30 2002-12-06 Matsushita Electric Ind Co Ltd キー表示装置
US20040036632A1 (en) * 2002-08-21 2004-02-26 Intel Corporation Universal display keyboard, system, and methods
US20040066374A1 (en) * 2002-10-03 2004-04-08 International Business Machines Corporation Keyboard configurable to multiple mappings
TW200620060A (en) * 2004-12-08 2006-06-16 Mitac Technology Corp Keyboard module with light-emitting array and key unit thereof

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2008036338A1 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2110833A1 (fr) * 2007-01-17 2009-10-21 Industrias Lorenzo, SA Disposition d'ensembles de commutation a touche
EP2110833A4 (fr) * 2007-01-17 2014-02-26 Lorenzo Ind Sa Disposition d'ensembles de commutation a touche

Also Published As

Publication number Publication date
WO2008073551A3 (fr) 2008-09-25
WO2008036338A1 (fr) 2008-03-27
WO2008073551A2 (fr) 2008-06-19

Similar Documents

Publication Publication Date Title
US20080092087A1 (en) Method and Display Data Entry Unit
US20080131184A1 (en) Display key, display keyswitch assembly, key display assembly, key display, display data entry device, display PC keyboard, and related methods
EP2087414B1 (fr) Dispositifs d'entrée humaine configurables sur internet
US6961048B2 (en) Displaying information on keys of a keyboard
US7091955B2 (en) Multi-purpose keyboard
US7253807B2 (en) Interactive apparatuses with tactiley enhanced visual imaging capability and related methods
US20080088590A1 (en) Display Input Equipped Data Entry Device and Methods
CN107463268A (zh) 具有电子可变键帽的计算机键盘
US20120062465A1 (en) Methods of and systems for reducing keyboard data entry errors
KR100735554B1 (ko) 문자 입력 방법 및 이를 위한 장치
WO2011093045A1 (fr) Dispositif fournissant une sensation tactile et procédé fournissant une sensation tactile
US20120017161A1 (en) System and method for user interface
CN105027064A (zh) 自适应虚拟键盘
JP2006216542A (ja) キーディスプレイ部が結合されたキー入力装置及びそれを提供するデジタル装置
JPH05134797A (ja) ダイナミツク予測キーボード及びそのキーボードを操作する方法
EP2183855A2 (fr) Combinaison capteur/clavier pour stations mobiles et applications de cette combinaison
EP2069890A1 (fr) Procédé et unité d'entrée de données d'affichage
KR101808774B1 (ko) 가상 키보드 구조, 가상 키패드 기반 문자 입력 방법, 이를 실현하기 위한 프로그램이 기록되어 있는 컴퓨터 판독 가능한 기록 매체
KR100967321B1 (ko) 속기 키보드의 키 및 문자 매핑 방법 및 장치
CN110310471B (zh) 一种家电遥控方法及系统
Ballard User Interface Design Guidelines for J2ME MIDP 2.0
Colven et al. Switch access to technology
Judge et al. Switch access to technology-A comprehensive Guide.
WO2012073005A1 (fr) Procédés et systèmes d'entrée de texte prédictive
Binder The complete idiot's guide to Mac OS X

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20090417

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK RS

DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20120403