WO1998002792A2

WO1998002792A2 - Data processor input device

Info

Publication number: WO1998002792A2
Application number: PCT/IL1997/000234
Authority: WO
Inventors: Adi Lipman; Aharon Lipman
Original assignee: Wizcom Technologies Ltd.
Priority date: 1996-07-16
Filing date: 1997-07-09
Publication date: 1998-01-22
Also published as: AU3357097A; WO1998002792A3; IL118875A0

Abstract

The invention discloses a data processor input device (2), including a record member (PKB) marked on a face with person-readable markings simulating a keyboard (51) in which the markings (52, 53, 54) divide the face of the record member into a plurality of distinct visual fields each representing and simulating a key of the keyboard, each of the key-representing fields including a person-readable marking (52a, 53a, 54a) identifying the respective key, and a machine-readable marking identifying the respective key, and a hand-holdable reader including a reading head (3) manually placeable over individual key-representing fields of the simulated keyboard for reading the machine-readable marking thereon, and a data processor including a recognition circuit for recognizing the keys identified by the machine-readable markings on their respective key-representing fields.

Description

DATA PROCESSOR INPUT DEVICE

The present invention relates to an input device which may be used as an

alternative to a keyboard for inputting data into a data processor. The invention is

particularly useful as an input device for use with a scanner-type electronic translator,

such as described in our Israel Patent Application No. 114,367 filed June 27, 1995. The

invention is therefore described below with respect to such a use, but it will be appreciated that the invention could be advantageously used in many other applications.

The above-cited patent application describes an electronic translator in the form of

a hand-holdable housing which includes a scanner head for scanning a record medium, an

optical sensor for sensing characters printed on the record medium, a storage device for storing a dictionary of words and their translations, a visual display, and a data processor for processing the characters sensed by the optical sensor, for recognizing words

therefrom corresponding to words stored in the storage device, and for displaying their

translations in the visual display. Such an electronic translator enables the user to scan printed text in one language, and to display in real-time the translation of the text in a

second language.

In a scanner-type electronic translator, the words to be translated must be in the form of a printed text to be scanned by the scanner head. Such an electronic translator,

therefore, does not have the capability of keyboard type electronic translators for translating words not appearing in a printed text, such as words to be spoken by the user

or to be used by the user when preparing a text to be printed. To provide a scanner-type

electronic translator with a keyboard for inputting such words would make the electronic translator extremely bulky and would thereby defeat a main advantage of the scanner- type electronic translator, such as described in the above patent application.

An object of the present invention is to provide an input device which can be used

in lieu of a keyboard for inputting data into a data processor. Another object of the

invention is to provide such an input device for a scanner- type electronic translator, e.g.,

as described in the above- cited patent application, to add to it the capability of translating words not appearing in a printed text but without the additional bulk of a conventional keyboard for this purpose.

According to a broad aspect of the present invention, there is provided a data processor input device, comprising: a record member marked on a face with person- readable markings simulating a keyboard which markings divide said face of the record member into a plurality of distinct visual fields each representing and simulating a key of

the keyboard; each of the key-representing fields including a person-readable marking identifying the respective key, and a machine-readable marking identifying the respective

key; and a hand-holdable reader including a reading head manually placeable over

individual key- representing fields of the simulated keyboard for reading the machine readable marking thereon, and a data processor including a recognition circuit for

recognizing the key identified by the machine-readable marking on the respective key-

representing field.

The invention is particularly useful in the form of an "optical keyboard", wherein

the machine-readable markings on the record medium identifying the respective keys are optical code markings, and the reading head in the hand-holdable reader is an optical

reading head. According to further features in the preferred embodiment of the invention

described below, the machine- readable markings on the record member identifying the

respective keys are plural-bit code markings. In this embodiment, the reading head

includes a linear array of optical sensor elements; and the data processor includes means for sensing the proper positioning of the linear array of optical sensor elements with

respect to the machine- readable markings on a record member, and means for

identifying the keys represented by the plural-bit code markings sensed by the scanner

head.

Such an optical keyboard can thus operate by merely placing the scanner head over

the key-representing field of the record member, without scanning the record member.

The invention is especially useful for increasing the capability of scanner-type

electronic translators to input non-printed words for translation. In such an apparatus, the hand-holdable reader is a scanner-type electronic translator and includes a housing

containing a storage device for storing a dictionary of words and translations, a visual

display, and a data processor for processing the machine-readable markings read by the reading head, not only for identifying the keys on the simulated keyboard, but also for

recognizing words read by the reading head corresponding to words stored in the storage device, and for displaying their translations in the visual display.

Further features and advantages of the invention will be apparent from the description below.

The invention is herein described, by way of example only, with reference to the

accompanying drawings, wherein: Fig. 1 illustrates one form of data processor input device constructed in accordance

with the present invention for reading information from the record member;

Fig.2 is a block diagram schematically illustrating the construction of the optical scanner 2 ofFig. l;

Fig.3 more particularly illustrates the person- readable markings and the machine- readable code markings appearing on the record member of Fig.1;

Figs.4 and 5 are diagrams illustrating the manner of reading the machine-readable code markings appearing on the record member;

Fig.6 is a flow chart illustrating the operation of the input device of Figs.1-5; and

Fig.7 illustrates another form of record member which may also be used as a data processor input device in accordance with the present invention.

Fig.1 illustrates a data processor input device for use with a scanner-type electronic

translator, generally designated 2, to increase the capability of such a translator to translate non-printed words, e.g., words to be spoken by the user, or to be used by the

user in preparing a write-up. For purposes of example, the scanner-type electronic

translator 2 illustrated in Fig.1 may be that described in the above-cited Israel Patent

Application No. 114,367, and also in Israel Patent Application No. 118,914, filed July 22, 1996. It includes a scanner head 3 at one end for scanning printed text consisting of

words to be translated, and an optical sensor 4 (Fig.2) which senses the printed

characters and converts them to electrical signals. The electronic translator 2 further

includes electrical circuitry, to be described below with reference to Fig.2, comprising a storage device for storing a dictionary of words in one language and a translation in

another language, and a data processor for processing the electrical signals from the optical sensor, for recognizing words therefrom corresponding to words stored in the

storage device, and for displaying their translations in a visual display 6.

Fig. l also illustrates a record member simulating the appearance of a printed

keyboard PKB which is to be used with the scanner-type electronic translator 2 to enable non-printed words to be inputted for translation. This arrangement including the

keyboard-simulating record member PKB thereby adds to the scanner-type electronic translator 2 the capability, present in keyboard type translating devices, of translating non-printed words but without the additional bulk of a conventional keyboard.

Fig.1 further illustrates the electronic translator as including four directional keys 7

for centering the words reproduced in the visual display 6, and an ON/OFF key 8. When the scanner is energized by key 8, it automatically translates the scanned word and displays the translation in display 6. The four directional keys 7 may also be used for

scrolling the words reproduced in display 6. An Enter key 9 may be provided to perform

any one of various functions, as described in the above-cited patent application. The electronic translator is powered by its own batteries contained within its housing.

Fig.2 is a block diagram illustrating the overall electrical system in the above-

described electronic translator. The electrical system includes a digital signal processor 30, enclosed within housing 2 and receiving inputs from the CCD optical sensor 4 after conversion to digital form by an A D converter 40.

Processor 30 includes a CPU 31 which controls the energization of a light source

12 used for character detection, and a light source 14 used for displacement detection,

e.g., by illuminating a displacement detector marking on a roller carried by the scanner

head 3. These light sources are energized at different intervals and at different frequencies. Thus, when the CPU 31 receives the output from the CCD array 4 as a

result of energizing light source 12, it processes the information in a character detector

system 32; and when it receives the CCD array output as a result of energizing light

source 14, it processes the information in a displacement detector system 33. The light

received by the CCD array output from light source 12 is also used in a record medium detector system 34 for detecting the record medium RM.

Processor 30 also includes an optical character recognition (OCR) system 35

receiving the information processed in the character detector system 32 for recognizing characters. It further includes a PROM storage device 36 for storing, in addition to its

operational program, also a dictionary of words in one language and their translations in

another language. It further includes a RAM storage device 37 for use during the normal operation of the electronic translator. While the character detector system 32, the displacement detector system 33, the record medium detector system 34, and the optical character recognition (OCR) system 35 are all shown as separate blocks in Fig.2, it will

be appreciated that they are actually logic units within the data processor system 30. The

processor 30 also includes inputs from the control keys 7, 8, 9 illustrated in Fig.1.

While the invention is particularly useful with the hand-holdable scanner-type electronic translator described in the above-cited patent application, it may be used in

scanner-type electronic translators of other types, such as described in US Patents

4,890,230 and 5,063,508, as well as in optical scanners for other applications, such as

described in US Patents 4,947,261 and 5,301,243. Therefore, further details of the

construction and operation of the scanner-type electronic translator 2 are not set forth

herein. As indicated earlier, the record member PKB illustrated in Fig.1 is provided to

enable non-printed words also to be inputted into the electronic translator 2 but without the bulk of a keyboard generally provided for this purpose in a keyboard-type electronic translator. Record member PKB is printed on one face with person- readable markings simulating a keyboard. These person- readable markings include marking 51 simulating

the outline of a keyboard, and further markings 52, 53 and 54 dividing the face of the record member within the simulated keyboard frame 51 into a plurality of distinct visual fields each representing and simulating a key of the simulated keyboard.

Thus, markings 52 represent the outlines of numeral keys commonly provided on a keyboard, and markings 52a identify the respective keys; markings 53 represent the outlines of the alphabetical keys commonly provided on a keyboard, and markings 53a identify the respective keys; and markings 54 represent the outlines of various operational control keys commonly provided on a keyboard, and markings 54a identify the respective keys. The operational control keys simulated by markings 54 illustrated in Fig. l include keys marked TRANSLATE, ENGLISH, HEBREW, DEL (DELETED), INS (INSERT), SPACE, etc. Since all the markings 51, 52, 53 and 54 and 52a, 53a and

54a are person-readable markings, they may be produced by conventional printed techniques in visible ink.

Each of the person-readable key-representing markings 52, 53 and 54 on the keyboard-simulating record member PKB also includes machine-readable markings identifying the respective key. This is more clearly shown in Fig.3, wherein the person- readable marking 53, representing the key for the alphabetical character "A", is provided with both person-readable markings 53a and machine-readable markings 53b identifying the respective letter. The machine-readable markings 53b are in the form of an optical code capable of being sensed by the scanner head 3 of the electronic translator 2 and of being recognized by a character identification system, indicated by block 41 in Fig.2, included within the data processor 30. It will be appreciated that similar optical code markings are provided with respect to the simulated numerical keys 52 and the simulated operational control keys 54.

The machine-readable markings are in the form of plural-bit code markings identifying the respective keys. These code markings are illuminated by light source 12 (Fig.2) of the scanner head when placed over the respective key in the keyboard- simulating record member PKB. As a preferred example, light source 12 may be of the color red, and the plural-bit code markings may be of a different color so as to be non- reflecting with respect to the red color of light source 12; whereas the person-readable markings of the respective keys, as well as the background of the respective keys, may be of another color to reflect back the red light so as to be viewable by the user.

The optical sensor 4 within the reading head 3 consists of a linear array of optical sensor elements, e.g., CCD elements. The scanner head is merely placed over the simulated key on the record member PKB to be identified and is not moved across the record member. When the scanner head is thus placed in contact with the record

member PKB, the data processor 30 within the scanner first determines whether the linear array of sensor elements 4 is properly positioned with respect to the code markings on the record member to be able to read them, and if so, it reads the code markings to identify the key represented by such markings. The manner in which this is done is more particularly illustrated in Figs.4-6. The example illustrated in Figs.4-6 uses a code including eight bits Bi, B₂, B₃, B₄,

B₅, B₆, B , B₈, together with a Start bit B, and a Stop bit B_b at the beginning and end,

respectively, of the plural-bit code identifying the respective key. Such an eight-bit code can thus be used for identifying up to 256 keys. In this example, the optical sensor 4

consists of a 64-pixel line of CCD elements. The space between the Start bit B_a and

Stop bit Bb is approximately one-half the size of the CCD array.

The generated image on the CCD array is first analyzed to determine whether the

linear array of sensor elements 4 is properly positioned with respect to the code markings in identifying the respective key. This is done by determining the number of pixel

elements in the CCD array 4 which are spanned by the code markings between the Start and Stop bit markings, and then determining whether the number of such pixel elements

is within a predetermined range (L±ΔL); if less than that range, this indicates that the

linear array of pixel elements in the scanner head are not adequately aligned orthogonally

with the code markings for proper reading.

The number of pixel elements in the linear array spanned by the code markings is

then used to determine the number of pixel elements spanned by each of the code-

markings identifying the respective key. This enables identifying the pixel elements of

the linear array whose condition indicates either there is a "0" or " 1 " in each of the eight bits Bi, B₂, B₃, B₄, B₅, B₆, B₇, B_g identifying the key, as well as the Start and Stop bits B_a,

B_b.

Fig.6 is a flow chart illustrating the above- described manner of sensing the

condition of the linear array of CCD elements 4 and for identifying the character sensed

by the linear array. In this example, it will be assumed that a red light source 12 is used, and that the code markings, e.g., 53b, are non-reflecting to red so that a "minimum" light intensity is received by the pixel elements of the optical sensor when a "1 " is present, and

a maximum is received when a "0^H is present, as shown in Figs.4 and 5. In this example,

the code markings (e.g., 53b) may be blue so as to be non-reflecting to the red light, whereas the person-readable markings (e.g., 53a) may be red so as to be reflecting, and the background may be white so as also to be reflecting.

As shown in Fig.6, contact of the scanner head with the record medium is first

detected (block 60), which may be done in any suitable manner, e.g., by focusing light reflected from the record medium onto one of the CCD elements 4. The image stored in

the CCD elements 4 is then examined (block 61), the first and last minima are detected to indicate the Start bit B, and Stop bit Bb (Figs .4, 5), and the number of CCD elements between the two bits is calculated, as indicated by blocks 62, 63 and 64 in Fig.6.

A decision is then made whether the number (M) of CCD elements is within the

range of L±ΔL (block 65) to indicate whether the line of CCD elements 4 is properly

disposed orthogonally to the code markings. If not, the code analysis terminates; this may be indicated by energizing an indicator light (not shown).

If, however, the line of CCD elements 4 is properly located orthogonally to the

code markings, as determined by decision block 65 in Fig.6, the data processor then

calculates the bit width (ΔP), i.e., the number of CCD elements spanned by each bit

(block 66). This enables the data processor to determine the CCD numbers

corresponding to the eight-bit code identifying each character, whereupon the data

processor reads the eight-bit word identifying the respective key (block 67). The data processor then checks to see whether such a "word" exists in the stored code table (block 68). If so, it determines whether the key indicates a character (block 69), e.g., an alphabetical letter or number, or an operation code (block 70); and the key so identified is entered and displayed (blocks 71, 72).

As the above example wherein the optical sensor 4 is a line of 64 CCD pixel elements, the first valid minimum detected (B_a) may be pixel No. 12; the last valid

minimum (Bb) may be pixel No. 49; and ΔL may be ±3. In this example, the allowed

pixel difference (of block 65) would be 36±3; and the calculated pixel difference M

would be 37, i.e., within the range of proper registration. In this example, each data bit (ΔP, block 66, Fig.6) spans 4.1 pixels, so that the data processor can easily determine the pixel (or pixels) of the linear array sensing each of the bits in the eight-bit code identifying each key.

The overall operation of the system as illustrated in Figs.1 -6 will be apparent from the above description. For example to translate the word "boy" from English to Hebrew, the user: (1) places the scanner head on the key "English"; (2) lifts the scanner head and

places it on "B"; (3) lifts the scanner head and places it on "O"; (4) lifts the scanner head and places it on Y"; (5) lifts the scanner head and places it on "TRANSLATE", and (6) lifts the scanner head and places it on "HEBREW".

In the above example, the code markings were selected to be of a color (e.g., blue) so as to be non-reflecting with respect to the red light source 12, in which case the person-readable key and character markings would be reflecting (e.g., red), and the background would also be reflecting (e.g., white). It will be appreciated that a reverse color arrangement could be used, in which the machine-readable code markings would be reflecting (e.g., red, with a red light source), and the person-readable color of the characters and key would be non-reflecting (e.g., blue), and the background would also be non-reflecting (e.g., a different tone of blue).

Fig.7 illustrates another form of keyboard- simulating record member which may be used as an input device for a calculator-type data processor. The structure of the

record member illustrated in Fig.7, and the manner of using it as an optical keyboard input device, are basically the same as described above with respect to Figs.1-6, but modified for the calculator application of such a device.

While the invention has been described with respect to preferred embodiments, it

will be appreciated that these are set forth merely for purposes of example, and that many other variations, modifications and applications of the invention may be made.

Claims

1. A data processor input device, comprising:

a record member marked on a face with person- readable markings simulating a keyboard in which said markings divide said face of the record member into a plurality of

distinct visual fields each representing and simulating a key of the keyboard; each of said key-representing fields including a person-readable marking identifying

the respective key, and a machine-readable marking identifying the respective key; and a hand-holdable reader including a reading head manually placeable over

individual key-representing fields of said simulated keyboard for reading the machine- readable marking thereon, and a data processor including a recognition circuit for

recognizing the keys identified by the machine-readable markings on their respective key-

representing fields.

2. The input device according to Claim 1, wherein said machine-readable markings on the record medium identifying the respective keys are optical markings, and said

reading head in the hand-holdable reader is an optical reading head.

3. The input device according to Claim 2, wherein said key-representing fields of

said simulated keyboard include identifications of alphabetical characters.

4. The input device according to Claim 2, wherein said key-representing fields of

said simulated keyboard include identifications of numerical characters.

5. The input device according to any one of Claims 2-4, wherein said key- representing fields of said simulated keyboard include identifications of operational

control keys.

6. The input device according to any one of Claims 2-4, wherein said machine- readable markings on the record member identifying the respective keys are plural-bit code markings.

7. The input device according to Claim 6, wherein: said reading head includes a linear array of optical sensor elements; and said data processor includes means for sensing the proper positioning of said

linear array of optical sensor elements with respect to the machine-readable markings on the record member, and means for identifying the keys represented by the plural-bit code markings sensed by the scanner head.

8. The input device according to Claim 7, wherein said plural-bit code markings include a Start bit marking and a Stop bit marking respectively at the beginning and end of the plural-bit code marking identifying a respective key;

and wherein said means for sensing the proper positioning of the linear array of sensor elements senses the number of optical sensor elements spanned by the code markings between the Start and Stop bit markings, and determines whether the number of optical sensor elements is within a predetermined range.

9. The input device according to Claim 8, wherein said means for identifying the keys represented by the plural-bit code markings sensed by the scanner head determines the number of optical sensor elements in the linear array spanned by each bit, identifies the optical sensor element in the linear array corresponding to each bit, and reads out the optical sensor elements so identified to identify the key represented by the respective plural-bit code marking sensed by the scanner head.

10. The input device according to any one of Claims 2-4, wherein:

said hand-holdable reader includes a light source of a predetermined color;

said plural-bit code markings are of a different color so as to be non-reflecting with respect to said light source;

and said person-readable marking, and the background of the respective key, are each of a color to reflect back the light source of said predetermined color.

11. The input device according to any one of Claims 2-4, wherein:

said hand-holdable reader includes a light source of a predetermined color;

said plural-bit code markings are of the same color as that of said light source so as to be reflecting with respect to said light source; and said person-readable markings, as well as the background of the respective

keys, are of a color to be non-reflecting with respect to the color of said light source.

12. The input device according to any of Claims 1-4, wherein said hand-holdable reader is an electronic translator and further includes a storage device for storing a

dictionary of words and translations, and a visual display, said data processor including

means for processing the machine-readable markings read by said reading head, for recognizing words therefrom corresponding to words stored in said storage device, and for displaying their translations in said visual display.