JPH06217037A - Computer data output device - Google Patents

Abstract

PURPOSE:To give the commands to a computer by means of the hand signs and the face expressions by storing the image features and patterns of the hand and face states in an image data base. CONSTITUTION:An ultrawide angle lens 2B is attached to a storing frame and fetches the image of an operator operating a personal communicator 1 in the front of an input device 3. Then the lens 2B forms an image on the retina surface 2CC of an artificial retina chip 2C. The chip 2C takes out only the contour of the image formed on the surface 2CC and sends this image to an image analysis processor 22. The processor 22 contains the software to perform the image analysis processing operations such as the image processing, the feature extraction, the pattern recognition, etc., and the image retrieval processing to carry out the similar retrieval based on the result of the image analysis processing. Then an image data base system is formed in an exclusive memory 22A of the processor 22.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a device for outputting data to a computer.

[0002]

2. Description of the Related Art In recent years, computers have been reduced in size and improved in performance due to the development of electronic technology, and have been used for various purposes. For example, in a portable computer developed for carrying, it is connected to a wireless telephone device to perform data communication at the carrying destination, or to perform document input or accounting processing at the carrying destination. .

[0003]

However, with such miniaturization and higher performance, the operator has come to expect a response to a computer that is close to that of a human, and a keyboard, a mouse, etc. The conventional input device alone may be bothersome. For example, in the case of interactive software, it almost always responds to inquiries from the computer, so it becomes troublesome to operate the keyboard and mouse, and "just answer and understand. If you give me, "

An object of the present invention is to solve the above problems and improve the operability of a computer.

[0005]

A data output device for a computer according to the present invention is a device for outputting information and outputting a predetermined signal to a computer for inputting a response signal of the information, which is prepared in advance. An image database that stores a plurality of image information about images, an image detection unit that detects an image, an image search unit that searches the image database for image information that is similar to the detected image, and image information that is said to be similar And a search signal output means for outputting a signal corresponding to the above to the computer.

[0006]

In the computer data output apparatus of the present invention, the image detection means detects an image, and the image search means searches the image information stored in the image database for image information similar to the image. To do. When similar image information is found, the search signal output means outputs a signal corresponding to the image information to the computer.

Thus, for example, by storing the image features and patterns of the state of the hand and the state of the face in the image database, it is possible to issue a command to the computer by the hand cues and facial expressions. become.

[0008]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Next, an embodiment of the data output device for a computer of the present invention will be explained. 1 and 2 are perspective views of the personal communicator 1, and FIG. 3 is a block diagram thereof.
The personal communicator 1 includes a space eye 2 that processes image information, a pen input device 3, a main body 5, and a wireless telephone device 7. The pen input device 3 is
The housing frame 9 is held by the housing frame 9, and the housing frame 9 and the main body 5 are connected by a connecting portion 11 so as to be openable and closable in the arrow YY direction.
A holding mechanism (not shown) that holds the open state shown in FIG. 1 and the closed state shown in FIG. 2 is provided between the housing frame 9 and the main body 5.

A space eye 2, a microphone 13, a display 15, an ON switch 17, and an OFF switch 19 are attached to the housing frame 9 in the vicinity of the pen input device 3. A “space eye” lettering 2AA is provided near the space eye 2, and a space eye lettering 2AB is provided on the symmetrical side of the housing frame 9. In the vicinity of the microphone 13 located near the space eye 2,
The "microphone" lettering 13A is provided, the "on" lettering 17A is provided near the on switch 17, and the "off" lettering 19A is provided near the off switch 19. The on switch 17 and the off switch 19 are provided with two switch panels 17AA, 17BB, and 1 respectively.
It has 9AA and 19BB. These are arranged so as to be recessed from the surface of the housing frame 9 by 3 mm. The switch panels 17AA and 17BB output an ON signal when both are operated at substantially the same time. The switch panels 19AA and 19BB both output an off signal when they are operated at substantially the same time. This prevents an erroneous operation caused by accidentally touching a hand when carrying the device. As a result, the switch can be attached to the surface of the housing frame 9.

The radiotelephone device 7 and the main body 5 are contained in the accommodation box 2
It is housed in 1. The housing box 21 includes an image analysis processor 22, a dedicated memory 22A, a CPU 23, a voice analysis processor 24, a ROM 25, and a RAM 27.
EEPROM 29 and pen input controller unit 3
1, an input interface 33, a storage battery 35, power supply sockets 37 and 39, a telephone controller 41, a voice signal generation unit 43, an input / output controller 45,
An ear call controller 47, an ear call device 49,
The speaker 51, the speaker on switch 52, the display controller 53, the input pen 55, the input pen housing hole 57, the pen removal button 59, the output interface 61, the monitor lamp 63, the monitor speaker 65, and the attenuator 66. And the telephone output controller 6
7, a telephone output connector 69, a data input / output controller 71, a data input / output connector 73, a built-in application connector 74, and card connectors 75 and 77.
, Card storage 79, power supply controller 81, speaker storage 83, earphone storage device 85, and foot 8
7, a wireless telephone unit 89, an antenna 91, and an antenna housing portion 93 are provided.

The built-in application connector 74 has
The application software ROM 94 is inserted. The application software ROM 94 stores word processor software, database software, and communicator center software. These will be described later. The card storage unit 79 stores application software cards 95 and 97. The application software cards 95 and 97 are connected to the card connectors 75 and 77. Telephone output connector 69
A telephone cable 99 is connected to. Telephone cable 9
9 is connected to the facsimile apparatus 101. The data output cable 103 is connected to the data input / output connector 73. The data output cable 103 is a personal computer 105, a printer (not shown), or a GP.
S Connected to user equipment.

The wireless telephone device 7 includes a wireless telephone unit 89.
, An ear call controller 47, an input / output controller 45, an ear talker 49, a speaker 51, a microphone 13, and an antenna 91, and makes a call to and from a wireless telephone network (not shown). It has the function of receiving. The telephone controller 41 controls the input / output controller 45 and the wireless telephone unit 89 based on a command from the CPU 41. Audio signal generation unit 43
Synthesizes a predetermined voice based on a command from the CPU 23 and outputs it to the radio telephone unit 89 via the input / output controller 45.

The input interface 33 detects the voltage, consumption current and charging current of the storage battery 35. When the on-switch 17 is operated, the power controller 81
Power is supplied to the entire personal communicator 1 to make it active, and when the off switch 19 is operated, power is supplied to the standby system of the personal communicator 1 to make it stand by.

FIG. 4 is an explanatory view of the usage state of the personal communicator 1, and FIG. 5 is an explanatory view of the space eye 2. The space eye 2 includes an ultra wide-angle lens 2B, an artificial retina chip 2C, an image analysis processor 22, and a dedicated memory 22A. The ultra-wide-angle lens 2B is attached to the housing frame 9, and as shown in FIG. 4, in front of the pen input device 3, captures an image of the operator SSH who operates the personal communicator 1,
An image is formed on the retina surface 2CC of the artificial retina chip 2C. The artificial retina chip 2C has an image 2C obtained by extracting only the contour as shown in FIG. 5 from the image formed on the retina surface 2CC.
B is output to the image analysis processor 22. The image analysis processor 22 includes software for performing image analysis processing such as image processing, feature extraction, and pattern recognition, and image search processing for performing similarity search using the result of the image analysis processing, and stores an image database in the dedicated memory 22A. And form an image database system.

The dedicated memory 22A, as shown in FIG.
Space eye code data area 22AA, space monitor memory area 22AB, space characteristic memory area 22AC, sampling data area 22AD,
The pre-determined space eye code area 22AE is provided. The pen input device 3 includes a liquid crystal display 3A,
And a sensor layer 3B. Liquid crystal display 3A
Is connected to the pen input controller unit 31 and displays predetermined image data on the display surface 3C. The sensor layer 3B is connected to the pen input controller unit 31 and arranged below the liquid crystal display 3A to detect the position of the pen tip 55A of the input pen 55. The input pen 55 is provided with a coil (not shown) near the pen tip 55A. The input pen 55 includes a click / drag button 55B. The pen input device 3 and the input pen 55 detect the position at pen input by a known electromagnetic transfer method. The pen input device 3 is a ROM
The pen input device stored in 25 has a function of inputting characters without using a keyboard and a function of a pointing device.

As shown in FIG. 1, the speaker 51 includes a speaker body 51A, a supporting member 51B, and a connecting member 51C.
It has and. Speaker body 51A and support member 51
B is rotatably connected by a connecting member 51C in the directions of arrows YA and YB. The speaker main body 51A and the support member 51B are housed in the speaker housing 83 by being pushed in the arrow YC direction. The speaker 51 is connected to the speaker on switch 52,
When pulled out in the direction of the arrow YD, the “off” state is switched to the “on” state. The support member 51B is connected to a discharge mechanism (not shown), and when the "push" lettering portion 51D is pushed in the direction of the arrow YC in the stored state, the speaker body 51A pops out to the use position. An operation link (not shown) of the speaker on switch 52 is attached to the discharge mechanism (not shown).

The ear talker 49 is stored in the ear talker housing 85 when not used. Also,
When used, it is pulled out and used. this is,
After use, a finger is put in the finger-hanging hole 85B and the earphone storage device 85 is rotated according to the arrow 85A to be stored. The antenna 91 is normally housed in the antenna housing 93. Also, to improve the transmission / reception status,
Pull out and use. Therefore, it is provided with the freedom of movement in the directions of the arrows YE and YF and the rotatability in the directions of the arrows YH and YG.

As shown in FIG. 2, the input pen 55 is stored in the input pen storage hole 57 when it is not used. The pen eject button 59 is connected to a discharge mechanism (not shown) that causes the input pen 55 to pop out when pushed. The ROM 25 stores control programs and variable tables. The EEPROM 29 holds set values, designated values, etc., and includes an application registration area 29A and a selection item data table 29C. The selection item data table 29C stores the contents of the selection items on the screen displayed on the pen input device 3.

Next, the control executed by the CPU 23 will be described. FIG. 6 is an explanatory diagram of a display state of the display 15, FIG. 7 is an explanatory diagram of display control, and FIG. 8 is a flowchart of a display control processing routine. As shown in FIG. 6A, the display surface 1 of the display 15
5A includes a remaining power source display area 15B and an operating state display area 15C. The remaining power display area 15B is
"Power" display 15D, "0%" display 15E, "10"
A 0% "display 15F and a remaining amount display 15G are provided.
The remaining amount display 15G displays the remaining amount of the storage battery 35 as a bar graph. The operating state display area 15C is shown in FIG.
(K) has a display mode of a type.

The display control process shown in FIG. 8 is performed by the CPU.
23 is executed every predetermined time. First, power supply capacity detection is performed (step 100, hereinafter step is referred to as S). The power supply capacity is estimated by a power supply capacity calculation process (not shown) based on the voltage of the storage battery 35 input via the input interface 33 and the integrated value of the consumption current and the charging current. Next, the power capacity is displayed (S11).
0). The display is performed by the remaining amount display 15G. For example, if the power capacity is 100%, it is displayed as shown in FIG. 6 (A), and if it is 80%, it is displayed as shown in FIG. 6 (B).

Next, it is judged whether or not the reception is waiting (S12).
0). During the reception standby, the determination is made based on the set state of the reception standby flag set in a predetermined area of the RAM 27.
If it is not in standby for reception, the process proceeds to the next process as it is, and if it is in standby for reception, the standby display is displayed (S130). In the display waiting for reception, (A) of FIG.
Alternatively, the display shown in (I), (J) and (K) is performed.

Then, it is judged whether the FAX is being received (S).
140). During FAX reception, the FAX reception flag is used. If the FAX is being received, the FAX receiving display is performed (S150). The display during FAX reception is performed as shown in FIG. Thereafter, similarly, if data is being received (S160), a data receiving display (S170) as shown in FIG. 7C, and if FAX transmission is being performed (S180) as shown in FIG. 7D. Display during fax transmission (S190), during call (S200), display during call (S210) as shown in FIG. 7E, and during data transmission (S22)
0), a data transmission display as shown in FIG. 7F (S23)
0), during a call (S240), a call display as in (G) of FIG. 7 (S250), and during absence recording (S26).
0), display during absence recording as shown in FIG. 7H (S270)
Do.

Next, the data storage amount is detected (S28).
0). As the data storage amount, the data storage amount of the recorded message, the data storage amount of the reception FAX, and the data storage amount of the reception data are detected. Then, the data storage amount is displayed (S29).
0). The storage amount of recorded messages is as shown in (I) of FIG.
The storage amount of FAX is as shown in (J) of FIG. 7, and the storage amount of received data is as shown in (K) of FIG.

The above display control is always performed regardless of the operating states of the ON switch 17 and the OFF switch 19. Thereby, the operating state of the personal communicator 1 can be constantly monitored. FIG. 9 is a flowchart of the monitor control processing routine. It is executed by the CPU 23 at predetermined time intervals. First, it is determined whether the reception is in progress (S300). If it is being received, reception display is performed (S310). As for the reception display, the monitor lamp 63 is lit in green and the monitor speaker 65 outputs the reception sound. The volume of the received sound is adjusted by the attenuator 66.

Then, a determination is made during transmission (S32
0), if it is being transmitted, a transmission display is performed (S330). For the transmission display, the monitor lamp 63 is lit in red and the monitor speaker 65 outputs a transmission sound. next,
It is determined whether there is an abnormality (S340), and if it is abnormal, an abnormality display is performed (S350). The abnormality detects various abnormalities such as a state where the memory is full and a voltage drop of the storage battery 35. As for the display, the monitor lamp 63 is alternately turned on green and red, and the monitor speaker 65 is caused to output an alarm sound.

By the monitor control described above, the operating state of the personal communicator 1 can be monitored. FIG. 10 shows the standby of the personal communicator 1.
FIG. 3 is a usage state diagram of a charging state. When used in the state shown in this figure, the status of the personal communicator 1 can be grasped in an instant by the monitor lamp 63 and the monitor speaker 65. As shown in FIG. 10, the personal communicator 1 has its feet 87 facing down, and
It receives the charging power from the external power supply device 111 and the standby state in which it is set to 0.

FIG. 11 is a flow chart of the communicator control processing routine, and FIG. 12 is an explanatory view of the current status report screen. The communicator control processing routine is started by the CPU 23 when the ON signal is output from the ON switch 17, and is repeatedly executed until the OFF signal is output from the OFF switch 19 next time. First, the present situation investigation is performed (S400), and then the present situation report screen display is executed (S410). FIG. 12 is an example of the current status report screen displayed on the display surface 3C of the pen input device 3. On the current status report screen, a space eye mark display area 113, a current status report display 121, an operating status display area 123, a remaining memory capacity display 125, a FAX data storage capacity display 127,
Data storage amount display 129 and recorded message storage amount display 131
A FAX menu display 133, a data menu display 135, a telephone menu display 137, an application menu display 139, a setting menu display 141,
The space eye setting display 143 is displayed. In the operation status display area 123, "standby for reception", "receiving FAX", "receiving data", "transmitting FAX", "calling", "transmitting data", "call", or "absent""Recording" is displayed.

In the remaining memory amount display 125, the remaining storable memory amount for FAX, data and recorded messages is displayed as a percentage. Next, a judgment is made (S420). In the judgment, the selection of the item by the input pen 55 or the space eye 2 is awaited. Here, if the FAX menu display 133 is selected, then FAX processing is performed (S430). When the telephone menu display 137 is selected, telephone processing is performed (S440). If the data menu display 135 is selected, data processing is performed (S450). When the application menu display 139 is selected, application processing is performed (S460). When the setting menu display 141 is selected, setting processing is performed (S4
70). Each process will be described later.

FIG. 13 is an explanatory view of the space eye activation mark and the space eye stop mark, FIG. 14 is an explanatory view of the space eye code mark, FIG. 15 is an explanatory view of the space eye code mark, and FIG. 16 is a space eye selection execution mark. FIG. A space eye start mark 144 shown in FIG. 13A and a space eye stop mark 1 shown in FIG.
One of 45 is the space eye mark display area 1
13 is displayed. The space eye activation mark 144 is
It indicates that the space eye is currently stopped and serves as a selection mark for activating the space eye. The space eye stop mark 155 indicates that the space eye is currently in operation and serves as a selection mark for stopping the space eye.

Space eye code mark 1 shown in FIG.
46 is used in association with selection items such as the displays 133 to 143 of FIG. The space eye code mark 146 is displayed when the space eye stop mark 145 is displayed. When the space eye activation mark 144 is displayed, the space eye code mark 146 is not displayed. The space eye code mark 147 in FIG. 15 is the space eye code mark 14
6 is highlighted. The space eye code mark 147 is used to emphasize the space eye code mark 146. The space eye selection execution mark 148 in FIG. 16 is the space eye code mark 146 or 14
7 shows the selected state. When the space eye selection execution mark 148 is displayed and the selection execution is performed by the method described later, the space eye code mark 146 or 147 is selected and executed.

FIG. 17 is a flowchart of the space eye setting processing routine, and FIG. 18 is an explanatory view of the space eye setting menu. When the space eye setting display 143 is selected on the current status report screen of FIG. 12, the CPU 23 activates the space eye setting process of FIG.
First, the space eye setting menu is displayed (S50
0). As shown in FIG. 18, the space eye setting menu includes a space eye code addition display 100 on the display surface 3C.
1, re-input display 1003, stop display 1005, space eye activation mark 144, space eye setting display 1007, and “selection of 1 to 20, AZ” display 1009.
A confirmation code selection display 1010, a space eye code selection display field 1011, a space eye code input frame 1013, a deletion display 1015, and an input display 1017.
There are provided a sampling timing display 1019, a sampling period display 1021, and "Sampling the space eye code 1. Please input a bill, mouth shape, etc. during the sampling period."

After displaying the space eye setting menu, a determination is made next (S510). In the judgment, the space eye setting menu is selected. Here, if the space eye code is selected or the re-input display 1003 is selected, the next selected space eye code is sampled (S520). The space eye code is selected when the characters "1 to 20 or AZ" are input in the space eye code input frame 1013 and the input display 1017 is selected, or when the confirmation code selection display 1010 is selected. When is done. Confirmation code selection display 1
The selection of 010 is treated as a confirmation code.

In the sampling of the selected space eye code, the following processing is performed. The sampling timing display 1019 is displayed on the left end 101.
9A is highlighted on the right end 1019B side in order.
Here, the traveling speed is 0.3 seconds per one.

Display 1019C, 1019D, 101
An image is captured by the space eye 2 while 9E is highlighted. Image capture
The processing is performed at 0.05 second intervals, and the contour line of the captured image is stored in the sampling data area 22AD. A moving image for the selected space eye code is captured by the processing of.

After sampling, the feature extraction of the sampling data is performed (S530). FIG. 19 is a flowchart of a sampling data feature extraction processing routine. This processing is executed by the image analysis processor 22. First, the contour is read for each sampling data (S540). Next, moving image processing (understanding of changes) of each contour data is performed (S550). In the processing of a moving image, for example, the content of exercise is specified from a series of time-series images, the amount of movement is found, and the operation of recognizing the content is performed.

After the moving image processing, characteristic data is output (S560). In the output of the characteristic data, the processing result of the moving image is stored in a predetermined space eye code area of the space eye code data area 22AA. This allows
A search table for space eye code feature data is constructed. When the feature extracting process of the sampling data is completed, the process returns to the space eye setting menu of S500, and the determination process waits for input (S510).

If the space eye code is selected, sampling processing (S520) and feature extraction (S530) of the selected space eye code are executed.
On the other hand, if the re-input display 1003 is selected, the sampling processing of the previously selected space eye code (S52
0), the feature extraction process (S530) is executed again. S5
When it is determined that the space eye code addition display 1001 is selected in the judgment of 10, the space eye code addition processing is executed next (S580).

FIG. 20 is a flow chart of the space eye code giving processing routine. First, a screen is selected (S590). In selecting a screen, first, the current status report screen shown in FIG. 12 is displayed. Here, the input pen 55
When the space eye mark display area 113 is designated by, the displayed screen is selected. On the other hand, when a selection item such as the FAX menu display 133 is designated, a display screen of the designated selection item is displayed. In this way, the screens displayed one after another are switched and the screens are selected.

After selecting the screen, a space eye code assignment target is next input (S600). In the input of the space eye code addition target, the data of the selection item designated by the input pen 55 is input from the selection item data table 29C in the EEPROM 29. For example, in FIG.
When the FAX menu display 133 of 2 is instructed,
The selection item data of the FAX menu display 133 on this screen is input.

Next, the space eye code is input (S610). When inputting the space eye code, although not shown, a space eye code input frame that is substantially the same as the space eye code input frame 1013 shown in FIG. 18 is displayed. Next, the input of the space eye code in the space eye code input frame is awaited. When the space eye code is input, the space eye code is written next (S620). In writing the space eye code, the space eye code is added to the selection item data in the selection item data table 29C. As a result, a predetermined space eye code is set and registered in a predetermined selection item on a predetermined screen.

When the space eye code is written,
This routine is once ended, and the input standby state on the screen of FIG. 18 is entered. Here, when the cancel display 1005 is selected, the space eye setting process of FIG. 17 is once terminated, and the screen is changed to the current status report screen of FIG. 12
In this space eye mark display area 113, a space eye stop mark 145 is displayed here, but in the space eye mark display area 113, the space eye start-up mark 145 as shown in FIG. Mark 1
In some cases, 44 is displayed.

FIG. 21 is a flowchart of the space eye start-up processing routine. This process is activated by the CPU 23 at predetermined time intervals. First, it is determined whether the space eye activation mark is operated (S700). The determination that the space eye activation mark has been operated is made based on whether the space eye activation mark 144 is instructed by the input pen 55.
If the space eye activation mark is operated, then display screen data is input (S710). In the display screen data input, the selection item data of the image currently displayed on the display surface 3C is read from the selection item data table 29C.

After inputting the display screen data, the space eye code is then extracted (S720). In the space eye code extraction, the space eye code attached to the selected item data is read. Next, the space eye code is displayed (S730). In the space eye code display, the space eye code mark 146 or 14 is displayed near the selection item display to which the space eye code is attached.
7 is displayed. For example, in the case of FIG. 12, the space eye code marks 146A to 146F are displayed on the display 133 to.
It is displayed at the beginning of 143. A display example of the space eye code mark 147 will be described later. After displaying the space eye code, the space eye start mark is changed to the space eye stop mark (S740), and this routine is once ended. In the change, the space eye mark display area 113
The process of displaying the space eye stop mark 145 is performed. As a result, it is displayed that the Space Eye is currently being activated.

If the space eye is being activated, the next time this routine is activated, it is determined in step S700 whether or not the space eye stop mark is being displayed (S750), and the processing in steps S710 to S740. Is repeated. or,
When the space eye is not activated, that is, when the space eye stop mark is not displayed, S710 to S74
The process of 0 is not performed, and this routine is once terminated.

FIG. 22 is a flowchart of the space eye stop processing routine. This is activated following the space eye activation process of FIG. First, it is determined whether the space eye stop mark is operated (S800). If it has not been operated, this routine is temporarily terminated. Here, if the space eye stop mark is operated, then the display of the space eye code is erased (S81).
0). That is, the space eye code mark 146 or 147 is erased from the screen.

Next, the space eye stop mark is changed to the space eye start mark (S820). By this space eye stop processing, the space eye can be put into the standby state for activation. 23 is a flowchart of the space monitor processing routine, FIG. 24 is a flowchart of the space eye control processing routine, FIG. 25 is a flowchart of the space eye code determination processing routine, and FIG. 26 is a flowchart of the space eye code determination processing routine.
FIG. 27 is an explanatory diagram of operating states. These processes are
It is executed by the CPU 23 or the image analysis processor 22.

The space monitor process of FIG. 23 is performed by the CPU 23.
When the space eye stop mark is being displayed, it is first determined whether the space eye stop mark is being displayed (S850). If it is not being displayed, this routine is once terminated. If the space eye stop mark is displayed, then it is determined whether it is the specified time (S860). Here, if it is not the specified time,
This routine is once ended as it is. If it is the specified time, the space eye image is input next (S870). The stipulated time is a time interval from when the stipulated time is determined to be the stipulated time last time to when it is determined that the stipulated time has been reached this time, and the same time as the sampling interval in S520 of FIG. Next, the contour of the read image is extracted (S880), and this is written in the space monitor memory (S890). By this space monitor processing, the outline of the image captured from the ultra wide-angle lens 2B is written in the space monitor memory area 22AB.

The space eye control process of FIG.
When the space eye stop mark is being displayed, it is first determined whether the space eye stop mark is being displayed (S900). If it is not being displayed, this routine is ended as it is. On the other hand, if the space eye stop mark is being displayed, the contour data is read from the space monitor memory (S91).
0). This reads the contour for a predetermined period from the space monitor memory area 22AB. Next, moving image processing is performed (S920). This performs almost the same processing as S550 in FIG. After the moving image processing, the feature data is output to the space feature memory. In other words, the result of moving image processing is
Store in space feature memory area 22AC. In addition,
The moving image processing and the like are executed by the image analysis processor 22.

The space eye code judgment process of FIG. 25 is C
When activated by the PU 23 at predetermined intervals, it is first determined whether the space eye stop mark is being displayed (S940),
If it is not being displayed, this routine is ended as it is. If it is being displayed, the space eye code registered on the display screen is first input (S950). This is read from the selection item data in the selection item data table 29C.

Next, the characteristic data of the sampling data is input from the space eye code data area (S9).
60). That is, it corresponds to the space eye code registered in the current selection item of the display surface 3C, and the feature data obtained by sampling corresponding to this space eye code is stored in the space eye code data area 22A.
Input from A.

Next, the feature data is input from the space feature memory (S970). That is, the characteristic data actually obtained at present is read from the space characteristic memory area 22AC. After reading both feature data, the most similar feature data is extracted (S980). That is, the feature data most similar to the currently obtained feature data is searched from the preset feature data.

Next, the degree of similarity of the most similar feature data is calculated (S990). The calculation method is set appropriately. After calculating the degree of similarity, it is determined whether or not the degree is equal to or higher than a predetermined value (S1000). If it is equal to or larger than the predetermined value, the space eye code is output (S1).
010). Output is space code area 2 before confirmation
Go to 2AE.

The space eye code confirmation process of FIG. 26 is C
When the PU 23 is activated every predetermined time, it is first determined whether the space eye stop mark is being displayed (S1020). If it is not being displayed, this routine is ended as it is.
If it is being displayed, enter the space eye code (S
1030). The space eye code is input from the space eye code area 22AE before confirmation. Next, the display of the input space eye code is changed to the display of the confirmation code (S1040). This is displayed on the display surface 3C, and the pre-determined space eye code area 22A
The space eye code marks 146 and 147 corresponding to those input from E are changed to the space eye selection execution mark 148 in FIG. For example, as shown in FIG. 27, the space eye code mark 146 is changed to the space eye selection execution mark 148.

After changing the display to the confirmation code, the space eye code is input (S1050). Next, it is determined whether or not the entered space eye code is a confirmation code, and if it is not the confirmation code, the process moves to the confirmation code display in S1040. On the other hand, if the code is a confirmation code, the process proceeds to outputting a selection signal (S1070). As a result, the display of the entered space eye code is sequentially changed to the display of the confirmation code, and when the space eye code becomes the confirmation code, the selection items for which the space eye selection execution mark 148 is displayed at that time are displayed. The selection signal is output.

As a result, the desired selection item is selected on the display surface 3C. That is, the selection is performed by the space eye 2 without using the input pen 55. FIG. 28
Is a flowchart of the FAX processing routine, and FIG.
It is explanatory drawing of a document input screen. The FAX processing routine of FIG. 28 shows the contents of S430 of FIG. When the FAX processing routine is activated, the document input screen is first displayed (S1500). The document input screen includes a menu area 151 and a document input area 153, as shown in FIG. The menu area 151 includes a space eye mark display area 113 and a FAX menu display 155.
And FAX transmission display 157 and reception FAX display display 15
9 and a cancellation display 161 are displayed. The document input area 153 is initially blank.

In the space eye mark display area 113,
As shown in (A), the space eye activation mark 144
Alternatively, as shown in (B), a space eye stop mark 145 is displayed. When the space eye stop mark 145 is displayed, as shown in (B), the space eye code marks 146M, 146F, 1
46P and 146T are displayed, and the space eye code can be input by the space eye 2 as described above.

After the document input screen is displayed, a judgment is made (S1510). In the judgment, whether character input was selected,
Whether the FAX menu display 155 is selected, the FAX transmission display 157 is selected, or the reception FAX display display 159 is selected.
Is selected or the stop display 161 is selected. Here, the selection of the character input is a case where the document input area 153 is selected by the input pen 55 as shown in FIG.

When the character input is selected, document processing is performed next (S1520). The document processing occupies a main part of the document input function of the pen input computer. First, the cursor 163 is displayed at a point designated by the input pen 55, for example, the point 162. Next, the pen input area frame 165 is displayed. Pen input area frame 16
After the display of 5, the pen input is awaited. Here, as shown in FIG. 29, for example, if there is a hiragana input, it is traced and displayed in the pen input area frame 165. If there is a kanji input, the corresponding kanji is displayed. After this, input pen 55
When the conversion display 167 is selected by, the dictionary conversion is performed and the converted sentence is displayed at the position of the cursor 163. When the conversion display 167 is selected again, the second candidate dictionary conversion is performed. The input sentence is confirmed when there is the next pen input. Further, when the delete display 169 is selected, a process for deleting the character or pen input locus in the document input area 153 is performed. When the locus display 171 is selected, the locus of the input pen 55 in the document input area 153 is directly input. The image displayed in the document input area 153 is the FAX data memory 2 in the RAM 27.
It is stored in 7A.

In the determination of S1510, if the FAX menu display 155 is selected, the FAX menu processing is performed next (S1530), and if the FAX transmission display 157 is selected, the FAX transmission processing is performed next. (S1
540), if the received FAX display 159 is selected, then the received FAX display processing is performed (S1550).
Details will be described later. Further, when the stop display 161 is selected, this routine is temporarily terminated as it is.

FIG. 30 is a flowchart of the FAX menu processing routine, and FIG. 31 is an explanatory view of the FAX menu screen. When the FAX menu processing is activated, first, F
The AX menu screen is displayed (S1600). F
The AX menu screen includes a menu area 181 and a document selection area 183, as shown in FIG. In the menu area 181, the space eye mark display area 113, the next page display 185, the FAX transmission display 187, the reception FAX display display 189, and the cancel display 19 are displayed.
1 and a delete display 193 are displayed. A document list 195 is provided in the document selection area 183, and a document name display 197 is displayed in the document list 195.
A space eye stop mark 145 is displayed in the space eye mark display area 113. Therefore, the space eye code mark 146 is also displayed.

After the FAX menu screen is displayed, a judgment is made (S1610). In the judgment, whether the document is selected or the next page display 185 is selected, the FA
It is determined whether the X transmission display 187 is selected, the reception FAX display 189 is selected, the stop display 191 is selected, or the deletion display 193 is selected. Here, if the document is selected, that is, any one of the document name displays 197 is selected, then the document processing is performed (S1630).
In the document processing, first, the document input screen shown in FIG. 29 is displayed, and the document data stored in the document file 27B of the selected document name display 197 is displayed in the document input area 153. The document file 27B is RAM2
It is set within 7. Thereafter, the document processing that is substantially the same as S1520 described above is performed on the displayed document data. That is, it is possible to edit and use a prepared sentence.

The next page display 185 is determined at S1610.
If is selected, the page change process is executed.
In the page change process, the document list 195 is changed to the next page. If it is determined that the FAX transmission display 187 is selected, the FAX transmission processing is executed (S1640), and if the reception FAX display display 189 is selected, the reception F
AX display processing is executed (S1650), and delete display 19
When 3 is selected, deletion processing is executed (S1).
660). Further, when the stop display 191 is selected, this routine is temporarily terminated as it is.

FIG. 32 is a flowchart of the FAX transmission processing routine, and FIG. 33 is an explanatory view of the FAX transmission screen. When the FAX transmission process is activated, the FAX transmission screen is first displayed (S1700). The FAX transmission screen is displayed in the menu area 201 as shown in FIG.
And a transmission condition selection area 203. In the menu area 201, the space eye mark display area 113
A setting display 205 and a cancellation display 207 are displayed. In the transmission condition selection area 203, the transmission destination selection display 2
09, a transmission time selection display 211, and a transmission destination list 213
And a transmission time list 215 are provided, a transmission destination name 217 is displayed in the transmission destination list 213, and a transmission time name 219 is displayed in the transmission time list 215. A space eye stop mark 145 is displayed in the space eye mark display area 113. Therefore, (A)
As shown in, space eye code mark 146S, 1
46T, 146A, 146B, 146a, 146b are displayed. Space eye code mark 146a
The space eye code mark 146A is located below the space eye code mark 146b, and the space eye code mark 146b is located below the space eye code mark 146B. Here, the space eye code mark 146A or the destination selection display 209
When is selected, the space eye code mark 147a is changed as shown in FIG. Therefore, the selection item with the space eye code mark 146b is not the input target of the space eye code input, and the selection item with the space eye code mark 147a is the input target of the space eye code input. Is displayed.

After the FAX transmission screen is displayed, a judgment is made (S1710). In the judgment, whether the destination selection was done,
It is determined whether the transmission time is selected, the setting display 205 is selected, or the stop display 207 is selected. Here, when the destination is selected, that is, when one of the destination names 217 is selected, the transmission number setting process is executed next (S1720). In the transmission number setting processing, first, the telephone number set in the selected destination name 217 is set in the transmission number memory 27C in the RAM 27. After setting, the process returns to the determination process.

In the determination processing, if the transmission time is selected, that is, if any of the transmission time names 219 is selected, then the transmission time setting processing is executed (S1730). In the transmission time setting process, first, the transmission time set in the selected transmission time name 219 is set to the transmission time memory 2 in the RAM 27.
7D is set. After the setting, it is determined whether the next set transmission time is immediate (S1740), and if it is not immediate, the present routine is temporarily terminated. If the transmission time is immediate, then FAX transmission is executed (S175).
0). FAX transmission processing is performed by the wireless telephone device 7 through the R
The FAX data stored in the FAX data memory 27A in the AM 27 is facsimile-transmitted to the destination set in the transmission number memory 27C. As a result, a sentence or an image input by the pen input device 3 can be facsimile-transmitted to a desired destination on the spot. If the transmission is not immediate, it will be described later.

If the setting display 205 is selected in the determination in S1710, then FAX setting processing is executed (S1760). In the FAX setting process, the paper size,
Facsimile standards, transmission destinations are added and changed, and transmission times are added and changed by a FAX setting processing routine (not shown). That is, the transmission condition that should be set in advance is set.

If it is determined that the cancel display 207 is selected, this routine is temporarily terminated as it is. FIG. 34 shows
FIG. 35 is a flowchart of the reception FAX display processing routine.
FIG. 7 is an explanatory diagram of a reception FAX list screen. When the reception FAX display process is activated, first, the reception FAX list screen is displayed (S1800). The received fax list screen is shown in Fig. 3.
5, the menu area 221 and the reception F
And an AX selection area 223. Menu area 22
1 shows a data output display 225 and a stop display 227. In the reception FAX selection area 223, the reception F
An AX list display 229 and a reception FAX list 231 are provided, and a reception FAX name 233 is displayed in the reception FAX list 231.

After the reception FAX list screen is displayed, a judgment is made (S1810). In the judgment, it is judged whether the selection is made, the data output display 225 is selected, or the stop display 227 is selected. If any of the receiving FAX names 233 is selected here, the next receiving FAX
Display processing is executed (S1820). In the reception FAX display processing, the stored contents of the reception FAX data memory 27E corresponding to the reception FAX name 233 are displayed on the pen input device 3 as an image.

When the data output display 225 is selected in the judgment, the data output processing is executed (S183).
0). In the data output process, a data output screen (not shown) is displayed, selection of an output method is requested, and the content stored in the reception FAX data memory 27E is output by the selected method.
For example, the data is output to another facsimile device via the telephone output connector 69, or to another computer device or printer via the data input / output connector 73. Printing on paper is performed by outputting to a facsimile device.

When it is determined that the cancel display 227 is selected, this routine is temporarily terminated as it is. By the reception FAX display processing described above, the reception FAX data received via the wireless telephone device 7 and stored in the reception FAX data memory 27E is displayed or output to the outside and printed. You can

FIG. 36 is a flowchart of the deletion processing routine. When the deletion processing routine is started, first, F
The AX list screen is displayed (S1900). On the FAX list screen (not shown), data names indicating the storage contents of the FAX data memory 27A and the storage contents of the reception FAX data memory 27E are displayed. Then the selected F
Processing for deleting AX is performed (S1910). In the process of deleting the selected FAX, the stored data corresponding to the data name selected by the input pen 55 is deleted on the FAX list screen (not shown).

By this deletion processing, it is possible to delete unnecessary FAX data for transmission or received. F of the communicator control of FIG. 11 explained above
By the AX process (S430), FAX transmission data can be created, transmitted, and displayed only by operating the input pen 55. Further, screen operations such as transmission and display can be performed only by the operation of the space eye 2.

FIG. 37 is a flowchart of the telephone processing routine, FIG. 38 is an explanatory view of the telephone menu screen, and FIG.
Is an explanatory view of a message selection screen, FIG. 40 is a flowchart of a setting processing routine, and FIG. 41 is a flowchart of an answering machine display processing routine. When the telephone processing is activated, the telephone menu screen is first displayed (S20).
00). The telephone menu screen includes a menu area 241 and a call selection area 243, as shown in FIG. The setting display 245 is displayed in the menu area 241.
An answering machine display display 247 and a cancellation display 249 are displayed. The destination selection area 243 is provided with a destination selection (next page) display 251, a destination list 253, a transmission condition display 254, and a transmission condition list 255. The transmission destination list 253 includes transmission destinations. The name 257 is displayed, and the calling condition list 255 shows the calling condition name 259.

After the telephone menu screen is displayed, a judgment is made (S2010). In the judgment, any of the destination names 257
Is selected, the setting display 245 is selected, the recorded message display 247 is selected, or the stop display 249 is selected. Here, if any of the destination names is selected, the following judgment is made (S2020). In this judgment, the immediate display 26 from the calling condition name 259 is displayed.
1 is selected, the message transmission display 263 is selected, or the setting display 245 and the recorded message display 24
7. Judge whether the stop display 249 is selected. Here, when the immediate display 261 is selected, a telephone call is made (S2030). In the call origination, the call is originated to the destination selected in S2010. This makes it possible to talk with the other party.

In judgment, message transmission display 263
If is selected, a message selection screen is displayed next (S2040). As shown in FIG. 39, the message selection screen displays a menu area 271 and a message selection area 273. Menu area 27
A telephone call display 275 and a cancellation display 277 are displayed on the display screen 1. A message selection display 279 and a message list 281 are provided in the message selection area 273, and a message name 283 is displayed in the message list 281.

After the message selection screen is displayed, a judgment is made (S2050). In the determination, it is determined whether the stop display 277 is selected or any message name 283 is selected. Here, if the stop display 277 is selected, this routine is temporarily terminated, and if any message name 283 is selected, the content corresponding to the next selected message name 283 is displayed. . Illustration of the display screen here is omitted. The displayed content is RA
It is stored in the message data memory 27F in M27. The contents of the message data memory 27F are stored in advance using the input pen 55 by a message contents addition / modification routine (not shown).

After displaying the contents, a judgment is made (S207).
0). If it is determined that the telephone call display (not shown) is selected, the telephone call is made (S2030). In the telephone call, the selected message is automatically output as voice after connecting to the other party. Here, if there is a response from the other party, the voice data is received by the receiving telephone recording memory 2
It is stored in 7G. This content is reproduced by a receiving telephone recording / reproducing process (not shown).

If it is determined that the cancel display (not shown) is selected, this routine is temporarily terminated. As a result, the message transmission is stopped. When the setting display 245 is selected in the display state of the telephone menu screen, the setting process is performed next (S2080). In the setting process, as shown in FIG. 40, first, a setting screen is displayed (S2100). Although not shown, the setting screen includes an answering machine execution display, an answering machine cancel display, a cancellation display, a voice mode display, and a voice character conversion mode display. After the setting screen is displayed, the judgment is made.

If it is determined that the message recording execution display is selected, then the message recording processing is performed (S2120). In the answering machine process, a set is executed to execute an answering machine for a telephone received via the wireless telephone device 7. After that, it automatically answers the received call and records the received contents in the recorded message memory 27.
The process of storing in H is automatically performed. On the other hand, by judgment,
When the message recording cancel display is selected, the message recording cancel processing is performed (S2130). By this process, the process of recording the received telephone message is stopped. In addition, when it is determined that the cancel display is selected, this routine is temporarily terminated as it is.

If it is determined that the voice mode display is selected, the character conversion cancel process is executed (S214).
0). In the character conversion cancel process, the character conversion operation described below is canceled. If it is determined that the voice character conversion mode display is selected, character conversion operation processing is performed (S2150). In the character conversion operation process, the voice analysis processor 24 converts the voice mail recorded in the reception telephone recording memory 27G into character data, and stores it in the reception telephone character memory 27I. Further, in the case other than the recorded message, the voice signal received via the wireless telephone device 7 is converted into character data in real time and displayed on the pen input device 3 as characters. As a result, the received telephone call can be confirmed by the character data in addition to or by listening to the voice.

By the above setting process, it is possible to easily set whether or not to record the message. Further, since the telephone call is converted into character data and recognized, it is convenient for telephone calls in situations where no sound can be emitted, or can be utilized as a telephone device for the deaf. When the message recording display 247 is selected in the display state of the telephone menu screen, the message recording display processing is performed next (S20).
90).

As shown in FIG. 41, the recorded message display processing is as follows.
First, the list of recorded messages is displayed (S2200). Although not shown, the recorded message list screen includes a recorded message list, a recorded message list, a deletion display, and a cancellation display. In this determination, if any one of the recorded messages or the recorded characters is selected from the recorded message list or the recorded message list, it is reproduced next (S2220). In the case of voice recording, the voice recording data is called from the reception telephone recording memory 27G in the RAM 27 and is reproduced by the earphone 49 or the speaker 51 in the case of voice recording. In the case of an answering character, the answering character data is called from the reception telephone character memory 27I in the RAM 27, and the pen input device 3 is used.
By doing.

If it is determined that the deletion is made, the deletion process is performed next (S2230). The deletion process is performed by receiving the voice mail recording selected by the input pen 55 from the voice mail list or the voice mail list. The telephone recording memory 27G
Process to delete from inside, or receive telephone character memory 27I
Process to delete from inside. If the decision is to cancel, this routine is once terminated.

By the recorded message display processing described above, it is possible to reproduce recorded message voice data and display recorded message data in the form of character data. FIG. 42
Is a flowchart of the data processing routine, and FIG.
FIG. 44 is a flowchart of the transmission condition setting processing routine, and FIG. 45 is a flowchart of the data transmission processing routine.

When the data processing shown in FIG. 42 is started, the data input screen is first displayed (S2300). The data input screen is displayed in the menu area 29 as shown in FIG.
1 and a data input area 293. In the menu area 291, a transmission condition setting display 295, a data transmission display 297, a received data display display 299, and a cancel display 301 are provided. Data input area 293
Is initially solid.

After the data input screen is displayed, a judgment is made (S2310). In the judgment, whether the data input is selected, the transmission condition setting display 295 is selected, the data transmission display 297 is selected, the received data display 29
It is checked whether 9 is selected or the stop display 301 is selected. Here, the selection of data input is a case where the data input area 293 is selected by the input pen 55.

When the data input is selected, the data input process is performed next (S2320). In the data input process, first, a cursor 305 is displayed at a point designated by the input pen 55, for example, a point 303 as shown in FIG. 43, and a pen input area frame 307 is displayed. Then, the input data is transferred to the transmission data data memory 27.
The process of storing in J is performed.

If it is determined that the transmission condition setting display 295 is selected, then the transmission condition setting process is performed (S233).
0). Details will be described later. If the data transmission display 297 is selected in the determination, the data transmission processing is executed next (S2340), and if the reception data display 299 is selected, the reception data display processing is executed ( S23
50) If the stop display 301 is selected, this routine is temporarily terminated as it is.

In the transmission condition setting process of S2330, the process shown in FIG.
As shown in 4, the transmission condition setting screen is displayed first (S
2400). Although the transmission condition setting screen is not shown,
A selection display, a cancellation display, and an end display are provided. Here, when the selection display is selected, the transmission condition changing process is performed next (S2420). In the transmission condition change processing, first, a transmission condition change screen (not shown) is displayed. This transmission condition change screen includes an end display, a cancellation display, and a transmission condition selection display for data transmission such as BPS display, character length display, parity check display, stop bit number display, and X parameter display. It is displayed. Then, the process of inputting the information selected on the screen is performed.

When the end display is selected in the state of the transmission condition change screen or the transmission condition setting screen, the content of the transmission condition change process is confirmed. Further, when the stop display is selected, the change of the transmission condition change process is stopped. That is, the previous contents are not changed. By this transmission condition setting process, it is possible to set the standard of data transmission between computers.

Data transmission display 29 in S2310 of FIG.
When No. 7 is selected, the data transmission screen is first displayed as shown in the data transmission process of FIG. 45 (S25).
00). Although not shown, the data transmission screen includes a destination selection display, a transmission time selection display, a setting display, and a cancellation display. A judgment is made after the display (S251).
0).

If it is determined that the transmission destination selection display is selected, then the transmission number setting process is executed (S2520). In the transmission number setting process, a transmission number selection screen (not shown) is first displayed. The transmission number selection screen is provided with a transmission number list and a new number addition display. The transmission number list is provided with a plurality of transmission number displays. When the new number addition display is selected, a pen input area frame is displayed and a new destination number is input. Here, after waiting for the selection of the desired transmission number, if there is a selection, this number is set in the data transmission number memory 27K.

If it is determined that the transmission time selection display is selected, then transmission time setting processing is performed (S253).
0). In the transmission time setting process, a transmission time selection screen (not shown) is first displayed. The transmission time selection screen is provided with a transmission time input display and an immediate display. When the send time input display is selected, the pen input area frame is displayed,
Date and time data input by the pen is the data transmission time memory 27.
Stored in L. When the immediate display is selected, the immediate data is stored.

After the date and time data is stored, it is next determined whether it is immediate (S2540). If it is determined that it is not immediate, this routine is once terminated. On the other hand, if it is determined to be immediate, then data transmission processing is executed (S2550). In the data transmission process, the contents stored in the transmission data memory 27M are immediately transmitted. The transmission is performed under the transmission conditions set in S2330 and S2.
It is sent to the transmission number set in 520.

If it is determined in S2510 that the cancel display is selected, this routine is temporarily terminated. If the setting display is selected, then a data setting process is executed (S2560). In the data setting process, a data setting screen (not shown) is displayed first. This data setting screen is provided with a data input target display and an input type selection display. In the data input target display, for example, the data input / output connector 73, the card connector 75, and the card connector 77 are displayed. Text, binary, MMR data, RS232C, etc. are displayed on the input type selection display.

By this data transmission processing, settings are made for inputting and transmitting data. If the received data display display 299 is selected in the determination of S2310 in FIG. 42, the received data display processing is executed (S2350).
In the received data display processing, a received data display list screen (not shown) is displayed, selection is requested, and the selected received data is displayed as an image. When the external output is selected, it is output from the selected port.

If the cancel display 301 is selected in the determination (S2310), this routine is temporarily terminated. By the data processing described above, it is possible to directly send data to the destination computer or display the data sent from the destination computer. FIG. 46 is a flowchart of the application processing routine, FIG.
FIG. 7 is an explanatory diagram of an application selection screen.

When the application menu display 139 is selected in the determination in S420 of FIG. 11, application processing is next executed (S460). In the application processing, as shown in FIG. 46, first, an application selection screen is displayed (S2600). As shown in FIG. 47, the application selection screen has a menu area 311 and an application selection area 313.

A replacement display 315 is displayed in the menu area 311.
A full page display 317, a next page display 319, a stop display 321 and an execution display 323 are provided.
An application list 325 is provided in the application selection area 313. The application list 325 is provided with a use availability display 327. The availability indicator 327 includes an availability indicator 329 indicated by a white circle,
An unusable display 331 represented by a black circle is provided. The unusable display 331 indicates that the application software card is not set in the card storage 79.

An application display 333 is provided in the application list 325. After the application selection screen is displayed, the next judgment is made (S261).
0). In the judgment, it is judged which of the application selection screens has been selected. Here, if there is a selection in the menu area 311, a selection process is executed, and if the stop display 321 is selected, this routine is once terminated as it is. In addition, the application selection area 31
If the process in 3 is selected, then the application is executed (S2620). In the application execution, the processing shifts to the selected application routine. An example of the application will be described later.

FIG. 48 is a flowchart of the application menu registration processing routine, and FIG. 49 is a flowchart of the communicator center menu registration processing routine. The application menu registration process of FIG. 48 is started every predetermined time. First, it is determined whether a new application software card has been inserted. This judgment is made by first detecting whether or not the application software cards 95 and 97 are inserted in the card connectors 75 and 77 and, if so, by judging whether or not the card has already been registered as an application. To do.

If no new card has been inserted, this routine is once terminated. If inserted,
Registration data is input (S2710). Predetermined data is input as the registration data. Next, application registration is performed (S2720). Application registration is performed in the application registration area 29A in the EEPROM 29. When application registration is performed, FIG.
Menu area 31 of the application selection screen shown in
It is displayed in 1.

The communicator center menu registration process of FIG. 49 is started every predetermined time, and it is first determined whether or not communication is being performed with the communicator center 391 (S2800). If communication is not in progress, this routine is terminated as it is.
If it is in communication with the communicator center 391, next, the communicator center menu is read (S281).
0). The communicator center menu, which will be described in detail later, is included in the communication data with the communicator center 391 and transmitted. After reading, it is determined whether or not there is a change in the communicator center menu (S2820), and if there is no change, this routine is temporarily terminated as it is. If there is a change, communicator center menu registration is performed (S2830). The communicator center menu registration is performed in the communicator center menu area 29B in the EEPROM 29. As a result, the communicator center menu is appropriately modified. Public communication line 395
Are connected to a switching network (not shown).

FIG. 50 is a flowchart of the communicator center call processing routine, and FIG. 51 is an explanatory diagram of the communicator center 391. Communicator Center 3
91 is connected to a wireless telephone center 393, as shown in FIG. The wireless telephone center 393 is connected to the public communication line 395, is arranged in each predetermined wireless telephone service area, and performs two-way communication with a wireless telephone device such as the personal communicator 1. The communicator center 391 is connected to the ticket center 397, the bank computer center 399, the securities company 401, and the like.

The communicator center calling process of FIG. 50 is a process started when the “11 communicator center calling / online” display 341 of FIG. 47 is selected in S2610 of FIG. First, the usage items are displayed (S2900). After this display, a determination is made (S2910), and an itemized menu of the selected usage item name is displayed (S2920).

After the itemized menu is displayed, a judgment is made (S2930) and the individual processed image of the selected selected name is displayed (S2940). The individually processed image requests input or selection of predetermined data. When the input to this individual processing image is completed, next individual processing is executed (S2).
950). In execution of individual processing, first, the communicator center 391 is connected. Next, the data input by the individual processing image is transmitted to the communicator center 391, and ticket reservation processing is executed according to a predetermined procedure.

The communicator center 39 described above
By cooperating with Personal Communicator 1, 1 can efficiently reserve tickets and various information services,
And it can definitely be done. Further, by having the application processing function, the personal communicator 1 is provided with an almost unlimited use range.

FIG. 52 is a flowchart of the setting processing routine, and FIG. 53 is an explanatory view of the setting target selection screen. When the setting menu display 141 is selected in S420 of FIG. 11, the setting process of FIG. 52 is then executed. First,
A setting target selection screen is displayed (S3000). As shown in FIG. 53, the setting target selection screen includes a setting target selection display 411, a setting target list 413, and a cancellation display 417. A setting target name display 415 is displayed in the setting target list 413.

After the setting target selection screen is displayed, a judgment is next made (S3010). If it is determined that the cancel display 417 is selected, this routine is temporarily terminated as it is. On the other hand, if any one of the setting target list 413 is selected, the following setting process is executed. When the FAX transmission display 421 is selected, FAX transmission setting processing is executed (S3020). When the FAX reception display 423 is selected, the FAX reception setting process (S3030), the data transmission display 425 is selected, the data transmission setting process (S3040), and the data reception display 427 is selected. The data reception setting process (S3045), the telephone transmission setting process (S3050) when the telephone transmission display 429 is selected, and the telephone reception setting process (S3060) when the telephone reception display 431 is selected. To be executed.

In each of the setting processes of S3020 to S3060, setting of predetermined contents is performed according to a predetermined procedure. By the communicator control described above, input / output and setting of user data are performed. 54 shows the FAX
Flowchart of transmission time monitor processing routine, FIG.
6 is a flowchart of a data transmission time monitor processing routine. This is activated by the CPU 23 at predetermined time intervals. When the FAX transmission time monitor process of FIG. 54 is activated, it is first determined whether there is a transmission wait (S310).
0). The fax data memory 27A is waiting for transmission.
It is determined whether or not X data is stored. here,
If it is determined that the transmission is not waiting, this routine is temporarily terminated. On the other hand, if there is a transmission wait, it is next determined whether it is the transmission time (S3110). The transmission time is determined by comparing the transmission time set in the transmission time memory 27D with the current time.

Here, if it is not the transmission time, this routine is temporarily terminated as it is. If it is transmission time, then FA
X transmission is performed (S3120). Reservation transmission of FAX is performed by the FAX transmission time monitor processing described above. When the data transmission time monitor of FIG. 55 is activated, it is first determined whether there is a transmission wait (S3200). The waiting for transmission is determined by whether or not data is stored in the transmission data memory 27M. If it is determined that the transmission is not on standby, this routine is temporarily terminated as it is. On the other hand, if there is a transmission waiting, it is next determined whether it is the transmission time (S3210). The transmission time is the data transmission time memory 2
This is performed by comparing the transmission time set to 7L with the current time.

Here, if it is not the transmission time, this routine is temporarily terminated as it is. If it is the transmission time, then data transmission is performed (S3220). By the data transmission time monitor process described above, reserved transmission of data is performed. The personal communicator 1 described above can perform telephone calls, FAX communications, data communications, various application processes, and the like without performing keyboard operations, and can carry all of these as a set.

In addition, for the interactive processing, an anthropomorphic response that the input can be made only by gesturing and gesturing is performed. As a result, there is an extremely excellent effect that an information exchange device having high convenience and excellent usability can be obtained. It should be noted that the present invention is not limited to the above-described embodiments, and various embodiments can be implemented without changing the gist of the present invention.

[0114]

Since the computer data output apparatus of the present invention outputs a signal indicating image information similar to the detected image, a predetermined signal can be output depending on the state of the detection target of the image. As a result, for example, by storing the image features and patterns of the state of the hand and the state of the face in the image database, it is possible to issue a command to the computer by the signal of the hand and the signal of the face.

As a result, there is an extremely excellent effect that high convenience is obtained.

[Brief description of drawings]

FIG. 1 is a perspective view of a personal communicator 1.

FIG. 2 is a perspective view of a personal communicator 1.

FIG. 3 is a block diagram of a personal communicator 1.

FIG. 4 is an explanatory diagram of a usage state of the personal communicator 1.

FIG. 5 is an explanatory diagram of a space eye 2.

FIG. 6 is an explanatory diagram of a display state of the display 15.

FIG. 7 is an explanatory diagram of display control.

FIG. 8 is a flowchart of a display control processing routine.

FIG. 9 is a flowchart of a monitor control processing routine.

FIG. 10 is a usage state diagram of the personal communicator 1 in a standby state and a charging state.

FIG. 11 is a flowchart of a communicator control processing routine.

FIG. 12 is an explanatory diagram of a current status report screen.

FIG. 13 is an explanatory diagram of a space eye start mark and a space eye stop mark.

FIG. 14 is an explanatory diagram of a space eye code mark.

FIG. 15 is an explanatory diagram of a space eye code mark.

FIG. 16 is an explanatory diagram of a space eye selection execution mark.

FIG. 17 is a flowchart of a space eye setting processing routine.

FIG. 18 is an explanatory diagram of a space eye setting menu.

FIG. 19 is a flowchart of a feature extraction processing routine of sampling data.

FIG. 20 is a flowchart of a space eye code addition processing routine.

FIG. 21 is a flowchart of a space eye startup processing routine.

FIG. 22 is a flowchart of a space eye stop processing routine.

FIG. 23 is a flowchart of a space monitor processing routine.

FIG. 24 is a flowchart of a space eye control processing routine.

FIG. 25 is a flowchart of a space eye code determination processing routine.

FIG. 26 is a flowchart of a space eye code confirmation processing routine.

FIG. 27 is an explanatory diagram of an operating state.

FIG. 28 is a flowchart of a FAX processing routine.

FIG. 29 is an explanatory diagram of a document input screen.

FIG. 30 is a flowchart of a FAX menu processing routine.

FIG. 31 is an explanatory diagram of a FAX menu screen.

FIG. 32 is a flowchart of a FAX transmission processing routine.

FIG. 33 is an explanatory diagram of a FAX transmission screen.

FIG. 34 is a flowchart of a reception FAX display processing routine.

FIG. 35 is an explanatory diagram of a reception FAX list screen.

FIG. 36 is a flowchart of a deletion processing routine.

FIG. 37 is a flowchart of a telephone processing routine.

FIG. 38 is an explanatory diagram of a telephone menu screen.

FIG. 39 is an explanatory diagram of a message selection screen.

FIG. 40 is a flowchart of a setting processing routine.

FIG. 41 is a flowchart of an answering machine display processing routine.

FIG. 42 is a flowchart of a data processing routine.

FIG. 43 is an explanatory diagram of a data input screen.

FIG. 44 is a flowchart of a transmission condition setting processing routine.

FIG. 45 is a flowchart of a data transmission processing routine.

FIG. 46 is a flowchart of an application processing routine.

FIG. 47 is an explanatory diagram of an application selection screen.

FIG. 48 is a flowchart of an application menu registration processing routine.

FIG. 49 is a flowchart of a communicator center menu registration processing routine.

FIG. 50 is a flowchart of a communicator center call processing routine.

FIG. 51 is an explanatory diagram of a communicator center 391.

FIG. 52 is a flowchart of a setting processing routine.

FIG. 53 is an explanatory diagram of a setting target selection screen.

FIG. 54 is a flowchart of a FAX transmission time monitor processing routine.

FIG. 55 is a flowchart of a data transmission time monitor processing routine.

[Explanation of symbols]

 1 ... Personal communicator 2 ... Space eye 3 ... Pen input device 5 ... Main body 7 ... Wireless telephone device

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁵ Identification code Office reference number FI technical display location H04N 1/00 107 A 7046-5C

Claims (1)

[Claims] 1. An apparatus for outputting information and outputting a predetermined signal to a computer for inputting a response signal of the information, comprising: an image database for storing a plurality of image information of previously created images; Image detecting means for detecting, image searching means for searching the image database for image information similar to the detected image, and search signal outputting means for outputting a signal corresponding to the similar image information to the computer And a data output device for a computer.