JP2000122773A - Terminal equipment - Google Patents

Abstract

PROBLEM TO BE SOLVED: To more improve the operability of terminal equipment. SOLUTION: When an image is inputted from a touch panel 108, the data of the inputted image are stored in a temporary memory 104. When an image is inputted from a CCD camera 100 after displaying the image on a display device 106 based on the image data read out from the memory 104, the already displayed image and the image from the camera 100 are composed and a composed image is displayed on the display device 106.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a terminal device capable of inputting digital images.

[0002]

2. Description of the Related Art Hitherto, a portable terminal having a CCD camera (charge-coupled device) has been known. Such a portable terminal is provided with a display panel in which a display and a touch panel are combined with a CCD camera. Was able to display a digital input image, and could write a memo using a touch panel. In addition, a memo could be added from the touch panel to the digital image from the CCD camera displayed on the display panel.

[0003]

However, even if the object to be photographed and the comment to be added are determined in advance, the comment using the touch panel must be entered unless the image taken by the CCD camera is input to this portable terminal. If the image cannot be restored even if the comment cannot be added and the added comment is erroneously corrected, the image must be retaken with a CCD camera, which is very inconvenient.

[0004] It is an object of the present invention to provide a portable terminal which can solve the above-mentioned problems and can improve usability.

[0005]

According to a first aspect of the present invention, there is provided a terminal device having a touch panel and a CCD camera, wherein the storage device stores data of an image input from the touch panel. And display control means for displaying an image based on the read data, and when the image is input from the CCD camera after the image is displayed by the display control means, the display is performed. And a composite image display control means for displaying a composite image composed by the composite means.

[0006] The terminal device according to the first aspect of the present invention can further include positioning means for positioning the image from the CCD camera with respect to the image displayed by the display control means.

According to a first aspect of the present invention, there is provided a terminal device for storing a combined image stored by the combining unit, and for instructing the combined image storage unit to add a new combined image. May be further provided, and control means for adding the new composite image to the composite image storing means when the addition instruction means instructs addition of a new composite image.

The control means can display an error without adding a new composite image when there is no free space in the composite image storage means.

According to a first aspect of the present invention, there is provided a terminal device for storing a combined image stored by the combining unit, and for instructing the combined image storage unit to change a new combined image. And a control means for changing the image of the composite image storing means with the new composite image when the change instruction means instructs a change with a new composite image.

According to a sixth aspect of the present invention, in the terminal device having a touch panel, storing means for storing image data input from the touch panel,
Display control means for reading the image data from the storage means and displaying the image based on the read data; and displaying the image when the image is externally input after the image is displayed by the display control means. A combining unit that combines the input image and the image input from the outside, and a combined image display control unit that displays the combined image combined by the combining unit.

[0011] The terminal device of the invention according to claim 6 may further include positioning means for positioning an image input from the outside with respect to the image displayed by the display control means.

According to a sixth aspect of the present invention, there is provided a terminal device for storing a combined image stored by the combining unit, and for instructing the combined image storage unit to add a new combined image. May be further provided, and control means for adding the new composite image to the composite image storing means when the addition instruction means instructs addition of a new composite image.

The control means can display an error without adding a new composite image when there is no free space in the composite image storing means.

According to a sixth aspect of the present invention, there is provided a terminal device for storing a combined image stored by the combining unit, and for instructing the combined image storage unit to change a new combined image. And a control means for changing the image of the composite image storing means with the new composite image when the change instruction means instructs a change with a new composite image.

[0015]

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 shows an embodiment of the present invention. This is an example of the mobile terminal 10, and a front view of the appearance is shown in FIG. 2 and a rear view is shown in FIG.

Referring to FIG. The main body 200 has a CCD
(Charge coupled device) Camera 100 and antenna 1
26 is attached. The CCD camera 100 is shown in FIG.
Are rotatable at the portions indicated by, so that images from various angles can be input by the CCD camera 100 even when the main body 200 is fixed. CCD camera 1
The image photographed by 00 is output after being divided into RGB components. In FIG. 2, the main body 200 is provided with a color display 106 on the left side and an operation key arrangement section on the right side.

The color display 106 has a data display section 201.
And a viewer 401, and includes circuits necessary for display such as a liquid crystal drive circuit. Data display unit 201
2 is the left side of the dotted line shown in FIG. 2 of the display unit 106, on which the touch panel 108 (FIG. 1) is superimposed, and in addition to displaying data, can be set when the setting key 211 is pressed. The function is displayed, and the user can select a function to be executed from the displayed functions, and can perform an operation corresponding to the function. The following six functions can be set: (1) computer telephone number setting, (2) communication means setting (the same function as communication means key 209 shown in FIG. 2), (3) data transmission,
(4) data reception, (5) code conversion, and (6) conversion result registration. The touch panel 108 has many electrodes, and it is determined whether or not the input pen 128 has touched the panel based on the output from these electrodes, and it is assumed that some data has been input at the touched location.

The viewer 401 is the display shown in FIG.
Is used as a finder of the CCD camera 100, and is used as a display section of image data read by the scanner 129. Display 106
Which of the input data from the CCD camera 100, the input data from the scanner 129, and the input data from the touch on the touch panel 108 is displayed depends on the state of the operation of the mobile terminal 10.

Reference numeral 135 denotes a speaker which outputs sound data input by the communication means. 218
Is a slide type volume key. The volume of the speaker 135 decreases as the user slides to the left in FIG. 2, and the volume decreases to the minimum at the leftmost end and disappears at zero volume. Reference numeral 134 denotes a microphone for inputting sound such as voice. Reference numeral 219 denotes a slide type volume key. The more the slide is made to the left in FIG. 2, the smaller the gain of the microphone 134 becomes, and at the leftmost end, the gain of the microphone 134 becomes zero and no sound is input.

Next, the operation key arrangement section will be described. 220
Is an input switch for selecting which of the CCD camera 100, the input pen 128 and the touch panel 108, and the scanner 129, which are the input means of the portable terminal 10, the input means. . When the input changeover switch 220 is switched to the “F” position, the input is switched to the input from the CCD camera 100. When the input changeover switch 220 is switched to the “P” position, the input pen 128 is input from the touch panel 108 to the input. Can be switched
When the position is switched to the “S” position, the scanner 12
9 is switched to the input. A stop key 221 is used to interrupt a process being executed.

Reference numeral 203 denotes a moving image key for switching to a moving image mode in which data input from the CCD camera 100 is handled as a moving image. Reference numeral 202 denotes a still image key for switching to a still image mode in which data input from the CCD camera 100 is handled as a still image. When the still image key 202 is pressed and the still image mode is designated, an image is input from the CCD camera 100, and the input image is displayed on the viewer 401. 20
Reference numeral 9 denotes a communication means key for changing the communication means. When the key is pressed once, the currently set communication means is displayed on the display unit 201 of the display unit 106. When the key is pressed twice, the display is changed to the next communication means. And the communication means is changed by pressing a key. If the communication means key 209 is not pressed for a certain period of time, the displayed communication means is set, and the display of the communication means disappears. The switching order of the communication means is facsimile communication by wireless communication, computer communication by wireless, facsimile communication by wire, and computer communication by wire,
Optical communication is performed in this order. The default is wireless facsimile communication.

Reference numeral 207 denotes a key for displaying a counter. When this key 207 is depressed, image data (still image) inputted from the CCD camera 100 and recorded.
Is displayed on the display unit 106. Reference numeral 208 denotes a key for displaying a counter. When the key 208 is pressed, the total of the data stored by the image data input by operating the touch panel 108 and the image data read from the scanner 129 is calculated. Is displayed on a part of the display 106.

Reference numeral 223 denotes a reproduction display key for waiting for input of an input image from the CCD camera 100 to be reproduced and displayed next.

Reference numeral 210 denotes a designation key for designating either to combine previously recorded image data with newly input image data, or to combine and record as new data. Key. If the designation key 210 is switched to "none", no composition is performed. If the designation key 210 is switched to "update", the previously recorded and designated image is composed with the newly input image. ,
Replace the obtained combined image data with the previously recorded data, and if it is switched to "New", combine the previously recorded and specified image with the newly input image,
It is recorded as new data. 21
Reference numeral 6 denotes a shutter button, which is active at the time of photographing a still image. A still image is photographed by pressing the shutter button 216, and is inactive at the time of moving image photographing.

An LED (light emit) 205 indicates that communication is in progress.
ting diode) to indicate that it is communicating with another computer or the like. Reference numeral 206 denotes a recording switch with an LED. When the recording switch 206 is pressed, a recording mode is set, the LED is lit to indicate that recording is in progress, and when the recording switch 206 is pressed again, the recording mode is set. It is released and the LED goes out. When the shooting mode is the still image mode and the shutter button 216 is pressed during the recording mode, the still image input from the CCD camera 100 is stored in the field memory 102 of the mobile terminal 10. When the shooting mode is the moving image mode, the shutter button 216 is pressed,
When the recording switch 206 is turned on, data input from the CCD camera 100 starts to be recorded in the memory of another computer, and the LED of the recording switch 206 is turned on. A setting key 211 is for performing various settings. After the setting key 211 is pressed, the set data item is selected and set using the numeric keys 204.

Reference numeral 204 denotes a dial key, which is used for dialing during communication, and is used, for example, for inputting and setting a preset dial number of a moving image data recording destination computer. Reference numeral 222 denotes an outgoing / incoming key, which functions as an incoming key to activate the telephone function when pressed when there is an incoming call, and functions as an outgoing key when pressed other than when receiving an incoming call; Dial key 20
4 enables dial-up.

Next, FIG. 3 will be described. In FIG. 3, 1
Reference numerals 00, 126, and 200 denote the same parts as in FIG. 230
Is a modular jack for connecting a wired line. Reference numeral 231 denotes an LED light transmitting / receiving unit, which performs optical communication, for example, IrDA (infrared data association).
Used when communicating with. Reference numeral 232 denotes a connector for connecting the main body 200 to the scanner 129, and the scanner 129 is connected through the connector 232.
"0" and "1" for the black and white information of the image read from
Is sent as bit information.

Next, FIG. 1 will be described. In FIG. 1, 1
Reference numerals 00, 106, 126, 134, and 135 indicate the same parts as those in FIG. Reference numeral 101 denotes an A / D (anlog-to-digital) converter, which performs A / D conversion on RGB component data output from the CCD camera 100.

An input pen 128 is for inputting data to the touch panel 108 and has a pencil-like shape. Reference numeral 107 denotes a position detection unit which detects the position on the panel of data input from the touch panel 108 using the input pen 128, and places a predetermined width (thickness) of the input pen 128 at that position. ) Is taken into account in developing the image data. Reference numeral 129 denotes a black-and-white scanner, which is a normal scanner that optically reads and outputs information written on paper or the like. The scanner 129 includes circuits required for reading.

Reference numeral 104 denotes a temporary storage memory for displaying image data input from the touch panel 108 and expanded by the position detection unit 107 and image data read by the scanner 129 on the viewer 401 of the display unit 106. , For temporary storage in the form of a dot matrix. 131 is a data conversion unit,
The data stored in the temporary storage memory 104 is
To match the format after conversion by the / D conversion unit,
The data is converted and the color is specified in advance by some method.

Reference numeral 123 denotes a wireless communication unit,
26 has a circuit necessary for processing the radio wave received by it, and performs a protocol process required before a call is established by a wireless line. In this mobile terminal 10, PHS (pers
onal hadyphone system), which uses a modem to perform data communication by deemed voice when performing computer communication. Since a data communication technique using deemed voice using PHS is known, its description is omitted. Reference numeral 124 denotes a wired communication unit which has a circuit necessary for wired communication and performs a protocol process required before a call is established via a wired line. In the present embodiment, a well-known ISDN (integrated service digital n
etwork) line.

Reference numeral 122 denotes a switch.
According to the instruction of the wireless communication unit 123 or the wired communication unit 1
24 to select one of them. A facsimile (FAX) communication control unit 117 performs connection control and protocol processing (G3) of well-known facsimile communication. Reference numeral 118 denotes a computer communication control unit which controls communication with a communication partner computer and performs protocol processing.

Reference numeral 125 denotes an optical communication unit which performs local communication with a partner computer, and performs processing other than protocol processing. As optical communication, Ir
Although DA was adopted, this technique is well known and its description is omitted. An optical communication controller 119 performs IrDA protocol processing with a known communication partner computer.

A switch 120 selects one of the facsimile communication control unit 117, the computer communication control unit / protocol unit 118, and the optical communication control / protocol unit 119 in accordance with an instruction from the CPU 109.

Reference numeral 130 denotes a switch, which is a CCD camera 1
In accordance with an instruction from the CPU 109, either data input from 00 or data stored in the temporary storage memory 104 is switched. Reference numeral 102 denotes a field memory for storing data of one screen to be displayed on the viewer 401 of the display 106, which is switched by the switch 130. Reference numeral 132 denotes a switch which stores data input from the CCD camera 100 in accordance with an instruction from the CPU 109 and the temporary storage memory 10.
4 to select whether to combine the data stored in No. 4 or not. Switch 13
According to the instruction from the CPU 109, the data displayed on the viewer 401 of the display 106 is converted into the input data from the CCD camera 100, the data stored in the temporary storage memory 104, or , These two data are switched.

Reference numeral 103 denotes a timing control unit,
In response to an instruction to input data from the U109 to the field memory 102 or an instruction to output data from the field memory 102, the input / output timing of data in the field memory 102 is controlled. If the data input to the field memory 102 is data from the CCD camera 100, the digital camera waits for input of data of one captured image, and then performs D / A (digital-to-analog).
When the data is sent to the display 106 via the conversion unit 105 and is input from the touch panel 108 or the scanner 129, data input at an arbitrary fixed time interval is sent to the display 106 via the D / A conversion unit 105. Sent at any time. 10
Reference numeral 5 denotes a D / A converter, which performs D / A conversion on the data sent from the field memory 102 and converts the data into an RGB format.

Reference numeral 109 denotes a CPU,
Of each part is controlled. 114 is a ROM (read o
nly memory), and the CPU 109
A control program for controlling is stored. 1
Reference numeral 15 denotes a random access memory (RAM),
U109 is for storing variable data necessary for controlling the mobile terminal 10 and for storing information instructed in advance by the user, for example, display colors of input data from the touch panel 108, and the like. .

Reference numeral 110 denotes an encoding processing unit, which is data from the CCD camera 100,
Compresses the data stored in the image storage memory 11
1 and reads and expands image data from the image storage memory 111 in accordance with an instruction from the CPU 109. Reference numeral 111 denotes an image storage memory,
10 for storing data compressed. Reference numeral 104 denotes a temporary storage memory, and the encoding processing unit 11
This is for storing data decompressed by 0.

Reference numeral 112 denotes an encoding processing unit which compresses data input from the touch panel 108 or the scanner 129 and stored in the field memory 102, and in accordance with an instruction from the CPU 109.
3, and expands the image data. 11
Reference numeral 3 denotes an image storage memory for storing data compressed by the encoding processing unit 112. 10
Reference numeral 4 denotes a temporary storage memory for storing data decompressed by the encoding processing unit 112.

Reference numeral 133 denotes a pattern recognition processing unit.
In the image data input from the CD camera 100, a character code is detected from a portion designated by the operator.

Reference numeral 137 denotes a sound encoding unit that converts analog data input from the microphone 134 into digital data, converts the digitized data into analog data, and outputs a sound to a speaker based on the obtained analog data. 135.

Reference numeral 138 denotes a PC card i / f unit for incorporating various PCi / f cards to extend functions.

Reference numeral 139 denotes a field memory for developing and displaying image data from the touch panel 108 and the scanner 129 when synthesizing image data. A battery 127 supplies power to each unit of the apparatus.

FIG. 4 shows the configuration of the scanner 129 of FIG. In FIG. 4, reference numeral 240 denotes a connector on the scanner 129 side, which can be connected to the connector 232 of the main body 200 shown in FIG.
1 is connected to the scanner body 242. 24
Reference numeral 3 denotes an on / off switch for starting a reading operation when the switch is on and stopping the reading operation when the switch is off. Only when the on / off switch 243 is turned on, the read image data is transferred to the main body 200 via the cable 241 and the connector 240.
Sent to Reference numeral 244 denotes a light source for illuminating the original, which is turned on when the on / off switch 243 is turned on. A reading sensor 245 optically reads a document when the on / off switch 243 is turned on, converts the read data into “0” and “1” data, and sends the data to the temporary storage memory 104. .

Next, an example of use of the portable terminal 10 will be described with reference to FIG. In FIG. 5, reference numeral 10 denotes the same part as in FIG. Reference numeral 300 denotes a switching network, which may be a public network or a private network. A base station 301 connects the terminal 10 and the switching network 300 via a wireless line. 3
A computer 03 is a communication partner of the mobile terminal 10. 10 'has the same configuration as that of the portable terminal 10, and FIG.
3 shows an example of communicating with optical communication No. 3 by optical communication.

In using the mobile terminal 10, a communication address such as a telephone number of the computer 303 for storing moving image data is set in advance. The reason why the communication address is set in advance is that when the moving image data is stored by the portable terminal 10, the RAM 113 immediately fills up. Is stored in the memory of the external computer 303 provided with

(Function 1) Next, Function 1 will be described. Function 1 is a function of capturing and recording a moving image with the CCD camera 100. The moving image data is stored in a storage medium such as a communication partner computer by communication. At this time, the communication between the other computer and the mobile terminal 10 is ready, the storage on the computer side is ready, and the storage is started. I do. Also,
When the computer that stores the data runs out of storage capacity of the storage device during the storage process, the computer notifies the fact to that effect, notifies the operator on the portable terminal 10 side, and then automatically Disconnect the communication line.

FIGS. 6 and 7 show control programs stored in the ROM 114 of FIG.
11 is a flowchart illustrating an example of a program that sends data of a video shot at 0 to a computer 303 by communication and records the data in a storage device of the computer 303. When the power switch 217 is turned on, power is supplied from the battery 127 to each processing unit of the mobile terminal 10 (F510).
0), the process is started. First, each processing unit shown in FIG. 1 is diagnosed (F5101), and it is determined whether or not each processing unit has a failure (F5102). If it is determined that there is a failure, an error is displayed on the display unit 201 of the display unit 106, a predetermined sound is generated from the speaker 135, and the user is notified that the usable functions are limited. (F5103). On the other hand, if it is determined that there is no failure or that the functions can be used with limited functions, the keypad 116
(F5104). Even in this state, an incoming call can be received from the communication line, but this incoming call function is omitted in the present embodiment because it has no direct relation.

When the user presses the moving image key 203 to designate a moving image input, the video input mode is set to the moving image mode (F5105), and thereafter, the key input state is set again (F5104). ). Then, in order to specify the communication method, the user selects the communication means key 209
Is operated to select one of the communication means included in the mobile terminal 10, it is determined whether or not the communication is computer communication (F5106). Each time the user operates the communication means key 209, the communication means provided in the portable terminal 10 is in the order of wireless facsimile communication-> wireless computer communication-> wired facsimile communication-> wired computer communication-> optical communication. Switching, within a predetermined time, for example,
If there is no operation of the communication means key 209 within one second, the selection of the communication means is determined.

As a result of determining whether or not the communication is computer communication,
If the communication is not computer communication, a process of FAX or optical communication is performed (F5107). If the communication is computer communication, it is determined whether the communication is wired communication or wireless communication (F5108). If it is determined that the communication is wired communication, it is checked whether or not a wired line is connected (F510).
9) It is determined whether a line error has occurred (F51).
10). If it is not connected, or if a line failure occurs even though it is connected, it is determined that a line error has occurred, and the user is notified of the line error (F5111).

If there is no line error, it is confirmed whether or not the communication address (telephone number) of the computer 303 to which the moving image data is to be sent is set (F51).
12). If the communication line is determined to be a wireless line, the line is not checked, and it is confirmed whether or not the communication address (telephone number) of the computer 303 to which the moving image data is to be sent is set ( F5112). If it is determined that the communication address has already been registered,
The registered address is read from the RAM 115 and transmitted (F5115). On the other hand, if it is determined that the communication address of the computer 303 has not been set, the user is prompted to register (F5113). When the communication address is registered (F5114), the registered communication address is stored in the RAM 115, and transmitted to the computer 303 with the registered communication address (F5115).

Then, it is determined whether or not the stop key 221 has been pressed (F5116). If it has been determined that the stop key 221 has been pressed, the transmission is stopped (F5117). It is determined whether or not it has been performed (F5118). If it is determined that the computer 303 has not responded, the process returns to step F5116. If it is determined that the computer 303 has responded, it is already in a communication state. In order to negotiate whether or not to perform, the mobile terminal 10 notifies the computer 303 that the moving image communication will be performed (F5119), and waits for a response from the computer 303 to the notification (F5120). In this state, the portable terminal 10 and the computer 303 are in a wireless communication state, and the computer 303 is
It is waiting for data reception from 0.

In this state, it is monitored whether or not the shutter key 216 has been pressed (F5121). Here, the user may adjust the direction of the CCD camera 100. Since this adjustment is performed by moving a mechanical structure, the CP
U109 has nothing to do with it. The mobile terminal 1 by the user
When the 0 shutter key 216 is pressed, it is determined whether or not the combining switch 210 has been switched to “none”. If it is determined that the switch has not been switched to “None”, an error message is displayed and the user selects the combining switch 2.
Wait until 10 is set to "none" (F512
2). This is because C in communication of moving images in the present embodiment.
This is because communication between an image input from the CD camera 100 and an image obtained by synthesizing another image is prohibited. When a process for synthesizing is added, the synthesizing may be allowed.

Then, the combining switch 210 is selected by the user.
Is set to "none" and the recording switch 206 is turned on, an image is input from the CCD camera 100 (F5).
124). The image data input from the CCD camera 100 is converted into a digital signal by the A / D converter 101 and is temporarily stored in the field memory 102. And
A / D conversion of the image data for one screen is performed, and it is confirmed whether or not the image data is stored in the field memory 102. When reading of one screen is completed (F5125), the data is converted to D
The data is converted into analog data by the / A converter 105 and displayed on the viewer 401 of the display unit 106 (F5126). While image data is being read from the field memory 102 for display on the viewer 401 of the display 106,
The timing control circuit 1 reads data from the D camera 100 and does not write the data to the field memory 102.
03 is timed and notified to the CPU 109. The CPU 109 completes the writing of the data from the timing control circuit 103 to the field memory 102,
Upon receiving the read completion signal from the field memory 102, the control of writing data from the CCD camera 100 to the field memory 102, reading the data from the field memory 102, and outputting the data to the display 106 is repeated.

When data for one screen is written, then read and output, the CPU 109 checks whether the recording switch 206 is on or off (F5127). When the recording switch 206 is turned on (recording), "recording" is displayed on the display unit 201 of the display unit 106, and the LED of the recording switch 206 is turned on to indicate that recording is in progress (F5128). And the switch 12
0, the data for one screen displayed on the viewer 401 of the display unit 106 is read out from the field memory 102, and the computer communication control / protocol unit 11 is read out.
8, and the obtained packet is transmitted to the communication partner computer 303 by the wireless communication unit 123 (F5129).

When the transmission of the packet is completed, it is checked whether or not an error message such as a disk (memory) full message has been received from the computer 303 (F51).
30). As a result of checking, if an error message has not been received, the state of the recording switch 206 is checked again by the CPU 109 (F5132). If the recording switch 206 is not off and recording is on, the next one screen data is displayed. An input is made (F5124). Thereafter, until the recording switch 206 is turned off by the user, step F
Steps 5124 to F5132 are repeated. On the other hand,
If an error message is received from the computer 303 in step F5130, the error message is displayed on the display unit 201 of the display unit 106 (F5131).
The display of “Recording” is stopped, and
The ED is turned off (F5133), and then the communication line is disconnected (F5134).

On the other hand, steps F5127 and F513
If the recording switch 206 is turned off at 2, the flow shifts to step F5133.

Then, the CPU 109 checks whether or not the shutter button 216 is turned off (F5
135) If it is confirmed that the button is not turned off, the flow shifts to step F5124. If it is confirmed that the button is turned off, image input and display are stopped. Then, the process waits until the power switch 217 is turned off by the user (F5136). If the CPU 109 confirms that the power switch 217 is turned off, the power is turned off, and the process is terminated.

Next, with reference to FIG. 8, a moving image communication procedure after a call is established between the portable terminal 10 and the computer 303 will be described. After the call is made, the computer 303
Waits for a message from the mobile terminal 10 to perform video communication. When the computer 303 receives a notification from the mobile terminal 10 that video communication is to be performed,
Check whether there is a data storage memory. The portable terminal 10 is notified that there is no memory, and then the line is disconnected. On the other hand, if there is a memory, the portable terminal 10 responds.

When the portable terminal 10 receives the response from the computer 303, it transfers the moving image data to the computer 303.
In the form of a packet. Here, when the recording is stopped by the user, a moving image communication end notification is transmitted from the mobile terminal 10 to the computer 303, and the computer 303 that has received the moving image communication end notification returns a response to the mobile terminal 10.

Next, referring to FIG. 9, the moving image communication procedure after a call is established between portable terminal 10 and computer 303, and the memory for receiving data storage of computer 303 becomes full in the middle. The communication procedure in the case of the above will be described.
If a message indicating that the disk (memory) is full is sent from the computer 303 to the mobile terminal 10 while the data is being received, the mobile terminal 10 that has received this message returns a response to the computer 303, , End the communication.

In order to perform communication between the portable terminal 10 and the computer 303, the computer 303 also needs communication means and software for executing a protocol for communicating with the portable terminal 10. Is not different from the configuration of software used in personal computer communication or the like, and only the protocol is different, so that the description is omitted.

(Function 2) Next, function 2 will be described. Function 2 is a function for capturing and recording a still image with the CCD camera 100. The still image data is stored in the image storage memory 111 in the mobile terminal 10.

FIGS. 10 and 11 show the ROM 114 of FIG.
4 is a flowchart showing an example of a control program stored in the portable terminal 10 in the image storage memory 111 in the mobile terminal 10. Power switch 217
Is turned on, power is supplied from the battery 127 to each processing unit of the portable terminal 10 (F5200), and the processing is started. First, each processing unit shown in FIG. 1 is diagnosed (F520
1) It is determined whether or not each processing unit has a failure (F52).
02). If it is determined that there is a failure, an error is displayed on the display unit 201 of the display unit 106, a predetermined sound is generated from the speaker 135, and the user is notified that the usable functions are limited. (F520
3). On the other hand, if it is determined that there is no failure or that the function can be used with its functions restricted, the process waits until a key is input from the keypad 116 (F5204).

Then, the user selects the input switch key 220
Is switched to “f”, in response to this switching, the CPU 109 sets the input destination of the image data to the CCD camera 100 and the touch panel 108 or the scanner 129.
Is not read (F5225), the CCD
The image data from the camera 100 is input and displayed on the viewer 401 of the display 106 in the same manner as in the case of the moving image input of the present embodiment. Thereafter, the process returns to step F5204.

It is determined that there is no failure (S520
2) If the user subsequently presses a key that is not related to the input of a still image on the CCD camera 100, processing corresponding to the pressed key is performed (F5207).

Further, it is determined that there is no failure (S520
2) Later, when the still image key 202 is pressed by the user, the CPU 1 responds to the pressing of the still image key 202.
In step 09, the video input mode is set to the still image mode (F5205), and thereafter, the process stands by until a key input is made (F5206). During this key input standby, the user can, if necessary, display the CC displayed on the viewer 401 of the display 106.
The direction of the CCD camera 100 may be adjusted while checking the image from the D camera 100. This CCD camera 1
Since the adjustment of the direction of 00 is performed mechanically, the control of the CPU 109 is not affected by the adjustment of the camera direction.

Thereafter, the recording switch 206 is set by the user.
Is pressed, the LED of the recording switch 206 is turned on to indicate that recording is in progress (F5208).
Is turned on, that is, whether the mode is the “synthesis existence” mode or the “none” mode (F52).
09). If the mode is confirmed to be "none", it is checked whether or not any data is stored in the field memory 102 (F5210). If any data is stored, it is indicated that there is data for synthesis even though no synthesis is specified. Is displayed on the display unit 20 of the display 106.
1 (F521l). On the other hand, if any data is not stored, the process stands by until any key is pressed (F5214).

On the other hand, if it is confirmed that the combining switch 210 is turned on, that is, if it is confirmed that the “compositing available” mode is set, it is determined whether or not the image data to be updated or newly combined is stored in the field memory 102. Is checked (F5212). As a result of the check, if there is no stored image data, an error message indicating that there is no combined data even though the combination is specified is displayed on the display unit 201 of the display unit 106 (F5213). If there is data, the process waits until any key is pressed (F5214).

Then, the user presses the shutter button 21
When a key other than 6 is pressed, the power switch 21
It is confirmed whether or not 7 has been turned off (F5223). If the power switch 217 is turned off, the power supply is stopped to complete the present process. On the other hand, if the power switch 217 is not turned off, other processes are performed (F5224).

On the other hand, the user presses the shutter button 216
Is pressed again, it is checked again whether the input changeover switch 220 has been switched to "F" (F52).
15) If the switch has not been switched, a message prompting the user to switch the input switch 220 to “F” is displayed on the display unit 201 of the display unit 106 (F5).
217) Then, it waits until any key is pressed (F5204).

On the other hand, if the result of the check indicates that the input switch 220 has been switched to
An image for one screen is input from the camera 100 and the display 10
6 is displayed on the viewer 401 (F5216). In this state, image data for one screen from the CCD camera 100 is stored in the field memory 102, and a still image is captured.

Thereafter, it is checked whether or not the combining switch 210 is on. If the combining switch 210 is on, that is, if it is an update, the combined image is replaced with the previous image data before combining (F5219). . Thereafter, the process stands by until any key is pressed (F5214).

On the other hand, as a result of checking whether or not the synthesizing switch 210 is on, if it is off, ie,
If it is not an update (new or no combination), it is checked whether the recording switch 206 is on and there is a free space in the image storage memory 111 (F5220). If the recording switch 206 is turned off or if there is no free space in the image storage memory 111, this is notified (F5222). On the other hand, if the recording switch 206 is turned on and there is a free space in the image storage memory 111, the input still image data is recorded as new image data (F5221), and thereafter, the process waits until any key is pressed. (F5214).

(Function 3) Next, function 3 will be described. Function 3 is a function of compressing a moving image captured by the CCD camera 100 and transmitting the compressed moving image to a communication partner in real time by communication. The receiving side can expand the received data and display it on the display.

FIGS. 12 to 14 show the ROM 114 of FIG.
Is a flowchart showing an example of a control program stored in the control program for compressing a moving image captured by the CCD camera 100 and transmitting the compressed image to a communication partner in real time by communication. The data received on the receiving side can be expanded and displayed on the display. Power switch 2
When 17 is turned on, power is supplied from the battery 127 to each processing unit of the terminal 10 (F5300), and processing is started. First, each processing unit shown in FIG. 1 is diagnosed (F530
1) It is determined whether or not each processing unit has a failure (F53).
02). If it is determined that there is a failure, an error is displayed on the display unit 201 of the display unit 106, a predetermined sound is generated from the speaker 135, and the user is notified that the usable functions are limited. (F530
3). On the other hand, if it is determined that there is no failure or that the function can be used with limited functions, the process waits until a key is input from the keypad 116 (F5304).

Then, the recording switch 206 is set by the user.
If is pressed, the CPU 109 causes the non-recording mode to be set (F5305), and the flow returns to step F5304.

When the user presses the moving image key 203, the CPU 109 sets the image input mode from the CCD camera 100 to the moving image mode (F533).
2) Return to step F5304.

Further, when a key other than the moving image key 203, the recording switch 206, and the communication means key 209 is input, the processing for the input key is performed (F530).
7).

Further, the communication means key 2 is set by the user.
If the button 09 is pressed, it is determined whether or not the communication means is computer communication (F5306). If it is determined that the communication is not computer communication, other processing is performed (F5).
307) If it is determined that the communication is computer communication,
It is determined whether the communication is wired or wireless (F
5306). If it is determined to be wired, it is checked whether or not a wired line is connected (F5309).
It is checked whether a line error has occurred (whether the line is not connected or a line failure has occurred even if it is connected) (F5310). If a line error has occurred, a line error notification is sent to the user (F5311).
If no line error has occurred, it is checked whether any key has been pressed (F5312). However, if the communication line is a wireless line, no line check is performed. Here, the direction of the CCD camera 100 can be adjusted, and the user sets the combining switch 210 to “none”.

If it is confirmed that the outgoing / incoming key 222 has been pressed, the user is prompted to input a dial number (F5313). Then, the user selects dial key 2
04 is operated and dialed, the portable terminal 10
Computer communication control unit 118 and wireless communication unit 12
3 causes the computer to transmit the input number. In this case, it is assumed that the message is transmitted to the computer 303.

After confirming that the call / reception key 222 has been pressed, if the user presses the call / reception key 222 or the stop key 221, the transmission is interrupted (F 53).
16) Then, the process returns to step F5315.

The signal representing the response is transmitted to the radio communication unit 12.
3 and the CPU 1 by the computer communication control unit 118.
09 is notified (F5315), the CPU 109 causes the computer 303 to notify the fact that video communication is to be performed using a predetermined protocol (F5317). In response to this notification, the wireless communication unit 123 and the computer communication control unit 1
When the response is received by F.18 (F5318), the microphone 134 and the speaker 135 are turned on so that the voice communication can be performed. To the user (F5320). After that, it waits for key input (F5
315) During that time, a state is established in which voice communication can be performed. In this state, the audio data input from the microphone 134 is
The sound is encoded and compressed by the sound encoding unit 137, and the computer communication control unit 118 allocates half of the transmission capacity of the communication line to the voice communication to form a frame and transmit the frame.
Since the audio data sent from the partner computer 303 is also formatted in the same format as the transmission frame, the computer communication control unit 118 disassembles the frame and sends it to the sound encoding unit 137 to decompress and expand the code. Then, the data is transmitted from the speaker 135.

The input of the dial key 204 was prompted (F5
315) After that, when the user presses the shutter button 216, it is checked whether or not the combining switch 210 is turned on (F5321). When it is confirmed that the combining switch 210 is turned on, that is, when “combining is performed” (update, new), an error message is displayed on the display unit 201 of the display unit 106 (F5322).
The reason why the error message is displayed is that in the case of a moving image, the composition with another image is not allowed.
On the other hand, if there is “none”, an image is read from the CCD camera 100 (F 5323), and the image data input from the CCD camera 100 is converted into a digital signal by the A / D converter 101, and is stored in the field memory 102 by the CPU 109. Store it temporarily.

When the image data for one screen is A / D converted and stored in the field memory 102, the data is converted into analog data by the D / A converter 105, and is converted to analog data by the viewer 401 of the display 106. It is displayed small (F5325). The reason why the image data is displayed small is to display the image data sent from the partner computer 303 on another part of the viewer 401.

In order to display the image on the viewer 401 of the display 106, the timing is controlled by the timing control circuit 103 so that the data is not read from the CCD camera 100 and written into the field memory 102 while the image data is read from the field memory 102. Let me take it, CPU
Notify 109.

The CPU 109 controls the timing control circuit 10
3, when a signal indicating completion of writing of data into the field memory 102 and a signal indicating completion of reading from the field memory 102 are received, data is input to the field memory 102 from the CCD camera 100, and data is displayed from the field memory 102 to the display 106. And the control to output to When data for one screen is input and output, the computer communication control unit 118 and the wireless communication unit 123 transmit the data to the partner computer 303 (F532).
6).

The moving image data written in the field memory 102 is encoded and compressed by the encoding processing unit 110 and then passed to the computer communication control unit 118 by the CPU 109 so that half of the transmission capacity of the communication line is reduced by the moving image data communication. , And make it framed and transmitted. The moving image data sent from the partner computer 303 is also
Since the format is the same as the format of the transmission frame, the frame is disassembled by the computer communication control unit 118, the code is decompressed and decompressed by the encoding processing unit 110, temporarily stored in the field memory 102, and output to the display 106. Let it.

Then, the CPU 109 checks the presence / absence and type of the key press (F5327). If it is confirmed that the key is not pressed, the process returns to the step F5323, and thereafter, the steps F5323 to F5327 are repeated. As a result of checking the presence / absence and type of the key press, if a key irrelevant to such processing is pressed, the process proceeds to step F532.
3 and thereafter, steps F5323 through F5327
repeat. As a result of checking the presence / absence and type of the key press, if the shutter button 216 is pressed, image input from the CCD camera 100 is stopped, and display and transmission on the display 106 are stopped (F5328). Thereafter, the process stands by until any key is input (F5329).

When the outgoing / incoming key 222 is pressed, the microphone 134 and the speaker 135 are turned off.
The CPU 109 controls the computer communication control unit 118 and the wireless line circuit 123 to transmit a communication end message in a data frame and disconnect the wireless line (F5330). Thereafter, the process returns to step F5329.

After transmission is stopped, if a key other than the transmission / reception key 222 is pressed, a process corresponding to the pressed key is performed (F5331).

If the power switch 217 is pressed after the transmission is stopped, the power is turned off and the process is terminated.

FIG. 15 is a flowchart showing an example of a control program stored in the ROM 114 of FIG. When the power switch 217 is turned on, power is supplied from the battery 127 to each processing unit of the terminal 10 (F5340), and processing is started. First, each processing unit shown in FIG. 1 is diagnosed (F5341), and it is determined whether or not each processing unit has a failure (F5342). When it is determined that there is a failure, an error is displayed on the display unit 201 of the display unit 106, a predetermined sound is generated from the speaker 135, and the like.
The user is notified that the functions that can be used are limited (F5343). On the other hand, when it is determined that there is no failure or that the function can be used with the function restricted, the process waits for a key input from the keypad 116 (F5344).

When a key other than the outgoing / incoming key 222 is pressed, a process corresponding to the pressed key is performed (F5345). The mobile terminal waits for a message indicating that video communication is to be performed (F5346). Upon receiving the message, a response is returned to the message (F5347), and the microphone 13
4 and the speaker 135 are turned on (F5348).
In this state, voice communication can be performed. Thereafter, the process stands by until a key input is made (F5349).

Then, the stop key 221 or the call /
When the incoming key 222 is pressed, the incoming call is interrupted (F5
350). When the shutter button 216 is pressed,
The process moves to step F5321 (FIG. 14). If a key other than the shutter button 216 has been pressed, a process corresponding to the pressed key is performed (F5351), and then the process waits until any key is pressed (F5349).

Next, the procedure of moving image communication between the portable terminal A and the portable terminal B will be described with reference to FIG. When the call is set up, the mobile terminal B on the calling side switches to the mobile terminal A on the receiving side.
Is notified of a message indicating that video communication is to be performed. This message is transmitted in a frame for transmitting a moving image.
Upon receiving this message, the receiving portable terminal A returns a response. Thus, the data of the voice communication and the data of the moving image communication can be transmitted to each other. When terminating the communication, the end of the moving image communication is transmitted from either the calling side or the receiving side, or from both sides, and the receiving side returns a response and ends.

(Function 4) Next, function 4 will be described. Function 4 is a function for inputting data from the touch panel 108 by operating the input pen 128. Scanner 1
29 allows data to be input. The data input from these input means is stored in the image storage memory 111 of the mobile terminal 10.

FIG. 17 is a flowchart showing an example of a control program stored in the ROM 114 of FIG. 1, which controls processing when data is input from the touch panel 108 by operating the input pen 128. When the power switch 217 is turned on, power is supplied from the battery 127 to each processing unit of the portable terminal 10 (F5400), and the processing is started. First, each processing unit shown in FIG. 1 is diagnosed (F5401), and it is determined whether or not each processing unit has a failure (F5402). If it is determined that there is a failure, the display unit 201 of the display unit 106
In addition, an error message is displayed or a predetermined sound is generated from the speaker 135 to notify the user that the usable functions are limited (F5403). On the other hand, if it is determined that there is no failure or that the function can be used with limited functions, the process waits until a key is input from the keypad 116 (F54).
04).

If the input switch key 220 is switched to a position other than "pen", the corresponding processing is performed (F541).
5) If it is switched to “pen”, the scanner 12
9 and the input from the CCD camera 100 are not accepted. Alternatively, even if an attempt is made to input,
Is controlled so that power is not supplied to the processing unit so that the data is not held or cannot be input. Then, a timer (not shown) built in the CPU 109 is set (F5405). The timer notifies a constant time elapse signal from the time count circuit every time a preset time elapses, and performs time monitoring based on the constant time elapse signal.

When the timer expires (F5406), the input data input by the user from the touch panel 108 is read as image data until the timer expires, and the read image data is stored in the viewer 401 of the display 106. It is displayed (F5407). Next, the position detection unit 1 determines which position in the display 106 the image data displayed on the viewer 401 of the display 106 is.
07, and the detected position data is stored in the temporary storage memory 104. Then, the temporary storage memory 10
4 is converted by the data conversion unit 131,
A / D converter 1 converts image data from CCD camera 100
In the same data format as that converted into the digital image data by 01, the image data is input to the field memory 102, and the image is displayed on the viewer 401 of the display 106 based on the image data in the field memory 102. When the data input within a certain period of time is displayed, the process waits until any key is pressed (F5408).

Here, when the stop key 221 is pressed, the input from the touch panel 108 is interrupted, and the data input and displayed so far is cleared (F540).
9) Check the setting of the input switching key 220 again (F
5404).

When the shutter button 216 is pressed, the empty storage memory is checked (F5412). As a result of the check, if there is no empty storage memory, an error message to that effect is displayed on the display unit 201 of the display unit 106 (F5
413) The setting of the input switching key 220 is confirmed again (F5404).

When the power switch 217 is turned off,
The power of each processing part is turned off, and the processing ends (F541).
l).

Stop key 221 and shutter button 2
16 and a key other than the power switch 217 is pressed, a process corresponding to the pressed key is performed (F541).
0). Thereafter, the setting of the input switching key 220 is confirmed again (F5404).

FIG. 18 is a flowchart showing an example of a control program stored in the ROM 114 of FIG. 1, which controls processing when input from the scanner 129. When the power switch 217 is turned on, power is supplied from the battery 127 to each processing unit of the portable terminal 10 (F5500), and the processing is started. First, each processing unit shown in FIG. 1 is diagnosed (F5501), and it is determined whether or not each processing unit has a failure (F5502).
When it is determined that there is a failure, an error is displayed on the display unit 201 of the display unit 106 or the speaker 135 is displayed.
Then, a predetermined sound is generated to inform the user that usable functions are limited (F5503). On the other hand, if it is determined that there is no failure or that the function can be used with its functions restricted, the process waits until a key is input from the keypad 116 (F5504).

Then, when the CPU 109 confirms that the setting of the input switch key 220 has been switched to a setting other than "scanner", a process corresponding to the switched setting is performed (F5435). On the other hand, when the CPU 109 confirms that the scanner has been switched to “scanner”, it checks whether or not the scanner 129 is connected to the portable terminal 10 (F5436), and confirms that the scanner 129 is not connected. In this case, the user is prompted to connect the scanner 129 (F5437), and waits for the connection.

Here, the user connects the scanner 129 and turns on the reading switch 243 of the scanner 129.

Then, the scanner 1 is controlled by the CPU 109.
29 is confirmed to be connected to the mobile terminal 10,
Reading of the data sent from the scanner 129,
Repeat until data reading is completed (F5438,
F5439), and stores the read data in the temporary storage memory 1
04.

Here, the reading switch 2 is set by the user.
When 43 (FIG. 4) is turned off and the end of data reading is confirmed by the CPU 109, the read data is
In the same manner as in the case where “touch panel” is set, the image is displayed on the viewer 401 of the display device 106 (F5440). The user can check the read data on the viewer 401 of the display 106. Thereafter, the process stands by until any key is input (F5441).

Then, the stop key 221 is set by the user.
If is pressed, the scanner input is interrupted, the display is cleared, and the input switching designation is confirmed (F5434).

If the user presses the power key 217 to turn off the power while waiting for a key input, the power is turned off and the process ends.

If the user presses the shutter button 216 while waiting for a key input, it is checked whether the storage memory is empty (F5444). If it is empty, the data input from the scanner 129 is deleted. Remember (F544
6) Then, the input switching designation is confirmed (F543)
4). On the other hand, if you determine that the storage memory is not empty,
An error is displayed (F5445), and the input switching designation is confirmed (F5434).

While waiting for a key input, the stop key 221
When a key other than the power key 217 and the shutter button 216 is pressed, a process corresponding to the pressed key is performed (F5443), and thereafter, input switching designation is confirmed (F5434).

(Function 5) Next, function 5 will be described. Function 5 is a function that can combine data input from the CCD camera 100 with data input from the input pen 128 or the scanner 129. There are two operation methods for realizing this function. In the first method, an image previously captured by the CCD camera 100 and a touch panel 108 or a scanner 12
9 is synthesized with the image input. In the second method,
The image input by the touch panel 108 or the scanner 129 is combined with the image currently captured by the CCD camera 100.

FIGS. 19 and 20 show the ROM 114 of FIG.
5 is a flowchart showing an example of a control program for executing the first and second methods stored in the storage device. First, FIG. 19 will be described. When the power switch 217 is turned on, power is supplied from the battery 127 to each processing unit of the portable terminal 10 (F5500), and processing is started by the CPU 109 according to the program in the ROM 114. First, each processing unit shown in FIG. Diagnosis is performed (F5501), and it is checked whether or not each processing unit has a failure (F550).
2). If it is determined that there is a failure, the display 1
At 06, an error is displayed or a predetermined sound is generated from the speaker 135 to notify the user that the usable functions are limited (F5503). As a result of the diagnosis, if there is no failure or if the function can be used with a limited function, the process waits until a key is input from the keypad 116 (F5).
504).

When the user sets the combining switch 210 to "new" or "update" while waiting for a key input, the CPU 109 causes the RAM 115 to store the combining mode in the RAM 115 (F5505). The flow waits for a key input (F5504).

If the user presses the number-of-registered key 207 while waiting for key input, the CPU 109
The number of CCD input images is read from M11, and the read value is font-developed in the field memory 102 using the font of the ROM 114 and displayed on the viewer 401 of the display unit 106 (F5507). Thereafter, the flow waits until a key input is made (F5504). Therefore, when waiting for a key input, the user presses the registered number key 207 to
This indicates that the input image is displayed from the CD camera 100, and the number of stored image data input from the CCD camera 100 is displayed on the viewer 401 of the display unit 106, so that the number of data can be confirmed.

When the user presses the still image key 202 while waiting for key input, the input from the CCD camera 100 is designated as a still image input. In this case, the characteristics of the moving image? ? Display may be possible, but in such a case,
The moving image data is received from the partner computer 303 through communication and reproduced and displayed. Then, the designation of the still image input is stored in the RAM 115.

The user selects a composition switch, a still image switch, a registration number key 207, and a reproduction display key 223.
If a key other than is pressed, the key operation is not directly related to the present embodiment, so that processing corresponding to the pressed key is performed (F5508).

When the reproduction display key 223 is pressed by the user, input of an input image from the CCD camera 100 to be reproduced and displayed next is awaited (F5509).

Here, when a key other than a numeral is pressed by the user, a process corresponding to the pressed key is performed (F
5510). On the other hand, when the user operates the numeric keys, the compressed image data (the input image from the CCD camera 100 and stored in the image memory 113) corresponding to the input number is stored in the image memory 113. And decompressed by the encoding processing unit 112, developed in the field memory 102, and displayed on the viewer 401 of the display 106 (F551l). The user can see the image displayed on the display 106. afterwards,
The key input is waited again (F5512).

At the time when the image data is input, the number of the image data to be reproduced and displayed is checked.
The user may be prompted to re-input the image data.

If a key that is not valid or pressed is pressed while waiting for key input, processing corresponding to the pressed key is performed (F5513).

If the UP or DOWN key, which is a part of the reproduction display key 223, is pressed while waiting for key input (S4).
507) The image data whose storage management number is one larger or one smaller than the currently displayed data is displayed in the same manner as above (F5514). After that, the display of the input image from the target CCD camera 100 is completed.

Next, FIG. 20 will be described. FIG. 20 is a flowchart showing an example of a control program for implementing the second method. This control program, as described above,
This is a control program for synthesizing an image captured by the CCD camera 100 with an image input from the touch panel 108 or the scanner 129. While waiting for key input of the registered number key 208 (F5515), the user presses the registered number key 208 to indicate that the image is to be displayed on a touch panel or a scanner.
To input image data from the touch panel 108 or the scanner 129, read the number of images from the RAM 115, and display the read number of images on the display unit 20 of the display 106.
1 is displayed. Then, the internal display processing mode is set to touch panel and scanner image display (F5516).

If a key not related to the display processing is pressed while waiting for key input, processing corresponding to the pressed key is performed (F5517).

In order to display the image for reproduction, the user presses the reproduction display key 223 after confirming the number of stored images. When the reproduction display key 223 is pressed by the user, the CPU 109 causes the display image to wait for designation of a display image (waiting for key input) (F5518).

Here, when a key other than the numeric keys 204 is operated, that is, when invalid data is input, an error message is displayed or processing corresponding to the operated key is performed (F5519). . On the other hand, number key 2
04 is operated, that is, when correct data is input, the image data designated by the operation of the numeric keys 204 is stored in the image storage memory 11 by the CPU 109.
1 is expanded from the field memory 139 while being expanded by the encoding processing unit 110, and is displayed (F5520). Thereafter, the flow waits until any key is operated (F5521). Here, the user can check the synthesized image data.

Then, the reproduction display key 22 is set by the user.
When the UP and DOWN keys, which are part of Step 3, are pressed,
The image data having the storage management number one larger than or smaller than the data currently displayed is displayed on the viewer 401 of the display unit 106 (F5523). The user can check the composite image. Thereafter, the process stands by until a key is operated (F5523).

Here, the user presses the shutter button 21
When the button 6 is depressed, the LED 206 is turned on to indicate that recording is in progress, the data in the field memory 139 is transferred to the field memory 102, and the data is synthesized. In accordance with the setting of “update”, the data is compressed by the encoding processing unit 112 and stored in the image storage memory 113 (F552
4). Then, it waits until a key is operated (F55).
15).

While waiting for key input (F5525), the CCD
If the registered number key 207 is operated again to display an image, the process waits until any key is operated (F
5515).

If the key 208 is operated while the key input is awaited (F5525), that is, if the touch panel or the scanner image display is designated, the flow stands by until any key is operated (F5515).

While waiting for key input (F5525), the registered number key 207, the registered number key 207, and the power key 2
If a key other than 17 has been operated by the user, a process corresponding to the operated key is performed (F5526).

If the power key 217 is operated and the power is turned off while waiting for key input (F5525), the power is turned off and the process is terminated.

FIGS. 21 and 22 show the ROM 114 of FIG.
Is a flowchart showing an example of a control program that is stored in the control program and that combines an image captured by the CCD camera 100 with an image input from the touch panel 108 or the scanner 129. When the power switch 217 is turned on, power is supplied from the battery 127 to each processing unit of the portable terminal 10 (F5540), and the processing is started. First, each processing unit shown in FIG. 1 is diagnosed (F5541), and it is determined whether or not each processing unit has a failure (F5542). When it is determined that there is a failure, an error is displayed on the display unit 201 of the display unit 106, a predetermined sound is generated from the speaker 135, and the like.
The user is notified that usable functions are limited (F5543). On the other hand, if it is determined that there is no failure or that the functions can be used with limited functions, the process waits until a key is input from the keypad 116 (F5544).

When the user presses the still image key 202 in order to input a still image from the CCD camera 100 while waiting for key input, the CPU 109 stops the image input mode from the CCD camera 100. Image mode, and set the still image mode to RAM
115 (F5545). Thereafter, the process stands by until any key is operated (F5574).

If the input switching key 220 is switched to “camera” by the user while waiting for key input (F5544), the CPU 109 switches the image input destination to CC.
The D camera 100 is set, information of the set image input destination is stored in the RAM 115, and control is performed so that image data is not input from the touch panel 108 or the scanner 129 (F5546). In this case, the power supply to the touch panel 108 or the scanner 129 may be stopped, or in practice, even if image data comes in, the data may be discarded by software processing.

When the input from the CCD camera 100 is set, the image input from the CCD camera 100 starts, and A
The data for one screen is converted into digital data by the / D converter 101, the obtained digital data is stored in the field memory 102, and the data is output to the viewer 401 of the display 106. When data for one screen is input from the CCD camera 100, the data is output to the viewer 401 of the display 106, and when output is completed, the process of inputting and outputting data for the next one screen is repeated. Thereafter, the process stands by until any key is operated (F5544).

When a key operation not related to the key input is performed while waiting for the key input (F5547), an error notification is performed or a process corresponding to the operated key is performed (F547).
548).

When the user turns on the recording switch 206 while waiting for a key input (F5547), the CPU 1
By 09, the LED of the recording switch 206 is turned on to indicate that recording is in progress (F5549). Also, R
The flag indicating that recording is being performed in the AM 115 is turned on. Thereafter, the process stands by until any key is operated (F5550). In this case, the user operates the CCD camera 10
The direction of 0 can be adjusted while viewing the image displayed on the viewer 401 of the display 10. This CCD camera 1
Since the adjustment of 00 is performed mechanically, the operation of the CPU 109 is not affected. In addition, the user operates the combining switch 21.
0 can be set to "new" or "update". In this example, it is assumed that “new” is set.

Then, while waiting for a key input (F555)
0), when a key other than the shutter button 216 is operated by the user and the operated key is a key other than the power switch 217 (F5571), a process corresponding to the operated key is performed (F5572).

If the shutter button 216 is operated while waiting for a key input (F5555), it is checked whether or not the input switch key 220 is set to "camera" (F5551). If the camera is not set to the camera, a message to set the input switch key 220 to “camera” is displayed on the viewer 401 of the display unit 106 (F5553), and the input switch key 220 is again set.
Wait for the input of (F5544).

On the other hand, when the input switch key 220 is set to “camera”, image data for one field is input from the CCD camera 100, and the input image data is input to the viewer 401 of the display 106. At the same time, the image data from the field memory 102 is compressed by the
1 is stored. When the storage process is completed, the recording switch 2
The LED 06 is turned off. After that, the CCD camera 100
The CPU 109 causes the CPU 109 to wait for a key input in order to synthesize an image input from the touch panel 108 with the image captured in step (F5554).

When the input switch key 220 is switched to “touch panel” by the user while waiting for key input (F5554), the CPU 109 causes the image input destination to be set to “touch panel”, and the set image input destination information is stored in the RAM 115. And control is performed so that image data is not input from the CCD camera 100 or the scanner 129 (F5555).

When the user sets the combining switch 210 to “new” or “update” while waiting for a key input (F5554), the combining switch 21 is set by the CPU 109.
0 is stored in the RAM 115 (F555
6) Check in later processing. The setting in this example may be “new” or “none”. Here, the user can input data from the touch panel 108, considering that the CCD input image is being displayed. The input from the touch panel 108 reads data input from the touch panel 108 for a certain period of time and displays the data on the display 106 so that the user can recognize what data the user is input. Then, the user can confirm the input data.

Then, a timer is set (F555)
7) Wait until the timer times out (F
5558). Then, when the timer expires, the data input until the time expires is read into the field memory 139 and output to the display 106 (F5559). Thereafter, this input processing is repeated until there is any key input (F5560).

When the user operates the stop key 221 while waiting for key input (F5560), the input from the touch panel 108 is interrupted, and the data input and displayed so far is cleared (F5561). Thereafter, the process stands by until any key is operated (F5560).

If the user operates the power switch 217 to turn off the power while waiting for a key input (F5560), the process ends.

If the user presses the shutter button 216 while waiting for a key input (F5560), it is checked whether or not the storage memory is empty (F5563). If it is confirmed that the storage memory is not empty, , An error is displayed on the display unit 201 of the display unit 106 (F5564), and then, it waits until any key is operated (F556).
0). On the other hand, if the storage memory is empty, it is checked whether or not the combining switch 210 is turned on (F5565).

Here, "None" is designated (F5
505) If there is no data in the field memory 139 (F5566), the image input from the CCD camera 100 and the image input from the touch panel 108 are combined, and the obtained combined image is compressed by the encoding processing unit 112. Are stored in the image storage memory 113 (F557
0). Thereafter, the flow waits until any key is operated (F5571). On the other hand, if "none" is specified (F
5505) If there is data in the field memory 139 (F5566), the display unit 2 of the display unit 106
01 is displayed (F5567), and then the process stands by until any key is operated (F5571).

Alternatively, if "composite available" is designated (F5505) and the image to be composed is not in the field memory 139 (F5566), the display 106
An error is displayed on the display unit 201 (F5569),
After that, it waits until any key is operated (F5
571). On the other hand, if “synthesis existence” is designated (F55
05) Moreover, the image to be synthesized is stored in the field memory 13.
9 (F5566), the image input from the CCD camera 100 and the image input from the touch panel 108 are combined, the obtained combined image is compressed by the encoding processing unit 112, and stored in the image storage memory 113 ( F55
70). Thereafter, the key input is monitored (F5571).

When the power switch 217 is operated and the power is turned off, the present processing is terminated. When a key other than the power switch 217 is operated, a processing corresponding to the operated key is performed (F5572). ). in this case,
An operation for creating the next composite image may be performed.

(Function 6) Next, function 6 will be described. Function 6 was previously a CCD camera 100, input pen 128,
The data input from the scanner 129 is reproduced and the display 1
This function allows the data currently being input from the CCD camera 100 to be displayed on the display unit 106 while displaying the data 06. By recording the currently input data by this function 6, it is possible to newly record the data obtained by combining the previously input data and the currently recorded data, or to record the data after updating the previous data. Can be.

Function 5 is a function of displaying an image from the CCD camera 100 first and inputting a comment from the touch panel 108 later. On the other hand, the function 6 reproduces data previously input from the CCD camera 100, the touch panel 108, or the scanner 129, and
6 and the data currently being input from the CCD camera 100 is displayed on the display 106. When the data currently being input is recorded, the data obtained by combining the previous input data and the data just recorded is displayed as " It can be recorded as "new" or "update" of previous data.

FIGS. 23 and 24 show the ROM 114 of FIG.
Is a control program stored in the control unit, and is a flowchart showing an example of a control program that records data obtained by combining the previous input data and the data just recorded as “new” or “update” of the previous data. is there. When the power switch 217 is turned on, power is supplied from the battery 127 to each processing unit of the portable terminal 10 (F5600).
Processing is started. First, each processing unit shown in FIG. 1 is diagnosed (F5601), and it is determined whether or not each processing unit has a failure (F5602). If it is determined that there is a failure, an error is displayed on the display unit 201 of the display unit 106, a predetermined sound is generated from the speaker 135, and the user is notified that the usable functions are limited. (F5603). On the other hand, if it is determined that there is no failure or that the function can be used with limited functions, the process waits until a key is input from the keypad 116 (F5604).

In the key input waiting state (F5604), the user sets the combining switch 210 to "new" or "update".
Is set to any of the above, the set synthesis mode is stored in the RAM 115 by the CPU 109 (F
5605). Thereafter, the process stands by until any key is operated (F5604).

In the key input waiting state (F5604), when the user operates the still image key 202 to specify the still image input, the CPU 109 causes the image input mode of the RAM 115 to be set to the still image mode (F5606).
After that, it waits until any key is operated (F5
604).

In the key input waiting state (F5604), when the registered number key 208 is pressed by the user, it indicates that the data is input from the touch panel 108 or the scanner 129 and is input from the touch panel 108 or the scanner 129. The number of image data stored and stored is displayed on the display 106 and the number is confirmed (F5).
607). Thereafter, the process stands by until any key is operated (F5604). While waiting for key input (F560
4) If the user presses the power key 217, the process ends.

In the key input waiting state (F5604), when keys other than the composition switch 210, the still image key 202, the registered number key 208, and the reproduction display key 221 are operated, the keys correspond to the operated keys. Perform processing (F56
08).

When the user presses the reproduction display key 221 in the key input waiting state (F5604), the display waits for display image designation (F5609). When a key other than the numeric keys 204 is operated by the user, a process corresponding to the operated key is performed (F5610). On the other hand, when the numeric key 204 is operated, while the image data is decompressed by the encoding
In step S561, the designated image data is read from the image storage memory 111, stored in the field memory 139, and displayed on the display unit 106 (F561l). Here, the user can check the displayed image.
After that, it waits until any key is operated (F5
612).

When the user operates the UP and DOWN keys in order to view other data in the key input waiting state (F5612), the CPU 109 causes the CPU 109 to operate in accordance with these operations.
The data of the management number immediately before the displayed image data or 1
The data of the next management number is displayed (F5614).
Here, the selection of the touch panel and the scanner input image to be combined ends. Thereafter, the process stands by until any key is operated (F5615). On the other hand, when a key other than the UP and DOWN keys has been operated, processing corresponding to the operated key is performed (F5613).

In the key input waiting state (F5615), when the user switches the input switch 220 to “F” in order to input image data from the CCD camera 100, the input is changed to the input from the CCD camera 100. Switching, the image data from the CCD camera 100 is input to the field memory 102, and an image is displayed on the viewer 401 of the display 106 based on the image data in the field memory 102. Thereafter, the process stands by until any key is operated (F5615).

When the user operates the still image key 202 in the key input waiting state (F5615), the CPU
109, the mode is set to the still image mode (F5
616). Thereafter, the process stands by until any key is operated (F5618). The user adjusts the position of the displayed touch panel image data and the image data of the CCD camera input by adjusting the input position from the CCD camera 100 while looking at the viewer 401 of the display 106, and adjusts the position. You can check. Positioning can be performed by moving the touch panel image by operating the touch panel 108, but this method is not employed in the present embodiment.

The recording switch 206 is set by the user.
If any other key is operated, a process corresponding to the operated key is performed (F5618-1). On the other hand, when the recording switch 206 is operated by the user, the CPU 10
9, the LED of the recording switch 206 is turned on to indicate that the recording is in progress (F5619), and thereafter, it is checked whether the designation key 210 is set to "None" or other than "None" (F5620).

Then, if "None" is set (F5
620) If there is data in the field memory 139 (F5621), the display unit 20 of the display unit 106
1 is displayed (F5623), and thereafter, the process stands by until any key is operated (F5615).

If “None” is set (F562
0) If there is no data in the field memory 139 (F5621), the flow waits until any key is operated (F5625).

If the setting is other than “none” (F562
0) If the data has not been read into the field memory 139 (F5623), an error is displayed on the display unit 201 of the display unit 106 (F5624), and thereafter, it waits until any key is operated (F56).
15).

If the setting is other than "none" (F562
0) If data is read into the field memory 139 (F5623), the process waits until any key is operated (F5625).

If a key other than the shutter button 216 is operated in the key input waiting state (F5625), the flow stands by until any key is operated (F5615).

On the other hand, in the key input waiting state (F562
5) When the shutter button 216 is pressed by the user, it is checked whether or not the input changeover switch 220 is set to "F", that is, whether or not the input has been switched to the input from the CCD camera 100 (F5625). .
If not, an error is displayed on the display unit 201 of the display unit 106, and the input switching is set to "ka".
(F5628). Thereafter, the process stands by until any key is operated (F5615).
On the other hand, when “f” is set, the CCD camera 1
The image data for one screen from 00 is stored in the field memory 10.
2 (F5627). Then, specify key 210
Is checked (F5629).

If the setting of the designation key 210 is “update”, the field memory 10 of the CCD camera input image
2, a touch panel input image field memory 139;
Are transmitted and synthesized, the obtained data is compressed by the encoding processing unit 112, and the CPU 109 stores the data in the image storage memory 113 by replacing the previous data (F5630).

If the setting of the designation key 210 is "new", it is checked whether or not there is a free space in the image storage memory 113 (F5631). If there is no free space, an error is displayed (F5633) and the free space is displayed. If there is, new image data is recorded (F5632), and thereafter, the flow returns to F5604.

Here, the power switch 21 is selected by the user.
When the power is turned off by operating 7, the power is turned off,
This processing ends.

(Function 7) Next, the function 7 will be described. The function 7 is a function capable of transmitting recorded data to another computer, receiving the data from another computer, storing the data in the image storage memory 111 of the mobile terminal 10, and displaying the image.

FIGS. 25 and 26 show the ROM 114 of FIG.
FIG. 4 is a flowchart showing an example of a control program stored in a computer and transmitting data to and from another computer. When the power switch 217 is turned on, power is supplied from the battery 127 to each processing unit of the mobile terminal 10 (F5700), and the processing is started. First, each processing unit shown in FIG. 1 is diagnosed (F570
1) It is determined whether or not each processing unit has a failure (F57).
02). If it is determined that there is a failure, an error is displayed on the display unit 201 of the display unit 106, a predetermined sound is generated from the speaker 135, and the user is notified that the usable functions are limited. (F570
3). On the other hand, if it is determined that there is no failure or that the function can be used with its functions restricted, the process waits until a key is input from the keypad 116 (F5704).

Then, in the key input waiting state (F570
4) When the user operates the still image key 202,
The still image mode is set by turning on the internal flag of the RAM 115 (F5705), and thereafter, the process stands by until any key is operated (F5704).

In the key input waiting state (F5704), when the user operates the number-of-registered-number key 207 and the image input from the CCD camera 100 is designated, the CPU 109
As a result, the number of image data input from the CCD camera 100 is displayed on the viewer 401 of the display 106 (F5).
706).

When the reproduction display key 223 is operated in a key input waiting state (F5704), the input of the numeric key 204 is waited (F5708).

In the key input waiting state (F5704), the user inputs a still image key 202 and a registered number key 207.
When a key other than the reproduction display key 223 is operated, processing corresponding to the operated key is performed (F5707).

When a key other than the numeric keys 204 is operated while waiting for input of the numeric keys 204 (F5708), processing corresponding to the operated keys is performed (F5708).
709). On the other hand, when the numeric key 204 is operated,
The designated CCD camera image is read by the CPU 109 and displayed on the viewer 401 of the display unit 106 (F5710). Here, the user can check the image data displayed on the viewer 401 of the display device 106. Thereafter, the flow waits until any key is operated (F5711).

The power switch 21 is set by the user.
If the power is turned off by operating the power supply 7, the power is turned off and the process is terminated.

While waiting for key input (F5711), UP,
If the DOWN key has been operated, an image with the management number one smaller or one larger is displayed in accordance with the operated key (F5713). Here, selection and confirmation of the image data to be sent are completed. Thereafter, the process stands by until any key is operated (F5714).

Then, while waiting for a key input (F571
4) If the still image key 202 is operated by the user, “still image” is set again (F5715), and then the process waits until any key is operated (F571).
1).

When the recording key 206 is operated by the user while waiting for key input (F5714), the non-recording mode is set and the LED of the recording key 206 is turned off (F5).
716). Thereafter, the flow waits until any key is operated (F5711).

When the user operates the communication key 209 while waiting for key input (F5714), the CPU 10
By 9, it is checked whether or not it is a computer communication (F 5718). If the result of the check indicates that the communication is not computer communication, processing corresponding to the set communication means is performed (F5717). On the other hand, in the case of computer communication, it is checked whether or not it is wired communication (F5719). As a result of the check, if it is a wired communication, a line connection check is performed (F5722), and if there is a connection error (F5721), an error notification is performed (F572).
2) If there is no connection error, send / receive key 22
Wait for the input of 2 (F5723).

While waiting for input of the transmission / reception key 222 (F5
723), when a key other than the outgoing / incoming key 222 is operated, a process corresponding to the operated key is performed (F5).
725) On the other hand, if the outgoing / incoming key 222 is operated, the user is prompted to input the dial number of the other party (F5).
724). When the user inputs a dial number using the numeric keys 204, the input dial number is transmitted to the computer communication control unit 118 and the wireless communication unit 123.
And send it to the line according to the procedure. When the transmission of the dial number is completed, the process waits for a key press and waits for a response from the other party (F5726).

While waiting for a key press and a response from the other party (F57
26) Depending on the user, the stop key 221 or call /
When the incoming key 222 is pressed, communication is interrupted by the CPU 109 (F5727).

While waiting for a key press and a response from the other party (F57
26), when a response from the other party is detected via the wireless communication unit 123 and the computer communication control / protocol unit 118,
The PU 109 notifies the other computer 303 of the still image communication on the protocol (F572
9), and waits for a response from the partner computer 303 (F5730). If there is no response from the partner computer 303 after waiting for a certain time, an error notification is made (F5731). If there is a response, the microphone 134 and the speaker 135 are turned on, and the partner computer 30 is turned off.
3 is notified by a sound or a display that the response has been made (F5732).
Here, voice communication was also enabled.

While waiting for a key press and a response from the other party (F57
26), the user operates the communication means key 209,
When transmission start is selected from the selectable functions, the CPU 1
In step 09, the same image data as the image expanded in the field memory 102 is read out from the image storage memory 113 while being compressed, and the read image data is packetized by the computer communication control unit 118. The transmission is performed by the communication unit 123. Then, when the transmission is completed, the user is notified (F5728). Here, the user can confirm the end of the transmission by a display message or the like. Thus, one image has been transmitted. After that, it waits for the input of the UP and DOWN keys (F5711). Here, when the power switch 217 is operated by the user to turn off the power, the power is turned off, and the present process ends.

FIGS. 27 and 28 show the ROM 114 of FIG.
5 is a flowchart showing an example of a control program stored in the control program when polling reception of data is performed. When the power switch 217 is turned on, power is supplied from the battery 127 to each processing unit of the portable terminal 10 (F5750), and processing is started by the CPU 109 according to the program in the ROM 114.
Each processing unit shown in FIG. 1 is diagnosed (F5751), and it is checked whether or not each processing unit has a failure (F5752).
If it is determined that there is a failure, an error is displayed on the display unit 106 or a predetermined sound is generated from the speaker 135 to notify the user that the usable functions are limited (F5753). ). As a result of the diagnosis, if there is no failure or if the function can be used with limited functions, the process waits until a key is input from the keypad 116 (F575).
4).

The call is transmitted and the other party answers (F5754)
To F5765) are the same, and a description thereof will be omitted. However, the transmission data is expanded and displayed in the field memory 102 when transmitted, whereas the polling reception is not expanded and displayed. In the polling reception, data to be polled is specified and received, the received image data is displayed on the viewer 401 of the display 106, and the shutter button 2 is pressed.
This data is stored when 16 is pressed.

When the other party answers the call (F575)
6) The CPU 109 notifies the user that the still image communication (polling reception) is to be performed by the protocol, and waits for a response (F5769). If there is no response for a certain period of time, an error message is displayed on the display unit 201 of the display unit 106 (F5770). If there is a response, the user enables voice communication and confirms that the other party has responded. Inform by sound (F5
771) Then, it waits until a key is operated or the other party responds (F5765). The user can input the received image data number.

When the image data number is input by the user (F5765), the CPU 109 sends the image data number to be received to the other party, receives and displays the data corresponding to the image data number, and notifies the user. Yes (F5
768). Thereafter, the flow waits until a key is operated or the other party responds (F5765). Here, the user can check the received image, and if the user wants to store the received image, the user can operate the shutter button 216 to store the received image.

When the outgoing / incoming key 222 is operated, it is checked whether a call is currently being made (F5).
772) If a call has been established, the communication end is notified to the other party (F5774), and the line is disconnected (F5775).
On the other hand, if there is no call, the call is stopped (F
5773).

Next, referring to FIG.
A procedure for controlling still image communication after a call has been established between 0 and the computer 303 will be described. When performing still image communication, first, the portable terminal 10 notifies the computer 303 of performing moving image communication. The computer 303 that has received this message from the mobile terminal 10 checks whether or not there is a memory for data storage, returns a response if there is a memory for data storage, and returns a response if there is no memory for data storage. Then, instead of responding, the portable terminal 10 is notified and the line is disconnected. The mobile terminal 10 that has received the response from the computer 303 transmits the moving image data in a packet format. When sending a plurality of image data, this procedure is repeated for the number of image data. If the received image data storage memory becomes full during the reception of one piece of data, processing is performed in the same procedure as the procedure described with reference to FIG.

Next, with reference to FIG. 30, a description will be given of a polling reception procedure of still image communication after a call is made between the portable terminal 10 and the computer 303. First, it notifies the computer 303 that it wants to perform polling reception of a still image from the mobile terminal 10 that sent the call. The computer 303 returns a response to this notification. The mobile terminal 10 that has received the response sends the data ID to be received to the computer 303. How to assign this data ID is determined in advance. When the data ID to be received is sent to the computer, if there is data in the computer 303, a response is returned from the computer and the actual still image data is sent to the portable terminal 10. If another data is desired, the data ID is sent to the portable terminal 10. If the computer 303 has the data, a response is returned from the computer 303.
Data is sent. This process is repeated while the desired data is present. When the desired data is not available, the portable terminal 10 notifies the end of polling reception, and ends when receiving a response from the computer 303.

(Function 8) Next, the function 8 will be described. Function 8 is to display the image input from the CCD camera 100 on the display 10.
6 is displayed on the viewer 401, and the displayed viewer 401 is displayed.
A function of specifying a range, a row, and a column direction specified on the touch panel 108 above, recognizing a pattern of image data within the specified range, converting the pattern into a character code, and displaying the recognized character code on the display unit 106 It is. It is a function that can be displayed and checked by the operator, and can be corrected if there is an error. The converted character code can be stored.

FIGS. 31 and 32 show the ROM 114 of FIG.
Control program stored in the display 106
9 is a flowchart showing an example of a control program for displaying a character code on an image displayed on the viewer 401 of FIG. In FIG. 31, the same steps as those in FIG. 25 are denoted by the same reference numerals. Therefore, the procedure from power-on to completion of diagnosis and from selection of a target image input from the CCD camera 100 to display on the viewer 401 of the display 106 will be described with reference to FIGS. 25 and 26. The procedure is the same as described. However, in the description of the function 8, the image previously recorded from the CCD camera 100 is used as an image.

After the user operates the UP and DOWN keys to display the target image, the user waits for the "touch panel" to be switched by the input switch 220 (F5813).
When a key other than the input switch 220 is operated by the user, a process corresponding to the operated key is performed (F5816). On the other hand, when the input switch 220 is operated by the user and is switched to “P”,
The input is set to the input pen 128 input from the touch panel 108 (F5814), and control is performed so that no other input is performed (F5814). Here, the user can perform code conversion on the displayed image and designate a range to be code information by enclosing the range with a line.

Then, the data input from the touch panel 108 is read at regular intervals and displayed on the viewer 401 of the display 106 (F5815). Then, it is determined whether or not the input image is a line and a frame (F
5817). If it is determined that the input data is a frame, data from the touch panel 108 is input and displayed in the same manner as before, and the input of the setting key 211 is waited for (F5820).

When a key other than the setting key 211 is operated, a process corresponding to the operated key is performed (F
5816). On the other hand, when the setting key 211 is operated by the user, the CPU 109 causes the viewer 401 of the display unit 106 to display functions that can be performed with the setting key 211. After that, it waits for the selection of “code conversion” (F582)
1).

When the user selects "code conversion", the image data in the portion surrounded by the frame is transferred to the field memory 139, and the data is transferred to the pattern recognition processing unit 133 to perform pattern recognition. (F582
2). When the pattern recognition processing is completed, the pattern recognition processing unit 133 notifies the CPU 109 of the completion, and writes the result of the code conversion to a predetermined address on the RAM 115. Pattern recognition processing unit 133
CPU 109 that has received the notification that
Using the font stored in the ROM 114, the code on the image 115 is converted into image data, expanded on the field memory 139, and displayed on the display 106 as a conversion result (F5823). Here, the user can check the conversion result, and if so, can register the function using the setting key 211.

Then, it is checked whether or not the conversion result has been registered by the user (F5824). If the conversion result has been registered, the conversion data is flagged as the conversion result, and the converted data is added to the image. Register in the recording memory 112 (F
5825). Thereafter, the flow waits until a key operation is performed (F5824).

The portion other than the conversion range is stored as the image data, and the data stored as the image data and the data stored as the converted and code data are paired with each other to form one image. And information indicating the range of the original image in which the code conversion is performed, is stored together. If this process is repeated, the process waits for a key input (F5807).

If the power is turned off by operating the power key 217 by the user in the key input waiting state (F5824), the power is turned off and this processing is terminated.

When the user views the partially converted data, the image data number is specified in the same manner as when viewing the unconverted data. CPU
When reproducing the code-converted data, the 109 reads out information that stores which part of the original image corresponds to the code-converted part, and reads out the information stored in the field memory 1.
39, the code is font-decompressed into a portion corresponding to the original position on the other hand, while the portion which has not been code-converted is decompressed by the encoding processing unit 110 and decompressed into the field memory 139 to reproduce and display the original image. .

[0208]

As described above, according to the present invention,
Since it was configured as described above, the description and comment to be added in advance are input and stored from the touch panel or externally,
When shooting with the CCD camera, the input image from the CCD camera is synthesized and displayed while reading and displaying the explanations and comments stored in advance, so that it is easy to use and it is possible to prevent both images from overlapping. is there.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a first embodiment of the present invention.

FIG. 2 is a front view showing the external front of the portable terminal shown in FIG. 1;

FIG. 3 is a rear view showing an external rear surface of the mobile terminal shown in FIG. 1;

FIG. 4 is a diagram showing a configuration of a scanner 129 of FIG.

FIG. 5 is an explanatory diagram for explaining a usage example of the mobile terminal 10;

FIG. 6 is a flowchart (part 1) illustrating an example of a control program stored in the ROM 114 of FIG. 1 and storing an image captured by the CCD camera 100 in a storage device of the computer 303;

FIG. 7 is a flowchart (part 2) illustrating an example of a control program stored in the ROM 114 of FIG. 1 and storing an image captured by the CCD camera 100 in a storage device of the computer 303;

FIG. 8 is an explanatory diagram for explaining a moving image communication procedure after a call is established between the mobile terminal 10 and the computer 303.

FIG. 9 is a diagram illustrating a moving image communication procedure after a call is established between the portable terminal 10 and the computer 303, in which the communication procedure when the reception data storage memory of the computer 303 becomes full on the way; FIG.

10 is a flowchart (part 1) illustrating an example of a control program stored in the ROM 114 of FIG. 1, which stores data of a still image captured by the CCD camera 100 in the image storage memory 111. FIG. .

11 is a flowchart (part 2) showing an example of a control program stored in the ROM 114 of FIG. 1 and storing data of a still image captured by the CCD camera 100 in the image storage memory 111. FIG. .

12 is a flowchart showing an example of a control program stored in the ROM 114 of FIG. 1, which compresses a moving image captured by the CCD camera 100 and transmits the compressed moving image to a communication partner in real time by communication (part 1); )
It is.

13 is a flowchart showing an example of a control program stored in the ROM 114 of FIG. 1, which compresses a moving image taken by the CCD camera 100 and transmits the compressed moving image to a communication partner in real time by communication (part 2); )
It is.

FIG. 14 is a flowchart showing an example of a control program stored in the ROM 114 of FIG. 1, which compresses a moving image captured by the CCD camera 100 and transmits the compressed moving image to a communication partner in real time by communication (part 3); )
It is.

FIG. 15 is a flowchart showing an example of a control program stored in the ROM 114 of FIG. 1, which performs processing at the time of an incoming call;

FIG. 16 is an explanatory diagram for describing a procedure of moving image communication between the portable terminal A and the portable terminal B.

FIG. 17 is a flowchart showing an example of a control program stored in ROM 114 of FIG. 1, which controls processing when data is input from touch panel 108 by an input pen operation.

FIG. 18 is a flowchart showing an example of a control program stored in the ROM 114 of FIG. 1, which controls processing when input from the scanner 129;

FIG. 19 is a view showing the first stored in the ROM 114 of FIG. 1;
6 is a flowchart (part 1) illustrating an example of a control program for implementing the second method.

FIG. 20 is a diagram showing the first stored in the ROM 114 of FIG. 1;
10 is a flowchart (part 2) illustrating an example of a control program for implementing the second method.

21 is a flowchart showing an example of a control program stored in the ROM 114 of FIG. 1, which is an example of a control program for combining an image captured by the CCD camera 100 with an image input from the touch panel 108 or the scanner 129. FIG. ).

22 is a flowchart showing an example of a control program stored in the ROM 114 of FIG. 1, which is an example of a control program for synthesizing an image captured by the CCD camera 100 with an image input from the touch panel 108 or the scanner 129 (part 2); ).

23 is a control program stored in the ROM 114 of FIG. 1, in which data obtained by combining previous input data and currently recorded data is recorded as “new” or “updated” of previous data. It is a flowchart (the 1) which shows an example of a control program.

24 is a control program stored in the ROM 114 of FIG. 1, which records data obtained by combining previous input data and currently recorded data as "new" or "update" of previous data. It is a flowchart (the 2) which shows an example of a control program.

FIG. 25 is a flowchart (part 1) illustrating an example of a control program stored in the ROM 114 of FIG. 1 and transmitting data to and from another computer.

FIG. 26 is a flowchart (part 2) illustrating an example of a control program stored in the ROM 114 of FIG. 1 and transmitting data to and from another computer.

FIG. 27 is a flowchart (part 1) illustrating an example of a control program stored in the ROM 114 of FIG. 1, which is used for polling reception of data.

FIG. 28 is a flowchart (part 2) illustrating an example of a control program stored in the ROM 114 of FIG. 1, which is used when polling reception of data is performed.

FIG. 29 is an explanatory diagram for describing a procedure for controlling still image communication after a call is established between the portable terminal 10 and the computer 303.

FIG. 30 is an explanatory diagram illustrating a polling reception request for still image communication after a call is made between the portable terminal 10 and the computer 303.

FIG. 31 is a flowchart (part 1) illustrating an example of a control program stored in the ROM 114 of FIG. 1 and displaying a character code on an image displayed on the display unit 106;

FIG. 32 is a flowchart (part 2) illustrating an example of a control program stored in the ROM 114 of FIG. 1 and displaying a character code on an image displayed on the display unit 106;

[Explanation of symbols]

 Reference Signs List 100 CCD camera 102, 139 Field memory 106 Display 108 Touch panel 109 CPU 110, 112 Encoding processing unit 111, 113 Image storage memory 114 ROM 115 RAM 116 Keypad 123 Wireless communication unit 124 Wire communication unit 125 Optical communication unit 126 Antenna 129 Scanner

Claims (10)

[Claims] 1. A terminal device having a touch panel and a CCD camera, storing means for storing image data input from the touch panel, reading image data from the storing means, and storing an image based on the read data. Display control means for displaying, and after the image is displayed by the display control means, the CC
A combining unit that combines the displayed image and the image from the CCD camera when an image is input from the D camera; and a combined image display control unit that displays a combined image combined by the combining unit. A terminal device comprising: 2. The terminal device according to claim 1, further comprising positioning means for positioning an image from said CCD camera with respect to an image displayed by said display control means. 3. A composite image storing means according to claim 1, wherein said composite image storing means stores the image image synthesized by said synthesizing means, and an additional instructing means instructs said synthetic image storing means to add a new synthetic image. And a control unit for adding the new composite image to the composite image storage unit when the addition instruction unit instructs the addition of a new composite image. 4. The terminal device according to claim 3, wherein the control unit displays an error without adding a new composite image when the composite image storage unit has no free space. 5. The composite image storing unit according to claim 1, wherein the composite image storing unit stores the image image composited by the composing unit, and a change instructing unit instructs the composite image storing unit to change a new composite image. And a control unit for changing an image of the composite image storing unit with the new composite image when a change by a new composite image is instructed by the change instruction unit. 6. A terminal device having a touch panel, a storage means for storing image data input from the touch panel, and a display control for displaying an image based on the data read and read from the storage means. Means for synthesizing the displayed image and the image input from the outside when an image is input from the outside after the image is displayed by the display control means; and the synthesizing means. And a combined image display control means for displaying a combined image combined by the above. 7. The terminal device according to claim 6, further comprising positioning means for positioning an image input from outside with respect to the image displayed by said display control means. 8. The combined image storing means according to claim 6, wherein said combined image storing means stores the image combined by said combining means, and additional instructing means for instructing said combined image storing means to add a new combined image. And a control unit for adding the new composite image to the composite image storage unit when the addition instruction unit instructs the addition of a new composite image. 9. The terminal device according to claim 8, wherein the control unit displays an error without adding a new composite image when the composite image storage unit has no free space. 10. A composite image storing means according to claim 6, wherein said composite image storing means stores the image image synthesized by said synthesizing means, and a change instructing means for instructing said synthetic image storing means to change a new synthetic image. And a control unit for changing an image of the composite image storing unit with the new composite image when a change by a new composite image is instructed by the change instruction unit.