JP3476670B2 - Mobile terminal communication system, mobile terminal communication method, and medium recording program for mobile terminal communication - Google Patents

Description

Detailed Description of the Invention

[0001]

TECHNICAL FIELD The present invention relates to a portable terminal communication system, a portable terminal communication method, and a portable terminal communication suitable for use in a portable information terminal device including an electronic notebook, a personal computer, a word processor, a pocket computer and the like. The present invention relates to a medium having a program recorded therein.

[0002]

2. Description of the Related Art For example, a conventional portable information terminal has many application functions such as handwriting input software, address management, and schedule management in the terminal body. Currently, the mainstream terminals with handwriting recognition function are equipped with even a character recognition program in the mobile terminal itself for further character recognition. Further, there is also a function of storing handwritten data as it is at the time of input, and later recognizing a character by a program included in the device itself, converting the character code into a character code and saving the character code.

Further, a portable terminal which does not have a character recognition function and which only freely inputs figures and characters on a uniform screen is
It is difficult to perform character recognition from the image information afterwards, since the entered locus is simply recorded as a finally drawn figure (FIG. 21).

A mobile terminal having a character recognition function needs to have a fast processing speed because it must have sufficient performance for character recognition and a processing speed at which writing speed does not hinder practical use. There was a factor that increased costs.

On the other hand, there is a problem of making it small for carrying, and because of the restriction of using a battery, it is necessary to use hardware whose processing speed is slower than that of a personal computer or the like. The recognition process took time.

Data other than characters drawn on a mobile terminal is recorded as it is. For example, a straight line or a circle drawn by a free hand is a human being from the beginning in an environment such as a personal computer in order to cure a beautiful figure. Had to remake.

Since these programs are composed of software dedicated to the hardware used in the terminal, they are often not general programs and were not easily changed.

[0008]

Since the conventional portable terminal having a handwriting input function has other electronic notebook functions or has a character recognition program,
A large capacity was required for both the program capacity and the RAM. In addition, the character recognition program takes a long time to operate, and even if the user wants to input data in a hurry, the processing speed of the terminal may not be in time for the input speed.

In particular, a terminal capable of character recognition is
It is difficult to recognize and convert images with mixed figures and characters and input because there is a block for writing characters and conversion data is handled line by line.

The present invention is intended to solve the above-mentioned problems. The functions of the mobile terminal are narrowed down and the hardware configuration of the terminal device is simplified to reduce the cost of the device and the software of the main body of the mobile terminal. It is an object of the present invention to provide a mobile terminal communication system and a mobile terminal communication method that reduce the work required for development and speed up the user interface processing.

Further, according to the present invention, after the data input to the portable terminal is taken into the personal computer, the image data other than the characters is recognized as a figure, and a straight line or a circle drawn by freehand,
In addition, there is a mobile terminal communication system and a mobile terminal communication method in which squares and the like are cured and registered, and without needing to newly rewrite, the handwritten figures can be easily treated as clean figure data by writing them clean. The purpose is to provide.

Further, according to the present invention, by designating the area of the character by the data input to the portable terminal, only the character portion of the data written in the free arrangement is recognized and converted into the character code, An object of the present invention is to provide a mobile terminal communication system and a mobile terminal communication method that accurately perform character recognition in freehand input data by performing a clear copy, and perform character conversion without new human input. .

Further, according to the present invention, by designating the area of the figure by the data input to the portable terminal, only the figure part of the data written freely can be recognized and registered. An object of the present invention is to provide a mobile terminal communication system and a mobile terminal communication method that accurately prints a figure without humans having to newly input free-hand written character data by converting it into a pattern and printing it. To do.

Further, according to the present invention, when handwritten characters and figures are mixed in the data input to the portable terminal, the area of the characters and the area of the figures are designated to write freely. Of the input data drawn by freehand, by converting the character part of the data to the character, converting the figure part to the registered figure pattern, and writing it out,
An object of the present invention is to provide a mobile terminal communication system and a mobile terminal communication method that accurately perform clear copy of input data in which characters and figures are mixed without requiring humans to newly input.

[0015]

Means for Solving the Problems A portable terminal communication system according to claim 1, wherein the input means for handwriting a character or graphics, etc., first for displaying characters or graphics, etc. that are handwritten by the input means and display means, said input hand
A capturing means for capturing the handwritten data input in the column ,
It can communicate with external devices and can be retrieved by the capture means.
A first for transmitting the handwritten data loaded into the external device
Mobile terminal device provided with a communication unit, and wherein the mobile terminal the first communication means and mutually communicable second <br/> communication means of the device, is received by the second communication means Said hand
And character recognition means for character recognition data writing, the second
To figure recognition the handwritten data received by the communication unit
Is composed from an external device and a figure recognition unit that, the
The external device is the character recognition means and / or the graphic.
The data recognized by the recognition means is sent to the second communication means.
Therefore, it is transmitted to the first communication means of the mobile terminal device.
Then, the mobile terminal device receives by the first communication means.
The displayed data is displayed on the first display means.
I am trying. The mobile terminal communication system according to claim 2,
Input means for inputting characters or figures, and the input hand
It is configured integrally with the stage and is input by the input means.
And a first display means for displaying characters or figures
Vector corresponding to the character data input by the input means
Capturing means for capturing both image data and image data
And an intercommunication with an external device,
Vector data and image data that are captured by
And a first communication means for transmitting the data to the external device.
The band terminal device and the first communication of the mobile terminal device.
Second communication means capable of mutual communication with the communication means;
The vector data and the image received by the communication means.
External device equipped with character recognition means for character recognition of data
And the external device is connected to the character recognition means.
The character-recognized data by the second communication means.
And transmits to the first communication means of the mobile terminal device,
The mobile terminal device is received by the first communication means.
Display the character-recognized data on the first display means.
It is characterized by doing.

More specifically, the portable terminal communication system according to claims 1 and 2 exchanges information with a display unit capable of displaying characters, graphics, etc., an input device arranged thereon, and an external device such as a personal computer. Communication unit to do, C to do all the processing
PU, a work to be used when executing a program, a RAM for storing data registered by a user, a ROM for storing a program, an interface section for transmitting information written in an input device to a CPU, and a data for displaying data from the CPU It is a connection cable used for a display driver unit, an external information device, and a wired connection.

[0017]

A portable terminal communication system according to claim 3 is
Input means for inputting characters or figures, and the input hand
The first to display the characters or figures entered in the column
Display means and graphic data input by the input means
Both the corresponding vector data and image data are
It is possible to intercommunicate with the importing means and the external device,
The vector data captured by the capturing means and
A first communication device for transmitting image data to the external device
A mobile terminal device having a step, and the mobile terminal device
Second communication means capable of mutual communication with the first communication means of
And the vector data received by the second communication means.
Pattern recognition means for recognizing data and image data
The external device comprises:
The data recognized by the graphic recognition means is transferred to the second communication.
The first communication hand of the mobile terminal device by a communication means.
The mobile terminal device, the first communication means
The data recognized in the above figure is recognized in the first table.
It is characterized in that it is displayed on the display means. Claim 4
In the above configuration, the mobile terminal communication system of
The device further receives the data at the second communication means.
Second display means for displaying the image data;
From the image data displayed on the display means 2
Area that specifies the area for recognizing characters and / or graphics
A character recognition means and / or a front
The graphic recognition means is designated by the area designation means.
Characterized by recognizing characters and / or figures in different areas
I am trying. For example, handwriting text and
Write image data. Mobile devices and external information devices
Connecting. External information device that captures data from mobile devices
Send to the vessel. External information from the data sent from the mobile device
Receive on the device. Characters in the received image data
Specify the range to be recognized. The range specified part,
Character recognition is performed with vector data. Character recognized
Convert the result to the corresponding character code. Code conversion
The created text data. Image recognition part,
Specify the range from the remaining image data. Range specified
Image recognition is performed on the part together with the vector data. image
From the recognized result, a clean copy figure corresponding to the image data
Convert to. Confirm the data you have written. Confirmed day
Store and organize data. From external information devices to mobile devices
Send it. The mobile device receives data from the external information device.
It Easy to use by organizing the data imported to the mobile device
Arrange. Disconnect and re-use each separately
Ready. New image data and
And record it as vector data
Realize the method of plotting when showing. Claim 5
In the above configuration, the mobile terminal communication system is the mobile
The input means and the first display means of the terminal device are integrated
It is characterized by being configured in. Claim 9
In the configuration, the mobile terminal communication system of
The terminal device is a personal computer or word processor.
It consists of a terminal device such as a console or pocket computer.
Is characterized by.

[0019] The mobile terminal communication system according to claim 3, the hardware configuration is as claimed in claim 1, 2. The stored program performs image recognition of the received data,
Prepare a program that has the function of clear-printing an image written in freehand, recording it, and transferring the data to the mobile device again.

The mobile terminal communication method according to claim 6, wherein the mobile
A mobile terminal that sends and receives data between the terminal and external devices.
Communication method, in which the vector data input to the mobile terminal is input.
For transmitting data and image data to the external device
And the step of transmitting the
Recognize vector data and image data as characters
Recognition step and the characters recognized in the recognition step
To a character code data, and the conversion step
Convert the character code data converted in the conversion step to the mobile terminal.
A second transmitting step of transmitting at the end, and the mobile terminal
The character corresponding to the sent character code data.
And a step of displaying.

Specifically, the portable terminal communication method according to claim 6 is a portable information device, an external information device, a communication means such as infrared rays or a cable. In the system capable of connecting as described above, a program for realizing the step chart of FIG. 12 is prepared. Write handwritten character data on the mobile device and connect the mobile device to the external information device. Image data captured from a mobile device is transmitted to an external information device.

The data sent from the portable device is received by the external information device, and the received image data is character-recognized together with the vector data. The character recognition result is converted into a character code corresponding to the image data. Create code-converted text data. Store and organize the created text data. Data is transmitted from the external information device to the mobile device. The mobile device receives data from the external information device. Arrange the data imported to the mobile device and arrange it for easy use. Disconnect and re-use each unit individually.

The mobile terminal communication method according to claim 7, wherein the mobile
A mobile terminal that sends and receives data between the terminal and external devices.
Communication method, in which the vector data input to the mobile terminal is input.
For transmitting data and image data to the external device
And the step of transmitting the
Recognize vector data and image data as figures
Recognition step and the figure recognized in the recognition step
Conversion step for converting the
The graphic code data converted in the conversion step is stored in the portable terminal.
A second transmitting step of transmitting at the end, and the mobile terminal
The graphic corresponding to the transmitted graphic code data.
And a step of displaying.

[0024] Specifically, the portable terminal communication method according to claim 7 comprises a portable information device, an external information device, and communication means such as infrared rays and a cable. In the system capable of connecting as described above, a program for realizing the step chart of FIG. 14 is prepared.

First, the image data is written in the portable device and the portable device and the external information device are connected. Image data captured from a mobile device is transmitted to an external information device.
The data sent from the mobile device is received by the external information device. Image recognition of the received image data. From the result of image recognition, it is converted into a clean print figure corresponding to the image data. Confirm the data you have written. Store and organize the confirmed data. Data is transmitted from the external information device to the mobile device. The mobile device receives data from the external information device.

The data taken in the portable device is organized and arranged in an easy-to-use manner. Disconnect and re-use each unit individually. For the confirmation of the clear copy, a method of recording as new image data and a method of recording as vector data and plotting at the time of display are realized.

A mobile terminal communication program according to claim 8 is provided.
The recorded medium is used as a portable terminal and as the external device.
A computer to execute the above-mentioned mobile terminal communication method
It is characterized by that.

[0028]

[0029]

[0030]

According to the portable terminal communication system according to any one of claims 1 to 5 or 9 , the portable device alone can input image data of a character or an image by handwriting, store it, and call and display it. To do. In addition, the external information device has a role of character recognition / image recognition of the data taken from the data input to the mobile device from the image data and the vector data.

According to the mobile terminal communication method of the sixth and seventh aspects, when the data is input to the mobile device, the vector data is detected and stored at the same time as the image data, so that the subsequent recognition processing can be further performed. Make sure. Further, when the recognition work is performed by the external information device, the recognition part is divided into characters or images to improve the accuracy of the recognition rate.

According to the recording medium of claim 8 , the portable terminal
And the computer as the external device.
Can read and execute mobile terminal communication method
It

[0034]

[0035]

[0036]

BEST MODE FOR CARRYING OUT THE INVENTION A portable terminal communication system and a portable terminal communication method according to an embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a system block diagram showing the configuration of a mobile terminal communication system according to an embodiment of the present invention.

(Embodiment 1) In FIG. 1, 1 is a display unit capable of displaying characters, figures, etc., 2 is an input device arranged on it, and 3 is communication for exchanging information with external equipment such as a personal computer. Part 4 is a CPU that performs all processing,
5 is a RAM for storing data used by the user to execute the program and data registered by the user, 6 is a ROM storing the program, and 7 is a CPU for storing information written in the input device.
Interface unit 8 for transmitting data from the CPU, 8 is a display driver unit for displaying data from the CPU, 9 is an external information device, and 10 is a connection cable as a connecting means used for wired connection. Reference numeral 11 is an information portable device.

The data input from the input device 2 represented by an analog resistance film is sent to the CPU 4 through the interface section 7, and the touched position is detected by the program recorded in the ROM 6 and the movement is performed simultaneously. Vector data of is detected. At this time, the dot on the display portion corresponding to the portion where the position data is detected is turned on, and the image data is displayed on the display portion 1.

The input data is loaded into the RAM 5 as both vector data and image data (FIG. 5). Vector data is composed of items of a start point position (XY coordinate data) and an end point position (XY coordinate data) for each of the divided line segments, which is obtained by dividing a line forming a figure at a fixed distance from the start point. Use as a parameter.
On the other hand, the image data is one data of a set of points forming a figure, and the bitmap data of the start point position (XY coordinate data) and the bitmap size (vertical bit number / horizontal bit number) are used as configuration parameters. To do.

Vector Data Vector data is based on the mathematical idea of vectors. Here, as an example, it is assumed that the coordinates between the two points on both ends of the straight line are determined as the start point and the end point and the coordinates are used as parameters. A complex curve is considered as a set of several straight lines, and it is handled by approximating some straight line figures divided by the set resolution.

The finer the resolution, the greater the amount of data, but the reproducibility of curves and the recognizability of figures and characters are improved. To obtain vector data of the figure and character data to be drawn, measure the movement distance while capturing the trajectory of the data drawn on the tablet, etc. When the distance becomes a constant value, the vector that makes that point the end point Take in the coordinates of
It is the first vector data.

Thereafter, this work is repeated until the end point of the drawn graphic / character data, and the vector data of one curve is created as several divided straight line vectors.

FIG. 2 shows an example of creating vector data. At this time, the vector of a continuous curve can be omitted because the previous linear vector end point and the next linear vector start point are the same. In this case, the vector data of one continuous curve is judged by adding a separator which means the end of the data at the end.

The vector data created by the example of FIG. 1 is stored as a form surrounded by a header and an end code indicating that it is a two-dimensional array, as shown in Table 1 below.

[0045]

[Table 1]

Here, for example, if the header is 0Dh,
The data format to be stored (registered) is as follows:
{0Dh, 54,21,43,33,42,55,5
4,78,80,82,91,80,98,59, FF
h} In order to increase the recognition rate, finer line decomposition can be performed.

When there are a plurality of figures on one screen, the vector data in the above data format is continuously registered. The stored data is designated and displayed on the display unit 1 when necessary.

At the time of communication, transmission / reception is performed in this stored data form, and the receiving side uses the same sequence to reproduce the figure on the screen. That is, the internal data is transmitted / received to / from the external information device 9 via the communication unit 3 by using communication means such as infrared rays and wires.

A program for character recognition from vector data and bitmap image data is prepared for the external information device 9. The program may be a hard disk or the like provided in the external information device 9, or may be a CD-ROM, an IC card, or any other type of recording medium that is built in the external information device 9 or removable from the external information device 9. It may be.

First, recognition processing is performed from the captured image data and vector data. When a character that matches the pattern is found in advance, it is converted into a character code corresponding to that character, and text data is created from the original character image data by the code.

The image data image data, as shown in Table 2, is a saved bit map data of the figure drawn on the screen as it is, or compression to. Table 2 shows an example of configuration parameters of a figure (in the case of an ellipse, a rectangle, and a trapezoid).

[0052]

[Table 2]

For compression, in addition to MH compression used in facsimiles and the like, JP for data compatibility with a personal computer is used.
A method such as G or GIF format is used. The reference figure of Table 2 is shown in FIG.

FIG. 3 shows an example of bitmap data, which is uncompressed bitmap data. Specifically, it has a form in which header data indicating that it is a bitmap is added. In the header, the image size of the data is written in vertical × horizontal bits so that the size of the image can be changed. This is so that image data of a size smaller than the full size of one screen can be handled.

FIG. 4 is a diagram of a stored bitmap data format. At the time of communication, transmission / reception is performed with this header added.

FIG. 5 shows that the input data is loaded into the RAM 5 as both vector data and image data. In FIG. 5, in order to measure the character spacing, the typeface such as continuous letters cannot be recognized first, but the input condition is to write each character separately in a state similar to a regular script.

The character spacing when only horizontal characters are analyzed is analyzed as follows. First, when a character is input, the height of the character is almost constant even if the horizontal interval is unbalanced. By using this, the size of one character can be roughly estimated.

First, the average of the heights of the images in the area designated as a character is calculated, and the frame having a square within a predetermined error range (for example, about ± 15%) from the size is used as a basic character of one character. If there is a space (a part without bitmap data) that is equal to or larger than the set ratio as the size, it is determined as a character boundary. The size of the ratio of the portion judged to be a space shall be registered in advance.

When recognizing vertically written characters, the characters are divided vertically in the same manner. In this case, if the designated character area range is long in the vertical direction, it is determined to be vertical writing, and if it is long in the horizontal direction, it is determined that horizontal writing characters have been input.

Returning to the description of FIG. 1, the converted character image is deleted from the original bitmap data. This is performed for all character data, and when completed, it is registered and the recognition conversion process is completed.

The character coded text data is significantly smaller in size than the bitmap image data. Therefore, if the original data is not needed, the usable area of the memory is expanded by deleting it. Further, by transferring the data to the portable device again, the memory area of the portable device can be reduced and the data which has been converted into the readable font data can be used (FIG. 6).

In FIG. 6, the vector data and the image data are not compared but each registered pattern is compared to determine the character code and the display position.

In the current character recognition system, after the normal pattern recognition, some candidates are displayed and the target character is selected from them. Therefore, if there is a confusing pattern, many candidates are displayed and the recognition efficiency is reduced.

Therefore, the object of the present invention is to increase the recognition rate by taking out possible candidates for vector data and applying pattern recognition based on the image data on them.
That is, the captured vector data is first compared with a vector pattern of a character registered in advance, and some candidates in which the patterns match are extracted.

Thereafter, the image data is compared with an image pattern of a character that is also registered in advance, and candidates in which the patterns are considered to match are narrowed down to facilitate selection.

For convenience, the "display position" is a character string in which one predetermined position for one character of the original image data (for example, the position where the upper left bitmap is located) is determined as a character reference point and arranged from there. To place.

As described above, according to the first embodiment, the input means for inputting characters or figures, the display means for displaying the input characters or figures, and the vector corresponding to the input character data. A portable terminal device that uses a capturing unit that captures both data and image data and a communication unit that transmits and receives the vector data and the image data captured by the capturing unit to an external information device,
A mobile terminal communication system comprising a communication means capable of mutual communication with the mobile terminal means of the mobile terminal device, and an external device for performing character recognition of the vector data based on the image data and managing the character recognized data. Will be provided.

(Embodiment 2) The external information device 9 of FIG. 1 is provided with a program for performing graphic recognition from vector data and bitmap image data. First, recognition processing is performed from the captured image data and vector data.

As shown in FIG. 7, when a figure pattern (ellipse in the example) that matches a prepared pattern such as a straight line, a circle, an ellipse, a rectangle, and a trapezoid is found, it is converted into a figure code corresponding to the figure. At the same time, the deformation parameters of the figure (in the example, the major axis, minor axis and angle of the ellipse) and the position of the center point are calculated. The original figure to be recognized is deleted from the original bitmap image data. This process is performed for all the graphic data that requires it, and when it is finished, it is registered and the recognition conversion process is completed.

Taking the case of the ellipse in FIG. 7 as an example, it will be explained that the major axis calculation, the minor axis calculation, the center point calculation, the center position calculation and the inclination calculation can be determined from the vector data and the image data. Also, it will be explained that the graphic code determination, display position determination, angle determination, and configuration parameter determination are performed.

By comparing the vector data of the drawn graphic data and the image data with the acquired pattern data, it is first recognized which kind of the registered graphic the drawn graphic is within the designated range. And display the candidates. The "figure code determination" is performed by the user determining the desired figure from among them.

At this time, if a figure pattern corresponding to the drawn figure pattern is not registered, the drawn figure cannot be converted and is used as it is as bitmap data.

After determining the type of figure to be converted, each parameter is measured. In the case of an ellipse, the four constituent parameters are “major axis”, “minor axis”, “center point position” and “tilt”. The method of determining these is shown in FIG.

First, the X-axis direction and Y of the figure recognized as an ellipse
The coordinate position of the extreme point is measured for each axial direction.
Then, the midpoint of the coordinates is calculated for each of them. The obtained midpoint is the "center point" of the ellipse. The coordinates of this point are referred to as the "center point position".

Next, two points farthest from the center point are obtained. First, the coordinates of the point farthest from the center point of the obtained ellipse in the origin direction in both the X-axis direction and the Y-axis direction are obtained.

As an example, first, the distance from the center point to the origin (point A in the example of FIG. 8) at the same height as the center point is measured, and then the distance between the surrounding points and the center point is the origin. Each direction is measured up to the same X coordinate as the center point, and the farthest point is stored.

Next, a line segment L1 connecting this point and the center point, and a line segment L2 (original line segment L1 perpendicular to the X-axis direction based on the center point)
The slope of the vertical line segment L2 is -1 / a
Is required. ) Is obtained, and the intersection of this line segment and the drawn elliptical bitmap on the X-axis side is obtained.

In FIG. 8, of the lengths of L1 and L2,
The longer one is doubled and the shorter one is doubled. "Inclination" is the inclination of the major axis with respect to the X axis. This is represented by a vector, so in this example, it is the inclination vector of L1 itself.

Returning to the explanation of FIG. 1, when all the graphic data are registered and the recognition conversion processing is completed, the storage and display processing can be selected. One is to store only the parameters of the coded figure data, and calculate and draw the figure from the parameters at the position recorded at the time of display. In the case of this format, the coded graphic data is much smaller in size than the bitmap image data. Therefore, if the original data is not necessary, it is deleted to expand the usable area of the memory.

By transferring the data to the portable device again,
The memory area of the mobile device is small, and the data that has been converted into easy-to-read font data can be used (FIG. 9).

In the case of FIG. 9, the data obtained from the vector data and the image data can be transmitted to the portable terminal as "major axis", "minor axis", "line type", and "center position". Explain that sometimes images can be plotted from parameters.

By the method described in FIG. 8 above, each ellipse parameter “major axis” is calculated from vector data and image data.
Obtain "minor axis", "tilt" and "center position". This data is
It is managed and stored in the format shown in Table 3 below.

[0083]

[Table 3]

When sending data to an external portable terminal or the like,
In this case, the data is sent in this case. In this case, a header code, which means that the graphic data is sent, is added before the data.

At the time of display, the image is plotted based on this parameter. First, when it is determined that the figure to be drawn is an ellipse, the center point coordinates on the display screen are determined from the center point position data. Next, a point at a position half the major axis in the direction having the gradient of the inclination vector from the center point is searched for in the left and right directions. This can be obtained using the Pythagorean theorem with the center point as the starting point.

FIG. 10 shows the above. Considering a right-angled triangle having the X-axis component of the tilt vector as the base and the y-axis component as the height, and having a semi-field length of the major axis on the hypotenuse,
The length of the base and the height can be calculated as a ratio. Utilizing this,
The point coordinates of both ends of the major axis are obtained. When the point of the major axis is determined in this way, next, the line segment perpendicular to the major axis from the center point and having the minor axis is created in the same manner. The inclination perpendicular to the major axis is
It can be obtained by exchanging the X and Y components of the major axis inclination vector and multiplying the X component by -1. From the above, both end points of the major axis and the minor axis can be obtained. After that, by connecting these points with a fixed curvature, we can draw the ellipse of interest.

Another method is a method of rewriting the recognized parameters into bitmap data, plotting the bitmap data on the one from which the recognized pattern is deleted, and registering it as new bitmap data. in this case,
The size of the data to be registered does not change much from the original data, but the drawing time when displaying can be shortened (FIG. 11).

With reference to FIG. 11, it will be described that data in the bitmap compressed data format can be transmitted to the portable terminal device. In that case, it is also explained that the image is expanded at the time of display.

Since the data amount of bitmap format data is too large as it is, the data is compressed and stored. The data compression means is the MH method used in FAX or the like, or the JPG method generally used for image compression.
Or GIF format compression is used. In order to distinguish the compressed data from the normal bitmap data, the header code of the type is added to the head of the data as shown in Table 4.

[0090]

[Table 4]

From the header code in Table 4, it is possible to know whether the subsequent data format is compressed bitmap data or uncompressed bitmap data. Data transmission to an external mobile terminal is performed in this data format, and the received external device stores data in this state. The original data is reproduced by performing the decompression work corresponding to the compressed form, which is displayed on the side receiving this data by communication.

When a command to display the stored data is issued, the form of the data is judged from the header code.
Since the data this time is bit map data that has been compressed (compressed in the JPG format as an example), decompression work by JPG decompression is started and the bit map data is decompressed in the work area. . After that, the expanded bitmap data is displayed as dots on the display as it is, and the original data is displayed.

As described above, according to the second embodiment, the input means for inputting characters or figures, the display means for displaying the input characters or figures, and the vector corresponding to the input character data. A portable terminal device that uses a capturing unit that captures both data and image data and a communication unit that transmits and receives the vector data and the image data captured by the capturing unit to an external information device,
There is provided a mobile terminal communication system including a communication unit capable of mutual communication with the mobile terminal unit of the mobile terminal device and including an external device that recognizes the shape of an image and manages received data.

(Embodiment 3) FIG. 12 shows the character recognition step of the mobile terminal communication method of the present invention. In FIG. 12, in step 1 (hereinafter, simply referred to as “S1”), only characters are manually input as image data into the mobile device. At this time, the position and vector of the line or point drawn with a pen or the like on the touch panel is detected and stored. At the same time, the display of the portion corresponding to the touched position is turned on and the locus is displayed on the display device. When the input is completed, the mobile device stores / registers the bitmap data. At this time, in order to reduce the file size, it is possible to compress and register.

In step S2, the portable device in which the handwritten data is registered is connected to an external information device such as a personal computer. As a connecting means, infrared rays, RF and ultrasonic waves are used wirelessly, and a connection cable is used wiredly. When the connection is completed, data transmission from the mobile device to the external information device is started in S3.

At the same time, the external information device also starts receiving the bitmap and vector data from the portable device in step S4. When the data reception is completed, the captured bitmap data is displayed on the screen of the external information device. Specify the range of the part you want to recognize with the pointing device. When the designation is completed, character recognition is started (S5 and FIG. 13).

The recognition process of each character is performed by recognizing the pattern of the registered vector pattern and the image data of the bitmap. When a matching character candidate is detected, the corresponding character code is stored in the buffer. The same recognition and code conversion is performed for all the characters within the range, and when completed, the recognized candidate sentence is displayed on the screen of the external information device.

Among these candidates, the characters that are not recognized correctly are corrected by designating further candidate characters (S6). When all the characters are confirmed, the entire character is created as new text data. At this time, if there is no need, the original image data is deleted (S
7). The text data thus created is stored in an appropriate file (S8).

The text-converted file is data-transmitted from the external information device for use again in the portable device (S9). At the same time, the portable device receives this data (S10). The text data captured by the mobile device can be displayed and used as text that has been clearly written using the font stored in the ROM 6 of FIG. At the same time, a folder is created and saved so that the user can easily use it, and the original image data is deleted if unnecessary, thereby saving the data area (S11). S
12 is disconnection.

As described above, according to the third embodiment, there is provided a portable terminal communication method for communicating image data input to a portable terminal with an external device, the image data being transmitted from the portable terminal to the external device. A first transmission step,
A recognition step of recognizing the image data transmitted to the external device as a character, a conversion step of converting the recognized character into a character code in the external device, and the character code data obtained by the conversion step from the external device. There is provided a portable terminal communication method comprising a second transmitting step of transmitting to a portable terminal.

(Embodiment 4) FIG. 14 shows an example of a graphic recognition step of the present invention. In FIG. 14, a graphic is manually input as image data into the mobile device in S21. At this time, the position and vector of the line or point drawn with a pen or the like on the touch panel is detected and stored. At the same time, the display of the portion corresponding to the touched position is turned on and the locus is displayed on the display device. When the input is completed, the mobile device stores / registers the bitmap data. At this time, in order to reduce the file size, it is possible to compress and register.

In step S22, the portable device in which handwritten data is registered is connected to an external information device such as a personal computer. As a connecting means, infrared rays, RF and ultrasonic waves are used wirelessly, and a connection cable is used wiredly.

When the connection is completed, the data transmission from the portable device to the external information device is started in S23. At the same time, the external information device also starts receiving the bitmap and vector data from the portable device in step S24. When the data reception is completed, the captured bitmap data is displayed on the screen of the external information device. Specify the area of the figure you want to recognize with a pointing device.
When the designation is completed, the figure recognition is started (S25).

The recognition processing of each figure is performed by recognizing the pattern data registered in advance and the image data of the bitmap. When a matching figure candidate is detected, the corresponding figure code and its constituent parameters are stored in the buffer. Table 2 shows an example of the constituent parameters of the figure.

Similar recognition for all figures within the range
When the code conversion is performed and the processing is completed, the recognized candidate graphic is displayed on the screen of the external information device (FIG. 15).

Among these candidates, the figure which is not recognized is corrected by designating further candidates (S26). When all figures have been fixed, the whole figure is created as new image data.

At this time, if it is desired to reduce the size of the data area to be stored, only the configuration parameter is recorded, and if it is desired to give priority to the drawing speed, new bitmap data is created (FIG. 16). At this time, if unnecessary, the original image data is deleted (S27). The text data thus created is stored in an appropriate file (S2
8).

The text-converted file is data-transmitted from the external information device for use again in the portable device (S29). At the same time, the portable device receives this data (S30). When the data format to be stored is the parameter format, the new image data taken into the portable device can be displayed and used as a figure that has been clearly written using the drawing program stored in the ROM 6. When the data format to be stored is the newly created bitmap image data, the saved image data is displayed and used as it is. At the same time, a folder is created and saved so that the user can easily use it, and the original image data is deleted if unnecessary, thereby saving the data area (S31). S32 is disconnection.

As described above, according to the fourth embodiment, there is provided a portable terminal communication method for communicating image data input to a portable terminal with an external device, the image data being transmitted from the portable terminal to the external device. A first transmission step,
A recognition step of recognizing the image data transmitted to the external device as a graphic, and a second step of transmitting the graphic data obtained by the recognition step from the external device to the mobile terminal
And a mobile terminal communication method comprising:

(Fifth Embodiment) FIG. 17 shows an example of a character / figure mixed recognition step. In FIG. 17, in S41, characters and figures are manually input as image data into the mobile device. At this time, the position and vector of the line or point drawn with a pen or the like on the touch panel is detected and stored. At the same time, the display of the portion corresponding to the touched position is turned on and the locus is displayed on the display device. When the input is completed, the mobile device stores / registers the bitmap data. At this time, to reduce the file size,
It can be compressed and registered.

In step S42, the portable device in which handwritten data is registered is connected to an external information device such as a personal computer. As a connecting means, infrared rays, RF and ultrasonic waves are used wirelessly, and a connection cable is used wiredly.

When the connection is completed, the data transmission from the portable device to the external information device is started in S43. At the same time, the external information device also starts receiving the bitmap and vector data from the portable device in step S44.

When the data reception is completed, the fetched bitmap data is displayed on the screen of the external information device.
A portion of the desired character recognition is designated with a pointing device (S45). When the designation is completed, character recognition is started (S46).

Character recognition is performed in steps S47 and S48 as in the third embodiment. Next, the area for which the figure recognition is desired is designated by the pointing device (S4).
9). When the designation is completed, figure recognition is started (S5).
0). The figure recognition is performed in step S5 as in the fourth embodiment.
0, S51.

The individual recognition processing is performed by recognizing the pattern data and the bit map image data that have been registered in advance. When the recognition and conversion of characters and figures are completed, the data is confirmed (S5).
2).

When the confirmation of all the data is completed, the entire data is created as new text data or image data. The text data thus created is stored in an appropriate file (S53).

The text-converted file is data-transmitted from the external information device for use again in the portable device (S54).

At the same time, the portable device receives this data (S55). The newly created data is in a state in which character codes and graphic codes are mixed. When the data format of the graphic to be stored is the parameter format, the new image data loaded into the portable device displays the font data at the designated position in the character code portion, and the graphic portion in the ROM 6 of FIG. It can be displayed and used as a clean-printed figure using the drawing program stored in (Fig. 18).

When the data format to be stored is the newly created bitmap image data, the saved image data is displayed / used as it is (FIG. 19). At the same time, create and save a folder for your convenience,
If there is no need, the original image data is deleted to save the data area (S56). When all the work is completed, disconnect the connection so that it can be used individually.

As described above, according to the fifth embodiment, there is provided a portable terminal communication method for communicating image data input to a portable terminal with an external device, the image data being transmitted from the portable terminal to the external device. A first transmission step,
A step of specifying a character portion for recognizing the image data transmitted to the external device as a character and a figure portion for recognizing as a figure; a step of recognizing the character portion as a character and the figure portion as a figure; In the external device, convert the recognized characters to character codes,
There is provided a mobile terminal communication method comprising a conversion step of converting a recognized figure into a figure, and a second transmission step of transmitting character code data and figure conversion data obtained by the conversion step from the external device to the mobile terminal. .

Besides, the present invention is not limited to the embodiments described above and shown in the drawings, and it is needless to say that the present invention can be appropriately modified and implemented within the scope not departing from the gist.

[0122]

According to the above portable terminal communication system,
By converting the character data of a mobile device that can be easily input by handwriting into an easy-to-read text data by recognizing it with an external device, it is possible to build a system that is easier to use and cheaper by making it a small amount of data. it can. Moreover, since the function of the mobile device itself is small, a small device can be configured and is suitable for carrying. Further, the external information device for recognition can be easily upgraded by providing the program as a medium.

Further, according to the above portable terminal communication system, the image data of the portable device, which can be easily input by handwriting, is recognized by the external device and converted into the vector data which is easy to see. By making it small, a system that is easier to use can be constructed at low cost. Alternatively, it can be used as easy-to-see image data even if the data size does not change, by re-converting into bitmap data such as a clean circle or straight line. Moreover, since the function of the mobile device itself is small, a small device can be configured and is suitable for carrying. Further, the external information device for recognition can be easily upgraded by providing the program as a medium.

According to the above portable terminal communication method,
In the mobile device alone, the function of limiting the functions of simultaneously storing handwritten input image data and image data of vector data and displaying the stored data is an inexpensive and fast responsive terminal. Can be realized.

In the original bitmap data, since characters and figures are written at free positions on the screen, it is difficult to recognize the characters and figures as they are. In addition, if objects other than characters are drawn on the same screen, they may be erroneously recognized as characters, or figures may not be recognized as figures. The range specification is effective in limiting the part where the characters are written and improving the recognition accuracy.

Further, by forming a system with an external information device having character recognition and image recognition functions, when character or image recognition is performed on data input from a portable device,
It is possible to perform more reliable character recognition and image recognition by recognizing the character part and the image part by specifying the range respectively. Further, the external information device for recognition can be easily upgraded by providing the program as a medium.

Therefore, as a total system, it is possible to realize a system which is inexpensive at the whole and reliable in conversion as compared with the case where a device in which a function such as character recognition is incorporated in the portable device itself is configured.

[Brief description of drawings]

FIG. 1 is a system block diagram showing a configuration of a mobile terminal communication system according to an embodiment of the present invention.

FIG. 2 is a drawing showing an example of creating vector data used in an embodiment of the present invention.

FIG. 3 is a diagram showing an example of creating bitmap data used in an embodiment of the present invention.

FIG. 4 is a diagram showing a form example of stored bitmap data.

FIG. 5 is a diagram showing an example of character recognition data memory storage according to an embodiment of the present invention.

FIG. 6 is a diagram showing a character recognition procedure, parameters, and a redisplay configuration according to the embodiment of the present invention.

FIG. 7 is a diagram showing a graphic recognition procedure, parameters, and a redisplay configuration according to an embodiment of the present invention.

FIG. 8 is a diagram showing configuration parameters of an ellipse.

FIG. 9 is a diagram showing a redisplay procedure when storing parameter-converted graphic data.

FIG. 10 is a diagram showing XY components of a tilt vector.

FIG. 11 is a diagram showing a procedure for redisplaying graphic bitmap data that has undergone graphic conversion.

FIG. 12 is a diagram showing a character recognition step operation according to the embodiment of the present invention.

FIG. 13 is a diagram showing a procedure example of character recognition by range designation according to an embodiment of the present invention.

FIG. 14 is a diagram showing a graphic recognition step operation according to the embodiment of the present invention.

FIG. 15 is a diagram showing an example of a procedure of figure recognition by specifying a range according to an embodiment of the present invention.

FIG. 16 is a diagram showing an example of a procedure of creating / saving / deleting a folder according to an embodiment of the present invention. (A) is an example in which the compactness of the file size is prioritized (when saving the parameter format of the figure recognition data) (B) is an example in which the drawing speed is prioritized (in the case of the bitmap format of the figure recognition data)

FIG. 17 is a diagram showing an example of a recognition procedure when a character and a figure are mixed according to an embodiment of the present invention.

FIG. 18 is a diagram showing a mixture of character / graphic data (in the case of a parameter format) according to an embodiment of the present invention.

FIG. 19 is a diagram showing a mixture of character / graphic data (in the case of a bitmap format) according to an embodiment of the present invention.

FIG. 20 is a view showing reference patterns of Table 2.

FIG. 21 is a view showing a single character recognition by a conventional mobile terminal device.

[Explanation of symbols]

1 Display device 2 input devices 3 Communications department 4 CPU 5 RAM 6 ROM 7 Interface (I / F) 8 drivers 9 External information equipment 10 Connection means 11 Portable information devices

Continuation of front page (56) Reference JP-A-8-297713 (JP, A) JP-A-6-245006 (JP, A) JP-A-6-236457 (JP, A) JP-A-10-293803 (JP , A) JP-A 9-171528 (JP, A) JP-A 8-339423 (JP, A) JP-A 6-236389 (JP, A) JP-A 61-234147 (JP, A) 61-89998 (JP, U) (58) Fields investigated (Int.Cl. ⁷ , DB name) G06K 9/00-9/82 H04Q 7/38

Claims (9)

(57) [Claims] 1. A input means characters or graphics, etc. to handwriting input, a first display means for displaying the handwritten input character or graphics, etc. in the input unit, the handwritten data input by said input means The capturing means that captures the data and the external device can communicate with each other , and the capturing means can capture the data.
A first for transmitting the handwritten data loaded into the external device
The portable terminal device and a communication means, and said first communication means and mutually communicable second communication means, the handwritten data received by the second communication means of the portable terminal device and character recognition means for recognizing <br/> letters, the handwritten data received by said second communication means
Construction from an external device and a pattern recognizing means for figure recognition
And the external device includes the character recognition unit and / or the character recognition unit.
The data recognized by the figure recognition means is used as the second communication hand.
According to a step, to the first communication means of the mobile terminal device
And the mobile terminal device received by the first communication means.
Data is displayed on the first display means.
Mobile terminal communication system that. 2. An input means for inputting a character or a figure, and the input means, which are integrated with each other,
First display means for displaying the input character or graphics, etc. Te, a capturing means to capture both the vector data and image data corresponding to the character data inputted by said input means, an external device and intercommunication It is possible,
In front of the vector data and image data loaded
Portable terminal apparatus having a first communication means for transmitting to the Kigaibu device, and the portable terminal and the first communication means and mutually communicable second communication means of the device, said second communication means Vector data received at
And is constructed from an external device that includes a character recognition means for character recognizing the image data, the external device has been character recognition by said character recognition means
Data is transferred to the mobile terminal device by the second communication means.
To the first communication means, and the mobile terminal device receives the first communication means.
Display the character-recognized data on the first display means.
A mobile terminal communication system characterized by: 3. Input means for inputting characters or figures
And display the characters or figures entered by the input means
And a vector corresponding to the graphic data input by the input means.
Importer that imports both toll data and image data
And the external device can communicate with each other.
In front of the vector data and image data loaded
A portable terminal having a first communication means for transmitting to an external device
End device, and mutual communication with the first communication means of the mobile terminal device
Second communication means and the vector data received by the second communication means
And a figure recognition means for recognizing the image data
And the external device is recognized by the graphic recognition means.
Data is transferred to the mobile terminal device by the second communication means.
To the first communication means, and the mobile terminal device receives the first communication means.
Display the figure-recognized data on the first display means
A mobile terminal communication system characterized by: 4. The external device further receives the image data received by the second communication means.
And second display means for displaying, the image data displayed on the second display means
Specify the character and / or region that recognizes the figure was from in
Area specifying means, the character recognition means and / or the graphic recognition means,
Characters in the area designated by the area designating means and
5. The method according to claim 1, further comprising recognizing a graphic.
4. The mobile terminal communication system according to any one of 3 above . 5. The input means and the first of the portable terminal device
The display means of No. 1 is integrally configured.
The mobile terminal communication according to claim 1, 3, or 4.
Belief system. 6. Data transmission / reception between a mobile terminal and an external device
A method for communicating with a portable terminal, comprising vector data and an image input to the portable terminal.
First transmission step of transmitting data to the external device
And the vector data transmitted by the external device and
A recognition step of recognizing the image data as a character and a character code data of the character recognized in the recognition step.
And a conversion step for converting the character code data converted in the conversion step
The second transmission step of transmitting to the mobile terminal, the character code data transmitted by the mobile terminal
Displaying the corresponding characters.
Mobile terminal communication method. 7. Data transmission / reception between a mobile terminal and an external device
A method for communicating with a portable terminal, comprising vector data and an image input to the portable terminal.
First transmission step of transmitting data to the external device
And the vector data transmitted by the external device and
A recognition step of recognizing the image data as a figure, and the figure recognized in the recognition step as figure code data.
And a conversion step for converting the graphic code data converted in the conversion step
The second transmitting step of transmitting to the mobile terminal, and the graphic code data transmitted by the mobile terminal.
And a step of displaying a corresponding figure.
Mobile terminal communication method. 8. A portable terminal and a computer as the external device.
Computer to execute the mobile terminal communication method according to claim 6 or 7.
A mobile terminal communication program characterized by being recorded
Medium. 9. The portable terminal device is a personal computer.
Edge of computer, word processor, pocket computer, etc.
6. An end device as claimed in any one of claims 1 to 5, characterized in that
The mobile terminal communication system according to item 1.