KR20120044963A - Apparatus and method for playing handwriting message using handwriting data - Google Patents

Abstract

PURPOSE: A writing message reproduction apparatus and method thereof are provided to successively reproduce a writing message by using writing data. CONSTITUTION: A transmission side user writes a writing message by using a portable terminal(401). An event processing unit creates writing data including time information and location information(405). A first image processing unit encodes a writing image including the writing data(407). The encoded writing image is transmitted to an MMS(Multimedia Message Service) transmission unit. The MMS transmission unit transmits the writing image to a reception side portable terminal(409).

Description

Apparatus and method for reproducing handwritten messages using handwritten data {APPARATUS AND METHOD FOR PLAYING HANDWRITING MESSAGE USING HANDWRITING DATA}

The present invention relates to playback of a handwritten message, and more particularly, to an apparatus and a method for sequential playback of a handwritten message using handwritten data including location information and time information of the handwritten message.

As various technologies such as wired or wireless communication technology, multimedia technology, hardware manufacturing technology such as a central processing unit and memory, and power charging technology are developed, the functions of the mobile terminal are further strengthened. For example, the existing mobile terminal delivers the contents to be communicated to the other party using a voice call, but after the transmission and reception of the text message becomes possible, if the voice call is not possible or the simple contents need to be delivered, it includes the simple text contents. Using Short Message Service (SMS), it is possible to simply deliver the contents to be communicated to the other party.

Such a short message service has been developed from SMS to a long message service (LMS) including a text of long text, and to a multimedia message service (MMS) including multimedia files such as images and videos. Advances have made it possible to offer users more diverse benefits. In particular, unlike SMS or LMS, which transmits only text contents, in case of MMS, which transmits multimedia files, user demand is gradually increasing due to the extensibility of the expression. Referring to the method of transmitting the desired content using the MMS as follows.

1 is an exemplary diagram illustrating information transmission using a conventional MMS.

Referring to FIG. 1, an MMS may be created by inputting a desired character or attaching a desired image to the handwriting recognition area. In the MMS input screen shown in FIG. 1, the handwriting recognition area includes three single recognition areas for recognizing one character at a time, and character information desired by a user is input by an input tool such as a finger or a stylus pen. You can also import images stored in memory by using the file attachment field located below the text input window and send the images.

However, currently used MMS performs transmission including only pre-stored images. If the sending side wants to send the handwritten contents by using MMS, it should be saved after changing the handwritten contents into an image file using a separate program. In addition, since it is changed into a single still image image when changing to an image file, sequential time information written by the user is not included.

In other words, when the receiving side receives the image included in the MMS, only one still image is shown, and the handwriting or emotion of the transmitting side cannot be transmitted as it cannot be reproduced sequentially. There is a problem that the vitality disappears.

The present invention has been devised for the above problem, and proposes an apparatus and method for sequentially reproducing a handwritten message to a receiver by using handwritten data including location information and time information of the handwritten message.

According to an aspect of the present invention, in a method of reproducing a handwritten message using handwritten data, the handwritten message is input, and a still image is generated using the handwritten data including the location information and time information of the handwritten message and the location information. And encoding and transmitting a handwriting image including the handwriting data to the still image, receiving and decoding the handwriting image, and extracting the handwriting data included in the decoded handwriting image. And sequentially reproducing the contents of the handwritten message according to the order in which the contents of the handwritten message are input by using the extracted handwritten data.

According to another aspect of the present invention, in a handwritten message reproduction apparatus using handwritten data, an input / output unit for inputting a handwritten message by a user and outputting a received handwritten image, and analyzing the handwritten message to locate the handwritten message Generates a still image using the handwriting data including the information and time information and the position information, encodes the image into a single handwriting image, transmits the decoded image, and decodes the received handwriting image to be included in the received handwriting image. And a wireless communication unit configured to extract positional information and time information of the handwritten data, and sequentially reproduce contents of the handwritten message, and to transmit and receive the handwritten image.

According to the present invention, since the handwritten message is sequentially reproduced using handwritten data including time information and location information of one or more points constituting the handwritten message, there is an effect that the handwritten message containing the sender's emotion can be expressed.

1 is an exemplary diagram illustrating information transmission using a conventional MMS;
2 is a diagram illustrating a handwriting message generation process according to an embodiment of the present invention;
3 is an internal configuration diagram of a mobile terminal for transmitting and receiving a handwritten image according to an embodiment of the present invention;
4 is a flowchart illustrating a process of generating a handwriting image including handwriting data according to an embodiment of the present invention;
5 is a flowchart illustrating a handwritten image playback process including handwritten data according to an embodiment of the present invention;
6-8 illustrate fields for storing handwritten data according to an embodiment of the present invention;
9 is a block diagram illustrating an internal structure of point sequence data according to an embodiment of the present invention;
10 is an exemplary view illustrating a process of sequentially playing a handwritten message by handwriting data according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, specific details such as specific components are shown, which are provided to help a more general understanding of the present invention, and the specific details may be changed or changed within the scope of the present invention. It is self-evident to those of ordinary knowledge in Esau.

2 is an exemplary diagram illustrating a process of generating a handwritten message according to an embodiment of the present invention.

Referring to FIG. 2, a transmitting user creates a writing message by using an input device such as a finger or a stylus pen using a mobile terminal. The mobile terminal generates handwriting data including location information and time information of one or more points constituting the handwriting message using the handwriting message thus created, and generates a still image using the location information of the handwriting data.

The still image is composed of a plurality of fields, and pixel values when the handwritten message is imaged in any one of the plurality of fields are stored. These pixel values are defined as still image data, and the still image data does not include time information or position information of one or more points constituting the handwritten message. The handwritten data is then included in one of the plurality of fields constituting the still image and compressed.

According to the present invention, an image in which handwriting data is stored in a specific field of a still image including still image data is defined as a handwriting image, and the handwriting image is in a format such as JPEG (Joint Photographic coding Experts Group), GIF (Graphic Interchange Format), or the like. The compressed and compressed handwritten image is transmitted to the receiving side.

Looking at the internal configuration of the mobile terminal performing the Figure 2 as follows.

3 is an internal configuration diagram of a mobile terminal for transmitting and receiving a handwritten image according to an embodiment of the present invention. The mobile terminal includes an input / output unit 31, a control unit 33, and a wireless communication unit 35 to transmit and receive a handwritten image. The input / output unit 31 includes a touch screen input unit 301 and a touch screen output unit 303, and the controller 33 includes an event processor 305, a first image processor 307, and a second image processor 313. And an attached image processor 315 and a handwritten message processor 317, and the wireless communication unit 35 includes an MMS transmitter 309 and an MMS receiver 311.

Referring to FIG. 3, the input / output unit 31 receives a writing message input by a user, and plays a role of reproducing the writing image received from the controller 33. The touch screen input unit 301 is responsible for receiving the handwritten message by the user, and the touch screen output unit 303 is responsible for playing the handwritten message. The input / output unit 31 transmits an input writing message to the control unit 33.

The controller 33 interprets the handwritten message received from the input / output unit 31 to generate handwritten data including position information and time information, and generates a still image using the position information of the generated handwritten data. . The still image is composed of a plurality of fields, and one of the still images stores still image data composed of pixel values when the handwritten message is imaged. Since the pixel values constituting the still image data are for expressing the handwriting message as it is, position information and time information of one or more points constituting the handwriting message are not included.

In addition, the controller 33 encodes the writing data in a specific field of the still image and transmits the writing data to the wireless communication unit 35, and detects the writing data included in the writing image received from the wireless communication unit 35. It serves to transmit to the input / output unit 31.

In more detail, the event processor 305 of the controller 33 interprets the handwritten message received from the input / output unit 31 to generate handwritten data including position information and time information of one or more points constituting the handwritten message. And generates a still image using the location information. The still image is composed of a plurality of fields, and still image data, which is pixel values obtained by imaging a handwritten message, is stored in any one of the plurality of fields. The still image data does not include position information and time information of one or more points constituting the handwritten message. The event processor 305 transmits the handwritten image including the handwritten data to a specific field of the still image to the first image processor 307.

The handwriting data is stored in any one field except the field in which the still image data is stored. In addition, if a writing message is written with a specific image as a background, pixel values of the specific image including the writing message are stored in the still image data.

The first image processor 307 encodes the handwriting message in order to transmit the handwriting image.

The second image processor 313 decodes an image received from the wireless communication unit 35. If the decoding is performed and interpreted, but the handwriting data is not included in the image, it is determined as a general attached image that does not include the handwriting message and transmitted to the attached image processor 315. If the handwriting data is included, it is determined as a handwriting image and transmitted to the handwriting message processing unit 317.

The attached image processing unit 315 transmits the image to the touch screen output unit 303 so that the image including the writing data is received on the screen. The handwriting message processing unit 317 processes the handwriting message to be sequentially reproduced using time information and location information using handwriting data included in the handwriting image, and transmits the handwriting message to the touch screen output unit 303.

The wireless communication unit 35 plays a role of transmitting and receiving various images including a handwritten image, and an MMS transmitter 309 is responsible for transmitting an image, and an MMS receiver 311 is responsible for receiving an image.

4 is a flowchart illustrating a process of generating a handwriting image including handwriting data according to an embodiment of the present invention.

Referring to FIG. 4, in step 401, a user of a sending side creates a handwritten message using a mobile terminal. The handwriting message is input through the touch screen input unit 301, and may use an input tool such as a finger or a stylus pen. In addition, the user of the transmitting side may write in the empty space when writing the handwriting message, or may write the handwriting message with a specific image as a background.

In step 403, the touch screen input unit 301 transmits the input handwritten message to the event processor 305, and the event processor 305 analyzes the received handwritten message to extract location information of the handwritten message. In operation 405, the event processor 305 extracts time information from the received handwriting message and generates handwriting data including the extracted location information and time information. The generated handwriting data includes location information and time information of one or more points constituting the handwriting message.

In operation 407, the event processor 305 generates a still image using the location information, and transmits a handwritten image including handwritten data to a specific field of the still image to the first image processor 307. The first image processor 307 encodes this. The handwriting data is stored in any one field except for the field in which the still image data is stored, and the corresponding field may be an image header field, or a separate field may be generated after one or more fields constituting the still image to include the handwriting data. You may. The encoded handwriting image is transmitted to the MMS transmitter 309 in step 409, and is transmitted to the receiving mobile terminal.

5 is a flowchart illustrating a handwritten image reproduction process including handwritten data according to an embodiment of the present invention.

Referring to FIG. 5, in step 501, the mobile terminal receives an image from the transmitting mobile terminal using the MMS receiver 311. The MMS receiver 311 transmits the received image to the second image processor 313. In operation 503, the second image processor 313 decodes the received image to determine whether handwritten data is included. The handwriting data is stored in any one of a plurality of fields constituting the image.

If the general attached image does not include the handwritten image, the process proceeds to step 509 and the attached image is output through the attached image processor 315 and the touch screen output unit 303 as it is. If the handwriting image includes the handwriting data, the controller proceeds to step 505 and transmits the handwritten image decoded by the second image processor 313 to the handwriting message processor 317. In step 507, the handwriting message processing unit 317 processes the handwriting message to be sequentially played using the time information and location information of the handwriting data included in the received handwriting image, and transmits the handwriting message to the touch screen output unit 303. The screen output unit 303 sequentially reproduces the handwritten message.

As described above, the writing data is included in any one of the plurality of fields constituting the still image. However, if handwriting data is stored in a field storing still image data, the still image data itself may be damaged in the process of being stored, so the handwriting data is stored in a field other than the field in which the still image data is stored. Looking at it in detail as follows.

6-8 illustrate exemplary fields in which handwritten data is stored, according to an exemplary embodiment. FIG. 6 schematically shows an EXIF (Exchangeable Image File Format) information field in which handwriting data is stored, FIG. 7 shows in detail the handwriting data stored in the image header field, and FIG. 8 is in addition to the image header field. The handwriting data stored in other fields is shown in detail. 6-8, it is assumed that one handwritten image is composed of a plurality of fields, and is largely composed of an image start field, an image header field, an image data field, and an image end field.

Referring to FIG. 6, handwritten data is stored in the EXIF information field, and still image data is stored in the image data field. The EXIF information field may be included in the image header field. The EXIF information field is an area that stores various types of information of the corresponding handwritten image and is not displayed on the output screen of the mobile terminal when the handwritten message is actually played. The image data field is a field containing still image data. The image data field includes only pixel values when the handwritten message is imaged, and does not include time information or position information.

The present invention stores and transmits handwriting data in an EXIF information field at a transmitting mobile terminal and checks whether handwriting data is stored in an EXIF information area of a received image when the receiving mobile terminal receives an image. If the writing data is stored, the writing messages may be sequentially played on the output screen. If you look at this in more detail:

Referring to FIG. 7, the image header field includes an application field App1. This application field consists of an application header field, an EXIF information field, a thumbnail image field, etc. The application header field stores the configuration and information of the application field, the thumbnail image field stores a thumbnail image, and the handwriting data in the EXIF information field. Is stored. In more detail, the handwriting data is stored in the user comment area included in the EXIF information field. The handwriting data may be composed of a point sequence symbol, a length of sequence data, point sequence data, and the like. The point sequence symbol is a symbol representing a handwriting image including a specific image and a symbol representing a handwriting image without a specific image. It includes. The point sequence data refers to each handwritten data, and the sequence data length refers to the total length of the handwritten data. In addition, although not shown in the drawings, the expression color and thickness information of the handwritten message may be included, and may be compressed as necessary.

FIG. 8 illustrates writing data stored in fields other than the image header field. Referring to FIG. 8, only a part of the writing data is stored in the image header field, and the rest is generated by storing an additional field after the image ending field. . In the figure, the point sequence symbol and the data length of the sequence are stored in the EXIF information field, and the point sequence data is stored in the space after the image end filter. However, this may vary according to user settings. For example, the image header field may store all the information constituting the handwriting data in the space after the image end filter without storing any information constituting the handwriting data.

6-8 has been described using the JPEG format as an example, but may be converted to another format. For example, you can convert a still image to GIF format and save it in a specific field of the GIF.You can save handwritten data, including time information and location information, in the header of the GIF or after the terminator to convert the handwritten image to GIF format. Can be.

9 is a diagram illustrating the internal structure of point sequence data according to an embodiment of the present invention. The point sequence data shown in FIG. 9 means time information of continuously input point coordinates, and may be largely composed of handwritten data header, decoding information, stroke start, stroke attribute, stroke point, and data end.

Referring to FIG. 9, the handwriting data header records the number of points or marker characters constituting the entire handwriting message and includes the total number of points. The decoding information includes version information and other information. Stroke start, stroke attribute tags, and stroke points can be distinguished by one stroke, and their size can vary depending on the total number of strokes. End of data means the end of the handwritten message. The configuration of FIG. 9 is only an exemplary embodiment and the internal structure of the point sequence data may vary according to the type and size of time information.

Next, a process of playing a handwritten message using handwritten data using the configuration diagram of the mobile terminal will be described.

10 is an exemplary diagram illustrating a process of sequentially playing handwritten messages by handwritten data according to an embodiment of the present invention.

Referring to FIG. 10, the second image processor 313 of the controller 33 determines whether the received image includes handwriting data, and if the handwriting data is included, time information and location information included in the handwriting data are included. The handwritten messages are sequentially reproduced on the touch screen output unit 303 using the handwritten messages. For example, when a handwritten message “Let's be a toucher!” Is received, the touch screen output unit 303 may use one or more time information and location information generated according to the coordinate values of each point constituting the handwritten message. Are played sequentially. Handwriting data is stored in specific fields of the image and is not displayed on the output screen. However, in the case of a mobile terminal that does not have a function of detecting handwriting data included in the image, the handwriting data cannot be confirmed, and thus the image is displayed on the touch screen output unit 303 as it is.

Meanwhile, in the foregoing description of the present invention, specific embodiments have been described, but various modifications may be made without departing from the scope of the present invention. Accordingly, the scope of the present invention should not be limited by the illustrated embodiments, but should be determined by equivalents of the claims and the claims.

Claims (26)

In a handwritten message playback method using handwritten data,
Receiving a writing message and generating a still image using the writing data including location information and time information of the writing message and the location information;
Encoding and transmitting a handwritten image including the handwritten data to the still image;
Receiving and decoding the handwritten image;
Extracting the handwriting data included in the decoded handwriting image;
And reproducing the contents of the handwritten message sequentially according to the order in which the contents of the handwritten message are input by using the extracted handwriting data. The method of claim 1, wherein the still image is
And a still image data which is pixel values when the handwritten message is imaged as a still image in one of the plurality of fields. The method of claim 2, wherein the still image is stored in a joint photographic coding experts group (JPEG) format. 4. The method of claim 3, wherein an EXIF field is used as an information field for storing a header of the handwritten data. The method of claim 3, wherein the entire information of the writing data is stored after an end of image (EOI) of the JPEG file. The method of claim 2, wherein the still image is stored in a graphic interchange format (GIF). The method of claim 6, wherein the entire information of the writing data is stored after the terminator of the GIF file. The method of claim 2, wherein the writing data is
And storing the still image data in any one of the plurality of fields except for a field in which the still image data is stored. The method of claim 2, wherein the writing data is
And generating and storing a new field in addition to the plurality of fields. The method of claim 1, wherein the location information
And a coordinate value of one or more points constituting the handwritten message. The method of claim 1, wherein the time information is
And at least one dot constituting the handwritten message is generated time information. In the handwritten message playback apparatus using handwritten data,
An input / output unit configured to input a writing message by a user and output a received writing image;
Analyzing the handwriting message, handwriting data including location information and time information of the handwriting message, and generating a still image using the location information are encoded and transmitted into a single handwriting image, and the received handwriting image is transmitted. A control unit which decodes position information and time information of the handwriting data included in the received handwriting image and sequentially reproduces the contents of the handwriting message;
And a wireless communication unit configured to transmit and receive the handwritten image. The method of claim 12, wherein the input and output unit
A touch screen input unit which transmits the handwritten message to the controller;
And a touch screen output unit which sequentially reproduces the contents of the handwritten message. 15. The apparatus of claim 13, wherein the still image is stored in a joint photographic coding experts group (JPEG) format. 15. The apparatus of claim 14, wherein an exchangeable image file format (EXIF) field is used as an information field for storing the header of the handwriting data. 15. The apparatus of claim 14, wherein the entire information of the writing data is stored after an end of image (EOI) of the JPEG file. 15. The apparatus of claim 13, wherein the still image is stored in a GIF (Graphic Interchange format) format. 18. The apparatus of claim 17, wherein the entire information of the writing data is stored after the terminator of the GIF file. The method of claim 12, wherein the control unit
The writing message is analyzed to generate the writing data including location information and time information of the writing message, the still image is generated using the location information, and the writing data is stored in a specific field of the still image. An event processor for transmitting a handwritten image,
A first image processor which encodes the handwritten image received from the event processor;
A second image processor which decodes the received handwritten image;
And a handwriting message processing unit which sequentially reproduces the handwriting message using the position information and the time information received from the second image processing unit. 20. The display device of claim 19, wherein the second image processor
And when the image including the time information is received, the image is transmitted without extracting additional information. The method of claim 20,
And an attached image processing unit which receives the image not including the writing message from the second image processing unit and transmits the image to the input / output unit as it is. The method of claim 19, wherein the control unit
And determining whether a specific image is written in the background when the writing message is written, and if the specific image is created in the background, generating the specific image including the writing message as a still image. The method of claim 12, wherein the still image is
And a still image data, which are pixel values when the handwritten message is imaged as a still image, in one of the plurality of fields. The method of claim 23, wherein the still image is
And the still image data is stored in any one of the plurality of fields except the field in which the still image data is stored. The method of claim 23, wherein the writing data is
And a new field is generated and stored in addition to the plurality of fields. The method of claim 12, wherein the wireless communication unit
An MMS transmitter for transmitting the handwritten image to another mobile terminal;
And an MMS receiver configured to receive the handwritten image from another mobile terminal.

Images