WO2011003262A1

WO2011003262A1 - Mobile terminal and method thereof for implementing image and text editing function

Info

Publication number: WO2011003262A1
Application number: PCT/CN2009/075855
Authority: WO
Inventors: 杨蒙
Original assignee: 中兴通讯股份有限公司
Priority date: 2009-07-10
Filing date: 2009-12-22
Publication date: 2011-01-13
Also published as: CN101605176A

Abstract

A mobile terminal and a method thereof for implementing image and text editing function are disclosed by the present invention. The method comprises the following steps: when an image and text editing function is enabled, the mobile terminal records strokes inputted by a user; according to key geometrical feature points of the inputted strokes, the mobile terminal searches editing operation commands set for an editing operation command corresponding to the inputted strokes; the mobile terminal processes the text or image enclosed by the inputted strokes according to the editing operation command, and feeds the processing result back to the user. The technical solutions of the present invention adds handwriting editing, symbols and identifiers which is accustomedly used by human to the mobile terminal according to the simple geometrical relation, enables user to express intentions naturally, avoids complex operations for seeking menu items, simplifies user operations, and raises user experience of software.

Description

Mobile terminal and method for realizing graphic editing function thereof

The present invention relates to the field of mobile communication terminals, and in particular, to a mobile terminal and a method for implementing the image editing function. Background technique

At present, the use of mobile terminals is increasing, and there are many applications running on mobile terminals. As mobile terminals become more powerful, they already have the computational power of many software and are very convenient. The operation results of the software on the touch screen mobile terminal are all obtained by the menu command. As the function of the mobile terminal increases, the menu items are more and more, and the menu depth is deeper and deeper, so that the user operates the touch screen on the mobile terminal. The text and graphics first focus on the object to be manipulated, then look for the corresponding menu options, and finally operate the menu items to achieve the corresponding operation. This process is inconsistent with the habits of humans using hands to directly manipulate objects for thousands of years, especially for the input of text and graphics, which has been using paper and pen in life.

But there are disadvantages to using this pen on paper:

1. The modification of the text and graphics is erased with an eraser and then rewritten to achieve the purpose of modification, and the operation steps are more complicated.

2. Sometimes people will use some familiar operations or actions to keep the traces of the changes directly on the paper. For example, when you need to remove a text, you can directly modify the text on the text to modify the text, but at the same time modify it. The traces and results are kept on paper, which seems to be messy and cannot directly feedback the modified results. Summary of the invention

In view of this, the main object of the present invention is to provide a mobile terminal and an implementation picture thereof. The function method enables the user to edit the graphic according to the habit of hand operation on the touch screen mobile terminal, and the editing process is completed.

In order to solve the above technical problem, the technical solution of the present invention is implemented as follows:

The present invention provides a method for implementing a graphic editing function, the method comprising:

When the graphic editing function is enabled, the input stroke input by the user is recorded;

And searching for an editing operation command corresponding to the input stroke from the editing operation command set according to the key geometric feature point of the input stroke;

The text or graphic of the input stroke closure is processed according to the editing operation command, and the processing result is fed back to the user.

The editing operation command collectively stores a correspondence between a stroke and an editing operation command; the editing operation command is divided into a text editing operation command and a picture editing operation command; and the text editing operation command includes at least deleting, adding, moving, and Inverting command; the picture editing operation command includes at least a delete, add, move, invert, and zoom command. The method further includes: classifying all editing operation commands in the editing operation command set according to the number of strokes of the stroke to obtain a subset of the editing operation commands.

The process of searching for an edit operation command corresponding to the input stroke from the edit operation command set includes:

Calculating the number of strokes of the input stroke;

Finding a corresponding subset of the editing operation command from the edit operation command set according to the number of strokes of the input stroke;

The key geometric feature points of the input stroke are matched with the key geometric feature points of the stroke corresponding to the editing operation command subset edit operation command, and the editing operation command corresponding to the input stroke is found.

After the editing operation command is found, the method further includes: confirming to the user whether to execute the editing operation command, and if yes, performing the text or graphic of the input stroke closing package Processing, otherwise, waiting for the user to re-enter the input stroke.

After processing the text or graphics of the input stroke closure, the method further includes: releasing key geometric feature points of the input stroke and refreshing the display interface of the mobile terminal.

The present invention also provides a mobile terminal for implementing a graphic editing function, comprising an input module, an editing operation command identification module, a storage module and a processing module, wherein:

The input module is configured to: when the text editing function is enabled, record an input stroke input by the user, and provide the input stroke to the editing operation command identification module;

The editing operation command identifying module is configured to search for an editing operation command corresponding to the input stroke from the editing operation command set according to the key geometric feature point of the input stroke, and provide the editing operation command to the processing module;

The storage module is configured to store the edit operation command set;

The processing module is configured to process the text or graphics of the input stroke closure according to the editing operation command, and feed back the processing result to the user.

The editing operation command set stored in the storage module is a correspondence between the editing operation command and the stroke; the editing operation command is divided into a text editing operation command and a picture editing operation command, wherein the text editing operation command includes at least Delete, add, move, and invert commands; the picture editing operation commands include at least delete, add, move, invert, and zoom commands.

The storage module is further configured to classify all the editing operation commands in the editing operation command set according to the number of strokes of the stroke to obtain a subset of the editing operation commands. .

The editing operation command identification module is further configured to calculate a number of strokes of the input stroke, and find a corresponding subset of the editing operation command from the editing operation command set according to the number of strokes; and key geometry of the input stroke The feature point is matched with a key geometric feature point of the stroke corresponding to the edit operation command subset edit operation command, and an edit operation command corresponding to the input stroke is found.

The processing module searches for an edit corresponding to the input stroke in the edit operation command recognition module After the operation command is used, it is also used to confirm to the user whether to execute the edit operation command, and if so, to process the text or graphics of the input stroke closure, otherwise, wait for the user to perform the operation of inputting the stroke again.

The processing module is further configured to release the feature points of the input stroke after processing the text or graphics of the input stroke closure, and refresh the display interface.

Compared with the prior art, the technical solution of the present invention introduces the editing mode in the writing of the human pen and paper into the mobile terminal, so that the user performs a corresponding editing operation on the independent object such as text or graphics on the mobile terminal by using the stylus pen or the finger. The cumbersome steps of the user looking for menu items on the mobile terminal are avoided, providing a better user experience. DRAWINGS

1 is a schematic structural diagram of a mobile terminal according to the present invention;

2 is a schematic flow chart of a detailed method of the present invention. detailed description

The technical solutions of the present invention are further described in detail below with reference to the accompanying drawings and specific embodiments. The mobile terminal having the graphic editing function, in particular, the touch screen mobile terminal, as shown in FIG. 1, includes an input module 10, an editing operation command identification module 20, a storage module 30, and a processing module 40, wherein:

The input module 10 is configured to record a stroke input by a user through a stylus or a finger (hereinafter referred to as an input stroke) when the graphic editing function is enabled, in particular, record a key geometric feature point of the input stroke, and send it to the editing operation command to identify Module 20; the key geometric feature points of the input stroke, such as the starting point, the inflection point and the ending point of the stroke, and the combination of the key geometric feature points of the input stroke, indicating the input stroke;

The editing operation command identification module 20 is configured to receive key geometric feature points of the input stroke, and identify and input the input stroke from the storage module 30 according to the key geometric feature points of the input stroke data. Corresponding editing operation command, and sending the editing operation command and the key geometric feature points of the input stroke to the processing module 40;

The storage module 30 is configured to store a correspondence between a stroke and an editing operation command (which may be referred to as an editing operation command set), wherein the stroke is composed of key geometric feature points; the key geometric feature points of the input stroke and the editing operation command are concentrated The key geometric feature points are matched, and the corresponding editing operation command can be obtained;

The processing module 40 is configured to process the text or graphics of the input stroke closure according to the editing operation command, and feed back the processing result to the user. The text or graphic of the input stroke closure is the text or graphic to be processed, wherein there is a certain relationship between the closure area of the text or the graphic and the closure area of the input stroke, which will be explained by the following embodiments. .

After the editing operation command recognition module 20 recognizes the editing operation command, the processing module 40 may further confirm to the user whether to execute the editing operation command, and if so, process the text or graphics of the input stroke closing package, otherwise, wait The user re-enters the input stroke.

Further, the editing operation command stored in the storage module 30 may be further divided into a text editing operation command and a picture editing operation command; wherein the text editing operation command further includes commands such as deleting, adding, moving, and inverting, and the image editing operation command Further include commands such as delete, add, move, invert, and scale.

In order to improve the accuracy of the editing operation command corresponding to the recognition input stroke, the storage module 30 may further classify the editing operation command corresponding to the key geometric feature point of the stroke according to the number of strokes of the stroke in the editing operation command set, so that the editing operation command identifies After receiving the key geometric feature points of the input stroke, the module 20 is further configured to calculate the number of strokes of the input stroke, and find all the editing operation commands corresponding to the number of the strokes from the storage module 30 according to the number of strokes, and then input the strokes. The key geometric feature points are matched with the key geometric feature points of the strokes in the edit operation command set, thereby identifying corresponding editing operation commands.

The process of implementing the graphic editing function of the mobile terminal is specifically described below, as shown in FIG. 2, including The following steps:

Step 201: The mobile terminal enables the graphic editing function to record key geometric feature points of the input stroke.

When the mobile terminal enables the text editing function according to the user operation, the input stroke of the user is recorded. In this step, when the user can press the display screen of the mobile terminal to reach a certain threshold by using the stylus or the finger, the mobile terminal thinks that the user wants to edit the text or the graphic, and immediately enables the graphic editing function; or the mobile terminal provides There is a graphic editing function option. When the user selects the graphic editing function option, the mobile terminal immediately enables the graphic editing function, and the user can input the stroke through the editing interface provided by the mobile terminal.

When recording the user's input stroke, the mobile terminal can use a timer to record the key geometric feature points of each stroke (the storage form is InputPointlnfo) when the pen is dropped and the pen is lifted during the user input, specifically The timer initial value of the timer may be a default value of the mobile terminal (ie, the default value is confirmed by a test result of a normal user of a certain duration), or may be a preset value selected by the user.

Specifically, the storage form of a single key geometric feature point is as follows:

Struct InputPointInfo

Point < Int positionx, Int positiony >; 坐标Coordinate position of key geometric feature points Int PointColor //Identifies the pixel color of the pixel. The pixel of the operation command and input stroke is unique on the terminal.

Int strokeld; //Identifies the stroke of the key geometric feature point. Specifically, the storage form of a single input stroke is as follows:

Struct Strokelnfo

Int strokeld; / / identify the id of each stroke InputPointlnfo *inputPontinfo; 〃 Store the linked list of multiple key geometric feature points contained in the input stroke

In OperatorCommandld; Strokelnfo of input strokes constitutes Strokelnfo linked list.

Step 202: The mobile terminal calculates the number of input strokes.

According to the storage form of the input stroke provided in step 201, when the user inputs a stroke, the storage form of Strokelnfo is used, that is, one input stroke corresponds to one StrokeInfo. Therefore, the number of input strokes can be determined based on the number of StrokeInfos on the Strokelnfo list.

Step 203: The mobile terminal identifies the subset of the editing operation command according to the number of input strokes.

According to the number of input strokes, the corresponding editing operation command classification is recognized from the editing operation command set, for example, the number of strokes is 1 corresponding to a type of editing operation command, and each editing operation command in the editing operation command includes only one stroke. For example, when the number of input strokes is 2, a corresponding type of editing operation command can be identified, and each editing operation command in the type of editing operation command includes two strokes. A type of editing operation command can be called an editing operation command. The storage form of an editing operation command is as follows:

Int OperatorCommandld; / / identify the id of the edit operation command

Int OperatorCommandStrokeNumber; 〃 identifies the number of strokes corresponding to the edit operation command

Strokelnfo *Strokeinfo; / / store the information of each stroke included in the edit operation command, that is, Strokelnfo corresponding to each stroke According to OperatorCommandStrokeNumber, the edit operation command can be classified according to the number of strokes it contains.

Step 204: The mobile terminal identifies an edit operation command according to a key geometric feature point of the input stroke.

The mobile terminal identifies the corresponding editing operation command from the editing operation command classification identified in step 203 according to the key geometric feature point of the input stroke recorded in step 201, that is, the key geometric feature point of the stroke is input, and the editing operation is performed. Match the key geometric feature points of the strokes corresponding to all edit operation commands in the command.

Specifically, a type of editing operation command, that is, a subset of the editing operation command, is stored as follows:

Int OperaotCommandFlag; //If using 0: delete, 1 : move, 2: invert, 3: insert, 4: modify; can also be increased later with the increase of editing operation commands

OperatorCommandlnfo * OperatorCommandInfo; II stores the information of all editing operation commands, that is, the OperatorCommandInfo of each editing operation command, the input of the key geometric feature points and the matching of the key geometric feature points corresponding to the editing operation command, which can be input in the prior art. The matching method between the stroke and the stroke stored in the terminal is performed, and details are not described herein again.

It should be noted that after the editing operation command is recognized, the mobile terminal may further confirm to the user whether to execute the editing operation command, and if yes, process the text or graphics of the input stroke closing package, otherwise, wait for the user to re-execute Perform the operation of entering a stroke.

Step 205: The mobile terminal processes the edit operation object according to the recognized edit operation command.

In this step, the mobile terminal performs result feedback processing according to the geometric relationship between the edit operation command corresponding to the input stroke and the closure of the operated text or graphic. Editing the closure area of the operation command, that is, the graphic or text within the closure area is the processing object of the operation command. If there is a pixel inside the closed area of the input editing operation command, corresponding feedback is performed according to the relationship between the text (graphic) of the pixel in the closure area and the inflection point of the key geometric feature point of the input editing operation command. Processing, that is, processing of the input editing operation command for the character (graphic) to which the pixel belongs; if there is no pixel inside the closed area of the input editing operation command, but the closed area exists within a certain range of pixels Point, then corresponding feedback processing is performed according to the adjacent pixel points.

In this step, there is a case where the user input is inaccurate, that is, the editing operation command closure area and the text to be processed, the graphic closure area are not completely standard inclusion relationships or adjacent relations, and the processing method of the present invention is: when the editing operation command is closed When the ratio of the area of the package to the area of the closure and the area of the closure of the closure is between 3/2 and 2/1, it is considered to be the inclusion relationship; when the editing operation command is closed, the area of the closure and the area of the closure of the graphic is ' j, considered to be an adjacent relationship at 3/2.

Step 206: The mobile terminal feeds back the processed result to the user, and releases the key geometric feature point of the input stroke.

While the processing result is fed back to the user, the mobile terminal releases the recorded key geometric feature points of the current input stroke and refreshes the editing interface, that is, does not leave any operation trace on the editing interface. The process of refreshing the editing interface is actually the process of destroying the operation command variable OperatorCommandInfo.

It should be noted that, when the editing operation command is recognized, the operation of step 203 may not be performed, and the corresponding editing operation command is directly recognized in the editing operation command set according to the key geometric feature points of the input stroke. The above storage operation command subset is also stored in the edit operation command set.

The following describes the specific implementation of the above graphic editing function in combination with several specific applications: Application 1: Delete the processed object.

Can be set: The geometric features of the delete operation command are divided into two cases: a way of drawing a fork, That is, the two strokes are drawn as a straight line and intersect at a point, such as ACD. At the same time, there are pixels of text or graphics in the range of the stroke closure, indicating that the character "B" is to be deleted; and another way of drawing irregular lines, such as ≠*CD, When there is a pixel of text or graphic in the range of the stroke closure, it means that the character "AB" is to be deleted.

In this step, the mobile terminal performs a delete operation according to the number of the edit operation command corresponding to the input stroke. Specifically, the mobile terminal calculates the input stroke, that is, the edit operation command, by using the boundary point of the input stroke and the key geometric feature point. Closing area; then determining the pixel of the text or graphic in the closure area, deleting the text or graphic in the closing area, and refreshing the editing interface after deleting, and feeding back the deleted state to the user, wherein The input stroke closure area can be calculated according to the prior art; specifically, the deletion process of the text or graphics in the closure area is actually when the editing operation command closure area and the closure area of the text or graphics in the closure area are When a relationship or a neighbor relationship is included, the text or figure corresponding to the pixel within the closure range is released.

Application 2: Add an operation. Can be set: The geometric feature of the add operation is that the two strokes are straight lines and intersect at one point. At the same time, when the two stroke operation commands are displayed on the interface, there is no text or graphics in the closure range.

V

The pixels, such as ^ P ^CD , indicate that you need to add between the words "AB" and add a force between the words "CD". The mobile terminal performs an adding operation according to the editing operation command corresponding to the input stroke. Specifically, first, the relationship between the closing area of the editing operation command and the closing area of the editing operation text is calculated, if the ratio between the two is less than 3/ 2, the mobile terminal scans the position of the vertex in the left neighboring direction of the added stroke by using the vertex position of the added stroke (ie, the intersection of the two strokes), and moves the text in the right adjacent direction of the added stroke back. Then, add the text in the editing operation command closure after the text position in the left neighboring direction, that is, add the newly input text directly below or directly above the stroke, and feed back the added state to the user; specifically feedback to the user is Record Tim Add the newly entered text directly below or directly above the stroke.

Application three, mobile operation.

You can set the geometric feature of the move edit operation command to be an arc intersecting an ellipse or a circle, and set the text or image inside the ellipse or circle to move to the position indicated by the arc, such as

, indicating that the "people" needs to be moved to the right neighbor of the "home".

The mobile terminal performs a moving operation according to the editing operation command corresponding to the input stroke. Specifically, first, the relationship between the closed area of the mobile editing operation command and the closed area of the editing operation text is calculated, if the ratio between the two is 3/ When the relationship between 2 and 2/1 is considered to be an inclusion relationship, the mobile terminal saves the text information in the closed area between the end position of the input stroke (the right neighbor of "home") and the circle of the input stroke (ie, " The people, , ), then use the area of the circle recorded by the input stroke to scan the position of the pixel, extract the text information in the area, and then replace the text information between the input stroke end position and the input circle stroke with the extracted circle area. The internal text, and finally the text area between the last saved moving action end position and the moving working circle stroke is built in the circle area, and the further insertion process is a normal input character process.

Application 4: Inverted operation.

It can be set that the geometric feature of the inverted editing operation command is a stroke, and the angle value between the key geometric feature points (referring to the inflection point and the starting point) of the stroke has at least two near right angles (ie, the angle value is within a certain range, the present invention The range of the setting is the number ±), and the sum of the two near-right angles is close to π (that is, within a certain range, the range set by the present invention is π), for example, indicating that the "person" and the "people" need to be inverted. .

First, the relationship between the closure area of the inverted editing operation command and the closure area of the editing operation text is calculated. If the ratio between the two is between 3/2 and 2/1, it is considered to be an inclusion relationship, then the mobile terminal according to Enter the editing operation command corresponding to the stroke to perform the inversion operation. Specifically, the mobile terminal separately stores the text information in the area of the first half of the fold line closure, and the second half of the fold line is closed. The text information in the package area is specifically determined according to the position of the inflection point of the inversion operation and the position information of the start point and the end point, and the closure area of the front and rear half fold lines is determined, and then the position of the text in the closure is determined according to the pixel points scanned within the closure area; Further, the text information in the front and rear half of the fold line closure area is interchanged. Specifically, the exchange process first saves the text information and the character position in the front and rear half of the fold line closure area as temporary variables, and then The position variable of the text information in the front and rear half of the fold line closure area is swapped. Further, the mobile terminal writes the text information in the original half of the fold line closure area in the original half of the fold line closure area, and the first half of the fold line is closed. Write the text information in the original half of the fold line closure area within the package area. The mobile terminal can determine the text information in the closed area of the half fold line according to the prior art, and the relationship between the front and rear half of the fold line closure and the text information in the closed package is determined according to the closure relationship between the two. adjacent.

Application 5: Change the size of the graphic.

It can be set that the geometric feature of the operation of changing the graphic size is a straight line, and there is no pixel on the terminal to modify the text or the graphic in the closure area of the editing operation command. Further, the present invention distinguishes the input editing operation command stroke from the modified text or graphic by the pixel dot color.

The mobile terminal changes the size (length, width, etc.) of the graphic according to the end point coordinate position of the input stroke (here, the stroke corresponding to the modified editing operation command, the modified stroke of the cartridge), and redraws the graphic with the latest size attribute information; Further, in this step, the default mobile terminal has saved the length and width information of the graphic or the vertex information on the diagonal line, and then calculates the length and width according to the coordinate position of the end point of the modified stroke and the coordinate position of the modified graphic and the modified stroke intersection. The difference is added to the length and width of the original graphic, or subtracted to obtain the length and width information of the modified new graphic, and the mobile terminal repaints the graphic according to the latest size attribute.

It can be seen from the above embodiments that the technical solution of the present invention increases the writing editing, symbols and logos used by humans through the geometric relationship of the singles in the mobile terminal, so that the user can naturally express the intention and avoid searching for menu items, etc. Complex operations streamline user operations and improve the user experience of the software. The invention may, of course, be embodied in a variety of embodiments, and any modifications, equivalents, and improvements made within the spirit and scope of the invention are included in the present invention. Within the scope of protection of the claims.

Claims

Claim

A method for implementing a graphic editing function, the method comprising: recording an input stroke input by a user when the graphic editing function is enabled;

2. The method according to claim 1, wherein the editing operation command stores a correspondence between a stroke and an editing operation command in a centralized manner;

The editing operation command is divided into a text editing operation command and a picture editing operation command; the text editing operation command includes at least a delete, add, move, and invert command; the image editing operation command includes at least deleting, adding, moving, inverting, and Zoom command.

3. The method of claim 2, wherein the method further comprises: classifying all of the editing operation commands in the editing operation command set according to the number of strokes of the stroke to obtain a subset of the editing operation commands.

4. The method according to claim 3, wherein the process of searching for an editing operation command corresponding to the input stroke from the editing operation command set comprises:

Calculating the number of strokes of the input stroke;

5. The method according to claim 3, wherein after the editing operation command is found, the method further comprises: confirming to the user whether to execute the editing operation command, and if so, The text or graphics of the input stroke closure are processed again, otherwise, the user is waited for the operation of inputting the stroke again.

The method according to claim 1 or 2, wherein after processing the text or graphics of the input stroke closure, the method further comprises: releasing key geometric feature points of the input stroke and refreshing Mobile terminal display interface.

7. A mobile terminal for implementing a graphic editing function, comprising: an input module, an editing operation command identification module, a storage module, and a processing module, wherein:

The storage module is configured to store the edit operation command set;

8. The mobile terminal of claim 7, wherein

9. The mobile terminal of claim 8, wherein

10. The mobile terminal of claim 9, wherein

The editing operation command identification module is further configured to calculate a number of strokes of the input stroke, And searching for a corresponding subset of the editing operation command from the editing operation command set according to the number of strokes; and key geometrical feature points of the input stroke and a key geometry of the stroke corresponding to the editing operation command subset editing operation command The feature points are matched, and an editing operation command corresponding to the input stroke is found.

11. The mobile terminal of claim 9, wherein

The processing module, after the editing operation command identification module searches for an editing operation command corresponding to the input stroke, is further used to confirm to the user whether to execute the editing operation command, and if so, the text of the input stroke closing or The graphics are processed, otherwise, the user is waiting for the input stroke to be re-executed.

The mobile terminal according to any one of claims 7 to 11, wherein the processing module is further configured to release the input stroke after processing the text or graphics of the input stroke closure Feature points, and refresh the display interface.