CN115048027A

CN115048027A - Handwriting input method, device, system, electronic equipment and storage medium

Info

Publication number: CN115048027A
Application number: CN202210486464.2A
Authority: CN
Inventors: 葛星星; 杨宇; 郭晓天
Original assignee: Hefei Xunfei Reading And Writing Technology Co ltd
Current assignee: Hefei Xunfei Reading And Writing Technology Co ltd
Priority date: 2022-05-06
Filing date: 2022-05-06
Publication date: 2022-09-13

Abstract

The method can allow a user to write at any position of a display screen of the device, when the completion of a current writing period is detected, text conversion is carried out on writing handwriting information corresponding to the current writing period to obtain text content, and the text content is inserted into a target position of the display content of the display screen of the device, so that the text content can be input by handwriting. The scheme is applied to the ink screen equipment, so that the problems of delay and ghost image caused by low screen display refresh rate of the ink screen equipment are solved, writing can be carried out at any position of an equipment display screen of the ink screen equipment, and convenience is provided for a user to edit characters on the ink screen equipment.

Description

Handwriting input method, device, system, electronic equipment and storage medium

Technical Field

The present application relates to the field of handwriting input, and in particular, to a handwriting input method, apparatus, system, electronic device, and storage medium.

Background

Ink screen equipment is various in the existing market, and the ink screen equipment is widely applied due to the advantages of eye protection, low energy consumption and the like.

Based on the ink screen equipment, the user can realize the editing operation of characters. However, because the screen display refresh rate of the ink screen device is low, delay and ghost images are generated when characters are edited on the ink screen device in a keyboard mode, and the editing requirements of users cannot be basically met; when characters are edited on the ink screen equipment in a writing mode, although the problems of delay and ghost images caused by low screen display refresh rate of the ink screen equipment can be solved, the characters can only be input in a local area specified by an input method due to the limitation of the input method, and the editing requirements of users cannot be met.

Therefore, there is a need to develop a text editing scheme based on an ink screen device, so as to meet the requirements of users.

Disclosure of Invention

Based on the above requirements, the application provides a handwriting input method, device, system, electronic device and storage medium, and the method can be used for overcoming the problem that the ink screen device in the prior art cannot meet the text note editing requirements of the user.

The technical scheme provided by the application is as follows:

in a first aspect, the present application provides a handwriting input method, including:

acquiring writing handwriting information generated based on writing operation detected at any position of a display screen of the equipment;

if the end of the current writing period is detected, performing text recognition on all writing handwriting information acquired in the current writing period to obtain text content;

inserting the text content at a target location of the device display screen displaying content.

Optionally, the handwriting input method further includes:

when the equipment display screen enters a writing mode, if the equipment display screen displays an input keyboard, the input keyboard is controlled to be hidden, or the input keyboard is controlled to be invalid.

Optionally, the handwriting input method further includes:

when an equipment display screen enters a writing mode, if the equipment display screen does not display a positioning cursor, generating a virtual positioning cursor at a preset position or a position clicked by a user, and taking the position of the virtual positioning cursor as the target position; and if the device display screen displays a positioning cursor, taking the position of the positioning cursor as the target position.

Optionally, the handwriting input method further includes:

responding to preset operation, and entering an erasing mode;

in an erasing mode, responding to the detected erasing operation, and deleting an erasing object corresponding to the erasing operation; the erasing operation comprises a writing operation covering an erasing object;

the erasing object comprises writing information acquired in the current writing period or text content displayed on a display screen of the equipment.

Optionally, the handwriting input method further includes:

in an erase mode, in response to a detected erase release operation, exiting the erase mode;

wherein the erase-release operation comprises a write operation that uncovers the erase object.

Optionally, whether the current writing period is finished is determined by the following processing:

in the current writing period, detecting writing pause and recording the writing pause duration;

judging whether the writing pause duration reaches a preset pause duration threshold value or not;

and when the writing pause is detected and the writing pause time reaches a preset pause time threshold, determining that the current writing period is ended.

Optionally, the handwriting input method further includes:

acquiring the pause duration between characters when a user continuously writes in the historical duration;

and updating the pause duration threshold based on the pause duration between characters when the user continuously writes in the historical duration.

Optionally, the text recognition is performed on all handwriting information obtained in the current writing period to obtain text content, including:

determining writing areas corresponding to all writing handwriting information acquired in the current writing period on a display screen of the equipment;

and performing text recognition based on the handwriting information in the writing area to obtain text content.

Optionally, the determining a writing area corresponding to all writing trace information acquired in the current writing period on the device display screen includes:

and determining the smallest enclosure frame area of all the handwriting information corresponding to the current writing period as a writing area on the display screen of the slave device.

In a second aspect, the present application provides a handwriting input apparatus, comprising:

the device comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring writing handwriting information generated based on writing operation detected at any position of a display screen of the device;

the recognition module is used for performing text recognition on all the handwriting information acquired in the current writing period to obtain text content if the end of the current writing period is detected;

an insertion module for inserting the text content at a target location of the device display screen displaying content.

In a third aspect, the present application provides an electronic device, comprising:

a memory and a processor;

wherein the memory is used for storing programs;

the processor is configured to implement the handwriting input method according to any one of the first aspect by executing the program in the memory.

In a fourth aspect, the application provides a handwriting input system, which includes a stylus and the electronic device of the third aspect.

In a fifth aspect, the present application provides a storage medium comprising: the storage medium has stored thereon a computer program which, when executed by a processor, performs the steps of the handwriting input method according to any of the claims of the first aspect.

According to the handwriting input method, the handwriting input device, the handwriting input system, the electronic equipment and the storage medium, a user can write at any position of the display screen of the equipment, after the completion of the current writing period is detected, text conversion is carried out on writing handwriting information corresponding to the current writing period to obtain text content, and the text content is inserted into the target position of the display content of the display screen of the equipment, so that the handwriting input text content can be realized. The scheme supports the user to write at any position of the display screen of the equipment, and provides convenience for the user to edit the characters on the display screen of the equipment. On the other hand, in the scheme, the recognition of the writing contents is triggered based on the end of the writing period, and when the writing period is ended, all the writing contents in the writing period can be recognized and displayed on a screen, so that the method supports the user to continuously write in the writing period, and further improves the editing efficiency of the user.

The scheme is applied to the ink screen equipment, so that the problems of delay and double images caused by low screen display refresh rate of the ink screen equipment are solved, the user can write at any position of the equipment display screen of the ink screen equipment, the user is supported to continuously write, and convenience is brought to the user for character editing in the ink screen equipment.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.

Fig. 1 is a schematic flowchart of a handwriting input method provided in an embodiment of the present application;

FIG. 2 is a schematic display diagram of a display screen of a device provided in an embodiment of the present application;

FIG. 3 is another display diagram of a display screen of a device provided by an embodiment of the present application;

fig. 4 is a schematic flowchart of deleting an erased object according to an embodiment of the present application;

FIG. 5 is a schematic display diagram of a display screen of a device during an erase operation according to an embodiment of the present disclosure;

FIG. 6 is a schematic display diagram corresponding to a display screen of a device after erasing is completed according to an embodiment of the present disclosure;

FIG. 7 is another schematic display diagram of a display screen of a device after erasing is completed according to an embodiment of the present disclosure;

FIG. 8 is a flow chart illustrating a process for determining whether a current writing cycle is over according to an embodiment of the present application;

FIG. 9 is a schematic flowchart of text recognition on all handwriting information obtained in a current writing period according to an embodiment of the present application;

FIG. 10 is a schematic diagram of a display of a writing area for determining a current writing cycle provided by an embodiment of the present application;

fig. 11 is a schematic structural diagram of a handwriting input device according to an embodiment of the present application;

fig. 12 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

fig. 13 is a schematic structural diagram of a handwriting input system according to an embodiment of the present application.

Detailed Description

The technical scheme of the embodiment of the application is suitable for the application scene of handwriting input, and by adopting the technical scheme of the embodiment of the application, characters can be written at any position of the display screen of the equipment and text conversion can be carried out, so that convenience is provided for a user to edit the characters on the display screen of the equipment. Illustratively, the device display screen includes a display screen of an ink screen device, and the device display screen further includes a display screen of any other device with a handwriting function, such as a display screen of a smart phone, a tablet computer, and the like.

The technical solutions in the embodiments of the present application will be described clearly and completely with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only some embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The present embodiment proposes a handwriting input method, as shown in fig. 1, the method includes:

s101, acquiring handwriting information generated based on the writing operation detected at any position of a display screen of the equipment.

The writing operation refers to an operation of writing characters on a display screen of a device by a writing device or a finger or the like. When writing, based on different types of display screens of the equipment, the adopted writing equipment is different. For example, if the display screen of the device is an ink screen, an electromagnetic pen can be used as the writing device; if the display screen of the device is a capacitive screen, the capacitive pen can be used as writing equipment, and under the condition that the display screen of the device is the capacitive screen, the writing equipment can be omitted, and the device can be directly used for handwriting by using fingers.

Based on writing equipment or fingers, when writing operation is carried out on the equipment display screen, an electric signal can be generated by contacting the equipment display screen, and the electric signal can be captured by the equipment display screen. The equipment at equipment display screen place can convert the electrical signal into the coordinate point in the equipment display screen coordinate system, then draws the coordinate point into writing information, shows writing information on equipment display screen. Illustratively, if the device display screen is an ink screen and the stylus is an electromagnetic pen, in the writing operation process, the ink screen acquires an electrical signal generated by the contact between the electromagnetic pen and the ink screen in the writing operation process in real time, converts the electrical signal into a coordinate point, draws black handwriting information based on the coordinate point, and displays the black handwriting information on a handwriting control of the device where the device display screen is located, namely displays the black handwriting information on the ink screen.

When the equipment display screen enters the writing mode, the handwriting control in the application layer of the equipment where the equipment display screen is located is switched to the full-screen mode, so that the writing signal corresponding to the writing operation can be acquired at any position of the equipment display screen, the writing can be performed at any position of the equipment display screen, and convenience is provided for a user to edit characters on the equipment display screen.

Specifically, an operation of entering the writing mode may be set in advance, and in response to the operation, the device display screen enters the writing mode. In the embodiment of the present application, specific contents of the operation of entering the writing mode are not limited as long as the operation of entering the writing mode can be detected by the device where the device display screen is located. As an example, pressing the device display screen with a writing device or a finger for a preset time interval, for example, 2 seconds, may be used as an operation to enter the writing mode; a writing operation control button can be arranged on the equipment where the equipment display screen is arranged, for example, the writing operation control button is arranged on the side face or the back face of the equipment, and the control button is operated to be used as the operation for entering the writing mode; writing control may also be performed by voice, as an operation to enter a writing mode when corresponding voice content is detected, for example, "enter a handwriting mode", or the like.

In addition, a menu bar is typically provided on the display screen of the device, and includes a variety of editing options, such as text editing options including font size setting, font setting, bolding setting, etc., as well as close options, minimize options, delete options, insert pictures options, etc. In order to avoid that a user mistakenly touches the editing options in the menu bar during the writing operation, for example, when the device display screen enters the writing mode, the trigger time of the editing options in the menu bar in the writing mode may be appropriately prolonged, for example, when the device display screen enters the writing mode, a certain editing option in the menu bar is pressed by a finger or the writing device and the pressing time reaches a preset time, for example, after 3 seconds, the operation corresponding to the pressed editing option in the menu bar is executed;

for example, in another alternative embodiment, in order to avoid that the editing option in the menu bar is touched by mistake during the writing operation, the editing option in the menu bar may be set to be unable to be triggered when the device display screen enters the writing mode, when the device display screen exits the writing mode, the editing option in the menu bar can be triggered and executed, and when the user wants to adopt the editing option in the menu bar, the user needs to exit the writing mode first;

for example, in another alternative embodiment, in order to avoid the editing option in the menu bar being touched by mistake during the writing operation, in the writing mode, a menu bar sub-mode may be further set, and an entering operation into the menu bar sub-mode may be set, for example, the menu bar may be pressed by a finger or a writing device and the pressing time may reach a preset time, for example, 3 seconds, and then, in response to the operation, the device display screen may enter the menu bar sub-mode, in the menu bar sub-mode, the editing option in the menu bar may be triggered and executed, the editing option operation in the menu bar may be detected to be completed, or the editing option operation in the menu bar may not be detected within a preset time, and then, the menu bar sub-mode may be automatically exited and the writing mode may be returned.

In this embodiment, the language and font corresponding to the writing operation are not limited, as long as the handwriting information generated by the writing operation can be recognized and converted based on the text recognition technology.

And S102, if the end of the current writing period is detected, performing text recognition on all the handwriting information acquired in the current writing period to obtain text contents.

The user's writing operation on the display screen of the device may be divided into at least one writing cycle. The writing period may be a set period of fixed duration, or may be a writing period flexibly determined according to the start and stop of writing by the user. For example, the writing period may be determined as a period of a fixed duration, or an interval in which the start of writing and the end of writing by the user are detected may be determined as one writing period.

After a writing period is finished, text recognition can be performed on all writing notes acquired in the writing period to obtain recognized writing trace information, namely text content. For example, all writing information acquired in the current writing period may be sent to a text recognition engine, and based on the text recognition engine, the writing information is subjected to recognition conversion to obtain text content.

Illustratively, the handwriting information may be converted for recognition based on existing text recognition techniques. Such as Optical Character Recognition (OCR) technology, etc.

In the embodiment of the application, if an interval in which the user starts writing and ends writing is detected is determined as one writing period, the writing period may be determined based on the writing habit of the user. During the writing operation, the user is detected to pause, and when the user pauses for a long time, it can be determined that one writing period is finished, and all the written notes acquired in the writing period are subjected to text recognition.

After the recognition of the handwriting information is finished, the corresponding handwriting information is deleted so as to avoid secondary repeated recognition and improve the recognition rate. Illustratively, the recognized handwriting information may be deleted by calling a specific cleaning function.

S103, inserting the text content at the target position of the content displayed on the display screen of the equipment.

The display content refers to content displayed on the device display screen, and may include all content displayed on the device display screen. The target position refers to a specific position where the positioning cursor is located in the display content. In this embodiment, after the text content is obtained, the text content may be inserted into a position where a positioning cursor in the display content of the display screen of the device is located.

Based on the introduction, a user can write at any position of a display screen of the equipment, after the completion of the current writing period is detected, text conversion is carried out on writing handwriting information corresponding to the current writing period to obtain text content, and the text content is inserted into a target position of the display content of the display screen of the equipment, so that the text content can be input by handwriting. The scheme supports the user to write at any position of the display screen of the equipment, and provides convenience for the user to edit the characters on the display screen of the equipment. On the other hand, in the scheme, the recognition of the written content is triggered based on the end of the writing period, and when the writing period is ended, all the written content in the writing period can be recognized and displayed on a screen, so that the method supports the user to continuously write in the writing period, and further improves the editing efficiency of the user.

Illustratively, another embodiment of the present application discloses that the handwriting input method further includes:

when the device display screen enters a writing mode, if the device display screen displays an input keyboard, the input keyboard is controlled to be hidden, or the input keyboard is controlled to be invalid.

Specifically, the device is generally installed with input method software, which may be the input method software of the device itself, or may be installed with third party software. In the embodiment of the application, after the device display screen enters the handwriting mode, the device display screen may display an input keyboard corresponding to the input method software, and when full-screen handwriting is performed, the input keyboard corresponding to the input method software may be touched by mistake, so that the device display screen receives wrong information. Therefore, in this embodiment, if the device display screen enters the writing mode, the input keyboard corresponding to the input method software may be hidden, or the input keyboard corresponding to the input method software may be controlled to be disabled.

It should be noted that, in the embodiment, it is preferable to hide the input keyboard corresponding to the input method software, because the input keyboard is still displayed on the device display screen, and the presence of the input keyboard still affects the writing operation of the user when the user writes, although the input keyboard cannot be clicked due to a failure in the manner of controlling the input keyboard corresponding to the input method software to fail.

In the embodiment, the input keyboard is hidden or the input keyboard is controlled to be invalid, so that the condition that the input keyboard is touched by a user by mistake in the writing operation process to cause the display screen of the equipment to receive wrong information is effectively avoided, and the character input efficiency in the writing process is improved.

Illustratively, another embodiment of the present application discloses a handwriting input method, further comprising:

Due to the setting of the input method software, the input keyboard and the positioning cursor have a certain incidence relation, when the input keyboard is hidden or the input keyboard is controlled to be invalid, the positioning cursor may be hidden or invalid, and the positioning cursor may not be hidden or invalid. Therefore, in this embodiment, when the device display screen enters the writing mode, it is required to detect whether the positioning cursor is hidden or invalid, and if it is detected that the positioning cursor is hidden or invalid, a virtual positioning cursor may be generated, and a position where the virtual positioning cursor is located is taken as the target position. And if the positioning cursor is detected to be normally displayed and is not hidden or invalid, taking the position of the positioning cursor as the target position.

The location at which the virtual positioning cursor is generated may be a user-selected location, i.e., a location at which the user presses with a finger or a writing device; the position of generating the virtual positioning cursor may also be a preset position, where the preset position may be a start position or an end position of the display content, and the present embodiment is not limited. Illustratively, when the device display screen enters a writing mode, after detecting that the positioning cursor is hidden or invalid, if detecting that the user selects any position in the display content, generating the virtual positioning cursor at any position selected by the user; if it is detected that the user does not select any position in the display content, the virtual positioning cursor can be generated at a preset position, and the virtual positioning cursor can also not be generated until the user selects any position in the display content and the virtual positioning cursor is generated at any position selected by the user.

For example, the virtual positioning cursor constructed in the writing mode in the embodiment is an inputtable area forged in the positioning layer of the device. The virtual positioning cursor has the same function as the positioning cursor and is used for displaying the position of the text content to be inserted. When the virtual positioning cursor is displayed on the device display screen, the virtual positioning cursor may be a regularly flashing vertical line or a regularly flashing horizontal line, and the device display screen may also display the virtual positioning cursor in other forms as long as the virtual positioning cursor can display the position of the text content to be inserted, which is not particularly limited in this embodiment.

Illustratively, in the display screen of the device shown in fig. 2, the content corresponding to the area a is the display content, and the vertical line B in the area a is the virtual positioning cursor. The position of the virtual positioning cursor determines the target word for inserting the text content. In the device display screen shown in fig. 2, the text corresponding to the area C is writing trace information corresponding to one writing period in the writing mode, and after the writing period is detected to be over, text recognition is performed on the writing trace information, the obtained text content is inserted to the position where the vertical line B is located, and the display content of the device display screen after the insertion is shown in fig. 3. The characters shown in fig. 2 and 3 are only used as examples to illustrate the insertion positions of the text contents, and do not have any limitation to the present application.

In the embodiment of the application, under the condition that the positioning cursor is hidden or invalid, the virtual positioning cursor which has the same function as the positioning cursor is constructed, the condition that text content cannot be inserted due to the fact that the positioning cursor is hidden or invalid when a display screen of the equipment enters a writing mode is avoided, and writing operation can be carried out normally.

Illustratively, as shown in fig. 4, another embodiment of the present application discloses a handwriting input method, further comprising:

s401, responding to preset operation, and entering an erasing mode.

The preset operation refers to an operation of entering an erase mode. For example, the preset operation may be pressing the device display screen with a finger or a stylus for a preset time, for example, after pressing the device display screen with a finger or a stylus for 2 seconds, the device display screen enters an erasing mode.

In response to the preset operation, the device display screen enters an erase mode.

S402, in the erasing mode, responding to the detected erasing operation, and deleting the erasing object corresponding to the erasing operation.

When the device display screen enters the erasing mode, the user can take an erasing operation, and in response to the erasing operation taken by the user, the device where the device display screen is located deletes the erasing object. The above-mentioned erasing operation may be set as needed, as long as the device can determine the erasing object based on the erasing operation of the user, and the embodiment is not limited.

Illustratively, the erasing operation includes a writing operation to cover the erasing object, a writing operation to draw a closed figure to surround the erasing object, an operation to directly erase using an erasing end of the writing apparatus, and the like. The device can determine the handwriting information covered by the line drawn by the writing device or the finger as the erasing object, and delete the part of the handwriting information; and drawing a writing operation that the closed graph surrounds the erasing object, wherein the writing operation comprises drawing a rectangular, circular or irregular closed graph, and closing the erasing object, the equipment display screen can detect the closed graph, the writing information in the closed graph is determined as the erasing object, and the part of the writing information is deleted. Since the cap end of the stylus pen generally has an erasing function, the operation of directly erasing the object to be erased by using the erasing end of the writing instrument may be an operation of directly erasing the object to be erased by using the erasing end of the stylus pen.

In addition, the erasing object is handwriting information acquired in the current writing period or text content displayed on a display screen of the device. That is to say, the handwriting information acquired in the current writing period and the text content displayed on the display screen of the device can be deleted by the above-mentioned erasing operation in the erasing mode.

For example, if a user finds that a writing error exists in writing trace information corresponding to a current writing period in the writing operation process, a preset operation may be performed, for example, a stylus tip is used to press a device display screen for 2 seconds, and the device display screen enters an erasing mode. After the device display screen enters an erasing mode, a user determines the content of writing errors, namely an erasing object, a stylus pen point is used for drawing a line which is drawn through the erasing object, the device where the device display screen is located can determine that writing information covered by the line drawn by the stylus pen point is the erasing object, and the part of the writing information is deleted.

Further, for example, if the user finds that there is an error in the converted text content during the writing operation, a predetermined operation may be performed, for example, pressing the display screen of the device for 2 seconds by using a stylus pen tip, and the display screen of the device enters an erasing mode. After the device display screen enters an erasing mode, a user determines the content of writing errors, namely an erasing object, the stylus pen point is used for drawing a line which is drawn across the erasing object, the device can determine the text content covered by the line drawn by the stylus pen point as the erasing object, and the partial handwriting information is deleted. Besides, except that the erasing objects in the text content are deleted in the form of the erasing mode, because the text content is already recognized and converted and belongs to editable text, the writing mode can be exited so as to call up the input keyboard, and the erasing objects are deleted by using the deleting options in the input keyboard. If the deletion option exists in the menu bar, the deletion option in the menu bar can be called to delete the erasing object.

It should be further noted that, when the device display screen enters the erasing mode from the writing mode, the current writing period is suspended but not ended, the handwriting information corresponding to the current writing period does not perform text recognition until the erasing mode exits, and when the writing mode is resumed, the current writing period is resumed. And when the current writing period is detected to be finished, performing text recognition on all the handwriting information corresponding to the current writing period.

In the embodiment of the application, the writing handwriting information acquired in the current writing period or the text content displayed on the display screen of the device is erased, so that the user can delete the writing error in time in the writing operation process, convenience is provided for the user, and the accuracy of the content edited by the user is also ensured.

in an erase mode, the erase mode is exited in response to a detected erase disarming operation.

Specifically, the erase canceling operation refers to an operation of exiting the erase mode, which is set in advance. When the erasure is completed, the user can perform an erasure removal operation, and the device display screen exits the erasure mode in response to the detected erasure removal operation.

Illustratively, the erase-release operation includes a write operation that uncovers the erased object. Specifically, after the erasing is completed, the user can continue to write in a blank area of the device display screen without characters, so as to avoid covering other characters. And exiting the erasing mode when detecting that the user continues writing operation in a blank area without characters on the display screen of the equipment, namely the writing operation of the erasing object is not covered.

Further, in an implementation example, in the erasing mode, the writing operation covering the erasing object may be used as the erasing operation, and the writing operation not covering the erasing object may be used as the erasing releasing operation. That is, after entering the erasing mode, if the written information corresponding to the writing operation covers the erasing object, the erasing object is deleted, and if the writing operation is performed in a blank area without any characters, the erasing mode is exited.

For example, in the erasing mode, if the writing operation covering the erasing object is used as the erasing operation, the writing operation not covering the erasing object is used as the erasing releasing operation, and the writing information corresponding to the area D in fig. 5 needs to be deleted as the erasing object, the pen tip of the stylus pen may be used to scribe a line in the area D and cover the erasing object, as shown by the straight line E in fig. 5. The device where the device display screen is located determines the detected line-covered handwriting information as an erased object, and deletes the erased object to obtain the device display screen shown in fig. 6. In the device display screen shown in fig. 6, when a writing operation in a blank area without any text is detected, the device display screen exits the erasing mode.

In the erase mode, if the text content corresponding to the area G in fig. 5 needs to be deleted as the erase target by using the writing operation covering the erase target as the erase operation and the writing operation not covering the erase target as the erase cancel operation, the pen tip of the stylus pen may be used to draw a line in the area G and cover the erase target, as shown by a straight line H in fig. 5. And determining the detected handwriting information covered by the lines as an erasing object by the equipment where the equipment display screen is located, and deleting the erasing object to obtain the equipment display screen shown in the figure 7.

The characters shown in fig. 5, 6 and 7 are only used as examples to illustrate the erasing of characters, and do not have any limiting effect on the present application.

In the embodiment of the application, a mode of rapidly exiting the erasing mode is provided, so that a user can continue writing operation, and the writing speed of the user is improved.

Illustratively, as shown in fig. 8, in another embodiment of the present application, it is disclosed that whether the current writing period is finished is determined by the following process:

s801, in the current writing period, detecting writing pause and recording the writing pause duration.

The writing pause refers to a pause after each character is written when the user writes continuously; the writing pause duration refers to a pause duration after each character is written by the user when the user writes continuously.

S802, judging whether the writing pause time reaches a preset pause time threshold.

The preset pause duration threshold is a preset threshold time.

Illustratively, when the user is detected to lift the pen, timing is started, and when the timing time reaches the preset pause duration threshold value, and the pen drop is still not detected, the writing pause duration reaches the preset pause duration threshold value.

For example, the initial pause duration threshold may be set by the user, or may be written before the device leaves the factory. Specifically, when a user uses the device display screen for writing for the first time, a pause duration threshold can be set by himself/herself; or, the user does not adopt a self-setting mode, but adopts a preset pause duration threshold value when the equipment leaves the factory. When the preset pause time threshold value when leaving the factory is determined, a plurality of persons can be selected to perform writing experiments, the average pause time in the writing experiment process is determined, the average pause time is written into equipment, and the preset pause time threshold value when the equipment leaves the factory is determined. In the writing process of the user, the pause duration threshold can be continuously corrected based on the writing speed of the user, and the pause duration threshold matched with the writing habit of the user is obtained.

And detecting whether the pause duration reaches a preset pause duration threshold after each character is written by the user when the user continuously writes.

And S803, when the writing pause is detected and the writing pause time reaches a preset pause time threshold, determining that the current writing period is finished.

And if the writing pause is detected and the writing pause time reaches a preset pause time threshold, indicating that the user stops writing, ending the current writing period, and performing text recognition on all writing handwriting information acquired in the current writing period to obtain text content so as to insert the text content into a target position of the display content of the display screen of the equipment.

In the embodiment, based on the writing habit of the user, the writing operation is divided into a plurality of writing periods to be recognized respectively, so that the writing speed can be improved, the problem that the writing speed of the user is reduced due to the recognition mode of writing one character and recognizing one character is solved, the pressure on a recognition engine when all writing handwriting information generated by one section of writing operation is recognized can be reduced, and the text conversion efficiency is improved.

acquiring the pause duration between characters when a user continuously writes in the historical duration; and updating the pause duration threshold value based on the pause duration between the characters when the user continuously writes in the historical duration.

The user writes at different speeds for different time periods. For example, the writing speed may be faster when the user just starts writing, and may gradually decrease after the user writes for a while. If the fixed pause duration threshold value is always kept, under the condition that the writing speed of the user is reduced, the user may be mistakenly considered that the writing operation is stopped when the writing operation is not stopped, and the text recognition is started when the current writing period is ended, so that the writing of the user is influenced; when the writing speed of the user is increased, the time for detecting whether the current writing cycle is finished may be too long, and the writing speed of the user may be reduced. Therefore, the pause duration threshold should be modified by the pause duration between characters when the user writes continuously, so that the pause duration threshold matches the pause duration between characters when the user writes continuously.

Specifically, the pause duration between characters when the user writes continuously in a period of time can be obtained. The process of determining the pause duration between characters is as follows:

and in the process of continuous writing, when detecting that the user lifts the pen, starting timing, when detecting that the user drops the pen, ending timing, and taking the timing duration between the pen lifting and the pen dropping of the user as the pause duration between the characters when the user continuously writes.

When the gradual increase of the pause duration between the characters when the user continuously writes is detected, the interval between the pen lifting and the pen falling of the user is increased, the writing speed of the user is reduced, and the pause duration threshold value can be properly increased; when the pause duration between characters is detected to be gradually reduced when the user continuously writes, the interval between pen lifting and pen falling of the user is reduced, the writing speed of the user is accelerated, and the pause duration threshold can be properly reduced.

According to the embodiment of the application, the pause time length threshold value can be corrected based on the pause time length between characters when the user continuously writes, so that the pause time length threshold value is matched with the pause time length between the characters when the user continuously writes, the condition that the user writes is influenced by overlong or overlong pause time length threshold value is avoided, and the convenience of the user in the writing process is improved.

Illustratively, as shown in fig. 9, another embodiment of the present application discloses that the performing text recognition on all handwriting information obtained in a current writing period to obtain text content includes:

s901, determining writing areas corresponding to all writing handwriting information acquired in the current writing period on a display screen of the device.

Specifically, based on writing equipment or finger, when writing operation is carried out on the equipment display screen, the contact with the equipment display screen can produce the signal of telecommunication, and the equipment at equipment display screen place can convert the signal of telecommunication into the coordinate point in the equipment display screen coordinate system, writes handwriting information based on the coordinate point generation and shows on the equipment display screen. Based on this, in an implementation example, the surrounding frame area of all the handwriting information corresponding to the current writing period may be determined as the writing area according to the coordinates of the handwriting information in the device display screen coordinate system.

And S902, performing text recognition based on the handwriting information in the writing area to obtain text content.

In the prior art, when handwriting information is recognized, the handwriting information is placed in a blank document with the size of a display screen of equipment, a recognition engine is adopted to recognize the whole document, the area of a recognition area is large, and the recognition speed is low.

In the embodiment of the application, the purpose of determining the writing area is to perform text recognition only on the writing information in the writing area, and thus, the blank area outside the writing area can be cut off, so that the recognition engine performs text recognition only on the writing area where the writing information is located, and the recognition time is shortened.

Illustratively, another embodiment of the present application discloses that the determining a writing area corresponding to all writing trace information obtained in a current writing period on a display screen of a device includes:

Specifically, the smallest enclosure area of all the handwriting information corresponding to the current writing period can be determined as the writing area based on the coordinates of the handwriting information in the device display screen coordinate system.

Illustratively, as shown in fig. 10, in the device display screen coordinate system XOY, of all coordinate points of all writing information corresponding to the current writing period, a first coordinate point T1 with the largest abscissa, a second coordinate point T2 with the smallest abscissa, a third coordinate point T3 with the largest ordinate, and a fourth coordinate point T4 with the smallest ordinate may be determined, and a rectangular region composed of a parallel line passing through the first coordinate point T1 and with the y-axis, a parallel line passing through the second coordinate point T2 and with the y-axis, a parallel line passing through the third coordinate point T3 and with the x-axis, a parallel line passing through the fourth coordinate point T4 and with the x-axis is taken as a writing region corresponding to the current writing process. The text shown in fig. 10 is merely an example to illustrate the determination of the writing area, and does not have any limitation to the present application.

In the embodiment of the application, the minimum enclosure frame area of all the writing handwriting information corresponding to the current writing period is used as the writing area, so that the blank area in the writing area is minimum, and the recognition time is further reduced.

Corresponding to the handwriting input method, the embodiment of the present application further discloses a handwriting input device, as shown in fig. 11, the device includes:

an acquisition module 100, configured to acquire writing trace information generated based on a writing operation detected at an arbitrary position on a display screen of a device;

the recognition module 110 is configured to, if it is detected that the current writing period is ended, perform text recognition on all writing trace information acquired in the current writing period to obtain text content;

an insertion module 120 for inserting the text content at a target location of the device display screen displaying content.

The handwriting input device of the application, the user can write in the optional position of equipment display screen, and acquisition module 100 acquires the writing information that the writing operation that detects based on the optional position at equipment display screen and generated, and recognition module 110 detects current writing cycle and accomplishes the back, carries out text conversion to the writing information that current writing cycle corresponds, obtains text content, and insertion module 120 is in the target position department that equipment display screen shows content inserts text content can realize handwriting input text content. The scheme supports the user to write at any position of the display screen of the equipment, and provides convenience for the user to edit the characters on the display screen of the equipment. On the other hand, in the scheme, the recognition of the written content is triggered based on the end of the writing period, and when the writing period is ended, all the written content in the writing period can be recognized and displayed on a screen, so that the method supports the user to continuously write in the writing period, and further improves the editing efficiency of the user.

Optionally, in another embodiment of the present application, the handwriting input apparatus further includes:

and the keyboard processing module is used for controlling the input keyboard to be hidden or controlling the input keyboard to be invalid if the input keyboard is displayed on the equipment display screen when the equipment display screen enters a writing mode.

the device comprises a positioning cursor processing module, a display module and a display module, wherein the positioning cursor processing module is used for generating a virtual positioning cursor at a preset position or a position clicked by a user when a device display screen enters a writing mode and if the device display screen does not display the positioning cursor, and taking the position of the virtual positioning cursor as the target position; and if the device display screen displays a positioning cursor, taking the position of the positioning cursor as the target position.

the first response module is used for responding to preset operation and entering an erasing mode;

the erasing module is used for responding to the detected erasing operation and deleting an erasing object corresponding to the erasing operation in an erasing mode; the erasing operation comprises a writing operation covering an erasing object;

the erasing object comprises writing handwriting information acquired in the current writing period or text content displayed on a display screen of the equipment.

a second response module, configured to, in an erase mode, respond to a detected erase release operation and exit the erase mode;

the pause detection module is used for detecting writing pause and recording the writing pause duration in the current writing period;

the judging module is used for judging whether the writing pause time reaches a preset pause time threshold;

and the determining module is used for determining that the current writing period is finished when the writing pause is detected and the writing pause time reaches a preset pause time threshold.

the pause acquisition module is used for acquiring the pause duration among characters when the user continuously writes in the historical duration;

and the updating module is used for updating the pause duration threshold value based on the pause duration between the characters when the user continuously writes in the historical duration.

Optionally, in another embodiment of the present application, the identification module 110 includes:

the device comprises a determining unit, a processing unit and a processing unit, wherein the determining unit is used for determining writing areas corresponding to all writing handwriting information acquired in the current writing period on a display screen of the device;

and the recognition unit is used for performing text recognition based on the handwriting information in the writing area to obtain text content.

Optionally, in another embodiment of the present application, when the determining unit determines that all writing trace information acquired in the current writing period corresponds to a writing area on a display screen of the device, the determining unit is specifically configured to:

Specifically, please refer to the content of the above method embodiment for the specific work content of each unit of the handwriting input method, which is not described herein again.

Another embodiment of the present application further provides an electronic device, as shown in fig. 12, the electronic device including:

a memory 200 and a processor 210;

wherein, the memory 200 is connected to the processor 210 for storing programs;

the processor 210 is configured to implement the handwriting input method disclosed in any of the above embodiments by running the program stored in the memory 200.

Specifically, the electronic device may further include: a bus, a communication interface 220, an input device 230, and an output device 240.

The processor 210, the memory 200, the communication interface 220, the input device 230, and the output device 240 are connected to each other through a bus. Wherein:

a bus may comprise a path that transfers information between components of a computer system.

The processor 210 may be a general-purpose processor, such as a general-purpose Central Processing Unit (CPU), microprocessor, etc., an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of programs in accordance with the present disclosure. But may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components.

The processor 210 may include a main processor and may also include a baseband chip, modem, and the like.

The memory 200 stores programs for executing the technical solution of the present application, and may also store an operating system and other key services. In particular, the program may include program code including computer operating instructions. More specifically, memory 200 may include a read-only memory (ROM), other types of static storage devices that may store static information and instructions, a Random Access Memory (RAM), other types of dynamic storage devices that may store information and instructions, a disk storage, a flash, and so forth.

The input device 230 may include a means for receiving data and information input by a user, such as a keyboard, mouse, camera, scanner, light pen, voice input device, touch screen, pedometer or gravity sensor, etc.

Output device 240 may include equipment that allows output of information to a user, such as a display screen, printer, speakers, etc.

Communication interface 220 may include any device that uses any transceiver or the like to communicate with other devices or communication networks, such as an ethernet network, a Radio Access Network (RAN), a Wireless Local Area Network (WLAN), etc.

The processor 210 executes the program stored in the memory 200 and invokes other devices, which can be used to implement the steps of the handwriting input method provided by the above-mentioned embodiments of the present application.

Another embodiment of the present application further provides a handwriting input system, as shown in fig. 13, the handwriting input system includes the electronic device 300 of the above embodiment, and a stylus 310. When a user uses the stylus 310 to perform writing operation, and the stylus 310 contacts the electronic device 300, the stylus 310 establishes connection with the electronic device 300, an electrical signal is generated on a device display screen of the electronic device 300, the electronic device 300 converts the electrical signal into a coordinate point, and writing handwriting information is drawn based on the coordinate point and displayed on the device display screen of the electronic device 300.

Another embodiment of the present application further provides a storage medium, where a computer program is stored on the storage medium, and when the computer program is executed by a processor, the computer program implements the steps of the handwriting input method provided in any of the above embodiments.

Specifically, the specific working contents of each part of the electronic device and the handwriting input system, and the specific processing contents of the computer program on the storage medium when being executed by the processor may refer to the contents of each embodiment of the handwriting input method, and are not described herein again.

While, for purposes of simplicity of explanation, the foregoing method embodiments are presented as a series of acts or combinations, it will be appreciated by those of ordinary skill in the art that the present application is not limited by the illustrated ordering of acts, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.

It should be noted that, in the present specification, the embodiments are all described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other. For the device-like embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.

The steps in the method of each embodiment of the present application may be sequentially adjusted, combined, and deleted according to actual needs, and technical features described in each embodiment may be replaced or combined.

The modules and sub-modules in the device and the terminal in the embodiments of the application can be combined, divided and deleted according to actual needs.

In the several embodiments provided in the present application, it should be understood that the disclosed terminal, apparatus and method may be implemented in other manners. For example, the above-described terminal embodiments are merely illustrative, and for example, the division of a module or a sub-module is only one logical division, and there may be other divisions when the terminal is actually implemented, for example, a plurality of sub-modules or modules may be combined or integrated into another module, or some features may be omitted or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or modules, and may be in an electrical, mechanical or other form.

The modules or sub-modules described as separate parts may or may not be physically separate, and parts that are modules or sub-modules may or may not be physical modules or sub-modules, may be located in one place, or may be distributed over a plurality of network modules or sub-modules. Some or all of the modules or sub-modules can be selected according to actual needs to achieve the purpose of the solution of the present embodiment.

In addition, each functional module or sub-module in the embodiments of the present application may be integrated into one processing module, or each module or sub-module may exist alone physically, or two or more modules or sub-modules may be integrated into one module. The integrated modules or sub-modules may be implemented in the form of hardware, or may be implemented in the form of software functional modules or sub-modules.

Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software unit executed by a processor, or in a combination of the two. The software cells may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

Finally, it should also be noted that, in this document, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A handwriting input method, comprising:

2. The method of claim 1, further comprising:

3. The method of claim 1, further comprising:

4. The method of claim 1, further comprising:

responding to preset operation, and entering an erasing mode;

5. The method of claim 4, further comprising:

in an erase mode, in response to detecting a de-erase operation, exiting the erase mode;

6. The method of claim 1, wherein whether the current writing cycle is over is determined by:

in the current writing period, detecting the writing pause and recording the writing pause duration;

7. The method of claim 6, further comprising:

and updating the pause duration threshold value based on the pause duration between the characters when the user continuously writes in the historical duration.

8. The method according to claim 1, wherein performing text recognition on all handwriting information obtained in the current writing period to obtain text content comprises:

9. The method according to claim 8, wherein the determining a writing area on a display screen of a device corresponding to all writing trace information acquired in a current writing period comprises:

10. A handwriting input apparatus, comprising:

an insertion module for inserting the text content at a target location of the content displayed on the display screen of the device.

11. An electronic device, comprising:

a memory and a processor;

wherein the memory is used for storing programs;

the processor is configured to implement the handwriting input method according to any one of claims 1 to 9 by executing the program in the memory.

12. A handwriting input system comprising a stylus and the electronic device of claim 11.

13. A storage medium, comprising: the storage medium has stored thereon a computer program which, when executed by a processor, implements the steps of the handwriting input method of any of claims 1 to 9.