WO2023070334A1 - 手写输入显示方法及装置、计算机可读存储介质 - Google Patents

手写输入显示方法及装置、计算机可读存储介质 Download PDF

Info

Publication number
WO2023070334A1
WO2023070334A1 PCT/CN2021/126505 CN2021126505W WO2023070334A1 WO 2023070334 A1 WO2023070334 A1 WO 2023070334A1 CN 2021126505 W CN2021126505 W CN 2021126505W WO 2023070334 A1 WO2023070334 A1 WO 2023070334A1
Authority
WO
WIPO (PCT)
Prior art keywords
handwriting
content
overlapping area
axis
coordinate
Prior art date
Application number
PCT/CN2021/126505
Other languages
English (en)
French (fr)
Inventor
李中茹
李川
柴海燕
刘玉竹
尹小玉
Original Assignee
京东方科技集团股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司 filed Critical 京东方科技集团股份有限公司
Priority to CN202180003099.9A priority Critical patent/CN116391164A/zh
Priority to PCT/CN2021/126505 priority patent/WO2023070334A1/zh
Publication of WO2023070334A1 publication Critical patent/WO2023070334A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

  • Embodiments of the present disclosure relate to but are not limited to the field of computer application technology, especially a method and device for displaying handwriting input, and a computer-readable storage medium.
  • Interactive electronic whiteboard is a conference or educational auxiliary human-computer interaction device, which can realize dust-free writing, remote conference and other functions.
  • the interactive electronic whiteboard integrates functions such as a computer, a player, a projector, and an electronic writing board.
  • the content written on the electronic writing board can be saved as PDF (Portable Document Format) or various image formats, which is more convenient for transmission and storage.
  • the content written on the electronic writing board can record handwriting points, and the writing content can be optimized according to the handwriting point analysis algorithm, so as to realize richer functions such as handwriting optimization and strokes that cannot be realized by traditional blackboards, and improve user experience.
  • An embodiment of the present disclosure provides a handwriting input display method, including:
  • the second input being a marking line for highlighting one or more of the first contents, the marking line and one or more of the first contents including an overlapping area ;
  • the method before adjusting the line width of the marking line according to the height of the first content in the overlapping area, the method further includes:
  • the method after receiving the user's second input, the method further includes: branching the first content in the overlapping area; or, after receiving the user's first input , the method further includes: branching the first content;
  • the adjusting the line width of the marking line according to the height of the first content in the overlapping area includes: adjusting the overlapping with the first content in each line in the overlapping area according to the height of the first content in each line in the overlapping area.
  • the linewidth of the marker line includes: adjusting the overlapping with the first content in each line in the overlapping area according to the height of the first content in each line in the overlapping area.
  • the handwriting point information is divided into multiple arrays, and each array includes attribute information of multiple handwriting points in a stroke, and the attribute information includes X-axis coordinates, Y-axis coordinates, pen-up marks
  • the one stroke is the writing track between pen down and pen up.
  • the branching the first content in the overlapping area includes:
  • the first content overlapping with the same marking line is located in the same row, and the first content overlapping with a different marking line is located in a different line.
  • the branching the first content includes:
  • the handwriting point information of the first content establish a third coordinate axis according to the acquired handwriting point information, the abscissa of the third coordinate axis is the Y-axis coordinate of the handwriting point, and the ordinate of the third coordinate axis is The number of handwriting points corresponding to the Y-axis coordinates of the handwriting points;
  • the first content includes one or more characters and/or graphics
  • calculating the height of the first content in the overlapping area according to the acquired handwriting point information includes:
  • the method further includes: using a neural network to identify the first content in the overlapping area.
  • the calculating the height of each character and/or figure in the overlapping area includes:
  • the abscissa of the first coordinate axis is the X-axis coordinate of the handwriting point
  • the first The ordinate of the coordinate axis is the Y-axis coordinate of the handwriting point
  • the two handwriting points are the handwriting points of a character and/or figure; when the distance between the abscissas of the two handwriting points When it is greater than the preset distance, it is judged that the two handwriting points are the handwriting points of two characters and/or graphics;
  • the Y-axis coordinates of the largest Y-axis coordinate point and the smallest Y-axis coordinate point are subtracted to obtain the height of each character and/or graphic in the overlapping area .
  • the calculating the height of each character and/or figure in the overlapping area includes:
  • the handwriting point information of the first content in the overlapping area and establish a first coordinate axis and a second coordinate axis according to the acquired handwriting point information
  • the abscissa of the first coordinate axis is the X-axis coordinate of the handwriting point
  • the ordinate of the first coordinate axis is the Y-axis coordinate of the handwriting point
  • the abscissa of the second coordinate axis is the X-axis coordinate of the handwriting point
  • the ordinate of the second coordinate axis is the corresponding The number of handwriting points of the X-axis coordinates of the handwriting points
  • the Y-axis coordinates of the largest Y-axis coordinate point and the smallest Y-axis coordinate point are subtracted to obtain the The height of each character and/or graphic in the overlapping area.
  • the method before receiving the user's second input, the method further includes:
  • calculating the height of the first content in the overlapping area according to the acquired handwriting point information includes:
  • the difference between the highest Y-axis coordinate and the lowest Y-axis coordinate of the one or more strokes is used as the height of the first content in the overlapping area.
  • adjusting the line width of the marking line according to the height of the first content in the overlapping area includes:
  • the adjusted line width of the marking line is K1*h L , K1 is a real number between 0.5 and 1.5, and h L is the height of the first content of the line.
  • K1 is between 1/3 and 5/6.
  • the adjusted marking line is centered on the center line of the first content in each row along the ordinate direction, or the marking line before adjustment is centered.
  • An embodiment of the present disclosure also provides a handwriting input display device, including a touch screen, a processor, and a memory; wherein, the touch screen is used to interact with the user; the processor reads the The stored executable program code is used to run a program corresponding to the executable program code, so as to realize the handwriting input display method as described in any one of the preceding items.
  • An embodiment of the present disclosure also provides a computer-readable storage medium, where one or more programs are stored on the computer-readable storage medium, and the one or more programs can be executed by one or more processors to realize The steps of the handwriting input display method as described in any one of the preceding items.
  • FIG. 1 is a schematic flowchart of a handwriting input display method according to an embodiment of the present disclosure
  • FIGS. 2a to 2c are schematic diagrams of several first inputs and second inputs according to embodiments of the present disclosure
  • FIG. 3a to FIG. 3d are schematic diagrams of several transformed marking lines according to embodiments of the present disclosure.
  • FIG. 4a and FIG. 4b are structural schematic diagrams of two handwriting input display devices provided by exemplary embodiments of the present disclosure.
  • FIG. 4c and FIG. 4d are schematic diagrams of an application scenario and an application process of a handwriting input display method according to an embodiment of the present disclosure
  • Fig. 5 is a schematic structural diagram of another handwriting input display device provided by an exemplary embodiment of the present disclosure.
  • Interactive electronic whiteboard is a conference or educational auxiliary human-computer interaction device, which can realize dust-free writing, remote conference and other functions.
  • the interactive electronic whiteboard integrates functions such as a computer, a player, a projector, and an electronic writing board.
  • the content written on the electronic writing board can be saved as PDF or multiple image formats, which is more convenient for transmission and storage.
  • the content written on the electronic writing board can record handwriting points, and the writing content can be optimized according to the handwriting point analysis algorithm, so as to realize richer functions such as handwriting optimization and strokes that cannot be realized by traditional blackboards, and improve user experience.
  • Electronic whiteboard marker pen also known as marker pen, is a kind of high-transparency color pen specially used for writing or drawing. It is often used to mark and highlight a piece of text in writing scenes for highlighting.
  • the marker pen function is added to the writing board software of the electronic whiteboard. Users can select this mode and draw a paragraph of text to achieve the goal of highlighting the text.
  • the width of the existing marker pens cannot be adjusted automatically. Users need to manually adjust the thickness of the marker pens according to the size of the written text, and then use the marking function after selecting the thickness. Every time you use it, you need to adjust the width of the marker pen according to the size of the text. Poor convenience.
  • FIG. 1 is a schematic flowchart of a method for displaying handwriting input provided by an embodiment of the present disclosure.
  • the method can be applied to electronic devices with electronic tablet functions such as desktop computers, notebook computers, smart phones, and tablet computers.
  • this method can be applied to the electronic writing board software installed in the above-mentioned electronic equipment, or can be applied to a browser in the form of a webpage, and when the user opens the corresponding webpage in the browser for writing or displaying,
  • the handwriting input display method of the embodiment of the present disclosure is automatically invoked.
  • the hardware composition of the electronic whiteboard includes: touch screen, camera, speaker, microphone, PC (Personal Computer) module, software (writing pad software, video conferencing, etc.), operating system, interface (including high-definition multimedia Interface (High Definition Multimedia Interface, HDMI), Universal Serial Bus (Universal Serial Bus, USB), VGA (Video Graphics Array), etc.), integrated motherboard, etc.
  • the handwriting input display method includes the following steps:
  • Step 101 Receive and display a first input from a user.
  • the first input may be one or more first contents input by handwriting.
  • the first content may be identified as one or more characters and/or graphics through a neural network (for example, a recurrent neural network (Recurrent Neural Network, RNN), etc.).
  • a neural network for example, a recurrent neural network (Recurrent Neural Network, RNN), etc.
  • the characters may include words, letters, numbers, arithmetic symbols, punctuation marks, and any other special characters.
  • special characters are symbols that are used less frequently than traditional or commonly used symbols and are difficult to directly input.
  • the first input may include one line of characters and/or graphics, or multiple lines of characters and/or graphics, as shown in FIG. 2a, FIG. 2b or FIG. 2c.
  • the handwriting input display method of the embodiments of the present disclosure may not recognize the first content through a neural network, but only regard the first content as one or more strokes (ie, writing traces).
  • the method before receiving the user's first input, the method further includes: in response to the user's first operation, setting the input mode of the whiteboard marker to the writing mode.
  • writing mode users can use whiteboard pens to input characters and/or graphics etc. on the interactive electronic whiteboard.
  • Step 102 Receive and display a second input from the user.
  • the second input may be a marking line for highlighting one or more first contents, and the marking line and the one or more first contents contain an overlapping area.
  • the marking line is displayed on one or more characters and/or graphics in a transparent state or a semi-transparent state, as shown in FIG. 2a, FIG. 2b or FIG. 2c.
  • the marking line may be a straight line, a curved line, a broken line, and the like.
  • the method before receiving the user's second input, the method further includes: in response to the user's second operation, setting the input mode of the whiteboard marker to a marker pen mode.
  • the marker pen mode is used to mark the content that needs to be marked, and the marker pen defaults to a thinner handwriting.
  • Step 103 Adjust the line width of the marking line according to the height of the first content in the overlapping area.
  • the height of the first content refers to the difference between the Y-axis coordinate of the highest handwriting point and the Y-axis coordinate of the lowest handwriting point among the multiple handwriting points of the first content.
  • the line width of a marking line refers to the width of the marking line in a direction perpendicular to the extending direction of the marking line. Exemplarily, when the marking line extends along the X-axis direction, the line width of the marking line refers to the width of the marking line along the extending direction of the Y-axis.
  • the width of the marking pen handwriting can be automatically adjusted without the writer's perception, solving the problem of marking.
  • the pen handwriting is too thin to reflect the key points of the mark, or the writing width of the marker pen needs to be adjusted continuously to match the technical problem of the height of the written text. Users do not need to manually adjust the thickness of the marker pen handwriting according to the size of the written text, which greatly improves the writer's writing experience.
  • the method before adjusting the line width of the marking line according to the height of the first content in the overlapping area, the method further includes:
  • the height of the first content in the overlapping area may be calculated by the computing module of the handwriting input display device itself, or the height of the first content in the overlapping area may be calculated by the first server connected to the handwriting input display device, This disclosure does not limit this.
  • the handwriting point information is divided into multiple arrays, each array includes attribute information of multiple handwriting points in a stroke, and the attribute information includes X-axis coordinates, Y-axis coordinates, pen-up flags, and the like.
  • the attribute information of multiple handwriting points in one stroke forms an array.
  • the Chinese character "one” includes a stroke "horizontal”, and this stroke can include about 100 handwriting points.
  • Each handwriting The attribute information of the point includes X-axis coordinates, Y-axis coordinates, a pen-up flag, and the like.
  • the attribute information may also include time stamp, pressure information, speed information and so on.
  • the method further includes: branching the first content in the overlapping area.
  • the method further includes: branching the first content.
  • the overlapping area includes multiple lines of characters and/or graphics, and the row to which the characters and/or graphics in the overlapping area belong can be distinguished in combination with a row-by-line operation method.
  • the row-by-row operation method may refer to some existing row-by-row operation methods.
  • the row-by-row operation may be performed according to the density of coordinate points, which is not limited in the present disclosure.
  • branching the first content in the overlapping area includes:
  • the first content overlapping with the same marking line is located in the same row, and the first content overlapping with a different marking line is located in a different line.
  • branching the first content includes:
  • the abscissa of the third coordinate axis is the Y-axis coordinate of the handwriting point
  • the ordinate of the third coordinate axis is the Y-axis of the corresponding handwriting point
  • the coordinate points in the third coordinate axis are fitted to the second curve, and the handwriting points between adjacent troughs on the second curve are determined to be in the same row.
  • the branching method in this embodiment is applicable to the first content in overlapping areas, and is also applicable to the first content in non-overlapping areas.
  • the first content includes one or more characters and/or graphics
  • calculating the height of the first content in the overlapping area according to the acquired handwriting point information includes:
  • the height of the first content in each row is calculated according to the height of each character and/or graphic (for example, the height may be an average height or an actual height).
  • the method further includes: using a neural network to identify the first content in the overlapping area.
  • the average height of the row of characters and/or graphics is
  • the line width of the marking line overlapping each row of the first content is adjusted according to the height of each row of the first content in the overlapping area.
  • calculating the height of each character and/or graphic in the overlapping area includes:
  • the abscissa of the first coordinate axis is the X-axis coordinate of the handwriting point
  • the ordinate of the first coordinate axis is the handwriting point
  • the two handwriting points are judged to be the handwriting points of a character and/or graphic; when the distance between the abscissas of the two handwriting points is greater than When the spacing is preset, it is judged that the two handwriting points are the handwriting points of two characters and/or graphics;
  • the size of the preset spacing may be determined according to the size of the actual handwriting input area and the average height of each line of characters and/or graphics, which is not limited in this embodiment of the present disclosure.
  • calculating the height of each character and/or figure in the overlapping area includes:
  • the handwriting point information of the first content in the overlapping area establish the first coordinate axis and the second coordinate axis according to the acquired handwriting point information, the abscissa of the first coordinate axis is the X-axis coordinate of the handwriting point, and the first coordinate axis
  • the ordinate is the Y-axis coordinate of the handwriting point
  • the abscissa of the second coordinate axis is the X-axis coordinate of the handwriting point
  • the ordinate of the second coordinate axis is the handwriting point quantity of the X-axis coordinate of the corresponding handwriting point
  • the Y-axis coordinates of the largest Y-axis coordinate point and the smallest Y-axis coordinate point are subtracted to obtain each The height of characters and/or graphics.
  • adjusting the line width of the marking line according to the height of the first content in the overlapping area includes:
  • the adjusted line width of the marking line is K1*h L , 0.5 ⁇ K1 ⁇ 1.5, h L is the height of the first content of a line, as shown in Figure 3a, 3b or 3d Show.
  • K1 is between 1/3 and 5/6.
  • K1 2/3.
  • the adjusted marking line is centered on the center line of the first content of each row along the ordinate direction, or the pre-adjusted marking line is centered.
  • the shape of the adjusted marking line may be similar to or different from the shape of the pre-adjusting marking line, for example, the adjusted marking line may be uniformly changed into a straight line, as shown in FIG. 3a, or the same as
  • the shape of the marking line before adjustment is similar, that is, if the shape of the marking line before adjustment is a curve or a broken line, the adjusted marking line is still a curve or a broken line, as shown in FIG. 3b.
  • the method before receiving the user's second input, the method further includes:
  • the characters of the standard font may include standard fonts such as KaiTi, SongTi, Times New Roman, and Arial.
  • the graphics of the standard body can include rectangles, squares, triangles, circles, ellipses, regular pentagons, regular hexagons, parallelograms, and the like.
  • a correspondence table of the average height of the first input characters and/or graphics and the adjusted sizes of the characters and/or graphics of the standard body may be preset.
  • the size of the characters of the adjusted standard body is set to be font size four; when the first When the average height of the input characters is between 1/8 and 1/6 of the height of the handwriting input area of the electronic whiteboard, the adjusted size of the characters in the standard font is set as a font size three.
  • calculating the height of the first content in the overlapping area according to the acquired handwriting point information includes:
  • the determined difference between the highest Y-axis coordinate and the lowest Y-axis coordinate is used as the height of the first content in the overlapping area.
  • the neural network does not need to identify the first content, but only needs to regard the first content as a writing track composed of individual strokes, which greatly simplifies the calculation process, and the accuracy rate is basically not affected.
  • the handwriting input display device may include a writing module 401 and a first algorithm module 402; - input and display, the first input is one or more first contents input by handwriting, receive and display the user's second input, the second input is a marking line for highlighting one or more first contents, The marking line and one or more first contents contain an overlapping area; the first algorithm module 402 is configured to adjust the line width of the marking line according to the height of the first content in the overlapping area.
  • the first algorithm module 402 is further configured to acquire handwriting point information of the first content in the overlapping area; and calculate the height of the first content in the overlapping area according to the acquired handwriting point information.
  • the handwriting input display device further includes a first network module, and the first network module is configured to transmit the acquired handwriting point information to the first server; receive the first The calculation result of the server, the calculation result is the height of the first content in the overlapping area.
  • the first algorithm module does not need to calculate the height of the first content in the overlapping area according to the acquired handwriting point information, but only needs to adjust the line width of the marking line according to the calculation result of the first server.
  • the handwriting point information can be divided into multiple arrays, each array includes attribute information of multiple handwriting points in a stroke, and the attribute information includes X-axis coordinates, Y-axis coordinates, pen-up flags wait.
  • the first algorithm module 402 is further configured to: branch the first content in the overlapping area.
  • the first server may also branch the first content in the overlapping area.
  • the first content is one or more characters and/or graphics; calculating the height of the first content in the overlapping area according to the obtained handwriting point information includes:
  • the method further includes: using a neural network to identify the first content in the overlapping area.
  • calculating the height of the first content in the overlapping area according to the acquired handwriting point information includes:
  • the difference between the highest Y-axis coordinate and the lowest Y-axis coordinate of one or more strokes is used as the height of the first content in the overlapping area.
  • the first algorithm module 402 calculates the height of each character and/or figure in the overlapping area, including:
  • the abscissa of the first coordinate axis is the X-axis coordinate of the handwriting point
  • the ordinate of the first coordinate axis is the handwriting point
  • adjusting the line width of the marking line according to the height of the first content in the overlapping area includes:
  • the adjusted line width of the marked line is K1*h L , where K1 is a real number between 0.5 and 1.5, and h L is the height of the first content of a line.
  • K1 is between 1/3 and 5/6.
  • the adjusted marking line is centered on the center line of the first content of each row along the ordinate direction, or the pre-adjusted marking line is centered.
  • the writing module 401 before receiving the user's second input, is further configured to: convert the first input characters and/or graphics into standard body characters and/or graphics, and The average height of the characters and/or graphics, adjust the size of the characters and/or graphics of the standard body.
  • the handwriting input display device is applied to an application scenario composed of an interactive electronic whiteboard and a first server, wherein, as shown in FIG. 4c, the interactive electronic whiteboard includes a writing module, a first algorithm module and The first network module, the first server includes a second network module and a second algorithm module, as shown in Figure 4d, the handwriting input display method includes the following steps:
  • Conference participant M writes one or more lines of text on the writing module of the interactive electronic whiteboard.
  • Conference participant M or N activates the marker pen (that is, marker pen) function on the whiteboard, and draws the marker pen across a certain line/multiple lines of text to draw out the content that needs to be marked.
  • the marker pen defaults to thinner handwriting.
  • the first algorithm module of the interactive electronic whiteboard calculates the range of the characters drawn by the marker pen, and uploads the handwriting point data of the characters in this range to the first server through the first network module.
  • the algorithm server calculates the average height h L1 , h L2 , ..., h Ln of each line of text by using the method of branch calculation, and then returns it to the interactive electronic whiteboard.
  • the first server transmits the average height data to the first network module of the interactive electronic whiteboard through the second network module, and the first network module transmits the data to the first algorithm module.
  • An embodiment of the present disclosure also provides a handwriting input display device, the handwriting input display device may include a touch screen, a processor and a memory; wherein, the touch screen is used to interact with the user; the processor reads the The stored executable program code is used to run a program corresponding to the executable program code, so as to realize any one of the handwriting input display methods above.
  • the handwriting input display device may include: a processor 510, a memory 520, a bus system 530 and a touch screen 540, wherein the processor 510, the memory 520 and the touch screen 540 Connected through the bus system 530 , the memory 520 is used to store instructions, and the processor 510 is used to execute the instructions stored in the memory 520 to control the touch screen 540 to receive user input or display.
  • the touch screen 540 may receive and display the first input of the user under the control of the processor 510, where the first input is one or more first contents input by handwriting; receive and display the second input of the user,
  • the second input is a marking line for highlighting one or more first contents, the marking line and the one or more first contents contain an overlapping area, and the adjusted line width of the marking line is displayed through the touch screen.
  • the processor 510 can be a central processing unit (Central Processing Unit, CPU), and the processor 510 can also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASICs), off-the-shelf programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
  • a general-purpose processor may be a microprocessor, or the processor may be any conventional processor, or the like.
  • Memory 520 may include read-only memory and random-access memory, and provides instructions and data to processor 510 .
  • a portion of memory 520 may also include non-volatile random access memory.
  • memory 520 may also store device type information.
  • bus system 530 may also include a power bus, a control bus, and a status signal bus. However, for clarity of illustration, the various buses are labeled as bus system 530 in FIG. 5 .
  • the processing performed by the processing device may be completed by an integrated logic circuit of hardware in the processor 510 or instructions in the form of software. That is, the method steps in the embodiments of the present disclosure may be implemented by a hardware processor, or by a combination of hardware and software modules in the processor.
  • the software module may be located in storage media such as random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers, and the like.
  • the storage medium is located in the memory 520, and the processor 510 reads the information in the memory 520, and completes the steps of the above method in combination with its hardware. To avoid repetition, no detailed description is given here.
  • An embodiment of the present disclosure also provides a computer-readable storage medium, the computer-readable storage medium stores executable instructions, and when the executable instructions are executed by a processor, the handwriting input display provided by any of the above-mentioned embodiments of the present disclosure can be realized.
  • the handwriting input display method can adjust the line width of the marking line according to the height of the first content in the overlapping area, and can automatically adjust the width of the marker handwriting without the writer's perception, so as to solve the problem of marker handwriting.
  • the method for driving the handwriting input display device to display the handwriting input by executing executable instructions is basically the same as the method for displaying the handwriting input provided by the above-mentioned embodiments of the present disclosure, and will not be repeated here.
  • the handwriting input display method, device, and computer storage medium provided by the embodiments of the present disclosure adjust the line width of the marking line according to the height of the first content in the overlapping area, and can automatically adjust the marking pen handwriting without the writer's perception
  • the width of the marker pen solves the technical problem that the marking pen is too thin to reflect the key points, or the width of the marker pen’s handwriting needs to be adjusted continuously to match the height of the written text. Users do not need to manually adjust the thickness of the marker pen’s handwriting according to the size of the written text. Improve the writer's writing experience.
  • the functional modules/units in the system, and the device can be implemented as software, firmware, hardware, and an appropriate combination thereof.
  • the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be composed of several physical components. Components cooperate to execute.
  • Some or all of the components may be implemented as software executed by a processor, such as a digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit.
  • Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media).
  • computer storage media includes both volatile and nonvolatile media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules, or other data. permanent, removable and non-removable media.
  • Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cartridges, tape, magnetic disk storage or other magnetic storage devices, or can Any other medium used to store desired information and which can be accessed by a computer.
  • communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media .

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

一种手写输入显示方法及装置、计算机可读存储介质，所述手写输入显示方法包括：接收用户的第一输入并显示，所述第一输入为以手写方式输入的一个或多个第一内容；接收用户的第二输入并显示，所述第二输入为用于突出显示一个或多个所述第一内容的标记线，所述标记线与一个或多个所述第一内容包含交叠区域；根据所述交叠区域的第一内容的高度，调整所述标记线的线宽。

Description

手写输入显示方法及装置、计算机可读存储介质 技术领域
本公开实施例涉及但不限于计算机应用技术领域，尤指一种手写输入显示方法及装置、计算机可读存储介质。
背景技术
交互式电子白板是一种会议或者教育辅助人机交互设备，能实现无尘书写、远程会议等功能。交互式电子白板融合了电脑、播放器、投影仪、电子写字板等功能。通过电子写字板书写的内容可以保存成PDF(Portable Document Format)或者多种图片格式，更便于传播和存储。此外，电子写字板书写的内容可以记录笔迹点，并根据笔迹点分析算法对书写内容进行优化，实现传统黑板无法实现的更加丰富的如笔迹优化、笔锋等功能，提升了用户体验。
发明内容
以下是对本文详细描述的主题的概述。本概述并非是为了限制权利要求的保护范围。
本公开实施例提供了一种手写输入显示方法，包括：
接收用户的第一输入并显示，所述第一输入为以手写方式输入的一个或多个第一内容；
接收用户的第二输入并显示，所述第二输入为用于突出显示一个或多个所述第一内容的标记线，所述标记线与一个或多个所述第一内容包含交叠区域；
根据所述交叠区域的第一内容的高度，调整所述标记线的线宽。
在一些示例性实施例中，在根据所述交叠区域的第一内容的高度，调整所述标记线的线宽之前，所述方法还包括：
获取所述交叠区域的第一内容的笔迹点信息；
根据获取的笔迹点信息计算所述交叠区域的第一内容的高度。
在一些示例性实施例中，在所述接收用户的第二输入之后，所述方法还包括：对所述交叠区域的第一内容进行分行；或者，在所述接收用户的第一输入之后，所述方法还包括：对所述第一内容进行分行；
所述根据所述交叠区域的第一内容的高度，调整所述标记线的线宽，包括：根据所述交叠区域的每行第一内容的高度，调整与每行第一内容交叠的所述标记线的线宽。
在一些示例性实施例中，所述笔迹点信息分成多个数组，每个数组包括一个笔画中的多个笔迹点的属性信息，所述属性信息包括X轴坐标、Y轴坐标、抬笔标志位，所述一个笔画为一次落笔到抬笔之间的书写轨迹。
在一些示例性实施例中，所述对所述交叠区域的第一内容进行分行，包括：
获取所述标记线的笔迹点信息，根据所述标记线的抬笔标志位信息确定所述标记线的条数；
获取所述交叠区域的第一内容的笔迹点信息；
根据所述标记线与所述第一内容的坐标信息，确定与同一条标记线交叠的第一内容位于同一行，与不同标记线交叠的第一内容位于不同行。
在一些示例性实施例中，所述对第一内容进行分行，包括：
获取所述第一内容的笔迹点信息，根据获取的笔迹点信息建立第三坐标轴，所述第三坐标轴的横坐标为笔迹点的Y轴坐标，所述第三坐标轴的纵坐标为对应笔迹点的Y轴坐标的笔迹点数量；
将所述第三坐标轴中的坐标点拟合成第二曲线，确定所述第二曲线上相邻波谷之间的笔迹点位于同一行。
在一些示例性实施例中，所述第一内容包括一个或多个字符和/或图形，根据获取的笔迹点信息计算所述交叠区域的第一内容的高度，包括：
计算所述交叠区域每个字符和/或图形的高度；
根据每个字符和/或图形的高度计算每行第一内容的高度。
在一些示例性实施例中，所述方法还包括：通过神经网络识别所述交叠区域的第一内容。
在一些示例性实施例中，所述计算所述交叠区域每个字符和/或图形的高度，包括：
获取所述交叠区域的第一内容的笔迹点信息，根据获取的笔迹点信息建立第一坐标轴，所述第一坐标轴的横坐标为所述笔迹点的X轴坐标，所述第一坐标轴的纵坐标为所述笔迹点的Y轴坐标；
当两个笔迹点的横坐标之间的间距小于或等于预设间距时，判断所述两个笔迹点为一个字符和/或图形的笔迹点；当两个笔迹点的横坐标之间的间距大于预设间距时，判断所述两个笔迹点为两个字符和/或图形的笔迹点；
将所述交叠区域的每个字符的多个笔迹点中，最大Y轴坐标点与最小Y轴坐标点的Y轴坐标相减，得到所述交叠区域每个字符和/或图形的高度。
在一些示例性实施例中，所述计算所述交叠区域每个字符和/或图形的高度，包括：
获取所述交叠区域的第一内容的笔迹点信息，根据获取的笔迹点信息建立第一坐标轴和第二坐标轴，所述第一坐标轴的横坐标为所述笔迹点的X轴坐标，所述第一坐标轴的纵坐标为所述笔迹点的Y轴坐标，所述第二坐标轴的横坐标为所述笔迹点的X轴坐标，所述第二坐标轴的纵坐标为对应所述笔迹点的X轴坐标的笔迹点数量；
将所述第二坐标轴中的坐标点拟合成第一曲线，确定所述第一曲线上相邻波谷之间的笔迹点为同一字符和/或图形的笔迹点；
在所述第一坐标轴中，将所述交叠区域的每个字符和/或图形的多个笔迹点中，最大Y轴坐标点与最小Y轴坐标点的Y轴坐标相减，得到所述交叠区域每个字符和/或图形的高度。
在一些示例性实施例中，在接收用户的第二输入之前，所述方法还包括：
将所述第一输入的字符和/或图形转化为标准体的字符和/或图形，并根据所述第一输入的字符和/或图形的平均高度，调整所述标准体的字符和/或图形的大小。
在一些示例性实施例中，根据获取的笔迹点信息计算所述交叠区域的第一内容的高度，包括：
获取与每条标记线交叠的一个或多个笔画；
根据每个笔画的笔迹点信息确定所述一个或多个笔画的最高Y轴坐标与最低Y轴坐标；
将所述一个或多个笔画的最高Y轴坐标与最低Y轴坐标的差值，作为所述交叠区域的第一内容的高度。
在一些示例性实施例中，根据所述交叠区域的第一内容的高度，调整所述标记线的线宽，包括：
调整后的所述标记线的线宽为K1*h L，K1为0.5到1.5之间的实数，h L为所述一行第一内容的高度。
在一些示例性实施例中，K1在1/3到5/6之间。
在一些示例性实施例中，调整后的所述标记线以每行第一内容沿纵坐标方向的中心线为中心，或者，以调整前的所述标记线为中心。
本公开实施例还提供了一种手写输入显示装置，包括触控屏、处理器和存储器；其中，所述触控屏，用于与用户进行交互；所述处理器通过读取所述存储器中存储的可执行程序代码来运行与所述可执行程序代码对应的程序，以用于实现如前任一项所述的手写输入显示方法。
本公开实施例还提供了一种计算机可读存储介质，所述计算机可读存储介质上存储有一个或者多个程序，所述一个或者多个程序可被一个或者多个处理器执行，以实现如前任一项所述的手写输入显示方法的步骤。
在阅读理解了附图和详细描述后，可以明白其他方面。
附图说明
附图用来提供对本公开技术方案的进一步理解，并且构成说明书的一部分，与本公开的实施例一起用于解释本公开的技术方案，并不构成对本公开的技术方案的限制。附图中各部件的形状和大小不反映真实比例，目的只是 示意说明本公开内容。
图1为本公开实施例一种手写输入显示方法的流程示意图；
图2a至图2c为本公开实施例几种第一输入和第二输入的示意图；
图3a至图3d为本公开实施例几种变换后的标记线的示意图；
图4a和图4b为本公开示例性实施例提供的两种手写输入显示装置的结构示意图；
图4c和图4d为本公开实施例的一种手写输入显示方法的应用场景和应用流程示意图；
图5为本公开示例性实施例提供的另一种手写输入显示装置的结构示意图。
具体实施方式
为使本公开的目的、技术方案和优点更加清楚明白，下文中将结合附图对本公开的实施例进行详细说明。注意，实施方式可以以多个不同形式来实施。所属技术领域的普通技术人员可以很容易地理解一个事实，就是方式和内容可以在不脱离本公开的宗旨及其范围的条件下被变换为各种各样的形式。因此，本公开不应该被解释为仅限定在下面的实施方式所记载的内容中。在不冲突的情况下，本公开中的实施例及实施例中的特征可以相互任意组合。
除非另外定义，本公开实施例公开使用的技术术语或者科学术语应当为本公开所属领域内具有一般技能的人士所理解的通常意义。本公开实施例中使用的“第一”、“第二”以及类似的词语并不表示任何顺序、数量或者重要性，而只是用来区分不同的组成部分。“包括”或者“包含”等类似的词语意指出该词前面的元件或物件涵盖出现在该词后面列举的元件或者物件及其等同，而不排除其他元件或者物件。
交互式电子白板是一种会议或者教育辅助人机交互设备，能实现无尘书写、远程会议等功能。交互式电子白板融合了电脑、播放器、投影仪、电子写字板等功能。通过电子写字板书写的内容可以保存成PDF或者多种图片格 式，更便于传播和存储。此外，电子写字板书写的内容可以记录笔迹点，并根据笔迹点分析算法对书写内容进行优化，实现传统黑板无法实现的更加丰富的如笔迹优化、笔锋等功能，提升了用户体验。
电子白板马克笔又名记号笔，是一种书写或绘画专用的透明度较高彩色笔，在书写场景常用于标记、高亮一段文字内容以便突出显示。电子白板的书写板软件中加入马克笔功能，用户可以通过选择此模式，划过一段文字，已达到突出显示此段文字的目标。但是，现有的马克笔笔迹宽度不能自动调节，用户需要根据书写文字的大小手动调整马克笔笔迹粗细，选择粗细后再使用其标记功能，每次使用都需要根据文字大小调节马克笔宽度，操作便捷性差。
图1为本公开实施例所提供的一种手写输入显示方法的流程示意图，该方法可以应用于台式电脑、笔记本电脑、智能手机、平板电脑等具有电子写字板功能的电子设备中。可选地，该方法可以应用于上述电子设备中安装的电子写字板软件中，或者，可以以网页的形式，应用于浏览器中，用户在浏览器中打开相应的网页进行书写或展示时，自动调用本公开实施例的手写输入显示方法。
为便于描述，下述实施例将以本公开实施例的手写输入显示方法应用于交互式电子白板软件中为例，来解释说明本公开。在示例性实施例中，电子白板的硬件构成包括：触控屏、摄像头、扬声器、麦克风、PC(Personal Computer)模块、软件(书写板软件、视频会议等)、操作系统、接口(包括高清多媒体接口(High Definition Multimedia Interface，HDMI)、通用串行总线(Universal Serial Bus，USB)、VGA(Video Graphics Array)等)、集成主板等。
如图1所示，该手写输入显示方法包括以下步骤：
步骤101：接收用户的第一输入并显示，第一输入可以为以手写方式输入的一个或多个第一内容。
在一些示例性实施例中，可以通过神经网络(例如，循环神经网络(Recurrent Neural Network，RNN)等)识别第一内容为一个或多个字符和/ 或图形。
在一些示例性实施例中，字符可以包括文字、字母、数字、运算符号、标点符号以及其他任意的特殊字符等。
本公开实施例中，特殊字符是相对于传统或常用的符号外，使用频率较少且难以直接输入的符号，其种类繁多，示例性的，特殊字符可以包括：数学符号(例如，≈、≡、≠、＝、≤、≥、<、>等)、单位符号(例如，℃、
Figure PCTCN2021126505-appb-000001
﹪、‰、㎡等)、拼音字符(例如，ā、á、ǎ、à、ō、ó、ǒ、ò等)等。
在一些示例性实施例中，第一输入可以包括一行字符和/或图形，也可以包括多行字符和/或图形，如图2a、图2b或图2c所示。
在另一些示例性实施例中，本公开实施例的手写输入显示方法也可以不通过神经网络识别第一内容，而只将第一内容看成一个或多个笔画(即书写轨迹)。
在一些示例性实施例中，在接收用户的第一输入之前，该方法还包括：响应用户的第一操作，设置白板笔的输入模式为书写模式。在书写模式下，用户可以使用白板笔在交互式电子白板上输入字符和/或图形等。
步骤102：接收用户的第二输入并显示，第二输入可以为用于突出显示一个或多个第一内容的标记线，标记线与一个或多个第一内容包含交叠区域。
在一些示例性实施例中，标记线以透明状态或半透明状态显示在一个或多个字符和/或图形上，如图2a、图2b或图2c所示。
在一些示例性实施例中，标记线可以为直线、曲线、折线等。
在一些示例性实施例中，在接收用户的第二输入之前，该方法还包括：响应用户的第二操作，设置白板笔的输入模式为标记笔模式。标记笔模式用于标出需要重点标记的内容，标记笔默认为较细的笔迹。
步骤103：根据交叠区域的第一内容的高度，调整标记线的线宽。
本公开实施例内，第一内容的高度指的是第一内容的多个笔迹点中，最高笔迹点的Y轴坐标与最低笔迹点的Y轴坐标的差值。标记线的线宽指的是该标记线沿垂直于该标记线的延伸方向的宽度。示例性的，当标记线沿X轴 方向延伸时，标记线的线宽指的是该标记线沿Y轴的延伸方向的宽度。
本公开实施例的手写输入显示方法，通过根据交叠区域的第一内容的高度，调整标记线的线宽，能够在书写者无感知的情况下，自动调整马克笔笔迹的宽度，解决了马克笔笔迹过细不能体现标记重点，或者需要不断调整马克笔的笔迹宽度以匹配书写文字高度的技术问题，用户不需要根据书写文字的大小手动调整马克笔笔迹粗细，极大的提升了书写者的书写体验。
在一些示例性实施例中，在根据交叠区域的第一内容的高度，调整标记线的线宽之前，该方法还包括：
获取交叠区域的第一内容的笔迹点信息；
根据获取的笔迹点信息计算交叠区域的第一内容的高度；或者，将获取的笔迹点信息传输至第一服务器；接收第一服务器的计算结果，计算结果为交叠区域的第一内容的高度。
本实施例中，可以由手写输入显示装置本身的运算模块计算交叠区域的第一内容的高度，也可以由与手写输入显示装置连接的第一服务器计算交叠区域的第一内容的高度，本公开对此不作限制。
在一些示例性实施例中，笔迹点信息分成多个数组，每个数组包括一个笔画中的多个笔迹点的属性信息，属性信息包括X轴坐标、Y轴坐标、抬笔标志位等。
本实施例中，一个笔画中的多个笔迹点的属性信息组成一个数组，示例性的，汉字“一”包括一个笔画“横”，这一个笔画可以包括100个左右的笔迹点，每个笔迹点的属性信息包括X轴坐标、Y轴坐标、抬笔标志位等。在另一些示例性实施例中，该属性信息还可以包括时间戳、压力信息、速度信息等。
在一些示例性实施例中，在接收用户的第二输入之后，该方法还包括：对交叠区域的第一内容进行分行。
在另一些示例性实施例中，在接收用户的第一输入之后，该方法还包括：对第一内容进行分行。
如图2b所示，交叠区域包括多行字符和/或图形，可以结合分行运算的方法区分交叠区域的字符和/或图形所属行。本实施例中，分行运算的方法可以参照现有的一些分行运算的方法，示例性的，可以根据坐标点的密集程度进行分行，本公开对此不作限制。
在一些示例性实施例中，对交叠区域的第一内容进行分行，包括：
获取标记线的笔迹点信息，根据标记线的抬笔标志位信息确定标记线的条数；
获取交叠区域的第一内容的笔迹点信息；
根据标记线与第一内容的坐标信息，确定与同一条标记线交叠的第一内容位于同一行，与不同标记线交叠的第一内容位于不同行。
在另一些示例性实施例中，对第一内容进行分行，包括：
获取第一内容的笔迹点信息，根据获取的笔迹点信息建立第三坐标轴，第三坐标轴的横坐标为笔迹点的Y轴坐标，第三坐标轴的纵坐标为对应笔迹点的Y轴坐标的笔迹点数量；
将第三坐标轴中的坐标点拟合成第二曲线，确定第二曲线上相邻波谷之间的笔迹点位于同一行。
本实施例的分行方法适用于交叠区域的第一内容，也适用于非交叠区域的第一内容。
在一些示例性实施例中，第一内容包括一个或多个字符和/或图形，根据获取的笔迹点信息计算交叠区域的第一内容的高度，包括：
计算交叠区域每个字符和/或图形的高度；
根据每个字符和/或图形的高度计算每行第一内容的高度(示例性的，该高度可以为平均高度，也可以为实际高度)。
在一些示例性实施例中，所述方法还包括：通过神经网络识别交叠区域的第一内容。
在一些示例性实施例中，假设交叠区域包括一行字符和/或图形，该行包 括N个字符和/或图形，则该行字符和/或图形的平均高度为
Figure PCTCN2021126505-appb-000002
在一些示例性实施例中，在对第一内容进行分行之后，根据交叠区域的每行第一内容的高度，调整与每行第一内容交叠的标记线的线宽。
在一些示例性实施例中，计算交叠区域每个字符和/或图形的高度，包括：
获取交叠区域的第一内容的笔迹点信息，根据获取的笔迹点信息建立第一坐标轴，第一坐标轴的横坐标为笔迹点的X轴坐标，第一坐标轴的纵坐标为笔迹点的Y轴坐标；
当两个笔迹点的横坐标之间的间距小于或等于预设间距时，判断该两个笔迹点为一个字符和/或图形的笔迹点；当两个笔迹点的横坐标之间的间距大于预设间距时，判断该两个笔迹点为两个字符和/或图形的笔迹点；
将交叠区域的每个字符和/或图形的多个笔迹点中，最大Y轴坐标点与最小Y轴坐标点的Y轴坐标相减，得到交叠区域每个字符和/或图形的高度。
本实施例中，预设间距的大小可以根据实际手写输入区域的大小、每行字符和/或图形的平均高度而定，本公开实施例对此不作限制。
在另一些示例性实施例中，计算交叠区域每个字符和/或图形的高度，包括：
获取交叠区域的第一内容的笔迹点信息，根据获取的笔迹点信息建立第一坐标轴和第二坐标轴，第一坐标轴的横坐标为笔迹点的X轴坐标，第一坐标轴的纵坐标为笔迹点的Y轴坐标，第二坐标轴的横坐标为笔迹点的X轴坐标，第二坐标轴的纵坐标为对应笔迹点的X轴坐标的笔迹点数量；
将第二坐标轴中的坐标点拟合成第一曲线，确定第一曲线上相邻波谷之间的笔迹点为同一字符和/或图形的笔迹点；
在第一坐标轴中，将交叠区域的每个字符和/或图形的多个笔迹点中，最大Y轴坐标点与最小Y轴坐标点的Y轴坐标相减，得到交叠区域每个字符和/或图形的高度。
本实施例中，假设一个字符和/或图形的多个笔迹点中，最大Y轴坐标点为(x1，y1)，最小Y轴坐标点为(x2，y2)，则该字符和/或图形的高度为 h C＝y2-y1。
在一些示例性实施例中，根据交叠区域的第一内容的高度，调整标记线的线宽，包括：
当交叠区域的第一内容包括多行时，根据每行第一内容的高度，调整与每行第一内容对应的标记线的线宽，如图3c所示；
当交叠区域的第一内容为一行时，调整后的标记线的线宽为K1*h L，0.5<K1≤1.5，h L为一行第一内容的高度，如图3a、3b或3d所示。
在一些示例性实施例中，K1在1/3到5/6之间。示例性的，K1＝2/3。
在一些示例性实施例中，调整后的标记线以每行第一内容沿纵坐标方向的中心线为中心，或者，以调整前的标记线为中心。
在一些示例性实施例中，调整后的标记线的形状可以与调整前的标记线的形状相似或不同，例如，可以将调整后的标记线统一变更为直线，如图3a所示，或者与调整前的标记线的形状相似，即，如果调整前的标记线的形状为曲线或折线，调整后的标记线仍然为曲线或折线，如图3b所示。
在一些示例性实施例中，在接收用户的第二输入之前，该方法还包括：
将第一输入的字符和/或图形转化为标准体的字符和/或图形，并根据第一输入的字符和/或图形的平均高度，调整标准体的字符和/或图形的大小。
示例性的，标准体的字符可以包括楷体、宋体、Times New Roman、Arial等标准字体。标准体的图形可以包括矩形、正方形、三角形、圆形、椭圆、正五边形、正六边形、平行四边形等。
示例性的，可以预先设置第一输入的字符和/或图形的平均高度与调整后的标准体的字符和/或图形的大小的对应关系表格。例如，当第一输入的字符的平均高度在电子白板的手写输入区域的高度的1/10到1/8之间时，设置调整后的标准体的字符的大小为四号字体；当第一输入的字符的平均高度在电子白板的手写输入区域的高度的1/8到1/6之间时，设置调整后的标准体的字符的大小为三号字体。
在另一些示例性实施例中，也可以将手写体的字符转换为预先设置的某 个固定字体和字号，这样，电子白板无需自动调整马克笔的笔迹宽度，只需要采取固定宽度的马克笔的笔迹即可。
在另一些示例性实施例中，根据获取的笔迹点信息计算交叠区域的第一内容的高度，包括：
获取与每条标记线交叠的一个或多个笔画；
根据每个笔画的笔迹点信息确定与每条标记线交叠的一个或多个笔画的最高Y轴坐标与最低Y轴坐标；
将确定的最高Y轴坐标与最低Y轴坐标的差值，作为交叠区域的第一内容的高度。
本实施例中，不需要通过神经网络识别第一内容，只需要将第一内容看作一个个笔画组成的书写轨迹，从而大大简化了计算过程，且准确率基本不受影响。
本公开实施例还提供了一种手写输入显示装置，如图4a所示，该手写输入显示装置可包括书写模块401和第一算法模块402；其中，书写模块401，被配置为接收用户的第一输入并显示，第一输入为以手写方式输入的一个或多个第一内容，接收用户的第二输入并显示，第二输入为用于突出显示一个或多个第一内容的标记线，标记线与一个或多个第一内容包含交叠区域；第一算法模块402，被配置为根据交叠区域的第一内容的高度，调整标记线的线宽。
在一些示例性实施例中，第一算法模块402还被配置为，获取交叠区域的第一内容的笔迹点信息；根据获取的笔迹点信息计算交叠区域的第一内容的高度。
在另一些示例性实施例中，如图4b所示，该手写输入显示装置还包括第一网络模块，第一网络模块被配置为，将获取的笔迹点信息传输至第一服务器；接收第一服务器的计算结果，计算结果为交叠区域的第一内容的高度。此时，第一算法模块不需要根据获取的笔迹点信息计算交叠区域的第一内容的高度，只需要根据第一服务器的计算结果，调整标记线的线宽即可。
在一些示例性实施例中，笔迹点信息可以分成多个数组，每个数组包括一个笔画中的多个笔迹点的属性信息，所述属性信息包括X轴坐标、Y轴坐标、抬笔标志位等。
在一些示例性实施例中，第一算法模块402还被配置为：对交叠区域的第一内容进行分行。在另一些示例性实施例中，也可以由第一服务器对交叠区域的第一内容进行分行。
在一些示例性实施例中，第一内容为一个或多个字符和/或图形；根据获取的笔迹点信息计算交叠区域的第一内容的高度，包括：
计算交叠区域每个字符和/或图形的高度；
根据每个字符和/或图形的高度计算每行第一内容的高度。
在一些示例性实施例中，该方法还包括：通过神经网络识别交叠区域的第一内容。
在一些示例性实施例中，根据获取的笔迹点信息计算所述交叠区域的第一内容的高度，包括：
获取与每条标记线交叠的一个或多个笔画；
根据每个笔画的笔迹点信息确定一个或多个笔画的最高Y轴坐标与最低Y轴坐标；
将一个或多个笔画的最高Y轴坐标与最低Y轴坐标的差值，作为交叠区域的第一内容的高度。
在一些示例性实施例中，第一算法模块402计算交叠区域每个字符和/或图形的高度，包括：
获取交叠区域的第一内容的笔迹点信息，根据获取的笔迹点信息建立第一坐标轴，第一坐标轴的横坐标为笔迹点的X轴坐标，第一坐标轴的纵坐标为笔迹点的Y轴坐标；
当两个笔迹点的横坐标之间的间距小于或等于预设间距时，判断两个笔迹点为一个字符和/或图形的笔迹点；当两个笔迹点的横坐标之间的间距大于预设间距时，判断两个笔迹点为两个字符和/或图形的笔迹点；
将交叠区域的每个字符和/或图形的多个笔迹点中，最大Y轴坐标点与最小Y轴坐标点的Y轴坐标相减，得到交叠区域每个字符和/或图形的高度。
在一些示例性实施例中，根据交叠区域的第一内容的高度，调整标记线的线宽，包括：
调整后的标记线的线宽为K1*h L，K1为0.5到1.5之间的实数，h L为一行第一内容的高度。
在一些示例性实施例中，K1在1/3到5/6之间。
在一些示例性实施例中，调整后的标记线以每行第一内容沿纵坐标方向的中心线为中心，或者，以调整前的标记线为中心。
在一些示例性实施例中，在接收用户的第二输入之前，书写模块401还配置为：将第一输入的字符和/或图形转化为标准体的字符和/或图形，并根据第一输入的字符和/或图形的平均高度，调整标准体的字符和/或图形的大小。
在一些示例性实施例中，该手写输入显示装置应用于交互式电子白板和第一服务器组成的应用场景中，其中，如图4c所示，交互式电子白板包括书写模块、第一算法模块和第一网络模块，第一服务器包括第二网络模块和第二算法模块，如图4d所示，该手写输入显示方法包括如下步骤：
会议参与者M在交互式电子白板端书写模块书写一行或多行文字。
会议参与者M或N在白板端启用马克笔(即标记笔)功能，将马克笔划过某行/某多行文字，从而划出需要重点标记的内容，马克笔默认为较细的笔迹。
交互式电子白板的第一算法模块，计算马克笔划过的文字范围，将此范围的文字的笔迹点数据通过第一网络模块上传到第一服务器。
第一服务器的第二网络模块接收到笔迹点数据后，通过第二算法模块计算出此段文字的平均高度h，计算方法为：h L＝∑hi/T(T为本段文字个数，i＝1，2，3，…，T)。若标记的文字为多行，算法服务器运用分行计算的方法分别计算出每行文字的平均高度h L1、h L2、…、h Ln，再返回给交互式电子白板端。
第一服务器将平均高度数据通过第二网络模块传递给交互式电子白板端的第一网络模块，第一网络模块将数据传输给第一算法模块，为兼容文字过大或过小的情况，第一算法模块计算出调整后的马克笔笔迹的宽度为k1＝(2/3)*h L，随后书写模块即刻调整马克笔笔迹的宽度。用户即可体验出马克笔宽度自动调整的效果。
本公开实施例还提供了一种手写输入显示装置，该手写输入显示装置可包括触控屏、处理器和存储器；其中，触控屏，用于与用户进行交互；处理器通过读取存储器中存储的可执行程序代码来运行与可执行程序代码对应的程序，以用于实现如上任一项的手写输入显示方法。
如图5所示，在一个示例中，手写输入显示装置可包括：处理器510、存储器520、总线系统530和触控屏540，其中，该处理器510、该存储器520和该触控屏540通过该总线系统530相连，该存储器520用于存储指令，该处理器510用于执行该存储器520存储的指令，以控制该触控屏540接收用户的输入或者进行显示。具体地，触控屏540可在处理器510的控制下接收用户的第一输入并显示，第一输入为以手写方式输入的一个或多个第一内容；接收用户的第二输入并显示，第二输入为用于突出显示一个或多个第一内容的标记线，标记线与一个或多个第一内容包含交叠区域，并通过触控屏显示调整后的标记线的线宽。
应理解，处理器510可以是中央处理单元(Central Processing Unit，CPU)，处理器510还可以是其他通用处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、现成可编程门阵列(FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。
存储器520可以包括只读存储器和随机存取存储器，并向处理器510提供指令和数据。存储器520的一部分还可以包括非易失性随机存取存储器。例如，存储器520还可以存储设备类型的信息。
总线系统530除包括数据总线之外，还可以包括电源总线、控制总线和 状态信号总线等。但是为了清楚说明起见，在图5中将各种总线都标为总线系统530。
在实现过程中，处理设备所执行的处理可以通过处理器510中的硬件的集成逻辑电路或者软件形式的指令完成。即本公开实施例的方法步骤可以体现为硬件处理器执行完成，或者用处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器，闪存、只读存储器，可编程只读存储器或者电可擦写可编程存储器、寄存器等存储介质中。该存储介质位于存储器520，处理器510读取存储器520中的信息，结合其硬件完成上述方法的步骤。为避免重复，这里不再详细描述。
本公开实施例还提供了一种计算机可读存储介质，该计算机可读存储介质存储有可执行指令，该可执行指令被处理器执行时可以实现本公开上述任一实施例提供的手写输入显示方法，该手写输入显示方法可以通过根据交叠区域的第一内容的高度，调整标记线的线宽，能够在书写者无感知的情况下，自动调整马克笔笔迹的宽度，解决了马克笔笔迹过细不能体现标记重点，或者需要不断调整马克笔的笔迹宽度以匹配书写文字高度的技术问题，用户不需要根据书写文字的大小手动调整马克笔笔迹粗细，极大的提升了书写者的书写体验。通过执行可执行指令驱动手写输入显示装置进行手写输入显示的方法与本公开上述实施例提供的手写输入显示方法基本相同，在此不做赘述。
本公开实施例提供的手写输入显示方法、装置及计算机存储介质，根据交叠区域的第一内容的高度，调整标记线的线宽，能够在书写者无感知的情况下，自动调整马克笔笔迹的宽度，解决了马克笔笔迹过细不能体现标记重点，或者需要不断调整马克笔的笔迹宽度以匹配书写文字高度的技术问题，用户不需要根据书写文字的大小手动调整马克笔笔迹粗细，极大的提升了书写者的书写体验。
本领域普通技术人员可以理解，上文中所公开方法中的全部或某些步骤、系统、装置中的功能模块/单元可以被实施为软件、固件、硬件及其适当的组合。在硬件实施方式中，在以上描述中提及的功能模块/单元之间的划分不一定对应于物理组件的划分；例如，一个物理组件可以具有多个功能，或者一 个功能或步骤可以由若干物理组件合作执行。某些组件或所有组件可以被实施为由处理器，如数字信号处理器或微处理器执行的软件，或者被实施为硬件，或者被实施为集成电路，如专用集成电路。这样的软件可以分布在计算机可读介质上，计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的，术语计算机存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外，本领域普通技术人员公知的是，通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据，并且可包括任何信息递送介质。
虽然本公开所揭露的实施方式如上，但所述的内容仅为便于理解本公开而采用的实施方式，并非用以限定本公开。任何本公开所属领域内的技术人员，在不脱离本公开所揭露的精神和范围的前提下，可以在实施的形式及细节上进行任何的修改与变化，但本公开的保护范围，仍须以所附的权利要求书所界定的范围为准。

Claims (17)

  1. 一种手写输入显示方法，包括：
    接收用户的第一输入并显示，所述第一输入为以手写方式输入的一个或多个第一内容；
    接收用户的第二输入并显示，所述第二输入为用于突出显示一个或多个所述第一内容的标记线，所述标记线与一个或多个所述第一内容包含交叠区域；
    根据所述交叠区域的第一内容的高度，调整所述标记线的线宽。
  2. 根据权利要求1所述的手写输入显示方法，在根据所述交叠区域的第一内容的高度，调整所述标记线的线宽之前，所述方法还包括：
    获取所述交叠区域的第一内容的笔迹点信息；
    根据获取的笔迹点信息计算所述交叠区域的第一内容的高度。
  3. 根据权利要求2所述的手写输入显示方法，在所述接收用户的第二输入之后，所述方法还包括：对所述交叠区域的第一内容进行分行；或者，在所述接收用户的第一输入之后，所述方法还包括：对所述第一内容进行分行；
    所述根据所述交叠区域的第一内容的高度，调整所述标记线的线宽，包括：根据所述交叠区域的每行第一内容的高度，调整与每行第一内容交叠的所述标记线的线宽。
  4. 根据权利要求2所述的手写输入显示方法，其中，所述笔迹点信息分成多个数组，每个数组包括一个笔画中的多个笔迹点的属性信息，所述属性信息包括X轴坐标、Y轴坐标、抬笔标志位，所述一个笔画为一次落笔到抬笔之间的书写轨迹。
  5. 根据权利要求3所述的手写输入显示方法，所述对所述交叠区域的第一内容进行分行，包括：
    获取所述标记线的笔迹点信息，根据所述标记线的抬笔标志位信息确定所述标记线的条数；
    获取所述交叠区域的第一内容的笔迹点信息；
    根据所述标记线与所述第一内容的坐标信息，确定与同一条标记线交叠的第一内容位于同一行，与不同标记线交叠的第一内容位于不同行。
  6. 根据权利要求3所述的手写输入显示方法，所述对所述第一内容进行分行，包括：
    获取所述第一内容的笔迹点信息，根据获取的笔迹点信息建立第三坐标轴，所述第三坐标轴的横坐标为笔迹点的Y轴坐标，所述第三坐标轴的纵坐标为对应笔迹点的Y轴坐标的笔迹点数量；
    将所述第三坐标轴中的坐标点拟合成第二曲线，确定所述第二曲线上相邻波谷之间的笔迹点位于同一行。
  7. 根据权利要求4所述的手写输入显示方法，所述第一内容包括一个或多个字符和/或图形，根据获取的笔迹点信息计算所述交叠区域的第一内容的高度，包括：
    计算所述交叠区域每个字符和/或图形的高度；
    根据每个字符和/或图形的高度计算每行第一内容的高度。
  8. 根据权利要求7所述的手写输入显示方法，所述方法还包括：通过神经网络识别所述交叠区域的第一内容。
  9. 根据权利要求7所述的手写输入显示方法，其中，所述计算所述交叠区域每个字符和/或图形的高度，包括：
    获取所述交叠区域的第一内容的笔迹点信息，根据获取的笔迹点信息建立第一坐标轴，所述第一坐标轴的横坐标为所述笔迹点的X轴坐标，所述第一坐标轴的纵坐标为所述笔迹点的Y轴坐标；
    当两个笔迹点的横坐标之间的间距小于或等于预设间距时，判断所述两个笔迹点为一个字符和/或图形的笔迹点；当两个笔迹点的横坐标之间的间距大于预设间距时，判断所述两个笔迹点为两个字符和/或图形的笔迹点；
    将所述交叠区域的每个字符和/或图形的多个笔迹点中，最大Y轴坐标点 与最小Y轴坐标点的Y轴坐标相减，得到所述交叠区域每个字符和/或图形的高度。
  10. 根据权利要求7所述的手写输入显示方法，其中，所述计算所述交叠区域每个字符和/或图形的高度，包括：
    获取所述交叠区域的第一内容的笔迹点信息，根据获取的笔迹点信息建立第一坐标轴和第二坐标轴，所述第一坐标轴的横坐标为所述笔迹点的X轴坐标，所述第一坐标轴的纵坐标为所述笔迹点的Y轴坐标，所述第二坐标轴的横坐标为所述笔迹点的X轴坐标，所述第二坐标轴的纵坐标为对应所述笔迹点的X轴坐标的笔迹点数量；
    将所述第二坐标轴中的坐标点拟合成第一曲线，确定所述第一曲线上相邻波谷之间的笔迹点为同一字符和/或图形的笔迹点；
    在所述第一坐标轴中，将所述交叠区域的每个字符和/或图形的多个笔迹点中，最大Y轴坐标点与最小Y轴坐标点的Y轴坐标相减，得到所述交叠区域每个字符和/或图形的高度。
  11. 根据权利要求7所述的手写输入显示方法，在接收用户的第二输入之前，所述方法还包括：
    将所述第一输入的字符和/或图形转化为标准体的字符和/或图形，并根据所述第一输入的字符和/或图形的平均高度，调整所述标准体的字符和/或图形的大小。
  12. 根据权利要求4所述的手写输入显示方法，根据获取的笔迹点信息计算所述交叠区域的第一内容的高度，包括：
    获取与每条标记线交叠的一个或多个笔画；
    根据每个笔画的笔迹点信息确定所述一个或多个笔画的最高Y轴坐标与最低Y轴坐标；
    将所述一个或多个笔画的最高Y轴坐标与最低Y轴坐标的差值，作为所述交叠区域的第一内容的高度。
  13. 根据权利要求1所述的手写输入显示方法，其中，根据所述交叠区域的第一内容的高度，调整所述标记线的线宽，包括：
    调整后的所述标记线的线宽为K1*h L，K1为0.5到1.5之间的实数，h L为所述第一内容的高度。
  14. 根据权利要求13所述的手写输入显示方法，其中，K1在1/3到5/6之间。
  15. 根据权利要求1所述的手写输入显示方法，其中，调整后的所述标记线以每行第一内容沿纵坐标方向的中心线为中心，或者，以调整前的所述标记线为中心。
  16. 一种手写输入显示装置，包括触控屏、处理器和存储器；其中，所述触控屏，用于与用户进行交互；所述处理器通过读取所述存储器中存储的可执行程序代码来运行与所述可执行程序代码对应的程序，以用于实现如权利要求1至权利要求15任一项所述的手写输入显示方法。
  17. 一种计算机可读存储介质，所述计算机可读存储介质上存储有一个或者多个程序，所述一个或者多个程序可被一个或者多个处理器执行，以实现如权利要求1至权利要求15任一项所述的手写输入显示方法的步骤。
PCT/CN2021/126505 2021-10-26 2021-10-26 手写输入显示方法及装置、计算机可读存储介质 WO2023070334A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202180003099.9A CN116391164A (zh) 2021-10-26 2021-10-26 手写输入显示方法及装置、计算机可读存储介质
PCT/CN2021/126505 WO2023070334A1 (zh) 2021-10-26 2021-10-26 手写输入显示方法及装置、计算机可读存储介质

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2021/126505 WO2023070334A1 (zh) 2021-10-26 2021-10-26 手写输入显示方法及装置、计算机可读存储介质

Publications (1)

Publication Number Publication Date
WO2023070334A1 true WO2023070334A1 (zh) 2023-05-04

Family

ID=86160263

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/126505 WO2023070334A1 (zh) 2021-10-26 2021-10-26 手写输入显示方法及装置、计算机可读存储介质

Country Status (2)

Country Link
CN (1) CN116391164A (zh)
WO (1) WO2023070334A1 (zh)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1670681A (zh) * 2004-03-19 2005-09-21 微软公司 用于电子高亮器笔和定位设备的自动高度调整
CN104281379A (zh) * 2013-07-08 2015-01-14 中国电信股份有限公司 触摸屏上绘画轨迹的自动调整方法和装置
CN108595054A (zh) * 2018-05-08 2018-09-28 上海彭创教育科技有限公司 一种电子白板系统
CN111352599A (zh) * 2019-05-07 2020-06-30 鸿合科技股份有限公司 一种远程白板的数据处理方法及装置、电子设备

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1670681A (zh) * 2004-03-19 2005-09-21 微软公司 用于电子高亮器笔和定位设备的自动高度调整
CN104281379A (zh) * 2013-07-08 2015-01-14 中国电信股份有限公司 触摸屏上绘画轨迹的自动调整方法和装置
CN108595054A (zh) * 2018-05-08 2018-09-28 上海彭创教育科技有限公司 一种电子白板系统
CN111352599A (zh) * 2019-05-07 2020-06-30 鸿合科技股份有限公司 一种远程白板的数据处理方法及装置、电子设备

Also Published As

Publication number Publication date
CN116391164A (zh) 2023-07-04

Similar Documents

Publication Publication Date Title
US20220357843A1 (en) Handwriting processing method, touch display device, computer device and storage medium
CN109284059B (zh) 笔迹绘制方法、装置、交互智能平板和存储介质
US8600164B2 (en) Method and tool for recognizing a hand-drawn table
US7970812B2 (en) Redistribution of space between text segments
KR20180048774A (ko) 디지털 노트 필기의 시스템 및 방법
CN105488544A (zh) 一种描红临摹笔迹识别的方法及系统
KR102075433B1 (ko) 필기 입력 장치 및 그 제어 방법
KR102347554B1 (ko) 디지털 잉크를 뷰티파잉하기 위한 시스템 및 방법
US10268369B2 (en) Detecting erasure gestures in an electronic presentation system
WO2022166833A1 (zh) 图像处理方法和装置、电子设备和存储介质
US20130106865A1 (en) Device, method and computer program product
EP3610361B1 (en) Multi-stroke smart ink gesture language
US11514696B2 (en) Display device, display method, and computer-readable recording medium
US11137903B2 (en) Gesture-based transitions between modes for mixed mode digital boards
WO2023070334A1 (zh) 手写输入显示方法及装置、计算机可读存储介质
US20180350121A1 (en) Global annotations across contents
WO2022160619A1 (zh) 手写体识别方法及装置、手写体识别系统和交互平板
WO2020056619A1 (zh) 文字书写检错方法、终端设备及存储介质
US10452952B2 (en) Typesetness score for a table
US10409481B2 (en) Adaptive inking in an electronic presentation system
US11789604B2 (en) Handwriting processing method, handwriting processing device and non-transitory storage medium
JP6373664B2 (ja) 電子機器、方法及びプログラム
WO2022160330A1 (zh) 手写体识别方法及装置
US20200225787A1 (en) Stroke-based object selection for digital board applications
CN112181231A (zh) 板书输入方法、系统及装置

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 17921638

Country of ref document: US

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21961710

Country of ref document: EP

Kind code of ref document: A1