CN112306359A - Handwriting display method, device, equipment and storage medium - Google Patents
Handwriting display method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN112306359A CN112306359A CN201910810278.8A CN201910810278A CN112306359A CN 112306359 A CN112306359 A CN 112306359A CN 201910810278 A CN201910810278 A CN 201910810278A CN 112306359 A CN112306359 A CN 112306359A
- Authority
- CN
- China
- Prior art keywords
- handwriting
- image
- target object
- book
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the disclosure discloses a method, a device, equipment and a storage medium for displaying handwriting, wherein the method for displaying the handwriting comprises the following steps: acquiring images of books in real time; judging whether a target object exists in the image or not; determining a motion track of the target object in response to determining that the target object exists in the image; generating handwriting according to the motion trail; rendering the handwriting to the image; and displaying the rendered image. The handwriting display method, the handwriting display device, the terminal and the readable medium are used for realizing interaction between the handwriting and a real book and improving the sense of reality in the writing process.
Description
Technical Field
The embodiment of the disclosure relates to computer technologies, and in particular, to a method, an apparatus, a device, and a storage medium for displaying handwriting.
Background
The handwriting provided by the embodiment of the disclosure can be understood as data information which is collected and displayed by computer equipment and used for simulating the writing effect of physical paper pens.
In the prior art, a handwriting display method generally includes generating handwriting through user operations acting on a mouse, a touch screen, a digitizer and other handwriting input devices; and displaying the handwriting on a user interface. The defects of the existing handwriting display method at least comprise that the handwriting interaction with a real book is lacked, so that the reality sense of the writing process is low.
Disclosure of Invention
In view of this, the embodiments of the present disclosure provide a method, an apparatus, a device, and a storage medium for displaying handwriting, which are used to implement interaction between the handwriting and a real book and improve the sense of reality in the writing process.
In a first aspect, an embodiment of the present disclosure provides a handwriting display method, including:
acquiring images of books in real time;
judging whether a target object exists in the image or not;
in response to determining that the target object is present in the image,
determining a motion track of the target object;
generating handwriting according to the motion trail;
rendering the handwriting to the image; and
and displaying the rendered image.
In a second aspect, an embodiment of the present disclosure provides a display device for handwriting, including:
the image acquisition module is used for acquiring images of books in real time;
the image judging module is used for judging whether a target object exists in the image or not;
a motion track determining module, configured to determine a motion track of the target object in response to determining that the target object exists in the image;
the handwriting generating module is used for generating handwriting according to the motion trail;
the handwriting rendering module is used for rendering the handwriting to the image;
and the handwriting display module is used for displaying the rendered image.
In a third aspect, an embodiment of the present disclosure provides a terminal device, including:
one or more processors;
a memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement a method for presenting writing according to any embodiment of the present disclosure.
In a fourth aspect, the embodiments of the present disclosure provide a computer storage medium, on which a computer program is stored, and when the program is executed by a processor, the method for displaying handwriting according to any embodiment of the present disclosure is implemented.
According to the handwriting display method, the handwriting display device, the handwriting display equipment and the handwriting storage medium, the terminal can acquire images of a book in real time, and when a target object (such as a pen point or a fingertip and other target objects) exists in the images, the motion track of the target object on the book can be determined according to the acquired images in real time; and generating handwriting according to the motion trail, rendering the handwriting to an image, and displaying the rendered image, so that the interaction between the handwriting and a real book is realized, and the sense of reality in the writing process is improved.
Drawings
In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, a brief description will be given below to the drawings required for the embodiments or the technical solutions in the prior art, and it is obvious that the drawings in the following description are some embodiments of the present disclosure, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a flowchart illustrating a handwriting display method according to an embodiment of the present disclosure;
FIG. 2a is a flowchart of a handwriting display method provided by the second embodiment of the disclosure;
FIG. 2b is a flowchart of another handwriting display method provided in the second embodiment of the disclosure;
FIG. 3 is a schematic structural diagram of a handwriting display device provided by a third embodiment of the present disclosure;
fig. 4 shows a schematic diagram of a hardware structure of a terminal device according to a fourth embodiment of the present disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.
It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order, and/or performed in parallel. Moreover, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
The term "include" and variations thereof as used herein are open-ended, i.e., "including but not limited to". The term "based on" is "based, at least in part, on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions for other terms will be given in the following description.
It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence relationship of the functions performed by the devices, modules or units.
It is noted that references to "a", "an", and "the" modifications in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will recognize that "one or more" may be used unless the context clearly dictates otherwise.
The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.
Example one
Fig. 1 shows a flowchart of a handwriting display method provided by an embodiment of the present disclosure, which may be applied to a handwriting display situation, and the method may be implemented by a terminal, and may be implemented by software and/or hardware in the terminal.
As shown in fig. 1, the method for displaying handwriting provided in the embodiment of the present disclosure includes the following steps:
and S110, acquiring images of the book in real time.
The terminal is provided with an image acquisition module (such as a camera), and when the terminal receives an image acquisition instruction, the image acquisition module can be controlled to acquire images of books in real time. The real-time acquisition may be understood as a time interval between two acquisition actions of the camera is short, and the time interval may be preset, for example, 0.03s or 0.05s, and is not specifically limited herein. The image acquisition instruction may be triggered when a physical key or a virtual key preset in the terminal is pressed, may also be triggered when a voice acquisition module of the terminal receives a preset voice, and may also be triggered when a physical key or a virtual key of another terminal in communication connection with the terminal is pressed, which is not specifically limited herein.
And S120, judging whether the target object exists in the image.
The target object may be an object having a tip portion, such as a pen, a user's finger, or a simulated pen configured in advance by the terminal device, and is not limited in this respect. Wherein, the target object can be used for writing on the book without handwriting according to the operation of a user (namely, writing handwriting can not be left on the real book). Whether the target object exists in the image can be judged through a general image recognition algorithm (such as an image recognition algorithm of a neural network).
And S130, responding to the judgment that the target object exists in the image, and determining the motion track of the target object.
When the target object exists in the judgment image, the determination of the motion trail of the target object can be performed in response to the judgment that the target object exists in the image. In the writing process of the target object, the image contains both the book and the target object, the position of the book can be determined according to the image, the relative position of the target object and the position of the book can also be determined, and further the motion trail of the target position can be determined according to the real-time change of the relative position.
Optionally, determining the motion trajectory of the target object includes:
determining a book coordinate system and real-time position coordinates of a target object in the book coordinate system in real time according to the image; and determining the motion track of the target object according to the real-time position coordinates.
Wherein the book coordinate system may be determined by identifying the position of the corner points of the book pages in the image. For example, after the corner point of the book page is identified, the upper left corner point may be used as the origin point of the coordinate system, and the horizontal rightward direction of the corner point may be defined as the positive direction of the horizontal axis, and the vertical downward direction may be defined as the positive direction of the vertical axis. After the book coordinate system is determined, the real-time position coordinates of the target object in the book coordinate system can be determined, and then interpolation processing can be carried out between the real-time position coordinates to obtain the motion track of the target object. By constructing the book coordinate system, the continuous motion track of the target object can be ensured when the book moves.
And S140, generating handwriting according to the motion trail.
Wherein, the motion trajectory may be processed (e.g. smoothed) to obtain a handwriting, so that the handwriting is close to the real handwriting.
Optionally, generating a handwriting according to the motion trajectory includes: and generating handwriting according to the motion trail and the currently selected handwriting parameters.
The motion trail can be modified and rendered according to the handwriting parameters so as to improve the display effect of the handwriting; the currently selected handwriting parameters can be handwriting parameters which are selected in advance before the target object is written, and can also be selected in the writing process of the target object.
Further, the handwriting parameters include at least one of: handwriting style, handwriting thickness, handwriting color and handwriting effect.
The handwriting styles can include, for example, pencils, pens, writing brushes, marker pens, needle pens, ball point pens, and the like; wherein, the thickness of the handwriting can comprise 0.25mm, 0.5mm, 0.7mm, 1.0mm and the like; wherein, the handwriting color is, for example, each color obtained by adjusting RGB values; the handwriting effect may include a static effect and a dynamic effect, and the static effect may include a shadow, an underline, and the like, for example, and the dynamic effect may include a handwriting flick, or a dynamic embellishment added around the handwriting, and the like, for example. The above description of the handwriting style, the handwriting thickness, the handwriting color, and the handwriting effect is only an exemplary example, and is not particularly limited.
And S150, rendering the handwriting to an image.
The handwriting can be superimposed on the image according to the relative position of the motion trail and the book.
And S160, displaying the rendered image.
After the book coordinate system is determined, the image of the superposed handwriting can be displayed on the display screen according to the corresponding relation between the book coordinate system and the display coordinate system of the terminal display screen.
Optionally, rendering the handwriting to an image, including: determining the page curvature of the book according to the image; correcting the image and the handwriting according to the curvature of the page; and rendering the corrected handwriting to the corrected image.
When the book is thick, the page of the book can be bent to a certain degree after the book is opened, and the curvature of the page of the book can be detected according to the image. When the curvature of the page of the book in the image is smaller than or equal to the preset curvature, the page of the book can be regarded as a plane, and the image and the handwriting image can not be corrected; when the curvature of the page of the book is larger than the preset curvature, the page of the book can be considered as a curved surface, and the image and the handwriting image need to be corrected at the moment, so that the image deformation is reduced, and the display effect of the image is improved.
The curvature of the page of the book can be determined by the deformation degree of the book content (such as characters or figures) in the image, and can also be measured by a fringe projection three-dimensional measurement method. And correcting the book content and the handwriting in the image according to the determined page curvature so that the corrected result is close to the book content and the handwriting when the page is a plane. The corrected handwriting is rendered to the corrected image and displayed through the display screen, and the display effect of the image can be improved.
According to the handwriting display method provided by the embodiment of the disclosure, a terminal can acquire images of a book in real time, and when a target object (such as a pen point or a fingertip and other target objects) exists in the images, the motion track of the target object on the book can be determined according to the images acquired in real time; and generating handwriting according to the motion trail, rendering the handwriting to an image, and displaying the rendered image, so that the interaction between the handwriting and a real book is realized, and the sense of reality in the writing process is improved.
Example two
The embodiment enriches the handwriting display method on the basis of the embodiment, which belongs to the same inventive concept as the handwriting display method provided by the embodiment, and the technical details which are not described in detail in the embodiment can be referred to the embodiment.
Optionally, after displaying the rendered image, the method further includes: receiving a modification instruction; and modifying the handwriting rendered to the image according to the modification instruction.
Optionally, after displaying the rendered image, the method further includes: receiving a storage instruction; and storing the rendered image according to the storage instruction.
Fig. 2a shows a flowchart of a method for displaying a handwriting provided in the second embodiment of the present disclosure, where the method for displaying a handwriting provided in the second embodiment of the present disclosure includes the following steps:
s211, collecting images of the book in real time;
s212, judging whether a target object exists in the image or not;
s213, responding to the judgment that the target object exists in the image, and determining the motion track of the target object;
s214, generating handwriting according to the motion trail;
s215, rendering the handwriting to an image;
s216, displaying the rendered image;
s217, receiving a modification instruction;
and S218, modifying the handwriting rendered to the image according to the modification instruction.
Wherein, the modification instruction may include a deletion instruction and a parameter modification instruction; the rendered handwriting can be deleted according to the deletion instruction, and the handwriting parameters of the rendered handwriting can be modified according to the parameter modification instruction, for example, the handwriting style, the handwriting thickness, the handwriting color and/or the handwriting effect of the handwriting can be modified according to the modification instruction. The rendered handwriting can be modified by modifying the instruction, so that the modified handwriting can better meet the requirements of users, and the user experience is improved.
Fig. 2b shows a flowchart of another method for displaying a handwriting according to the second embodiment of the present disclosure, where the method for displaying a handwriting according to the second embodiment of the present disclosure includes the following steps:
s221, collecting images of the book in real time;
s222, judging whether a target object exists in the image or not;
s223, responding to the judgment that the target object exists in the image, and determining the motion track of the target object;
s224, generating handwriting according to the motion trail;
s225, rendering the handwriting to an image;
s226, displaying the rendered image;
s227, receiving a storage instruction;
and S228, storing the rendered image according to the storage instruction.
After the terminal receives the storage instruction, the rendered image can be stored, so that the user can store and look up the handwriting conveniently. Exemplarily, when books are borrow books, the user is not convenient for do the note on books, can write through target object on books no writing this moment to according to writing the trace and generating the handwriting, render the handwriting to borrow books on, and the image of rendering the handwriting is stored up, thereby can be convenient for the user to remain and read the handwriting, improve user experience.
Further, the two method flows provided by the embodiment of the disclosure may also be combined, for example, after the handwriting rendered to the image is modified according to the modification instruction, the storage instruction may be received, and the modified image is stored according to the storage instruction, so as to enrich the display method of the handwriting.
Optionally, the book is a copybook, a problem book or a color-filling picture book.
Wherein, the copybook can be recycled by writing calligraphy practice on the copybook; by making the handwriting on the exercise book, the exercise book can be conveniently used repeatedly by a user for exercise; the pen trace color filling is carried out on the color filling drawing book, so that the color filling drawing book can be recycled. In addition, the book can be other books suitable for handwriting, which is not listed here.
On the basis of the embodiment, the embodiment of the disclosure can modify the handwriting and/or store the image rendered with the handwriting after the image rendered with the handwriting is displayed, and is beneficial to improving user experience. In addition, a specific application scene of the handwriting display method is provided, for example, a user can experience the convenience and the technological sense brought by handwriting in scenes of using copybooks to practice calligraphy, using problem books to do questions, using color filling of color filling sketches and the like, and the handwriting display method is favorable for recycling books. The embodiment of the present disclosure and the method for displaying handwriting proposed by the above embodiment belong to the same inventive concept, and technical details that are not described in detail in the embodiment can be referred to the above embodiment, and the embodiment and the above embodiment have the same beneficial effects.
EXAMPLE III
Fig. 3 shows a structural schematic diagram of a handwriting display device provided by a third embodiment of the present disclosure, which is applicable to a case of displaying handwriting. The handwriting display device provided by the disclosure can be used for realizing the handwriting display method provided by the embodiment.
As shown in fig. 3, the device for displaying handwriting in the embodiment of the present disclosure includes:
an image acquisition module 310, configured to acquire an image of a book in real time;
an image determining module 320, configured to determine whether a target object exists in the image;
a motion trajectory determination module 330, configured to determine a motion trajectory of the target object in response to determining that the target object exists in the image;
a handwriting generating module 340, configured to generate handwriting according to the motion trajectory;
a handwriting rendering module 350 for rendering the handwriting to the image;
and the handwriting display module 360 is used for displaying the rendered image.
Optionally, the motion trajectory determining module includes:
the position coordinate determination submodule is used for determining a book coordinate system and the real-time position coordinate of the target object in the book coordinate system in real time according to the image;
and the motion track determining submodule is used for determining the motion track of the target object according to the real-time position coordinates.
Optionally, the handwriting display module includes:
and the handwriting generating submodule is used for generating handwriting according to the motion trail and the currently selected handwriting parameters.
Further, the handwriting parameters include at least one of: handwriting style, handwriting thickness, handwriting color and handwriting effect.
Optionally, the handwriting display module further includes:
the rendering submodule is used for determining the page curvature of the book according to the image; correcting the image and the handwriting according to the curvature of the page; and rendering the corrected handwriting to the corrected image.
Optionally, the handwriting display device may further include:
the instruction receiving module is used for receiving a modification instruction;
the modification module is used for modifying the handwriting rendered to the image according to the modification instruction; correspondingly, the handwriting display module is also used for displaying the modified image.
Optionally, the instruction receiving module is further configured to receive a storage instruction, and the display apparatus for handwriting may further include:
and the storage module is used for storing the rendered image according to the storage instruction.
Optionally, the book is a copybook, a problem book or a color-filling picture book.
The handwriting display device provided by the embodiment of the disclosure belongs to the same inventive concept as the handwriting display method provided by the embodiment, and technical details which are not described in detail in the embodiment of the disclosure can be referred to the embodiment, and the embodiment of the disclosure has the same beneficial effects as the embodiment.
Example four
Fig. 4 shows a schematic diagram of a hardware structure of a terminal device according to a fourth embodiment of the present disclosure. The terminal device in the embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle terminal (e.g., a car navigation terminal), and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 4 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 4, electronic device 400 may include a processing device (e.g., central processing unit, graphics processor, etc.) 401 that may perform various appropriate actions and processes in accordance with a program stored in a Read-Only Memory (ROM) 402 or a program loaded from a storage device 408 into a Random Access Memory (RAM) 403. In the RAM 403, various programs and data necessary for the operation of the electronic apparatus 400 are also stored. The processing device 401, the ROM 402, and the RAM 403 are connected to each other via a bus 404. An input/output (I/O) interface 405 is also connected to bus 404.
Generally, the following devices may be connected to the I/O interface 405: input devices 406 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; an output device 407 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 408 including, for example, tape, hard disk, etc.; and a communication device 409. The communication means 409 may allow the electronic device 400 to communicate wirelessly or by wire with other devices to exchange data. While fig. 4 illustrates an electronic device 400 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication device 409, or from the storage device 408, or from the ROM 402. The computer program performs the above-described functions defined in the methods of the embodiments of the present disclosure when executed by the processing device 401.
The terminal provided by the embodiment of the present disclosure and the method for displaying handwriting provided by the embodiment belong to the same inventive concept, and technical details that are not described in detail in the embodiment of the present disclosure may be referred to the embodiment, and the embodiment of the present disclosure have the same beneficial effects.
EXAMPLE five
The embodiment of the disclosure provides a computer storage medium, on which a computer program is stored, and when the program is executed by a processor, the method for displaying handwriting provided by the embodiment is implemented.
It should be noted that the computer storage media described above in this disclosure can be computer readable signal media or computer readable storage media or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a Read-Only Memory (ROM), an Erasable Programmable Read-Only Memory (EPROM) or FLASH Memory (FLASH), an optical fiber, a portable compact disc Read-Only Memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.
The computer storage may be contained in the electronic device; or may exist separately without being assembled into the electronic device.
The computer stores one or more programs that, when executed by the electronic device, cause the electronic device to: acquiring images of books in real time; judging whether a target object exists in the image or not; determining a motion track of the target object in response to judging that the target object exists in the image; generating handwriting according to the motion trail; rendering the handwriting to an image; and displaying the rendered image.
Alternatively, the computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: acquiring images of books in real time; judging whether a target object exists in the image or not; determining a motion track of the target object in response to judging that the target object exists in the image; generating handwriting according to the motion trail; rendering the handwriting to an image; and displaying the rendered image.
Computer program code for carrying out operations for aspects of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of an element does not in some cases constitute a limitation on the element itself.
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
According to one or more embodiments of the present disclosure, there is provided a handwriting display method, including: : acquiring images of books in real time; judging whether a target object exists in the image or not; determining a motion track of the target object in response to determining that the target object exists in the image; generating handwriting according to the motion trail; rendering the handwriting to the image; and displaying the rendered image.
According to one or more embodiments of the present disclosure, there is provided a handwriting display method, further including: the determining the motion track of the target object comprises: determining a book coordinate system and real-time position coordinates of a target object in the book coordinate system in real time according to the image; and determining the motion track of the target object according to the real-time position coordinates.
According to one or more embodiments of the present disclosure, there is provided a handwriting display method, further including: generating handwriting according to the motion trail, comprising: and generating handwriting according to the motion trail and the currently selected handwriting parameters.
According to one or more embodiments of the present disclosure, there is provided a handwriting display method, further including: the handwriting parameters include at least one of: handwriting style, handwriting thickness, handwriting color and handwriting effect.
According to one or more embodiments of the present disclosure, there is provided a handwriting display method, further including: the rendering the handwriting to the image includes: determining the page curvature of the book according to the image; correcting the image and the handwriting according to the page curvature; and rendering the corrected handwriting to the corrected image.
According to one or more embodiments of the present disclosure, there is provided a handwriting display method, further including: after the displaying the rendered image, the method further comprises: receiving a modification instruction; and modifying the handwriting rendered to the image according to the modification instruction.
According to one or more embodiments of the present disclosure, there is provided a handwriting display method, further including: after the displaying the rendered image, the method further comprises: receiving a storage instruction; and storing the rendered book image according to the storage instruction.
According to one or more embodiments of the present disclosure, there is provided a handwriting display method, further including: the book is a copybook, a problem book or a color filling drawing book.
According to one or more embodiments of the present disclosure, there is provided a display device of handwriting, including: the image acquisition module is used for acquiring images of books in real time; the image judging module is used for judging whether a target object exists in the image or not; a motion track determining module, configured to determine a motion track of the target object in response to determining that the target object exists in the image; the handwriting generating module is used for generating handwriting according to the motion trail; the handwriting rendering module is used for rendering the handwriting to the image; and the handwriting display module is used for displaying the rendered image.
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.
Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
Claims (11)
1. A handwriting display method is characterized by comprising the following steps:
acquiring images of books in real time;
judging whether a target object exists in the image or not;
in response to determining that the target object is present in the image,
determining a motion track of the target object;
generating handwriting according to the motion trail;
rendering the handwriting to the image; and
and displaying the rendered image.
2. The method of claim 1, wherein determining the motion trajectory of the target object comprises:
determining a book coordinate system and real-time position coordinates of a target object in the book coordinate system in real time according to the image;
and determining the motion track of the target object according to the real-time position coordinates.
3. The method according to claim 1, wherein the generating handwriting from the motion trail comprises: and generating handwriting according to the motion trail and the currently selected handwriting parameters.
4. A method as claimed in claim 3, wherein the handwriting parameters include at least one of: handwriting style, handwriting thickness, handwriting color and handwriting effect.
5. The method of claim 1, wherein the rendering the handwriting to the image comprises:
determining the page curvature of the book according to the image;
correcting the image and the handwriting according to the page curvature;
and rendering the corrected handwriting to the corrected image.
6. The method of any of claims 1-5, further comprising, after said presenting the rendered image:
receiving a modification instruction;
and modifying the handwriting rendered to the image according to the modification instruction.
7. The method of any of claims 1-5, further comprising, after said presenting the rendered image:
receiving a storage instruction;
and storing the rendered image according to the storage instruction.
8. The method of any of claims 1-5, wherein the book comprises a copybook, a problem book, or a color-filled picture book.
9. A device for displaying handwriting, comprising:
the image acquisition module is used for acquiring images of books in real time;
the image judging module is used for judging whether a target object exists in the image or not;
a motion track determining module, configured to determine a motion track of the target object in response to determining that the target object exists in the image;
the handwriting generating module is used for generating handwriting according to the motion trail;
the handwriting rendering module is used for rendering the handwriting to the image;
and the handwriting display module is used for displaying the rendered image.
10. A terminal device, characterized in that the terminal comprises:
one or more processors;
a memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement a method of presenting writing according to any one of claims 1-8.
11. A computer storage medium on which a computer program is stored which, when being executed by a processor, carries out a method of presenting writing according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910810278.8A CN112306359A (en) | 2019-08-29 | 2019-08-29 | Handwriting display method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910810278.8A CN112306359A (en) | 2019-08-29 | 2019-08-29 | Handwriting display method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112306359A true CN112306359A (en) | 2021-02-02 |
Family
ID=74486703
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910810278.8A Pending CN112306359A (en) | 2019-08-29 | 2019-08-29 | Handwriting display method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112306359A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115909342A (en) * | 2023-01-03 | 2023-04-04 | 湖北瑞云智联科技有限公司 | Image mark recognition system and method based on contact point motion track |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104834467A (en) * | 2015-04-14 | 2015-08-12 | 广东小天才科技有限公司 | Method and system for sharing handwriting in paper page |
| CN105988568A (en) * | 2015-02-12 | 2016-10-05 | 北京三星通信技术研究有限公司 | Method and device for acquiring note information |
-
2019
- 2019-08-29 CN CN201910810278.8A patent/CN112306359A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105988568A (en) * | 2015-02-12 | 2016-10-05 | 北京三星通信技术研究有限公司 | Method and device for acquiring note information |
| CN104834467A (en) * | 2015-04-14 | 2015-08-12 | 广东小天才科技有限公司 | Method and system for sharing handwriting in paper page |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115909342A (en) * | 2023-01-03 | 2023-04-04 | 湖北瑞云智联科技有限公司 | Image mark recognition system and method based on contact point motion track |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110058685B (en) | Virtual object display method and device, electronic equipment and computer-readable storage medium | |
| CN112929582A (en) | Special effect display method, device, equipment and medium | |
| CN111399729A (en) | Image drawing method and device, readable medium and electronic equipment | |
| CN111638791B (en) | Virtual character generation method and device, electronic equipment and storage medium | |
| CN112051961A (en) | Virtual interaction method and device, electronic equipment and computer readable storage medium | |
| CN110069191B (en) | Terminal-based image dragging deformation implementation method and device | |
| CN111783508A (en) | Method and apparatus for processing image | |
| CN110766772A (en) | Flatter-based cross-platform poster manufacturing method, device and equipment | |
| CN112131926A (en) | Recording method and device of dot matrix writing content and electronic equipment | |
| CN110969159B (en) | Image recognition method and device and electronic equipment | |
| CN114401443B (en) | Special effect video processing method and device, electronic equipment and storage medium | |
| CN114842120A (en) | Image rendering processing method, device, equipment and medium | |
| CN114742856A (en) | Video processing method, device, equipment and medium | |
| CN111862349A (en) | Virtual brush implementation method and device and computer readable storage medium | |
| WO2022099871A1 (en) | Handwriting data processing method and apparatus, and electronic device | |
| CN112306359A (en) | Handwriting display method, device, equipment and storage medium | |
| CN112132859A (en) | Sticker generation method, apparatus, medium, and electronic device | |
| CN112231023A (en) | Information display method, device, equipment and storage medium | |
| CN111459443A (en) | Character point-reading method, device, equipment and readable medium | |
| CN112492399A (en) | Information display method and device and electronic equipment | |
| WO2022016653A1 (en) | Dot-matrix writing content recording method and apparatus, and electronic device | |
| CN112788426A (en) | Display method, device, medium and electronic equipment of function display area | |
| CN112308745A (en) | Method and apparatus for generating information | |
| CN112382147B (en) | Method, device, medium and electronic equipment for adjusting function display area | |
| CN112492381B (en) | Information display method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210202 |
|
| RJ01 | Rejection of invention patent application after publication |