WO2023029125A1 - 笔迹位置的确定方法、装置、终端设备及存储介质 - Google Patents

笔迹位置的确定方法、装置、终端设备及存储介质 Download PDF

Info

Publication number
WO2023029125A1
WO2023029125A1 PCT/CN2021/120025 CN2021120025W WO2023029125A1 WO 2023029125 A1 WO2023029125 A1 WO 2023029125A1 CN 2021120025 W CN2021120025 W CN 2021120025W WO 2023029125 A1 WO2023029125 A1 WO 2023029125A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
writing
handwriting
electronic document
target electronic
Prior art date
Application number
PCT/CN2021/120025
Other languages
English (en)
French (fr)
Inventor
苏臻
Original Assignee
广东艾檬电子科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广东艾檬电子科技有限公司 filed Critical 广东艾檬电子科技有限公司
Publication of WO2023029125A1 publication Critical patent/WO2023029125A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/14—Image acquisition
    • G06V30/146—Aligning or centring of the image pick-up or image-field
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/32—Digital ink
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied

Definitions

  • the present application relates to the field of image acquisition technology, and in particular to a method, device, terminal device and storage medium for determining a handwriting position.
  • the installed camera is used to collect the content written by the user to obtain the handwriting of the user.
  • the user first writes and completes the homework, and then scans with an electronic pen or a camera on the terminal device, so as to obtain the writing result of the user.
  • the main technology used is the scheme of cooperation between the electronic backing board and the electromagnetic pen.
  • Embodiments of the present application provide a handwriting position determination method, device, terminal device, and storage medium, which can improve the accuracy of the terminal device in determining the handwriting position.
  • an embodiment of the present application provides a method for determining a handwriting position, the method is executed by the terminal device, and there is a communication connection between the terminal device and the electronic pad, and the method includes:
  • the target electronic document and the first position information determine the second position information of the current handwriting in the target electronic document.
  • the determining the target electronic document corresponding to the writing medium according to the first image information includes:
  • the feature information includes at least one of target graphics and/or target keywords
  • the target electronic document corresponding to the feature information query the target electronic document corresponding to the feature information.
  • the acquiring the first position information of the current handwriting on the writing medium according to the first image information includes:
  • the first position information of the current handwriting on the writing medium is determined according to the current position coordinates of the writing device in the writing medium and the edge coordinates of the writing medium.
  • the current handwriting corresponds to first time information
  • the first image information corresponds to second time information
  • the target electronic document corresponding to the writing medium according to the first image information Before determining the target electronic document corresponding to the writing medium according to the first image information, it further includes:
  • the determining the second position information of the current handwriting in the target electronic document according to the current handwriting, the target electronic document and the first position information includes:
  • the target image file area is determined, and the target image file area is the first position information in the target electronic document.
  • the target image file area determine the second position information of the current handwriting in the target electronic document.
  • the method before determining the second position information of the current handwriting in the target electronic document according to the current handwriting, the target electronic document and the first position information, the method further includes:
  • the method further includes:
  • the method also includes:
  • the target electronic document and the first position information, according to the target electronic document in the target electronic document Correct the handwriting order according to the preset order corresponding to the text information at the second position information.
  • the method further includes:
  • the completion rate of the corresponding document content at the second position information in the target electronic document is calculated.
  • an embodiment of the present application provides a device for determining a handwriting position, the device is executed by the terminal device, and there is a communication connection between the terminal device and the electronic pad, and the device includes:
  • the first acquisition module is used to acquire the current handwriting of the writing device during writing on the writing medium through the electronic backing board, and the writing medium is placed on the electronic backing board;
  • the first collection module is configured to collect the first image information of the writing process of the writing device on the writing medium through the camera of the terminal device;
  • a first determining module configured to determine a target electronic document corresponding to the writing medium according to the first image information
  • a second acquiring module configured to acquire first position information of the current handwriting on the writing medium according to the first image information
  • the second determining module is configured to determine second position information of the current handwriting in the target electronic document according to the first position, the target electronic document and the first position information.
  • an embodiment of the present application provides a terminal device, including a memory and a processor, where a computer program is stored in the memory, and when the computer program is executed by the processor, the processor realizes the above-mentioned The method for determining the handwriting position described in one aspect and any optional mode thereof.
  • an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the handwriting as described in the above-mentioned aspect and any optional mode thereof can be realized. How to determine the location.
  • the embodiment of the present application provides a computer program product.
  • the computer program product runs on a computer
  • the computer executes the handwriting position detection as described in the above-mentioned one aspect and any optional mode thereof. Determine the method.
  • an embodiment of the present application provides an application distribution platform, which is used to distribute a computer program product, wherein, when the computer program product runs on a computer, the computer executes one of the above-mentioned The method for determining the handwriting position described in the aspect and any optional mode thereof.
  • This application obtains the current handwriting of the writing device during the writing process on the writing medium through the electronic backing board, and the writing medium is placed on the electronic backing board; collects the first image information of the writing device during the writing process on the writing medium through the camera of the terminal device ; According to the first image information, determine the target electronic document corresponding to the writing medium; According to the first image information, obtain the first position information of the current handwriting on the writing medium; According to the first position, the target electronic document and the first position information, determine The second position information of the current handwriting in the target electronic document.
  • the present application determines the current handwriting on the writing medium, it also combines the target electronic document determined by the first image information collected by the camera and the first position information of the current handwriting on the writing medium to determine the second position of the current handwriting in the target electronic document.
  • the target electronic document determined by the first image information collected by the camera and the first position information of the current handwriting on the writing medium to determine the second position of the current handwriting in the target electronic document.
  • the second position information of the current handwriting in the target electronic document can still be determined in combination with the first image information, so as to improve the accuracy of determining the position of the handwriting.
  • Fig. 1 is a schematic diagram of a scene of writing based on an electronic pad provided by an exemplary embodiment of the present application
  • Fig. 2 is a method flowchart of a method for determining a handwriting position provided by an exemplary embodiment of the present application
  • Fig. 3 is a schematic diagram of a scene of writing on a writing medium according to an exemplary embodiment of the present application
  • Fig. 4 is a schematic structural diagram of an electronic pad related to an exemplary embodiment of the present application.
  • Fig. 5 is a method flowchart of a method for determining a handwriting position provided by an exemplary embodiment of the present application
  • Fig. 6 is a schematic diagram of handwriting appearing in a writing medium according to an exemplary embodiment of the present application.
  • Fig. 7 is an image schematic diagram of a kind of first image information related to an exemplary embodiment of the present application.
  • Fig. 8 is a schematic diagram of an image of an electronic pen writing on an electronic pad according to an exemplary embodiment of the present application
  • Fig. 9 is a schematic diagram of an image of a target electronic document according to an exemplary embodiment of the present application.
  • Fig. 10 is a schematic diagram of an image of a target electronic document containing handwriting according to an exemplary embodiment of the present application
  • Fig. 11 is a schematic diagram of an image of a target electronic document containing a review result according to an exemplary embodiment of the present application
  • Fig. 12 is a method flowchart of a method for determining a handwriting position provided by an exemplary embodiment of the present application
  • Fig. 13 is a structural block diagram of an apparatus for determining handwriting positions provided by an exemplary embodiment of the present application.
  • Fig. 14 is a schematic structural diagram of a terminal device disclosed in an exemplary embodiment of the present application.
  • the "plurality” mentioned herein means two or more.
  • “And/or” describes the association relationship of associated objects, indicating that there may be three types of relationships, for example, A and/or B may indicate: A exists alone, A and B exist simultaneously, and B exists independently.
  • the character “/” generally indicates that the contextual objects are an "or” relationship.
  • the solution provided by this application can be used in the real scene where the camera installed on the terminal device collects the images of the user writing on the writing medium when people use the terminal device in their daily life.
  • paper text content into electronic documents there are two main ways to convert paper text content into electronic documents: one is to convert paper content such as homework and test papers that have been written into electronic image documents by scanning and taking pictures; During the writing process of students, the text information is picked up in the terminal device through technical identification means, and the corresponding handwriting document is generated.
  • FIG. 1 shows a schematic diagram of a scene of writing based on an electronic pad provided by an exemplary embodiment of the present application.
  • the scene architecture includes an electronic pen 110 , a paper 120 , and an electronic pad 130 .
  • the paper 120 is placed on the electronic pad 130, when the electronic pen 110 writes on the paper 120, the electronic pad 130 can receive the movement signal of the electronic pen 110 on the electronic pad 130, and according to the movement signal, determine The handwriting formed by the electronic pen 110 during the writing process, so as to realize the recognition of the user's handwriting.
  • the scheme in Figure 1 above can recognize the user's handwriting based on the user's writing process, but cannot determine the position of the content written by the user on the paper.
  • the paper in Figure 1 is dragged, After turning pages and other actions, the handwriting recognized by the electronic backing board cannot be coherently matched on the paper, resulting in low accuracy in determining the position of the handwriting on the paper, so that the user needs to ensure that the paper on the electronic backing board is relatively electronic during the writing process.
  • the position of the backing plate remains unchanged, the application method is relatively single, and the application scenarios are limited.
  • the present application provides a method for determining the handwriting position, which can accurately locate the handwriting position of the handwriting on paper in combination with the image information captured by the electronic backing board, and improve the accuracy of the terminal device in determining the handwriting position.
  • FIG. 2 shows a flow chart of a method for determining a handwriting position provided by an exemplary embodiment of the present application.
  • the method can be executed by a terminal device, and there is a communication connection between the terminal device and the electronic pad.
  • the method for determining the position of the handwriting may include the following steps.
  • step 201 the current handwriting of the writing device during writing on the writing medium is obtained through the electronic backing board.
  • the writing medium is placed on the electronic pad.
  • the electronic underlay of the present application may include two parts, an electromagnetic induction module and a signal transmission module.
  • the electromagnetic induction module is used for electromagnetic induction with the writing device to recognize the handwriting written by the user on the writing medium
  • the signal transmission module is used for transmitting the acquired data (handwriting) to the terminal device.
  • the terminal device may be a terminal on which a camera may be installed.
  • the terminal can be a mobile phone, tablet computer, e-book reader, smart glasses, smart watch, MP3 player (Moving Picture Experts Group Audio Layer III, moving picture expert compression standard audio layer 3), MP4 (Moving Picture Experts Group Audio Layer IV, dynamic image expert compression standard audio level 4) Players, tutoring machines, notebook computers, laptop computers and desktop computers, etc.
  • terminal devices can also be household devices equipped with cameras, such as desk lamps, smart phones, etc. TVs, smart robots, smart refrigerators, smart air conditioners, smart rice cookers and other equipment.
  • the terminal device is connected to the signal transmission module of the electronic pad through a communication network, and optionally, the communication network is a wired network or a wireless network. That is, the terminal device receives the current handwriting and the like sent by the electronic pad through the communication network.
  • the aforementioned wireless network or wired network uses standard communication technologies and/or protocols.
  • the network is usually the Internet, but can be any network, including but not limited to Local Area Network (LAN), Metropolitan Area Network (MAN), Wide Area Network (WAN), mobile, wired or wireless Any combination of network, private network, or virtual private network.
  • data exchanged over a network is represented using technologies and/or formats including Hyper Text Mark-up Language (HTML), Extensible Markup Language (XML), and the like.
  • HTML Hyper Text Mark-up Language
  • XML Extensible Markup Language
  • the electronic pad sends the collected signal to the terminal device through communication methods such as Bluetooth, Wireless-Fidelity (Wi-Fi), and ZigBee.
  • the electronic pad can also be sent to the terminal device through a universal serial bus (Universal Serial Bus, USB).
  • USB Universal Serial Bus
  • the writing device can be an electronic pen.
  • the electronic pen has a replaceable refill and can write normally on the writing medium.
  • a pressure sensor and an electromagnetic frequency adjustment structure can be installed inside the electronic pen to identify different pressures according to different pressures. Thickness, when the electronic pen slides on the electronic backing board, the electronic pen sends the corresponding electromagnetic frequency band to the electronic backing board based on the pressing force. Thickness, so as to record the thickness of handwriting and other information.
  • the electronic backing board receives the electromagnetic frequency band sent by the writing device, and the electronic backing board automatically starts to acquire the current handwriting in the electronic backing board, and the current handwriting is the current The movement trajectory of the position where the writing device is connected to the electronic backing board on the electronic backing board within the preset time period corresponding to the moment.
  • the preset time period may be pre-set in the electromagnetic pad by developers or operation and maintenance personnel. For example, if the preset time period is the current moment and the first 10mm of the current moment, then the current handwriting is the moving track of the position where the writing device is connected to the electronic backing board during the time period.
  • Step 202 collect the first image information of the writing process of the writing device on the writing medium through the camera of the terminal device.
  • the first image information may be an image captured by the image capture camera, or may be a set of multiple images captured by the image capture camera.
  • the terminal device may take pictures during the writing process of the user through the installed camera, and the captured image is the first image information.
  • FIG. 3 shows a schematic diagram of a scene of writing on a writing medium according to an exemplary embodiment of the present application. As shown in FIG. 3 , it includes a terminal device 301 , a writing medium 302 and a writing device 303 . Wherein, the user can place the terminal device 301 on the front side of the writing medium 302, so that the shooting range of the image acquisition camera of the terminal device 301 can cover the writing medium 302, and the image written by the user on the writing medium 302 can be captured.
  • the terminal device when it obtains the first image information, it may send a shooting instruction to the camera after receiving the current handwriting sent by the electronic pad, and control the camera to shoot, so as to collect the image in the writing process information.
  • the camera of the terminal device may be a monocular camera or a multi-camera, and the monocular camera may be an RGB camera or a camera based on a dynamic vision sensor (Dynamic Vision Sensor, DVS).
  • DVS Dynamic Vision Sensor
  • Step 203 according to the first image information, determine the target electronic document corresponding to the writing medium.
  • the target electronic document is pre-identified and stored by the terminal device on writing media such as textbooks, exercise books, tutorial books, and test papers.
  • the terminal device can pre-store the target electronic document in the local memory, or store it in a
  • the device has a communication connection to the server.
  • the server may be a server or a cluster composed of multiple servers. For example, a user scans a target electronic document through a terminal device to generate a corresponding electronic document, and stores each generated electronic document in a local memory.
  • the terminal device may determine the target electronic document corresponding to the writing medium according to the acquired first image information.
  • the terminal device identifies the first image information, extracts the feature information in the first image information, queries whether there is a matching electronic document among the pre-stored electronic documents according to the feature information, and determines the matching electronic document as the same as the writing medium.
  • the feature point may be information such as the title and title included in the first image information.
  • the terminal device obtains the target electronic document stored in the server through a communication connection with the server.
  • Table 1 shows a storage relationship table of a target electronic document related to an exemplary embodiment of the present application.
  • the terminal device can associate the target electronic document with its corresponding characteristic information, and the terminal device can query the corresponding target electronic document in Mark 1 according to the characteristic information.
  • Step 204 obtain the first position information of the current handwriting on the writing medium.
  • the terminal device may also identify the writing device in the first image information according to the first image information, determine the current handwriting at the position where the writing device and the writing medium are connected, and obtain the first position of the current handwriting on the writing medium. - location information.
  • the first position information may be expressed according to a Cartesian coordinate system.
  • the terminal device establishes a Cartesian coordinate system based on the length and width of the writing medium in the first image information, and the first position of the current handwriting in the writing medium can use
  • the coordinates of the center point in the current handwriting are represented.
  • FIG. 4 shows a schematic structural diagram of an electronic pad related to an exemplary embodiment of the present application. As shown in FIG. 4 , it includes an electronic pad 401 , a writing device 402 , a writing medium 403 , a current handwriting 404 , and a center point 405 .
  • the terminal device may establish a Cartesian coordinate system based on one corner point of the writing medium 403 , and the first position of the current handwriting 404 in the writing medium 403 may be represented by the coordinates of the center point 405 .
  • the rectangular coordinate system in FIG. 4 may be a spatial rectangular coordinate system.
  • Step 205 according to the current handwriting, the target electronic document and the first position information, determine the second position information of the current handwriting in the target electronic document.
  • the terminal device may determine the second position information of the current handwriting in the target electronic document in combination with the acquired current handwriting, the target electronic document and the first position information.
  • the terminal device calibrates according to the current handwriting transmitted by the electronic pad and the first position information acquired by itself according to the first image information, it is determined that the current handwriting transmitted by the electronic pad corresponds to the target electronic document
  • the angle to be rotated and the distance to be moved are converted according to the angle to be rotated and the distance to be moved to obtain the second position information of the current handwriting in the target electronic document.
  • this application obtains the current handwriting of the writing device during the writing process on the writing medium through the electronic backing board, and the writing medium is placed on the electronic backing board; collects the writing process of the writing device on the writing medium through the camera of the terminal device the first image information; according to the first image information, determine the target electronic document corresponding to the writing medium; according to the first image information, obtain the first position information of the current handwriting on the writing medium; according to the first position, the target electronic document and the second A position information, determining the second position information of the current handwriting in the target electronic document.
  • the present application determines the current handwriting on the writing medium, it also combines the target electronic document determined by the first image information collected by the camera and the first position information of the current handwriting on the writing medium to determine the second position of the current handwriting in the target electronic document.
  • the target electronic document determined by the first image information collected by the camera and the first position information of the current handwriting on the writing medium to determine the second position of the current handwriting in the target electronic document.
  • the second position information of the current handwriting in the target electronic document can still be determined in combination with the first image information, so as to improve the accuracy of determining the position of the handwriting.
  • the terminal device when the user uses the writing device to write on the writing medium, the terminal device can also obtain the handwriting sequence of the current handwriting, and correct the handwriting sequence written by the user through the terminal device, thereby improving the accuracy of the writing process.
  • the user's writing habits are corrected to improve the detection effect of the user's writing process.
  • FIG. 5 shows a flow chart of a method for determining a handwriting position provided by an exemplary embodiment of the present application.
  • the method can be executed by a terminal device, and there is a communication connection between the terminal device and the electronic backing board.
  • the method for determining the position of the handwriting may include the following steps.
  • step 501 the current handwriting of the writing device during writing on the writing medium is obtained through the electronic pad, and the current handwriting includes first time information.
  • the writing medium is placed on the electronic pad. Similar to the description in step 201 above, after the user places the writing medium on the electronic backing board, the user uses the writing device to write on the writing medium. Get the current handwriting at the connected position.
  • the electronic backing board may include an electromagnetic induction module, a power supply and a signal transmission module, wherein the electronic backing board is powered by a power supply, and the signal transmission module may also include an antenna induction unit and an antenna transmission unit, and the antenna induction unit It can be a backing plate wrapped with plastic material for the antenna line, or a flexible writing pad wrapped with flexible materials such as rubber and braid; the electronic backing plate can receive the electromagnetic signal emitted by the electronic pen through the antenna sensing unit, and has a horizontal and vertical grid shape.
  • the antenna sensing unit can usually be implemented using a flexible printed circuit (FPC).
  • the electromagnetic induction module can locate the position of the written handwriting in the antenna coverage area by detecting the signal strength received by different horizontal and vertical nodes, and obtain the position change process of the electromagnetic pen writing process in the antenna coverage area.
  • the electronic pad when it acquires the current handwriting, it can determine a preset range area on the writing medium according to the connection position between the writing medium and the writing device, and the position corresponding to the preset range area is the current handwriting location range.
  • the preset range area may be pre-set in the terminal device by a developer or an operation and maintenance personnel.
  • the preset range area is the corresponding range area extending 2cm outward from the connecting position of the writing medium and the writing device.
  • the electronic backing board after the connecting position of the writing medium and the writing device is determined according to electromagnetic induction, according to For the connected position, the range area corresponding to the extension of 2 cm from the connected position is taken as the current handwriting location range, and the handwriting within the location range is obtained as the current handwriting.
  • FIG. 6 shows a schematic diagram of handwriting appearing in a writing medium according to an exemplary embodiment of the present application.
  • a writing device 601 it includes a writing device 601 , a writing medium 602 , an electronic pad 603 , a current handwriting 604 , and a range area 605 .
  • the writing device 601 can have electromagnetic signal transmission with the electronic pad 603, when the user controls the nib of the writing device 601 to move on the writing medium 602, the writing device 601 leaves writing marks on the writing medium 602, and the electronic pad 603 Through the electromagnetic induction and signal transmission between the electronic pen 601, the electronic pad 603 is obtained through the connection position with the electronic pen 601, and the range area 605 is obtained based on the preset range area, and the handwriting in the range area 605 Obtained as the current handwriting 604 .
  • the electronic backing board when it obtains the current handwriting, it can also obtain the first time information corresponding to the current handwriting through its own timing device.
  • the timing device can be a built-in clock of the electronic underlay.
  • the electronic underlay acquires the current handwriting, it acquires the time of the current clock, and uses this time as the first time information corresponding to the current handwriting.
  • the camera of the terminal device collects first image information of the writing process of the writing device on the writing medium, where the first image information includes second time information.
  • the first image information may be an image captured by the image capture camera, or may be a set of multiple images captured by the image capture camera.
  • the terminal device may take pictures during the writing process of the user through the installed camera, and the captured image is the first image information.
  • the terminal device may also record the second time information for the first image information according to its own internal clock device.
  • Step 503 according to the first time information, obtain second time information that is the same as the first time information.
  • the terminal device after the terminal device receives the current handwriting transmitted by the electronic underlay, it can obtain the second time information that is the same as the first time information among the second time information recorded by itself according to the first time information corresponding to the current handwriting.
  • the first time information is time one
  • the terminal device selects the second time information in which the corresponding time in the second time information is time one.
  • Step 504 acquiring first image information corresponding to the second time information.
  • the terminal device acquires the first image information corresponding to the second time information according to the acquired second time information.
  • Step 505 according to the first image information, determine the target electronic document corresponding to the writing medium.
  • the terminal device acquires feature information in the writing medium by performing image recognition on the first image information, where the feature information includes at least one of target graphics and/or target keywords; according to the feature information, A target electronic document corresponding to the feature information is queried.
  • image recognition includes character recognition and graphic recognition.
  • the terminal device performs optical character recognition (Optical Character Recognition, OCR) on the obtained first image information to recognize the text in the first image information, and extract the target keywords in the first image information.
  • OCR optical Character Recognition
  • the terminal device can also perform graphic recognition on the first image information through the graphic recognition model, and extract the target graphics in the first image information, so as to combine the target graphics and or target tube detection to query the pre-stored target electronic documents, and obtain and feature information The corresponding target electronic document.
  • the above character recognition and graphic recognition may also be integrated into the same recognition model, which is not limited here.
  • FIG. 7 shows a schematic diagram of an image of first image information related to an exemplary embodiment of the present application.
  • the first image information 700 contains various target graphics 701 and target keywords 702, and the terminal device can extract the target graphics 701 and For characteristic information such as the target keyword 702, the target electronic document corresponding to the characteristic information is obtained by querying the above Table 1.
  • Step 506 according to the first image information, obtain the first position information of the current handwriting on the writing medium.
  • the terminal device identifies the writing device in the first image information according to the first image information, determines the current handwriting at the position where the writing device and the writing medium are connected, and acquires the first position of the current handwriting on the writing medium information.
  • the terminal device determines the current position coordinates of the writing device in the writing medium and the edge coordinates of the writing medium according to the first image information; according to the current position coordinates of the writing device in the writing medium and the edge coordinates of the writing medium The edge coordinates determine the first position information of the current handwriting on the writing medium.
  • the terminal device After identifying the first image information, the terminal device establishes a spatial Cartesian coordinate system according to the length and width of the writing medium in the first image letter, and according to the four corner points of the writing medium, Corner coordinates get the edge coordinates of the writing medium.
  • the terminal device can also determine the current position coordinates of the writing device in the writing medium through the first image information, and determine the first position information of the current handwriting on the writing medium according to the position coordinates of the writing device and the edge coordinates of the writing medium.
  • the terminal device determines the relative coordinates of the current handwriting on the writing medium through the position coordinates of the writing device in the current writing medium and the edge coordinates of the writing medium, thereby indicating the distance between the position of the current handwriting on the writing medium and the edge of the writing medium.
  • the positional relationship realizes the representation of the position of the current handwriting on the writing medium.
  • the terminal device may also acquire the positional relationship between the writing medium and the electronic pad according to the first image information; and correct the first positional information of the current handwriting on the writing medium according to the positional relationship. That is, the terminal device recognizes the position of the writing medium and the electronic backing board in the first image information, and obtains the position coordinates of the electronic backing board in a spatial Cartesian coordinate system based on the length and width of the writing medium, thereby obtaining the writing medium and the electronic backing board. The positional relationship of the electronic pad.
  • the terminal device may also correct the first position information of the current handwriting on the writing medium according to the positional relationship between the writing medium and the electronic pad.
  • the current handwriting may have a direction on the writing medium.
  • FIG. 8 shows a Schematic diagram of the image of the electronic pen writing on the electronic pad. As shown in FIG. 8 , it includes an electronic pad 801 , a writing device 802 , a writing medium 803 , and a current handwriting 804 .
  • the terminal device can The positional relationship of the electronic pad corrects the obtained first position information of the current handwriting on the writing medium, so that the relative position of the current handwriting on the writing medium is more accurate.
  • Step 507 according to the current handwriting, the target electronic document and the first position information, determine the second position information of the current handwriting in the target electronic document.
  • the target image file area is determined by comparing each image file area pre-divided in the target electronic document with the first position information, and the target image file area is the image file area to which the first position information belongs in the target electronic document ; Determine the second position information of the current handwriting in the target electronic document according to the area of the target image file.
  • FIG. 9 shows a schematic diagram of an image of a target electronic document according to an exemplary embodiment of the present application.
  • a target electronic document 900 it includes a target electronic document 900 , various image file areas 901 , and a first location 902 .
  • Each image file area 901 may be pre-divided by the terminal device when inputting the target electronic document 900 .
  • the terminal device determines the image file area where the first location information is located according to the first location information, and determines the image file area where the first location information is located as the target image file area.
  • the target image file area is the image file area where the first location is located in FIG. 9 .
  • the terminal device acquires the second position information of the current handwriting in the target electronic document according to the determined target image file area.
  • the second position information may indicate the position of the current handwriting in the target electronic document.
  • Step 508 filling the current handwriting into the target electronic document according to the second position information.
  • the terminal device may fill the acquired current handwriting into the target electronic document according to the second position information, and output the target electronic document.
  • FIG. 10 shows a schematic diagram of an image of a target electronic document containing handwriting according to an exemplary embodiment of the present application. As shown in FIG. 10 , it includes a target electronic document 1000 and each handwriting 1001 . As shown in FIG. 10 , after determining the second position information of the current handwriting in the target electronic document, the terminal device can finally fill in all the handwriting acquired this time in the target electronic document and display it on the display screen.
  • Step 509 verifying the current handwriting according to the preset text information corresponding to the second position information in the target electronic document.
  • the preset text information may be answer information of the target electronic document.
  • the terminal device can also store the answer information of the target electronic document in advance. In this step, the terminal device can obtain the answer information corresponding to the target electronic document according to the target electronic document, and give the answer information in the target electronic document in the second The answer (preset text information) corresponding to the position information is used to verify the handwriting written by the user.
  • the terminal device can display the first marking information at the second position information, and the first marking information is used to indicate that the result of the user's writing is wrong; if the current handwriting is different from the preset text information Similarly, the second marking information is displayed at the second location information, and the second marking information is used to indicate that the result written by the user is correct. Please refer to FIG.
  • FIG. 11 which shows a schematic diagram of an image of a target electronic document including a review result according to an exemplary embodiment of the present application.
  • FIG. 11 it includes a target electronic document 1100 , each handwriting 1101 , first marking information 1102 , and second marking information 1103 .
  • the terminal device after determining the second position information of the current handwriting in the target electronic document, the terminal device fills all the acquired handwriting in the target electronic document, and uses the answer information to correct each handwriting in the target electronic document. Checking is performed to achieve a review effect, and the first marking information and the second marking information are displayed on the display screen.
  • the handwriting sequence of the current handwriting during the writing process of the writing device on the writing medium is obtained through the electronic backing board; After the second position information in the document, the order of handwriting is corrected according to the preset order corresponding to the text information at the second position information in the target electronic document.
  • the electronic backing board when the electronic backing board obtains the current handwriting of the writing device in the process of writing on the writing medium, it records the handwriting sequence of the current handwriting of the writing device in the process of writing on the writing medium, and sends the handwriting sequence according to the above communication method
  • the terminal device after the terminal device executes the above step 507, it can also correct the order of handwriting according to the preset sequence corresponding to the text information at the second position information in the target electronic document, or use the The writing sequence of the handwriting is verified by the method, and it is displayed whether the handwriting sequence is correct, so as to guide the user's writing process.
  • the terminal device may also acquire the writing time of the current handwriting; and calculate the completion rate of the content of the document corresponding to the second position information in the target electronic document according to the writing time of the current handwriting. For example, in the above Figure 9, for the first image file area, it took the user 2 minutes to write the corresponding handwriting, which can show that the completion rate of the user to complete the corresponding first image file area in the target electronic document is 2 minutes , to obtain the user's problem-solving efficiency.
  • this application obtains the current handwriting of the writing device during the writing process on the writing medium through the electronic backing board, and the writing medium is placed on the electronic backing board; collects the writing process of the writing device on the writing medium through the camera of the terminal device the first image information; according to the first image information, determine the target electronic document corresponding to the writing medium; according to the first image information, obtain the first position information of the current handwriting on the writing medium; according to the first position, the target electronic document and the second A position information, determining the second position information of the current handwriting in the target electronic document.
  • the present application determines the current handwriting on the writing medium, it also combines the target electronic document determined by the first image information collected by the camera and the first position information of the current handwriting on the writing medium to determine the second position of the current handwriting in the target electronic document.
  • the target electronic document determined by the first image information collected by the camera and the first position information of the current handwriting on the writing medium to determine the second position of the current handwriting in the target electronic document.
  • the second position information of the current handwriting in the target electronic document can still be determined in combination with the first image information, so as to improve the accuracy of determining the position of the handwriting.
  • FIG. 12 shows a flowchart of a method for determining a handwriting position provided by an exemplary embodiment of the present application.
  • the method can be executed by a terminal device, and there is a communication connection between the terminal device and the electronic pad.
  • the method for determining the position of the handwriting may include the following steps.
  • Step 1201 using the camera of the tablet computer to convert the content of the paper medium into a graphical electronic document entry system.
  • users can identify and store writing media such as textbooks, exercise books, tutorial books, and test papers in advance through a tablet computer, and convert the content of paper media into graphical electronic documents and enter them into the homework detection system.
  • the job detection system may be pre-developed by developers or operation and maintenance personnel.
  • a job detection application program is installed on the tablet computer, and the user triggers the tablet computer to start the job detection system by clicking the application program.
  • Step 1202 collect the writing image on the electronic pad through the camera of the tablet computer.
  • the electronic backing board will send the handwriting to the tablet computer, and the tablet computer will take pictures of the student's writing process through the camera to obtain the writing image during the writing process.
  • Step 1203 the tablet computer receives the handwriting sent by the electronic pad, and uses the collected handwriting image to obtain the position information of the handwriting.
  • Step 1204 the tablet computer uses time synchronization to determine the position of the handwriting in the electronic document.
  • the tablet computer can also determine the written handwriting received at the same time and the written image taken at the same time according to the time synchronization rule.
  • the corresponding position information in the medium determines the position of the handwriting in the electronic document.
  • Step 1205 the tablet computer corrects the handwriting at the corresponding position in the electronic document according to the pre-stored answers.
  • the tablet computer corrects the handwriting in the electronic document according to the pre-stored answers.
  • Step 1206 the tablet computer outputs the electronic document containing handwriting and correction information.
  • the tablet computer outputs the electronic document containing the review result.
  • this application obtains the current handwriting of the writing device during the writing process on the writing medium through the electronic backing board, and the writing medium is placed on the electronic backing board; collects the writing process of the writing device on the writing medium through the camera of the terminal device the first image information; according to the first image information, determine the target electronic document corresponding to the writing medium; according to the first image information, obtain the first position information of the current handwriting on the writing medium; according to the first position, the target electronic document and the second A position information, determining the second position information of the current handwriting in the target electronic document.
  • the present application determines the current handwriting on the writing medium, it also combines the target electronic document determined by the first image information collected by the camera and the first position information of the current handwriting on the writing medium to determine the second position of the current handwriting in the target electronic document.
  • the target electronic document determined by the first image information collected by the camera and the first position information of the current handwriting on the writing medium to determine the second position of the current handwriting in the target electronic document.
  • the second position information of the current handwriting in the target electronic document can still be determined in combination with the first image information, so as to improve the accuracy of determining the position of the handwriting.
  • FIG. 13 shows a structural block diagram of an apparatus for determining a handwriting position provided by an exemplary embodiment of the present application.
  • the handwriting position determining device 1300 can be used in a terminal device, and there is a communication connection between the terminal device and the electronic pad. As shown in FIG. 13 , the handwriting position determining device can include the following steps.
  • the first acquisition module 1301 is configured to acquire the current handwriting of the writing device during writing on the writing medium through the electronic backing board, and the writing medium is placed on the electronic backing board;
  • the first collection module 1302 is configured to collect the first image information of the writing process of the writing device on the writing medium through the camera of the terminal device;
  • a first determining module 1303, configured to determine a target electronic document corresponding to the writing medium according to the first image information
  • the second acquiring module 1304 is configured to acquire the first position information of the current handwriting on the writing medium according to the first image information
  • the second determining module 1305 is configured to determine second position information of the current handwriting in the target electronic document according to the first position, the target electronic document and the first position information.
  • the first determining module 1303 includes: a first acquiring unit and a first querying unit;
  • the first acquisition unit is configured to perform image recognition on the first image information, and acquire feature information in the writing medium, where the feature information includes at least one of target graphics and/or target keywords;
  • the first query unit is configured to query the target electronic document corresponding to the feature information according to the feature information.
  • the second obtaining module 1304 includes: a first determining unit and a second determining unit;
  • the first determination unit is configured to determine the current position coordinates of the writing device in the writing medium and the edge coordinates of the writing medium according to the first image information
  • the second determining unit is configured to determine the first position information of the current handwriting on the writing medium according to the current position coordinates of the writing device in the writing medium and the edge coordinates of the writing medium.
  • the current handwriting corresponds to first time information
  • the first image information corresponds to second time information
  • the device also includes:
  • the third acquisition module is configured to acquire a second time information that is the same as the first time information according to the first time information before determining the target electronic document corresponding to the writing medium according to the first image information. time information;
  • a fourth acquiring module configured to acquire the first image information corresponding to the second time information.
  • the second determining module 1305 includes: a third determining unit and a fourth determining unit;
  • the third determination unit is configured to determine the target image file area according to the comparison between each image file area pre-divided in the target electronic document and the first position information, and the target image file area is the first An image file area where the location information belongs in the target electronic file;
  • the fourth determining unit is configured to determine second position information of the current handwriting in the target electronic document according to the target image file area.
  • the device also includes:
  • the fourth obtaining module is used to determine the second position information of the current handwriting in the target electronic document according to the current handwriting, the target electronic document and the first position information, according to the the first image information, and acquire the positional relationship between the writing medium and the electronic pad;
  • a first correction module configured to correct the first position information of the current handwriting on the writing medium according to the position relationship.
  • the device also includes:
  • the first filling module is configured to, after determining the second position information of the current handwriting in the target electronic document according to the handwriting information, the target electronic document and the first position information, add the Filling the current handwriting into the target electronic document according to the second position information;
  • a first verification module configured to verify the current handwriting according to the preset text information corresponding to the second position information in the target electronic document
  • the first display module is used to display the first marking information at the second position information when the current handwriting is different from the preset text information
  • the second display module is configured to display second marking information at the second location information when the current handwriting is the same as the preset text information.
  • the device also includes:
  • the fifth acquisition module is used to acquire the handwriting sequence of the current handwriting during the writing process of the writing device on the writing medium through the electronic backing board;
  • the second correction module is configured to, after determining the second position information of the current handwriting in the target electronic document according to the current handwriting, the target electronic document and the first position information, according to the Correcting the handwriting order according to the preset order corresponding to the text information at the second position information in the target electronic document.
  • the device also includes:
  • a sixth acquiring module configured to acquire the second position information of the current handwriting in the target electronic document after determining the second position information of the current handwriting in the target electronic document according to the current handwriting, the target electronic document and the first position information. Describe the writing time of the current handwriting;
  • the completion rate calculation module is configured to calculate the completion rate of the document content corresponding to the second position information in the target electronic document according to the writing duration of the current handwriting.
  • this application obtains the current handwriting of the writing device during the writing process on the writing medium through the electronic backing board, and the writing medium is placed on the electronic backing board; collects the writing process of the writing device on the writing medium through the camera of the terminal device the first image information; according to the first image information, determine the target electronic document corresponding to the writing medium; according to the first image information, obtain the first position information of the current handwriting on the writing medium; according to the first position, the target electronic document and the second A position information, determining the second position information of the current handwriting in the target electronic document.
  • the present application determines the current handwriting on the writing medium, it also combines the target electronic document determined by the first image information collected by the camera and the first position information of the current handwriting on the writing medium to determine the second position of the current handwriting in the target electronic document.
  • the target electronic document determined by the first image information collected by the camera and the first position information of the current handwriting on the writing medium to determine the second position of the current handwriting in the target electronic document.
  • the second position information of the current handwriting in the target electronic document can still be determined in combination with the first image information, so as to improve the accuracy of determining the position of the handwriting.
  • FIG. 14 shows a schematic structural diagram of a terminal device disclosed in an exemplary embodiment of the present application.
  • a terminal device may include: a radio frequency (Radio Frequency, RF) circuit 1410, a memory 1420, an input unit 1430, a display unit 1440, a sensor 1450, an audio circuit 1460, a WiFi module 1470, a processor 1480, and a power supply 1490, etc.
  • the terminal device can be used as a massage device or as a target device.
  • the structure of the terminal device shown in FIG. 14 does not constitute a limitation on the terminal device, and may include more or less components than those shown in the figure, or combine some components, or arrange different components.
  • the RF circuit 1410 can be used for sending and receiving information or receiving and sending signals during a call. In particular, after receiving the downlink information from the base station, it is processed by the processor 1480; in addition, the designed uplink data is sent to the base station.
  • the RF circuit 1410 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (Low Noise Amplifier, LNA), a duplexer, and the like.
  • RF circuitry 1410 may also communicate with networks and other devices via wireless communications.
  • the above wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile communication (Global System of Mobile communication, GSM), General Packet Radio Service (General Packet Radio Service, GPRS), Code Division Multiple Access (Code Division Multiple Access, CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), etc.
  • GSM Global System of Mobile communication
  • GPRS General Packet Radio Service
  • CDMA Code Division Multiple Access
  • WCDMA Wideband Code Division Multiple Access
  • LTE Long Term Evolution
  • SMS Short Messaging Service
  • the memory 1420 may be used to store software programs and modules, and the processor 1480 executes various functional applications and data processing of the terminal device by running the software programs and modules stored in the memory 1420 .
  • Memory 1420 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, at least one application program required by a function (such as a sound playback function, an image playback function, etc.); Data created by the use of terminal equipment (such as audio data, phonebook, etc.), etc.
  • the memory 1420 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.
  • the input unit 1430 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the terminal device.
  • the input unit 1430 may include a touch panel 1431 and other input devices 1432 .
  • the touch panel 1431 also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 1431 or near the touch panel 1431). operation), and drive the corresponding connection device according to the preset program.
  • the touch panel 1431 may include two parts, a touch detection device and a touch controller.
  • the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and sends it to the to the processor 1480, and can receive and execute commands sent by the processor 1480.
  • the touch panel 1431 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave.
  • the input unit 1430 may also include other input devices 1432 .
  • other input devices 1432 may include but not limited to one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), trackball, mouse, joystick, and the like.
  • the display unit 1440 may be used to display information input by or provided to the user and various menus of the terminal device.
  • the display unit 1440 may include a display panel 1441.
  • the display panel 1441 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like.
  • the touch panel 1431 can cover the display panel 1441, and when the touch panel 1431 detects a touch operation on or near it, it sends it to the processor 1480 to determine the type of the touch event, and then the processor 1480 determines the type of the touch event according to the The type provides a corresponding visual output on the display panel 1441 .
  • the touch panel 1431 and the display panel 1441 are used as two independent components to realize the input and input functions of the terminal device, in some embodiments, the touch panel 1431 and the display panel 1441 can be integrated. And realize the input and output functions of the terminal equipment.
  • the terminal device may also include at least one sensor 1450, such as a light sensor, a motion sensor, and other sensors.
  • the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1441 according to the brightness of the ambient light, and the proximity sensor may turn off the display panel 1441 and the display panel 1441 when the terminal device moves to the ear. / or backlighting.
  • the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used for applications that recognize the posture of terminal equipment (such as horizontal and vertical screen switching, Related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tap), etc.; as for the gyroscope, barometer, hygrometer, thermometer, infrared sensor and other sensors that can be configured on the terminal device, here No longer.
  • the audio circuit 1460, the speaker 1461, and the microphone 1462 can provide an audio interface between the user and the terminal device.
  • the audio circuit 1450 can transmit the electrical signal converted from the received audio data to the speaker 1461, and the speaker 1461 converts it into an audio signal for output; After being received, it is converted into audio data, and then the audio data is processed by the output processor 1480, and then sent to, for example, another terminal device through the RF circuit 1410, or the audio data is output to the memory 1420 for further processing.
  • WiFi is a short-distance wireless transmission technology.
  • terminal equipment can help users send and receive emails, browse web pages, and access streaming media. It provides users with wireless broadband Internet access.
  • FIG. 14 shows a WiFi module 1470, it can be understood that it is not an essential component of the terminal device, and can be completely omitted as required without changing the essence of the invention.
  • the processor 1480 is the control center of the terminal equipment, and uses various interfaces and lines to connect various parts of the entire terminal equipment, by running or executing software programs and/or modules stored in the memory 1420, and calling data stored in the memory 1420 , execute various functions of the terminal equipment and process data, so as to monitor the terminal equipment as a whole.
  • the processor 1480 may include one or more processing units; preferably, the processor 1480 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application programs, etc. , the modem processor mainly handles wireless communications. It can be understood that the foregoing modem processor may not be integrated into the processor 1480 .
  • the terminal device also includes a power supply 1490 (such as a battery) for supplying power to various components.
  • a power supply 1490 (such as a battery) for supplying power to various components.
  • the power supply can be logically connected to the processor 1480 through the power management system, so that functions such as charging, discharging, and power consumption management can be realized through the power management system.
  • the terminal device may also include a camera, a Bluetooth module, etc., which will not be repeated here.
  • the embodiment of the present application discloses a computer-readable storage medium, which stores a computer program, wherein, when the computer program is executed by a processor, the methods in the foregoing method embodiments are implemented.
  • the embodiment of the present application discloses a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute the method in the above method embodiment.
  • the embodiment of the present application discloses an application distribution platform, wherein the application distribution platform is used to distribute a computer program product, wherein, when the computer program product is run on a computer, the computer is made to execute the method in the above method embodiment.
  • the units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, located in one place, or distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.
  • the above-mentioned integrated units are realized in the form of software function units and sold or used as independent products, they can be stored in a computer-accessible memory.
  • the technical solution of the present application in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a memory , including several requests to make a computer device (which may be a personal computer, server, or network device, etc., specifically, a processor in the computer device) execute some or all of the steps of the above-mentioned methods in various embodiments of the present application.
  • ROM read-only Memory
  • RAM random access memory
  • PROM programmable read-only memory
  • EPROM Erasable Programmable Read Only Memory
  • OTPROM One-time Programmable Read-Only Memory
  • EEPROM Electronically Erasable Programmable Read-Only Memory
  • CD-ROM Compact Disc Read-Only Memory

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种笔迹位置的确定方法、装置、终端设备及存储介质，属于图像采集技术领域。该方法由终端设备（301）执行，终端设备（301）与电子垫板（130）之间具有通信连接，通过电子垫板（130）获取书写设备（303）在书写介质（302）上进行书写过程中当前笔迹在电子垫板（130）中的第一位置；并通过终端设备（301）的摄像头采集第一图像信息；根据第一图像信息，确定书写介质（302）对应的目标电子文档（203）；根据第一图像信息，获取当前笔迹在书写介质（302）上的第一位置信息（204）；根据第一位置，目标电子文档以及第一位置信息，确定当前笔迹在目标电子文档中的第二位置信息。上述方法在当书写介质（302）在电子垫板（130）上被挪动时，仍然可以结合第一图像信息确定出当前笔迹在目标电子文档中的第二位置信息，提高确定笔迹位置的准确性。

Description

笔迹位置的确定方法、装置、终端设备及存储介质 技术领域
本申请涉及图像采集技术领域，特别涉及一种笔迹位置的确定方法、装置、终端设备及存储介质。
背景技术
随着科学技术的快速发展，在课堂教学和家庭练习方面，学生可以利用智能设备对自身书写的内容进行采集，从而捕获到书写笔迹。
比如，在一些电子笔或者终端设备上通过安装摄像头，利用安装的摄像头对用户书写的内容进行采集，得到用户的书写笔迹。比如，在撰写家庭作业或者练习册的过程中，用户先撰写完成家庭作业，通过电子笔或者终端设备上的摄像头进行扫描，从而获取到用户的撰写结果。其中，在笔迹获取的过程中，主要应用的技术有电子垫板与电磁笔相互配合的方案，通过将用户书写所用的纸张放置在一块具有特殊天线的电子垫板上，在用户进行书写的过程中，通过电磁笔与电子垫板的触发效果，实现确定用户在书写过程中笔迹所在的位置，并进行书写笔迹的识别。
在上述方案中，如果用户在书写过程中挪动了书写所用的纸张，通过电磁笔与电子垫板之间的触发确定出的书写笔迹的位置，与实际纸张上的位置并不符合，降低了确定书写笔迹位置的准确性。
发明内容
本申请实施例提供了一种笔迹位置的确定方法、装置、终端设备及存储介质，可以提高终端设备确定笔迹位置的准确性。
一方面，本申请实施例提供了一种笔迹位置的确定方法，所述方法由所述终端设备执行，所述终端设备与电子垫板之间具有通信连接，所述方法包括：
通过所述电子垫板获取书写设备在书写介质上进行书写过程中的当前笔迹，所述书写介质放置在所述电子垫板上；
通过所述终端设备的摄像头采集所述书写设备在所述书写介质上进行书写过程的第一图像信息；
根据所述第一图像信息，确定所述书写介质对应的目标电子文档；
根据所述第一图像信息，获取所述当前笔迹在所述书写介质上的第一位置信息；
根据所述第一位置，所述目标电子文档以及所述第一位置信息，确定所述当前笔迹在所述目标电子文档中的第二位置信息。
可选的，所述根据所述第一图像信息，确定所述书写介质对应的目标电子文档，包括：
对所述第一图像信息进行图像识别，获取所述书写介质中的特征信息，所述特征信息包括目标图形和/或目标关键词中的至少一种；
根据所述特征信息，查询与所述特征信息对应的所述目标电子文档。
可选的，所述根据所述第一图像信息，获取当前笔迹在所述书写介质上的第一位置信息，包括：
根据所述第一图像信息，确定所述书写设备当前在所述书写介质中的位置坐标以及所述书写介质的边缘坐标；
根据所述书写设备当前在所述书写介质中的位置坐标以及所述书写介质的边缘坐标，确定所述当前笔迹在所述书写介质上的第一位置信息。
可选的，所述当前笔迹对应有第一时间信息，所述第一图像信息对应有第二时间信息；
在所述根据所述第一图像信息，确定所述书写介质对应的目标电子文档之前，还包括：
根据所述第一时间信息，获取与所述第一时间信息相同的第二时间信息；
获取所述第二时间信息对应的所述第一图像信息。
可选的，所述根据所述当前笔迹，所述目标电子文档以及所述第一位置信息，确定所述当前笔迹在所述目标电子文档中的第二位置信息，包括：
根据所述目标电子文档中预先划分的各个图档区域与所述第一位置信息进行比对，确定目标图档区域，所述目标图档区域是所述第一位置信息在所述目标电子文档中所属的图档区域；
根据所述目标图档区域，确定所述当前笔迹在所述目标电子文档中的第二位置信息。
可选的，在所述根据所述当前笔迹，所述目标电子文档以及所述第一位置信息，确定所述当前笔迹在所述目标电子文档中的第二位置信息之前，还包括：
根据所述第一图像信息，获取所述书写介质与所述电子垫板的位置关系；
根据所述位置关系，校正所述当前笔迹在所述书写介质上的第一位置信息。
可选的，在所述根据所述笔迹信息，所述目标电子文档以及所述第一位置信息，确定所述当前笔迹在所述目标电子文档中的第二位置信息之后，还包括：
将所述当前笔迹按照所述第二位置信息填充至所述目标电子文档中；
根据所述目标电子文档中在所述第二位置信息处对应的预设文字信息，对所述当前笔迹 进行校验；
当所述当前笔迹与所述预设文字信息不相同时，在所述第二位置信息处展示第一标示信息；
当所述当前笔迹与所述预设文字信息相同时，在所述第二位置信息处展示第二标示信息。
可选的，所述方法还包括：
通过所述电子垫板获取书写设备在书写介质上进行书写过程中当前笔迹的笔迹顺序；
在所述根据所述当前笔迹，所述目标电子文档以及所述第一位置信息，确定所述当前笔迹在所述目标电子文档中的第二位置信息之后，根据所述目标电子文档中在所述第二位置信息处的文字信息对应的预设顺序，对所述笔迹顺序进行校正。
可选的，在所述根据所述当前笔迹，所述目标电子文档以及所述第一位置信息，确定所述当前笔迹在所述目标电子文档中的第二位置信息之后，还包括：
获取所述当前笔迹的书写时长；
根据所述当前笔迹的书写时长，计算目标电子文档中在所述第二位置信息处对应文档内容的完成率。
另一方面，本申请实施例提供了一种笔迹位置的确定装置，所述装置由所述终端设备执行，所述终端设备与电子垫板之间具有通信连接，所述装置包括：
第一获取模块，用于通过所述电子垫板获取书写设备在书写介质上进行书写过程中的当前笔迹，所述书写介质放置在所述电子垫板上；
第一采集模块，用于通过所述终端设备的摄像头采集所述书写设备在所述书写介质上进行书写过程的第一图像信息；
第一确定模块，用于根据所述第一图像信息，确定所述书写介质对应的目标电子文档；
第二获取模块，用于根据所述第一图像信息，获取所述当前笔迹在所述书写介质上的第一位置信息；
第二确定模块，用于根据所述第一位置，所述目标电子文档以及所述第一位置信息，确定所述当前笔迹在所述目标电子文档中的第二位置信息。
另一方面，本申请实施例提供了一种终端设备，包括存储器及处理器，所述存储器中存储有计算机程序，所述计算机程序被所述处理器执行时，使得所述处理器实现如上述一个方面及其任一可选方式所述的笔迹位置的确定方法。
另一方面，本申请实施例提供了一种计算机可读存储介质，其上存储有计算机程序，所述计算机程序被处理器执行时实现如上述一个方面及其任一可选方式所述的笔迹位置的确定方法。
另一方面，本申请实施例提供了一种计算机程序产品，当所述计算机程序产品在计算机上运行时，使得所述计算机执行如上述一个方面及其任一可选方式所述的笔迹位置的确定方法。
另一方面，本申请实施例提供了一种应用发布平台，所述应用发布平台用于发布计算机程序产品，其中，当所述计算机程序产品在计算机上运行时，使得所述计算机执行如上述一个方面及其任一可选方式所述的笔迹位置的确定方法。
本申请实施例提供的技术方案可以至少包含如下有益效果：
本申请通过电子垫板获取书写设备在书写介质上进行书写过程中的当前笔迹，书写介质放置在电子垫板上；通过终端设备的摄像头采集书写设备在书写介质上进行书写过程的第一图像信息；根据第一图像信息，确定书写介质对应的目标电子文档；根据第一图像信息，获取当前笔迹在书写介质上的第一位置信息；根据第一位置，目标电子文档以及第一位置信息，确定当前笔迹在目标电子文档中的第二位置信息。本申请在确定书写介质上的当前笔迹之后，还结合摄像头采集的第一图像信息确定的目标电子文档以及当前笔迹在书写介质上的第一位置信息，确定当前笔迹在目标电子文档中的第二位置信息，当书写介质在电子垫板上被挪动时，仍然可以结合第一图像信息确定出当前笔迹在目标电子文档中的第二位置信息，提高确定笔迹位置的准确性。
附图说明
图1是本申请一示例性实施例提供的一种基于电子垫板进行书写的场景示意图；
图2是本申请一示例性实施例提供的一种笔迹位置的确定方法的方法流程图；
图3是本申请一示例性实施例涉及的一种在书写介质上进行书写的场景示意图；
图4是本申请一示例性实施例涉及的一种电子垫板的结构示意图；
图5是本申请一示例性实施例提供的一种笔迹位置的确定方法的方法流程图；
图6是本申请一示例性实施例涉及的一种在书写介质中出现书写笔迹的示意图；
图7是本申请一示例性实施例涉及的一种第一图像信息的图像示意图；
图8是本申请一示例性实施例涉及的一种电子笔在电子垫板上书写的的图像示意图；
图9是本申请一示例性实施例涉及的一种目标电子文档的图像示意图；
图10是本申请一示例性实施例涉及的一种包含书写笔迹的目标电子文档的图像示意图；
图11是本申请一示例性实施例涉及的一种包含批阅结果的目标电子文档的图像示意图；
图12是本申请一示例性实施例提供的一种笔迹位置的确定方法的方法流程图；
图13是本申请一示例性实施例提供的笔迹位置的确定装置的结构框图；
图14是本申请一示例性实施例公开的一种终端设备的结构示意图。
具体实施方式
这里将详细地对示例性实施例进行说明，其示例表示在附图中。下面的描述涉及附图时，除非另有表示，不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本申请相一致的所有实施方式。相反，它们仅是与如所附权利要求书中所详述的、本申请的一些方面相一致的装置和方法的例子。
在本文中提及的“多个”是指两个或两个以上。“和/或”，描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。字符“/”一般表示前后关联对象是一种“或”的关系。
本申请提供的方案，可以用于人们在日常生活中使用终端设备时，通过终端设备安装的摄像头采集用户在书写介质上进行书写过程的图像的现实场景中，为了便于理解，下面首先对本申请实施例涉及的场景架构进行简单介绍。
随着科学技术的发展，人们对子女的教育越来越重视，在教育方面，将学生的作业、考试进行电子化，老师可以基于将学生的纸质作业、试卷等扫描转化成电子版进行批阅，从而提高教学效率。目前，一些学校为了提升教师对学生作业、试卷的批改效率，直接让学生在电脑或者平板电脑上作答，将电脑或者平板电脑作为答题工具，一方面增加了学生与电子屏幕接触的时间，不利于学生视力健康保护，另一方面使用电子设备完成作业、试卷时不方便书写，不适用于需要较大量书写内容的场景。因此，一般会让学生在纸质书本、纸张、试卷上进行书写，书写完成之后，再将纸质化的内容转换成电子文档实现自动批阅、或由老师批阅。
目前将纸质化文字内容转变成电子文档的方式主要分两大类：一类是将已经书写完成的作业、试卷等纸质内容，通过扫描、拍照的方式转换成电子图像文档；另一类是在学生书写过程中，通过技术识别手段将文字信息拾取在终端设备中，并生成对应的书写笔迹文档。
其中，上述通过扫描、拍照的方式需要在学生完成作业、考试、练习等任务后方可进行，对试卷、书本进行扫描需要用到专业的仪器，多数情况下需由老师完成，需要逐一扫描，耗费大量时间；基于拍照的方式进行书写笔迹的识别方式也主要分为两种：一种为红外点阵识别技术，其原理是使用特定的具有图像识别功能的笔，识别特定纸张上具有的微小的、规律排列的标记点与用户书写笔迹的第一位置信息，从而实现书写笔迹在终端设备上的复原；这种方案必须借助特殊的纸张，因此不适用于学生作业、考试场景。
另外一种为电磁笔方案，通过在用户书写所用的纸张下面放置一块具有特殊天线的电子 垫板，通过电子垫板实现书写笔迹的识别。比如，请参考图1，其示出了本申请一示例性实施例提供的一种基于电子垫板进行书写的场景示意图。如图1所示，在该场景架构中包含了电子笔110，纸120，电子垫板130。
其中，纸120放置在电子垫板130上，当电子笔110在纸120上进行书写时，电子垫板130可以接收到电子笔110在电子垫板130上的移动信号，根据该移动信号，确定电子笔110在书写过程中形成的书写笔迹，从而实现对用户书写笔迹的识别。
上述图1中的方案可以基于用户的书写过程识别出用户的书写笔迹，但是无法确定用户书写的内容在纸上的位置，当用户在书写过程中，将图1中的纸进行了拖动、翻页等动作之后，电子垫板识别的书写笔迹在纸上不能连贯地对应起来，导致确定纸上的书写笔迹位置的准确低，使得用户在书写过程中需要保证电子垫板上的纸相对电子垫板的位置保持不变，应用方式较为单一，应用场景有局限性。
为了避免上述技术方案中存在的问题，提高终端设备确定书写笔迹位置的准确性。本申请提供了一种笔迹位置的确定方法，可以结合对电子垫板拍摄得到的图像信息，对纸上的书写笔迹的笔迹位置进行准确定位，提高终端设备确定书写笔迹位置的准确性。
请参考图2，其示出了本申请一示例性实施例提供的一种笔迹位置的确定方法的方法流程图。该方法可以由终端设备执行，终端设备与电子垫板之间具有通信连接，如图2所示，该笔迹位置的确定方法可以包括如下几个步骤。
步骤201，通过电子垫板获取书写设备在书写介质上进行书写过程中的当前笔迹。
其中，书写介质放置在电子垫板上。可选的，本申请的电子垫板可以包括两个部分，电磁感应模块和信号传输模块。其中，电磁感应模块用于与书写设备进行电磁感应，识别出用户在书写介质上书写的笔迹，信号传输模块用于将获取到的数据(书写笔迹)向终端设备进行传输。
可选的，终端设备可以是可以安装有摄像头的终端。比如，该终端可以是手机、平板电脑、电子书阅读器、智能眼镜、智能手表、MP3播放器(Moving Picture Experts Group Audio Layer III，动态影像专家压缩标准音频层面3)、MP4(Moving Picture Experts Group Audio Layer IV，动态影像专家压缩标准音频层面4)播放器、家教机、笔记本电脑、膝上型便携计算机和台式计算机等等，终端设备也可以是安装有摄像头的家用设备，比如，台灯、智能电视、智能机器人、智能冰箱、智能空调、智能电饭煲等设备。
可选的，终端设备与电子垫板的信号传输模块通过通信网络连接，可选的，该通信网络是有线网络或无线网络。即，终端设备通过通信网络的方式接收电子垫板发送的当前笔迹等。
可选的，上述的无线网络或有线网络使用标准通信技术和/或协议。网络通常为因特网、但也可以是任何网络，包括但不限于局域网(Local Area Network，LAN)、城域网(Metropolitan Area Network，MAN)、广域网(Wide Area Network，WAN)、移动、有线或者无线网络、专用网络或者虚拟专用网络的任何组合。在一些实施例中，使用包括超文本标记语言(Hyper Text Mark-up Language，HTML)、可扩展标记语言(Extensible Markup Language，XML)等的技术和/或格式来代表通过网络交换的数据。此外还可以使用诸如安全套接字层(Secure Socket Layer，SSL)、传输层安全(Transport Layer Security，TLS)、虚拟专用网络(Virtual Private Network，VPN)、网际协议安全(Internet Protocol Security，IPsec)等常规加密技术来加密所有或者一些链路。在另一些实施例中，还可以使用定制和/或专用数据通信技术取代或者补充上述数据通信技术。
比如，电子垫板通过蓝牙、无线保真(Wireless-Fidelity，WiFi)、紫峰(ZigBee)等通信方式将采集到的信号发送给终端设备。或者，电子垫板也可以通过通用串行总线(Universal Serial Bus，USB)的方式发送给终端设备。
可选的，书写设备可以是电子笔，电子笔具有可更换的笔芯，可以在书写介质上正常书写，电子笔内部可以安装有压力传感器和电磁频率调节结构，根据不同的按压力度识别不同的粗细程度，电子笔在电子垫板上滑动时，电子笔基于按压力度向电子垫板发送对应的电磁频段，电子垫板接收到该电磁频段之后，识别对应的按压力度，确定与按压力度对应的粗细程度，从而记录笔迹的粗细等信息。
可选的，用户在通过书写设备在书写介质上进行书写的过程中，电子垫板接收到书写设备发送的电磁频段，电子垫板便自动开始获取在电子垫板中当前笔迹，当前笔迹是当前时刻下对应的预设时间段内书写设备与电子垫板相连位置在电子垫板上的移动轨迹。其中，预设时间段可以有开发人员或者运维人员预先在电磁垫板中设置。比如，预设时间段是当前时刻以及当前时刻的前10mm，那么，当前笔迹是该时间段内书写设备与电子垫板相连位置在电子垫板上的移动轨迹。
步骤202，通过终端设备的摄像头采集书写设备在书写介质上进行书写过程的第一图像信息。
可选的，第一图像信息可以是图像采集相机采集到的一张图像，也可以是图像采集相机采集到的多张图像组成的集合。本申请中，终端设备可以通过安装的摄像头在用户书写过程中进行拍摄，拍摄得到的图像是第一图像信息。请参考图3，其示出了本申请一示例性实施例涉及的一种在书写介质上进行书写的场景示意图。如图3所示，其中包含了终端设备301，书写介质302，书写设备303。其中，用户可以将终端设备301放置在书写介质302的前侧， 使得终端设备301的图像采集相机的拍摄范围可以覆盖书写介质302，可以拍摄到用户在书写介质302上的书写图像。
在一种可能实现的方式中，终端设备获取第一图像信息时，可以是在接收到电子垫板发送的当前笔迹之后，向摄像头发送拍摄指令，控制摄像头拍摄，从而采集到书写过程中的图像信息。可选的，终端设备的摄像头可以是单目摄像头或者多目摄像头，单目摄像头可以是RGB摄像头或者基于动态视觉传感器(Dynamic Vision Sensor，DVS)的摄像头。在用户书写过程中，终端设备通过安装的摄像头对用户书写采集时可以是周期性的。
步骤203，根据第一图像信息，确定书写介质对应的目标电子文档。
可选的，目标电子文档是终端设备预先对课本、练习册、辅导书籍、试卷等书写介质进行识别并存储的，终端设备可以将目标电子文档预先存储在本地内存中，也可以存储在与终端设备具有通信连接的服务器中。可选的，该服务器可以是一个服务器或者多个服务器组成的集群。比如，用户通过终端设备对目标电子文档进行扫描，生成对应的电子文档，将生成的各个电子文档存储在本地内存中。
可选的，终端设备可以根据获取到的第一图像信息，确定与书写介质对应的目标电子文档。终端设备通过对第一图像信息进行识别，提取第一图像信息中的特征信息，根据特征信息查询预先存储的各个电子文档中是否有相匹配的电子文档，将匹配的电子文档确定为与书写介质对应的目标电子文档。该特征点可以是第一图像信息中包含的标题、题目名称等信息。当目标电子文档存储在服务器中时，终端设备通过与服务器之间的通信连接，获取存储在服务器中的目标电子文档。
例如，请参考表1，其示出了本申请一示例性实施例涉及的一种目标电子文档的存储关系表。
特征信息 目标电子文档
特征信息一 目标电子文档一
特征信息二 目标电子文档二
特征信息三 目标电子文档三
…… ……
表1
如表1所示，终端设备可以将目标电子文档与各自对应的特征信息，终端设备可以根据特征信息查询标1中对应的目标电子文档。
步骤204，根据第一图像信息，获取当前笔迹在书写介质上的第一位置信息。
可选的，终端设备还可以根据第一图像信息，对第一图像信息中的书写设备进行识别，确定书写设备与书写介质在相连位置处的当前笔迹，并获取当前笔迹在书写介质上的第一位置信息。
可选的，第一位置信息可以按照直角坐标系来表示，比如，终端设备基于第一图像信息中书写介质的长和宽建立有直角坐标系，当前笔迹在书写介质中的第一位置可以利用当前笔迹中的中心点的坐标来表示。例如，请参考图4，其示出了本申请一示例性实施例涉及的一种电子垫板的结构示意图。如图4所示，其中包含了电子垫板401，书写设备402，书写介质403，当前笔迹404，中心点405。其中，终端设备可以基于书写介质403其中一个角点建立直角坐标系，当前笔迹404在书写介质403中的第一位置可以用中心点405的坐标来表示。可选的，图4中的直角坐标系可以是空间直角坐标系。
步骤205，根据当前笔迹，目标电子文档以及第一位置信息，确定当前笔迹在目标电子文档中的第二位置信息。
可选的，终端设备可以结合获取到的当前笔迹，目标电子文档以及第一位置信息，确定当前笔迹在目标电子文档中的第二位置信息。本申请中，通过终端设备根据电子垫板传输过来的当前笔迹以及自身根据第一图像信息获取到的第一位置信息进行校准，确定出电子垫板传输过来的当前笔迹对应到目标电子文档中时需要转动的角度和需要移动的距离，按照需要转动的角度和需要移动的距离，将第一位置信息进行转换，得到当前笔迹在目标电子文档中的第二位置信息。
综上所述，本申请通过电子垫板获取书写设备在书写介质上进行书写过程中的当前笔迹，书写介质放置在电子垫板上；通过终端设备的摄像头采集书写设备在书写介质上进行书写过程的第一图像信息；根据第一图像信息，确定书写介质对应的目标电子文档；根据第一图像信息，获取当前笔迹在书写介质上的第一位置信息；根据第一位置，目标电子文档以及第一位置信息，确定当前笔迹在目标电子文档中的第二位置信息。本申请在确定书写介质上的当前笔迹之后，还结合摄像头采集的第一图像信息确定的目标电子文档以及当前笔迹在书写介质上的第一位置信息，确定当前笔迹在目标电子文档中的第二位置信息，当书写介质在电子垫板上被挪动时，仍然可以结合第一图像信息确定出当前笔迹在目标电子文档中的第二位置信息，提高确定笔迹位置的准确性。
在一种可能实现的方式中，用户使用书写设备在书写介质上进行书写的过程中，终端设备还可以获取当前笔迹的笔迹顺序，并通过终端设备对用户书写的笔迹顺序进行校正，从而提高对用户的书写习惯进行纠正，提高对用户书写过程的检测效果。
请参考图5，其示出了本申请一示例性实施例提供的一种笔迹位置的确定方法的方法流程图。该方法可以由终端设备执行，终端设备与电子垫板之间具有通信连接，如图5所示，该笔迹位置的确定方法可以包括如下几个步骤。
步骤501，通过电子垫板获取书写设备在书写介质上进行书写过程中的当前笔迹，当前笔迹包括第一时间信息。
其中，书写介质是放置在电子垫板上的。类似于上述步骤201中的描述，在用户将书写介质放置在电子垫板上之后，用户使用书写设备在书写介质上进行书写，在用户书写过程中，电子垫板可以根据书写设备在书写介质上的相连位置获取当前笔迹。
可选的，在本申请中，电子垫板可以包括电磁感应模块、电源和信号传输模块，其中，电子垫板通过电源供电，信号传输模块还可以包含天线感应单元和天线发送单元，天线感应单元可以是使用塑胶材料包裹天线线路的垫板、或者使用橡胶、编织物等柔性材料包裹柔性天线的柔性书写垫；电子垫板可以通过天线感应单元接收电子笔发射的电磁信号，横纵网格状。天线感应单元通常可以使用柔性电路板(Flexible Printed Circuit，FPC)实现。电磁感应模块可以通过检测不同横纵节点接收到的信号强度来定位书写的笔迹在天线覆盖区域内的位置，得到电磁笔书写过程中在天线覆盖区域内的位置变化过程。
在一种可能实现的方式中，电子垫板在获取当前笔迹时，可以根据书写介质和书写设备的相连位置处在书写介质上确定预设范围区域，该预设范围区域对应的位置是当前笔迹所在位置范围。其中，预设范围区域可以由开发人员或者运维人员预先在终端设备中设置。比如，预设范围区域是以书写介质和书写设备的相连位置处向外延伸2cm对应的范围区域，那么，在电子垫板中，根据电磁感应确定书写介质和书写设备的相连位置处之后，按照该相连位置，将按照该连接位置处向外延伸2cm之后对应的范围区域作为当前笔迹所在位置范围，获取所在位置范围内的书写笔迹作为当前笔迹。
比如，请参考图6，其示出了本申请一示例性实施例涉及的一种在书写介质中出现书写笔迹的示意图。如图6所示，其中包含了书写设备601，书写介质602，电子垫板603，当前笔迹604，范围区域605。其中，书写设备601可以与电子垫板603之间具有电磁信号传送，用户控制书写设备601的笔尖在书写介质602上移动时，书写设备601在书写介质602上留下书写痕迹，电子垫板603通过与电子笔601之间的电磁感应以及信号传递，获取到电子垫板603通过与电子笔601之间的相连位置，并基于预设范围区域获取到范围区域605，将范围区域605内的笔迹获取为当前笔迹604。
可选的，电子垫板在获取到当前笔迹时，还可以通过自身的计时设备获取当前笔迹对应的第一时间信息。比如，该计时设备可以是电子垫板的内置时钟，电子垫板获取到当前笔迹 时，获取当前时钟的时间，将该时间作为当前笔迹对应的第一时间信息。
步骤502，通过终端设备的摄像头采集书写设备在书写介质上进行书写过程的第一图像信息，第一图像信息包括第二时间信息。
可选的，第一图像信息可以是图像采集相机采集到的一张图像，也可以是图像采集相机采集到的多张图像组成的集合。本申请中，终端设备可以通过安装的摄像头在用户书写过程中进行拍摄，拍摄得到的图像是第一图像信息。其中，终端设备也可以根据自身内部的时钟设备对第一图像信息记录第二时间信息。
步骤503，根据第一时间信息，获取与第一时间信息相同的第二时间信息。
可选的，终端设备接收到电子垫板传输的当前笔迹之后，可以根据当前笔迹对应的第一时间信息，获取自身记录的各个第二时间信息中与第一时间信息相同的第二时间信息。比如，第一时间信息是时间一，结合时间同步，终端设备选择第二时间信息中对应的时间为时间一的第二时间信息。
步骤504，获取第二时间信息对应的第一图像信息。
终端设备根据获取到的第二时间信息，获取第二时间信息对应的第一图像信息。
步骤505，根据第一图像信息，确定书写介质对应的目标电子文档。
在一种可能实现的方式中，终端设备通过对第一图像信息进行图像识别，获取书写介质中的特征信息，特征信息包括目标图形和/或目标关键词中的至少一种；根据特征信息，查询与特征信息对应的目标电子文档。
其中，图像识别包括文字识别和图形识别。比如，终端设备通过对获取到的第一图像信息进行光学字符识别(Optical Character Recognition，OCR)，对第一图像信息中的文字进行识别，提取第一图像信息中的目标关键词。终端设备也可以通过图形识别模型对第一图像信息进行图形识别，提取第一图像信息中的目标图形，从而结合目标图形和或目标管检测对预存的各个目标电子文档进行查询，获取与特征信息对应的目标电子文档。可选的，上述文字识别和图形识别也可以集合在同一个识别模型中，此处并不加以限定。
请参考图7，其示出了本申请一示例性实施例涉及的一种第一图像信息的图像示意图。如图7所示，在第一图像信息700中包含了各个目标图形701，目标关键词702，终端设备通过对第一图像信息进行文字识别和图形识别，可以提取到其中的各个目标图形701和目标关键词702等特征信息，通过查询上述表1，获取与特征信息相对应的目标电子文档。
步骤506，根据第一图像信息，获取当前笔迹在书写介质上的第一位置信息。
可选的，终端设备根据第一图像信息，对第一图像信息中的书写设备进行识别，确定书写设备与书写介质在相连位置处的当前笔迹，并获取当前笔迹在书写介质上的第一位置信息。
在一种可能实现的方式中，终端设备根据第一图像信息，确定书写设备当前在书写介质中的位置坐标以及书写介质的边缘坐标；根据书写设备当前在书写介质中的位置坐标以及书写介质的边缘坐标，确定当前笔迹在书写介质上的第一位置信息。
比如，类似上述图4所示，终端设备通过对第一图像信息进行识别之后，按照第一图像信中书写介质的长和宽建立空间直角坐标系，并根据其中书写介质的四个角点的角点坐标获取书写介质的边缘坐标。终端设备还可以通过第一图像信息，确定出书写设备当前在书写介质中的位置坐标，根据书写设备的位置坐标以及书写介质的边缘坐标，确定出当前笔迹在书写介质上的第一位置信息。即，终端设备通过书写设备在当前书写介质中的位置坐标以及书写介质的边缘坐标，确定当前笔迹在书写介质上的相对坐标，从而指示当前笔迹在书写介质上的位置与书写介质边缘之间的位置关系，实现对当前笔迹在书写介质上位置的表示。
在一种可能实现的方式中，终端设备还可以根据第一图像信息，获取书写介质与电子垫板的位置关系；根据位置关系，校正当前笔迹在书写介质上的第一位置信息。即，终端设备通过对第一图像信息中书写介质的位置及电子垫板进行识别，获取电子垫板在基于书写介质的长和宽建立空间直角坐标系下的位置坐标，从而获取到书写介质与电子垫板的位置关系。
可选的，终端设备还可以根据书写介质与电子垫板的位置关系，对当前笔迹在书写介质上的第一位置信息进行校正。比如，终端设备确定书写介质与电子垫板之间的位置关系之后，当前笔迹在书写介质上可能是具有方向的，请参考图8，其示出了本申请一示例性实施例涉及的一种电子笔在电子垫板上书写的的图像示意图。如图8所示，其中包含了电子垫板801，书写设备802，书写介质803，当前笔迹804。在书写过程中，由于书写动作等原因，用户可能将书写介质在电子垫板上拖动或者旋转，导致书写介质803相对于电子垫板的位置发生移动，此时，终端设备可以根据书写介质与电子垫板的位置关系，将获取到的当前笔迹在书写介质上的第一位置信息进行校正，使得当前笔迹在书写介质上的相对位置更加准确。
步骤507，根据当前笔迹，目标电子文档以及第一位置信息，确定当前笔迹在目标电子文档中的第二位置信息。
可选的，根据目标电子文档中预先划分的各个图档区域与第一位置信息进行比对，确定目标图档区域，目标图档区域是第一位置信息在目标电子文档中所属的图档区域；根据目标图档区域，确定当前笔迹在目标电子文档中的第二位置信息。
请参考图9，其示出了本申请一示例性实施例涉及的一种目标电子文档的图像示意图。如图9所示，其中包含了目标电子文档900，各个图档区域901，第一位置902。各个图档区域901可以是终端设备在对目标电子文档900录入时预先划分的。本步骤中，终端设备根据第一位置信息，确定第一位置信息所处的图档区域，将第一位置信息所处的图档区域确定为 目标图档区域。比如，当第一位置信息是图9中的第一位置902所在的位置信息，目标图档区域就是图9中第一位置所处的图档区域。终端设备根据确定的目标图档区域，获取当前笔迹在目标电子文档中的第二位置信息。第二位置信息可以指示当前笔迹在目标电子文档中所处的位置。
步骤508，将当前笔迹按照第二位置信息填充至目标电子文档中。
在一种可能实现的方式中，终端设备可以将获取到的当前笔迹按照第二位置信息填充到目标电子文档中，并将目标电子文档输出。请参考图10，其示出了本申请一示例性实施例涉及的一种包含书写笔迹的目标电子文档的图像示意图。如图10所示，其中包含了目标电子文档1000，各个书写笔迹1001。如图10所示，终端设备在确定出当前笔迹在目标电子文档中的第二位置信息之后，最终可以将此次获取的书写笔迹全都填充在目标电子文档中，并且在显示屏中显示。
步骤509，根据目标电子文档中在第二位置信息处对应的预设文字信息，对当前笔迹进行校验。
可选的，预设文字信息可以是目标电子文档的答案信息。比如，终端设备也可以预先将目标电子文档的答案信息进行存储，在本步骤中，终端设备可以根据目标电子文档，获取到与目标电子文档对应的答案信息，并给予目标电子文档中在第二位置信息处对应的答案(预设文字信息)，对用户书写的笔迹进行校验。
可选的，当当前笔迹与预设文字信息不相同时，在第二位置信息处展示第一标示信息；当当前笔迹与预设文字信息相同时，在第二位置信息处展示第二标示信息。即，如果当前笔迹与预设文字信息不相同，终端设备可以在第二位置信息处展示第一标示信息，该第一标示信息用于指示用户书写的结果错误；如果当前笔迹与预设文字信息相同，在第二位置信息处展示第二标示信息，该第二标示信息用于指示用户书写的结果正确。请参考图11，其示出了本申请一示例性实施例涉及的一种包含批阅结果的目标电子文档的图像示意图。如图11所示，其中包含了目标电子文档1100，各个书写笔迹1101，第一标示信息1102，第二标示信息1103。如图11所示，终端设备在确定出当前笔迹在目标电子文档中的第二位置信息之后，将获取的书写笔迹全都填充在目标电子文档中，利用答案信息对目标电子文档中的各个书写笔迹进行校验，达到批阅效果，并且在显示屏中显示第一标示信息和第二标示信息。
在一种可能实现的方式中，通过电子垫板获取书写设备在书写介质上进行书写过程中当前笔迹的笔迹顺序；在根据当前笔迹，目标电子文档以及第一位置信息，确定当前笔迹在目标电子文档中的第二位置信息之后，根据目标电子文档中在第二位置信息处的文字信息对应的预设顺序，对笔迹顺序进行校正。
比如，电子垫板在获取书写设备在书写介质上进行书写过程中的当前笔迹时，顺便记录书写设备在书写介质上进行书写过程中当前笔迹的笔迹顺序，并将笔迹顺序也按照上述通信方式发送给终端设备，终端设备在执行上述步骤507之后，还可以根据目标电子文档中在第二位置信息处的文字信息对应的预设顺序，对笔迹顺序进行校正，也可以利用类似于图11所示的方式对该书写笔迹的书写顺序进行校验，并显示笔迹顺序是否正确，达到对用户书写过程的指导。
在一种可能实现的方式中，终端设备还可以获取当前笔迹的书写时长；根据当前笔迹的书写时长，计算目标电子文档中在第二位置信息处对应文档内容的完成率。比如，在上述图9中，对于第一个图档区域来说，用户书写对应的书写笔迹花费了2分钟，可以说明用户完成目标电子文档中对应第一个图档区域的完成率是2分钟，获取到用户的做题效率。
综上所述，本申请通过电子垫板获取书写设备在书写介质上进行书写过程中的当前笔迹，书写介质放置在电子垫板上；通过终端设备的摄像头采集书写设备在书写介质上进行书写过程的第一图像信息；根据第一图像信息，确定书写介质对应的目标电子文档；根据第一图像信息，获取当前笔迹在书写介质上的第一位置信息；根据第一位置，目标电子文档以及第一位置信息，确定当前笔迹在目标电子文档中的第二位置信息。本申请在确定书写介质上的当前笔迹之后，还结合摄像头采集的第一图像信息确定的目标电子文档以及当前笔迹在书写介质上的第一位置信息，确定当前笔迹在目标电子文档中的第二位置信息，当书写介质在电子垫板上被挪动时，仍然可以结合第一图像信息确定出当前笔迹在目标电子文档中的第二位置信息，提高确定笔迹位置的准确性。
下面，以上述终端设备是平板电脑，平板电脑通过自身的摄像头，实现对学生日常撰写习题的过程进行监督为例，对上述图2和图5所示的实施例进行举例介绍，对于本申请装置实施例中未披露的细节，请参照本申请图2或者图5中实施例的相关描述。
请参考图12，其示出了本申请一示例性实施例提供的一种笔迹位置的确定方法的方法流程图。该方法可以由终端设备执行，终端设备与电子垫板之间具有通信连接，如图12所示，该笔迹位置的确定方法可以包括如下几个步骤。
步骤1201，利用平板电脑的摄像头将纸质介质内容转化为图形化的电子文档录入系统。
可选的，用户通过平板电脑预先对课本、练习册、辅导书籍、试卷等书写介质进行识别并存储，将纸质介质内容转化为图形化的电子文档录入到作业检测系统中。其中，作业检测系统可以是开发人员或者运维人员预先开发的。比如，平板电脑上安装有作业检测应用程序，用户通过点击该应用程序，触发平板电脑启动作业检测系统。
步骤1202，通过平板电脑的摄像头采集电子垫板上的书写图像。
可选的，在用户撰写过程中，电子垫板会向平板电脑发送书写笔迹，平板电脑通过摄像头对学生撰写过程进行拍摄，得到撰写过程中的书写图像。
步骤1203，平板电脑接收电子垫板发送的书写笔迹，并利用采集的书写图像获取书写笔迹的位置信息。
步骤1204，平板电脑利用时间同步，确定书写笔迹在电子文档中的位置。
可选的，平板电脑在根据书写图像确定出对应的电子文档之后，平板电脑还可以根据时间同步规则，确定同一时间下接收到的书写笔迹以及拍摄的书写图像，根据书写笔迹以及书写笔迹在书写介质中对应的位置信息，确定书写笔迹在电子文档中的位置。
步骤1205，平板电脑根据预先存储的答案对电子文档中对应位置处的书写笔迹进行批改。
平板电脑根据预先存储的答案对对电子文档中书写笔迹进行批改。
步骤1206，平板电脑将含有书写笔迹、批改信息的电子文档输出。
可选的，类似于上述图11，平板电脑将包含批阅结果的电子文档输出。
综上所述，本申请通过电子垫板获取书写设备在书写介质上进行书写过程中的当前笔迹，书写介质放置在电子垫板上；通过终端设备的摄像头采集书写设备在书写介质上进行书写过程的第一图像信息；根据第一图像信息，确定书写介质对应的目标电子文档；根据第一图像信息，获取当前笔迹在书写介质上的第一位置信息；根据第一位置，目标电子文档以及第一位置信息，确定当前笔迹在目标电子文档中的第二位置信息。本申请在确定书写介质上的当前笔迹之后，还结合摄像头采集的第一图像信息确定的目标电子文档以及当前笔迹在书写介质上的第一位置信息，确定当前笔迹在目标电子文档中的第二位置信息，当书写介质在电子垫板上被挪动时，仍然可以结合第一图像信息确定出当前笔迹在目标电子文档中的第二位置信息，提高确定笔迹位置的准确性。
下述为本申请装置实施例，可以用于执行本申请方法实施例。对于本申请装置实施例中未披露的细节，请参照本申请方法实施例。
请参考图13，其示出了本申请一示例性实施例提供的笔迹位置的确定装置的结构框图。该笔迹位置的确定装置1300可以用于终端设备中，终端设备与电子垫板之间具有通信连接，如图13所示，该笔迹位置的确定装置可以包括如下几个步骤。
第一获取模块1301，用于通过所述电子垫板获取书写设备在书写介质上进行书写过程中的当前笔迹，所述书写介质放置在所述电子垫板上；
第一采集模块1302，用于通过所述终端设备的摄像头采集所述书写设备在所述书写介质 上进行书写过程的第一图像信息；
第一确定模块1303，用于根据所述第一图像信息，确定所述书写介质对应的目标电子文档；
第二获取模块1304，用于根据所述第一图像信息，获取所述当前笔迹在所述书写介质上的第一位置信息；
第二确定模块1305，用于根据所述第一位置，所述目标电子文档以及所述第一位置信息，确定所述当前笔迹在所述目标电子文档中的第二位置信息。
可选的，所述第一确定模块1303，包括：第一获取单元和第一查询单元；
所述第一获取单元，用于对所述第一图像信息进行图像识别，获取所述书写介质中的特征信息，所述特征信息包括目标图形和/或目标关键词中的至少一种；
所述第一查询单元，用于根据所述特征信息，查询与所述特征信息对应的所述目标电子文档。
可选的，第二获取模块1304，包括：第一确定单元和第二确定单元；
所述第一确定单元，用于根据所述第一图像信息，确定所述书写设备当前在所述书写介质中的位置坐标以及所述书写介质的边缘坐标；
所述第二确定单元，用于根据所述书写设备当前在所述书写介质中的位置坐标以及所述书写介质的边缘坐标，确定所述当前笔迹在所述书写介质上的第一位置信息。
可选的，所述当前笔迹对应有第一时间信息，所述第一图像信息对应有第二时间信息；
所述装置还包括：
第三获取模块，用于在所述根据所述第一图像信息，确定所述书写介质对应的目标电子文档之前，根据所述第一时间信息，获取与所述第一时间信息相同的第二时间信息；
第四获取模块，用于获取所述第二时间信息对应的所述第一图像信息。
可选的，所述第二确定模块1305，包括：第三确定单元和第四确定单元；
所述第三确定单元，用于根据所述目标电子文档中预先划分的各个图档区域与所述第一位置信息进行比对，确定目标图档区域，所述目标图档区域是所述第一位置信息在所述目标电子文档中所属的图档区域；
所述第四确定单元，用于根据所述目标图档区域，确定所述当前笔迹在所述目标电子文档中的第二位置信息。
可选的，所述装置还包括：
第四获取模块，用于在所述根据所述当前笔迹，所述目标电子文档以及所述第一位置信息，确定所述当前笔迹在所述目标电子文档中的第二位置信息之前，根据所述第一图像信息， 获取所述书写介质与所述电子垫板的位置关系；
第一校正模块，用于根据所述位置关系，校正所述当前笔迹在所述书写介质上的第一位置信息。
可选的，所述装置还包括：
第一填充模块，用于在所述根据所述笔迹信息，所述目标电子文档以及所述第一位置信息，确定所述当前笔迹在所述目标电子文档中的第二位置信息之后，将所述当前笔迹按照所述第二位置信息填充至所述目标电子文档中；
第一检验模块，用于根据所述目标电子文档中在所述第二位置信息处对应的预设文字信息，对所述当前笔迹进行校验；
第一展示模块，用于当所述当前笔迹与所述预设文字信息不相同时，在所述第二位置信息处展示第一标示信息；
第二展示模块，用于当所述当前笔迹与所述预设文字信息相同时，在所述第二位置信息处展示第二标示信息。
可选的，所述装置还包括：
第五获取模块，用于通过所述电子垫板获取书写设备在书写介质上进行书写过程中当前笔迹的笔迹顺序；
第二校正模块，用于在所述根据所述当前笔迹，所述目标电子文档以及所述第一位置信息，确定所述当前笔迹在所述目标电子文档中的第二位置信息之后，根据所述目标电子文档中在所述第二位置信息处的文字信息对应的预设顺序，对所述笔迹顺序进行校正。
可选的，所述装置还包括：
第六获取模块，用于在所述根据所述当前笔迹，所述目标电子文档以及所述第一位置信息，确定所述当前笔迹在所述目标电子文档中的第二位置信息之后，获取所述当前笔迹的书写时长；
完成率计算模块，用于根据所述当前笔迹的书写时长，计算目标电子文档中在所述第二位置信息处对应文档内容的完成率。
综上所述，本申请通过电子垫板获取书写设备在书写介质上进行书写过程中的当前笔迹，书写介质放置在电子垫板上；通过终端设备的摄像头采集书写设备在书写介质上进行书写过程的第一图像信息；根据第一图像信息，确定书写介质对应的目标电子文档；根据第一图像信息，获取当前笔迹在书写介质上的第一位置信息；根据第一位置，目标电子文档以及第一位置信息，确定当前笔迹在目标电子文档中的第二位置信息。本申请在确定书写介质上的当前笔迹之后，还结合摄像头采集的第一图像信息确定的目标电子文档以及当前笔迹在书写介 质上的第一位置信息，确定当前笔迹在目标电子文档中的第二位置信息，当书写介质在电子垫板上被挪动时，仍然可以结合第一图像信息确定出当前笔迹在目标电子文档中的第二位置信息，提高确定笔迹位置的准确性。
请参考图14，其示出了本申请一示例性实施例公开的一种终端设备的结构示意图。如图14所示，可以包括：射频(Radio Frequency，RF)电路1410、存储器1420、输入单元1430、显示单元1440、传感器1450、音频电路1460、WiFi模块1470、处理器1480、以及电源1490等部件。在上述实施例中，该终端设备是可以作为按摩设备，也可以作为目标设备。本领域技术人员可以理解，图14中示出的终端设备结构并不构成对终端设备的限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。
下面结合图14对终端设备的各个构成部件进行介绍：
RF电路1410可用于收发信息或通话过程中，信号的接收和发送，特别地，将基站的下行信息接收后，给处理器1480处理；另外，将设计上行的数据发送给基站。通常，RF电路1410包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器(Low Noise Amplifier，LNA)、双工器等。此外，RF电路1410还可以通过无线通信与网络和其他设备通信。上述无线通信可以使用任一通信标准或协议，包括但不限于全球移动通讯系统(Global System of Mobile communication，GSM)、通用分组无线服务(General Packet Radio Service，GPRS)、码分多址(Code Division Multiple Access，CDMA)、宽带码分多址(Wideband Code Division Multiple Access,WCDMA)、长期演进(Long Term Evolution，LTE)、电子邮件、短消息服务(Short Messaging Service，SMS)等。
存储器1420可用于存储软件程序以及模块，处理器1480通过运行存储在存储器1420的软件程序以及模块，从而执行终端设备的各种功能应用以及数据处理。存储器1420可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等；存储数据区可存储根据终端设备的使用所创建的数据(比如音频数据、电话本等)等。此外，存储器1420可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。
输入单元1430可用于接收输入的数字或字符信息，以及产生与终端设备的用户设置以及功能控制有关的键信号输入。具体地，输入单元1430可包括触控面板1431以及其他输入设备1432。触控面板1431，也称为触摸屏，可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板1431上或在触控面板1431附近的操作)， 并根据预先设定的程式驱动相应的连接装置。可选的，触控面板1431可包括触摸检测装置和触摸控制器两个部分。其中，触摸检测装置检测用户的触摸方位，并检测触摸操作带来的信号，将信号传送给触摸控制器；触摸控制器从触摸检测装置上接收触摸信息，并将它转换成触点坐标，再送给处理器1480，并能接收处理器1480发来的命令并加以执行。此外，可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触控面板1431。除了触控面板1431，输入单元1430还可以包括其他输入设备1432。具体地，其他输入设备1432可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。
显示单元1440可用于显示由用户输入的信息或提供给用户的信息以及终端设备的各种菜单。显示单元1440可包括显示面板1441，可选的，可以采用液晶显示器(Liquid Crystal Display，LCD)、有机发光二极管(Organic Light-Emitting Diode,OLED)等形式来配置显示面板1441。进一步的，触控面板1431可覆盖显示面板1441，当触控面板1431检测到在其上或附近的触摸操作后，传送给处理器1480以确定触摸事件的类型，随后处理器1480根据触摸事件的类型在显示面板1441上提供相应的视觉输出。虽然在图14中，触控面板1431与显示面板1441是作为两个独立的部件来实现终端设备的输入和输入功能，但是在某些实施例中，可以将触控面板1431与显示面板1441集成而实现终端设备的输入和输出功能。
终端设备还可包括至少一种传感器1450，比如光传感器、运动传感器以及其他传感器。具体地，光传感器可包括环境光传感器及接近传感器，其中，环境光传感器可根据环境光线的明暗来调节显示面板1441的亮度，接近传感器可在终端设备移动到耳边时，关闭显示面板1441和/或背光。作为运动传感器的一种，加速计传感器可检测各个方向上(一般为三轴)加速度的大小，静止时可检测出重力的大小及方向，可用于识别终端设备姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等；至于终端设备还可配置的陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器，在此不再赘述。
音频电路1460、扬声器1461，传声器1462可提供用户与终端设备之间的音频接口。音频电路1450可将接收到的音频数据转换后的电信号，传输到扬声器1461，由扬声器1461转换为声音信号输出；另一方面，传声器1462将收集的声音信号转换为电信号，由音频电路1460接收后转换为音频数据，再将音频数据输出处理器1480处理后，经RF电路1410以发送给比如另一终端设备，或者将音频数据输出至存储器1420以便进一步处理。
WiFi属于短距离无线传输技术，终端设备通过WiFi模块1470可以帮助用户收发电子邮件、浏览网页和访问流式媒体等，它为用户提供了无线的宽带互联网访问。虽然图14示出了 WiFi模块1470，但是可以理解的是，其并不属于终端设备的必须构成，完全可以根据需要在不改变发明的本质的范围内而省略。
处理器1480是终端设备的控制中心，利用各种接口和线路连接整个终端设备的各个部分，通过运行或执行存储在存储器1420内的软件程序和/或模块，以及调用存储在存储器1420内的数据，执行终端设备的各种功能和处理数据，从而对终端设备进行整体监控。可选的，处理器1480可包括一个或多个处理单元；优选的，处理器1480可集成应用处理器和调制解调处理器，其中，应用处理器主要处理操作系统、用户界面和应用程序等，调制解调处理器主要处理无线通信。可以理解的是，上述调制解调处理器也可以不集成到处理器1480中。
终端设备还包括给各个部件供电的电源1490(比如电池)，优选的，电源可以通过电源管理系统与处理器1480逻辑相连，从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。
尽管未示出，终端设备还可以包括摄像头、蓝牙模块等，在此不再赘述。
本申请实施例公开一种计算机可读存储介质，其存储计算机程序，其中，该计算机程序被处理器执行时实现上述方法实施例中的方法。
本申请实施例公开一种计算机程序产品，该计算机程序产品包括存储了计算机程序的非瞬时性计算机可读存储介质，且该计算机程序可操作来使计算机执行上述方法实施例中的方法。
本申请实施例公开一种应用发布平台，其中，应用发布平台用于发布计算机程序产品，其中，当计算机程序产品在计算机上运行时，使得计算机执行上述方法实施例中的方法。
应理解，说明书通篇中提到的“一个实施例”或“一实施例”意味着与实施例有关的特定特征、结构或特性包括在本申请的至少一个实施例中。因此，在整个说明书各处出现的“在一个实施例中”或“在一实施例中”未必一定指相同的实施例。此外，这些特定特征、结构或特性可以以任意适合的方式结合在一个或多个实施例中。本领域技术人员也应该知悉，说明书中所描述的实施例均属于可选实施例，所涉及的动作和模块并不一定是本申请所必须的。
在本申请的各种实施例中，应理解，上述各过程的序号的大小并不意味着执行顺序的必然先后，各过程的执行顺序应以其功能和内在逻辑确定，而不应对本申请实施例的实施过程构成任何限定。
上述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物单元，即可位于一个地方，或者也可以分布到多个网络单元上。可根据实际的需要选择其中的部分或全部单元来实现本实施例方案的目的。
另外，在本申请各实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
上述集成的单元若以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可获取的存储器中。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或者部分，可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储器中，包括若干请求用以使得一台计算机设备(可以为个人计算机、服务器或者网络设备等，具体可以是计算机设备中的处理器)执行本申请的各个实施例上述方法的部分或全部步骤。
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成，该程序可以存储于一计算机可读存储介质中，存储介质包括只读存储器(Read-Only Memory，ROM)、随机存储器(Random Access Memory，RAM)、可编程只读存储器(Programmable Read-only Memory，PROM)、可擦除可编程只读存储器(Erasable Programmable Read Only Memory，EPROM)、一次可编程只读存储器(One-time Programmable Read-Only Memory，OTPROM)、电子抹除式可复写只读存储器(Electrically-Erasable Programmable Read-Only Memory，EEPROM)、只读光盘(Compact Disc Read-Only Memory，CD-ROM)或其他光盘存储器、磁盘存储器、磁带存储器、或者能够用于携带或存储数据的计算机可读的任何其他介质。
以上对本申请实施例公开的一种笔迹位置的确定方法、装置、终端设备以及存储介质进行了举例介绍，本文中应用了个例对本申请的原理及实施方式进行了阐述，以上实施例的说明只是用于帮助理解本申请的方法及其核心思想；同时，对于本领域的一般技术人员，依据本申请的思想，在实施方式及应用范围上均会有改变之处，综上所述，本说明书内容不应理解为对本申请的限制。

Claims (12)

  1. 一种笔迹位置的确定方法，其特征在于，所述方法由所述终端设备执行，所述终端设备与电子垫板之间具有通信连接，所述方法包括：
    通过所述电子垫板获取书写设备在书写介质上进行书写过程中的当前笔迹，所述书写介质放置在所述电子垫板上；
    通过所述终端设备的摄像头采集所述书写设备在所述书写介质上进行书写过程的第一图像信息；
    根据所述第一图像信息，确定所述书写介质对应的目标电子文档；
    根据所述第一图像信息，获取所述当前笔迹在所述书写介质上的第一位置信息；
    根据所述当前笔迹，所述目标电子文档以及所述第一位置信息，确定所述当前笔迹在所述目标电子文档中的第二位置信息。
  2. 根据权利要求1所述的方法，其特征在于，所述根据所述第一图像信息，确定所述书写介质对应的目标电子文档，包括：
    对所述第一图像信息进行图像识别，获取所述书写介质中的特征信息，所述特征信息包括目标图形和/或目标关键词中的至少一种；
    根据所述特征信息，查询与所述特征信息对应的所述目标电子文档。
  3. 根据权利要求1所述的方法，其特征在于，所述根据所述第一图像信息，获取当前笔迹在所述书写介质上的第一位置信息，包括：
    根据所述第一图像信息，确定所述书写设备当前在所述书写介质中的位置坐标以及所述书写介质的边缘坐标；
    根据所述书写设备当前在所述书写介质中的位置坐标以及所述书写介质的边缘坐标，确定所述当前笔迹在所述书写介质上的第一位置信息。
  4. 根据权利要求1所述的方法，其特征在于，所述当前笔迹对应有第一时间信息，所述第一图像信息对应有第二时间信息；
    在所述根据所述第一图像信息，确定所述书写介质对应的目标电子文档之前，还包括：
    根据所述第一时间信息，获取与所述第一时间信息相同的第二时间信息；
    获取所述第二时间信息对应的所述第一图像信息。
  5. 根据权利要求1至4任一所述的方法，其特征在于，所述根据所述当前笔迹，所述目 标电子文档以及所述第一位置信息，确定所述当前笔迹在所述目标电子文档中的第二位置信息，包括：
    根据所述目标电子文档中预先划分的各个图档区域与所述第一位置信息进行比对，确定目标图档区域，所述目标图档区域是所述第一位置信息在所述目标电子文档中所属的图档区域；
    根据所述目标图档区域，确定所述当前笔迹在所述目标电子文档中的第二位置信息。
  6. 根据权利要求1至4任一所述的方法，其特征在于，在所述根据所述当前笔迹，所述目标电子文档以及所述第一位置信息，确定所述当前笔迹在所述目标电子文档中的第二位置信息之前，还包括：
    根据所述第一图像信息，获取所述书写介质与所述电子垫板的位置关系；
    根据所述位置关系，校正所述当前笔迹在所述书写介质上的第一位置信息。
  7. 根据权利要求1至4任一所述的方法，其特征在于，在所述根据所述笔迹信息，所述目标电子文档以及所述第一位置信息，确定所述当前笔迹在所述目标电子文档中的第二位置信息之后，还包括：
    将所述当前笔迹按照所述第二位置信息填充至所述目标电子文档中；
    根据所述目标电子文档中在所述第二位置信息处对应的预设文字信息，对所述当前笔迹进行校验；
    当所述当前笔迹与所述预设文字信息不相同时，在所述第二位置信息处展示第一标示信息；
    当所述当前笔迹与所述预设文字信息相同时，在所述第二位置信息处展示第二标示信息。
  8. 根据权利要求1至4任一所述的方法，其特征在于，所述方法还包括：
    通过所述电子垫板获取书写设备在书写介质上进行书写过程中当前笔迹的笔迹顺序；
    在所述根据所述当前笔迹，所述目标电子文档以及所述第一位置信息，确定所述当前笔迹在所述目标电子文档中的第二位置信息之后，根据所述目标电子文档中在所述第二位置信息处的文字信息对应的预设顺序，对所述笔迹顺序进行校正。
  9. 根据权利要求1至4任一所述的方法，其特征在于，在所述根据所述当前笔迹，所述目标电子文档以及所述第一位置信息，确定所述当前笔迹在所述目标电子文档中的第二位置 信息之后，还包括：
    获取所述当前笔迹的书写时长；
    根据所述当前笔迹的书写时长，计算目标电子文档中在所述第二位置信息处对应文档内容的完成率。
  10. 一种笔迹位置的确定装置，其特征在于，所述装置由所述终端设备执行，所述终端设备与电子垫板之间具有通信连接，所述装置包括：
    第一获取模块，用于通过所述电子垫板获取书写设备在书写介质上进行书写过程中的当前笔迹，所述书写介质放置在所述电子垫板上；
    第一采集模块，用于通过所述终端设备的摄像头采集所述书写设备在所述书写介质上进行书写过程的第一图像信息；
    第一确定模块，用于根据所述第一图像信息，确定所述书写介质对应的目标电子文档；
    第二获取模块，用于根据所述第一图像信息，获取所述当前笔迹在所述书写介质上的第一位置信息；
    第二确定模块，用于根据所述第一位置，所述目标电子文档以及所述第一位置信息，确定所述当前笔迹在所述目标电子文档中的第二位置信息。
  11. 一种终端设备，其特征在于，包括存储器及处理器，所述存储器中存储有计算机程序，所述计算机程序被所述处理器执行时，使得所述处理器实现如权利要求1至9任一所述的笔迹位置的确定获取方法。
  12. 一种计算机可读存储介质，其上存储有计算机程序，其特征在于，所述计算机程序被处理器执行时实现如权利要求1至9任一所述的笔迹位置的确定方法。
PCT/CN2021/120025 2021-08-31 2021-09-23 笔迹位置的确定方法、装置、终端设备及存储介质 WO2023029125A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111011111.9A CN115761767A (zh) 2021-08-31 2021-08-31 笔迹位置的确定方法、装置、终端设备及存储介质
CN202111011111.9 2021-08-31

Publications (1)

Publication Number Publication Date
WO2023029125A1 true WO2023029125A1 (zh) 2023-03-09

Family

ID=85331955

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/120025 WO2023029125A1 (zh) 2021-08-31 2021-09-23 笔迹位置的确定方法、装置、终端设备及存储介质

Country Status (2)

Country Link
CN (1) CN115761767A (zh)
WO (1) WO2023029125A1 (zh)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100104189A1 (en) * 2008-10-23 2010-04-29 Aravamudhan Bharath Handwriting Identification Method, Program And Electronic Device
CN103380413A (zh) * 2011-02-21 2013-10-30 夏普株式会社 电子设备、内容显示方法及内容显示程序
CN104835365A (zh) * 2015-05-05 2015-08-12 广东小天才科技有限公司 一种适用于书写作业检查的方法、智能设备及装置
CN109800297A (zh) * 2019-01-23 2019-05-24 广东小天才科技有限公司 一种基于学习设备的学习辅助方法及学习设备
CN112684922A (zh) * 2021-03-11 2021-04-20 广东小天才科技有限公司 笔迹同步方法、装置、系统、终端设备及存储介质

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100104189A1 (en) * 2008-10-23 2010-04-29 Aravamudhan Bharath Handwriting Identification Method, Program And Electronic Device
CN103380413A (zh) * 2011-02-21 2013-10-30 夏普株式会社 电子设备、内容显示方法及内容显示程序
CN104835365A (zh) * 2015-05-05 2015-08-12 广东小天才科技有限公司 一种适用于书写作业检查的方法、智能设备及装置
CN109800297A (zh) * 2019-01-23 2019-05-24 广东小天才科技有限公司 一种基于学习设备的学习辅助方法及学习设备
CN112684922A (zh) * 2021-03-11 2021-04-20 广东小天才科技有限公司 笔迹同步方法、装置、系统、终端设备及存储介质

Also Published As

Publication number Publication date
CN115761767A (zh) 2023-03-07

Similar Documents

Publication Publication Date Title
CN108090855B (zh) 一种学习计划推荐方法及移动终端
CN110970003A (zh) 屏幕亮度调整方法、装置、电子设备及存储介质
CN104798362A (zh) 用户终端、外部装置、数据收发系统和数据收发方法
CN109063583A (zh) 一种基于点读操作的学习方法及电子设备
CN110083319B (zh) 笔记显示方法、装置、终端和存储介质
CN107358227A (zh) 一种标记识别方法、移动终端以及计算机可读存储介质
US20210096739A1 (en) Method For Editing Text And Mobile Terminal
CN112068752B (zh) 一种空间展示方法、装置、电子设备及存储介质
CN109739418A (zh) 多媒体播放应用程序的交互方法及终端
KR20220154763A (ko) 이미지 처리 방법 및 전자 장비
CN107632768A (zh) 按键使用方法、终端及计算机可读存储介质
US20170329486A1 (en) Method and device for interaction between terminals
CN109495638B (zh) 一种信息显示方法及终端
CN109857321A (zh) 基于屏幕投影的操作方法、移动终端、可读存储介质
CN107809531A (zh) 一种日程创建方法、移动终端
WO2020238496A1 (zh) 图标管理方法及终端设备
KR102511456B1 (ko) 문자 입력 방법 및 단말
CN110197159B (zh) 指纹采集方法及终端
CN109960456B (zh) 一种虚拟按键布局的生成方法及终端设备
CN109947988B (zh) 一种信息处理方法、装置、终端设备及服务器
WO2021197260A1 (zh) 便签创建方法及电子设备
CN108762641B (zh) 一种文本编辑方法及终端设备
CN109739414A (zh) 一种图片处理方法、移动终端、计算机可读存储介质
CN109120778A (zh) 一种显示控制方法及终端
CN109062485A (zh) 双面屏的显示方法、双面屏终端及计算机可读存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21955655

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE