CN116229472B

CN116229472B - Intelligent pen, written information acquisition system and correction processing system

Info

Publication number: CN116229472B
Application number: CN202310525290.0A
Authority: CN
Inventors: 胡华成; 张鸿亮
Original assignee: Shenzhen Bangbangbang Technology Co ltd
Current assignee: Shenzhen Bangbangbang Technology Co ltd
Priority date: 2023-05-11
Filing date: 2023-05-11
Publication date: 2023-08-01
Anticipated expiration: 2043-05-11
Also published as: CN116229472A

Abstract

The application relates to an intelligent pen, a writing information acquisition system and a correction processing system, wherein a writing end of the intelligent pen is provided with a camera unit and an auxiliary light source, the camera unit is used for shooting a writing area pointed by the writing end, and a control unit of the intelligent pen acquires image data shot by the camera unit; the control unit is provided with at least two working modes including an infrared light shooting mode and a visible light shooting mode; in the infrared shooting mode, the control unit controls the auxiliary light source to emit infrared light, and the image pickup unit shoots an infrared light image of the writing area; in the visible light shooting mode, the control unit controls the auxiliary light source to emit white light, and the image pickup unit shoots a visible light image of the writing area. The intelligent pen has wider application prospect and better application effect, and can better realize writing information acquisition.

Description

Intelligent pen, written information acquisition system and correction processing system

Technical Field

The application relates to the technical field of intelligent pens, in particular to an intelligent pen, a written information acquisition system and a correction processing system.

Background

The existing dot matrix intelligent pen is mainly used for collecting dot matrix code image information on writing paper during writing, so that written track information is obtained through calculation according to the dot matrix code image information. The device generally comprises a control unit, a pressure sensing unit for monitoring a writing end and a high-definition camera shooting unit which is arranged in the writing end and is specially used for shooting dot matrix code images. When the writing end writes on the writing paper printed with the dot matrix code, the pressure sensor is triggered to start the high-definition camera unit, dot matrix code images of the writing area are shot at a high speed through the high-definition camera unit and transmitted to the processor, the processor analyzes the dot matrix code images through an algorithm to obtain coordinate information, and then a writing track of the writing end is obtained through calculation according to a series of coordinate information.

However, the existing dot matrix smart pen is limited to a single shooting mode, and is usually an infrared shooting mode dedicated to shooting dot matrix code image information, which results in limited application, and is usually only used for collecting writing tracks of writers and synchronously storing and displaying by using APP or cloud.

Disclosure of Invention

Accordingly, an object of the present application is to provide a smart pen capable of supporting a wider range of applications, not limited to a single shooting mode, but to collecting a dot matrix code image.

The embodiment of the application discloses an intelligent pen, which comprises a pen body, a control unit and a shooting unit, wherein one end of the pen body is a writing end, the control unit is arranged in the pen body, the shooting unit is arranged in the writing end, and the shooting unit is connected with the control unit; the intelligent pen further comprises an auxiliary light source, wherein the auxiliary light source is arranged in the writing end and is connected with the control unit;

the control unit is used for acquiring image data shot by the shooting unit; the control unit is provided with at least two working modes including an infrared light shooting mode and a visible light shooting mode, wherein the infrared light shooting mode is used for shooting dot matrix code images; in the infrared shooting mode, the control unit controls the auxiliary light source to emit infrared light, and the shooting unit shoots an infrared dot matrix code image of the writing area; in the visible light shooting mode, the control unit controls the auxiliary light source to emit white light, the camera shooting unit shoots a visible light image of the writing area, and the visible light image is used for identifying text information or handwriting image information;

The working mode of the control unit further comprises a mixed mode, and in the mixed mode, the control unit controls the image pickup unit and the auxiliary light source to alternately shoot in the infrared light shooting mode and the visible light shooting mode, and infrared light dot matrix code image data and visible light image data shot by the image pickup unit are alternately acquired.

In one embodiment, when writing paper exists in a writing area pointed by the writing end, the infrared dot matrix code image data shot by the shooting unit in the infrared shooting mode comprises a coordinate mark of the writing paper, and the control unit recognizes the coordinate mark and acquires coordinate information of the writing paper corresponding to the writing area; the coordinate mark is used for marking coordinate information of the writing paper.

In one embodiment, the control unit calculates the writing speed of the writing end according to the coordinate mark, and adjusts the working frequency of the visible light shooting mode according to the writing speed;

and/or the control unit controls the working frequency of the infrared light shooting mode, and adjusts the working frequency of the visible light shooting mode according to the working frequency of the infrared light shooting mode.

In one embodiment, when the control unit adjusts the operating frequency of the visible light photographing mode according to the writing speed, the greater the writing speed of the writing tip, the greater the operating frequency of the visible light photographing mode is adjusted by the control unit;

and/or when the control unit adjusts the working frequency of the visible light shooting mode according to the working frequency of the infrared light shooting mode, if the working frequency of the infrared light shooting mode exceeds a preset frequency threshold, the working frequency of the visible light shooting mode is reduced.

In one embodiment, the pen further comprises a pressure sensor, wherein the pressure sensor is arranged in the pen body, is connected with the control unit, detects pressure data of the writing end and transmits the pressure data to the control unit;

and the control unit receives and judges whether the pressure data exceeds a preset pressure threshold, if so, the control unit is switched to the mixing mode, and otherwise, the control unit is not switched to the mixing mode.

In one embodiment, the camera unit comprises an infrared light macro camera module and a visible light macro camera module, wherein the infrared light macro camera module is used for shooting infrared light dot matrix code images in the infrared light shooting mode; the visible light micro-camera module is used for shooting visible light images in the visible light shooting mode;

Or, the camera unit is a micro-distance camera module, the micro-distance camera module shoots an infrared dot matrix code image in the infrared shooting mode, and shoots a visible light image in the visible light shooting mode.

In one embodiment, the auxiliary light source comprises an infrared light LED and a white light LED, the infrared light LED and the white light LED are respectively arranged at two sides of the camera unit, and the infrared light LED and the white light LED are equidistant from the pen core part of the writing end.

In one embodiment, the control unit switches to the visible light photographing mode when any one of the following conditions is triggered:

the control unit judges that the image data shot by the shooting unit comprises a preset mark;

the control unit receives a control instruction for switching to the visible light shooting mode;

the control unit detects that the intelligent pen is connected with a server or a mobile terminal through WIFI;

the control unit detects that the intelligent pen performs high-speed communication with a server or a mobile terminal, wherein the high-speed communication means that the communication transmission rate reaches or exceeds a preset transmission rate threshold.

The embodiment of the application also discloses a writing information acquisition system, which comprises:

The intelligent pen according to any one of the above embodiments, wherein the pen body of the intelligent pen is further provided with a communication unit connected with the control unit, the intelligent pen is in communication connection with the information receiving end through the communication unit, and the control unit obtains writing information according to image data shot by the shooting unit and sends the writing information to the information receiving end;

and the information receiving end is used for receiving the writing information sent by the intelligent pen.

The embodiment of the application also discloses a correction processing system, which comprises:

the intelligent pen according to any one of the above embodiments, wherein the pen body of the intelligent pen is further provided with a communication unit connected with the control unit, the intelligent pen is in communication connection with the server through the communication unit, the image data shot by the camera unit comprises dot matrix code image data on answering paper printed with dot matrix code images and visible light image data of the answering paper, the control unit obtains correction handwriting information according to the dot matrix code image data, obtains answer handwriting information on the answering paper according to the visible light image data, and sends the correction handwriting information and the answer handwriting information to the server;

The server is used for receiving the correction handwriting information and the answer handwriting information sent by the intelligent pen, determining corrected questions and corrected content information according to the correction handwriting information, and determining correction results of the corrected questions according to the content information and a preset scoring rule; matching the answer handwriting information with the handwriting characteristic data of a plurality of prestored answer persons, and determining the answer persons corresponding to the answer handwriting information; binding the correction results of the corresponding answering person and the corrected questions.

The intelligent pen provided by the embodiment of the application is provided with at least two shooting modes, including an infrared shooting mode and a visible light shooting mode, and the control unit is provided with at least two working modes including the infrared shooting mode and the visible light shooting mode; in the working mode, the control unit controls the auxiliary light source to emit infrared light, and the image pickup unit shoots an infrared light image of the writing area; and under the working mode of the visible light shooting mode, the control unit controls the auxiliary light source to emit white light, and the image pickup unit shoots the visible light image of the writing area. The intelligent pen can be applied to writing paper provided with coordinate marks such as dot matrix codes, wherein the coordinate marks can be shot by infrared light, an infrared light image containing the coordinate marks can be shot when the intelligent pen is used for writing on the writing paper, a visible light image of the writing paper can be shot, and the visible light image can comprise answer handwriting information and the like on the writing paper. Through the intelligent pen disclosed by the embodiment of the application, the infrared light image and the general visible light image which contain the coordinate mark on the writing paper can be collected together, so that the writing handwriting information of the intelligent pen can be determined according to the coordinate mark and other handwriting information such as answering handwriting information on the writing paper can be identified according to the visible light image on the writing paper. For example, when the intelligent pen is specifically applied to an correction processing system, the intelligent pen provided by the embodiment of the application realizes that when a correction person uses the intelligent pen to correct on the answer sheet printed with the dot matrix code image, the intelligent pen can collect correction handwriting information of correction and answer handwriting information of an answer person on the answer sheet; therefore, the server can determine the correction result of the corresponding question according to the correction handwriting information and the answer handwriting information, and determine the answer corresponding to the answer handwriting information, and bind the corresponding answer and the correction result of the corresponding question, so that more efficient correction is realized, and the workload of the correction is greatly reduced.

For a better understanding and implementation, the present application is described in detail below with reference to the drawings.

Drawings

FIG. 1 is a schematic diagram of a smart pen architecture according to an embodiment of the present application;

FIG. 2 is a side view of a smart pen architecture according to an embodiment of the present application;

FIG. 3 is a cross-sectional view of a smart pen structure according to an embodiment of the present application;

fig. 4 illustrates several arrangements of an auxiliary light source and an image capturing unit according to an embodiment of the present application;

FIG. 5 is a schematic diagram of a smart pen and writing paper co-operation application according to an embodiment of the present application;

FIG. 6 is a schematic diagram of filtering a dot matrix code image for a visible light image according to an embodiment of the present application;

fig. 7 is a schematic diagram of performing puncturing on a dot matrix code pixel block according to an embodiment of the present application;

fig. 8 is a schematic diagram of image stitching of visible light images according to an embodiment of the present application;

FIG. 9 is a schematic view of a smart pen according to an embodiment of the present application forming a tilt angle when writing;

FIG. 10 is a schematic diagram of a written information acquisition system according to an embodiment of the present application;

fig. 11 is a schematic diagram of an modification processing system according to an embodiment of the present application.

Detailed Description

Referring to fig. 1, 2 and 3, the embodiment of the application discloses an intelligent pen, which comprises a pen body 1, a control unit 2 and a camera unit 3, wherein one end of the pen body 1 is a writing end 101, the control unit 2 is arranged in the pen body 1, the camera unit 3 is arranged in the writing end 101, and the camera unit 3 is connected with the control unit 2; the intelligent pen further comprises an auxiliary light source 4, wherein the auxiliary light source 4 is arranged in the writing end 101 and is connected with the control unit 2;

The image capturing unit 3 is configured to capture an image of a writing area pointed by the writing end 101, and the control unit 2 obtains image data captured by the image capturing unit 3; the control unit 2 is provided with at least two modes of operation including an infrared light shooting mode and a visible light shooting mode; in the infrared light shooting mode, the control unit 2 controls the auxiliary light source 4 to emit infrared light, and the image capturing unit 3 shoots an infrared light image of the writing area; in the visible light photographing mode, the control unit 2 controls the auxiliary light source 4 to emit white light, and the image pickup unit 3 photographs a visible light image of the writing area.

In this embodiment of the present application, the smart pen has at least two shooting modes, including an infrared light shooting mode and a visible light shooting mode, and different shooting modes are used for shooting different types of images, such as visible light images or infrared light images. To achieve different shooting modes, it is generally necessary to correspondingly set different types of auxiliary light such as infrared light or white light for auxiliary shooting, and to set different types of cameras such as infrared cameras or visible light cameras for capturing different types of images. In other embodiments, the smart pen may also implement other shooting modes, such as a blue light shooting mode, for shooting other types of images, where the control unit 2 controls the auxiliary light source 4 to emit blue light, and the image capturing unit 3 shoots a blue light image of the writing area.

The writing end 101 is one end of the smart pen for writing, the camera unit 3 is arranged in the smart pen, the camera unit 3 can be arranged to be aligned with the writing area of the writing end 101, specifically aligned with the pen point position of the writing end 101 and the adjacent area thereof, so that the writing area of the writing end 101 can be clearly photographed.

The control unit 2 is configured to control operations of various functional units, modules or devices of the smart pen, and includes controlling the image capturing unit 3 and the auxiliary light source 4 according to a preset control logic, so as to implement a preset working mode, and receiving, processing, and transmitting image data captured by the image capturing unit 3. It may be a general processor or may be an integration of an image processor and a control chip.

In this embodiment, the control unit 2 includes an image processor and a control chip.

The image processor and the control chip can be matched according to different schemes to respectively realize different functions. For example, in an alternative embodiment, the image processor is dedicated to receiving and processing all image data captured by the image capturing unit 3, including infrared light image data and visible light image data, and the control chip controls the auxiliary light source 4 and the image capturing unit 3 to implement a preset working mode. In a preferred embodiment, the image processor is dedicated to receiving and processing infrared light image data captured by the imaging unit 3; the control chip controls the auxiliary light source 4 and the image capturing unit 3 to achieve a preset working mode, and receives and processes visible light image data captured by the image capturing unit 3 in the visible light capturing mode.

In this embodiment, the control unit 2 is provided with at least two working modes, and is configured to control the operation of each shooting mode of the smart pen, including controlling the smart pen to operate in an infrared light shooting mode or a visible light shooting mode, so as to correspondingly acquire an infrared light image or a visible light image shot by the imaging unit 3. In addition, the control unit 2 may further set other operation modes, for example, a hybrid mode in which the control unit 2 controls at least two photographing modes to alternately operate and alternately acquire data of different types of images photographed by the photographing unit 3.

The image capturing unit 3 is used for capturing an image of the writing area. In general, when an image is captured by an image capturing unit, an auxiliary light is required to supplement light to a captured object, so that the captured image is clearer, and particularly, a specific image cannot be captured by visible light, but a specific auxiliary light such as infrared light is required to supplement light to capture the image. The writing end 101 of the present embodiment is further provided with the auxiliary light source 4, and the auxiliary light source 4 is configured to emit different types of auxiliary light to assist the image capturing unit 3 to capture different types of images.

The auxiliary light source 4 and the image pickup unit 3 may be integrally designed, and the whole is arranged in the writing end 101 as a functional component; or may be non-integral but disposed in the same housing and within writing end 101; and may also be separate and separately disposed within writing end 101.

Referring to fig. 3, in the present embodiment, the auxiliary light source 4 includes an infrared LED401 and a white LED402, which are respectively connected to the control unit 2 and are controlled by the control unit 2 to respectively emit infrared light and white light to the writing area. Specifically, in one embodiment, the infrared LED401 and the white LED402 are disposed on two sides of the image capturing unit 3 and equidistant from the pen core 8 of the writing tip 101, respectively. In other embodiments, the infrared LED401, the white LED402, and the position of the imaging unit 3 and the pen core 8 of the writing end 101 may be other specific arrangements, which are not limited to this embodiment of the present application, and may be arranged according to circumstances, please refer to fig. 4, and fig. 4 discloses several different arrangements, wherein the lens refers to the imaging unit.

In other embodiments, the auxiliary light source 4 may not be composed of an infrared light LED and a white light LED, but a special light emitting device may be used, and the light emitting device may adjust the frequency of the emitted light, which may include emitting infrared light, emitting white light, and the like.

Accordingly, for capturing different types of images, the camera unit 3 may also use a corresponding type of camera, such as a visible light camera or an infrared camera, so that the reflected light is captured better to obtain a high-quality image, for example, for capturing an infrared image, the auxiliary light source 4 is required to supplement infrared light to the subject, and a special infrared camera is required at this time because a general visible light camera cannot capture the reflected infrared image. Of course, a camera with stronger photosensitivity and wider photosensitivity frequency range can be adopted, so that capturing of various types of images including visible light images and infrared light images can be realized by only one camera.

Preferably, according to the requirements of different shooting modes, the camera with good photosensitivity and suitable auxiliary light can be adopted in a targeted manner. In one example, to capture the dot matrix code image printed on the writing paper, infrared light is preferably used to assist in capturing, and the camera may also correspondingly use an infrared camera instead of a normal visible light camera to capture the dot matrix code image more clearly.

In this embodiment of the present application, the infrared light shooting mode is a mode for shooting an infrared light image, and is dedicated to collecting a coordinate identifier, for example, a dot matrix code image, on a writing paper, and mainly uses infrared light as auxiliary light during shooting. In general, the smart pen adopts special pen ink to make the written handwriting visible to human eyes but not shot under infrared light, for example, carbon-free pen ink or other pen ink which does not absorb infrared light is adopted to make the written handwriting not absorb infrared light, so that the handwriting written by the smart pen is transparent in the infrared light shooting mode, cannot be shot by the shooting unit 3, and can only be shot by the shooting unit 3 in the visible light shooting mode; in contrast, the coordinate mark, such as a dot matrix code image, on the writing paper is printed with an ink capable of absorbing the infrared light, such as a carbon-containing ink, so that the coordinate mark can be clearly photographed in the infrared light photographing mode.

In one example, when the smart pen writes on writing paper with dot matrix codes printed thereon, when the image capturing unit 3 works in the infrared light capturing mode, handwriting written by the smart pen itself is not captured, handwriting written by other special ink such as carbon-free ink is not captured, but only dot matrix code images on the writing paper are captured, so that the definition of captured dot matrix code images can be ensured, and the processing and analysis of the dot matrix code images by an algorithm are facilitated.

The visible light shooting mode is a mode for shooting a general visible light image, is special for collecting the general visible light image on writing paper, and mainly uses white light as auxiliary light during shooting. The visible light image on the writing paper generally comprises handwriting written on the writing paper by the intelligent pen and original handwriting such as answering handwriting and the like on the writing paper, but may not comprise coordinate marks on the writing paper. In general, the coordinate marks on the writing paper can be printed by special ink so as to have invisible effect or lower visibility, so that the coordinate marks can not be shot when the visible light image is shot, and only other images such as handwriting content and the like are shot.

As for the image pickup unit 3 as described above, the embodiment of the present application also specifically provides the following design, but is not limited to the design provided by the embodiment of the present application.

The camera unit 3 may be a single camera or a combination of a plurality of cameras. And preferably, the camera adopted by the camera unit 3 is a macro camera, so that the image of the writing area can be clearly captured in a close-range scene.

Referring to fig. 5, in one embodiment, the image capturing unit 3 may employ a macro camera module with a wider light sensing range, which is capable of capturing a visible light image and an infrared light image, and specifically, the macro camera module captures an infrared light image in the infrared light capturing mode and captures a visible light image in the visible light capturing mode.

In another embodiment, the camera unit 3 may also be composed of a plurality of different modules, which support implementing different shooting modes for capturing different types of images. Specifically, the camera unit 3 may include an infrared light macro camera module and a visible light macro camera module, where the infrared light macro camera module and the visible light macro camera module are respectively connected to the control unit 2, and the infrared light macro camera module is configured to capture an infrared light image in the infrared light capturing mode; the visible light micro-camera module is used for shooting visible light images in the visible light shooting mode.

The infrared light micro-distance camera module can capture infrared light images sharply, and an infrared sensing device can be adopted for a camera; the visible light micro-distance camera module can capture visible light images sharply, and a camera can adopt a common visible light photosensitive device.

Referring to fig. 5, in an embodiment, an optical filter may be further disposed in front of the image capturing unit 3 and/or the auxiliary light source 4, i.e. pointing in the writing area, for filtering auxiliary light during capturing, and removing interference light of other frequencies, so that the auxiliary light is purer, and thus the captured image has higher definition.

In one embodiment, the smart pen further comprises a communication unit 5, and the communication unit 5 is disposed in the pen body 1 and connected with the control unit 2, and the smart pen is in communication connection with other devices such as a cloud server and a mobile terminal such as a smart phone through the communication unit 5, so that the smart pen can be controlled through the cloud server or the mobile terminal and data transmitted by the smart pen can be received.

The communication unit 5 may be a WIFI communication module, a bluetooth communication module or other wireless communication protocol modules, and may also be a wired communication unit such as a USB serial port. Preferably, the communication unit 5 includes a WIFI communication assembly, a bluetooth communication assembly, and a USB serial port communication assembly, so as to support WIFI communication, bluetooth communication, and USB connection for communication and data transmission.

In one embodiment, the smart pen further comprises a battery unit 6, wherein the battery unit 6 is arranged in the pen body 1 and is used for supplying power to each functional unit of the smart pen, and in particular, the battery unit 6 is connected with the control unit 2 and can also be connected with the communication unit 5 and the like.

The following describes the use of the smart pen and related application scenarios according to the embodiments of the present application.

The intelligent pen provided by the embodiment of the application can shoot images of a writing area during writing, wherein the images comprise infrared light images and visible light images. In one embodiment, when writing paper exists in a writing area pointed by the writing end, the infrared light image data shot by the shooting unit in the infrared light shooting mode comprises a coordinate mark of the writing paper, and the control unit recognizes the coordinate mark and acquires coordinate information of the writing paper corresponding to the writing area; the coordinate mark is used for marking coordinate information of the writing paper.

The smart pen according to this embodiment may be used in combination with writing paper provided with a coordinate identifier, where the coordinate identifier may be an image code, such as a dot matrix code image, or may be another type of identifier, such as a digital identifier. The coordinate mark may be printed on the writing paper, or may be adhered to the writing paper, where the printing is not limited, and is preferably performed by using special ink, so that the coordinate mark has a invisible effect and cannot be photographed under visible light, but can only be photographed under infrared light, for example, a layer of coordinate mark which is invisible to human eyes or has low visibility may be printed on the writing paper by using invisible ink containing carbon elements or ink containing carbon elements and having high transparency, so that the coordinate mark on the writing paper can only be clearly photographed in the infrared light photographing mode, but cannot be photographed in the visible light photographing mode.

In this embodiment, when the writing end 101 writes on the writing paper provided with the coordinate identifier, the image capturing unit 3 captures the coordinate identifier of the writing area in the infrared light capturing mode, the control unit 2 recognizes the coordinate identifier to obtain the corresponding coordinate information, and further, the control unit 2 may calculate the movement track of the writing process of the writing end 101 according to a series of associated coordinate information, so as to determine the writing content. If the image capturing unit 3 is not in the infrared light capturing mode, but in the visible light capturing mode, a visible light image on the writing paper is captured, and the visible light image on the writing paper generally includes text information, writing handwriting, and the like on the writing paper, so that the image information related to image recognition can also include the text information and writing handwriting content.

Referring to fig. 5, in this embodiment, the smart pen is specifically configured to be used with a writing paper printed with a dot matrix code image, and when the writing end 101 writes on the writing paper, the image capturing unit 3 can capture the dot matrix code image on the writing paper in the infrared light capturing mode and capture the visible light image on the writing paper in the visible light capturing mode.

The dot matrix code image is generally used for marking coordinate information on the writing paper, the camera unit 3 collects the dot matrix code image and transmits the dot matrix code image to the control unit 2, the control unit 2 can analyze the dot matrix code image through an algorithm to obtain corresponding coordinate information, further, a series of dot matrix code images are shot according to the writing end 101 when writing on the writing paper, a series of coordinate information can be obtained through calculation, and a track written by the writing end 101 can be obtained through calculation according to the coordinate information, so that writing content is determined. Furthermore, in some embodiments, the control unit 2 may further calculate, from the matrix code image, that the pen body state parameter includes an inclination angle of the pen body 1 when the writing end 101 writes.

In some embodiments, the dot matrix code image may be used to mark other preset information, such as personal identity information, and the personal identity information may be obtained through identification by an algorithm, for example, in some applications, a specific dot matrix code image is printed specifically on a certain area on writing paper, and after the dot matrix code image is collected by the smart pen, the identity information of the student to which the writing paper belongs may be obtained through identification.

Further, specific usage modes of the smart pen in various shooting modes are described in detail below.

According to the application, the control logic of the control unit 2 may be set to implement different working modes according to the needs of different application scenarios, including setting to enable the control unit 2 to control to work independently in a certain shooting mode, for example, the infrared shooting mode or the visible shooting mode, or to control to work alternately in multiple shooting modes, for example, to work alternately in the infrared shooting mode and the visible shooting mode. When the intelligent pen works independently in the infrared shooting mode, the intelligent pen is equivalent to a general intelligent pen and can be applied to various schemes which can be realized by the general intelligent pen.

For setting different working modes, setting can be performed through a mode setting key on the smart pen, for example, a visible light shooting mode key is set on the smart pen, and when receiving a trigger signal sent by the visible light mode key triggered by a user, the control unit 2 switches to the visible light shooting mode, and can also set other keys to switch to other working modes. Of course, the different operation modes may be set not by key triggering but by other modes, which is not limited in the embodiment of the present application.

In one embodiment, the operation mode of the control unit 2 further includes a hybrid mode, in which the control unit 2 controls the image capturing unit 3 and the auxiliary light source 4 to alternately capture the infrared light image data and the visible light image data captured by the image capturing unit 3 in the infrared light capturing mode and the visible light capturing mode.

Specifically, the control unit 2 monitors the state of the smart pen, and when determining that the state of the smart pen is a preset state, for example, a mixed state or a modified state, controls the camera unit 3 and the auxiliary light source 4 to alternately perform shooting in the infrared light shooting mode and the visible light shooting mode, and alternately acquire the infrared light image data and the visible light image data shot by the camera unit 3. Wherein the smart pen status may be determined in particular by monitoring the individual functional units or components of the smart pen, in particular by the control unit 2 in dependence of the monitored signals or the received control instructions.

It should be noted that, when the smart pen shoots each time, the auxiliary light source 4 emits auxiliary light corresponding to the current shooting mode to assist the image capturing unit 3 to capture an image, for example, when shooting is performed in the infrared shooting mode, the auxiliary light source 4 emits infrared light correspondingly, and the image capturing unit 3 captures an infrared light image reflected by the infrared light.

The smart pen according to this embodiment may be applied to a modified scenario, where the smart pen state includes a modified state and a non-modified state, and the control unit 2 may start the hybrid mode by monitoring the smart pen state when the monitoring is the modified state. Specifically, when the monitored signal meets a preset condition or receives a preset control command, the control unit 2 determines that the state of the smart pen is a correction state, so as to control the smart pen to work in the hybrid mode.

In particular, in the correction scenario of one embodiment, the smart pen corrects on the writing paper printed with the coordinate identifier, for example, the dot matrix code image, where in the hybrid mode, the control unit 2 controls the image capturing unit 3 and the auxiliary light source 4 to alternately capture in the infrared light capturing mode and the visible light capturing mode, and the image capturing unit 3 captures coordinate identifier image data, for example, dot matrix code image data, on the writing paper in the infrared light capturing mode and captures visible light image data on the writing paper in the visible light capturing mode.

Of course, the hybrid mode of the smart pen of the present embodiment may be applied to other scenes according to actual situations, and is not limited to be applied to the correction scene.

The embodiment realizes that the intelligent pen can alternately shoot images of different types, so that the acquired images of multiple types can support different requirements and can be determined according to actual application scenes.

Wherein the control unit 2 controls the imaging unit 3 and the auxiliary light source 4 to perform imaging at a high rate, for example, 60 frames per second, 90 frames per second, 120 frames per second, or other frame rate, in general. Wherein different shooting modes can respectively adopt different shooting frequencies, and the control unit 2 can specifically control the shooting modes. That is, the alternate shooting described in the embodiments of the present application does not mean that one shooting mode is shot once and then another shooting mode is switched to take the shots in turn, but means that different shooting modes may take the shots in different periods, or may take the shots at different time points as long as the shots are not taken at the same time, for example, after the infrared light shooting mode is shot several times, the visible light shooting mode is shot once.

Specifically, the shooting frequencies of different shooting modes can be dynamically adjusted according to the situation.

In one embodiment, the control unit 2 calculates the writing speed of the writing end 101 according to the coordinate identifier, and adjusts the working frequency of the visible light shooting mode according to the writing speed;

And/or the control unit 2 controls the working frequency of the infrared light shooting mode, and adjusts the working frequency of the visible light shooting mode according to the working frequency of the infrared light shooting mode.

In this embodiment, the coordinate information is calculated according to the coordinate identifier to obtain the written displacement, and the written displacement, that is, the writing speed, of the writing end 101 in unit time can be calculated according to the time parameter, so that the working frequency of the visible light shooting mode is adjusted according to the magnitude of the written displacement in unit time. The operating frequency refers to the number of shots per unit time, for example, 60 frames per second.

In one embodiment, when the control unit 2 adjusts the operating frequency of the visible light photographing mode according to the writing speed, the greater the writing speed of the writing terminal 101, the greater the operating frequency of the visible light photographing mode is adjusted. Specifically, if the displacement of writing in unit time is too small, the difference between the front and back photographed visible light images is also small, so that the photographing of the visible light images can be reduced, repeated photographing of overlapping images is avoided, image data redundancy is caused, and the transmission capacity and the data storage space are excessively consumed. According to the embodiment, the working frequency of the visible light shooting mode is dynamically adjusted, so that the transmission capacity and the data storage space of the intelligent pen can be saved, and the power consumption can be properly reduced.

In this embodiment, the operating frequency of the visible light shooting mode may be adjusted according to the operating frequency of the infrared light shooting mode. For example, when the smart pen shoots infrared light images in the infrared light shooting mode at a higher speed or a higher working frequency, the acquisition of visible light images in the visible light shooting mode can be properly reduced, so that the influence of insufficient transmission capacity on the transmission of image data, particularly infrared light image data, is avoided.

In one embodiment, when the control unit 2 adjusts the operating frequency of the visible light capturing mode according to the operating frequency of the infrared light capturing mode, if the operating frequency of the infrared light capturing mode exceeds a preset frequency threshold, the operating frequency of the visible light capturing mode is reduced. For example, if the infrared light capturing mode captures images at a frame rate of 120 frames per second, the operating frequency of the visible light capturing mode is reduced to 60 frames per second.

In general, the acquisition of the visible light image does not need an excessively high acquisition density, that is, the visible light shooting mode does not need an excessively high working frequency, while the infrared light shooting mode has a relatively high working frequency to ensure that the coordinate marks on the writing paper are sufficiently captured to satisfy the calculation and determination writing track, and the infrared light shooting mode is higher than the visible light shooting mode in working. Therefore, the acquisition of visible light images by the visible light shooting mode can be reduced according to the situation, so that the normal work of the infrared light shooting mode is ensured. In this embodiment, to ensure normal transmission of data, the operating frequency of the visible light shooting mode may be reduced, so that the infrared light shooting mode is supported to shoot at a higher operating frequency and data can be normally transmitted.

Referring to fig. 6, the method is specifically applied to writing paper with dot matrix code images, after the intelligent pen acquires visible light images in the visible light shooting mode, the dot matrix code images possibly existing in the visible light images can be filtered through a preset algorithm, so that pure images without dot matrix codes are obtained, and only images such as handwriting images or other text patterns on the writing paper are generally reserved in the pure images. The filtering of the dot matrix code in the visible light image can be realized according to a preset pixel gray value threshold, because the pixel gray value of the dot matrix code image on writing paper is generally smaller, the smaller gray value of the dot matrix code image can be realized particularly during manufacturing or printing, and of course, the most preferred scheme is that the dot matrix code image on writing paper is transparent under visible light and cannot be shot into the visible light image; in addition, the method can also search, lock and filter the lattice codes in the image based on a pixel block size searching and rejecting algorithm. Regarding the pixel block size-based search and reject algorithm, please refer to fig. 7, assuming that the size of the shooting area of the camera is 256×256, the pixel block formed by the adjacent pixels in the dot matrix code image will not occupy an area greater than 2×2 in the shooting area of the camera, so that an area with a size of 4×4 may be set as a pixel block threshold, and the dot matrix code pixel block not greater than the pixel block threshold may be rejected.

Further referring to fig. 8, after obtaining the pure images, the obtained plurality of pure images may be further subjected to stitching processing, so as to obtain stitched images, thereby facilitating subsequent processing including text recognition.

In an example, the intelligent pen provided in the embodiment of the present application may independently operate in the visible light shooting mode, so that the intelligent pen may be used as a translation pen to scan and obtain text information, for example, the writing end 101 is used to scan an english book, a plurality of visible light images are shot during scanning, the control unit 2 may splice the visible light images to obtain a complete continuous image of a scanned area, the image includes an english character string, and then text recognition may be performed to extract english content and translate, so as to implement the translation pen function.

Further, for the control unit 2 to monitor the state of the smart pen so as to set the working mode thereof to the mixed mode in a preset state, for example, a mixed state, the embodiment of the application provides various possible ways to set the state of the smart pen to the preset state so as to start the mixed mode of the control unit 2.

The following description will take a preset state as an example of a mixed state, where the mixed state is defined according to an application situation of the smart pen, and is a state that is satisfied with starting the mixed mode, specifically, the control unit 2 determines, according to a monitored signal or a received control instruction, whether the smart pen state is a mixed state, that is, whether the mixed mode can be started. It should be noted that the following method for determining the mixed state is equally applicable to determining the modified state in the modified scene.

In one embodiment, the control unit 2 determines that the state of the smart pen is a mixed state and switches to the mixed mode when detecting a trigger signal generated after the mixed state setting key on the smart pen is triggered.

That is, a dedicated mixed state setting key may be provided on the smart pen, and a user may set the smart pen state to a mixed state and switch to the mixed mode by triggering the mixed state setting key.

In another embodiment, the control unit 2 monitors the writing state of the writing tip 101, and when it is monitored that the writing tip 101 is writing, determines that the smart pen state is a mixed state and switches to the mixed mode.

In this embodiment, the control unit 2 monitors whether the writing end 101 is writing, so as to determine whether the state of the smart pen is a mixed state, if the writing end 101 is writing, the state of the smart pen is a mixed state, so as to switch to the mixed mode, otherwise, the state is not a mixed state, and the state is not switched to the mixed mode. Specifically, when the writing state of the writing end 101 is monitored, the writing end 101 may be monitored by the pressure sensor 7 associated with the writing end 101, and when the writing end 101 performs writing, the pressure sensor 7 generates pressure data so that the control unit 2 monitors the pressure data of the pressure sensor 7, and the control unit 2 determines that the state of the smart pen is a mixed state according to the pressure data.

In yet another embodiment, the control unit 2 starts to monitor the writing state of the writing end 101 when detecting a trigger signal generated after a mixing state setting key on the smart pen is triggered, and determines that the smart pen state is a mixing state and switches to the mixing mode when detecting that the writing end 101 is writing.

In this embodiment, on the premise that the mixing state setting key of the smart pen is triggered, the control unit 2 starts to monitor the writing state of the writing end 101, and when it is monitored that the writing end 101 is writing, it determines that the state of the smart pen is actually the mixing state and switches to the mixing mode, so that it is ensured that after the mixing state setting key is triggered, it is monitored that the smart pen switches to the mixing mode to shoot under the writing condition.

In order to achieve the switching to the hybrid mode by monitoring the writing state of the writing tip 101 as described above, a number of possible solutions are in particular possible.

For example, in one embodiment, the smart pen further comprises a pressure sensor 7, wherein the pressure sensor 7 is disposed in the pen body 1, and the pressure sensor 7 is connected with the control unit 3, detects pressure data of the writing end 101 and transmits the pressure data to the control unit 2; the control unit 2 switches to the hybrid mode when receiving the pressure data, and does not switch to the hybrid mode otherwise.

Specifically, the intelligent pen is internally provided with a pen core 8, the pen point part of the pen core 8 is positioned at a writing end 101 and used for writing, the pen core rod is positioned in the pen body 1 and is abutted against the pressure sensor 7, so that the pen point of the pen core 8 contacts writing paper when the writing end 101 writes, the pen core rod generates acting force on the pressure sensor 7 to generate pressure data, and the control unit 2 judges that the state of the intelligent pen is in a mixed state when detecting the pressure data of the pressure sensor 7, thereby controlling to switch to the batch mixing mode, or else not switching to the mixing mode.

Further, in order to more accurately judge whether the intelligent pen state is in the mixed state, misjudgment is avoided, and a pressure threshold value can be set as a judging condition. In one embodiment, the control unit 2 receives and determines whether the pressure data exceeds a preset pressure threshold, if yes, it switches to the hybrid mode, otherwise it does not switch to the hybrid mode.

In this embodiment, the control unit 2 detects the pressure data of the pressure sensor 7 and determines whether the pressure data exceeds a preset pressure threshold value, so as to determine whether the smart pen state is in a mixed state, thereby controlling whether to switch to the mixed mode. The preset pressure threshold value may be set according to circumstances, for example, may be set to 0, and then the smart pen state is judged to be a mixed state as long as the pressure sensor 7 generates pressure data, and then the mode is switched to the mixed mode; the preset pressure threshold value can be set according to pressure data during normal writing as a standard, so that whether the intelligent pen state is a mixed state can be accurately judged.

In addition, when the control unit 2 monitors the writing state of the writing end 101, a laser ranging technology or a sonar ranging technology may be adopted, and accordingly, a laser ranging device or a sonar ranging device may be disposed on the writing end 101 and connected to the control unit 2, where the laser ranging device or the sonar ranging device ranges along a writing area pointed by the writing end 101, and the control unit 2 may determine whether the writing end 101 is writing according to whether the measured distance is less than a preset distance threshold, for example, in a normal case, when the writing end 101 is writing on writing paper, the measured distance is less than the preset distance threshold, and then it is determined that the writing end 101 is writing.

Further, in order to more accurately determine whether the writing end 101 is writing, it may be further configured to detect an inclination angle of the pen body 1 of the smart pen, and determine that the writing end 101 is writing only if the inclination angle of the pen body 1 of the smart pen also satisfies a preset condition.

Normally, when a user writes with the smart pen, the pen body 1 of the smart pen should have a certain inclination angle. Referring to fig. 9, when the pen is normally held for writing, an included angle of about 30 ° is formed between the pen body 1 of the smart pen and the normal line of the writing paper plane. In this regard, the tilt angle of the body 1 of the smart pen may be detected by a correlation detection means such as a gyroscope, so that a judgment is made as to whether a preset tilt angle range, for example, 25 ° to 35 °, is satisfied. Alternatively, the tilt angle of the pen body 1 of the smart pen may be determined based on other methods, for example, by calculating based on a captured dot matrix code image to determine the tilt angle of the pen body 1 of the smart pen.

On the basis of realizing the application, the intelligent pen can also independently work in a certain shooting mode, so that the intelligent pen is applied to other scenes.

the control unit 2 judges that the image data shot by the shooting unit 3 comprises a preset mark;

the control unit 2 receives a control instruction for switching to the visible light shooting mode;

the control unit 2 detects that the intelligent pen is connected with a server or a mobile terminal through WIFI;

In this embodiment, when any one of the above conditions is triggered, the control unit 2 starts or switches to perform shooting in the visible light shooting mode, and at this time, the smart pen may be used as a general scanning pen to scan and acquire a visible light image on writing paper, so that the content on the writing paper may be obtained through an image recognition algorithm, for example, OCR text recognition, and further, the scanned visible light image or the writing content obtained through recognition processing may be sent to the server or the client APP of the user.

Specifically, the determining that the image data shot by the image capturing unit 3 includes a preset identifier may be that a preset dot matrix code image is specially printed on writing paper, and when the control unit 2 receives the dot matrix code image data, it determines that the dot matrix code image data meets a preset condition, so as to control to switch to the visible light shooting mode to work and obtain the visible light image data shot by the image capturing unit 3; alternatively, the smart pen may be used to write a specific identifier, for example, to write a word "switch" or to write a preset special symbol, so that the identifier is captured by the image capturing unit 3, and the control unit 2 switches to the visible light capturing mode when recognizing that the identifier is included in the image data. In this embodiment, the user may use the smart pen to capture a preset identifier, for example, a dot matrix code image, so that the control unit 2 switches to the visible light capturing mode to capture a photograph.

The control unit 2 receives the control instruction for switching to the visible light photographing mode, and there are various possible ways to enable the control unit 2 to receive the control instruction, for example, the following ways may be adopted:

The writing end 101 of the intelligent pen performs double-click operation;

a visible light shooting mode key on the intelligent pen is triggered;

receiving a preset control instruction of the APP;

and detecting a trigger signal generated after the pen body 1 of the intelligent pen is sleeved with the special pen cap.

The double-click operation performed by the writing end 101 means that the writing end 101 continuously clicks twice within a preset time, specifically, the double-click operation of the writing end 101 may be monitored by the pressure sensor 7 or by the ranging technology, and in this embodiment, after the user uses the smart pen to continuously click twice on the writing paper, the working mode of the control unit 2 may be switched to the visible light shooting mode.

The visible light shooting mode key is arranged on the intelligent pen body 1 and is specially used for controlling the control unit 2 to switch to the visible light shooting mode, and a user can directly trigger the key to set the working mode of the control unit 2 as the visible light shooting mode.

Or, the user may control the smart pen through the client APP, and send a preset control instruction through the client APP, so that the control unit 2 works in the visible light shooting mode.

Or, the user may also set the visible light shooting mode by sleeving a special pen cap on the pen body 1 of the intelligent pen, and specifically, an induction element may be disposed on the special pen cap to trigger the pen body 1 of the intelligent pen to generate a trigger signal, and the control unit 2 detects the trigger signal and switches to the visible light shooting mode.

In addition, when the smart pen is in the WIFI connection state or the smart pen performs high-speed communication with the server or the mobile terminal, the control unit 2 may switch to the visible light shooting mode. The high-speed communication means that the communication transmission rate reaches or exceeds a preset transmission rate threshold, for example, reaches or exceeds 1Mbps. Because the communication rate of WIFI communication or other high-speed communication can meet the requirement of image transmission of the smart pen, the visible light image is generally collected and transmitted by using the visible light shooting mode in the WIFI connection state or other high-speed communication state.

Referring to fig. 10, the embodiment of the application further discloses a writing information acquisition system, including:

the intelligent pen according to any one of the above embodiments, the pen body 1 of the intelligent pen is further provided with a communication unit 5 connected with the control unit 2, the intelligent pen is connected with an information receiving end in a communication manner through the communication unit 5, and the control unit 2 obtains writing information according to image data shot by the shooting unit 3 and sends the writing information to the information receiving end;

The writing information acquisition system provided by the embodiment of the application is used for acquiring writing information and sending the writing information to the information receiving end, wherein the information receiving end can be a server, such as a cloud server, or a client, such as a smart phone, a tablet or intelligent teaching equipment; the writing information collected by the intelligent pen of the embodiment may include writing information written by the user through the intelligent pen, and the other content information collected by the user through the intelligent pen includes text content information printed on the writing paper obtained through scanning and other writing information existing on the writing paper obtained through scanning. After the information receiving end receives the writing information, the writing information can be further applied according to the requirement, for example, the writing information is identified, so that handwriting content written by the intelligent pen per se is obtained through identification, handwriting content, other text images and the like existing on writing paper are obtained through identification, and for example, handwriting analysis can be performed on the writing information, so that handwriting characteristic data can be obtained for research or further application.

In one embodiment, the image capturing unit captures visible light image data of the writing paper; the control unit performs splicing processing on a plurality of visible light image data shot by the shooting unit to obtain spliced image data, and sends the spliced image data to the information receiving end; the information receiving end receives and identifies the spliced image data to obtain content information in the spliced image data;

and/or the camera shooting unit shoots infrared light image data of the writing paper, wherein the writing paper is provided with a coordinate mark for marking coordinate information of the writing paper, and the infrared light image data comprises the coordinate mark on the writing paper; the control unit identifies the coordinate identifier, acquires coordinate information of the writing paper corresponding to the writing area, acquires intelligent pen writing information according to the coordinate information of a plurality of writing papers, and sends the intelligent pen writing information to the information receiving end; and the information receiving end receives the writing information of the intelligent pen.

In this embodiment, the user may use the smart pen to collect visible light image data of writing paper, where the visible light image data of writing paper may include text information printed on the writing paper and written handwriting information, and in addition, the smart pen may also collect infrared light image data, where the infrared light image data includes a coordinate identifier of a writing area, so as to identify the coordinate identifier to determine coordinate information of the writing paper corresponding to the writing area, and further calculate a motion track written by the writing end 101 of the smart pen according to a series of coordinate information, so as to obtain handwriting information written by the smart pen. Specifically, the user may operate the control unit 2 of the smart pen to control the image capturing unit 3 to capture the visible light image data in a visible light capturing mode, and may operate the image capturing unit 3 to capture the infrared light image data in an infrared light capturing mode, or may operate the control unit 2 to control the image capturing unit 3 to alternately capture the visible light image data and the infrared light image data in the hybrid mode, where the description of the smart pen may be performed with reference to the above embodiments.

In one embodiment, the visible light image data of the writing paper photographed by the photographing unit includes a dot matrix code image on the writing paper;

before the control unit performs splicing processing on the plurality of visible light image data shot by the shooting unit, filtering processing is performed on dot matrix code images in the visible light image data based on a pixel gray threshold filtering method and/or a pixel block size searching and rejecting method.

In this embodiment, the dot matrix code image in the visible light image may be filtered by using a pixel gray threshold filtering method, or may be searched, locked and removed by using a pixel block size searching and removing method, so that only other image contents of the visible light image are retained, and a pure image excluding the dot matrix code image is obtained. Of course, two methods can be combined simultaneously to filter the dot matrix code image, so that the filtering effect is ensured.

In one embodiment, after the information receiving end obtains the content information in the spliced image data, matching the content information with handwriting feature data of a plurality of prestored writers, determining the writer corresponding to the content information, and binding the corresponding writer with the content information;

And/or after the information receiving end receives the writing information of the intelligent pen, matching the writing information of the intelligent pen with the handwriting characteristic data of a plurality of prestored writers, determining the writer corresponding to the writing information of the intelligent pen, and binding the corresponding writer with the writing information of the intelligent pen.

In this embodiment, the information receiving end determines the writer corresponding to the content information by matching the content information with the handwriting feature data of a plurality of prestored writers, so as to implement binding of the content information and the writers corresponding to the content information. Similarly, the intelligent pen writing information and the corresponding writer are bound.

In an application scenario, a user can collect writing content information through the intelligent pen, for example, the writing content in a book page is scanned and collected in a visible light shooting mode, meanwhile, the user can write by using the intelligent pen, so that writing information sent to the information receiving end comprises writing handwriting information of the user, the information receiving end can obtain identity information of the user according to matching identification of the writing handwriting information of the user, and the identity information of the user is associated with the writing information collected by the user and is bound and stored. Of course, the user can collect the handwriting content written by the user in the infrared shooting mode and upload the handwriting content to the information receiving end for storage, and the information receiving end obtains the identity information of the user according to the handwriting content written by the user in a matching mode and binds the identity information.

The handwriting characteristic data of the writer in the embodiment is obtained by collecting handwriting image data of the writer and performing characteristic clustering calculation, deep learning model training or neural network model training.

In one embodiment, the information receiving end obtains handwriting feature data of the plurality of writers by the following method:

acquiring handwriting information written by a writer on writing paper provided with a coordinate mark by using an intelligent pen;

dividing the handwriting information of the writer to obtain a plurality of single characters, dividing the plurality of single characters to obtain a plurality of local units, calculating the characteristics of each local unit, and clustering to obtain a plurality of local characteristics of the handwriting information of the writer;

and storing the local features as handwriting feature data of the writer.

In this embodiment, the smart pen used for acquiring handwriting feature data of a plurality of writers may be the smart pen provided in the embodiment of the present application, or may be a general smart pen. Specifically, in a specific application scenario, a writer can write on writing paper provided with coordinate identifiers such as dot matrix codes by using respective intelligent pens in advance, the intelligent pens collect writing handwriting information of each writer and send the writing handwriting information to the information receiving end, so that the information receiving end determines writing handwriting images written by the writer according to the writing handwriting information, and handwriting characteristic data of each writer are obtained through characteristic clustering calculation, deep learning model training or neural network model training.

In a specific embodiment, when the information receiving end matches the content information with the handwriting feature data of a plurality of prestored writers, firstly, dividing the content information to obtain a plurality of single characters, then dividing the plurality of single characters to obtain a plurality of local units respectively, and calculating the features of each local unit to obtain a plurality of local features of the content information; matching the local features of the content information with handwriting feature data of a plurality of prestored writers, wherein the writer with the highest matching degree with the local features of the content information is the writer corresponding to the content information;

and/or when the information receiving end matches the intelligent pen writing information with the pre-stored handwriting feature data of a plurality of writers, firstly dividing the intelligent pen writing information to obtain a plurality of single characters, then dividing the plurality of single characters to obtain a plurality of local units respectively, and calculating the features of each local unit to obtain a plurality of local features of the intelligent pen writing information; matching the local features of the writing information of the intelligent pen with the handwriting feature data of a plurality of prestored writers, wherein the writer with the highest matching degree of the local features of the writing information of the intelligent pen is the writer corresponding to the writing information of the intelligent pen.

Referring to fig. 11, the embodiment of the application further discloses a correction processing system, including:

the intelligent pen according to any one of the above embodiments, wherein the pen body 1 of the intelligent pen is further provided with a communication unit 5 connected with the control unit 2, the intelligent pen is in communication connection with a server through the communication unit 5, the image data shot by the camera unit 3 includes dot matrix code image data on answering paper printed with dot matrix code images and visible light image data of the answering paper, the control unit 2 obtains correction handwriting information according to the dot matrix code image data, obtains answering handwriting information on the answering paper according to the visible light image data, and sends the correction handwriting information and the answering handwriting information to the server;

The correcting handwriting information may be the original dot-matrix code image data collected when the intelligent pen corrects the answer sheet, or may be the data of the original dot-matrix code image data processed by the control unit 2 of the intelligent pen. Specifically, for the former, the intelligent pen directly sends the acquired dot matrix code image data to a server, so that the server can calculate modified content information and modified topic information corresponding to a modified region according to the dot matrix code image data; in the latter case, the smart pen may collect the dot matrix code image data, then perform partial processing by using the control unit 2, and then send the processed data to the server.

The answering handwriting information refers to handwriting image information of an answer by an answer person on the answering paper. The answer handwriting information acquired by the server can be an original answer handwriting image acquired by shooting by the intelligent pen, or can be data of the original answer handwriting image after being processed on the intelligent pen. The answer handwriting information is used for identifying an answer, specifically, for example, by calculating characteristics of an answer handwriting image and matching with handwriting characteristic data of a plurality of prestored answer, and the answer corresponding to the answer handwriting information can be determined.

The correction processing system is specially used for correcting a scene of a question, dot matrix code images are uniformly printed on answer sheets of a person answering the question, specifically, the dot matrix codes can be printed in a local area or all areas of the answer sheets based on the distribution condition of the questions on the answer sheets when the answer sheets are manufactured, and coordinate information of the dot matrix codes printed in each area of the answer sheets is bound with corresponding question information in a server. For example, the area range of the question 1 on the answer sheet is (1, 1) (1, 5) (5, 1), after the dot matrix codes are printed in the area, the coordinate information of the dot matrix codes is bound with the question 1, so that the acquired area can be determined to be the question 1 when the acquired coordinate information of the dot matrix codes is positioned in the area range.

In the scene of the embodiment, when the correction person uses the intelligent pen to correct the answer paper of the answer person, the intelligent pen not only collects the dot matrix code image data to obtain correction handwriting information corrected by the correction person, but also collects the visible light image of the answer paper, wherein the visible light image contains the answer handwriting answered by the answer person, so that the answer handwriting information is obtained; and the intelligent pen sends the correction handwriting information and the answer handwriting information to the server.

The server receives the correction handwriting information and the answer handwriting information, extracts coordinate information according to the correction handwriting information, determines topics corresponding to the corrected areas according to the coordinate information, obtains corrected content information such as corrected scores according to the coordinate information, and determines correction results of the corresponding topics according to the content information and preset scoring rules. In addition, the server also matches the answer handwriting information with the handwriting feature data of a plurality of prestored answer persons, and determines that the prestored handwriting feature data is most matched with the answer handwriting information, for example, the answer person with the highest similarity is the answer person corresponding to the answer handwriting information. And finally, the server binds the corresponding answer and the modification result of the corresponding question.

In one embodiment, the scoring rule preset in the server side includes an adding mode and a subtracting mode;

the step of determining the correction result of the corresponding title according to the content information and the preset scoring rule comprises the following steps:

in the scoring mode, identifying the content information to determine a score of the correction, wherein the score is a score of a topic corresponding to the correction handwriting information; and in the score reduction mode, identifying the content information to determine a score for correction, and subtracting the score from the total score of the questions corresponding to the correction handwriting information to obtain a result which is the score of the questions corresponding to the correction handwriting information.

The scoring rule can be set through keys on the intelligent pen, for example, a score adding mode key and a score subtracting mode key are arranged on the intelligent pen, and the intelligent pen can send corresponding instructions to the server by triggering different keys, so that the server starts the corresponding scoring rule.

The scoring rule may also be set by writing a preset mark on the answer sheet by the smart pen, and in one embodiment, the determining, according to the content information and the preset scoring rule, the correction result of the corresponding question includes:

when a scoring mode setting mark in the content information is recognized, the scoring rule adopts a scoring mode or a subtracting mode corresponding to the scoring mode setting mark.

In this embodiment, the correction person uses the smart pen to write a preset scoring mode setting mark such as a hook, a fork, a circle or other marks on the answer sheet, and sets different scoring rules through different marks, for example, the hook corresponds to a scoring mode, and the fork corresponds to a subtracting mode. And when the server identifies that the content information comprises the preset scoring mode setting mark according to the acquired correction handwriting information, responding to the scoring mode setting mark and starting a corresponding scoring rule.

In one embodiment, the server further performs the following steps:

under the scoring mode, accumulating the corrected score to obtain a final answer score, and binding the answer score with the corresponding answer person;

and in the score reduction mode, subtracting the corrected score from the answer total score to obtain a final answer score, and binding the answer score with the corresponding answer person.

In this embodiment, in the score adding mode, the correction person only needs to correct the score of the questions with correct scores, and finally calculates the total score, and the score of each corrected question is accumulated to obtain the final score, while the questions without correction are questions without scores, and correction and statistics are not needed. In the subtracting mode, the correcting person only needs to correct the deduction score of the wrong questions needing deduction, and finally calculates the total time, and the accumulated deduction score of each corrected question is subtracted from the total score to obtain the final score.

The answer sheet and the scoring condition of each question and the final calculated total score can be further bound, and the server can further collect and analyze the correction results of each answer sheet after correction is completed.

In an embodiment, the correction processing system may further include a client, and the server further synchronously sends data such as the answer and the correction result to the client, so that the correction person can conveniently check and learn. The client can be a mobile device such as a smart phone or a tablet of a user, or can be special computer teaching equipment.

The handwriting characteristic data of the answering machine in the embodiment is handwriting characteristic data of the answering machine, which is obtained by collecting handwriting images of the answering machine and performing characteristic clustering calculation, deep learning model training or neural network model training.

In one embodiment, the server obtains handwriting feature data of the plurality of answer persons by the following method:

obtaining writing information when an answer person uses an intelligent pen to answer on answer paper printed with dot matrix code images; dividing the writing handwriting information of the answer to obtain a plurality of single characters, dividing the plurality of single characters to obtain a plurality of local units, calculating the characteristics of each local unit and clustering to obtain a plurality of local characteristics of the writing handwriting information of the answer; and storing the local features as handwriting feature data of the answering person.

In this embodiment, the smart pen used for obtaining handwriting feature data of a plurality of answer persons may be the smart pen provided in the embodiment of the present application, or may be a general smart pen. Specifically, in an application scenario, all answering machines can write on answering paper printed with dot matrix codes by using respective intelligent pens, the intelligent pens collect writing handwriting information of each answering machine and send the writing handwriting information to the server, so that the server determines writing handwriting images written by the answering machines according to the writing handwriting information, and handwriting characteristic data of each answering machine are obtained through characteristic clustering calculation, deep learning model training or neural network model training.

According to the embodiment, the corresponding answer person is determined by matching the characteristic of answer handwriting information acquired by the intelligent pen with handwriting characteristic data of a plurality of prestored answer persons. In one embodiment, the matching the answer handwriting information with pre-stored handwriting feature data includes:

dividing the answer handwriting information to obtain a plurality of single characters, dividing the plurality of single characters to obtain a plurality of local units, and calculating the characteristics of each local unit to obtain a plurality of local characteristics of the answer handwriting information;

Matching the partial characteristics of the answering handwriting information with the handwriting characteristic data of a plurality of prestored answering persons, wherein the answering person with the highest matching degree with the partial characteristics of the answering handwriting information is the answering person corresponding to the answering handwriting information.

In summary, the smart pen provided in the embodiment of the present application has at least two shooting modes, including an infrared shooting mode and a visible light shooting mode, and the control unit is provided with at least two working modes including an infrared shooting mode and a visible light shooting mode; in the working mode, the control unit controls the auxiliary light source to emit infrared light, and the image pickup unit shoots an infrared light image of the writing area; and under the working mode of the visible light shooting mode, the control unit controls the auxiliary light source to emit white light, and the image pickup unit shoots the visible light image of the writing area. The intelligent pen can be applied to writing paper provided with coordinate marks such as dot matrix codes, wherein the coordinate marks can be shot by infrared light, an infrared light image containing the coordinate marks can be shot when the intelligent pen is used for writing on the writing paper, a visible light image of the writing paper can be shot, and the visible light image can comprise answer handwriting information and the like on the writing paper. Through the intelligent pen disclosed by the embodiment of the application, the infrared light image and the general visible light image which contain the coordinate mark on the writing paper can be collected together, so that the writing handwriting information of the intelligent pen can be determined according to the coordinate mark and other handwriting information such as answering handwriting information on the writing paper can be identified according to the visible light image on the writing paper. For example, when the intelligent pen is specifically applied to an correction processing system, the intelligent pen provided by the embodiment of the application realizes that when a correction person uses the intelligent pen to correct on the answer sheet printed with the dot matrix code image, the intelligent pen can collect correction handwriting information of correction and answer handwriting information of an answer person on the answer sheet; therefore, the server can determine the correction result of the corresponding question according to the correction handwriting information and the answer handwriting information, and determine the answer corresponding to the answer handwriting information, and bind the corresponding answer and the correction result of the corresponding question, so that more efficient correction is realized, and the workload of the correction is greatly reduced.

The above examples merely represent a few embodiments of the present application, which are described in more detail and are not to be construed as limiting the scope of the invention. It should be noted that modifications and improvements can be made by those skilled in the art without departing from the spirit of the present application, and the present application is intended to encompass such modifications and improvements.

Claims

1. The intelligent pen is characterized by comprising a pen body, a control unit and a shooting unit, wherein one end of the pen body is a writing end, the control unit is arranged in the pen body, the shooting unit is arranged in the writing end, and the shooting unit is connected with the control unit; the intelligent pen further comprises an auxiliary light source, wherein the auxiliary light source is arranged in the writing end and is connected with the control unit;

2. The intelligent pen according to claim 1, wherein when writing paper exists in a writing area pointed by the writing end, the infrared light dot matrix code image data shot by the shooting unit in the infrared light shooting mode comprises a coordinate mark of the writing paper, and the control unit recognizes the coordinate mark and acquires coordinate information of the writing paper corresponding to the writing area; the coordinate mark is used for marking coordinate information of the writing paper.

3. The smart pen according to claim 2, wherein the control unit calculates a writing speed of the writing tip according to the coordinate mark, and adjusts an operating frequency of the visible light photographing mode according to the writing speed;

4. The smart pen according to claim 3, wherein when the control unit adjusts the operating frequency of the visible light photographing mode according to the writing speed, the greater the writing speed of the writing tip, the greater the operating frequency of the visible light photographing mode is adjusted by the control unit;

5. The smart pen of claim 1, further comprising a pressure sensor disposed within the pen body, the pressure sensor being connected to the control unit, detecting pressure data at the writing end and transmitting to the control unit;

6. The smart pen according to any one of claims 1 to 5, wherein the camera unit comprises an infrared light macro camera module and a white light macro camera module, wherein the infrared light macro camera module is configured to capture an infrared light dot matrix code image in the infrared light capturing mode; the white light micro-camera module is used for shooting visible light images in the visible light shooting mode;

7. The intelligent pen according to any one of claims 1 to 5, wherein the auxiliary light source comprises an infrared LED and a white LED, the infrared LED and the white LED are respectively arranged at two sides of the camera unit, and the infrared LED and the white LED are equidistant from a pen core part of the writing end.

8. The smart pen according to any one of claims 1 to 5, wherein the control unit switches to the visible light photographing mode when any one of the following conditions is triggered:

9. A writing information acquisition system, comprising:

the intelligent pen according to any one of claims 1 to 8, wherein a pen body of the intelligent pen is further provided with a communication unit connected with the control unit, the intelligent pen is in communication connection with an information receiving end through the communication unit, and the control unit obtains writing information according to image data shot by the shooting unit and sends the writing information to the information receiving end;

10. The writing information collecting system according to claim 9, wherein the image capturing unit captures visible light image data of the writing paper; the control unit performs splicing processing on a plurality of visible light image data shot by the shooting unit to obtain spliced image data, and sends the spliced image data to the information receiving end; the information receiving end receives and identifies the spliced image data to obtain content information in the spliced image data;

And/or the camera shooting unit shoots infrared dot matrix code image data of the writing paper, wherein the writing paper is provided with a coordinate mark for marking coordinate information of the writing paper, and the infrared dot matrix code image data comprises the coordinate mark on the writing paper; the control unit identifies the coordinate identifier, acquires coordinate information of the writing paper corresponding to the writing area, acquires intelligent pen writing information according to the coordinate information of a plurality of writing papers, and sends the intelligent pen writing information to the information receiving end; and the information receiving end receives the writing information of the intelligent pen.

11. The writing information acquisition system according to claim 10, wherein after the information receiving end obtains the content information in the spliced image data, the content information is matched with handwriting feature data of a plurality of prestored writers, writers corresponding to the content information are determined, and the corresponding writers are bound with the content information;

12. The writing information collecting system according to claim 11, wherein when the information receiving end matches the content information with a plurality of prestored handwriting feature data of writers, firstly dividing the content information to obtain a plurality of single characters, then dividing the plurality of single characters to obtain a plurality of local units respectively, and calculating the features of each local unit to obtain a plurality of local features of the content information; matching the local features of the content information with handwriting feature data of a plurality of prestored writers, wherein the writer with the highest matching degree with the local features of the content information is the writer corresponding to the content information;

13. The writing information collecting system according to claim 11, wherein the information receiving end obtains handwriting characteristic data of the plurality of writers by:

and storing the local features as handwriting feature data of the writer.

14. An abatement processing system, comprising:

the intelligent pen according to any one of claims 1 to 8, wherein a pen body of the intelligent pen is further provided with a communication unit connected with the control unit, the intelligent pen is in communication connection with a server through the communication unit, image data shot by the camera unit comprises dot matrix code image data on answering paper printed with dot matrix code images and visible light image data of the answering paper, the control unit obtains correction handwriting information according to the dot matrix code image data, obtains answering handwriting information on the answering paper according to the visible light image data, and sends the correction handwriting information and the answering handwriting information to the server;