WO2024007819A1

WO2024007819A1 - Method and apparatus for acquiring writing on blackboard, and device, system and storage medium

Info

Publication number: WO2024007819A1
Application number: PCT/CN2023/099469
Authority: WO
Inventors: 张青洪; 覃东珍; 母燕雄
Original assignee: 广州视源电子科技股份有限公司; 广州视睿电子科技有限公司
Priority date: 2022-07-04
Filing date: 2023-06-09
Publication date: 2024-01-11
Also published as: CN117392681A

Abstract

Provided in the embodiments of the present application are a method and apparatus for acquiring writing on a blackboard, and a device, a system and a storage medium. The method comprises: acquiring a first image collected by a photographic device in real time, wherein the photographic device is used for photographing a blackboard; identifying handwriting content and/or non-handwriting content from the first image, wherein the handwriting content and the non-handwriting content are both located in a blackboard area; adjusting display effects of the handwriting content and/or the non-handwriting content, so as to obtain a second image, wherein the second image is taken as currently acquired written content on the blackboard, the display effect of the handwriting content in the second image is correspondingly enhanced, and the display effect of the non-handwriting content in the second image is correspondingly weakened; and sending the second image to a display device, such that the display device displays the second image and/or stores the second image. By using the method, the technical problem in the relevant art of the accuracy of written content acquired by means of infrared touch detection on a blackboard being low can be solved.

Description

Blackboard writing method, device, equipment, system and storage medium

This application requires the priority of the Chinese patent application submitted to the China Patent Office on July 4, 2022, with the application number 202210787911.8 and the invention name "Blackboard Writing Obtaining Method, Device, Equipment, System and Storage Medium". All its contents have been approved. This reference is incorporated into this application.

Technical field

Embodiments of the present application relate to the field of image processing technology, and in particular, to a method, device, equipment, system and storage medium for obtaining blackboard writing.

Background technique

The blackboard is a commonly used teaching aid. During the teaching process, teachers write, draw, and other operations on the blackboard to form blackboard content to assist teaching. When the blackboard content is no longer needed, the blackboard content can be erased through a blackboard eraser. .

With the improvement of teaching level, there is an increasing need to preserve the blackboard writing content formed during the teaching process. In related technology, in order to save the content written on the blackboard, an infrared touch frame is installed around the blackboard. The writing operation on the blackboard is detected through infrared touch detection and the writing coordinates corresponding to the writing operation are obtained. The writing track is obtained through the writing coordinates and then saved. Write tracks to save the content written on the blackboard. However, when there are adsorbed objects on the blackboard (such as erasers or teaching aids, etc.), because the objects block part of the infrared light, when the teacher writes in the area around the object, the infrared touch box will not be able to accurately detect the writing operation. As a result, the correct blackboard writing content cannot be saved.

Contents of the invention

Embodiments of the present application provide a method, device, equipment, system and storage medium for obtaining blackboard writing, so as to solve the technical problem of low accuracy of blackboard writing content obtained through infrared touch detection in related technologies.

In a first aspect, in an embodiment of the present application, a method for obtaining blackboard writing is provided, which method includes:

Obtaining a first image collected in real time by a camera device used to photograph the blackboard;

Identify handwriting content and/or non-handwriting content in the first image, where both the handwriting content and the non-handwriting content are located in the blackboard area;

Adjust the display effect of the handwriting content and/or the non-handwriting content to obtain a second image. The second image is used as the currently acquired blackboard writing content. The display effect of the handwriting content is correspondingly enhanced, and the display effect of the non-handwriting content is correspondingly enhanced. The display effect is correspondingly weakened;

The second image is sent to a display device so that the display device displays the second image and/or stores the second image.

In a second aspect, in one embodiment of the present application, a device for obtaining blackboard writing is also provided, which device includes:

An image acquisition unit, used to acquire the first image collected in real time by the camera device, which is used to photograph the blackboard;

A content recognition unit configured to identify handwriting content and/or non-handwriting content in the first image, where both the handwriting content and the non-handwriting content are located in the blackboard area;

The effect adjustment unit is used to adjust the display effect of the handwriting content and/or the non-handwriting content to obtain a second image. The second image is used as the currently acquired blackboard writing content, and the display effect of the handwriting content is correspondingly enhanced, The display effect of the non-handwriting content is correspondingly weakened;

An image sending unit, configured to send the second image to a display device, so that the display device displays the second image and/or stores the second image.

In a third aspect, in one embodiment of the present application, a blackboard acquisition device is also provided, including: one or more processors,

When the one or more processors execute one or more programs, the blackboard writing acquisition method as described in the first aspect is implemented.

In the fourth aspect, in an embodiment of the present application, a blackboard writing acquisition system is also provided, including: a blackboard writing acquisition device, a camera device, and a display device,

The camera equipment is used to photograph the blackboard to obtain a real-time first image;

The blackboard acquisition device is used to acquire the first image; identify the handwriting content and/or non-handwriting content in the first image, and the handwriting content and the non-handwriting content are located in the blackboard area; adjust the The display effect of the handwriting content and/or the non-handwriting content is obtained to obtain a second image. The second image is used as the currently obtained blackboard writing content. The display effect of the handwriting content is correspondingly enhanced. The display effect of the non-handwriting content is obtained. Corresponding weakening; sending the second image to the display device;

The display device is used to display the second image and/or store the second image.

In a fifth aspect, an embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the blackboard writing acquisition method as described in the first aspect is implemented.

In one embodiment of the present application, a first image obtained by photographing a blackboard with a camera device is obtained, and the handwriting content and/or non-handwriting content located in the blackboard area in the first image is identified, and then the handwriting content and/or non-handwriting content is adjusted. The display effect of the handwriting content, in which the display effect of the handwriting content is enhanced and the display effect of the non-handwriting content is weakened to obtain the second image. The second image is used as the currently obtained blackboard writing content. After that, the second image is sent to the display The device is a technical means to enable the display device to display the second image and/or store the second image, which solves the technical problem of low accuracy of blackboard writing content obtained through infrared touch detection in related technologies, and uses the method of photographing images to replace Infrared touch detection can accurately obtain the content on the blackboard. Even if there are objects such as erasers and teaching aids adsorbed on the blackboard, the camera equipment can clearly capture the area around the erasers and teaching aids without obstruction, and the captured images can It includes the color of the chalk when writing and the strokes of the writing strokes, etc., and there will be no disconnection, ensuring the restoration of the content on the blackboard, and the handwriting content and/or non-handwriting content on the blackboard can be identified through the captured images , and adjust the corresponding display effect to make the handwriting content more prominent, thereby making the blackboard writing content in the second image more prominent, and after sending the second image to the display device, real-time display and real-time saving of the blackboard writing content can be realized, etc. , to facilitate subsequent use.

Description of the drawings

Figure 1 is a flow chart of a method for obtaining blackboard writing provided by an embodiment of the present application;

Figure 2 is a flow chart of a method for obtaining blackboard writing provided by an embodiment of the present application;

Figure 3 is a schematic diagram of a new type of blackboard provided by an embodiment of the present application;

Figure 4 is a data flow block diagram of a blackboard acquisition system provided by an embodiment of the present application;

Figure 5 is a schematic diagram of handwriting content provided by an embodiment of the present application;

Figure 6 is a schematic diagram of a second image provided by an embodiment of the present application;

Figure 7 is a schematic structural diagram of a blackboard writing acquisition device provided by an embodiment of the present application;

Figure 8 is a schematic structural diagram of a blackboard writing acquisition system provided by an embodiment of the present application.

Detailed ways

The present application will be further described in detail below in conjunction with the accompanying drawings and examples. It can be understood that the specific embodiments described here are used to explain the present application, but not to limit the present application. In addition, it should be noted that, for convenience of description, only some but not all structures related to the present application are shown in the drawings.

In the related technology, an infrared touch frame is installed around the blackboard, and blackboard writing is recorded through the infrared touch frame. Among them, the infrared touch frame is the main equipment for realizing infrared touch. The infrared touch frame is set around the blackboard or on the opposite sides, and is equipped with an infrared transmitting device (such as an infrared transmitting lamp) and an infrared receiving device (such as an infrared receiving lamp). The infrared transmitting device emits infrared light according to a certain frequency and is received by the corresponding infrared receiving device. At this time, all the infrared rays between the infrared transmitting device and the infrared receiving device form a light network covering the blackboard, and each infrared ray is Corresponds to an infrared transmitter and an infrared receiver. When teachers use chalk to write on the blackboard, the chalk will block the infrared light it touches. At this time, based on the blocking of infrared light, the writing operation can be detected and positioned to obtain the coordinates of the writing, and then based on the writing The coordinates are used to record and save the contents of the blackboard writing. After that, other devices can restore the contents of the blackboard writing by obtaining the written coordinates. It can be understood that each process of transmitting and receiving infrared light can be considered as a scanning process. After scanning at a certain frequency, the detection and positioning of the writing operation can be achieved.

However, when the infrared touch frame detects writing operations, due to the hardware limitations of the infrared touch frame, the detection may be inaccurate. For example, in some cases, when items such as teaching aids or erasers are adsorbed on the blackboard, due to the contact area between the items and the blackboard ( It can be determined by the blocked infrared light) is larger than the contact area between the chalk and the blackboard. Therefore, the adsorbed items and the chalk can be distinguished by the contact area. However, since the object blocks some infrared light, the amount of infrared light passing through the area around the object will be reduced. In this way, when the teacher writes in the area around the object (such as when drawing the border of the object), inaccurate detection will occur. . In addition, when the teacher writes text, a pen edge appears. However, the writing coordinates detected by the infrared touch frame cannot detect the pen edge. That is, when the blackboard writing content is restored based on the writing coordinates detected by the infrared touch frame, the pen edge in the blackboard writing content cannot be restored. Moreover, when teachers use different colors of chalk to write, the infrared touch frame cannot detect the color of the chalk, so when restoring the content written on the blackboard, the color of the chalk cannot be restored. Moreover, during the infrared touch frame detection process, data may be lost, so when restoring the blackboard writing content, the blackboard writing content cannot be accurately restored and disconnections may occur. Case. For example, during the writing process of teachers, continuous writing often occurs. When teachers write connected characters, different words and different strokes of the same word are written continuously. If data is lost during the infrared touch frame detection process, , then the writing coordinates detected by the infrared touch box are discontinuous, and the blackboard writing content restored based on the writing coordinates will be disconnected, which is not conducive to the accurate restoration of the blackboard writing content.

Based on the above content, it can be seen that the blackboard writing content recorded through the infrared touch frame is less accurate and is not conducive to accurate restoration. Therefore, embodiments of the present application provide a method, device, equipment, system and storage medium for obtaining blackboard writing, so as to accurately obtain the content of the blackboard writing and ensure the accuracy of the recording when recording the content of the blackboard writing.

One embodiment of the present application provides a method for obtaining blackboard writing. The method for obtaining blackboard writing can be executed by a blackboard writing obtaining device. The blackboard writing obtaining device can be implemented through software and/or hardware. The blackboard writing obtaining device can be two It is composed of one or more physical entities, or it can be composed of one physical entity.

In one embodiment, the blackboard writing acquisition device is a device with data processing capabilities. For example, the blackboard writing acquisition device may be an interactive tablet, a tablet computer, a camera device, etc., or may simply be a processor with data processing capabilities. When the blackboard writing acquisition device is a processor, if the program executed when the processor is running is relatively complex and the processor's own storage space cannot store the program, the blackboard writing acquisition device may also include a memory, and the memory stores the running process of the processor. procedures performed in.

Figure 1 is a flow chart of a blackboard writing acquisition method provided by an embodiment of the present application. Referring to Figure 1, the blackboard writing acquisition device includes the following steps when executing the blackboard writing acquisition method:

Step 110: Obtain the first image collected in real time by the camera device, which is used to photograph the blackboard.

For example, the camera device refers to a device with a camera function, such as a video camera. The camera equipment may also be recorded as a camera device, a camera terminal, a camera terminal, etc. The camera device receives the light from the lens through the camera sensor and converts the optical signals of these lights into electrical signals to achieve image collection.

In one embodiment, the camera device takes a picture of the blackboard to obtain the writing content on the blackboard in the form of an image. The blackboard captured by the camera equipment is a traditional blackboard on which chalk can be used to write. It can be understood that in practical applications, a traditional whiteboard can also be used as the blackboard used in this embodiment. Optionally, a blackboard can be photographed by one or more camera devices. When photographed by multiple camera devices, each camera device captures an area of the blackboard, and the captured areas can be spliced together to obtain the complete area of the blackboard. When photographed by one camera device, one camera device can capture the entire area of the blackboard. In one embodiment, a camera device takes a picture of a blackboard as an example for description. It can be understood that when there are multiple blackboards, each blackboard has a camera device to take pictures of it.

The relative positional relationship between the camera device and the blackboard can be set according to the actual situation. In one embodiment, the camera device is installed on the frame of the blackboard. The position and installation method of the frame where the camera device is installed are not currently limited. For example, the camera device Install it in the middle of the upper frame of the blackboard and photograph the blackboard from top to bottom. The camera equipment can be detachably installed on the blackboard frame, or can be fixedly installed on the blackboard frame. There are currently no restrictions.

In one embodiment, after the camera device is turned on, shooting continues. When the camera equipment shoots, the real-time collected images are sent to the blackboard writing acquisition equipment. Currently, the image collected by the camera device is recorded as the first image. It is understood that the first image contains at least the complete area of the blackboard from which it was captured. It should be noted that when the number of blackboards is multiple, the camera equipment corresponding to each blackboard The device sends the first image it collects in real time to the blackboard acquisition device.

Optionally, the blackboard writing acquisition device and the camera device can be the same physical entity. In this case, the existing camera device can be used, and the relevant processing logic of the blackboard writing acquisition device is added to the processor of the camera device, that is, the camera device and The blackboard writing acquisition device shares a processor, or a new processor can be added to the camera device, and the relevant processing logic of the blackboard writing acquisition device is implemented through the new processor. At this time, after the camera device collects the first image, it sends the first image to the blackboard acquisition device through internal wiring. Optionally, the blackboard writing acquisition device and the camera device can be different physical entities. At this time, the placement position of the blackboard writing acquisition device is currently not limited. For example, the blackboard writing acquisition device is hidden and placed on the side of the blackboard away from the user. Or place it in another location. At this time, the camera device and the blackboard writing acquisition device can transmit data in a wired or wireless manner. Currently, taking wired transmission as an example, the camera device transmits the first image to the blackboard writing acquisition device through a wired transmission channel.

For example, the transmission protocol used by the camera device and the blackboard acquisition device when transmitting the first image is currently not limited. In one embodiment, the camera equipment and the blackboard acquisition equipment implement wired transmission through Universal Serial Bus (USB) or Mobile Industry Processor Interface (MIPI). At this time, this step may specifically include: receiving the first image collected in real time by the camera device through the second USB transmission channel or the MIPI transmission channel.

Among them, the USB transmission channel refers to a channel that uses the USB protocol to transmit data. The USB standard used by the USB transmission channel is currently not limited. In one embodiment, the USB transmission channel between the camera device and the blackboard acquisition device is recorded as the second USB transmission channel. Exemplarily, after the camera device collects the first image, it encodes the first image into a signal suitable for a USB transmission channel, and sends it to the blackboard acquisition device through the second USB transmission channel. Optionally, the camera device encodes the first image through Image Signal Process (ISP), where ISP is a commonly used encoding technology method in the image processing process and will not be described separately at this time.

MIPI transmission channel refers to a channel that uses the MIPI standard to transmit data. Exemplarily, after the camera device collects the first image, it sends the first image to the blackboard writing acquisition device in the form of a MIPI signal (implemented through the MIPI transmission channel).

After the blackboard acquisition device receives the signal sent by the camera device, it obtains the corresponding first image.

Step 120: Identify handwriting content and/or non-handwriting content in the first image, where both the handwriting content and non-handwriting content are located in the blackboard area.

The blackboard area refers to the area where the blackboard is located in the first image. Handwriting content refers to the content written in the blackboard area using tools such as chalk. The handwriting content can be text content, graphic content, etc. Non-handwriting content refers to the content in other areas of the blackboard area except the handwriting content. The non-handwriting content may include unwritten board surfaces and target objects on the blackboard, or may only include target objects. The target objects include but are not limited to There is a possibility of contact between the target object and the blackboard surface due to erasers, teaching aids, and human hands.

In one embodiment, after the blackboard writing acquisition device acquires the first image, it performs image recognition on the first image to obtain the handwriting content located in the blackboard area in the first image. Among them, the technical means used in image recognition are not currently limited. For example, through machine learning technology, a neural network model for identifying handwriting content is pre-trained, and then the handwriting content in the first image is recognized through the neural network model.

In one embodiment, after the blackboard acquisition device acquires the first image, it performs image recognition on the first image to obtain the non-handwriting content located in the blackboard area in the first image. Among them, the technical means used in image recognition are not currently limited. For example, through machine learning technology, a neural network model for identifying non-handwriting content is pre-trained, and then the neural network model is used to identify non-handwriting content in the first image. content. Optionally, the non-handwriting content includes the target object. When recognizing the non-handwriting content, the type of the target object can be simultaneously identified.

In one embodiment, after the blackboard acquisition device acquires the first image, it performs image recognition on the first image to obtain the handwriting content and non-handwriting content located in the blackboard area in the first image. Among them, the method of identifying handwriting content and non-handwriting content can refer to the above description. It can be understood that when performing image recognition through machine learning technology, only one neural network model can be used to identify handwriting content and non-handwriting content at the same time, or other methods can be used to identify the handwriting content and non-handwriting content. Handwriting content and non-handwriting content are currently not limited.

Step 130: Adjust the display effect of the handwriting content and/or non-handwriting content to obtain a second image. The second image is used as the currently acquired blackboard writing content. The display effect of the handwriting content is correspondingly enhanced, and the display effect of the non-handwriting content is correspondingly weakened.

For example, when the handwriting content in the first image is recognized, the display effect of the handwriting content is adjusted. Among them, the display effect refers to the effect when displaying the corresponding content. Currently, adjusting the display effect of handwriting content is mainly to enhance the display effect of handwriting content. After the display effect is enhanced, the handwriting content can be displayed more prominently, that is, when users view images containing handwriting content, it is easier to pay attention to the handwriting content. In one embodiment, the display effect of the handwriting content can be adjusted by modifying the display brightness, color saturation and/or modifying other parameters. When enhancing the display effect of the handwriting content, the color saturation and/or the color saturation of the handwriting content can be enhanced. Or increase the display brightness of the handwriting content, etc., thereby making the color of the handwriting content more prominent. Optionally, an adjustment strategy for enhancing the display effect is set in advance, where the adjustment strategy may include adjustment parameters and adjustment amplitudes. After the handwriting content is recognized, the display effect of the handwriting content is enhanced according to the preset adjustment strategy. It should be noted that when the display effect is enhanced, the handwriting color corresponding to the handwriting content will not change significantly, that is, the color of the adjusted handwriting content viewed by the user's naked eye is basically the same as the color of the handwriting content before adjustment. Optionally, after the handwriting content is recognized, the display effect of the handwriting content in the first image is directly enhanced, and the enhanced first image is recorded as the second image, where the second image can be considered as the current Obtained blackboard content. Optionally, after identifying the handwriting content, extract the handwriting content, that is, extract the chalk writing trajectory in the first image separately, and then enhance the display effect of the extracted handwriting content and generate a second image. At this time, The content of the blackboard writing in the second image only contains content written in chalk.

For example, when non-handwriting content in the first image is recognized, the display effect of the non-handwriting content is adjusted. Currently, adjusting the display effect of non-handwriting content mainly involves weakening the display effect of non-handwriting content. After the display effect is weakened, the non-handwriting content is less likely to be noticed by the user when viewing it, which in turn makes the handwriting content more likely to be noticed. Similarly, the adjustment strategy for weakening the display effect is set in advance. After identifying the non-handwriting content, the display effect of the non-handwriting content is weakened according to the preset adjustment strategy. In one embodiment, the display effect of non-handwriting content can be adjusted by modifying the display brightness, modifying the color saturation, modifying the transparency, blurring, and/or other methods. Weakening the display effect is the opposite of enhancing the display effect. In one embodiment, after identifying the non-handwriting content in the first image, the display effect of the non-handwriting content in the first image is weakened by increasing the transparency of the non-handwriting content and blurring it. At this time, the content located in the blackboard area The handwriting content will be highlighted, thereby achieving the acquisition of the blackboard writing content. Currently, the first image after weakening the non-handwriting content is used as the second image.

For example, when identifying handwriting content and non-handwriting content in the first image, the display effect of the handwriting content in the first image is enhanced, and the display effect of the non-handwriting content in the first image is weakened, and then the display effect is The processed first image is used as the second image. Or, extract the recognized handwriting content and non-handwriting content, then enhance the display effect of the extracted handwriting content, weaken the display effect of the extracted non-handwriting content, and then synthesize the handwriting content and non-handwriting content into a new image and use the new image as the second image.

Optionally, when the camera equipment is shooting, it may capture other areas outside the blackboard (for example, when the blackboard is installed on the wall, the wall surrounding the blackboard is captured). At this time, if the handwriting content and/or content in the first image are captured, or non-handwriting content to adjust the display effect and obtain the second image, then other areas can be deleted in the second image and only the content of the blackboard area can be retained.

Optionally, the blackboard is usually rectangular in shape. Due to the angle limitation of the camera equipment when shooting, the blackboard area in the first image will appear trapezoidal. Therefore, the camera equipment is installed on the frame of the blackboard, adjusts the display effect of the handwriting content and/or the non-handwriting content, and obtains the second image. It also includes: performing trapezoidal correction on the blackboard area in the second image so that the The blackboard area in the second image is restored from a trapezoid to a rectangle, thereby restoring the blackboard writing content in the second image to the content presented on the rectangular blackboard. Among them, keystone correction is a common technical means for image processing in the field of photography and will not be described separately at this time.

Step 140: Send the second image to the display device, so that the display device displays the second image and/or stores the second image.

Exemplarily, after obtaining the second image, the blackboard acquisition device sends the second image to other devices so that the other devices can perform corresponding processing on the second image, such as displaying the second image and/or storing the second image, etc. .

In one embodiment, after obtaining the second image, the second image is sent to a display device, where the display device is a device with a display function, for example, the display device refers to a display screen that can present images. Optionally, the display device also has functions such as data processing and storage. At this time, the display device can also be an interactive tablet, a tablet computer, a notebook computer, a mobile phone and other electronic devices. Optionally, the blackboard writing acquisition device and the display device can be the same physical entity. In this case, the existing display device can be used, and the relevant processing logic of the blackboard writing acquisition device can be added to the processor of the display device, that is, the display device and The blackboard writing acquisition device shares a processor, or a new processor can be added to the display device, and the relevant processing logic of the blackboard writing acquisition device is implemented through the new processor. At this time, the blackboard acquisition device sends the second image to the display device through internal wiring. Optionally, the blackboard writing acquisition device and the camera device can be different physical entities. At this time, the blackboard writing acquisition device and the display device can transmit data through wired or wireless methods. Currently, taking wired transmission as an example, the blackboard writing acquisition device The device transmits the second image to the display device through a wired transmission channel.

It should be noted that when the blackboard writing acquisition device and the camera device are the same physical entity, if there are multiple blackboards, there are multiple blackboard writing acquisition devices, and each blackboard writing acquisition device can obtain the second image and send it to the display device . When the blackboard writing acquisition device and the camera device are not the same physical entity, if the number of blackboards is multiple, the number of camera devices is multiple. At this time, the blackboard writing acquisition device can receive the first image captured by each camera device and process it respectively. Corresponding second images are obtained, and then multiple second images are sent to the display device. After the display device receives multiple second images, if it needs to display the second images, it can display multiple second images at the same time, or display at least one of the second images according to preset display logic or user instructions.

In one embodiment, sending the second image to the display device includes: sending the second image to the display device through a first USB transmission channel or a multimedia transmission channel.

For example, the blackboard writing acquisition device and the display device may use a USB transmission channel to transmit data. Currently, the USB transmission channel between the blackboard writing acquisition device and the display device is recorded as the first USB transmission channel. Exemplarily, after the blackboard acquisition device generates the second image, the second image is encoded into a signal suitable for a USB transmission channel, and is sent to the display device through the first USB transmission channel. Optionally, the encoding rules used by the blackboard acquisition device are currently not limited. For example, the second image may be encoded in H.264 or H.265, where both H.264 and H.265 are video codec standards. It can be understood that since the blackboard acquisition device acquires the first image in real time and generates the corresponding second image, the real-time second image can be encoded in the form of video data and sent to the display device through the first USB transmission channel, and then, The display device decodes the received video data to obtain a real-time second image.

For example, the blackboard acquisition device and the display device may also use a multimedia transmission channel to transmit data. Among them, the multimedia transmission channel refers to the channel that uses multimedia interfaces for data transmission. Multimedia interfaces include but are not limited to High Definition Multimedia Interface (HDMI) or DisplayPort (DP). After the blackboard acquisition device generates the second image, the second image is transmitted to the display device through the multimedia transmission channel, so that the display device acquires the second image.

After the display device obtains the second image, it can obtain the writing content of the current blackboard and perform subsequent processing. In one embodiment, the subsequent processing includes displaying the content of the blackboard writing and/or storing the content of the blackboard writing, etc. When the display device displays the content of the blackboard writing, it sends the second image to its own display screen to display the second image on the display screen. Optionally, the second image can be displayed on the display screen in real time. It can be understood that currently, the second image is acquired by the processor of the display device and sent to the display screen. The processor of the display device uses Low-Voltage Differential Signaling (LVDS), V-by-One ( VBO), MIPI, Embedded Display Port (EDP) and other methods to send the second image to the display for display. It should be noted that the display rules when the display device displays the second image are currently not limited. When the display device stores the content of the blackboard writing, it can save the encoded data stream of the second image. Among them, the encoding rules used by the display device are currently not limited. After saving, the user of the display device can retrieve the data stream at any time as needed to obtain the content of the blackboard writing. Optionally, the display device can also upload the stored blackboard writing content to the network so that other devices in the network can obtain the blackboard writing content.

It should be noted that after the camera equipment is started, the first image is captured in real time and sent to the blackboard acquisition device. After that, the blackboard acquisition device acquires the first image in real time and performs the above processing to obtain the second image and sends the second image to the device in real time. display screen.

In the above, the first image obtained after the blackboard is photographed by the camera device is obtained, and the handwriting content and/or non-handwriting content located in the blackboard area in the first image are identified, and then the display effect of the handwriting content and/or non-handwriting content is adjusted. , wherein the display effect of the handwriting content is enhanced, and the display effect of the non-handwriting content is weakened to obtain the second image. The second image is used as the currently obtained blackboard writing content. After that, the second image is sent to the display device, so that the display device The technical means of displaying the second image and/or storing the second image solves the technical problem of low accuracy of blackboard content obtained through infrared touch detection in related technologies. Using the method of capturing images instead of infrared touch detection can accurately After obtaining the content on the blackboard, even if there are objects such as erasers and teaching aids adsorbed on the blackboard, the camera equipment can clearly capture the area around the erasers and teaching aids without obstruction, and the captured image can contain the color of the chalk writing. As well as the written strokes and other content, there will be no disconnection, ensuring the restoration of the content written on the blackboard, and black and white can be recognized through the captured images. The handwriting content and/or non-handwriting content in the board and adjusting the corresponding display effect can make the handwriting content more prominent, thereby making the blackboard writing content in the second image more prominent. Moreover, after the second image is sent to the display device, real-time display and real-time saving of the content of the blackboard writing can be realized to facilitate subsequent use.

Figure 2 is a flow chart of a method for obtaining blackboard writing provided by an embodiment of the present application. Based on the above embodiment, this embodiment further describes the operation of adjusting the display effect of the handwriting content and/or the non-handwriting content.

In this embodiment, the blackboard captured by the camera device (i.e., the traditional blackboard) and the display device constitute a new blackboard. It should be noted that the new blackboard can also be recorded as a smart blackboard, a smart blackboard, a recording blackboard, etc. No matter which name is used, as long as it can be realized The function of the new blackboard is equivalent to the new blackboard of this application.

In the new blackboard, the display device can be a TV, interactive tablet or other device with a display screen. Among them, the interactive tablet is an integrated device that uses touch technology to control the content displayed on the display tablet and realize human-computer interaction. It integrates projectors, electronic whiteboards, screens, speakers, TVs, and video conferencing terminals, etc. One or more functions.

The display device has one or more display screens, optionally, the display screen is a liquid crystal display (Liquid Crystal Display, LCD). In one embodiment, the display screen may or may not have a touch function. When the display screen has a touch function, it can be a capacitive screen, a resistive screen, an infrared screen and/or an electromagnetic screen. Users can control the display device by touching the display screen with their fingers or stylus. In addition, the display device can also be connected to external devices such as a mouse and keyboard, and users can also control the display device by operating external devices. The display device also includes a processor and a memory. The processor executes various functional applications and data processing of the display device by running software programs, instructions and modules stored in the memory. The display device also includes a power supply. After the display device is connected to the mains, the power supply works to supply power to various internal devices (such as processors, memory, display screens, etc.).

Optionally, the display device and blackboard can be designed integrally or independently. The arrangement between the display device and the blackboard can be set according to actual needs. For example, when the number of blackboards is one, when installing the blackboard and the display device, the blackboard and the display device are arranged horizontally. For another example, when the number of blackboards is two, install the blackboard and the display device. When displaying the device, the display device is located in the middle of the two blackboards. In one embodiment, two blackboards are taken as an example. Figure 3 is a schematic diagram of a new type of blackboard provided by an embodiment of the present application. Referring to Figure 3, there is a display device 13 between the blackboard 11 and the blackboard 12.

In one embodiment, the camera device is installed on the frame of the blackboard to take pictures of the blackboard. Currently, for description, the camera device is installed at the middle position of the upper frame of the blackboard as an example. For example, with reference to Figure 3, the upper side of the blackboard 11 A camera device 14 is installed in the middle of the edge, and a camera device 15 is also installed in the middle of the upper edge of the blackboard 12 .

Optionally, the blackboard acquisition device is integrated inside the display device. Optionally, the blackboard acquisition device is integrated inside the camera device. Optionally, the blackboard writing acquisition device, the display device and the camera device are all independent of each other. Currently, the description is based on the example that the blackboard writing acquisition device and the display device are independent of each other. At this time, the existing display device can be used, and a data transmission channel between the display device and the blackboard writing acquisition device can be established. The blackboard writing acquisition device and the display device may be connected in a wireless or wired manner. In one embodiment, the blackboard writing acquisition device and the display device are connected in a wired manner for exemplary description. When connected with a wire, data is transmitted between the processor of the display device and the processor of the blackboard acquisition device, such as the processing of the blackboard acquisition device sending the second image to the display device. for subsequent processing by the processor. When connected with a wire, the power supply of the display device can also provide power to the blackboard writing acquisition device so that the blackboard writing acquisition device can operate normally. Optionally, when the blackboard acquisition device is operating normally, power can be provided to the camera device so that the camera device starts to collect the first image.

Figure 4 is a data flow block diagram of a blackboard writing acquisition system provided by an embodiment of the present application. The data transmission flow between various devices is shown in Figure 4, in which the camera sensor (i.e., camera sensor) is located in the camera device and can also be equivalent to the camera device. The first processor is located in the blackboard writing acquisition device, and may also be equivalent to the blackboard writing acquisition device. The first processor may also be the processor of the camera device, that is, the blackboard acquisition device and the camera device are the same physical entity. The second processor is a processor in the display device, the liquid crystal display screen is a display screen in the display device, and the power supply is a power supply in the display device. Based on Figure 4, it can be seen that after the display device is started, the power supply can provide power to the first processor. After that, the first processor starts to work (that is, the blackboard acquisition device works) and provides power to the camera sensor, and the camera sensor works (that is, the camera equipment Work). After the camera sensor works, it collects the first image and sends it to the first processor. Then the first processor processes the first image to obtain the second image, and sends the second image to the second processor. The second processor After obtaining the second image, the LCD screen can be controlled to display. Moreover, the second processor can also control the power supply.

In this embodiment, the blackboard acquisition device simultaneously identifies the handwriting content and non-handwriting content located in the blackboard area in the first image, and modifies the handwriting content and the display effect of the non-handwriting content. At this time, referring to Figure 2, the blackboard writing acquisition method executed by the blackboard writing acquisition device specifically includes:

Step 210: Obtain the first image collected in real time by the camera device, which is used to photograph the blackboard.

Step 220: Identify handwriting content and/or non-handwriting content in the first image, and both the handwriting content and non-handwriting content are located in the blackboard area.

In one embodiment, the non-handwriting content includes objects. Among them, the target object can be an eraser, teaching aids and other items, or it can be a human hand. Optionally, when identifying non-handwriting content, you can also only identify the target object. At this time, the unwritten area on the blackboard is no longer regarded as non-handwriting content. The target object is in contact with the surface of the blackboard, and the contact method is currently not limited. In some cases, there is a situation where the target object blocks the handwriting content. At this time, after identifying the handwriting content and non-handwriting content in the first image, it also includes: when detecting that the handwriting content is blocked by the target object, obtaining the historical handwriting content and using it as the current The recognized handwriting content, the historical handwriting content is the handwriting content recognized before the target object blocks the handwriting content. For example, when identifying the target object and the handwriting content, you can determine whether the target object blocks the handwriting content. The judgment method is not limited at present. For example, when the target object is detected, the position of the target object in the blackboard area is determined, and then the detection is queried. The recognition result of the position before reaching the target object. If the recognition result is that the handwriting content is displayed at the position, the handwriting content displayed at the position is regarded as the historical handwriting content, and it is determined that the target object blocks the handwriting content. If the recognition result is that the handwriting content is not displayed at the position, it is determined that the target object does not block the handwriting content. After determining that the target object blocks the handwriting content, obtain the historical handwriting content at the location of the target object, and use the historical handwriting content as the handwriting content currently recognized at the location, and combine the handwriting content at this location with other currently recognized handwriting content. Together as the handwriting content recognized this time, to ensure the integrity of the blackboard writing content subsequently obtained. Optionally, only when the target object meets the set type, it is judged whether the target object blocks the handwriting content. For example, the human hand is determined to be the target object of the set type. At this time, if the target object is recognized, it is judged Whether the target object is a human hand. If the target object is a human hand, continue to detect whether the target object blocks the handwriting content. If the target object is not a human hand, then no Detection of blocked handwriting content. The advantage of this setting is to avoid misidentification of occlusion when using teaching aids to block the handwriting content or using an eraser to erase the handwriting content due to teaching needs. It should be noted that in actual applications, occlusion detection may not be performed, and subsequent operations can be directly performed after identifying the target object.

Step 230: Enhance the display effect of handwriting content and weaken the display effect of non-handwriting content.

For example, after identifying the handwriting content and non-handwriting content in the first image, the recognized handwriting content and non-handwriting content are extracted.

After that, the display effect of the handwriting content is enhanced, and the display effect of the non-handwriting content is weakened. In one embodiment, enhancing the display effect of the handwriting content includes: increasing the display brightness and/or color saturation of the handwriting content. In one embodiment, weakening the display effect of non-handwriting content includes: reducing the display brightness and/or color saturation of non-handwriting content; and/or increasing the transparency of non-handwriting content; and/or blurring non-handwriting content. It should be noted that when adjusting the display effect above, the adjustment range of the parameters involved is not currently limited. Optionally, the display effects of handwriting content and non-handwriting content can be adjusted at the same time, or the display effects of handwriting content and non-handwriting content can be adjusted successively.

In one embodiment, the extracted handwriting content is still an image, and the extracted non-handwriting content is also an image. At this time, step 230 may include steps 231 to 232:

Step 231: Enhance the display effect of the handwriting content to obtain the first-level sub-image.

For example, after the handwriting content is recognized, the handwriting content can be extracted from the first image by cutting out the image or other methods, and the extracted handwriting content is still in the form of an image. In one embodiment, after extracting the handwriting content, the display effect of the handwriting content is enhanced to obtain an enhanced image. Currently, the enhanced image is recorded as a first-level sub-image. Among them, the first-level sub-image only displays the enhanced handwriting content, and other areas are transparent. The size of the image obtained when extracting handwriting content is currently not limited. Optionally, the image is the same size as the first image, or the image is the same size as the blackboard area in the first image, or the image is the same size as the blackboard area in the first image. The image is of a set size. At this time, when extracting the handwriting content, the relative position of the handwriting content in the obtained image is the same as the relative position of the handwriting content in the first image (or in the blackboard area). Optionally, the size of the image obtained when extracting the handwriting content is the same as the size of the smallest rectangular area containing the handwriting content. Afterwards, the display effect of the handwriting content in the image is enhanced, and the enhanced image is recorded as a first-level sub-image.

Step 232: Weaken the display effect of non-handwriting content to obtain a second-level sub-image.

For example, after identifying the non-handwriting content, the non-handwriting content can be extracted from the first image by cutting out the image or other methods, and the extracted non-handwriting content is still in the form of an image. In one embodiment, after extracting the non-handwriting content, the display effect of the non-handwriting content is weakened to obtain a weakened image. Currently, the weakened image is recorded as a second-level sub-image. Among them, the second-level sub-image displays non-handwriting content, and other areas are transparent. The size of the image obtained when extracting non-handwriting content is currently not limited. Optionally, the image is the same size as the first-level sub-image, the same size as the first image, or the size of the blackboard area in the first image. Similarly, at this time, when extracting non-handwriting content, the relative position of the non-handwriting content in the obtained image is the same as the relative position of the non-handwriting content in the first image (or in the blackboard area). Optionally, the size of the image obtained when extracting the non-handwriting content is the same as the size of the smallest rectangular area containing the non-handwriting content. After that, the display effect of the non-handwriting content in the image is weakened, And the weakened image is recorded as the second-level sub-image.

It should be noted that handwriting content and non-handwriting content can be processed at the same time, or they can be processed one after another, and there is no current limit.

Step 240: A second image is composed of the handwriting content and non-handwriting content after adjusting the display effect.

For example, the second image is composed of handwriting content and non-handwriting content. In one embodiment, the handwriting content and non-handwriting content can be merged into one image according to their positions in the first image (currently for the second image). In one embodiment, when the handwriting content and the non-handwriting content are in sub-images of different levels, this step may also be: superimposing the sub-image of the first level on the sub-image of the second level to obtain the third sub-image containing the content of the writing on the blackboard. Two images.

For example, both the first-level sub-image and the second-level sub-image are regarded as one level of the image. Among them, in the computer design system, in order to process the image materials more conveniently and effectively, the materials can be placed in different layers, and the image can be regarded as a superposition of several layers of images. At this time, each layer can be considered as a level. When processing images, each level can be processed independently without affecting the image content of other levels. In one embodiment, the sub-image of the first level is used as the first layer, the sub-image of the second level is used as the second layer, and the first layer is superimposed on the second layer to obtain the second image. The second image serves as the currently acquired blackboard writing content. Optionally, when the relative positions of the handwriting content and the non-handwriting content in the corresponding sub-image are the same as the relative positions of the handwriting content and the non-handwriting content in the first image, two levels of sub-images can be directly superimposed to obtain the second image. Optionally, according to the relative positions of the handwriting content and the non-handwriting content in the first image, two levels of sub-images are superimposed, so that the relative positions of the handwriting content and the non-handwriting content in the second image are consistent with the relative positions of the handwriting content in the first image. The relative position of content and non-handwriting content is consistent.

Optionally, there is a possibility that there is no handwriting content in the blackboard area, that is, the user has not written on the blackboard. At this time, the blackboard acquisition device cannot recognize the handwriting content. In this case, only the recognized non-handwriting content can be extracted. . Correspondingly, the first-level sub-image does not display any content, that is, it is a transparent image, and no operation to enhance the display effect is required. After that, the sub-images of the two levels are superimposed to obtain a second image that only displays non-handwriting content.

Optionally, if only the target object is recognized when recognizing non-handwriting content, then there is also the possibility that there is no non-handwriting content in the blackboard area. At this time, the blackboard acquisition device cannot recognize the non-handwriting content. In this case, you can Only the recognized handwriting content is extracted. Correspondingly, the second-level sub-image does not display any content, that is, it is a transparent image, and no operation to weaken the display effect is required. Afterwards, after the sub-images of the two levels are superimposed, a second image showing only the handwriting content is obtained. It should be noted that when only the target object is recognized, the blackboard surface is no longer regarded as non-handwriting content. At this time, the second image does not need to display the background color of the blackboard, that is, the blackboard surface is not displayed, and only the handwriting content and the target object are displayed. If you want the second image to also display the background color of the blackboard, you can add a level when generating the second image. This level is the lowest level of the second image. The background color of the blackboard is displayed in the image of this level as the second image. The image provides a background so that the second image shows the face of the blackboard.

For example, the camera device is installed on the frame of the blackboard. At this time, due to the limitation of the angle when the camera device shoots the blackboard, the blackboard area appears as a trapezoid instead of a rectangle in the first image. In the second image obtained based on the first image, The content of the blackboard writing is also the content of the blackboard writing corresponding to the trapezoid. Therefore, in one embodiment, in order to avoid the deformation of the blackboard writing content due to the shooting angle, after obtaining the second image, it also includes: performing trapezoidal correction on the blackboard area in the second image. After trapezoidal correction, the blackboard writing content in the second image is closer to the real blackboard writing content on the blackboard, that is, the blackboard writing content in the second image is the blackboard corresponding to the rectangle. book content. It should be noted that there is no limit to the method used for trapezoidal correction, as long as trapezoidal correction can be achieved. Optionally, since the second image is obtained by superimposing sub-images of two levels, after obtaining the sub-images of two levels, the sub-images of two levels can also be subjected to trapezoidal correction respectively, and then the two sub-images can be The sub-images of the hierarchy are superimposed to obtain the second image.

For example, FIG. 5 is a schematic diagram of handwriting content provided by an embodiment of the present application. Referring to FIG. 5 , the blackboard 22 displays the handwriting "Mathematics" written in chalk, and a target object eraser 21 is adsorbed. Figure 6 is a schematic diagram of a second image provided by an embodiment of the present application. After the camera device takes a picture of the blackboard 22 displaying the handwriting content shown in Figure 5, the blackboard acquisition device processes the corresponding first image and performs The second image obtained after keystone correction. Referring to FIG. 6 , the display effect of the handwriting content in the second image (the handwriting content in FIG. 5 is “mathematics”) is obviously stronger than the display effect of the eraser 21 . It should be noted that the camera equipment at the edge of the blackboard is not shown in Figure 5 .

Step 250: Send the second image to the display device, so that the display device displays the second image and/or stores the second image.

Exemplarily, after obtaining the second image, the blackboard writing acquisition device sends the second image to the display device, so that the display device acquires real-time blackboard writing content.

As mentioned above, by using the method of capturing images instead of infrared touch detection, the content on the blackboard can be accurately obtained. Even if there are objects such as erasers and teaching aids adsorbed on the blackboard, the camera equipment can clearly capture the area around the erasers and teaching aids without obstruction. Case. Furthermore, by obtaining the second image through the recognized handwriting content and non-handwriting content, the non-blackboard area in the first image can be eliminated, so that the second image only contains the content of the blackboard area. Moreover, through hierarchical processing, handwriting content and non-handwriting content are corresponding to the first level and the second level, which facilitates separate processing of handwriting content and non-handwriting content and improves processing flexibility.

Figure 7 is a schematic structural diagram of a device for obtaining blackboard writing provided by an embodiment of the present application. Referring to FIG. 7 , the blackboard acquisition device includes: an image acquisition unit 301 , a content recognition unit 302 , an effect adjustment unit 303 and an image sending unit 304 .

Among them, the image acquisition unit 301 is used to acquire the first image collected in real time by a camera device used to photograph the blackboard; the content recognition unit 302 is used to identify the handwriting content and content in the first image. /or non-handwriting content, the handwriting content and the non-handwriting content are both located in the blackboard area; the effect adjustment unit 303 is used to adjust the display effect of the handwriting content and/or the non-handwriting content to obtain the second image , the second image is used as the currently acquired blackboard writing content, the display effect of the handwriting content is correspondingly enhanced, and the display effect of the non-handwriting content is correspondingly weakened; the image sending unit 304 is used to send the second image to the display device to cause the display device to display the second image and/or store the second image.

In one embodiment of the present application, the effect adjustment unit 303 is used to adjust the display effect of the handwriting content and the non-handwriting content. When the second image is obtained, it includes: a display effect adjustment sub-unit, used to adjust the handwriting content. The display effect is enhanced, and the display effect of non-handwriting content is weakened; the image composition subunit is used to form a second image from the handwriting content and the non-handwriting content after adjusting the display effect.

In one embodiment of the present application, the display effect adjustment sub-unit includes: an effect enhancement sub-unit, used to adjust the content of the handwriting The display effect is enhanced to obtain the sub-image of the first level; the effect weakening unit is used to weaken the display effect of the non-handwriting content to obtain the sub-image of the second level. Correspondingly, the image composition subunit is specifically configured to superimpose the first-level sub-image on the second-level sub-image to obtain a second image containing the content of the blackboard writing on the blackboard.

In one embodiment of the present application, the camera equipment is installed on the frame of the blackboard, and the device further includes: a trapezoidal correction unit for adjusting the display effect of the handwriting content and/or the non-handwriting content, so as to obtain After the second image, keystone correction is performed on the blackboard area in the second image.

In one embodiment of the present application, when the display effect adjustment subunit is used to enhance the display effect of the handwriting content, it is specifically used to: increase the display brightness and/or color saturation of the handwriting content. When the display effect adjustment subunit is used to weaken the display effect of the non-handwriting content, it is specifically used to: reduce the display brightness and/or color saturation of the non-handwriting content; and/or increase the display effect of the non-handwriting content. Transparency; and/or, blurring the non-handwriting content.

In one embodiment of the present application, the image sending unit 304 is specifically configured to: send the second image to a display device through a first USB transmission channel or a multimedia transmission channel, so that the display device displays the second image and/or Or store the second image.

In one embodiment of the present application, the non-handwriting content includes a target object, and the target object is in contact with the surface of the blackboard. The device further includes: an occlusion detection unit for identifying the handwriting content in the first image and After non-handwriting content, when it is detected that the handwriting content in the first image is blocked by the target object, the historical handwriting content is obtained and used as the currently recognized handwriting content. The historical handwriting content is the content blocked by the target object. The handwriting content recognized before describing the handwriting content.

In one embodiment of the present application, the image acquisition unit 301 is specifically configured to receive the first image collected in real time by a camera device through a second USB transmission channel or a MIPI transmission channel, and the camera device is used to capture the blackboard.

The blackboard writing acquisition device provided by the embodiment of the present application is included in the blackboard writing acquisition device, and can be used to execute the blackboard writing acquisition method provided in any of the above embodiments, and has corresponding functions and beneficial effects.

It is worth noting that in the above-mentioned embodiment of the blackboard writing acquisition device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned divisions, as long as the corresponding functions can be realized; in addition, The specific names of each functional unit are only for the convenience of distinguishing each other and are not used to limit the scope of the present invention.

An embodiment of the present application also provides a blackboard writing acquisition device. The blackboard writing acquisition device includes one or more processors. When the one or more processors execute one or more programs, the blackboard writing acquisition method as provided in any of the above embodiments is implemented.

It is understandable that in some cases, the blackboard acquisition device also includes a memory, and the processor and the memory can be connected through a bus or other means. As a computer-readable storage medium, the memory can be used to store software programs, computer-executable programs and modules, such as program instructions/modules corresponding to the blackboard writing acquisition method in the embodiment of the present application. The processor executes various functional applications and data processing of the blackboard writing acquisition device by running software programs, instructions and modules stored in the memory, that is, implementing the above blackboard writing acquisition method. The memory may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system and at least one application required for a function; the stored data area may store data created based on the use of the blackboard acquisition device, etc. Additionally, memory may include high speed random access memory The device may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some examples, the memory may further include memory located remotely relative to the processor, and these remote memories may be connected to the blackboard acquisition device via a network. Examples of the above-mentioned networks include but are not limited to the Internet, intranets, local area networks, mobile communication networks and combinations thereof.

Optionally, the blackboard writing acquisition device may also include a communication device, which is used to implement communication functions, such as data transmission with camera equipment and display equipment. The blackboard writing acquisition device may further include an input device operable to receive input numeric or character information and generate key signal input related to user settings and function control of the blackboard writing acquisition device.

The above-mentioned blackboard writing acquisition device includes a blackboard writing acquisition device, and can be used to execute the blackboard writing acquisition method provided in any of the above embodiments, and has corresponding functions and beneficial effects.

Figure 8 is a schematic structural diagram of a blackboard writing acquisition system provided by an embodiment of the present application. Referring to FIG. 8 , the blackboard writing acquisition system includes: a blackboard writing acquisition device 41 , a camera device 42 and a display device 43 .

The camera device 41 is used to photograph the blackboard to obtain a real-time first image; the blackboard acquisition device 42 is used to obtain the first image; identify the handwriting content and/or non-handwriting content in the first image, the handwriting The content and the non-handwriting content are both located in the blackboard area; adjust the display effect of the handwriting content and/or the non-handwriting content to obtain a second image, the second image is used as the currently acquired blackboard content, the handwriting The display effect of the content is correspondingly enhanced, and the display effect of the non-handwriting content is correspondingly weakened; the second image is sent to the display device; the display device 43 is used to display the second image and/or store the second image.

In one embodiment of the present application, the blackboard writing acquisition device 41 is built in the camera device 42 and shares a processor with the camera device 42 . That is, the blackboard writing acquisition device 41 and the camera device 42 are one physical entity. At this time, the processor of the camera device 42 can not only control the collection of the first image, but also implement the above blackboard writing acquisition method.

In one embodiment of the present application, the blackboard writing acquisition system further includes: at least one blackboard, and a corresponding camera device 41 is provided on the frame of each blackboard.

In one embodiment of the present application, taking Figure 4 as an example, there are two blackboards, the display device is located in the middle of the two blackboards, and the camera device is installed at the middle position of the upper frame of the blackboard.

In one embodiment of the present application, the display device includes a power supply, and the power supply supplies power to the blackboard writing acquisition device, that is, the display device is also used to provide power to the blackboard writing acquisition device. Optionally, when the blackboard acquisition device is started based on the power supply of the display device, it can also provide power to the camera device.

The technical details in the use of the above-mentioned blackboard writing acquisition system can refer to the relevant description of the aforementioned blackboard writing acquisition method, and have corresponding functions and beneficial effects.

Embodiments of the present application also provide a storage medium containing computer-executable instructions, which, when executed by a computer processor, are used to perform relevant operations in the method for obtaining blackboard writing provided in any embodiment of the present application, And have corresponding functions and beneficial effects.

Those skilled in the art will understand that embodiments of the present application may be provided as methods, systems, or computer program products.

Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment that combines software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein. The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each process and/or block in the flowchart illustrations and/or block diagrams, and combinations of processes and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine, such that the instructions executed by the processor of the computer or other programmable data processing device produce a use A device for realizing the functions specified in one process or multiple processes of the flowchart and/or one block or multiple blocks of the block diagram. These computer program instructions may also be stored in a computer-readable memory that causes a computer or other programmable data processing apparatus to operate in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction means, the instructions The device implements the functions specified in a process or processes of the flowchart and/or a block or blocks of the block diagram. These computer program instructions may also be loaded onto a computer or other programmable data processing device, causing a series of operating steps to be performed on the computer or other programmable device to produce computer-implemented processing, thereby executing on the computer or other programmable device. Instructions provide steps for implementing the functions specified in a process or processes of a flowchart diagram and/or a block or blocks of a block diagram.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory. Memory may include non-volatile memory in computer-readable media, random access memory (RAM) and/or non-volatile memory in the form of read-only memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

Computer-readable media includes both persistent and non-volatile, removable and non-removable media that can be implemented by any method or technology for storage of information. Information may be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), and read-only memory. (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, Magnetic tape cassettes, tape magnetic disk storage or other magnetic storage devices or any other non-transmission medium can be used to store information that can be accessed by a computing device. As defined in this article, computer-readable media does not include transitory media, such as modulated data signals and carrier waves.

It should also be noted that the terms "comprises," "comprises," or any other variation thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that includes a list of elements not only includes those elements, but also includes Other elements are not expressly listed or are inherent to the process, method, article or equipment. Without further limitation, an element qualified by the statement "comprises a..." does not exclude the presence of additional identical elements in the process, method, good, or device that includes the element.

Note that the above are only the preferred embodiments of the present application and the technical principles used. Those skilled in the art will understand that this application Please not be limited to the specific embodiments described here. Various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of the present application. Therefore, although the present application has been described in detail through the above embodiments, the present application is not limited to the above embodiments, and may also include more other equivalent embodiments without departing from the concept of the present application, and the present application The scope is determined by the scope of the appended claims.

Claims

A method for obtaining blackboard writing, which includes:

Obtaining a first image collected in real time by a camera device used to photograph the blackboard;

Identify handwriting content and/or non-handwriting content in the first image, where both the handwriting content and the non-handwriting content are located in the blackboard area;

Adjust the display effect of the handwriting content and/or the non-handwriting content to obtain a second image. The second image is used as the currently acquired blackboard writing content. The display effect of the handwriting content is correspondingly enhanced, and the display effect of the non-handwriting content is correspondingly enhanced. The display effect is correspondingly weakened;

The second image is sent to a display device so that the display device displays the second image and/or stores the second image.
The blackboard writing acquisition method according to claim 1, wherein adjusting the display effect of the handwriting content and the non-handwriting content to obtain the second image includes:

The display effect of the handwriting content is enhanced, and the display effect of the non-handwriting content is weakened;

The second image is composed of the handwriting content and the non-handwriting content after adjusting the display effect.
The blackboard writing acquisition method according to claim 2, wherein enhancing the display effect of the handwriting content and weakening the display effect of the non-handwriting content include:

Enhance the display effect of the handwriting content to obtain a first-level sub-image;

Weaken the display effect of the non-handwriting content to obtain a second-level sub-image;

The second image composed of the handwriting content and the non-handwriting content after adjusting the display effect includes:

The sub-image of the first level is superimposed on the sub-image of the second level to obtain a second image containing the content of the writing on the blackboard.
The blackboard writing acquisition method according to claim 1, wherein the camera device is installed on the frame of the blackboard,

After adjusting the display effect of the handwriting content and/or the non-handwriting content to obtain the second image, it also includes:

Perform keystone correction on the blackboard area in the second image.
The blackboard writing acquisition method according to claim 2, wherein enhancing the display effect of the handwriting content includes:

Improve the display brightness and/or color saturation of the handwriting content;

Weakening the display effect of the non-handwriting content includes:

Reduce the display brightness and/or color saturation of the non-handwriting content; and/or,

Increase the transparency of said non-handwriting content; and/or,

Blur the non-handwriting content.
The blackboard writing acquisition method according to claim 1, wherein sending the second image to the display device includes:

The second image is sent to the display device through the first USB transmission channel or the multimedia transmission channel.
The blackboard writing acquisition method according to claim 1, wherein the non-handwriting content includes a target object, and the The target object is in contact with the surface of the blackboard;

After identifying the handwriting content and non-handwriting content in the first image, it also includes:

When it is detected that the handwriting content is blocked by the target object, historical handwriting content is obtained and used as the currently recognized handwriting content. The historical handwriting content is the handwriting content recognized before the target object blocks the handwriting content.
The blackboard writing acquisition method according to claim 1, wherein said acquiring the first image collected in real time by the camera device includes:

Receive the first image collected in real time by the camera device through the second USB transmission channel or the MIPI transmission channel.
A blackboard writing acquisition device, which includes:

An image acquisition unit, used to acquire the first image collected in real time by the camera device, which is used to photograph the blackboard;

A content recognition unit configured to identify handwriting content and/or non-handwriting content in the first image, where both the handwriting content and the non-handwriting content are located in the blackboard area;

The effect adjustment unit is used to adjust the display effect of the handwriting content and/or the non-handwriting content to obtain a second image. The second image is used as the currently acquired blackboard writing content, and the display effect of the handwriting content is correspondingly enhanced, The display effect of the non-handwriting content is correspondingly weakened;

An image sending unit, configured to send the second image to a display device, so that the display device displays the second image and/or stores the second image.
A blackboard writing acquisition device, which includes: one or more processors,

When the one or more processors execute one or more programs, the blackboard writing acquisition method as described in any one of claims 1-8 is implemented.
A blackboard writing acquisition system, which includes: blackboard writing acquisition equipment, camera equipment and display equipment,

The camera equipment is used to photograph the blackboard to obtain a real-time first image;

The blackboard acquisition device is used to acquire the first image; identify the handwriting content and/or non-handwriting content in the first image, and the handwriting content and the non-handwriting content are located in the blackboard area; adjust the The display effect of the handwriting content and/or the non-handwriting content is obtained to obtain a second image. The second image is used as the currently obtained blackboard writing content. The display effect of the handwriting content is correspondingly enhanced. The display effect of the non-handwriting content is obtained. Corresponding weakening; sending the second image to the display device;

The display device is used to display the second image and/or store the second image.
The blackboard writing acquisition system according to claim 11, wherein the blackboard writing acquisition device is built in the camera device and shares a processor with the camera device.
The blackboard writing acquisition system according to claim 11, further comprising: at least one blackboard, and corresponding camera equipment is provided on the frame of each blackboard.
The blackboard writing acquisition system according to claim 13, wherein there are two blackboards, the display device is located in the middle of the two blackboards, and the camera device is installed at the middle position of the upper frame of the blackboard.
The blackboard writing acquisition system according to claim 11, wherein the display device is further used to provide the blackboard Blackboard acquisition equipment provides power.
A computer-readable storage medium on which a computer program is stored, wherein when the program is executed by a processor, the blackboard writing acquisition method as described in any one of claims 1-8 is implemented.