WO2019033656A1 - 板书处理方法、装置、设备和计算机可读存储介质 - Google Patents
板书处理方法、装置、设备和计算机可读存储介质 Download PDFInfo
- Publication number
- WO2019033656A1 WO2019033656A1 PCT/CN2017/116749 CN2017116749W WO2019033656A1 WO 2019033656 A1 WO2019033656 A1 WO 2019033656A1 CN 2017116749 W CN2017116749 W CN 2017116749W WO 2019033656 A1 WO2019033656 A1 WO 2019033656A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- blackboard
- board
- book
- writing
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/32—Digital ink
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
Definitions
- the present invention relates to an e-learning technology, and more particularly to a tablet book processing method, apparatus, device, and computer readable storage medium.
- teaching courseware With the development of science and technology, the teaching method of displaying teaching courseware with projection and intelligent interactive tablet has been applied and promoted.
- teaching courseware does not reflect the teaching content that the teacher demonstrates during the teaching process, and interacts with the students' thinking, and lacks the practical content that is practical for the students.
- the invention provides a blackboard book processing method, device, device and computer readable storage medium, which realizes processing and saving the book book content, and records the learning content which is practical for the student.
- an embodiment of the present invention provides a method for processing a blackboard, which is characterized by comprising:
- the corresponding valid images are combined into a book record file according to the timing of collecting the book images.
- an embodiment of the present invention further provides a blackboard book processing device, where the book book processing device includes:
- An acquisition module configured to collect a blackboard image of the writing board
- a cutting module configured to cut the blackboard image according to the writing stroke in the blackboard image to obtain an effective image
- the combination module is configured to combine the corresponding valid images into a blackboard record file according to the timing of collecting the book image.
- an embodiment of the present invention further provides an apparatus, including:
- One or more processors are One or more processors;
- a storage device for storing one or more programs
- the one or more programs are executed by the one or more processors such that the one or more processors implement the tablet book processing method described above.
- an embodiment of the present invention further provides a computer readable storage medium, where a computer program is stored, and when the program is executed by the processor, the board processing method described above is implemented.
- the invention collects the board image of the writing board and performs cutting processing according to the writing handwriting, and obtains the effective board book content, and combines the board book recording file, and can record the board book content which the teacher demonstrates in the classroom according to the student's doubtful point in the file for the student.
- Embodiment 1 is a flowchart of a method for processing a blackboard provided by Embodiment 1 of the present invention
- FIG. 2 is a schematic structural diagram of a blackboard book processing apparatus according to Embodiment 2 of the present invention.
- FIG. 3 is a schematic structural diagram of a device according to Embodiment 3 of the present invention.
- FIG. 1 is a flowchart of a method for processing a blackboard according to a first embodiment of the present invention.
- the present embodiment is applicable to the processing and storage of a tablet content of a tablet.
- the method may be performed by a blackboard processing device, and specifically includes the following steps. 110 to 130:
- Step 110 Collect a blackboard image of the writing board.
- the image of the blackboard is the image presented on the surface of the writing board, that is, the image of the blackboard contains the content written by the teacher on the writing board as the teacher interacts with the student in the teaching process.
- the writing board is an electronic whiteboard provided by the touch screen terminal
- the touch screen terminal can intercept the closed image formed by the writing area of the electronic whiteboard as a board image on the terminal display interface; if the teaching writing board is a traditional blackboard, the control writing board can be controlled
- the camera on the surface captures an image to capture the image of the book.
- the step 110 may include: controlling a blackboard image of the writing board by a camera facing the surface of the writing board according to a preset frequency; calculating a height of a blank writing range below the writing handwriting in the photographed blackboard image; if the blank writing range is When the height is less than the preset first threshold, the blackboard image is acquired.
- step 110 is specifically: collecting a blackboard image of the tablet when receiving the acquisition instruction triggered by the user's operation.
- Step 120 Cutting the blackboard image according to the writing stroke in the blackboard image to obtain an effective image
- the cutting board image is cut according to the writing stroke in the blackboard image, and after detecting the writing handwriting, the smallest rectangular area surrounding the writing handwriting is obtained, and the partial image outside the minimum rectangular area is removed, and the writing handwriting is extracted. , proceed to the next step. It is also possible to crop other partial images of the blackboard image according to the writing stroke according to the requirements of the next processing, for example, cutting a blank writing range above and below the writing handwriting, specifically: detecting the writing handwriting in the graphic image of the blackboard, and obtaining the writing The handwriting is in the ordinate interval in the blackboard image; the partial image outside the ordinate interval in the blackboard image is rejected, and an effective image is obtained.
- Step 130 Combine the corresponding valid images into a blackboard record file according to the timing of collecting the book image.
- step 130 After the effective image cropped according to the writing stroke is acquired in step 120, step 130 combines the valid images into a blackboard recording file, for example, into a PDF file that is easy to read.
- the blank writing range above and below the writing handwriting can be eliminated to obtain a valid image.
- the effective image can be connected up and down to obtain a blackboard recording file. That is, the step 130 includes: creating a blackboard book record file and adding a valid image corresponding to the first acquired board book image to the board book record file; adding the valid image corresponding to the board book image collected by the Nth time to the board book record file, The board image of the N-1 acquisition is below the effective image.
- the gap between the two effective images can be eliminated, and a continuous document is formed, which converts the board content into a continuously readable e-book document.
- the method for processing a blackboard further includes: adjusting, in the effective image, a pixel point having the same color feature value and a color feature value on the surface of the tablet to a preset background color; for example, a transparent color.
- This step can be performed before the effective images are combined into a book record file, or after the effective images are combined into a book record file. This step makes the handwriting more distinct and readable.
- step 130 the method further includes:
- the font format of the text is set to a preset font format.
- the text can be selected, copied, cut, etc., or The way you can edit the document is saved. Further, it is also possible to perform an alignment operation on the text, such as arranging the text such that the left edge of each line of text is aligned on the same vertical line. Through the above operation, some disorganized blackboard images can be processed into a readable book record file.
- the technical solution of the embodiment collects the board image of the writing board and performs cutting processing according to the writing handwriting, and obtains effective board contents, and combines them into a board book recording file, so that the teacher can record the board contents in the class according to the student's doubts.
- students can review after class, solve the problem of providing courseware to students for reviewing in the prior art, lacking practical content of learning, realizing the processing and preservation of the contents of the blackboard, and recording the practical content that is practical for the students. It is convenient for students to review the effects in a targeted manner after class.
- the board processing apparatus includes:
- the collecting module 210 is configured to collect a blackboard image of the writing board
- the cutting module 220 is configured to cut the blackboard image according to the writing stroke in the blackboard image to obtain an effective image
- the combination module 230 is configured to combine the corresponding valid images into a blackboard record file according to the timing of collecting the book image.
- the cropping module 220 includes:
- a detecting unit configured to detect a writing handwriting in the blackboard image, and obtain an ordinate interval of the writing handwriting in the blackboard image
- a culling unit configured to remove a partial image in the template image outside the ordinate interval to obtain an effective image
- the combination module 230 includes:
- a creating module configured to create a blackboard book record file and add a valid image corresponding to the first acquired book book image to the board book record file;
- the adding module is configured to add the valid image corresponding to the board image acquired by the Nth time to the board record file, and below the effective image corresponding to the board image acquired by the N-1th time.
- the blackboard processing device further includes:
- an adjustment module configured to adjust a pixel point of the effective image that has the same color feature value and a color feature value of the surface of the tablet to a preset background color.
- the blackboard processing device further includes:
- An identification module configured to identify characters in the valid image
- a conversion module configured to convert characters in the valid image into text
- a setting module configured to set a font format of the text to a preset font format
- An alignment module for arranging the text such that the left edge of each line of text is aligned on the same vertical line.
- the book book processing device collects a book image by controlling a camera image taken toward the surface of the tablet.
- the blackboard book processing apparatus provided by the embodiment of the present invention can execute the blackboard book processing method provided by any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.
- FIG. 3 is a schematic structural diagram of a device according to Embodiment 3 of the present invention.
- the device includes a processor 310, a memory 320, an input device 330, and an output device 340.
- the number of processors 310 in the device may be One or more of the processors 310 are exemplified in FIG. 3; the processor 310, the memory 320, the input device 330, and the output device 340 of the device may be connected by a bus or other means, and the bus connection is taken as an example in FIG.
- the memory 320 is used as a computer readable storage medium, and can be used to store a software program, a computer executable program, and a module, such as a program instruction/module corresponding to the blackboard processing method in the embodiment of the present invention (for example, an acquisition module in a tablet processing device). 310, crop module 320 and combination module 330).
- the processor 310 executes various functional applications and data processing of the device by executing software programs, instructions, and modules stored in the memory 320, that is, implementing the above-described blackboard processing method.
- the memory 320 may mainly include a storage program area and an storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to usage of the terminal, and the like.
- memory 320 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device.
- memory 320 can further include memory remotely located relative to processor 310, which can be connected to the device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
- Input device 330 can be used to receive input numeric or character information and to generate key signal inputs related to user settings and function controls of the device.
- the output device 340 can include a display device such as a display screen.
- the fourth embodiment of the present invention further provides a computer readable storage medium, on which a computer program is stored, and when the program is executed by the processor, the blackboard book processing method described in the foregoing embodiment is implemented.
- the computer readable storage medium provided by the embodiment of the present invention is not limited to the method operation as described above, and may also perform related operations in the tablet processing method provided by any embodiment of the present invention.
- the present invention can be implemented by software and necessary general hardware, and can also be implemented by hardware, but in many cases, the former is a better implementation. .
- the technical solution of the present invention which is essential or contributes to the prior art, may be embodied in the form of a software product, which may be stored in a computer readable storage medium, such as a floppy disk of a computer. , Read-Only Memory (ROM), Random Access Memory (RAM), Flash (FLASH), hard disk or optical disk, etc., including a number of instructions to make a computer device (can be a personal computer)
- the server, or network device, etc. performs the methods described in various embodiments of the present invention.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Drawing Aids And Blackboards (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims (10)
- 一种板书处理方法,其特征在于,包括:采集书写板的板书图像;根据所述板书图像中的书写笔迹裁剪所述板书图像,得到有效图像;按照采集板书图像的时序将对应的有效图像组合成板书记录文件。
- 如权利要求1所述的板书处理方法,其特征在于,所述根据所述板书图像中的书写笔迹裁剪所述板书图像,得到有效图像,具体包括:检测所述板书图像中的书写笔迹,得到所述书写笔迹在所述板书图像中的纵坐标区间;剔除所述板书图像中处于所述纵坐标区间外的局部图像,得到有效图像;所述按照采集板书图像的时序将对应的有效图像组合成板书记录文件,具体包括:创建板书记录文件并添加第一次采集的板书图像对应的有效图像到所述板书记录文件中;将第N次采集的板书图像对应的有效图像添加至板书记录文件中,第N-1次采集的板书图像对应的有效图像下方。
- 如权利要求1或2所述的板书处理方法,其特征在于,所述板书处理方法还包括:将所述有效图像中,色彩特征值与书写板表面的色彩特征值相同的像素点调成预先设定的背景色。
- 如权利要求1或2所述的板书处理方法,其特征在于,在所述按照采集板书图像的时序将对应的有效图像组合成板书记录文件之后,还包括:识别所述有效图像中的字符;将所述有效图像中的字符转换为文本;将所述文本的字体格式设置为预先设定的字体格式。
- 如权利要求4所述的板书处理方法,其特征在于,在所述将所述文本的字体格式设置为预先设定的字体格式之后,还包括:排布所述文本,使得每一行文本的左边沿对齐在同一竖向直线上。
- 如权利要求1或2所述的板书处理方法,其特征在于,所述板书图像通过控制朝向书写板表面的摄像头拍摄图像进行采集。
- 一种板书处理装置,其特征在于,所述板书处理装置包括:采集模块,用于采集书写板的板书图像;裁剪模块,用于根据所述板书图像中的书写笔迹裁剪所述板书图像,得到有效图像;组合模块,用于按照采集板书图像的时序将对应的有效图像组合成板书记录文件。
- 如权利要求7所述的板书处理装置,其特征在于,所述裁剪模块包括:检测单元,用于检测所述板书图像中的书写笔迹,得到所述书写笔迹在所述板书图像中的纵坐标区间;剔除单元,用于剔除所述板书图像中处于所述纵坐标区间外的局部图像,得到有效图像;所述组合模块包括:创建模块,用于创建板书记录文件并添加第一次采集的板书图像对应的有效图像到所述板书记录文件中;添加模块,用于将第N次采集的板书图像对应的有效图像添加至所述板书 记录文件中,第N-1次采集的板书图像对应的有效图像下方。
- 一种设备,其特征在于,所述设备包括:一个或多个处理器;存储装置,用于存储一个或多个程序;当所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多个处理器实现如权利要求1-6中任一所述的板书处理方法。
- 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,该程序被处理器执行时实现如权利要求1至6中任一所述的板书处理方法。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710709916.8 | 2017-08-18 | ||
CN201710709916.8A CN107506720A (zh) | 2017-08-18 | 2017-08-18 | 板书处理方法、装置、设备和计算机可读存储介质 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2019033656A1 true WO2019033656A1 (zh) | 2019-02-21 |
Family
ID=60691247
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2017/116749 WO2019033656A1 (zh) | 2017-08-18 | 2017-12-17 | 板书处理方法、装置、设备和计算机可读存储介质 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN107506720A (zh) |
WO (1) | WO2019033656A1 (zh) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113326813A (zh) * | 2021-07-08 | 2021-08-31 | 长春电子科技学院 | 数学课堂板书电子格式转换方法 |
CN116012860A (zh) * | 2022-12-29 | 2023-04-25 | 华南师范大学 | 一种基于图像识别的教师板书设计水平诊断方法及装置 |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108305512A (zh) * | 2018-01-05 | 2018-07-20 | 珠海向导科技有限公司 | 一种课堂电子笔记记录系统及方法 |
CN113168276A (zh) * | 2018-12-29 | 2021-07-23 | 深圳市柔宇科技股份有限公司 | 一种笔记局部选取方法、装置、终端及可读存储介质 |
CN110176049B (zh) * | 2019-05-28 | 2023-04-28 | 成都依能科技股份有限公司 | 电子板书生成图片及ppt的方法 |
CN110347993A (zh) * | 2019-07-11 | 2019-10-18 | 深圳云智教育科技有限公司 | 一种板书管理方法及装置 |
CN111080763A (zh) * | 2019-12-26 | 2020-04-28 | 珠海金山网络游戏科技有限公司 | 一种贴图合并方法及装置 |
CN111355792A (zh) * | 2020-02-25 | 2020-06-30 | 北京体育大学 | 一种板书发送方法、系统及触控一体机 |
CN111881904A (zh) * | 2020-07-31 | 2020-11-03 | 城云科技(中国)有限公司 | 板书记录方法和系统 |
CN114407561B (zh) * | 2021-12-23 | 2023-02-24 | 湖南铁道职业技术学院 | 基于AIoT技术的黑板擦试方法及智能黑板擦组件 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050268279A1 (en) * | 2004-02-06 | 2005-12-01 | Sequoia Media Group, Lc | Automated multimedia object models |
CN102982015A (zh) * | 2012-11-06 | 2013-03-20 | 陆昀 | 利用电子白板制作电子课件的方法及相应的展现方法 |
CN104853129A (zh) * | 2014-02-13 | 2015-08-19 | 广东小天才科技有限公司 | 一种板书记录方法及系统 |
CN106778507A (zh) * | 2016-11-24 | 2017-05-31 | 北京小米移动软件有限公司 | 文字提取方法及装置 |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102289823B (zh) * | 2011-06-14 | 2014-02-26 | 汉王科技股份有限公司 | 获取显示设备上图形面积的方法和装置 |
US20140354652A1 (en) * | 2012-04-27 | 2014-12-04 | Mitsubishi Electric Corporation | Character drawing device and character drawing method |
CN102855482A (zh) * | 2012-08-16 | 2013-01-02 | 东莞宇龙通信科技有限公司 | 图片处理方法及装置 |
CN104657058A (zh) * | 2015-02-06 | 2015-05-27 | 深圳市金立通信设备有限公司 | 一种截图方法 |
-
2017
- 2017-08-18 CN CN201710709916.8A patent/CN107506720A/zh active Pending
- 2017-12-17 WO PCT/CN2017/116749 patent/WO2019033656A1/zh active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050268279A1 (en) * | 2004-02-06 | 2005-12-01 | Sequoia Media Group, Lc | Automated multimedia object models |
CN102982015A (zh) * | 2012-11-06 | 2013-03-20 | 陆昀 | 利用电子白板制作电子课件的方法及相应的展现方法 |
CN104853129A (zh) * | 2014-02-13 | 2015-08-19 | 广东小天才科技有限公司 | 一种板书记录方法及系统 |
CN106778507A (zh) * | 2016-11-24 | 2017-05-31 | 北京小米移动软件有限公司 | 文字提取方法及装置 |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113326813A (zh) * | 2021-07-08 | 2021-08-31 | 长春电子科技学院 | 数学课堂板书电子格式转换方法 |
CN113326813B (zh) * | 2021-07-08 | 2022-10-21 | 长春电子科技学院 | 数学课堂板书电子格式转换方法 |
CN116012860A (zh) * | 2022-12-29 | 2023-04-25 | 华南师范大学 | 一种基于图像识别的教师板书设计水平诊断方法及装置 |
CN116012860B (zh) * | 2022-12-29 | 2024-01-16 | 华南师范大学 | 一种基于图像识别的教师板书设计水平诊断方法及装置 |
Also Published As
Publication number | Publication date |
---|---|
CN107506720A (zh) | 2017-12-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2019033656A1 (zh) | 板书处理方法、装置、设备和计算机可读存储介质 | |
US10013643B2 (en) | Performing optical character recognition using spatial information of regions within a structured document | |
WO2019200783A1 (zh) | 动态图表类页面数据爬取方法、装置、终端及存储介质 | |
EP2359230B1 (en) | Background archiving and presentation method | |
WO2021051024A1 (en) | Editable notetaking resource with optional overlay | |
JP2017519288A (ja) | データ入力方法及び端末 | |
CN111506381B (zh) | 一种直播教学中辅助用户进行信息录入的方法及装置 | |
WO2022161293A1 (zh) | 图像处理方法及装置、电子设备和存储介质 | |
CN105427696A (zh) | 一种对目标题目所作答案进行判别的方法 | |
CN111881904A (zh) | 板书记录方法和系统 | |
CN113537801B (zh) | 板书处理方法、装置、终端和存储介质 | |
CN107423407B (zh) | 教学信息记录方法、装置、终端和计算机可读存储介质 | |
CN110889406B (zh) | 一种习题数据卡的信息采集方法、系统及终端 | |
WO2017206248A1 (zh) | 一种信息输入方法和装置 | |
WO2019033660A1 (zh) | 教学关联信息的确定方法、装置、教学设备及存储介质 | |
CN111179650A (zh) | 一种纸写板书和讲解自动文档化的讲台系统 | |
CN112542163B (zh) | 智能语音交互方法、设备及存储介质 | |
CN111417026A (zh) | 一种基于书写内容的在线学习方法及装置 | |
CN110309754B (zh) | 一种习题采集的方法及系统 | |
CN111506240A (zh) | 一种基于家教机的作业在线批改方法及装置 | |
CN110674825A (zh) | 应用于智能语音鼠标的文字识别方法、装置、系统和存储介质 | |
Koushik et al. | Automated marks entry processing in Handwritten answer scripts using character recognition techniques | |
RU2571379C2 (ru) | Интеллектуальная обработка электронного документа | |
KR20200058026A (ko) | 증강 현실을 이용한 한자 공부를 위한 전자 장치의 동작 방법 | |
CN114331932A (zh) | 目标图像生成方法和装置、计算设备以及计算机存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17921790 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17921790 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 16/10/2020) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17921790 Country of ref document: EP Kind code of ref document: A1 |