CN111860052A - Method, device, medium and equipment for identifying picture book - Google Patents
Method, device, medium and equipment for identifying picture book Download PDFInfo
- Publication number
- CN111860052A CN111860052A CN201910347690.0A CN201910347690A CN111860052A CN 111860052 A CN111860052 A CN 111860052A CN 201910347690 A CN201910347690 A CN 201910347690A CN 111860052 A CN111860052 A CN 111860052A
- Authority
- CN
- China
- Prior art keywords
- data
- matching
- picture
- acquiring
- contour
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims abstract description 31
- 238000012937 correction Methods 0.000 claims description 15
- 230000007547 defect Effects 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 12
- 238000012545 processing Methods 0.000 claims description 11
- 230000004931 aggregating effect Effects 0.000 claims description 2
- 238000004891 communication Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 238000012544 monitoring process Methods 0.000 description 4
- 210000001015 abdomen Anatomy 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000011112 process operation Methods 0.000 description 2
- 230000033228 biological regulation Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/40—Document-oriented image-based pattern recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/43—Querying
- G06F16/435—Filtering based on additional data, e.g. user or group profiles
- G06F16/437—Administration of user profiles, e.g. generation, initialisation, adaptation, distribution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/44—Browsing; Visualisation therefor
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Artificial Intelligence (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Image Analysis (AREA)
Abstract
A picture book identification method, device, medium and equipment comprises the following steps: page image information is collected; extracting page text information and book characteristic data according to the page image information; analyzing the page text information and the book data to acquire and send the picture characteristic data to the back end; and the back end processes the picture book characteristic data into picture book identification information and sends the picture book identification information to the front end. The invention solves the technical problem of low applicability of drawing book identification in the prior art.
Description
Technical Field
The present invention relates to an intelligent learning device, and more particularly, to a method, an apparatus, a medium, and a device for recognizing a picture book.
Background
With the continuous development of electronic information technology, the application of intelligent education and accompanying technology is very wide, and intelligent education devices are needed in use scenes such as online training, child accompanying, intelligent interactive learning and the like. The intelligent learning device in the traditional technology has low applicability to the drawing recognition function and low recognition precision.
To sum up, the intelligent learning education device and the matched technology thereof in the prior art have the technical problem of low recognition applicability of the picture book.
Disclosure of Invention
In view of the technical problem of low applicability of the sketch recognition in the intelligent learning education device and the matching technology thereof in the prior art, the invention aims to provide a sketch recognition method, a device, a medium and equipment, wherein the sketch recognition method comprises the following steps: acquiring picture information of the picture to acquire pixel distribution information; analyzing the pixel distribution information to acquire and draw the characteristic data; extracting contour data in the sketch feature data; traversing a preset drawing data set according to the contour data to obtain drawing matching data; acquiring matching defect data according to the picture matching data; and playing the multimedia data according to the matched defect data.
In an embodiment of the present invention, the step of extracting the contour data further includes: extracting pixel distribution data in the picture characteristic data; converting the pixel distribution data into split line data; the aggregated split line data is profile data.
In an embodiment of the present invention, the step of obtaining the matching data of the picture book includes: acquiring a preset drawing data set from a server; acquiring a contour matching threshold; matching the contour data with metadata in the drawing data set to obtain goodness of fit data; judging whether the goodness-of-fit data is greater than or equal to a contour matching threshold value; if yes, generating picture matching data; if not, traversing the metadata in the matched contour data and the drawing data set.
In an embodiment of the present invention, the step of playing the multimedia data includes: acquiring correction scheme data according to the matching defect data; converting the correction scheme data into multimedia data; and playing the multimedia data by the multimedia playing device.
In one embodiment of the present invention, a picture book recognition apparatus includes: a device housing; the sensing acquisition unit is arranged in the device shell and used for acquiring picture information of the picture book so as to acquire pixel distribution information; the micro-processing unit is connected with the sensing acquisition unit and used for analyzing the pixel distribution information so as to acquire and draw the characteristic data and the contour data; the singlechip data unit is connected with the micro-processing unit and used for traversing a preset drawing data set according to the contour data to acquire drawing matching data and acquiring matching defect data according to the drawing matching data; and the playing unit is connected with the single-chip data unit and used for acquiring the correction scheme data according to the matching defect data so as to extract and play the multimedia data in the correction scheme data.
In one embodiment of the present invention, a computer-readable storage medium stores a computer program, and the computer program is executed by a processor to implement a sketch recognition method.
In an embodiment of the present invention, a picture book recognition apparatus includes: a processor and a memory; the memory is used for storing computer programs, and the processor is used for executing the computer programs stored by the memory so as to enable the picture book recognition device to execute the picture book recognition method.
As described above, the motor speed regulating method and device provided by the invention have the following beneficial effects: according to the invention, the page information is acquired through the high-definition video camera, and the picture book information corresponding to the corresponding content can be analyzed and identified according to the page information.
In summary, the present invention provides a method, an apparatus, a medium, and a device for recognizing a picture book, which solve the technical problem of low applicability of the picture book recognition function in the prior art.
Drawings
Fig. 1 is a schematic flow chart illustrating a method for recognizing a picture book according to the present invention.
Fig. 2 is a schematic diagram illustrating a specific step of step S3 in fig. 1 in one embodiment.
Fig. 3 is a schematic diagram illustrating a specific step of step S4 in fig. 1 in one embodiment.
Fig. 4 is a schematic diagram illustrating a specific step of step S6 in fig. 1 in one embodiment.
Fig. 5 is a schematic diagram illustrating the connection of specific units of the present invention.
Description of the element reference numerals
1 device case
2 sensing acquisition unit
3 micro-processing unit
4 singlechip data unit
5 Play unit
Description of step designations
Method steps S1-S6
Method steps S31-S33
Method steps S41-S46
Method steps S61-S63
Detailed Description
The following description of the embodiments of the present invention is provided for illustrative purposes, and other advantages and effects of the present invention will become apparent to those skilled in the art from the present disclosure.
Referring to fig. 1 to 5, it should be understood that the structures shown in the drawings are only used for understanding and reading the present disclosure, and are not used to limit the conditions of the present invention, which can be implemented, so that the present invention has no technical significance, and any structural modification, ratio change or size adjustment should still fall within the scope of the present invention without affecting the efficacy and attainment of the present invention. In addition, the terms "upper", "lower", "left", "right", "middle" and "one" used in the present specification are for clarity of description, and are not intended to limit the scope of the present invention, and the relative relationship between the terms and the terms is not to be construed as a scope of the present invention.
Referring to fig. 1, a schematic flow chart of a method for recognizing a picture according to the present invention is shown, as shown in fig. 1, the present invention provides a method and a device for adjusting a speed of a motor, the method for adjusting a speed of a motor includes:
s1, acquiring picture information to obtain pixel distribution information, in this embodiment, the book information may be obtained by, for example, a laser scanning sensing element installed on the surface of the housing of the educational robot or on the touch screen, and gathering and packaging the page text information and the book data into, for example, a back-end request packet, and sending the back-end request packet to the back-end for further analysis;
s2, analyzing the pixel distribution information to obtain and draw the feature data, in this embodiment, the back end may be a computer or a mobile device such as a mobile phone or a tablet computer, which establishes a data connection with the front end acquisition device in a wireless or wired manner;
s3, extracting contour data in the sketch feature data, wherein in the embodiment, the contour data can be pixel distribution data acquired through a high-definition video camera or a touch screen, the rear end can be a rear-end server which is in communication connection with the educational robot, and the educational robot can be provided with an LCD display screen on the abdomen of a shell of the robot;
S4, traversing the preset drawing data set according to the contour data to obtain drawing matching data;
s5, obtaining matching defect data according to the picture matching data, in an embodiment, in this embodiment, the process operation of chapter feature data processing is mainly completed by the CPU of the back end computer in cooperation with the cache, and the chapter feature data includes data such as chapter information of chapter contents, and can match chapter identification information in a database stored in the back end computer or the terminal;
and S6, playing the multimedia data according to the matching defect data, wherein in the embodiment, a buzzer and a loudspeaker are arranged on the head shell of the robot, and an audio file and a voice prompt corresponding to the chapter identification data are played in a parallel sound box.
Referring to fig. 2, which is a detailed flowchart illustrating step S3 in fig. 1 according to an embodiment, as shown in fig. 2, the step S3 of extracting the contour data further includes:
s31, extracting pixel distribution data in the sketch feature data, in an embodiment, data sent by a front-end terminal device, for example, an interactive learning machine, to a back-end device, for example, a server, needs to be converted into data of an enumeration type, for example;
s32, converting the pixel distribution data into split line data;
And S33, aggregating the splitting line data into contour data.
Referring to fig. 3, which is a detailed flowchart illustrating the step S4 in fig. 1 in an embodiment, as shown in fig. 3, the step S4 of obtaining the graph matching data includes:
s41, obtaining a preset drawing dataset from a server, where in this embodiment, the drawing dataset may be transmitted through, for example, communication installed on the top of an educational robot, and the antenna communication antenna may include a General Packet Radio Service (GPRS) communication module and/or a narrowband internet of Things (NB-IoT) module based on a cell, so as to improve communication efficiency and real-time performance;
s42, obtaining a contour matching threshold, in an embodiment, the image contour can be obtained by a front-end acquisition device such as a radio frequency scanning head by installing an induction chip in a book or by an electronic device for identification;
s43, matching the contour data with metadata in the picture book data set to obtain goodness of fit data;
and S44, judging whether the goodness-of-fit data is larger than or equal to the contour fit threshold value, wherein in one embodiment, the ID of the education robot terminal can be stored in a memory, and the user can also read the ID of the education robot terminal from the memory through a communication element by utilizing the monitoring data programmed in the monitoring terminal, such as a single chip microcomputer. For example, the user may transmit an ID instruction to read the educational robot terminal to the communication antenna using the monitoring terminal;
And S45, if yes, generating the picture matching data, in one embodiment, the controller reads the ID of the education robot terminal from the memory and sends the ID to the monitoring terminal through the information element to be bound with the education robot terminal. The communication element may include at least one of a near field communication module, a bluetooth module, an infrared module, and a Wireless-Fidelity (WiFi) module;
and S46, if not, traversing and matching the contour data and the metadata in the picture book data set, in an embodiment, storing the contour data and the picture book pixel distribution data as a data attribute sequence, in the embodiment, storing the serialized page number characteristic information in a background computer hard disk or a cache, and in the embodiment, acquiring the book characteristic data by identifying a radio frequency chip installed in the book.
Referring to fig. 4, which is a detailed flowchart illustrating step S6 in fig. 1 according to an embodiment of the present invention, as shown in fig. 4, the step S6 of playing multimedia data includes:
s61, obtaining correction plan data according to the matching defect data, in one embodiment, the front end can send the correction plan data to the back end computer in a way of bluetooth for example through a communication module such as an antenna installed on the learning machine for example;
S62, converting the correction scenario data into multimedia data, in this embodiment, the correction scenario data can be converted into multimedia data such as audio data, and played by a speaker mounted on the head of the educational robot;
s63, playing the multimedia data with the multimedia playing device, in this embodiment, the picture book recognition result can be played through the parallel sound installed in the head shell of the educational robot, or the correction scheme is displayed on the display screen installed in the abdomen of the robot.
Referring to fig. 5, which is a schematic diagram showing connection of specific units of the picture recognition device of the present invention, as shown in fig. 5, a picture recognition device is characterized in that the device comprises a device shell 1, a sensing acquisition unit 2, a microprocessor unit 3, a single chip data unit 4 and a playing unit 5, the device shell 1 and the device shell 1 can be human-shaped shells of educational robots, and the robot shells comprise head shells, trunk shells, four-limb shells, etc.; a sensing and collecting unit 2 installed in the device housing 1 for collecting picture information to obtain pixel distribution information, in this embodiment, the book information may be obtained by, for example, a laser scanning sensing element installed on the surface of the housing of the educational robot or on the touch screen, and the page text information and the book data are collected and packaged into, for example, a back-end request packet, which is sent to the back-end for further analysis, in this embodiment, the back-end may be a computer or a mobile device such as a mobile phone or a tablet computer, which establishes data connection with the front-end collecting device in a wireless or wired manner; the micro-processing unit 3 is connected with the sensing acquisition unit 2 and used for analyzing the pixel distribution information to acquire and draw the characteristic data and the contour data, in the embodiment, the contour data can be pixel distribution data acquired through a high-definition video camera or a touch screen, the rear end can be a rear-end server which is in communication connection with the educational robot, and the educational robot can be provided with an LCD display screen on the belly of a shell of the robot; the single chip microcomputer data unit 4 is connected with the micro-processing unit 3 and used for traversing the preset drawing dataset according to the outline data to obtain drawing matching data and accordingly obtain matching defect data, in one embodiment, in the embodiment, the process operation of chapter feature data processing is mainly completed by a back-end computer CPU (central processing unit) in cooperation with cache, and the chapter feature data comprises data such as chapter content paragraph information and the like and can be matched with chapter identification information in a database stored in the back-end computer or a terminal; and the playing unit 5 is connected with the single-chip data unit 4 and used for acquiring the correction scheme data according to the matching defect data and extracting and playing the multimedia data in the correction scheme data according to the correction scheme data.
A computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements a sketch recognition method, as will be appreciated by one of ordinary skill in the art: all or part of the steps for implementing the above method embodiments may be performed by hardware associated with a computer program. The aforementioned computer program may be stored in a computer readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
A picture recognition apparatus comprising: a processor and a memory; the memory is used for storing a computer program, and the processor is used for executing the computer program stored in the memory, so as to enable the picture book identification device to execute the picture book identification method, where the memory may include a Random Access Memory (RAM) or may further include a non-volatile memory (such as at least one disk memory). The processor may be a general-purpose processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the integrated circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, or discrete hardware components.
In summary, the present invention provides a picture book identification method, device, medium and apparatus, and the motor speed regulation method and device provided by the present invention have the following beneficial effects: the invention collects page information through the high-definition video camera, and can analyze and identify the picture book information corresponding to corresponding content according to the page information.
Claims (7)
1. A picture book recognition method is characterized by comprising the following steps:
acquiring picture information of the picture to acquire pixel distribution information;
analyzing the pixel distribution information to acquire and draw characteristic data;
extracting contour data in the sketch feature data;
traversing a preset drawing data set according to the contour data to obtain drawing matching data;
acquiring matching defect data according to the picture matching data;
and playing the multimedia data according to the matching defect data.
2. The method of claim 1, wherein the step of extracting profile data further comprises:
Extracting pixel distribution data in the picture characteristic data;
converting the pixel distribution data into split line data;
and aggregating the splitting line data into profile data.
3. The method of claim 1, wherein the step of obtaining the sketch matching data comprises:
acquiring a preset drawing data set from a server;
acquiring a contour matching threshold;
matching the contour data with metadata in the drawing data set to obtain goodness of fit data;
judging whether the goodness-of-fit data is greater than or equal to a contour matching threshold value;
if yes, generating the picture matching data;
and if not, traversing and matching the contour data and the metadata in the drawing data set.
4. The method of claim 1, wherein the step of playing the multimedia data comprises:
acquiring correction scheme data according to the matching defect data;
converting the revision scheme data into multimedia data;
and playing the multimedia data by a multimedia playing device.
5. A picture recognition apparatus, comprising:
a device housing;
the sensing acquisition unit is arranged in the device shell and used for acquiring picture information of the picture book so as to acquire pixel distribution information;
The micro-processing unit is connected with the sensing acquisition unit and used for analyzing the pixel distribution information so as to acquire and draw the characteristic data and the contour data;
the singlechip data unit is connected with the micro-processing unit and used for traversing a preset drawing data set according to the outline data to acquire drawing matching data and acquiring matching defect data according to the drawing matching data;
and the playing unit is connected with the single-chip data unit and used for acquiring correction scheme data according to the matching defect data so as to extract and play the multimedia data in the correction scheme data.
6. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the picture recognition method according to any one of claims 1 to 4.
7. A picture recognition apparatus, comprising: a processor and a memory;
the memory is configured to store a computer program, and the processor is configured to execute the computer program stored in the memory to cause the sketch recognition apparatus to perform the sketch recognition method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910347690.0A CN111860052A (en) | 2019-04-26 | 2019-04-26 | Method, device, medium and equipment for identifying picture book |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910347690.0A CN111860052A (en) | 2019-04-26 | 2019-04-26 | Method, device, medium and equipment for identifying picture book |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111860052A true CN111860052A (en) | 2020-10-30 |
Family
ID=72965021
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910347690.0A Withdrawn CN111860052A (en) | 2019-04-26 | 2019-04-26 | Method, device, medium and equipment for identifying picture book |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111860052A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112765394A (en) * | 2021-01-07 | 2021-05-07 | 上海喜日电子科技有限公司 | Data processing method and device, electronic equipment and storage medium |
-
2019
- 2019-04-26 CN CN201910347690.0A patent/CN111860052A/en not_active Withdrawn
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112765394A (en) * | 2021-01-07 | 2021-05-07 | 上海喜日电子科技有限公司 | Data processing method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210103695A1 (en) | Object recognition and tagging based on fusion deep learning models | |
| CN104281847B (en) | A kind of reading method, device and equipment | |
| CN112215171B (en) | Target detection method, device, equipment and computer readable storage medium | |
| CN110765246A (en) | Question answering method and device based on intelligent robot, storage medium and intelligent equipment | |
| CN107977390A (en) | Paint this recognition methods, device, system and electronic equipment | |
| US11189183B2 (en) | Intelligent voice interaction method, device and computer readable storage medium | |
| CN107786549A (en) | Adding method, device, system and the computer-readable medium of audio file | |
| US20140095536A1 (en) | System and method for analysis of muitimedia content items | |
| CN110085068A (en) | A kind of study coach method and device based on image recognition | |
| CN110072140B (en) | Video information prompting method, device, equipment and storage medium | |
| CN111429338B (en) | Method, apparatus, device and computer readable storage medium for processing video | |
| CN110610698B (en) | Voice labeling method and device | |
| CN114049536A (en) | Virtual sample generation method and device, storage medium and electronic equipment | |
| CN113342968A (en) | Text abstract extraction method and device | |
| CN115205883A (en) | Data auditing method, device, equipment and storage medium based on OCR (optical character recognition) and NLP (non-line language) | |
| CN112101231A (en) | Learning behavior monitoring method, terminal, small program and server | |
| CN111860052A (en) | Method, device, medium and equipment for identifying picture book | |
| CN113407696A (en) | Collection table processing method, device, equipment and storage medium | |
| CN111008295A (en) | Page retrieval method and device, electronic equipment and storage medium | |
| CN115082828A (en) | Video key frame extraction method and device based on dominating set | |
| CN110941728B (en) | Electronic file processing method and device | |
| CN111881338A (en) | Printed matter content retrieval method based on social software light application applet | |
| CN112307186A (en) | Question-answering service method, system, terminal device and medium based on emotion recognition | |
| CN110163043B (en) | Face detection method, device, storage medium and electronic device | |
| CN112270231A (en) | Method for determining target video attribute characteristics, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20201030 |
|
| WW01 | Invention patent application withdrawn after publication |