CN111311624A - Book detection method and device of point reading equipment - Google Patents
Book detection method and device of point reading equipment Download PDFInfo
- Publication number
- CN111311624A CN111311624A CN202010203077.4A CN202010203077A CN111311624A CN 111311624 A CN111311624 A CN 111311624A CN 202010203077 A CN202010203077 A CN 202010203077A CN 111311624 A CN111311624 A CN 111311624A
- Authority
- CN
- China
- Prior art keywords
- book
- book page
- page area
- detection
- reading
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 131
- 230000015654 memory Effects 0.000 claims description 20
- 238000003708 edge detection Methods 0.000 claims description 8
- 238000012216 screening Methods 0.000 claims description 7
- 230000000903 blocking effect Effects 0.000 claims 1
- 238000000034 method Methods 0.000 abstract description 21
- 230000008569 process Effects 0.000 abstract description 12
- 239000002609 medium Substances 0.000 description 11
- 238000010586 diagram Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 230000002452 interceptive effect Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000013528 artificial neural network Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 239000012120 mounting media Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/174—Segmentation; Edge detection involving the use of two or more images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/187—Segmentation; Edge detection involving region growing; involving region merging; involving connected component labelling
Landscapes
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Facsimile Scanning Arrangements (AREA)
- User Interface Of Digital Computer (AREA)
- Image Analysis (AREA)
Abstract
The embodiment of the application discloses a book detection method and device of a point-reading device, an electronic device and a storage medium. According to the technical scheme, the plurality of target images are continuously acquired within the shooting range of the camera, book page area detection is carried out based on the target images, the corresponding book page areas are marked, and when the indication marks are detected to enter or exit the book page area sheltered, the book page areas are read to serve as book page detection images. By adopting the technical means, the interference existing in the process of determining the book page detection image can be avoided, and the book page detection image with better quality is provided, so that the original page query and the click-to-read content determination can be conveniently carried out, and the use experience of a user can be further optimized.
Description
Technical Field
The embodiment of the application relates to the technical field of intelligent learning equipment, in particular to a book detection method and device of point-reading equipment.
Background
At present, in order to effectively assist students in learning and reduce cost, many electronic devices for learning, such as tablet computers, mobile phones, learning machines and the like, appear on the market, and the electronic devices can solve the problem of difficulty encountered in the learning process of the students to a certain extent. In the process of using the equipment, a common mode is that a user places a book in a shooting range of an equipment camera, and by indicating related positions on the book, the functions of reading and solving problems of the equipment on learning contents at corresponding positions are realized, so that the learning of students is effectively assisted, and the learning effect is optimized.
In the process of using such electronic devices for reading and learning, it is usually necessary to query the database to extract the corresponding original page according to the book page detection image that is clicked and read by the user, and determine the content indicated by the user according to the original page to perform content reading or answering. However, when determining a book page detection image clicked and read by a user, a book page is often shielded by a shielding object such as a finger or a pen, so that the book page range is determined inaccurately, the original page query is interfered, the current click-reading operation fails, and the user experience is affected.
Disclosure of Invention
The embodiment of the application provides a book detection method and device of a point-reading device, an electronic device and a storage medium, and aims to solve the technical problems of page shielding and interference existing in book page detection.
In a first aspect, an embodiment of the present application provides a book detection method for a point-to-read device, including:
continuously acquiring a plurality of target images within a shooting range of a camera, wherein the target images comprise image data of book pages;
performing book page area detection based on the target image, and marking a corresponding book page area;
and when detecting that the indication mark enters or exits the book page area shielded, reading the book page area as a book page detection image, wherein the indication mark is used for indicating the book page to perform point reading.
Further, after performing book page area detection based on the target image and marking a corresponding book page area, the method further includes:
and when the movement of the book page is detected, detecting and marking the book page area again.
Further, the detecting the book page movement includes:
extracting two continuous target images;
determining two corresponding book page areas according to the book page area detection;
and comparing and judging that the coordinate information of the two book page areas changes, and determining the movement of the book pages.
Further, the detecting the book page area based on the target image and marking the corresponding book page area includes:
and detecting the target image based on an edge detection algorithm, identifying a book page area, and marking the book page area.
Further, the detecting the book page area based on the target image and marking the corresponding book page area further includes:
and determining book page area samples corresponding to each target image according to the book page area detection, and screening the book page area with the least interference information from the book page area samples based on the interference information detection for marking.
Further, the detecting that the indication mark enters or exits the book page area being blocked includes:
and extracting image data corresponding to the book page area, and detecting and tracking the indication marks based on a pre-trained indication mark detection and tracking algorithm.
Further, after reading the book page area as a book page detection image, the method further includes:
and inquiring a preset original page database based on the book page detection image, and determining corresponding original page data, wherein the original page data is used for determining contents clicked and read by a user indication identifier.
In a second aspect, an embodiment of the present application provides a book detection apparatus for a point-to-read device, including:
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for continuously acquiring a plurality of target images within the shooting range of a camera, and the target images comprise image data of book pages;
the marking module is used for detecting the book page area based on the target image and marking the corresponding book page area;
and the reading module is used for reading the book page area as a book page detection image when detecting that the indication mark enters or exits the book page area shielded, wherein the indication mark is used for indicating the book page to perform point reading.
In a third aspect, an embodiment of the present application provides an electronic device, including:
a memory and one or more processors;
the memory for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors implement the book detection method of the point-reading device according to the first aspect.
In a fourth aspect, embodiments of the present application provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform the book detection method of a point-reading apparatus according to the first aspect.
According to the method and the device, the plurality of target images are continuously acquired within the shooting range of the camera, the book page area is detected based on the target images, the corresponding book page area is marked, and when the indication mark is detected to enter or exit the area covering the book page area, the book page area is read to serve as the book page detection image. By adopting the technical means, the interference existing in the process of determining the book page detection image can be avoided, and the book page detection image with better quality is provided, so that the query and the point-reading content determination of the original page data are facilitated, and the use experience of a user is further optimized.
Drawings
Fig. 1 is a flowchart of a book detection method of a point-reading device according to an embodiment of the present application;
FIG. 2 is a schematic view of a usage scenario of a learning tablet according to an embodiment of the present application;
FIG. 3 is a schematic diagram illustrating a book page being read by a finger according to an embodiment of the present application;
FIG. 4 is a schematic block diagram of a book page area according to an embodiment of the present application;
fig. 5 is a schematic diagram illustrating a book page movement detection process according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a book detection device of a point-reading apparatus according to a second embodiment of the present application;
fig. 7 is a schematic structural diagram of an electronic device according to a third embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, specific embodiments of the present application will be described in detail with reference to the accompanying drawings. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be further noted that, for the convenience of description, only some but not all of the relevant portions of the present application are shown in the drawings. Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
The book detection method of the point-reading equipment aims to mark a book page area in advance before a user starts to use the point-reading equipment to perform point reading, so that the user can conveniently use the book page area as a book page detection image when performing point reading to inquire an original page database to determine corresponding original page data, and the point-reading content of the user can be determined by combining the point-reading coordinates of the user. Because the book page area marked in advance before point reading generally has no interference information, and when a user reads the book page area, the book page area can be shielded by indication marks such as fingers or pens, and when the user reads the book page area directly, interference and errors can exist when the user determines the book page area through the shot target image, so that the determination of point reading content is influenced, the condition of point reading failure is further caused, and the use experience of the user is influenced. Therefore, the book detection method of the point-reading device in the embodiment of the application is provided to solve the technical problems that errors and interference exist in the book page detection image determined by the existing point-reading device during point reading.
The first embodiment is as follows:
fig. 1 shows a flowchart of a book detection method of a point-to-read device according to an embodiment of the present application, where the book detection method of the point-to-read device provided in this embodiment may be executed by the book detection device of the point-to-read device, the book detection device of the point-to-read device may be implemented in a software and/or hardware manner, and the book detection device of the point-to-read device may be formed by two or more physical entities or may be formed by one physical entity. Generally speaking, the book detection device of the point reading device can be a tablet computer, a point reading machine, a learning machine, a mobile phone and other intelligent devices.
The following description will be made taking the book detection apparatus of the point-reading apparatus as an example of a main body of a book detection method for executing the point-reading apparatus. Referring to fig. 1, the book detection method of the point-reading device specifically includes:
s110, continuously acquiring a plurality of target images within the shooting range of the camera, wherein the target images comprise image data of book pages.
Illustratively, when a user uses the book detection device for reading learning, a reading learning application program on the book detection device is opened, and a camera of the device is called by the reading learning application program to shoot pages of the book in real time. Referring to fig. 2, taking a learning tablet as an example, when a user performs a point-reading learning, a book is placed in a shooting range of a front camera or an external camera module of the learning tablet. The learning flat plate is vertically placed, a camera corresponding to the top of one side of the learning flat plate screen faces a book placing position, a target image containing a book page is shot in real time through the camera, and the target image is identified. When recognizing that a user uses an indication mark such as a finger or a pen to indicate a book page to perform point reading, the learning tablet queries corresponding feedback content according to the point reading content by determining the content of the book page currently indicated by the user as the point reading content, and performs point reading analysis operations such as reading playing, answering and the like.
Generally speaking, the learning tablet sets up an original page database corresponding to each page of the book, where the original page database stores original page data corresponding to each page of the book, and the original page data corresponding to each page of the book may include multiple corresponding problem data, and there are corresponding feedback contents such as problem solutions, pronunciation and audio corresponding to each problem data. When the click-to-read content (namely exercise data) indicated by the user is determined, the exercise data asked by the user at present can be determined, and the feedback content is correspondingly determined to be fed back to the user, so that the click-to-read learning operation of the learning tablet is realized. Further, in order to determine the reading content of the user, it is required to first determine the book page currently indicated by the user, and define the book page as the book page detection image. And further, the corresponding exercise data can be obtained by inquiring according to the coordinates on the book page indicated by the user. Because the target image shot by the user during reading has the condition that the fingers shield the page area of the book, and the interference caused by the shielding easily influences the query of the original page data, the page area of the book is marked in advance before the user performs reading, so that the user can perform subsequent query of the original page data.
Specifically, before the user starts to perform the point reading learning, that is, when the user has not used the indication identifier (finger, pen, etc.) to indicate the book page to perform the point reading, the learning tablet calls the camera to continuously acquire a plurality of target images within the shooting range of the learning tablet, where the target images need to include the image data of the book page. And further carrying out detection marking and screening on the page area of the book corresponding to the target images.
And S120, detecting the book page area based on the target image, and marking the corresponding book page area.
Specifically, the method and the device for detecting the book page area in the embodiment of the application perform the book page area detection by acquiring a plurality of target images in advance, mainly aiming at determining the book page area with the least interference information from the plurality of sample images by taking the plurality of target images as the sample images.
When book page area detection is carried out on each target image, book page area samples corresponding to each target image are determined according to the book page area detection, and book page areas with the least interference information are screened out from the book page area samples based on the interference information detection for marking. It can be understood that if only one target image is shot to perform the detection marking of the book page area, the detected book page area is easily interfered by an interfering object (such as a writing case, etc. blocks the book page), which affects the determination of the subsequent reading content. Therefore, in order to extract a high-quality book page area in advance, the embodiment of the application obtains a high-quality book page area by continuously shooting a plurality of target head images, performing book page area detection on each target image one by one, taking a detection result of each target image as a book page area sample, and screening the book page area sample. When the book page area sample is screened, the book page area sample with the interferent can be detected through the interferent detection model based on the neural network, and finally the book page area with the minimum interference information is screened out. It should be noted that, the detection and recognition model for the interferent such as the writing case can be obtained by obtaining a large number of images of the writing case as training samples and using a neural network-based detection model for training. It can be understood that if a relevant interfering object such as a writing case is detected in a book page area sample, it indicates that there is interfering information in the book page area sample, and the interfering information is screened out.
In one embodiment, an image quality detection model may be further provided to perform image quality detection on a plurality of captured target images. The method generally detects parameter information such as brightness and definition of target images, further compares and judges the image quality of each target image based on a preset standard threshold (representing high image quality), and finally selects a target image with high image quality to detect and mark a book page area.
It should be noted that, when detecting a book page area, the embodiment of the present application detects the target image based on an edge detection algorithm, identifies the book page area, and marks the book page area. The edge detection algorithm can greatly reduce the data volume, can eliminate information which is considered irrelevant, and retains important structural attributes of the image. It can be understood that the target image captured by the camera usually includes not only the book page image data but also image data outside the book page area. In other words, in a user click-to-read scene, there may be interferents such as a writing case, a pen, and a user's body outside a book page area, and these interferents may also be recorded in a target image, and in order to remove this partial image data and store the image data of the book page area, the embodiment of the present application performs the book page area detection by using an edge detection algorithm, so as to detect an edge of a book actually used, intercept the book, and remove the interference of other objects.
In one embodiment, the page of the book can be placed at a fixed position, and after the target image is shot by the learning flat plate, the page area of the book can be directly intercepted corresponding to the coordinate position at the fixed position. There are many ways to detect the page area of the book, and the description is omitted here.
And then, intercepting the detected book page area and correspondingly marking the coordinates of the book page area. After that, when the book page is not moved, the user determines the contents to be read by the user in the cut-out book page area. And if the situation that the book page moves correspondingly indicates that the situations that the page of the book is turned, and the like may occur, the book page area in the target image at the current moment needs to be determined again. And the coordinates of the marked book page areas can be used as a judgment basis for book page movement, and whether the book pages move can be determined by judging the coordinate information of the two corresponding book page areas.
S130, when the fact that the indication mark enters or exits the book page area shielded is detected, reading the book page area to serve as a book page detection image, wherein the indication mark is used for indicating the book page to perform point reading.
Further, after the book page area is detected and marked, the current book page area is used as a book page detection image, and the detection mark of the book page area is not updated again until the book page is detected to move. Meanwhile, referring to fig. 3, when the user indicates the contents of a certain partial area of the page of the book using a finger (indication mark), the camera takes this target image in real time. And detecting and identifying the target image, and determining book page area image data with a finger indicating a book page, wherein the book page area image data is shown in fig. 4. It should be noted that, at this time, the determined book page area image data carries the occlusion information of the "finger", which may affect the determination of the original page data, and therefore, this book page area image data is not used for directly querying the original page data. The original page data is inquired in the book page area which is detected and marked before and has no interference information (such as a finger and the like).
Specifically, the image data corresponding to the book page area is extracted, and the indication mark is detected and tracked based on a pre-trained indication mark detection and tracking algorithm, so that whether the indication mark enters or exits the book page area shielded or not is judged. And detecting, identifying and tracking the fingers of the user in real time by establishing a target detection tracking model. Furthermore, corresponding to a target image shot in real time, preprocessing is carried out through an edge detection algorithm to obtain book page area image data, and the book page area image data is further input into the target detection tracking model, so that the condition that a user finger (namely an indication mark) enters and exits a book page area which is shielded can be tracked and identified. Further, in this time period, since the book page does not move, the learning tablet takes the book page area where the mark has been intercepted before as the book page detection image, and performs the basis for the user to click and read the content in the current time period.
Further, when the content clicked and read by the user in the current time period is determined, a preset original page database is inquired based on the book page detection image, and corresponding original page data is determined, wherein the original page data is used for determining the content clicked and read by the user indication identifier. It can be understood that the book page area intercepted and marked before is used as a basis for inquiring an original page database without finger interference, so that a book page detection image with good quality is provided, the inquiry efficiency and accuracy of original page data can be improved, click-to-read content determination is performed, and the use experience of a user is optimized. When inquiring, comparing the book page area with the original page data of the original page database one by one, determining the original page data with the highest similarity, and considering the original page data as the original page data corresponding to the book page currently indicated by the user. And further according to the original page data, combining with the corresponding coordinate information of the user clicking the book page, the click-to-read content indicated by the finger of the user can be determined. The learning assistance of the learning tablet to the user is realized by determining the corresponding reading content of the original page data, extracting the feedback content bound with the reading content and showing the feedback content to the user in the forms of pronunciation playing, problem solving and the like.
On the other hand, when the book page movement is detected, the detection and marking of the book page area is performed again. It will be appreciated that movement of the pages of the book causes the page area of the book to move, which may be the result of a user turning pages or moving the original book pages. However, in either case, the originally marked page area of the book is invalidated by the change of the page of the book or the change of the coordinates of the page area of the book. The interception and marking of the book page area needs to be updated for the determination of the contents of the click-to-read when the subsequent user indicates the book page.
Specifically, referring to fig. 5, a book page movement detection flow chart of the present application is provided, where the book page movement flow includes:
s141, extracting two continuous target images;
s142, determining two corresponding book page areas according to the book page area detection;
and S143, comparing and judging that the coordinate information of the two book page areas changes, and determining the movement of the book pages.
When judging whether the book page moves, the embodiment of the application judges whether the change exists by detecting and marking the book page areas of the two target images and comparing the coordinates of the two book page areas. And intercepting and marking the book page area by an edge detection algorithm, recording the coordinates of the book page areas corresponding to the front and rear target images as A1 and A2, and further comparing the difference between the coordinates of A1 and A2 to judge whether the book page moves.
In one embodiment, the method may further include capturing a target image in real time, detecting and intercepting a book page area from the target image, and comparing the book page area with a previously intercepted and marked book page area to determine whether the book page moves. There are many ways to detect the movement of the page of the book, and the description is omitted here.
Further, when it is detected that the book page has moved, that is, the book page area where the mark was previously cut out is invalid, referring to the above steps S110 to S120, the cut out and mark of the book page area are performed again on the photographed target image. And the newly marked book page area is used as the book page detection image of the subsequent stage (before the book page is not moved). And when the user performs point reading operation, inquiring the original page database according to the book page detection image and the coordinates on the book page area indicated by the finger of the user, determining the point reading content of the user, further acquiring the corresponding feedback content, and realizing the assistance of the learning of the user. And by analogy, if the book page moves again, the moved target image is further used for re-intercepting and marking the book page area.
In practical application, a target image is continuously acquired through a camera, and the target image is used for detecting whether a user performs a point reading operation or not and for intercepting a page area of a mark book. It can be understood that, corresponding to a stage before the book page is moved, the book page area of the stage remains unchanged, and at this time, all the reading operations on the book page can be determined based on the book page area intercepted by the stage and marked by the user. And then, each time the book page is moved, firstly re-intercepting the marked book page area based on the target image, and determining the click-to-read content of the user by using the re-intercepted marked book page area for the click-to-read operation of the subsequent user. And each interception mark of the book page area is used as a book page detection image at the stage by continuously acquiring a plurality of target images and screening book page area image data with the least interference information from the target images.
In the above, a plurality of target images are continuously acquired within the shooting range of the camera, book page area detection is performed based on the target images, the corresponding book page areas are marked, and when the indication marks are detected to enter or exit the book page area shielded, the book page areas are read as the book page detection images. By adopting the technical means, the interference existing in the process of determining the book page detection image can be avoided, and the book page detection image with better quality is provided, so that the original page query and the click-to-read content determination can be conveniently carried out, and the use experience of a user can be further optimized.
Example two:
on the basis of the foregoing embodiment, fig. 6 is a schematic structural diagram of a book detection device of a point-reading apparatus according to a second embodiment of the present application. Referring to fig. 6, the book detection device of the point-and-read apparatus provided in this embodiment specifically includes: an acquisition module 21, a marking module 22 and a reading module 23.
The acquisition module 21 is configured to continuously acquire a plurality of target images within a shooting range of a camera, where the target images include image data of a book page;
the marking module 22 is configured to perform book page area detection based on the target image, and mark a corresponding book page area;
the reading module 23 is configured to read the book page area as a book page detection image when detecting that the indication identifier enters or exits the book page area that is blocked, where the indication identifier is used to indicate a book page to perform point reading.
In the above, a plurality of target images are continuously acquired within the shooting range of the camera, book page area detection is performed based on the target images, the corresponding book page areas are marked, and when the indication marks are detected to enter or exit the book page area shielded, the book page areas are read as the book page detection images. By adopting the technical means, the interference existing in the process of determining the book page detection image can be avoided, and the book page detection image with better quality is provided, so that the original page query and the click-to-read content determination can be conveniently carried out, and the use experience of a user can be further optimized.
Specifically, still include:
and the detection updating module is used for detecting the movement of the book page and detecting and marking the book page area again.
Specifically, the marking module 22 includes:
and the detection unit is used for detecting the target image based on an edge detection algorithm, identifying a book page area and marking the book page area.
And the screening unit is used for determining book page area samples corresponding to the target images according to the book page area detection, and screening the book page area with the least interference information from the book page area samples for marking based on the interference information detection.
Specifically, the reading module 23 includes:
and the tracking unit is used for extracting image data corresponding to the book page area and detecting and tracking the indication marks based on a pre-trained indication mark detection and tracking algorithm.
The book detection device of the point-reading device provided by the second embodiment of the present application can be used for executing the book detection method of the point-reading device provided by the first embodiment of the present application, and has corresponding functions and beneficial effects.
Example three:
an embodiment of the present application provides an electronic device, and with reference to fig. 7, the electronic device includes: a processor 31, a memory 32, a communication module 33, an input device 34, and an output device 35. The number of processors in the electronic device may be one or more, and the number of memories in the electronic device may be one or more. The processor, memory, communication module, input device, and output device of the electronic device may be connected by a bus or other means.
The memory 32 is a computer-readable storage medium, and can be used to store software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the book detection method of the point-and-read device according to any embodiment of the present application (for example, an obtaining module, a marking module, and a reading module in a book detection apparatus of the point-and-read device). The memory can mainly comprise a program storage area and a data storage area, wherein the program storage area can store an operating system and an application program required by at least one function; the storage data area may store data created according to use of the device, and the like. Further, the memory may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the memory may further include memory located remotely from the processor, and these remote memories may be connected to the device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The communication module 33 is used for data transmission.
The processor 31 executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory, that is, implements the book detection method of the point-reading device.
The input device 34 may be used to receive entered numeric or character information and to generate key signal inputs relating to user settings and function controls of the apparatus. The output device 35 may include a display device such as a display screen.
The electronic device provided by the above can be used to execute the book detection method of the point-to-read device provided by the first embodiment, and has corresponding functions and beneficial effects.
Example four:
the present application also provides a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform a book detection method of a point-reading device, where the book detection method of the point-reading device includes: continuously acquiring a plurality of target images within a shooting range of a camera, wherein the target images comprise image data of book pages; performing book page area detection based on the target image, and marking a corresponding book page area; and when detecting that the indication mark enters or exits the book page area shielded, reading the book page area as a book page detection image, wherein the indication mark is used for indicating the book page to perform point reading.
Storage medium-any of various types of memory devices or storage devices. The term "storage medium" is intended to include: mounting media such as CD-ROM, floppy disk, or tape devices; computer system memory or random access memory such as DRAM, DDR RAM, SRAM, EDO RAM, Lanbas (Rambus) RAM, etc.; non-volatile memory such as flash memory, magnetic media (e.g., hard disk or optical storage); registers or other similar types of memory elements, etc. The storage medium may also include other types of memory or combinations thereof. In addition, the storage medium may be located in a first computer system in which the program is executed, or may be located in a different second computer system connected to the first computer system through a network (such as the internet). The second computer system may provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media residing in different locations, e.g., in different computer systems connected by a network. The storage medium may store program instructions (e.g., embodied as a computer program) that are executable by one or more processors.
Of course, the storage medium containing the computer-executable instructions provided in the embodiments of the present application is not limited to the book detection method of the point-and-read device described above, and may also perform related operations in the book detection method of the point-and-read device provided in any embodiments of the present application.
The book detection device, the storage medium, and the electronic device of the reading apparatus provided in the above embodiments may execute the book detection method of the reading apparatus provided in any embodiment of the present application, and refer to the book detection method of the reading apparatus provided in any embodiment of the present application without detailed technical details described in the above embodiments.
The foregoing is considered as illustrative of the preferred embodiments of the invention and the technical principles employed. The present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present application has been described in more detail with reference to the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present application, and the scope of the present application is determined by the scope of the claims.
Claims (10)
1. A book detection method of a point reading device is characterized by comprising the following steps:
continuously acquiring a plurality of target images within a shooting range of a camera, wherein the target images comprise image data of book pages;
performing book page area detection based on the target image, and marking a corresponding book page area;
and when detecting that the indication mark enters or exits the book page area shielded, reading the book page area as a book page detection image, wherein the indication mark is used for indicating the book page to perform point reading.
2. The book detection method of a point-reading apparatus according to claim 1, after performing book page area detection based on the target image and marking a corresponding book page area, further comprising:
and when the movement of the book page is detected, detecting and marking the book page area again.
3. The book detection method of a point-reading apparatus according to claim 2, wherein said detecting a book page movement comprises:
extracting two continuous target images;
determining two corresponding book page areas according to the book page area detection;
and comparing and judging that the coordinate information of the two book page areas changes, and determining the movement of the book pages.
4. The book detection method of a point-reading device according to claim 1, wherein said performing book page area detection based on said target image, marking a corresponding book page area, comprises:
and detecting the target image based on an edge detection algorithm, identifying a book page area, and marking the book page area.
5. The book detection method of a point-reading apparatus according to claim 1, wherein said performing book page area detection based on said target image, marking a corresponding book page area, further comprises:
and determining book page area samples corresponding to each target image according to the book page area detection, and screening the book page area with the least interference information from the book page area samples based on the interference information detection for marking.
6. The book detection method of the point-reading device according to claim 1, wherein the detecting that the indication mark enters or exits the blocking of the book page area comprises:
and extracting image data corresponding to the book page area, and detecting and tracking the indication marks based on a pre-trained indication mark detection and tracking algorithm.
7. The book detection method of the point-reading apparatus according to claim 1, further comprising, after said reading of the book page area as a book page detection image:
and inquiring a preset original page database based on the book page detection image, and determining corresponding original page data, wherein the original page data is used for determining contents clicked and read by a user indication identifier.
8. A book detection device of a point-reading apparatus, comprising:
the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for continuously acquiring a plurality of target images within the shooting range of a camera, and the target images comprise image data of book pages;
the marking module is used for detecting the book page area based on the target image and marking the corresponding book page area;
and the reading module is used for reading the book page area as a book page detection image when detecting that the indication mark enters or exits the book page area shielded, wherein the indication mark is used for indicating the book page to perform point reading.
9. An electronic device, comprising:
a memory and one or more processors;
the memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement a book detection method of a point-and-read device as recited in any of claims 1-7.
10. A storage medium containing computer-executable instructions for performing a book detection method of a point-and-read device according to any one of claims 1 to 7 when executed by a computer processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010203077.4A CN111311624B (en) | 2020-03-20 | 2020-03-20 | Book detection method and device of point reading equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010203077.4A CN111311624B (en) | 2020-03-20 | 2020-03-20 | Book detection method and device of point reading equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111311624A true CN111311624A (en) | 2020-06-19 |
| CN111311624B CN111311624B (en) | 2023-08-18 |
Family
ID=71157285
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010203077.4A Active CN111311624B (en) | 2020-03-20 | 2020-03-20 | Book detection method and device of point reading equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111311624B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020172421A1 (en) * | 2000-05-29 | 2002-11-21 | Tetsujiro Kondo | Image processing apparatus and method, communication apparatus, communication system and method, and recorded medium |
| JP2007005934A (en) * | 2005-06-21 | 2007-01-11 | Ricoh Co Ltd | Image processing apparatus, image processing method, and image processing program |
| CN107835366A (en) * | 2017-11-07 | 2018-03-23 | 广东欧珀移动通信有限公司 | Multi-medium play method, device, storage medium and electronic equipment |
| CN109656465A (en) * | 2019-02-26 | 2019-04-19 | 广东小天才科技有限公司 | Content acquisition method applied to family education equipment and family education equipment |
| CN109725732A (en) * | 2019-01-23 | 2019-05-07 | 广东小天才科技有限公司 | Knowledge point query method and family education equipment |
| CN110060524A (en) * | 2019-04-30 | 2019-07-26 | 广东小天才科技有限公司 | Robot-assisted reading method and reading robot |
-
2020
- 2020-03-20 CN CN202010203077.4A patent/CN111311624B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020172421A1 (en) * | 2000-05-29 | 2002-11-21 | Tetsujiro Kondo | Image processing apparatus and method, communication apparatus, communication system and method, and recorded medium |
| JP2007005934A (en) * | 2005-06-21 | 2007-01-11 | Ricoh Co Ltd | Image processing apparatus, image processing method, and image processing program |
| CN107835366A (en) * | 2017-11-07 | 2018-03-23 | 广东欧珀移动通信有限公司 | Multi-medium play method, device, storage medium and electronic equipment |
| CN109725732A (en) * | 2019-01-23 | 2019-05-07 | 广东小天才科技有限公司 | Knowledge point query method and family education equipment |
| CN109656465A (en) * | 2019-02-26 | 2019-04-19 | 广东小天才科技有限公司 | Content acquisition method applied to family education equipment and family education equipment |
| CN110060524A (en) * | 2019-04-30 | 2019-07-26 | 广东小天才科技有限公司 | Robot-assisted reading method and reading robot |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111311624B (en) | 2023-08-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111696128B (en) | High-speed multi-target detection tracking and target image optimization method and storage medium | |
| CN110434853B (en) | Robot control method, device and storage medium | |
| WO2020043155A1 (en) | Multiple scale image fusion method and device, storage medium, and terminal | |
| CN111399638B (en) | Blind computer and intelligent mobile phone auxiliary control method suitable for blind computer | |
| US8417026B2 (en) | Gesture recognition methods and systems | |
| US10922535B2 (en) | Method and device for identifying wrist, method for identifying gesture, electronic equipment and computer-readable storage medium | |
| CN110689555B (en) | KCF tracking target loss detection method and system based on foreground detection | |
| WO2022142918A1 (en) | Multi-target tracking system and method | |
| CN110969045A (en) | Behavior detection method and device, electronic equipment and storage medium | |
| CN111881740A (en) | Face recognition method, face recognition device, electronic equipment and medium | |
| CN114581998A (en) | Deployment and control method, system, equipment and medium based on target object association feature fusion | |
| JP7204786B2 (en) | Visual search method, device, computer equipment and storage medium | |
| CN105389812A (en) | Computer vision-based vehicle-mounted information terminal function automatic test method | |
| CN113329222B (en) | Camera function detection method and device | |
| CN111311624B (en) | Book detection method and device of point reading equipment | |
| CN116052231A (en) | Palm vein recognition method, device, equipment and storage medium | |
| US20220122341A1 (en) | Target detection method and apparatus, electronic device, and computer storage medium | |
| CN110766996B (en) | Click-to-read content positioning method and device, electronic equipment and storage medium | |
| CN112102502B (en) | Augmented reality auxiliary method for aircraft cockpit function test | |
| CN113870223A (en) | Method and device for detecting screen leakage of equipment | |
| WO2023272656A1 (en) | Picture book recognition method and apparatus, family education machine, and storage medium | |
| CN112529883A (en) | Patch detection method and device based on image edge recognition | |
| CN112686129A (en) | Face recognition system and method | |
| CN112464828B (en) | Method, device, equipment and storage medium for marking data of document image edge | |
| WO2023000442A1 (en) | Pen tip tracking method, medium, and computing device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |