CN110516660B - Page content reading method and device based on image features - Google Patents
Page content reading method and device based on image features Download PDFInfo
- Publication number
- CN110516660B CN110516660B CN201910854813.XA CN201910854813A CN110516660B CN 110516660 B CN110516660 B CN 110516660B CN 201910854813 A CN201910854813 A CN 201910854813A CN 110516660 B CN110516660 B CN 110516660B
- Authority
- CN
- China
- Prior art keywords
- page
- book
- image frame
- image
- current page
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/40—Document-oriented image-based pattern recognition
- G06V30/41—Analysis of document content
- G06V30/418—Document matching, e.g. of document images
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Library & Information Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Artificial Intelligence (AREA)
- Multimedia (AREA)
- Studio Devices (AREA)
Abstract
The application provides a page content reading method and device based on image characteristics, and the method comprises the following steps: detecting whether the current page of the book is an updated page or not, when the current page of the book is the updated page, triggering the equipment camera end to shoot the current page of the book in a global shooting mode, otherwise triggering the equipment camera end to shoot the current page of the book in a local shooting mode to obtain page feature points corresponding to the current page of the book, then page contents matched with the page feature points are searched out from a preset database, and the page contents are read, so that the pixel information amount and the processing time required to be processed when the equipment acquires the page feature points corresponding to the current page of the book according to the image frame are reduced under the condition of not changing the shooting frame rate of the camera end, the response speed of the equipment is increased, the power consumption of the equipment in the aspects of calculation and image pickup is reduced, the equipment requirement is reduced, and the equipment burden is lightened.
Description
Technical Field
The present application belongs to the field of computer technologies, and in particular, to a page content reading method and apparatus based on image features, and further, to an electronic device and a storage medium for executing the page content reading method based on image features.
Background
With the popularization of smart devices such as mobile phones and tablets, more and more people use the smart devices to learn and acquire information. For example, some devices for reading books, such as a reading device and a point reading device, generally take pictures of book pages of various paper book teaching materials through a camera of the device to obtain page pictures, and then obtain contents of the book pages based on the taken pictures to perform point reading, reading aloud or reading on the contents of the book pages, and the process of obtaining the contents of the book pages needs to repeatedly take and analyze the pictures.
At present, in some existing devices for reading books, in the operation processes of reading on a point, reading aloud or reading, etc., there is a problem that the response speed of the devices to pictures is slow due to the common time delay between the picture frame currently analyzed by the devices and the picture frame taken by the camera. The method for solving the problem of time delay of equipment in the prior art is as follows: in the same time, the image response speed is accelerated by increasing the number of frames taken by the camera and reducing the time for the equipment to perform queue analysis. Although the response speed is increased to a certain extent and the time delay problem is reduced, the method has the technical defects of high requirement on the computing capability of the equipment, increased equipment burden caused by increased power consumption of the equipment in the aspects of computing and shooting, unclear shooting of page information caused by the fact that the exposure degree of pictures shot by the equipment is easily influenced by ambient light and the like.
Disclosure of Invention
In view of this, embodiments of the present application provide a page content reading method and apparatus based on image characteristics, and an electronic device and a storage medium for executing the method, so as to solve the problem of time delay occurring during operations such as point reading, reading aloud or reading by a device in the prior art, and/or overcome technical defects that a requirement on computing capability of the device is high, a burden on the device is increased due to increased power consumption of the device in computing and image capturing, and exposure of a picture captured by the device is susceptible to ambient light, so that capturing of page information is unclear, and the like.
A first aspect of an embodiment of the present application provides a page content reading method based on image characteristics, including:
detecting whether a current page of a book is an updated page, wherein the updated page is a page where the book is located after page turning operation is executed;
when the current page of the book is an updated page, triggering an equipment camera end to shoot the current page of the book by adopting a global shooting mode to obtain an image frame, otherwise triggering an equipment camera end to shoot the current page of the book by adopting a local shooting mode to obtain the image frame so as to obtain page feature points corresponding to the current page of the book from the image frame;
and searching page contents matched with the page feature points from a preset database according to the acquired page feature points, and reading the page contents.
With reference to the first aspect, in a first possible implementation manner of the first aspect, the detecting whether a current page of a book is an updated page, where the step of detecting that the updated page is a page in which the book is located after a page turning operation is performed on the book further includes:
acquiring a first image frame and a second image frame which are pre-stored by the equipment camera, and comparing the image feature overlap ratio between the first image frame and the second image frame, wherein the first image frame is marked as an effective image frame before the book page turning operation is executed, and the second image frame is an image frame shot at the previous time before the equipment camera carries out current shooting;
comparing whether the image feature coincidence degree between the first image frame and the second image frame is smaller than a preset coincidence degree threshold value or not;
and when the image feature overlap ratio between the first image frame and the second image frame is smaller than a preset overlap ratio threshold value, determining that the current page of the book is an updated page, otherwise, determining that the current page of the book is a non-updated page.
With reference to the first possible implementation manner of the first aspect, in a second possible implementation manner of the first aspect, the detecting whether a current page of the book is an updated page, where the determining that the current page of the book is an updated page in the step of determining that the current page of the book is a page where a page turning operation is performed on the book, further includes:
acquiring the starting time of the book when page turning operation is executed;
judging whether the shooting time of the second image frame is within a preset time range according to the starting time when the page turning operation is executed on the book;
and when the shooting time of the second image frame is within the preset time range, determining and marking the current page of the book as an updated page.
With reference to the first aspect, the first possible implementation manner of the first aspect, and the second possible implementation manner of the first aspect, in a third possible implementation manner of the first aspect, the detecting whether a current page of the book is an updated page, where before the step of determining that the updated page is a page where the book is located after the page turning operation is performed on the updated page, the method further includes:
presetting a storage space connected with the equipment camera shooting end, and storing image frames shot in a preset time period of the equipment camera shooting end into the storage space, wherein the image frames stored into the storage space are sequenced according to the shooting time.
With reference to the third possible implementation manner of the first aspect, in a fourth possible implementation manner of the first aspect, the triggering, when the current page of the book is an updated page, the device camera end to shoot the current page of the book in a global shooting mode to obtain an image frame, otherwise, the triggering, by the device camera end, the device camera end to shoot the current page of the book in a local shooting mode to obtain an image frame, so as to obtain, from the image frame, a page feature point corresponding to the current page of the book, further includes:
storing image frames obtained by shooting the current page of the book by the equipment camera into the storage space for sequencing;
and pushing the acquired image frames to an equipment information processing end in a queue mode to identify page feature points according to the sequence of the storage space, so as to acquire the page feature points corresponding to the current page of the book from the image frames.
With reference to the first aspect, in a fifth possible implementation manner of the first aspect, the image frame obtained by the device camera shooting the current page of the book in the global shooting mode includes all positions of the current page of the book, and the image frame obtained by the device camera shooting the current page of the book in the local shooting mode includes a preset position of the current page of the book.
With reference to the first aspect, in a sixth possible implementation manner of the first aspect, when the current page of the book is an updated page, the triggering device camera end uses a global shooting mode to shoot the current page of the book to obtain an image frame, otherwise, the triggering device camera end uses a local shooting mode to shoot the current page of the book to obtain an image frame, so as to obtain a page feature point corresponding to the current page of the book from the image frame, before the triggering device camera end uses the global shooting mode to shoot the current page of the book to obtain the image frame, the method further includes:
acquiring a third image frame shot by the equipment camera shooting end at the previous time in a global shooting mode, wherein the third image frame is an image frame shot by the equipment camera shooting end in a local shooting mode;
performing image exposure parameter identification on the third image frame to acquire exposure parameter information corresponding to the third image frame;
and applying the exposure information to a fourth image frame obtained by the equipment camera in the global shooting mode to adjust the exposure of the image frame obtained by the equipment camera in the global shooting mode to be consistent with the exposure of the image frame obtained by the equipment camera in the local shooting mode.
A second aspect of embodiments of the present application provides a sheet content reading apparatus based on image characteristics, including:
the device comprises a detection module, a display module and a control module, wherein the detection module is used for detecting whether a current page of a book is an updated page, and the updated page is a page in which the book is located after page turning operation is executed;
the processing module is used for triggering the equipment camera to shoot the current page of the book by adopting a global shooting mode to obtain an image frame when the current page of the book is an updated page, and otherwise triggering the equipment camera to shoot the current page of the book by adopting a local shooting mode to obtain the image frame so as to obtain page feature points corresponding to the current page of the book from the image frame;
and the execution module is used for searching page contents matched with the page feature points from a preset database according to the acquired page feature points and reading the page contents.
A third aspect of the embodiments of the present application provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor, when executing the computer program, implements the steps of the image feature-based page content reading method according to any one of the first aspect.
A fourth aspect of embodiments of the present application provides a computer-readable storage medium, which stores a computer program, which when executed by a processor, implements the steps of the image feature-based page content reading method according to any one of the first aspects.
Compared with the prior art, the embodiment of the application has the advantages that:
according to the embodiment of the application, whether the current page of the book is the updated page or not is detected, when the current page of the book is the updated page, the triggering device camera shooting end adopts the global shooting mode to shoot the current page of the book to obtain the image frame, otherwise, the triggering device camera shooting end adopts the local shooting mode to shoot the current page of the book to obtain the image frame, so that the page characteristic points corresponding to the current page of the book are obtained from the image frame, page contents matched with the page characteristic points are searched out from a preset database, and the page contents are read. According to the method, under the condition that the shooting frame rate of the camera is not changed, the pixel information quantity of the picture shot by the camera in the process of obtaining the page feature point corresponding to the current page of the book by the equipment is reduced, so that the information quantity and time required to be processed when the equipment obtains the page feature point corresponding to the current page of the book according to the image frame are correspondingly reduced, the response speed of the equipment is increased, the power consumption of the equipment in the aspects of calculation and shooting is reduced, the requirement of the equipment is lowered, and the burden of the equipment is relieved.
Further, when the equipment camera end selects the global shooting mode to shoot the book, the exposure of the picture in the local shooting mode is fed back to the picture shot in the global shooting mode, so that the effect of the picture shot by the camera end in the global shooting mode is still little affected by illumination, the page content is partially clear, and the technical defects that the exposure of the picture shot by the equipment is easily affected by ambient illumination to cause that the page information is not clearly shot and the like are avoided.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
Fig. 1 is a schematic flowchart of a basic method of a page content reading method based on image characteristics according to an embodiment of the present application;
fig. 2 is a schematic flowchart of a method for determining whether a current page of a book is an updated page in the method for reading page contents based on image features according to the present application;
fig. 3 is a schematic process diagram of continuous shooting by a camera in the page content reading method based on image features according to the embodiment of the present application;
fig. 4 is a schematic flowchart of another method for determining whether a current page of the book is an updated page in the page content reading method based on image features according to the embodiment of the present application;
fig. 5 is a schematic flowchart of a method for acquiring image feature points corresponding to a current page of a book in a page content reading method based on image features according to an embodiment of the present application;
fig. 6 is a schematic flowchart of a method for adjusting exposure of an image frame captured in a global capture mode of a camera of a device in a page content reading method based on image features according to an embodiment of the present application;
fig. 7 is a schematic diagram illustrating a page content reading method based on image features when an image frame is shot in a global shooting mode according to an embodiment of the present application;
fig. 8 is a schematic diagram illustrating an image frame captured in a local capture mode in a page content reading method based on image characteristics according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of a page content reading device based on image characteristics according to an embodiment of the present application;
fig. 10 is a schematic view of an electronic device implementing a page content reading method based on image characteristics according to an embodiment of the present application.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.
The application aims to solve the problem that the response speed is low in the operation processes of point reading, reading or reading and the like of some existing book reading equipment.
In order to explain the technical solution described in the present application, the following description will be given by way of specific examples.
In some embodiments of the present application, please refer to fig. 1, fig. 1 is a schematic flowchart illustrating a basic method of a page content reading method based on image features according to an embodiment of the present application, which is detailed as follows:
in step S101, it is detected whether a current page of a book is an updated page, where the updated page is a page where the book is located after a page turning operation is performed on the book.
In the process of performing operations such as point reading, reading aloud or reading, the device for reading books needs the device camera to continuously shoot book pages according to a certain frame rate to obtain book page image frames, and page feature points are extracted from the image frames shot by the device camera to obtain the content of the book pages. In this embodiment, before capturing an image frame of a current page of a book, a device needs to first detect whether the current page of the book is an updated page, where the updated page is a page in which the book is located after performing a page turning operation. The page turning operation of the book exists in the operations of point reading, reading aloud, reading and the like of the equipment, so that the page where the book is located after one page turning operation of the book is an updated page relative to the page where the book is located before the page turning operation is executed. When the current page of the book is an updated page, it indicates that the current page content of the book is inconsistent with respect to the page content read by the device before, that is, the page of the book has changed, and the device is required to capture a valid image frame of the page of the book for reading the page content of the current page of the book. And when the current page of the book is a non-updated page, the current page content of the book is consistent with the page content read by the equipment before, namely the page of the book is not changed, and the equipment is not required to shoot the effective image frame of the page of the book for reading the page content of the current page of the book.
In step S102, when the current page of the book is an updated page, the device camera is triggered to capture the current page of the book in a global capture mode to obtain an image frame, otherwise, the device camera is triggered to capture the current page of the book in a local capture mode to obtain an image frame, so as to obtain page feature points corresponding to the current page of the book from the image frame.
In this embodiment, after it is detected in step S101 whether the current page of the book is an updated page, a shooting mode of the device camera is selected according to the detection result, so that the device camera can select a shooting mode suitable for the current page scene according to whether the book is an updated page, and then the device camera is triggered to shoot the book according to the selected shooting mode to obtain an image frame, so as to obtain page feature points corresponding to the current page of the book from the image frame. Specifically, when the current page of the book is an updated page, the device camera is triggered to shoot the current page of the book in a global shooting mode to obtain an image frame, otherwise, the device camera is triggered to shoot the current page of the book in a local shooting mode to obtain the image frame, so as to obtain page feature points corresponding to the current page of the book from the image frame.
In some embodiments of the application, the image frame obtained by shooting the current page of the book by the equipment camera shooting end in the global shooting mode includes all positions of the current page of the book, and the image frame obtained by shooting the current page of the book by the equipment camera shooting end in the local shooting mode includes the preset position of the current page of the book. Namely, the main difference between the global shooting mode and the local shooting mode of the camera of the equipment is that the image frames shot by the equipment have different pixel information amounts. Therefore, the device acquires the page feature points corresponding to the current page of the book from the image frames shot in different shooting modes, the quantity difference of the page feature points corresponding to the current page of the book is obtained, the pixel information quantity of the picture shot by the shooting end in the process of acquiring the page feature points corresponding to the current page of the book is reduced under the condition that the shooting frame rate of the shooting end is not changed, the information quantity and time required to be processed when the device acquires the page feature points corresponding to the current page of the book according to the image frames are correspondingly reduced, the response speed of the device is increased, the power consumption of the device in the aspects of calculation and shooting is reduced, the device requirement is reduced, and the device burden is relieved.
In some embodiments of the present application, a page of the book after completing one page turning operation is an updated page relative to a page of the book before performing the page turning operation. In the image frames continuously shot by the camera of the equipment, the book pages corresponding to the image frames shot by the camera of the equipment in the period from the completion of the first page turning operation of the book to the completion of the second page turning operation are non-updated pages, and the updated pages only exist in the image frames shot when the page turning operation is completed. Therefore, according to the embodiment, by utilizing the characteristic that the device stays on the same page for a long time in the operation processes of point reading, reading aloud or reading, and the like, when the current page of the book is a non-updated page, the device camera is triggered to select the local shooting mode for shooting to obtain the image frame, and only when the current page of the book is an updated page, the device camera is triggered to select the global shooting mode for shooting to obtain the image frame, so that the pixel information processing amount of the device during the period that the book is on the same page is reduced, the information processing time of the device is reduced, and the response speed of the device is increased.
In some embodiments of the application, in the local shooting mode, the preset position that the equipment end of making a video recording was shot can be preset by equipment according to the books that it read, and it is specific for the region that has obvious discernment degree that can reflect this books place page that its preset position is, for example the region that contains image characteristic points such as books frame, books central line, page number, page characters and/or page pattern. In this embodiment, when the local photographing mode is adopted for photographing, the preset position is determined by the device camera through the characteristic that the CMOS sensor rolling shutter in the camera scans line by line for exposure, so as to form an image frame representing the preset position of the current page of the book at the device camera sensor.
In step S103, page contents matched with the page feature points are searched from a preset database according to the acquired page feature points, and reading operations are performed on the page contents.
In this embodiment, after the page feature point corresponding to the current page of the book is obtained in step S102, a search is performed in a preset database according to the image feature point to obtain page content matched with the page feature of the page, and the page content is read. In some specific embodiments, the process may be determined by comparing the page feature point with a page feature point corresponding to each page content pre-stored in the preset database, and when the pre-stored page content includes a page feature point consistent with the page feature point, determining that the pre-stored page content matches the page feature point, and then obtaining the page content matching the page feature point to perform a reading operation.
In some embodiments of the present application, please refer to fig. 2, fig. 2 is a flowchart illustrating a method for determining whether a current page of a book is an updated page in the method for reading contents of pages based on image features according to the present application. The details are as follows:
in step S201, a first image frame and a second image frame pre-stored by the device camera are obtained, and an image feature overlap ratio between the first image frame and the second image frame is compared, where the first image frame is an image frame marked as valid before the book page turning operation is performed, and the second image frame is an image frame shot by the device camera before the current shooting is performed;
in step S202, comparing whether the image feature coincidence degree between the first image frame and the second image frame is less than a preset coincidence degree threshold value;
in step S203, when the image feature overlap ratio between the first image frame and the second image frame is smaller than a preset overlap ratio threshold, it is determined that the current page of the book is an updated page, otherwise, it is determined that the current page of the book is a non-updated page.
In this embodiment, a characteristic that an image frame is obtained by continuously shooting a book page by an apparatus camera according to a certain frame rate in a process of performing operations such as point reading, reading aloud or reading by using the apparatus for reading a book is utilized, and before the image frame of a current page of the book is shot by the apparatus camera, whether the current page of the book is an updated page is determined by comparing image feature overlap ratio between an image frame shot by the apparatus camera last time and an effective image frame marked by the apparatus currently. The effective image frame is an image frame shot by the shooting end of the equipment in the global shooting mode last time. Specifically, image frames shot by the equipment camera are stored in advance, and then before the equipment camera shoots an image frame of a current page of a book, a first image frame and a second image frame are obtained from the pre-stored image frames, wherein the first image frame is an image frame marked as valid before the book is turned over, namely the image frame shot by the equipment camera in the last global shooting mode; the second image frame is an image frame shot one time before the current shooting is carried out by the equipment camera, namely, the image frame stored latest in the storage space, and the image frame stored latest is an image frame shot by adopting a local shooting mode. Then, image feature points corresponding to the first image frame and the second image frame are respectively obtained, image feature overlap ratio between the first image frame and the second image frame is obtained by comparing the image feature points corresponding to the first image frame with the image feature points corresponding to the second image frame, after the image feature overlap ratio between the first image frame and the second image frame is obtained, the image feature overlap ratio is compared with a preset overlap ratio threshold value, so that whether book pages corresponding to the first image frame and the second image frame are the same page or not is judged, and whether the current book page is an updated page or not is determined. The preset contact ratio threshold value is a standard for judging whether pages shot correspondingly by the two image frames are the same page or not. When the image feature overlap ratio between the first image frame and the second image frame is smaller than a preset overlap ratio threshold value, it is determined that the pages shot corresponding to the two image frames are not the same page, the current page of the book is determined to be an updated page, otherwise, it is determined that the pages shot corresponding to the two image frames are the same page, and the current page of the book is determined to be a non-updated page. In some specific embodiments, the image feature overlap ratio between the first image frame and the second image frame may be calculated by a distance between corresponding image feature points in the two image frames.
For example, please refer to fig. 3 together, and fig. 3 is a schematic diagram of a process when the camera of the apparatus continuously shoots in the page content reading method based on image features according to the embodiment of the present application. As shown in fig. 3, there is a delay between the image frames processed by the device information processing side and the image frames captured by the device image capturing side. In this embodiment, before shooting at an apparatus camera, whether a current page of a book is an updated page is detected, when the current page of the book is on the updated page, a global shooting mode is used to shoot an effective image frame reflecting the contents of all pages of the updated page, and when the current page of the book is on a non-updated page, a local shooting mode is used to shoot an ineffective image frame reflecting only the contents of local pages of the non-updated page. For example, assuming that the 1 st image frame in fig. 2 is an effective image frame captured in a global capture mode, and the 2 nd to n-1 th image frames are invalid image frames captured in a local capture mode, if the image feature overlap ratio between the two image frames is smaller than a preset overlap ratio threshold value by comparing the 1 st image frame with the n-1 th image frame, it indicates that the current page of the book is turned over and is an updated page, and at this time, the device camera is triggered to capture the image frame of the updated page in the global capture mode when capturing the n th image frame, so as to re-read the page content according to the image frame. And if the image characteristic coincidence degree between the two image frames is larger than or equal to the preset coincidence degree threshold value, the current page of the book is not turned, the current page is consistent with the content of the page read before and is a non-updated page, and at the moment, the image pickup end of the equipment is triggered to adopt a local shooting mode to shoot when shooting the nth image frame to obtain the image frame of the non-updated page.
It is understood that, in this embodiment, there is only one image frame marked as valid, that is, when the device newly identifies an image frame captured in the global capture mode during the operation of reading, or reading, the newly identified image frame is marked as a valid image frame, and the previously identified valid image frame is unmarked.
Further, in some embodiments of the present application, please refer to fig. 4 together, and fig. 4 is a schematic flowchart illustrating another method for determining whether a current page of the book is an updated page in the page content reading method based on the image feature according to the embodiment of the present application. The details are as follows:
in step S401, a start time when the book performs a page turning operation is acquired.
In step S402, it is determined whether the shooting time of the second image frame is within a preset time range according to the starting time when the page turning operation is performed on the book.
In step S403, when the shooting time of the second image frame is within the preset time range, determining and marking the current page of the book as an updated page.
In this embodiment, during the operation of point reading, reading aloud or reading, the image capturing end of the device continuously captures a book page at a certain frame rate to obtain image frames. Therefore, for the process of performing the page turning operation on the book, the device camera end may also continuously shoot a plurality of image frames, because page contents reflected by the image frames shot in the process of performing the page turning operation are prone to errors and losses, in order to avoid obtaining the image frames in page turning as effective image frames of updated pages, when determining whether the current page of the book is an updated page, it may further determine whether the current page of the book is an updated page by obtaining a start time when the page turning operation is performed on the book, and then determining whether the shooting time of the second image frame is within a preset time range according to the start time when the page turning operation is performed on the book, and when the shooting time of the second image frame is within the preset time range, determining that the current page of the book is an updated page. For example, if it is determined that the image frame for updating the page appears in the image frame captured within 0.5 seconds after the page turning operation is performed on the book, the preset time range is between the starting time of the page turning operation performed on the book this time + the preset page turning operation time length and the starting time of the page turning operation performed on the book this time + the preset page turning operation time length +0.5 seconds. For example, the starting time of the page turning operation performed on the book at this time is obtained by monitoring that the starting time is 33 minutes and 40 seconds 00 when the page turning operation is 09, and the preset book page turning operation duration is 1 second, the image frame of the updated page after the page turning operation occurs between 33 minutes and 41 seconds 00 when the time is 09 and 33 minutes and 41 seconds 05 when the time is 09, and since the second image frame is the image frame shot before the current shooting is performed by the device camera, the latest state of the book is represented, it can be determined whether the page corresponding to the second image frame is the updated page by determining whether the shooting time of the second image frame is within the preset time range. And when the shooting time of the second image frame is between 09 minutes and 41 seconds 00 and 09 minutes and 33 minutes and 41 seconds 05, judging that the current page of the book is an updated page, otherwise, judging that the current page of the book is a non-updated page.
In some embodiments of the application, in the process of performing operations such as point reading, reading aloud or reading, the device camera continuously shoots the book page at a certain frame rate to obtain the image frames. Therefore, in this embodiment, a storage space connected to the device camera is preset, and the image frames captured by the device camera within a preset time period are stored in the storage space, wherein the image frames stored in the storage space are sorted according to the sequence of the capturing time. It can be understood that the image frames captured in the preset time period may be all image frames captured by the device camera in the operation process of the device that performs click reading, reading aloud or reading to the book this time, or all image frames captured by the device camera in the time period from the effective image frame of the page mark corresponding to the currently processed image frame to the image frame currently captured by the device camera, or the number of the stored image frames in the storage space may be set by the user in a customized manner, and the storage space automatically deletes the image frame captured at the earliest time when the device camera captures an image frame and stores the image frame in the storage space. It is to be understood that the deleted image frames are image frames that have been processed by the device.
Further, in some embodiments of the present application, please refer to fig. 5, and fig. 5 is a flowchart illustrating a method for acquiring an image feature point corresponding to a current page of a book in a page content reading method based on image features according to an embodiment of the present application. The details are as follows:
in step S501, the image frames obtained by shooting the current page of the book by the device camera are stored in the storage space and sorted.
In step S502, according to the sorting of the storage space, the acquired image frames are pushed to an equipment information processing end in a queue manner to perform page feature point identification, so as to acquire a page feature point corresponding to the current page of the book from the image frames.
Since the time consumed by the reading, or reading process of the book reading device is much longer than the time taken by the image capturing end to capture an image frame, in this embodiment, the image frames obtained by capturing the current page of the book by the image capturing end are stored in the storage space and sorted, where the image frames include image frames and image frames. Therefore, when the device performs the operations of point reading, reading aloud or reading and the like, the corresponding image frames can be sequentially acquired from the storage space according to the sequence of the shooting time, the page feature points are pushed to a device information processing end in a queue mode to be identified, the page feature points corresponding to the current page of the book are acquired from the image frames, and the page content reading operation is performed according to the page feature points.
In some embodiments of the present application, please refer to fig. 6, and fig. 6 is a flowchart illustrating a method for adjusting exposure of an image frame captured in a global capture mode of a camera of a device in a page content reading method based on image features according to an embodiment of the present application. The details are as follows:
in step S601, a third image frame captured by the device camera in a previous time before the device camera adopts a global capture mode is obtained, where the third image frame is an image frame captured by the device camera in a local capture mode;
in step S602, performing image exposure parameter identification on the third image frame to obtain exposure parameter information corresponding to the third image frame;
in step S603, the exposure information is applied to the fourth image frame obtained by the device camera in the global shooting mode, so as to adjust the exposure of the image frame obtained by the device camera shooting in the global shooting mode to be consistent with the exposure of the image frame obtained by the device camera shooting in the local shooting mode.
Referring to fig. 7 and 8 together, fig. 7 is a schematic diagram illustrating a page content reading method based on image features when an image frame is captured in a global capture mode according to an embodiment of the present application; fig. 8 is a schematic diagram of capturing an image frame in a local capture mode in the page content reading method based on image features according to the embodiment of the present application. As shown in fig. 7, in general, an image frame area 701 captured by the image capturing end of the device in the global capture mode is larger than the book area 702, and in the image frame area 701, a part of the area that is larger than the book area is likely to capture objects other than books, so that the image frame is likely to be affected by external natural illumination and is in an abnormal exposure state, and information of a book page cannot be clearly reflected. Therefore, in this embodiment, the image frames captured by the device camera may be stored in a preset storage space according to a time sequence by setting the device camera, and after the device camera performs global shooting on the current page of the book according to the global shooting mode and obtains the image frames of all positions of the current page of the book, a third image frame captured before the global shooting performed by the device camera is obtained from the preset storage space, where the third image frame is an image frame captured by the device camera in the local shooting mode, as shown in fig. 8, since the third image frame is captured in the local shooting mode, an area 801 of the third image frame is smaller than an area 802 of the page of the book, and the third image frame is not affected by external natural light and has a better exposure state. Therefore, after the third image frame is obtained, image exposure parameter identification is performed on the third image frame to obtain exposure parameter information corresponding to the third image frame, and then the exposure information is applied to a fourth image frame obtained by the equipment camera in the global shooting mode to adjust the exposure of the image frame shot by the equipment camera in the global shooting mode to be consistent with the exposure of the image frame shot in the local shooting mode, so that the fourth image frame has a better exposure state, and the problem that the exposure of the image shot by the equipment camera in the global shooting mode is easily affected by ambient illumination to cause that the page information is not clear is solved.
The above embodiment obtains the image frame of the current page of the book by using the local shooting mode when the current page of the book is not the updated page by detecting whether the current page of the book is the updated page. For the camera end of the equipment, the pixel information which needs to be scanned and exposed line by line is reduced, so that the shutter time of the camera sensor is correspondingly reduced, and the technical effect of reducing the power consumption of the camera end of the equipment is realized; for the equipment information processing terminal, the image frame shot locally is smaller, the occupied capacity is also smaller, so that the image frame transmission time in the process of pushing the image from the storage space to the equipment information processing terminal is correspondingly reduced, and under the condition of smaller image, the image feature points required to be processed by the equipment information processing terminal are also fewer, so that the information processing time is reduced. Therefore, the pixel information quantity of the picture shot by the camera in the process of acquiring the image characteristic point corresponding to the current page of the book by the equipment is reduced under the condition of not changing the shooting frame rate of the camera, so that the information quantity and time required to be processed when the equipment acquires the image characteristic point corresponding to the current page of the book according to the image frame are correspondingly reduced, the response speed of the equipment is accelerated, the power consumption of the equipment in the aspects of calculation and shooting is reduced, the requirement of the equipment is reduced, and the burden of the equipment is relieved.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.
In some embodiments of the present application, please refer to fig. 9, fig. 9 is a schematic structural diagram of a page content reading device based on image features according to an embodiment of the present application, which is detailed as follows:
the page content reading device based on the image characteristics comprises: a detection module 901, a processing module 902 and an execution module 903. The detecting module 901 is configured to detect whether a current page of a book is an updated page, where the updated page is a page where the book is located after a page turning operation is performed on the book. The processing module 902 is configured to trigger the device camera to capture the current page of the book in a global capture mode to obtain an image frame when the current page of the book is an updated page, and trigger the device camera to capture the current page of the book in a local capture mode to obtain an image frame if the current page of the book is the updated page, so as to obtain page feature points corresponding to the current page of the book from the image frame. The executing module 903 is configured to search page content matched with the page feature points from a preset database according to the acquired page feature points, and perform reading operation on the page content.
The page content reading device based on the image characteristics corresponds to the page content reading method based on the image characteristics one to one.
In some embodiments of the present application, please refer to fig. 10, and fig. 10 is a schematic view of an electronic device for implementing a page content reading method based on image features according to an embodiment of the present application. As shown in fig. 10, the electronic apparatus 10 of this embodiment includes: a processor 1000, a memory 1001 and a computer program 1002 stored in said memory 1001 and executable on said processor 1000, such as a page content reading program based on image characteristics. The processor 1000, when executing the computer program 1002, implements the steps in the various image-feature-based page content reading method embodiments described above. Alternatively, the processor 1000 implements the functions of the modules/units in the above device embodiments when executing the computer program 1002.
Illustratively, the computer program 1002 may be partitioned into one or more modules/units, which are stored in the memory 1001 and executed by the processor 100 to accomplish the present application. The one or more modules/units may be a series of computer program instruction segments capable of performing specific functions, which are used to describe the execution of the computer program 1002 in the electronic device 10. For example, the computer program 1002 may be divided into:
the device comprises a detection module, a display module and a control module, wherein the detection module is used for detecting whether a current page of a book is an updated page, and the updated page is a page in which the book is located after page turning operation is executed;
the processing module is used for triggering the equipment camera to shoot the current page of the book by adopting a global shooting mode to obtain an image frame when the current page of the book is an updated page, and otherwise triggering the equipment camera to shoot the current page of the book by adopting a local shooting mode to obtain the image frame so as to obtain page feature points corresponding to the current page of the book from the image frame;
and the execution module is used for searching page contents matched with the page feature points from a preset database according to the acquired page feature points and reading the page contents.
The electronic device may include, but is not limited to, the processor 100, the memory 1001. Those skilled in the art will appreciate that fig. 10 is merely an example of an electronic device 10 and does not constitute a limitation of the electronic device 10 and may include more or fewer components than shown, or some components may be combined, or different components, e.g., the electronic device may also include input-output devices, network access devices, buses, etc.
The Processor 100 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The storage 1001 may be an internal storage unit of the electronic device 10, such as a hard disk or a memory of the electronic device 10. The memory 1001 may also be an external storage device of the electronic device 10, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, provided on the electronic device 10. Further, the memory 1001 may also include both an internal storage unit and an external storage device of the electronic device 10. The memory 1001 is used for storing the computer program and other programs and data required by the electronic device. The memory 1001 may also be used to temporarily store data that has been output or is to be output.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other ways. For example, the above-described embodiments of the apparatus/terminal device are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow in the method of the embodiments described above can be realized by a computer program, which can be stored in a computer-readable storage medium and can realize the steps of the embodiments of the methods described above when the computer program is executed by a processor. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain other components which may be suitably increased or decreased as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media which may not include electrical carrier signals and telecommunications signals in accordance with legislation and patent practice.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present application and are intended to be included within the scope of the present application.
Claims (10)
1. A page content reading method based on image characteristics is characterized by comprising the following steps:
detecting whether a current page of a book is an updated page, wherein the updated page is a page in which the book is located after page turning operation is performed, and is judged through a contact ratio threshold value or a preset time range;
when the current page of the book is an updated page, triggering an equipment camera end to shoot the current page of the book by adopting a global shooting mode to obtain an image frame, otherwise triggering an equipment camera end to shoot the current page of the book by adopting a local shooting mode to obtain the image frame so as to obtain page feature points corresponding to the current page of the book from the image frame;
and searching page contents matched with the page feature points from a preset database according to the acquired page feature points, and reading the page contents.
2. The page content reading method based on image features as claimed in claim 1, wherein the step of detecting whether a current page of the book is an updated page, wherein the updated page is a page on which a page turning operation is performed on the book, further comprises:
acquiring a first image frame and a second image frame which are pre-stored by the equipment camera, and comparing the image feature overlap ratio between the first image frame and the second image frame, wherein the first image frame is marked as an effective image frame before the book page turning operation is executed, and the second image frame is an image frame shot at the previous time before the equipment camera carries out current shooting;
comparing whether the image feature coincidence degree between the first image frame and the second image frame is smaller than a preset coincidence degree threshold value or not;
and when the image feature overlap ratio between the first image frame and the second image frame is smaller than a preset overlap ratio threshold value, determining that the current page of the book is an updated page, otherwise, determining that the current page of the book is a non-updated page.
3. The page content reading method based on image features as claimed in claim 2, wherein the detecting whether the current page of the book is an updated page, wherein in the step of determining that the current page of the book is the updated page after the page turning operation is performed on the book, the method further comprises:
acquiring the starting time of the book when page turning operation is executed;
judging whether the shooting time of the second image frame is within a preset time range according to the starting time when the page turning operation is executed on the book;
and when the shooting time of the second image frame is within the preset time range, determining and marking the current page of the book as an updated page.
4. The page content reading method based on the image features as claimed in any one of claims 1 to 3, wherein the detecting whether the current page of the book is an updated page, wherein the updating page is a page where the book is located after the page turning operation is performed on the updated page, further comprises:
presetting a storage space connected with the equipment camera shooting end, and storing image frames shot in a preset time period of the equipment camera shooting end into the storage space, wherein the image frames stored into the storage space are sequenced according to the shooting time.
5. The page content reading method based on image features as claimed in claim 4, wherein the step of triggering the device camera to shoot the current page of the book in a global shooting mode to obtain an image frame when the current page of the book is an updated page, and otherwise triggering the device camera to shoot the current page of the book in a local shooting mode to obtain an image frame, so as to obtain the page feature point corresponding to the current page of the book from the image frame, further comprises:
storing image frames obtained by shooting the current page of the book by the equipment camera into the storage space for sequencing;
and pushing the acquired image frames to an equipment information processing end in a queue mode to identify page feature points according to the sequence of the storage space, so as to acquire the page feature points corresponding to the current page of the book from the image frames.
6. The page content reading method based on image features as claimed in claim 1, wherein the image frame obtained by shooting the current page of the book by the device camera in the global shooting mode includes all positions of the current page of the book, and the image frame obtained by shooting the current page of the book by the device camera in the local shooting mode includes a preset position of the current page of the book.
7. The page content reading method based on image features as claimed in claim 1, wherein when the current page of the book is an updated page, the step of triggering the device camera to shoot the current page of the book in a global shooting mode to obtain an image frame, and otherwise, the step of triggering the device camera to shoot the current page of the book in a local shooting mode to obtain an image frame, so as to obtain a page feature point corresponding to the current page of the book from the image frame, further includes, before the step of triggering the device camera to shoot the current page of the book in the global shooting mode to obtain the image frame:
acquiring a third image frame shot by the equipment camera shooting end at the previous time in a global shooting mode, wherein the third image frame is an image frame shot by the equipment camera shooting end in a local shooting mode;
performing image exposure parameter identification on the third image frame to acquire exposure parameter information corresponding to the third image frame;
and applying the exposure information to a fourth image frame obtained by the equipment camera in the global shooting mode to adjust the exposure of the image frame obtained by the equipment camera in the global shooting mode to be consistent with the exposure of the image frame obtained by the equipment camera in the local shooting mode.
8. An image-feature-based sheet content reading apparatus, comprising:
the detection module is used for detecting whether a current page of the book is an updated page, wherein the updated page is a page in which the book is located after page turning operation is performed on the book and is judged according to a contact ratio threshold value or a preset time range;
the processing module is used for triggering the equipment camera to shoot the current page of the book by adopting a global shooting mode to obtain an image frame when the current page of the book is an updated page, and otherwise triggering the equipment camera to shoot the current page of the book by adopting a local shooting mode to obtain the image frame so as to obtain page feature points corresponding to the current page of the book from the image frame;
and the execution module is used for searching page contents matched with the page feature points from a preset database according to the acquired page feature points and reading the page contents.
9. An electronic device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor when executing the computer program implements the steps of the image feature based page content reading method according to any one of claims 1 to 7.
10. A computer-readable storage medium, in which a computer program is stored, which, when being executed by a processor, carries out the steps of the image feature-based sheet content reading method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910854813.XA CN110516660B (en) | 2019-09-10 | 2019-09-10 | Page content reading method and device based on image features |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910854813.XA CN110516660B (en) | 2019-09-10 | 2019-09-10 | Page content reading method and device based on image features |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110516660A CN110516660A (en) | 2019-11-29 |
| CN110516660B true CN110516660B (en) | 2022-03-04 |
Family
ID=68631857
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910854813.XA Active CN110516660B (en) | 2019-09-10 | 2019-09-10 | Page content reading method and device based on image features |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110516660B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112165554B (en) * | 2020-08-10 | 2022-05-31 | 北京网梯科技发展有限公司 | Method and device for automatically starting power-saving mode in point reading |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103761892A (en) * | 2014-01-20 | 2014-04-30 | 广东小天才科技有限公司 | Method and device for voice-playing of printing book contents |
| CN104023160A (en) * | 2013-02-28 | 2014-09-03 | 株式会社Pfu | Overhead scanner and image obtaining method |
| CN104281847A (en) * | 2013-07-12 | 2015-01-14 | 步步高教育电子有限公司 | Point reading method, device and equipment |
| CN105139699A (en) * | 2015-08-04 | 2015-12-09 | 广东小天才科技有限公司 | Method and device for automatically turning pages |
| CN106484286A (en) * | 2016-09-26 | 2017-03-08 | 广东小天才科技有限公司 | A kind of display packing of number of pages labelling and device, terminal unit |
| CN110060524A (en) * | 2019-04-30 | 2019-07-26 | 广东小天才科技有限公司 | The method and reading machine people that a kind of robot assisted is read |
| CN110111612A (en) * | 2019-04-11 | 2019-08-09 | 深圳市学之友科技有限公司 | A kind of photo taking type reading method, system and point read equipment |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8798366B1 (en) * | 2010-12-28 | 2014-08-05 | Amazon Technologies, Inc. | Electronic book pagination |
| TWI446225B (en) * | 2011-07-28 | 2014-07-21 | Aptos Technology Inc | Projection system and image processing method thereof |
| JP2013046376A (en) * | 2011-08-26 | 2013-03-04 | Sanyo Electric Co Ltd | Electronic camera |
| JP6549409B2 (en) * | 2015-05-13 | 2019-07-24 | オリンパス株式会社 | Imaging device, imaging method, and program |
-
2019
- 2019-09-10 CN CN201910854813.XA patent/CN110516660B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104023160A (en) * | 2013-02-28 | 2014-09-03 | 株式会社Pfu | Overhead scanner and image obtaining method |
| CN104281847A (en) * | 2013-07-12 | 2015-01-14 | 步步高教育电子有限公司 | Point reading method, device and equipment |
| CN103761892A (en) * | 2014-01-20 | 2014-04-30 | 广东小天才科技有限公司 | Method and device for voice-playing of printing book contents |
| CN105139699A (en) * | 2015-08-04 | 2015-12-09 | 广东小天才科技有限公司 | Method and device for automatically turning pages |
| CN106484286A (en) * | 2016-09-26 | 2017-03-08 | 广东小天才科技有限公司 | A kind of display packing of number of pages labelling and device, terminal unit |
| CN110111612A (en) * | 2019-04-11 | 2019-08-09 | 深圳市学之友科技有限公司 | A kind of photo taking type reading method, system and point read equipment |
| CN110060524A (en) * | 2019-04-30 | 2019-07-26 | 广东小天才科技有限公司 | The method and reading machine people that a kind of robot assisted is read |
Non-Patent Citations (2)
| Title |
|---|
| Automatic page-turning mechanism with near-field electroadhesive force for linearly correctable imaging;Junseok Lee 等;《2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)》;20171214;第279-285页 * |
| 基于云端环境的EPUB3.0电子书学习系统设计与实现;胡畔 等;《XDJYJS》;20141231;第119-126页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110516660A (en) | 2019-11-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110705405B (en) | Target labeling method and device | |
| CN109166156B (en) | Camera calibration image generation method, mobile terminal and storage medium | |
| WO2019233392A1 (en) | Image processing method and apparatus, electronic device, and computer-readable storage medium | |
| CN110493595B (en) | Camera detection method and device, storage medium and electronic device | |
| CN110796600B (en) | Image super-resolution reconstruction method, image super-resolution reconstruction device and electronic equipment | |
| CN108961183B (en) | Image processing method, terminal device and computer-readable storage medium | |
| CN111401238B (en) | Method and device for detecting character close-up fragments in video | |
| CN112017137B (en) | Image processing method, device, electronic equipment and computer readable storage medium | |
| WO2018184260A1 (en) | Correcting method and device for document image | |
| CN110677585A (en) | Target detection frame output method and device, terminal and storage medium | |
| CN111970437B (en) | Text shooting method, wearable device and storage medium | |
| CN111080665B (en) | Image frame recognition method, device, equipment and computer storage medium | |
| CN110516660B (en) | Page content reading method and device based on image features | |
| CN108289176B (en) | Photographing question searching method, question searching device and terminal equipment | |
| CN113158773B (en) | Training method and training device for living body detection model | |
| CN107992816B (en) | Photographing search method and device, electronic equipment and computer readable storage medium | |
| CN107360361B (en) | Method and device for shooting people in backlight mode | |
| US10373329B2 (en) | Information processing apparatus, information processing method and storage medium for determining an image to be subjected to a character recognition processing | |
| CN108769521B (en) | Photographing method, mobile terminal and computer readable storage medium | |
| CN110874814B (en) | Image processing method, image processing device and terminal equipment | |
| CN110610178A (en) | Image recognition method, device, terminal and computer readable storage medium | |
| CN110971820B (en) | Photographing method, photographing device, mobile terminal and computer readable storage medium | |
| CN113391779A (en) | Parameter adjusting method, device and equipment for paper-like screen | |
| CN110661969B (en) | Image acquisition method and device for display screen, electronic equipment and medium | |
| CN108769527B (en) | Scene identification method and device and terminal equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |