CN111026924A - Method for acquiring content to be searched and electronic equipment - Google Patents
Method for acquiring content to be searched and electronic equipment Download PDFInfo
- Publication number
- CN111026924A CN111026924A CN201910182469.4A CN201910182469A CN111026924A CN 111026924 A CN111026924 A CN 111026924A CN 201910182469 A CN201910182469 A CN 201910182469A CN 111026924 A CN111026924 A CN 111026924A
- Authority
- CN
- China
- Prior art keywords
- searched
- image
- content
- character
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 81
- 238000013507 mapping Methods 0.000 claims description 48
- 239000003550 marker Substances 0.000 claims description 23
- 238000004590 computer program Methods 0.000 claims description 8
- 230000002596 correlated effect Effects 0.000 claims description 2
- 230000000875 corresponding effect Effects 0.000 description 14
- 238000010586 diagram Methods 0.000 description 8
- 238000012015 optical character recognition Methods 0.000 description 3
- 238000012360 testing method Methods 0.000 description 2
- 238000013519 translation Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000036632 reaction speed Effects 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/22—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
- G06V10/225—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition based on a marking or identifier characterising the area
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/40—Document-oriented image-based pattern recognition
- G06V30/41—Analysis of document content
- G06V30/413—Classification of content, e.g. text, photographs or tables
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/40—Document-oriented image-based pattern recognition
- G06V30/41—Analysis of document content
- G06V30/418—Document matching, e.g. of document images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
Abstract
The invention relates to the technical field of electronic equipment, and discloses a method for acquiring contents to be searched and electronic equipment, wherein the method comprises the following steps: identifying the shot image to be searched to obtain character contents contained in the image to be searched, wherein the character contents contain each identified character and position information of each character; when search voice input by a user is detected, identifying a specified target position in the image to be searched; determining a region to be searched; and determining target characters of which the position information is matched with the area to be searched from the character content, and obtaining the content to be searched by sorting the target characters. By implementing the embodiment of the invention, all the characters contained in the shot contents to be searched can be identified before the user searches, so that the process that the electronic equipment identifies the same contents for multiple times is avoided, and the searching efficiency of the electronic equipment is improved.
Description
Technical Field
The invention relates to the technical field of electronic equipment, in particular to a method for acquiring contents to be searched and electronic equipment.
Background
With the rapid development of learning electronic devices such as family education machines and learning tablets, students can generally use the electronic devices to search for questions, and the electronic devices need to acquire contents which the students need to search for before searching for the questions. Currently, the method for acquiring the search content by the electronic device is generally as follows: the electronic equipment takes a picture to obtain an image containing the content to be searched, identifies all the content contained in the image, and then can select the content which needs to be searched by the user from all the content. However, in practice, it is found that when a user needs to recognize different contents in the same image for multiple times, the electronic device repeatedly recognizes the contents in the image, and further needs to select the contents to be searched on the basis of each recognition, which results in that the electronic device takes a long time to recognize the contents in the same image for multiple times, thereby reducing the searching efficiency of the electronic device.
Disclosure of Invention
The embodiment of the invention discloses a method for acquiring contents to be searched and electronic equipment, which can improve the searching efficiency of the electronic equipment.
The first aspect of the embodiments of the present invention discloses a method for acquiring a content to be searched, where the method includes:
identifying a shot image to be searched to obtain character contents contained in the image to be searched, wherein the character contents contain each identified character and position information of each character;
when search voice input by a user is detected, identifying a specified target position in the image to be searched;
determining a region to be searched in the image to be searched according to the target position;
and determining target characters of which the position information is matched with the area to be searched from the character content, and obtaining the content to be searched by sorting the target characters.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the recognizing the captured image to be searched to obtain the character content included in the image to be searched includes:
identifying a shot image to be searched to obtain image content, wherein the image content comprises characters in the image to be searched;
identifying the number of titles contained in the image content, and judging whether the number of titles is more than one;
if yes, determining the position information of each character in the image to be searched, and generating character content containing each character and the position information of each character.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, when it is determined that the number of titles is less than or equal to one, the method further includes:
determining the image content as content to be searched, and searching first answer information matched with the content to be searched;
and when a search instruction input by a user is detected, outputting the first answer information.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the identifying, when a search voice input by a user is detected, a specified target position in the image to be searched includes:
when a search voice input by a user is detected, shooting a target image containing an indicating marker image;
identifying a current location of the indicator marker image in the target image;
and establishing a mapping relation for the same area in the target image and the image to be searched, and determining that the current position corresponds to the target position in the image to be searched according to the mapping relation.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, after determining, from the character content, a target character whose position information matches the area to be searched, and obtaining the content to be searched by sorting the target character, the method further includes:
searching second answer information matched with the content to be searched;
and storing the second answer information and the content to be searched in a correlated manner, and outputting and displaying the second answer information through a display of the electronic equipment.
A second aspect of an embodiment of the present invention discloses an electronic device, including:
the first identification unit is used for identifying the shot image to be searched to obtain the character content contained in the image to be searched, wherein the character content contains each identified character and the position information of each character;
a second recognition unit, configured to recognize a specified target position in the image to be searched when a search voice input by a user is detected;
the first determining unit is used for determining a region to be searched in the image to be searched according to the target position;
and the second determining unit is used for determining target characters of which the position information is matched with the area to be searched from the character content and obtaining the content to be searched by sorting the target characters.
As an optional implementation manner, in a second aspect of the embodiment of the present invention, the first identifying unit includes:
the first identification subunit is used for identifying the shot image to be searched to obtain image content, wherein the image content comprises characters in the image to be searched;
the judging subunit is used for identifying the number of the titles contained in the image content and judging whether the number of the titles is more than one;
and the generating subunit is used for determining the position information of each character in the image to be searched and generating the character content containing each character and the position information of each character when the judgment result of the judging subunit is yes.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the electronic device further includes:
the first searching unit is used for determining the image content as the content to be searched and searching first answer information matched with the content to be searched when the judgment result of the judging subunit is negative;
and the first output unit is used for outputting the first answer information when a search instruction input by a user is detected.
As an optional implementation manner, in a second aspect of the embodiment of the present invention, the second identifying unit includes:
a photographing sub-unit for photographing a target image including an indication marker image when a search voice input by a user is detected;
a second identification subunit, configured to identify a current position of the indicator image in the target image;
and the determining subunit is used for establishing a mapping relation between the target image and the same area in the image to be searched, and determining that the current position corresponds to the target position in the image to be searched according to the mapping relation.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the electronic device further includes:
the second searching unit is used for searching second answer information matched with the content to be searched after the second determining unit determines target characters of which the position information is matched with the area to be searched from the character content and obtains the content to be searched by sorting the target characters;
and the second output unit is used for storing the second answer information and the content to be searched in a correlation manner and outputting and displaying the second answer information through a display of the electronic equipment.
A third aspect of the embodiments of the present invention discloses another electronic device, including:
a memory storing executable program code;
a processor coupled with the memory;
the processor calls the executable program code stored in the memory to perform part or all of the steps of any one of the methods of the first aspect.
A fourth aspect of the present embodiments discloses a computer-readable storage medium storing a program code, where the program code includes instructions for performing part or all of the steps of any one of the methods of the first aspect.
A fifth aspect of embodiments of the present invention discloses a computer program product, which, when run on a computer, causes the computer to perform some or all of the steps of any one of the methods of the first aspect.
A sixth aspect of the present embodiment discloses an application publishing platform, where the application publishing platform is configured to publish a computer program product, where the computer program product is configured to, when running on a computer, cause the computer to perform part or all of the steps of any one of the methods in the first aspect.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
in the embodiment of the invention, the shot image to be searched is identified to obtain the character content contained in the image to be searched, wherein the character content contains each identified character and the position information of each character; when search voice input by a user is detected, identifying a specified target position in the image to be searched; determining a region to be searched in the image to be searched according to the target position; and determining target characters of which the position information is matched with the area to be searched from the character content, and obtaining the content to be searched by sorting the target characters. Therefore, by implementing the embodiment of the invention, all characters contained in the shot contents to be searched can be identified before the user searches, so that when the user needs to search any contents in the image to be searched, the contents to be searched specified by the user can be directly selected from the identified characters, the process that the electronic equipment identifies the same contents for multiple times is avoided, and the searching efficiency of the electronic equipment is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic flow chart of a method for acquiring content to be searched according to an embodiment of the present invention;
fig. 2 is a schematic flow chart of another method for acquiring content to be searched according to the embodiment of the present invention;
fig. 3 is a schematic flow chart of another method for acquiring content to be searched according to the embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure;
FIG. 5 is a schematic structural diagram of another electronic device disclosed in the embodiments of the present invention;
FIG. 6 is a schematic structural diagram of another electronic device disclosed in the embodiments of the present invention;
fig. 7 is a schematic structural diagram of another electronic device disclosed in the embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It is to be noted that the terms "comprises" and "comprising" and any variations thereof in the embodiments and drawings of the present invention are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
The embodiment of the invention discloses a method for acquiring contents to be searched and electronic equipment, which can avoid the process that the electronic equipment identifies the same contents for multiple times, thereby improving the searching efficiency of the electronic equipment. The following are detailed below.
Example one
Referring to fig. 1, fig. 1 is a schematic flow chart illustrating a method for acquiring content to be searched according to an embodiment of the present invention. As shown in fig. 1, the method for acquiring content to be searched may include the following steps:
101. the electronic equipment identifies the shot image to be searched to obtain the character content contained in the image to be searched, wherein the character content contains each identified character and the position information of each character.
In the embodiment of the present invention, the electronic device may be a family education machine, a learning tablet, a notebook computer, a desktop computer, and the like, which is not limited in the embodiment of the present invention. The electronic device can shoot an image to be searched through an image acquisition device arranged on the electronic device, wherein the image acquisition device can be a camera, a camera and other devices.
In the embodiment of the invention, the image to be searched can be a shot book image, a test paper image and the like, so that the image to be searched can contain a plurality of characters, the electronic equipment can identify the position of each character in the image, the electronic equipment can establish a rectangular plane coordinate system by taking the image to be searched as a basis, the coordinate of the center position of the character can be determined as the position information of the character in the image to be searched, and when the electronic equipment identifies the character contained in the image to be searched, the electronic equipment can identify the coordinate of the character in the image to be searched together and mark the character by taking the coordinate of the character as the position information of the character. The electronic equipment can also divide the recognized characters, can divide the characters contained in the same topic or the same segment of characters into the same content area, and then the electronic equipment can determine the corresponding area of the same content area in the image to be searched according to the coordinates of the characters in the same content area.
102. When a search voice input by a user is detected, the electronic device recognizes a specified target position in an image to be searched.
In the embodiment of the invention, the electronic equipment can collect the sound in the environment where the electronic equipment is located through the microphone arranged on the electronic equipment, and extract the voice in the collected sound to obtain the user voice, so that the electronic equipment can determine the extracted user voice as the search voice input by the user.
In the embodiment of the invention, the specified target position in the image to be searched can be a position indicated by a user on a plane such as a test paper, a book and the like through a finger, a real object pen or a laser pen, the electronic equipment identifies the indicated position through image acquisition equipment, determines a target position corresponding to the indicated position in the image to be searched, and further determines the content to be searched according to the target position determined in the image to be searched.
103. And the electronic equipment determines a region to be searched in the image to be searched according to the target position.
In the embodiment of the invention, the electronic equipment can determine the coordinate information corresponding to the target position in the image to be searched, detect the content area where the coordinate information is located, further determine the determined content area as the area to be searched, and further integrate the characters contained in the content area to generate the content to be searched.
As an alternative implementation, the manner in which the electronic device determines the area to be searched in the image to be searched according to the target position may include the following steps:
the electronic equipment analyzes the search voice to obtain the type of the content to be searched;
the electronic equipment calculates a search box matched with the type of the content to be searched according to a preset frame selection algorithm;
the electronic equipment determines the position of the search box in the image to be searched according to the target position;
and the electronic equipment determines a search area in the image to be searched according to the position of the search box in the image to be searched.
By implementing the implementation mode, the type of the content to be searched (such as a search word meaning type, a search sentence translation type or a search subject type) can be determined according to the search voice input by the user, the search frame corresponding to the type of the content to be searched can be determined according to a preset frame selection algorithm, the preset frame selection algorithm can generate the search frames with different sizes and shapes according to the difference of the number of characters possibly contained in the type of the content to be searched, the position of the search frame in the image to be searched is determined by combining the acquired target position specified by the user, and then the region contained in the search frame is determined as the region to be searched in the image to be searched, so that the accuracy of the content to be searched contained in the region to be searched is improved.
104. The electronic equipment determines the target characters of which the position information is matched with the area to be searched from the character content, and obtains the content to be searched by sorting the target characters.
In the embodiment of the invention, the electronic equipment can determine the characters of the position information in the area to be searched as the target characters, can identify the position relation among all the target characters, and can further sequence all the target characters, so that the content to be searched is obtained according to the sequenced target characters.
In the method described in fig. 1, the process of recognizing the same content by the electronic device multiple times can be avoided, thereby improving the searching efficiency of the electronic device. In addition, the method described in fig. 1 is implemented to improve the accuracy of the content to be searched contained in the area to be searched.
Example two
Referring to fig. 2, fig. 2 is a schematic flow chart illustrating another method for acquiring content to be searched according to an embodiment of the present invention. As shown in fig. 2, the method for acquiring content to be searched may include the following steps:
201. the electronic equipment identifies the shot image to be searched to obtain image content, wherein the image content comprises characters in the image to be searched.
In the embodiment of the invention, the electronic device can recognize the characters contained in the image to be searched by an Optical Character Recognition (OCR) technology, and the accuracy of character recognition can be improved by the OCR technology, so that the image content containing all the characters in the image to be searched is obtained.
202. The electronic equipment identifies the number of the titles contained in the image content, judges whether the number of the titles is more than one, and if so, executes step 203; if not, step 204 to step 205 are executed.
In the embodiment of the invention, the electronic equipment can identify the number of the topics possibly existing in the image to be searched, the identification mode can be that the electronic equipment detects whether a number exists in the image to be searched, and if so, the electronic equipment can determine the number of the topics contained in the image content according to the number. If the image to be searched only contains one question, the electronic equipment does not need to record the position information of the character of the question, because the user can default the content to be searched by the user as the question if the user needs to search the content in the image to be searched, the step of identifying the position information of the character by the electronic equipment can be simplified under the condition that the image to be searched only contains one question, and the searching efficiency of the electronic equipment is improved.
203. The electronic device determines the position information of each character in the image to be searched, generates character content containing each character and the position information of each character, and performs steps 206 to 208.
In the embodiment of the present invention, by implementing the above steps 201 to 203, the number of titles included in the image to be searched can be identified, and if the number of titles included in the image to be searched is greater than one, the position information of each character in the image to be searched can be marked, so that it is ensured that the character in each title can determine a specific position in the image to be searched.
204. The electronic equipment determines the image content as the content to be searched, and searches first answer information matched with the content to be searched.
205. When a search instruction input by a user is detected, the electronic equipment outputs first answer information.
In the embodiment of the invention, the electronic equipment can search the identified topic in advance under the condition that the image to be searched only contains one topic, determine the first answer information corresponding to the topic, store the content to be searched and the first answer information in a correlation manner, and directly output the first answer information when the electronic equipment detects that the user needs to search the answer of the topic, thereby improving the reaction speed of the electronic equipment.
In the embodiment of the present invention, by implementing the above steps 204 to 205, when it is detected that the image to be searched only contains one topic, the topic may be directly searched, and if the user needs to search the content in the image to be searched, the content to be searched identified from the image to be searched may be regarded as the topic, so that the electronic device may search the topic when it is detected that the image to be searched only contains one topic, obtain a corresponding answer, and directly output and display the answer when a search instruction input by the user is detected, thereby increasing the speed of outputting the answer by the electronic device.
206. When a search voice input by a user is detected, the electronic device recognizes a specified target position in an image to be searched.
207. And the electronic equipment determines a region to be searched in the image to be searched according to the target position.
208. The electronic equipment determines the target characters of which the position information is matched with the area to be searched from the character content, and obtains the content to be searched by sorting the target characters.
In the method described in fig. 2, the process of recognizing the same content by the electronic device multiple times can be avoided, thereby improving the searching efficiency of the electronic device. In addition, the method described in fig. 2 can ensure that the characters in each title can be located at specific positions in the image to be searched. In addition, the method described in fig. 2 is implemented to improve the speed of outputting answers by the electronic device.
EXAMPLE III
Referring to fig. 3, fig. 3 is a schematic flow chart of another method for acquiring content to be searched according to an embodiment of the present invention. As shown in fig. 3, the method for acquiring content to be searched may include the following steps:
301. the electronic equipment identifies the shot image to be searched to obtain image content, wherein the image content comprises characters in the image to be searched.
302. The electronic equipment identifies the number of the titles contained in the image content, judges whether the number of the titles is more than one, and if so, executes step 303; if not, step 304-step 305 are executed.
303. The electronic device determines position information of each character in the image to be searched, generates character content including each character and the position information of each character, and performs steps 306 to 312.
304. The electronic equipment determines the image content as the content to be searched, and searches first answer information matched with the content to be searched.
305. When a search instruction input by a user is detected, the electronic equipment outputs first answer information.
306. When a search voice input by a user is detected, the electronic device captures a target image containing an image of an indicating marker.
In the embodiment of the present invention, the indication marker may be an object used by the user to indicate the content to be searched, such as a finger of the user, a physical pen, a laser pen, and the like, and the indication marker image may be an image of the indication marker. When detecting that the user inputs the search voice, the electronic device may first recognize the position of the indication marker within the shooting range by using an image recognition technology, and shoot according to the position of the indication marker, thereby obtaining a target image including an image of the indication marker.
307. The electronic device identifies a current location of the indicator marker image in the target image.
In the embodiment of the present invention, the electronic device may also establish a rectangular plane coordinate system based on the target image, determine coordinate information of the indicating marker image in the target image, and use the coordinate information as the current position of the indicating marker image.
308. The electronic equipment establishes a mapping relation for the same area in the target image and the image to be searched, and determines that the current position corresponds to the target position in the image to be searched according to the mapping relation.
In the embodiment of the invention, the electronic equipment can compare the target image with the image to be searched to obtain the same region in the target image and the image to be searched, and establish the mapping relation between the planar rectangular coordinate system of the target image and the planar rectangular coordinate system of the image to be searched according to the same region, so as to obtain the target position in the image to be searched corresponding to the current position in the target image according to the determined mapping relation.
As an optional implementation manner, the method for establishing, by the electronic device, a mapping relationship between the target image and the same region in the image to be searched, and determining, according to the mapping relationship, that the current position corresponds to the target position in the image to be searched may include the following steps:
the electronic equipment selects a plurality of target areas in the target image, wherein the target areas can be areas within a preset distance from the current position of the target image;
the electronic equipment compares the current area with any one target area in the image to be searched to obtain the current area which is the same as the target area;
the electronic equipment establishes a first mapping relation between each pixel in the target area and each pixel in the current area;
the electronic equipment determines a second mapping relation between a region except the target region in the target image and a region except the current region in the image to be searched according to a first mapping relation established between the target region and the current region;
the electronic equipment integrates the first mapping relation and the second mapping relation to generate a mapping relation between a target image containing the first mapping relation and the second mapping relation and an image to be searched;
and the electronic equipment determines that the current position in the target image corresponds to the target position in the image to be searched according to the mapping relation.
By implementing the implementation mode, the first mapping relation between a certain partial area in the target image and the same partial area in the image to be searched can be determined, and then the mapping relation between the target image and the image to be searched can be determined according to the first mapping relation, so that the situation that the electronic equipment uses all the target images to compare with all the images to be searched is avoided, and the speed of the electronic equipment for establishing the mapping relation between the target image and the image to be searched is improved.
In the embodiment of the present invention, by implementing the above steps 306 to 308, the indication marker image indicating the content to be searched by the user in the target image can be detected, and the indication position of the indication marker image in the image to be searched is determined by establishing the mapping relationship between the target image and the image to be searched and the position of the indication marker image in the target image, so that the electronic device can determine the position in the image to be searched indicated by the user according to the current indication information of the user, and the accuracy of determining the user indication position in the image to be searched is improved.
309. And the electronic equipment determines a region to be searched in the image to be searched according to the target position.
310. The electronic equipment determines the target characters of which the position information is matched with the area to be searched from the character content, and obtains the content to be searched by sorting the target characters.
311. The electronic equipment searches second answer information matched with the content to be searched.
As an alternative implementation, the manner of searching for the second answer information matching the content to be searched by the electronic device may include the following steps:
the electronic equipment searches whether target historical search content matched with the content to be searched exists in the prestored historical search content;
if the answer information exists, the electronic equipment acquires pre-stored target answer information associated with target historical search content, and determines the answer information as second answer information matched with the content to be searched;
and if not, the electronic equipment searches second answer information matched with the content to be searched through the Internet.
By implementing the implementation mode, the target historical search content matched with the content to be searched can be searched in the pre-stored historical search content before searching the answers, if the target historical search content exists, the answer matched with the target historical search content and stored in the electronic equipment can be determined as the second answer information matched with the content to be searched, the process that the electronic equipment searches the same content is avoided, and the searching efficiency of the electronic equipment is improved.
312. And the electronic equipment stores the second answer information in association with the content to be searched, and outputs and displays the second answer information through a display of the electronic equipment.
In the embodiment of the present invention, by implementing the steps 311 to 312, the answer corresponding to the content to be searched can be searched, and the answer can be output and displayed, and in addition, the answer and the content to be searched can also be stored, so that when the electronic device searches the content searched in the past again, the answer corresponding to the content to be searched can be directly output, and the process of searching the electronic device is simplified.
In the method described in fig. 3, the process of recognizing the same content by the electronic device multiple times can be avoided, thereby improving the searching efficiency of the electronic device. In addition, the implementation of the method described in fig. 3 increases the speed of the electronic device in establishing the mapping relationship between the target image and the image to be searched. In addition, the method described in fig. 3 is implemented, and the accuracy of determining the user indication position in the image to be searched is improved. In addition, the method described in fig. 3 is implemented, so that the process that the electronic device searches for the same content is avoided, and the efficiency of searching for the electronic device is improved. In addition, the method described in fig. 3 is implemented, and the process of searching the electronic device is simplified.
Example four
Referring to fig. 4, fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure. As shown in fig. 4, the electronic device may include:
a first identifying unit 401, configured to identify the captured image to be searched, so as to obtain character contents included in the image to be searched, where the character contents include each identified character and position information of each character.
A second recognition unit 402 for recognizing a specified target position in the image to be searched when a search voice input by the user is detected.
A first determining unit 403, configured to determine, according to the target position identified by the second identifying unit 402, a region to be searched in the image to be searched obtained by the first identifying unit 401.
As an optional implementation manner, the manner of determining the area to be searched in the image to be searched according to the target position by the first determining unit 403 may specifically be:
analyzing the search voice to obtain the type of the content to be searched;
calculating according to a preset frame selection algorithm to obtain a search frame matched with the type of the content to be searched;
determining the position of the search box in the image to be searched according to the target position;
and determining a search area in the image to be searched according to the position of the search box in the image to be searched.
By implementing the implementation mode, the type of the content to be searched (such as a search word meaning type, a search sentence translation type or a search subject type) can be determined according to the search voice input by the user, the search frame corresponding to the type of the content to be searched can be determined according to a preset frame selection algorithm, the preset frame selection algorithm can generate the search frames with different sizes and shapes according to the difference of the number of characters possibly contained in the type of the content to be searched, the position of the search frame in the image to be searched is determined by combining the acquired target position specified by the user, and then the region contained in the search frame is determined as the region to be searched in the image to be searched, so that the accuracy of the content to be searched contained in the region to be searched is improved.
A second determining unit 404, configured to determine, from the character content obtained by the first identifying unit 401, a target character whose position information matches the region to be searched determined by the first determining unit 403, and obtain the content to be searched by sorting the target character.
Therefore, the electronic device described in fig. 4 can avoid the process of recognizing the same content multiple times by the electronic device, thereby improving the search efficiency of the electronic device. In addition, the electronic device described in fig. 4 is implemented to improve the accuracy of the content to be searched contained in the area to be searched.
EXAMPLE five
Referring to fig. 5, fig. 5 is a schematic structural diagram of another electronic device according to an embodiment of the disclosure. The electronic device shown in fig. 5 is optimized from the electronic device shown in fig. 4. The first recognition unit 401 of the electronic device shown in fig. 5 may include:
the first identifying sub-unit 4011 is configured to identify the captured image to be searched, so as to obtain image content, where the image content includes characters in the image to be searched.
The judging sub-unit 4012 is configured to identify the number of titles included in the image content obtained by the first identifying sub-unit 4011, and judge whether the number of titles is greater than one.
A generating sub-unit 4013 configured to, when a result of the judgment by the judging sub-unit 4012 is yes, determine position information of each character in the image to be searched, and generate character content including each character and the position information of each character.
In the embodiment of the invention, the number of the titles contained in the image to be searched can be identified, and if the number of the titles contained in the image to be searched is more than one, the position information of each character in the image to be searched can be marked, so that the character in each title can be ensured to determine the specific position in the image to be searched.
As an alternative implementation, the electronic device shown in fig. 5 may further include:
a first search unit 405, configured to, when the result of the judgment by the judgment sub-unit 4012 is no, determine the image content as the content to be searched, and search for first answer information that matches the content to be searched.
A first output unit 406, configured to output the first answer information obtained by the first search unit 405 when a search instruction input by the user is detected.
When the implementation mode is implemented, when it is detected that the image to be searched only contains one topic, the topic can be directly searched, if the user needs to search the content in the image to be searched, the content to be searched identified from the image to be searched can be regarded as the topic, so that the electronic device can search the topic when detecting that the image to be searched only contains one topic to obtain a corresponding answer, and the answer can be directly output and displayed when detecting a search instruction input by the user, thereby improving the speed of outputting the answer by the electronic device.
Therefore, the electronic device described in fig. 5 can avoid the process of recognizing the same content multiple times by the electronic device, thereby improving the search efficiency of the electronic device. In addition, the electronic device described in fig. 5 can ensure that the characters in each title can be located at specific positions in the image to be searched. In addition, the electronic device described in fig. 5 is implemented to increase the speed of outputting answers by the electronic device.
EXAMPLE six
Referring to fig. 6, fig. 6 is a schematic structural diagram of another electronic device according to an embodiment of the disclosure. The electronic device shown in fig. 6 is optimized from the electronic device shown in fig. 5. The second recognition unit 402 of the electronic device shown in fig. 6 may include:
a photographing sub-unit 4021 for photographing a target image including an indicating marker image when a search voice input by a user is detected.
A second identifying subunit 4022 configured to identify a current position of the indicator image in the target image captured by the capturing subunit 4021.
The determining subunit 4023 is configured to establish a mapping relationship between the target image captured by the capturing subunit 4021 and the same area in the image to be searched, and determine, according to the mapping relationship, that the current position identified by the second identifying subunit 4022 corresponds to the target position in the image to be searched.
In the embodiment of the invention, the indication marker image indicating the content to be searched by the user in the target image can be detected, and the indication position of the indication marker image in the image to be searched is determined by establishing the mapping relation between the target image and the image to be searched and the position of the indication marker image in the target image, so that the electronic equipment can determine the position in the image to be searched indicated by the user according to the current indication information of the user, and the accuracy of determining the indication position of the user in the image to be searched is improved.
As an optional implementation manner, the manner in which the determining subunit 4023 establishes a mapping relationship between the target image and the same region in the image to be searched, and determines, according to the mapping relationship, that the current position corresponds to the target position in the image to be searched may specifically be:
selecting a plurality of target areas in the target image, wherein the target areas can be areas within a preset distance from the current position of the target image;
comparing the image to be searched to obtain a current area which is the same as any one target area;
establishing a first mapping relation between each pixel in the target area and each pixel in the current area;
determining a second mapping relation between a region except the target region in the target image and a region except the current region in the image to be searched according to a first mapping relation established between the target region and the current region;
synthesizing the first mapping relation and the second mapping relation to generate a mapping relation between a target image containing the first mapping relation and the second mapping relation and an image to be searched;
and determining that the current position in the target image corresponds to the target position in the image to be searched according to the mapping relation.
By implementing the implementation mode, the first mapping relation between a certain partial area in the target image and the same partial area in the image to be searched can be determined, and then the mapping relation between the target image and the image to be searched can be determined according to the first mapping relation, so that the situation that the electronic equipment uses all the target images to compare with all the images to be searched is avoided, and the speed of the electronic equipment for establishing the mapping relation between the target image and the image to be searched is improved.
As an alternative implementation, the electronic device shown in fig. 6 may further include:
a second searching unit 407, configured to search second answer information that matches the content to be searched after the second determining unit 404 determines, from the character content, a target character whose position information matches the region to be searched and obtains the content to be searched by sorting the target character;
and a second output unit 408, configured to store the second answer information searched by the second searching unit 407 in association with the content to be searched, and output and display the second answer information through a display of the electronic device.
By implementing the implementation mode, the answer corresponding to the content to be searched can be searched, the answer is output and displayed, and in addition, the answer and the content to be searched can be stored, so that the answer corresponding to the content to be searched can be directly output when the electronic equipment searches the content searched in the past again, and the searching process of the electronic equipment is simplified.
As an optional implementation manner, the manner of searching for the second answer information matching the content to be searched by the second searching unit 407 may specifically be:
searching whether target historical search content matched with the content to be searched exists in the prestored historical search content;
if yes, obtaining pre-stored target answer information associated with the target historical search content, and determining the answer information as second answer information matched with the content to be searched;
and if not, searching second answer information matched with the content to be searched through the Internet.
By implementing the implementation mode, the target historical search content matched with the content to be searched can be searched in the pre-stored historical search content before searching the answers, if the target historical search content exists, the answer matched with the target historical search content and stored in the electronic equipment can be determined as the second answer information matched with the content to be searched, the process that the electronic equipment searches the same content is avoided, and the searching efficiency of the electronic equipment is improved.
Therefore, the electronic device described in fig. 6 can avoid the process of recognizing the same content multiple times by the electronic device, thereby improving the search efficiency of the electronic device. In addition, the electronic device described in fig. 6 is implemented, so that the speed of the electronic device for establishing the mapping relationship between the target image and the image to be searched is increased. In addition, the electronic equipment described in fig. 6 is implemented, so that the accuracy of determining the user indication position in the image to be searched is improved. In addition, the electronic device described in fig. 6 is implemented, so that the process that the electronic device searches for the same content is avoided, and the efficiency of searching for the electronic device is improved. In addition, the electronic device described in fig. 6 is implemented, and the process of searching for the electronic device is simplified.
EXAMPLE seven
Referring to fig. 7, fig. 7 is a schematic structural diagram of another electronic device according to an embodiment of the disclosure. As shown in fig. 7, the electronic device may include:
a memory 701 in which executable program code is stored;
a processor 702 coupled to the memory 701;
wherein, the processor 702 calls the executable program code stored in the memory 701 to execute part or all of the steps of the method in the above method embodiments.
The embodiment of the invention also discloses a computer readable storage medium, wherein the computer readable storage medium stores program codes, wherein the program codes comprise instructions for executing part or all of the steps of the method in the above method embodiments.
Embodiments of the present invention also disclose a computer program product, wherein, when the computer program product is run on a computer, the computer is caused to execute part or all of the steps of the method as in the above method embodiments.
The embodiment of the present invention also discloses an application publishing platform, wherein the application publishing platform is used for publishing a computer program product, and when the computer program product runs on a computer, the computer is caused to execute part or all of the steps of the method in the above method embodiments.
It should be appreciated that reference throughout this specification to "an embodiment of the present invention" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, the appearances of the phrase "in embodiments of the invention" appearing in various places throughout the specification are not necessarily all referring to the same embodiments. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. Those skilled in the art should also appreciate that the embodiments described in this specification are exemplary and alternative embodiments, and that the acts and modules illustrated are not required in order to practice the invention.
In various embodiments of the present invention, it should be understood that the sequence numbers of the above-mentioned processes do not imply an inevitable order of execution, and the execution order of the processes should be determined by their functions and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.
In addition, the terms "system" and "network" are often used interchangeably herein. It should be understood that the term "and/or" herein is merely one type of association relationship describing an associated object, meaning that three relationships may exist, for example, a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
In the embodiments provided herein, it should be understood that "B corresponding to a" means that B is associated with a from which B can be determined. It should also be understood, however, that determining B from a does not mean determining B from a alone, but may also be determined from a and/or other information.
It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by instructions associated with a program, which may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), compact disc-Read-Only Memory (CD-ROM), or other Memory, magnetic disk, magnetic tape, or magnetic tape, Or any other medium which can be used to carry or store data and which can be read by a computer.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated units, if implemented as software functional units and sold or used as a stand-alone product, may be stored in a computer accessible memory. Based on such understanding, the technical solution of the present invention, which is a part of or contributes to the prior art in essence, or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a memory and includes several requests for causing a computer device (which may be a personal computer, a server, a network device, or the like, and may specifically be a processor in the computer device) to execute part or all of the steps of the above-described method of each embodiment of the present invention.
The above detailed description is provided for the method for acquiring content to be searched and the electronic device, and a specific example is applied in the detailed description to explain the principle and the implementation of the present invention, and the description of the above embodiment is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (12)
1. A method for acquiring contents to be searched is characterized by comprising the following steps:
identifying a shot image to be searched to obtain character contents contained in the image to be searched, wherein the character contents contain each identified character and position information of each character;
when search voice input by a user is detected, identifying a specified target position in the image to be searched;
determining a region to be searched in the image to be searched according to the target position;
and determining target characters of which the position information is matched with the area to be searched from the character content, and obtaining the content to be searched by sorting the target characters.
2. The method according to claim 1, wherein the recognizing the shot image to be searched for to obtain the character content contained in the image to be searched for comprises:
identifying a shot image to be searched to obtain image content, wherein the image content comprises characters in the image to be searched;
identifying the number of titles contained in the image content, and judging whether the number of titles is more than one;
if yes, determining the position information of each character in the image to be searched, and generating character content containing each character and the position information of each character.
3. The method according to claim 2, wherein when it is determined that the number of titles is less than or equal to one, the method further comprises:
determining the image content as content to be searched, and searching first answer information matched with the content to be searched;
and when a search instruction input by a user is detected, outputting the first answer information.
4. The method according to claim 2 or 3, wherein the identifying the designated target position in the image to be searched when the search voice input by the user is detected comprises:
when a search voice input by a user is detected, shooting a target image containing an indicating marker image;
identifying a current location of the indicator marker image in the target image;
and establishing a mapping relation for the same area in the target image and the image to be searched, and determining that the current position corresponds to the target position in the image to be searched according to the mapping relation.
5. The method according to any one of claims 1 to 4, wherein after determining target characters of which position information is matched with the area to be searched from the character content and obtaining the content to be searched by sorting the target characters, the method further comprises:
searching second answer information matched with the content to be searched;
and storing the second answer information and the content to be searched in a correlated manner, and outputting and displaying the second answer information through a display of the electronic equipment.
6. An electronic device, comprising:
the first identification unit is used for identifying the shot image to be searched to obtain the character content contained in the image to be searched, wherein the character content contains each identified character and the position information of each character;
a second recognition unit, configured to recognize a specified target position in the image to be searched when a search voice input by a user is detected;
the first determining unit is used for determining a region to be searched in the image to be searched according to the target position;
and the second determining unit is used for determining target characters of which the position information is matched with the area to be searched from the character content and obtaining the content to be searched by sorting the target characters.
7. The electronic device according to claim 6, wherein the first identification unit includes:
the first identification subunit is used for identifying the shot image to be searched to obtain image content, wherein the image content comprises characters in the image to be searched;
the judging subunit is used for identifying the number of the titles contained in the image content and judging whether the number of the titles is more than one;
and the generating subunit is used for determining the position information of each character in the image to be searched and generating the character content containing each character and the position information of each character when the judgment result of the judging subunit is yes.
8. The electronic device of claim 7, further comprising:
the first searching unit is used for determining the image content as the content to be searched and searching first answer information matched with the content to be searched when the judgment result of the judging subunit is negative;
and the first output unit is used for outputting the first answer information when a search instruction input by a user is detected.
9. The electronic device according to claim 7 or 8, wherein the second recognition unit includes:
a photographing sub-unit for photographing a target image including an indication marker image when a search voice input by a user is detected;
a second identification subunit, configured to identify a current position of the indicator image in the target image;
and the determining subunit is used for establishing a mapping relation between the target image and the same area in the image to be searched, and determining that the current position corresponds to the target position in the image to be searched according to the mapping relation.
10. The electronic device according to any one of claims 6 to 9, further comprising:
the second searching unit is used for searching second answer information matched with the content to be searched after the second determining unit determines target characters of which the position information is matched with the area to be searched from the character content and obtains the content to be searched by sorting the target characters;
and the second output unit is used for storing the second answer information and the content to be searched in a correlation manner and outputting and displaying the second answer information through a display of the electronic equipment.
11. An electronic device, comprising:
a memory storing executable program code;
a processor coupled with the memory;
the processor calls the executable program code stored in the memory to execute the acquisition method of the content to be searched according to any one of claims 1 to 5.
12. A computer-readable storage medium characterized by storing a computer program that causes a computer to execute the acquisition method of a content to be searched for according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910182469.4A CN111026924A (en) | 2019-03-11 | 2019-03-11 | Method for acquiring content to be searched and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910182469.4A CN111026924A (en) | 2019-03-11 | 2019-03-11 | Method for acquiring content to be searched and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111026924A true CN111026924A (en) | 2020-04-17 |
Family
ID=70203550
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910182469.4A Pending CN111026924A (en) | 2019-03-11 | 2019-03-11 | Method for acquiring content to be searched and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111026924A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111581367A (en) * | 2020-05-11 | 2020-08-25 | 广东小天才科技有限公司 | Method and system for inputting questions |
| CN112632317A (en) * | 2021-01-13 | 2021-04-09 | 深圳市万物志科技有限公司 | Multi-target interaction method and device based on user pictures |
| CN113205091A (en) * | 2021-04-30 | 2021-08-03 | 作业帮教育科技（北京）有限公司 | Question identification method, device, equipment and medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080144062A1 (en) * | 2006-12-13 | 2008-06-19 | Canon Kabushiki Kaisha | Document processing method and document processing apparatus |
| CN103324924A (en) * | 2012-03-19 | 2013-09-25 | 宇龙计算机通信科技(深圳)有限公司 | Method and device for character positioning and terminal |
| CN106372216A (en) * | 2016-09-05 | 2017-02-01 | 广东小天才科技有限公司 | Method and device for improving subject finding accuracy |
| CN107885449A (en) * | 2017-11-09 | 2018-04-06 | 广东小天才科技有限公司 | One kind is taken pictures searching method, device, terminal device and storage medium |
| CN108133209A (en) * | 2016-12-01 | 2018-06-08 | 北京新唐思创教育科技有限公司 | Target area searching method and its device in a kind of text identification |
| CN109409234A (en) * | 2018-09-27 | 2019-03-01 | 广东小天才科技有限公司 | A kind of method and system for assisting student to carry out positioning problems study |
-
2019
- 2019-03-11 CN CN201910182469.4A patent/CN111026924A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080144062A1 (en) * | 2006-12-13 | 2008-06-19 | Canon Kabushiki Kaisha | Document processing method and document processing apparatus |
| CN103324924A (en) * | 2012-03-19 | 2013-09-25 | 宇龙计算机通信科技(深圳)有限公司 | Method and device for character positioning and terminal |
| CN106372216A (en) * | 2016-09-05 | 2017-02-01 | 广东小天才科技有限公司 | Method and device for improving subject finding accuracy |
| CN108133209A (en) * | 2016-12-01 | 2018-06-08 | 北京新唐思创教育科技有限公司 | Target area searching method and its device in a kind of text identification |
| CN107885449A (en) * | 2017-11-09 | 2018-04-06 | 广东小天才科技有限公司 | One kind is taken pictures searching method, device, terminal device and storage medium |
| CN109409234A (en) * | 2018-09-27 | 2019-03-01 | 广东小天才科技有限公司 | A kind of method and system for assisting student to carry out positioning problems study |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111581367A (en) * | 2020-05-11 | 2020-08-25 | 广东小天才科技有限公司 | Method and system for inputting questions |
| CN112632317A (en) * | 2021-01-13 | 2021-04-09 | 深圳市万物志科技有限公司 | Multi-target interaction method and device based on user pictures |
| CN113205091A (en) * | 2021-04-30 | 2021-08-03 | 作业帮教育科技（北京）有限公司 | Question identification method, device, equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109817046B (en) | Learning auxiliary method based on family education equipment and family education equipment | |
| CN109635772B (en) | Dictation content correcting method and electronic equipment | |
| CN111078083A (en) | Method for determining click-to-read content and electronic equipment | |
| CN111026949A (en) | Question searching method and system based on electronic equipment | |
| CN109766412B (en) | Learning content acquisition method based on image recognition and electronic equipment | |
| CN109597943B (en) | Learning content recommendation method based on scene and learning equipment | |
| CN111026924A (en) | Method for acquiring content to be searched and electronic equipment | |
| CN111027537A (en) | Question searching method and electronic equipment | |
| CN109410984B (en) | Reading scoring method and electronic equipment | |
| CN111079494A (en) | Learning content pushing method and electronic equipment | |
| CN109614552A (en) | A kind of guiding searching method and guiding search system | |
| CN109086431B (en) | Knowledge point consolidation learning method and electronic equipment | |
| CN111652145A (en) | Formula detection method and device, electronic equipment and storage medium | |
| CN111026786B (en) | Dictation list generation method and home education equipment | |
| CN110991357A (en) | Answer matching method and device and electronic equipment | |
| CN111027353A (en) | Search content extraction method and electronic equipment | |
| CN110084187B (en) | Position identification method, device, equipment and storage medium based on computer vision | |
| CN111753168A (en) | Method and device for searching questions, electronic equipment and storage medium | |
| CN111077997A (en) | Point reading control method in point reading mode and electronic equipment | |
| CN111079501A (en) | Character recognition method and electronic equipment | |
| CN111079777A (en) | Page positioning-based point reading method and electronic equipment | |
| CN111091034A (en) | Multi-finger recognition-based question searching method and family education equipment | |
| CN111090989B (en) | Prompting method based on character recognition and electronic equipment | |
| CN111079487A (en) | Method for acquiring dictation content and electronic equipment | |
| CN111091008A (en) | Method for determining dictation prompt content and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200417 |
|
| RJ01 | Rejection of invention patent application after publication |